--- I0313 12:56:01.774836 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0313 12:56:01.775651 13 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0313 12:56:01.775695 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0313 12:56:01.775921 13 controller.go:128] Shutting down kubernetes service endpoint reconciler I0313 12:56:01.788436 13 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0313 12:56:01.788482 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0313 12:56:01.791820 13 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0313 12:56:01.810824 13 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0313 12:56:01.810872 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0313 12:56:01.811102 13 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0313 12:56:01.811171 13 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0313 12:56:01.811199 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0313 12:56:01.843168 13 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0313 12:56:01.843276 13 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0313 12:56:01.843370 13 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0313 12:56:01.843484 13 controller.go:157] Shutting down quota evaluator I0313 12:56:01.843513 13 controller.go:176] quota evaluator worker shutdown I0313 12:56:01.843608 13 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0313 12:56:01.843654 13 controller.go:176] quota evaluator worker shutdown I0313 12:56:01.843660 13 controller.go:176] quota evaluator worker shutdown I0313 12:56:01.843665 13 controller.go:176] quota evaluator worker shutdown I0313 12:56:01.843670 13 controller.go:176] quota evaluator worker shutdown I0313 12:56:01.845088 13 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0313 12:56:01.845193 13 controller.go:120] Shutting down OpenAPI V3 controller I0313 12:56:01.845224 13 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0313 12:56:01.845266 13 autoregister_controller.go:168] Shutting down autoregister controller I0313 12:56:01.845310 13 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0313 12:56:01.845336 13 naming_controller.go:305] Shutting down NamingConditionController I0313 12:56:01.845371 13 controller.go:170] Shutting down OpenAPI controller I0313 12:56:01.845425 13 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0313 12:56:01.845445 13 establishing_controller.go:92] Shutting down EstablishingController I0313 12:56:01.845467 13 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0313 12:56:01.845495 13 crd_finalizer.go:281] Shutting down CRDFinalizer I0313 12:56:01.845628 13 controller.go:132] Ending legacy_token_tracking_controller I0313 12:56:01.845636 13 controller.go:133] Shutting down legacy_token_tracking_controller I0313 12:56:01.845679 13 gc_controller.go:91] Shutting down apiserver lease garbage collector I0313 12:56:01.845703 13 system_namespaces_controller.go:76] Shutting down system namespaces controller I0313 12:56:01.845729 13 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0313 12:56:01.845775 13 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0313 12:56:01.845815 13 controller.go:86] Shutting down OpenAPI V3 AggregationController I0313 12:56:01.845893 13 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0313 12:56:01.845922 13 controller.go:84] Shutting down OpenAPI AggregationController I0313 12:56:01.845941 13 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0313 12:56:01.845975 13 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0313 12:56:01.846067 13 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0313 12:56:01.846103 13 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0313 12:56:01.846579 13 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0313 12:56:01.847396 13 secure_serving.go:258] Stopped listening on [::]:6443 I0313 12:56:01.847422 13 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0313 12:56:01.847439 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0313 12:56:01.847507 13 local_available_controller.go:172] Shutting down LocalAvailability controller I0313 12:56:01.847598 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0313 12:56:01.847655 13 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0313 12:56:01.847714 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0313 12:56:01.847758 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0313 12:56:01.847785 13 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0313 12:56:01.847814 13 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" E0313 12:56:01.848640 13 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=13554&timeout=8m44s&timeoutSeconds=524&watch=true" auditID="3007d216-3fd0-4c42-a1b9-2368ace5dce9" I0313 12:56:01.851062 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0313 12:56:01.847619 13 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0313 12:56:01.847644 13 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0313 12:56:01.851735 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0313 12:56:03.847700 13 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0313 12:56:03.847859 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0313 12:56:03.857316 13 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0313 12:56:03.858608 13 cacher.go:171] Terminating all watchers from cacher pods W0313 12:56:03.862024 13 cacher.go:171] Terminating all watchers from cacher endpoints W0313 12:56:03.864330 13 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0313 12:56:03.865551 13 cacher.go:171] Terminating all watchers from cacher services W0313 12:56:03.934468 13 cacher.go:171] Terminating all watchers from cacher limitranges W0313 12:56:03.935752 13 cacher.go:171] Terminating all watchers from cacher podtemplates W0313 12:56:03.936615 13 cacher.go:171] Terminating all watchers from cacher secrets W0313 12:56:03.938105 13 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0313 12:56:03.938699 13 cacher.go:171] Terminating all watchers from cacher resourcequotas W0313 12:56:03.939659 13 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0313 12:56:03.940816 13 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0313 12:56:03.945121 13 cacher.go:171] Terminating all watchers from cacher nodes W0313 12:56:03.946657 13 cacher.go:171] Terminating all watchers from cacher configmaps W0313 12:56:03.956661 13 cacher.go:171] Terminating all watchers from cacher namespaces W0313 12:56:03.970441 13 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0313 12:56:03.972023 13 cacher.go:171] Terminating all watchers from cacher jobs.batch W0313 12:56:03.972615 13 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0313 12:56:03.973020 13 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0313 12:56:03.974238 13 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0313 12:56:03.975037 13 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0313 12:56:03.977428 13 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0313 12:56:03.978023 13 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0313 12:56:03.978797 13 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0313 12:56:03.979421 13 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0313 12:56:03.979936 13 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0313 12:56:03.981502 13 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0313 12:56:03.982718 13 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0313 12:56:03.986059 13 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0313 12:56:03.987522 13 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0313 12:56:03.988613 13 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0313 12:56:03.989076 13 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0313 12:56:03.989590 13 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0313 12:56:03.991089 13 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0313 12:56:03.991887 13 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0313 12:56:03.992208 13 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0313 12:56:03.993359 13 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0313 12:56:03.994048 13 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0313 12:56:03.994528 13 cacher.go:171] Terminating all watchers from cacher deployments.apps W0313 12:56:03.995928 13 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0313 12:56:03.998009 13 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0313 12:56:03.999207 13 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0313 12:56:03.999783 13 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0313 12:56:04.001021 13 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0313 12:56:04.001868 13 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0313 12:56:04.003007 13 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0313 12:56:04.003576 13 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0313 12:56:04.005179 13 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0313 12:56:04.006047 13 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0313 12:56:04.006894 13 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0313 12:56:04.007698 13 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0313 12:56:04.008727 13 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0313 12:56:04.009477 13 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0313 12:56:04.009869 13 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0313 12:56:04.010503 13 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0313 12:56:04.011105 13 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0313 12:56:04.011938 13 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0313 12:56:04.013373 13 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0313 12:56:04.014428 13 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0313 12:56:04.014922 13 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0313 12:56:04.016177 13 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0313 12:56:04.016882 13 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0313 12:56:04.017768 13 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0313 12:56:04.018472 13 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io W0313 12:56:04.019074 13 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0313 12:56:04.020071 13 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0313 12:56:04.020933 13 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0313 12:56:04.021429 13 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0313 12:56:04.022291 13 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0313 12:56:04.022826 13 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0313 12:56:04.023561 13 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0313 12:56:04.024168 13 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0313 12:56:04.024857 13 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0313 12:56:04.026247 13 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0313 12:56:04.026763 13 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0313 12:56:04.027545 13 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0313 12:56:04.028361 13 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io W0313 12:56:04.028874 13 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0313 12:56:04.029281 13 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0313 12:56:04.029886 13 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0313 12:56:04.031056 13 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0313 12:56:04.031728 13 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0313 12:56:04.032582 13 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0313 12:56:04.032836 13 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0313 12:56:04.033272 13 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0313 12:56:04.033940 13 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0313 12:56:04.034962 13 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0313 12:56:04.035882 13 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0313 12:56:04.036817 13 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0313 12:56:04.037522 13 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0313 12:56:04.038152 13 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0313 12:56:04.039385 13 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0313 12:56:04.040038 13 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0313 12:56:04.040960 13 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0313 12:56:04.041442 13 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0313 12:56:04.042033 13 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0313 12:56:04.042735 13 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0313 12:56:04.043529 13 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0313 12:56:04.044053 13 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0313 12:56:04.044374 13 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0313 12:56:04.045163 13 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0313 12:56:04.046035 13 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0313 12:56:04.046737 13 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0313 12:56:04.047429 13 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0313 12:56:04.048388 13 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0313 12:56:04.049097 13 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0313 12:56:04.052214 13 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0313 12:56:04.053034 13 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0313 12:56:04.053744 13 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0313 12:56:04.054649 13 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0313 12:56:04.055495 13 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0313 12:56:04.056307 13 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0313 12:56:04.056732 13 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0313 12:56:04.057221 13 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0313 12:56:04.057906 13 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0313 12:56:04.058421 13 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0313 12:56:04.058833 13 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0313 12:56:04.059508 13 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0313 12:56:04.060197 13 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0313 12:56:04.061077 13 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0313 12:56:04.061646 13 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0313 12:56:04.062965 13 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0313 12:56:04.063795 13 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0313 12:56:04.065218 13 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0313 12:56:04.065706 13 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0313 12:56:04.066404 13 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0313 12:56:04.067232 13 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0313 12:56:04.069947 13 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0313 12:56:04.071818 13 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0313 12:56:04.072434 13 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0313 12:56:04.073631 13 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0313 12:56:04.074249 13 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0313 12:56:04.074945 13 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0313 12:56:04.075476 13 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0313 12:56:04.075906 13 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0313 12:56:04.076293 13 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0313 12:56:04.076829 13 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0313 12:56:04.077358 13 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0313 12:56:04.077960 13 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0313 12:56:04.079033 13 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0313 12:56:04.079578 13 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0313 12:56:04.079970 13 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0313 12:56:04.080646 13 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0313 12:56:04.081304 13 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0313 12:56:04.081894 13 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0313 12:56:04.082428 13 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0313 12:56:04.082834 13 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0313 12:56:04.083898 13 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0313 12:56:04.084576 13 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0313 12:56:04.085196 13 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0313 12:56:04.085797 13 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0313 12:56:04.087225 13 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0313 12:56:04.087627 13 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0313 12:56:04.088189 13 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0313 12:56:04.089715 13 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0313 12:56:04.090432 13 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0313 12:56:04.090969 13 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0313 12:56:04.091918 13 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0313 12:56:04.092469 13 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0313 12:56:04.092997 13 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0313 12:56:04.093759 13 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0313 12:56:04.094493 13 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0313 12:56:04.095930 13 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0313 12:56:04.096739 13 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0313 12:56:04.097219 13 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0313 12:56:04.098195 13 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0313 12:56:04.099409 13 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0313 12:56:04.100344 13 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0313 12:56:04.100672 13 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0313 12:56:04.101926 13 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0313 12:56:04.102720 13 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0313 12:56:04.103551 13 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0313 12:56:04.104220 13 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0313 12:56:04.106218 13 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0313 12:56:04.107634 13 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0313 12:56:04.108276 13 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0313 12:56:04.108900 13 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0313 12:56:04.111652 13 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0313 12:56:04.112460 13 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0313 12:56:04.113223 13 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0313 12:56:04.113812 13 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0313 12:56:04.114483 13 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io I0313 12:56:04.163641 1 main.go:235] Termination finished with exit code 0 I0313 12:56:04.163930 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" ---