--- I0309 16:48:12.744613 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0309 16:48:12.744938 13 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0309 16:48:12.744954 13 controller.go:128] Shutting down kubernetes service endpoint reconciler I0309 16:48:12.744991 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0309 16:48:12.752194 13 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0309 16:48:12.752257 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0309 16:48:12.756079 13 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0309 16:48:12.773756 13 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0309 16:48:12.773802 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0309 16:48:12.774075 13 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0309 16:48:12.774090 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0309 16:48:12.774259 13 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0309 16:48:12.793970 13 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0309 16:48:12.794031 13 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0309 16:48:12.794122 13 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0309 16:48:12.794187 13 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0309 16:48:12.794229 13 controller.go:157] Shutting down quota evaluator I0309 16:48:12.794242 13 controller.go:176] quota evaluator worker shutdown I0309 16:48:12.794596 13 gc_controller.go:91] Shutting down apiserver lease garbage collector I0309 16:48:12.794757 13 local_available_controller.go:172] Shutting down LocalAvailability controller I0309 16:48:12.794778 13 controller.go:132] Ending legacy_token_tracking_controller I0309 16:48:12.794783 13 controller.go:133] Shutting down legacy_token_tracking_controller I0309 16:48:12.794798 13 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0309 16:48:12.795101 13 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0309 16:48:12.795115 13 controller.go:86] Shutting down OpenAPI V3 AggregationController I0309 16:48:12.795139 13 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0309 16:48:12.795153 13 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0309 16:48:12.795168 13 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0309 16:48:12.795190 13 controller.go:84] Shutting down OpenAPI AggregationController I0309 16:48:12.795214 13 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0309 16:48:12.795231 13 controller.go:176] quota evaluator worker shutdown I0309 16:48:12.795239 13 controller.go:176] quota evaluator worker shutdown I0309 16:48:12.795245 13 controller.go:176] quota evaluator worker shutdown I0309 16:48:12.795251 13 controller.go:176] quota evaluator worker shutdown I0309 16:48:12.795445 13 system_namespaces_controller.go:76] Shutting down system namespaces controller I0309 16:48:12.795490 13 controller.go:170] Shutting down OpenAPI controller I0309 16:48:12.795493 13 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0309 16:48:12.795530 13 establishing_controller.go:92] Shutting down EstablishingController I0309 16:48:12.795535 13 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0309 16:48:12.795549 13 crd_finalizer.go:281] Shutting down CRDFinalizer I0309 16:48:12.795565 13 naming_controller.go:305] Shutting down NamingConditionController I0309 16:48:12.795571 13 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0309 16:48:12.795580 13 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0309 16:48:12.795583 13 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0309 16:48:12.795633 13 controller.go:120] Shutting down OpenAPI V3 controller I0309 16:48:12.795663 13 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0309 16:48:12.795685 13 autoregister_controller.go:168] Shutting down autoregister controller I0309 16:48:12.795520 13 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0309 16:48:12.795822 13 secure_serving.go:258] Stopped listening on [::]:6443 I0309 16:48:12.795844 13 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0309 16:48:12.795862 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0309 16:48:12.796129 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0309 16:48:12.796145 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0309 16:48:12.796157 13 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0309 16:48:12.796165 13 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0309 16:48:12.796184 13 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0309 16:48:12.796188 13 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0309 16:48:12.796954 13 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0309 16:48:12.799342 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0309 16:48:12.800036 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" E0309 16:48:12.800092 13 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=14313&timeout=6m30s&timeoutSeconds=390&watch=true" auditID="f81aa1dc-6c9a-4c55-a836-ae5c5d51d084" I0309 16:48:12.806619 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0309 16:48:14.795922 13 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0309 16:48:14.796010 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0309 16:48:14.799196 13 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0309 16:48:14.801200 13 cacher.go:171] Terminating all watchers from cacher podtemplates W0309 16:48:14.802379 13 cacher.go:171] Terminating all watchers from cacher secrets W0309 16:48:14.820566 13 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0309 16:48:14.821507 13 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0309 16:48:14.822218 13 cacher.go:171] Terminating all watchers from cacher limitranges W0309 16:48:14.823316 13 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0309 16:48:14.823779 13 cacher.go:171] Terminating all watchers from cacher namespaces W0309 16:48:14.827827 13 cacher.go:171] Terminating all watchers from cacher configmaps W0309 16:48:14.832077 13 cacher.go:171] Terminating all watchers from cacher pods W0309 16:48:14.837319 13 cacher.go:171] Terminating all watchers from cacher endpoints W0309 16:48:14.838872 13 cacher.go:171] Terminating all watchers from cacher resourcequotas W0309 16:48:14.840000 13 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0309 16:48:14.841251 13 cacher.go:171] Terminating all watchers from cacher nodes W0309 16:48:14.842201 13 cacher.go:171] Terminating all watchers from cacher services W0309 16:48:14.844914 13 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0309 16:48:14.845563 13 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0309 16:48:14.845953 13 cacher.go:171] Terminating all watchers from cacher jobs.batch W0309 16:48:14.854029 13 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0309 16:48:14.856184 13 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0309 16:48:14.856834 13 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0309 16:48:14.859479 13 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0309 16:48:14.860448 13 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0309 16:48:14.861185 13 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0309 16:48:14.862031 13 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0309 16:48:14.862855 13 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0309 16:48:14.863971 13 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0309 16:48:14.865112 13 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0309 16:48:14.870505 13 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0309 16:48:14.874111 13 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0309 16:48:14.875044 13 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0309 16:48:14.875539 13 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0309 16:48:14.876728 13 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0309 16:48:14.877395 13 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0309 16:48:14.878504 13 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0309 16:48:14.879003 13 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0309 16:48:14.880085 13 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0309 16:48:14.880513 13 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0309 16:48:14.880940 13 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0309 16:48:14.882370 13 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0309 16:48:14.883106 13 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0309 16:48:14.886185 13 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0309 16:48:14.888064 13 cacher.go:171] Terminating all watchers from cacher deployments.apps W0309 16:48:14.890814 13 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0309 16:48:14.891226 13 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0309 16:48:14.891681 13 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0309 16:48:14.893020 13 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0309 16:48:14.894380 13 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0309 16:48:14.894806 13 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0309 16:48:14.895538 13 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0309 16:48:14.896231 13 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0309 16:48:14.896929 13 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0309 16:48:14.898010 13 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0309 16:48:14.898580 13 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0309 16:48:14.899386 13 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0309 16:48:14.899884 13 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0309 16:48:14.900466 13 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0309 16:48:14.901194 13 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0309 16:48:14.902078 13 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0309 16:48:14.902583 13 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0309 16:48:14.904056 13 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0309 16:48:14.906067 13 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0309 16:48:14.906592 13 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0309 16:48:14.907306 13 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0309 16:48:14.908247 13 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0309 16:48:14.909323 13 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0309 16:48:14.909936 13 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0309 16:48:14.910897 13 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0309 16:48:14.911399 13 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0309 16:48:14.912106 13 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0309 16:48:14.912820 13 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0309 16:48:14.913414 13 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0309 16:48:14.913889 13 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0309 16:48:14.914493 13 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0309 16:48:14.914933 13 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0309 16:48:14.915897 13 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0309 16:48:14.916881 13 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0309 16:48:14.917845 13 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0309 16:48:14.919125 13 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0309 16:48:14.921871 13 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0309 16:48:14.922715 13 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0309 16:48:14.923305 13 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0309 16:48:14.923782 13 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0309 16:48:14.925124 13 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0309 16:48:14.925648 13 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0309 16:48:14.926049 13 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0309 16:48:14.927671 13 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0309 16:48:14.928112 13 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0309 16:48:14.928738 13 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0309 16:48:14.929375 13 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io W0309 16:48:14.929696 13 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0309 16:48:14.930327 13 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0309 16:48:14.930819 13 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0309 16:48:14.931846 13 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0309 16:48:14.932468 13 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0309 16:48:14.933535 13 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0309 16:48:14.934889 13 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0309 16:48:14.935963 13 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0309 16:48:14.936576 13 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0309 16:48:14.937070 13 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0309 16:48:14.937750 13 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0309 16:48:14.938403 13 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0309 16:48:14.939094 13 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0309 16:48:14.939758 13 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0309 16:48:14.940419 13 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0309 16:48:14.941866 13 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0309 16:48:14.943539 13 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0309 16:48:14.944042 13 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0309 16:48:14.944779 13 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0309 16:48:14.945393 13 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0309 16:48:14.945794 13 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0309 16:48:14.946954 13 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0309 16:48:14.947490 13 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0309 16:48:14.948285 13 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0309 16:48:14.948960 13 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0309 16:48:14.951047 13 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0309 16:48:14.952048 13 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0309 16:48:14.953643 13 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0309 16:48:14.954757 13 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0309 16:48:14.955646 13 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0309 16:48:14.956335 13 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0309 16:48:14.957040 13 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0309 16:48:14.957944 13 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0309 16:48:14.959300 13 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0309 16:48:14.960051 13 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0309 16:48:14.960951 13 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io W0309 16:48:14.961728 13 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0309 16:48:14.962367 13 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0309 16:48:14.963043 13 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0309 16:48:14.964336 13 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0309 16:48:14.964831 13 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0309 16:48:14.965480 13 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0309 16:48:14.966340 13 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0309 16:48:14.967257 13 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0309 16:48:14.968568 13 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0309 16:48:14.969404 13 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0309 16:48:14.970055 13 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0309 16:48:14.971112 13 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0309 16:48:14.972695 13 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0309 16:48:14.973192 13 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0309 16:48:14.973751 13 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0309 16:48:14.975366 13 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0309 16:48:14.975825 13 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0309 16:48:14.976232 13 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0309 16:48:14.977039 13 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0309 16:48:14.977683 13 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0309 16:48:14.978332 13 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0309 16:48:14.979242 13 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0309 16:48:14.980153 13 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0309 16:48:14.980979 13 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0309 16:48:14.982294 13 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0309 16:48:14.983454 13 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0309 16:48:14.983983 13 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0309 16:48:14.984329 13 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0309 16:48:14.985253 13 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0309 16:48:14.986096 13 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0309 16:48:14.988752 13 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0309 16:48:14.990028 13 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0309 16:48:14.991268 13 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0309 16:48:14.991847 13 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0309 16:48:14.992362 13 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0309 16:48:14.993048 13 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0309 16:48:14.994128 13 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0309 16:48:14.995121 13 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0309 16:48:14.995621 13 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0309 16:48:14.996154 13 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0309 16:48:14.996711 13 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0309 16:48:14.998030 13 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0309 16:48:14.998766 13 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0309 16:48:14.999718 13 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0309 16:48:15.000667 13 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0309 16:48:15.001633 13 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0309 16:48:15.002221 13 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0309 16:48:15.002743 13 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0309 16:48:15.003353 13 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0309 16:48:15.004168 13 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0309 16:48:15.004659 13 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0309 16:48:15.005210 13 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0309 16:48:15.005925 13 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0309 16:48:15.006651 13 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0309 16:48:15.007260 13 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0309 16:48:15.007851 13 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0309 16:48:15.008609 13 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io I0309 16:48:15.053813 1 main.go:235] Termination finished with exit code 0 I0309 16:48:15.053917 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" ---