--- I0220 15:03:12.936804 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0220 15:03:12.937184 13 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0220 15:03:12.937230 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0220 15:03:12.937509 13 controller.go:128] Shutting down kubernetes service endpoint reconciler I0220 15:03:12.946363 13 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0220 15:03:12.946426 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0220 15:03:12.951825 13 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0220 15:03:12.968558 13 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0220 15:03:12.968656 13 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0220 15:03:12.968685 13 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0220 15:03:12.968690 13 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0220 15:03:12.968718 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0220 15:03:12.969075 13 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0220 15:03:12.969143 13 controller.go:132] Ending legacy_token_tracking_controller I0220 15:03:12.968780 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0220 15:03:12.969159 13 controller.go:133] Shutting down legacy_token_tracking_controller I0220 15:03:12.969188 13 gc_controller.go:91] Shutting down apiserver lease garbage collector I0220 15:03:12.969205 13 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0220 15:03:12.968964 13 controller.go:157] Shutting down quota evaluator I0220 15:03:12.969274 13 controller.go:176] quota evaluator worker shutdown I0220 15:03:12.969284 13 controller.go:176] quota evaluator worker shutdown I0220 15:03:12.969291 13 controller.go:176] quota evaluator worker shutdown I0220 15:03:12.969298 13 controller.go:176] quota evaluator worker shutdown I0220 15:03:12.969306 13 controller.go:176] quota evaluator worker shutdown I0220 15:03:12.969403 13 controller.go:84] Shutting down OpenAPI AggregationController I0220 15:03:12.969409 13 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0220 15:03:12.969436 13 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0220 15:03:12.969481 13 controller.go:86] Shutting down OpenAPI V3 AggregationController I0220 15:03:12.969502 13 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0220 15:03:12.969522 13 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0220 15:03:12.969525 13 secure_serving.go:258] Stopped listening on [::]:6443 I0220 15:03:12.969530 13 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0220 15:03:12.969555 13 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0220 15:03:12.969584 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0220 15:03:12.969822 13 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0220 15:03:12.970407 13 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0220 15:03:12.970422 13 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0220 15:03:12.970909 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0220 15:03:12.968914 13 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" E0220 15:03:12.971520 13 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=12723&timeout=7m6s&timeoutSeconds=426&watch=true" auditID="e67fbfda-151e-4c78-a54f-5745df15d54d" I0220 15:03:12.972203 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0220 15:03:12.972328 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0220 15:03:12.972379 13 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0220 15:03:12.972403 13 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0220 15:03:12.972416 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0220 15:03:12.974170 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0220 15:03:12.974209 13 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0220 15:03:12.974227 13 controller.go:170] Shutting down OpenAPI controller I0220 15:03:12.974276 13 local_available_controller.go:172] Shutting down LocalAvailability controller I0220 15:03:12.974306 13 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0220 15:03:12.974326 13 system_namespaces_controller.go:76] Shutting down system namespaces controller I0220 15:03:12.974326 13 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0220 15:03:12.974352 13 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0220 15:03:12.974384 13 naming_controller.go:305] Shutting down NamingConditionController I0220 15:03:12.974405 13 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0220 15:03:12.974284 13 crd_finalizer.go:281] Shutting down CRDFinalizer I0220 15:03:12.974296 13 establishing_controller.go:92] Shutting down EstablishingController I0220 15:03:12.974551 13 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0220 15:03:12.974566 13 autoregister_controller.go:168] Shutting down autoregister controller I0220 15:03:12.974622 13 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0220 15:03:12.974636 13 controller.go:120] Shutting down OpenAPI V3 controller I0220 15:03:12.980488 13 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0220 15:03:14.969837 13 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0220 15:03:14.969869 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0220 15:03:14.973524 13 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0220 15:03:14.974846 13 cacher.go:171] Terminating all watchers from cacher namespaces W0220 15:03:14.976116 13 cacher.go:171] Terminating all watchers from cacher podtemplates W0220 15:03:14.976678 13 cacher.go:171] Terminating all watchers from cacher limitranges W0220 15:03:14.978620 13 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0220 15:03:14.979253 13 cacher.go:171] Terminating all watchers from cacher pods W0220 15:03:14.981042 13 cacher.go:171] Terminating all watchers from cacher secrets W0220 15:03:14.984496 13 cacher.go:171] Terminating all watchers from cacher nodes W0220 15:03:14.986428 13 cacher.go:171] Terminating all watchers from cacher endpoints W0220 15:03:14.988315 13 cacher.go:171] Terminating all watchers from cacher services W0220 15:03:14.990754 13 cacher.go:171] Terminating all watchers from cacher configmaps W0220 15:03:15.007430 13 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0220 15:03:15.012330 13 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0220 15:03:15.012809 13 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0220 15:03:15.013286 13 cacher.go:171] Terminating all watchers from cacher resourcequotas W0220 15:03:15.013943 13 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0220 15:03:15.014829 13 cacher.go:171] Terminating all watchers from cacher jobs.batch W0220 15:03:15.016267 13 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0220 15:03:15.016890 13 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0220 15:03:15.017503 13 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0220 15:03:15.017754 13 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0220 15:03:15.018022 13 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0220 15:03:15.018535 13 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0220 15:03:15.018963 13 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0220 15:03:15.019562 13 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0220 15:03:15.020433 13 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0220 15:03:15.021432 13 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0220 15:03:15.022203 13 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0220 15:03:15.022751 13 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0220 15:03:15.023226 13 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0220 15:03:15.023889 13 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0220 15:03:15.026351 13 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0220 15:03:15.027146 13 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0220 15:03:15.027667 13 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0220 15:03:15.028520 13 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0220 15:03:15.030156 13 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0220 15:03:15.031180 13 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0220 15:03:15.031606 13 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0220 15:03:15.037580 13 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0220 15:03:15.038365 13 cacher.go:171] Terminating all watchers from cacher deployments.apps W0220 15:03:15.039783 13 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0220 15:03:15.041202 13 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0220 15:03:15.042150 13 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0220 15:03:15.043430 13 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0220 15:03:15.044492 13 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0220 15:03:15.045662 13 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0220 15:03:15.046958 13 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0220 15:03:15.048881 13 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0220 15:03:15.049544 13 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io W0220 15:03:15.049911 13 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0220 15:03:15.050619 13 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0220 15:03:15.051273 13 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0220 15:03:15.052135 13 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0220 15:03:15.052518 13 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0220 15:03:15.053178 13 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0220 15:03:15.053510 13 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0220 15:03:15.054315 13 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0220 15:03:15.055623 13 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0220 15:03:15.056317 13 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0220 15:03:15.057239 13 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0220 15:03:15.057753 13 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0220 15:03:15.058463 13 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0220 15:03:15.059450 13 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0220 15:03:15.059843 13 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0220 15:03:15.060433 13 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0220 15:03:15.061615 13 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0220 15:03:15.062076 13 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0220 15:03:15.062738 13 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0220 15:03:15.063173 13 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0220 15:03:15.063721 13 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0220 15:03:15.064107 13 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0220 15:03:15.065026 13 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0220 15:03:15.066389 13 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0220 15:03:15.066901 13 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0220 15:03:15.067605 13 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0220 15:03:15.068419 13 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0220 15:03:15.068878 13 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0220 15:03:15.069767 13 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0220 15:03:15.070292 13 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0220 15:03:15.070859 13 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0220 15:03:15.071555 13 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0220 15:03:15.071974 13 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0220 15:03:15.072749 13 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0220 15:03:15.073432 13 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0220 15:03:15.073984 13 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0220 15:03:15.074861 13 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0220 15:03:15.075846 13 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0220 15:03:15.076658 13 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0220 15:03:15.077080 13 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0220 15:03:15.078599 13 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0220 15:03:15.079576 13 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0220 15:03:15.080630 13 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0220 15:03:15.081384 13 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0220 15:03:15.081822 13 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0220 15:03:15.082254 13 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0220 15:03:15.083479 13 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0220 15:03:15.084071 13 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0220 15:03:15.085392 13 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0220 15:03:15.087087 13 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0220 15:03:15.087856 13 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0220 15:03:15.088812 13 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0220 15:03:15.089540 13 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0220 15:03:15.090391 13 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0220 15:03:15.090817 13 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0220 15:03:15.091546 13 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0220 15:03:15.092327 13 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0220 15:03:15.093213 13 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0220 15:03:15.093530 13 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0220 15:03:15.094402 13 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0220 15:03:15.095811 13 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0220 15:03:15.096147 13 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0220 15:03:15.096387 13 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0220 15:03:15.097396 13 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0220 15:03:15.098273 13 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0220 15:03:15.098670 13 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0220 15:03:15.099489 13 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0220 15:03:15.099944 13 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0220 15:03:15.100501 13 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0220 15:03:15.101096 13 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0220 15:03:15.101887 13 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0220 15:03:15.102359 13 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0220 15:03:15.102688 13 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0220 15:03:15.103237 13 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0220 15:03:15.103634 13 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0220 15:03:15.104618 13 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0220 15:03:15.104992 13 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0220 15:03:15.105270 13 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0220 15:03:15.105522 13 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0220 15:03:15.106156 13 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0220 15:03:15.106708 13 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io W0220 15:03:15.107353 13 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0220 15:03:15.107650 13 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0220 15:03:15.108134 13 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0220 15:03:15.108363 13 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0220 15:03:15.108998 13 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0220 15:03:15.109424 13 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0220 15:03:15.109699 13 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0220 15:03:15.110486 13 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0220 15:03:15.111165 13 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0220 15:03:15.111483 13 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0220 15:03:15.112164 13 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0220 15:03:15.112764 13 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0220 15:03:15.113321 13 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0220 15:03:15.113840 13 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0220 15:03:15.114507 13 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0220 15:03:15.115053 13 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0220 15:03:15.115404 13 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0220 15:03:15.116159 13 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0220 15:03:15.116582 13 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0220 15:03:15.116995 13 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0220 15:03:15.117277 13 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0220 15:03:15.117759 13 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0220 15:03:15.118056 13 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0220 15:03:15.118487 13 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0220 15:03:15.118981 13 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0220 15:03:15.119661 13 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0220 15:03:15.120020 13 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0220 15:03:15.120572 13 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0220 15:03:15.120916 13 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0220 15:03:15.121377 13 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0220 15:03:15.121721 13 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0220 15:03:15.122274 13 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0220 15:03:15.122825 13 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0220 15:03:15.123177 13 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0220 15:03:15.123501 13 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0220 15:03:15.124442 13 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0220 15:03:15.125020 13 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0220 15:03:15.125401 13 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0220 15:03:15.126085 13 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0220 15:03:15.126736 13 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0220 15:03:15.127538 13 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0220 15:03:15.128318 13 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0220 15:03:15.128735 13 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0220 15:03:15.129294 13 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0220 15:03:15.129608 13 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0220 15:03:15.130085 13 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0220 15:03:15.130358 13 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0220 15:03:15.130679 13 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0220 15:03:15.131141 13 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0220 15:03:15.131590 13 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0220 15:03:15.131873 13 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0220 15:03:15.132622 13 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0220 15:03:15.133120 13 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com I0220 15:03:15.158803 1 main.go:235] Termination finished with exit code 0 I0220 15:03:15.159280 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" --- I0220 15:06:44.242238 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0220 15:06:44.242587 13 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0220 15:06:44.242652 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0220 15:06:44.242767 13 controller.go:128] Shutting down kubernetes service endpoint reconciler I0220 15:06:44.250759 13 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0220 15:06:44.250878 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0220 15:06:44.256858 13 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0220 15:06:44.277182 13 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0220 15:06:44.277246 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0220 15:06:44.277488 13 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0220 15:06:44.277525 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0220 15:06:44.277636 13 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0220 15:06:44.316793 13 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0220 15:06:44.316829 13 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0220 15:06:44.316891 13 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0220 15:06:44.316962 13 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0220 15:06:44.316979 13 controller.go:157] Shutting down quota evaluator I0220 15:06:44.316989 13 controller.go:176] quota evaluator worker shutdown I0220 15:06:44.317012 13 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0220 15:06:44.317013 13 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0220 15:06:44.317029 13 local_available_controller.go:172] Shutting down LocalAvailability controller I0220 15:06:44.317047 13 controller.go:132] Ending legacy_token_tracking_controller I0220 15:06:44.317060 13 controller.go:133] Shutting down legacy_token_tracking_controller I0220 15:06:44.317075 13 gc_controller.go:91] Shutting down apiserver lease garbage collector I0220 15:06:44.317203 13 controller.go:86] Shutting down OpenAPI V3 AggregationController I0220 15:06:44.317231 13 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0220 15:06:44.317245 13 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0220 15:06:44.317272 13 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0220 15:06:44.317296 13 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0220 15:06:44.317318 13 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0220 15:06:44.317333 13 controller.go:84] Shutting down OpenAPI AggregationController I0220 15:06:44.317343 13 controller.go:176] quota evaluator worker shutdown I0220 15:06:44.317350 13 controller.go:176] quota evaluator worker shutdown I0220 15:06:44.317355 13 controller.go:176] quota evaluator worker shutdown I0220 15:06:44.317361 13 controller.go:176] quota evaluator worker shutdown I0220 15:06:44.317496 13 secure_serving.go:258] Stopped listening on [::]:6443 I0220 15:06:44.317511 13 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0220 15:06:44.317526 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0220 15:06:44.317724 13 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0220 15:06:44.318052 13 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0220 15:06:44.318103 13 controller.go:120] Shutting down OpenAPI V3 controller I0220 15:06:44.318122 13 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0220 15:06:44.318140 13 autoregister_controller.go:168] Shutting down autoregister controller I0220 15:06:44.318158 13 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0220 15:06:44.318175 13 controller.go:170] Shutting down OpenAPI controller I0220 15:06:44.318193 13 establishing_controller.go:92] Shutting down EstablishingController I0220 15:06:44.318209 13 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0220 15:06:44.318251 13 naming_controller.go:305] Shutting down NamingConditionController I0220 15:06:44.318278 13 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0220 15:06:44.318296 13 crd_finalizer.go:281] Shutting down CRDFinalizer I0220 15:06:44.318324 13 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0220 15:06:44.318349 13 system_namespaces_controller.go:76] Shutting down system namespaces controller E0220 15:06:44.318971 13 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=16412&timeout=9m12s&timeoutSeconds=552&watch=true" auditID="89801096-b9c9-4a77-990c-ce22648a5cd4" I0220 15:06:44.319500 13 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0220 15:06:44.319509 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0220 15:06:44.319559 13 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0220 15:06:44.320218 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0220 15:06:44.320245 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0220 15:06:44.320260 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0220 15:06:44.320264 13 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0220 15:06:44.320273 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0220 15:06:44.320303 13 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0220 15:06:46.317956 13 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0220 15:06:46.318010 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0220 15:06:46.322982 13 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0220 15:06:46.323773 13 cacher.go:171] Terminating all watchers from cacher configmaps W0220 15:06:46.329903 13 cacher.go:171] Terminating all watchers from cacher namespaces W0220 15:06:46.335832 13 cacher.go:171] Terminating all watchers from cacher resourcequotas W0220 15:06:46.337005 13 cacher.go:171] Terminating all watchers from cacher endpoints W0220 15:06:46.341916 13 cacher.go:171] Terminating all watchers from cacher nodes W0220 15:06:46.344764 13 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0220 15:06:46.345155 13 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0220 15:06:46.345702 13 cacher.go:171] Terminating all watchers from cacher services W0220 15:06:46.349764 13 cacher.go:171] Terminating all watchers from cacher podtemplates W0220 15:06:46.350789 13 cacher.go:171] Terminating all watchers from cacher limitranges W0220 15:06:46.351374 13 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0220 15:06:46.352243 13 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0220 15:06:46.353132 13 cacher.go:171] Terminating all watchers from cacher pods W0220 15:06:46.362254 13 cacher.go:171] Terminating all watchers from cacher secrets W0220 15:06:46.369553 13 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0220 15:06:46.370689 13 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0220 15:06:46.371308 13 cacher.go:171] Terminating all watchers from cacher jobs.batch W0220 15:06:46.371885 13 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0220 15:06:46.373575 13 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0220 15:06:46.374088 13 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0220 15:06:46.374567 13 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0220 15:06:46.375100 13 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0220 15:06:46.375709 13 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0220 15:06:46.376372 13 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0220 15:06:46.376763 13 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0220 15:06:46.377622 13 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0220 15:06:46.378281 13 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0220 15:06:46.379301 13 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0220 15:06:46.380516 13 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0220 15:06:46.382276 13 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0220 15:06:46.382811 13 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0220 15:06:46.383299 13 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0220 15:06:46.383672 13 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0220 15:06:46.384333 13 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0220 15:06:46.384613 13 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0220 15:06:46.386012 13 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0220 15:06:46.386544 13 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0220 15:06:46.386984 13 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0220 15:06:46.387899 13 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0220 15:06:46.388640 13 cacher.go:171] Terminating all watchers from cacher deployments.apps W0220 15:06:46.389466 13 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0220 15:06:46.390208 13 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0220 15:06:46.391847 13 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0220 15:06:46.393992 13 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0220 15:06:46.394570 13 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0220 15:06:46.395461 13 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0220 15:06:46.397442 13 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0220 15:06:46.398112 13 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0220 15:06:46.398558 13 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0220 15:06:46.399047 13 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0220 15:06:46.399389 13 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0220 15:06:46.400102 13 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0220 15:06:46.400737 13 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0220 15:06:46.402609 13 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0220 15:06:46.403153 13 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0220 15:06:46.406638 13 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0220 15:06:46.407113 13 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0220 15:06:46.410766 13 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0220 15:06:46.411599 13 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0220 15:06:46.414033 13 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0220 15:06:46.414761 13 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0220 15:06:46.416122 13 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0220 15:06:46.417265 13 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0220 15:06:46.418708 13 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0220 15:06:46.419333 13 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0220 15:06:46.419756 13 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0220 15:06:46.420473 13 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0220 15:06:46.421107 13 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0220 15:06:46.421880 13 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0220 15:06:46.422445 13 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0220 15:06:46.423129 13 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0220 15:06:46.423748 13 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0220 15:06:46.424233 13 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0220 15:06:46.425098 13 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0220 15:06:46.425560 13 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0220 15:06:46.426009 13 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0220 15:06:46.426752 13 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0220 15:06:46.427161 13 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0220 15:06:46.428250 13 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0220 15:06:46.428733 13 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0220 15:06:46.429391 13 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0220 15:06:46.430242 13 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0220 15:06:46.430730 13 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0220 15:06:46.431591 13 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0220 15:06:46.432189 13 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0220 15:06:46.432954 13 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0220 15:06:46.433301 13 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0220 15:06:46.433796 13 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0220 15:06:46.434544 13 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0220 15:06:46.435020 13 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0220 15:06:46.435349 13 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0220 15:06:46.435843 13 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0220 15:06:46.436564 13 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0220 15:06:46.437495 13 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0220 15:06:46.438555 13 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0220 15:06:46.440514 13 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0220 15:06:46.440977 13 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0220 15:06:46.441604 13 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0220 15:06:46.442737 13 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0220 15:06:46.443453 13 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0220 15:06:46.443748 13 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0220 15:06:46.444588 13 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0220 15:06:46.445266 13 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0220 15:06:46.445778 13 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0220 15:06:46.446400 13 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0220 15:06:46.447410 13 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0220 15:06:46.448264 13 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0220 15:06:46.449352 13 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0220 15:06:46.450131 13 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0220 15:06:46.450867 13 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0220 15:06:46.451668 13 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0220 15:06:46.453056 13 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0220 15:06:46.453542 13 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0220 15:06:46.454917 13 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0220 15:06:46.455465 13 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0220 15:06:46.456690 13 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0220 15:06:46.457147 13 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0220 15:06:46.457802 13 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0220 15:06:46.458434 13 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0220 15:06:46.459017 13 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0220 15:06:46.459561 13 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0220 15:06:46.460250 13 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0220 15:06:46.460689 13 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0220 15:06:46.461228 13 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0220 15:06:46.461716 13 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0220 15:06:46.462306 13 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0220 15:06:46.462841 13 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0220 15:06:46.463139 13 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0220 15:06:46.463577 13 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0220 15:06:46.464024 13 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0220 15:06:46.464406 13 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0220 15:06:46.465015 13 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0220 15:06:46.466193 13 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0220 15:06:46.466799 13 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0220 15:06:46.467217 13 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0220 15:06:46.467582 13 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io W0220 15:06:46.467909 13 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io W0220 15:06:46.468248 13 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0220 15:06:46.468849 13 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0220 15:06:46.469331 13 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0220 15:06:46.469657 13 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0220 15:06:46.469982 13 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0220 15:06:46.470352 13 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0220 15:06:46.470850 13 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0220 15:06:46.471395 13 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0220 15:06:46.472056 13 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0220 15:06:46.472396 13 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0220 15:06:46.472669 13 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0220 15:06:46.474247 13 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0220 15:06:46.474873 13 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0220 15:06:46.475498 13 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0220 15:06:46.475827 13 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0220 15:06:46.476296 13 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0220 15:06:46.476579 13 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0220 15:06:46.477141 13 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0220 15:06:46.477556 13 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0220 15:06:46.478469 13 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0220 15:06:46.479107 13 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0220 15:06:46.480406 13 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0220 15:06:46.480719 13 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0220 15:06:46.481418 13 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0220 15:06:46.482571 13 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0220 15:06:46.483251 13 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0220 15:06:46.483892 13 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0220 15:06:46.484782 13 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0220 15:06:46.485104 13 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0220 15:06:46.485776 13 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0220 15:06:46.486196 13 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0220 15:06:46.486543 13 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0220 15:06:46.487068 13 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0220 15:06:46.487717 13 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0220 15:06:46.488355 13 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0220 15:06:46.489156 13 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0220 15:06:46.489779 13 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0220 15:06:46.490391 13 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0220 15:06:46.490674 13 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0220 15:06:46.491261 13 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0220 15:06:46.491832 13 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0220 15:06:46.492184 13 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0220 15:06:46.492673 13 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0220 15:06:46.493250 13 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0220 15:06:46.493864 13 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io I0220 15:06:46.525700 1 main.go:235] Termination finished with exit code 0 I0220 15:06:46.525990 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" ---