--- I0320 08:42:47.903251 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0320 08:42:47.904024 11 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0320 08:42:47.904059 11 controller.go:128] Shutting down kubernetes service endpoint reconciler I0320 08:42:47.904071 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0320 08:42:47.914107 11 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0320 08:42:47.914149 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0320 08:42:47.925572 11 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0320 08:42:47.945487 11 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0320 08:42:47.945523 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0320 08:42:47.945711 11 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0320 08:42:47.945735 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0320 08:42:47.945842 11 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0320 08:42:47.968392 11 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0320 08:42:47.968438 11 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0320 08:42:47.968533 11 controller.go:157] Shutting down quota evaluator I0320 08:42:47.968563 11 controller.go:176] quota evaluator worker shutdown I0320 08:42:47.968601 11 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0320 08:42:47.968675 11 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0320 08:42:47.968723 11 controller.go:176] quota evaluator worker shutdown I0320 08:42:47.968739 11 controller.go:176] quota evaluator worker shutdown I0320 08:42:47.968746 11 controller.go:176] quota evaluator worker shutdown I0320 08:42:47.968756 11 controller.go:176] quota evaluator worker shutdown I0320 08:42:47.969800 11 controller.go:86] Shutting down OpenAPI V3 AggregationController I0320 08:42:47.969813 11 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0320 08:42:47.969863 11 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0320 08:42:47.969897 11 controller.go:84] Shutting down OpenAPI AggregationController I0320 08:42:47.969906 11 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0320 08:42:47.969941 11 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0320 08:42:47.969945 11 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0320 08:42:47.970001 11 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0320 08:42:47.970032 11 secure_serving.go:258] Stopped listening on [::]:6443 I0320 08:42:47.970041 11 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0320 08:42:47.970057 11 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0320 08:42:47.970087 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0320 08:42:47.970238 11 gc_controller.go:91] Shutting down apiserver lease garbage collector I0320 08:42:47.970270 11 controller.go:132] Ending legacy_token_tracking_controller I0320 08:42:47.970284 11 controller.go:133] Shutting down legacy_token_tracking_controller I0320 08:42:47.970313 11 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0320 08:42:47.970476 11 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0320 08:42:47.970776 11 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0320 08:42:47.970877 11 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0320 08:42:47.970932 11 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0320 08:42:47.970976 11 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0320 08:42:47.971020 11 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0320 08:42:47.971046 11 controller.go:120] Shutting down OpenAPI V3 controller I0320 08:42:47.971065 11 crd_finalizer.go:281] Shutting down CRDFinalizer I0320 08:42:47.971077 11 autoregister_controller.go:168] Shutting down autoregister controller I0320 08:42:47.970978 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0320 08:42:47.971093 11 controller.go:170] Shutting down OpenAPI controller I0320 08:42:47.971103 11 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0320 08:42:47.971112 11 establishing_controller.go:92] Shutting down EstablishingController I0320 08:42:47.971123 11 naming_controller.go:305] Shutting down NamingConditionController I0320 08:42:47.971053 11 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0320 08:42:47.971328 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0320 08:42:47.971370 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0320 08:42:47.971387 11 local_available_controller.go:172] Shutting down LocalAvailability controller I0320 08:42:47.971400 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0320 08:42:47.971172 11 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0320 08:42:47.971430 11 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0320 08:42:47.971570 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0320 08:42:47.971609 11 system_namespaces_controller.go:76] Shutting down system namespaces controller E0320 08:42:47.971795 11 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=11497&timeout=8m57s&timeoutSeconds=537&watch=true" auditID="b39e1e8e-0a27-4062-8636-84558edcdc09" I0320 08:42:49.970331 11 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0320 08:42:49.970381 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0320 08:42:49.975106 11 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0320 08:42:49.976380 11 cacher.go:171] Terminating all watchers from cacher services W0320 08:42:49.980034 11 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0320 08:42:49.982142 11 cacher.go:171] Terminating all watchers from cacher endpoints W0320 08:42:49.982988 11 cacher.go:171] Terminating all watchers from cacher pods W0320 08:42:49.987032 11 cacher.go:171] Terminating all watchers from cacher namespaces W0320 08:42:49.989972 11 cacher.go:171] Terminating all watchers from cacher secrets W0320 08:42:49.995039 11 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0320 08:42:49.995767 11 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0320 08:42:49.996142 11 cacher.go:171] Terminating all watchers from cacher resourcequotas W0320 08:42:49.996821 11 cacher.go:171] Terminating all watchers from cacher configmaps W0320 08:42:50.007808 11 cacher.go:171] Terminating all watchers from cacher limitranges W0320 08:42:50.009444 11 cacher.go:171] Terminating all watchers from cacher podtemplates W0320 08:42:50.011220 11 cacher.go:171] Terminating all watchers from cacher nodes W0320 08:42:50.012597 11 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0320 08:42:50.013366 11 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0320 08:42:50.014174 11 cacher.go:171] Terminating all watchers from cacher jobs.batch W0320 08:42:50.016547 11 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0320 08:42:50.018146 11 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0320 08:42:50.021038 11 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0320 08:42:50.022443 11 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0320 08:42:50.024122 11 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0320 08:42:50.034298 11 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0320 08:42:50.034920 11 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0320 08:42:50.035611 11 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0320 08:42:50.036237 11 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0320 08:42:50.036960 11 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0320 08:42:50.038624 11 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0320 08:42:50.041068 11 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0320 08:42:50.046051 11 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0320 08:42:50.048948 11 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0320 08:42:50.050964 11 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0320 08:42:50.052146 11 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0320 08:42:50.053029 11 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0320 08:42:50.053986 11 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0320 08:42:50.054787 11 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0320 08:42:50.057123 11 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0320 08:42:50.057890 11 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0320 08:42:50.058773 11 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0320 08:42:50.061228 11 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0320 08:42:50.062232 11 cacher.go:171] Terminating all watchers from cacher deployments.apps W0320 08:42:50.064143 11 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0320 08:42:50.065678 11 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0320 08:42:50.066366 11 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0320 08:42:50.067026 11 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0320 08:42:50.068453 11 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0320 08:42:50.069895 11 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0320 08:42:50.071763 11 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0320 08:42:50.074039 11 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0320 08:42:50.074948 11 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0320 08:42:50.077049 11 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0320 08:42:50.077902 11 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0320 08:42:50.078800 11 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0320 08:42:50.079652 11 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0320 08:42:50.080500 11 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0320 08:42:50.081919 11 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0320 08:42:50.082706 11 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0320 08:42:50.083139 11 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0320 08:42:50.083698 11 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0320 08:42:50.084299 11 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0320 08:42:50.085903 11 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0320 08:42:50.086948 11 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0320 08:42:50.087610 11 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0320 08:42:50.088530 11 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0320 08:42:50.089124 11 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0320 08:42:50.089858 11 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0320 08:42:50.090535 11 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0320 08:42:50.091070 11 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0320 08:42:50.091942 11 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0320 08:42:50.092874 11 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0320 08:42:50.093594 11 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0320 08:42:50.094045 11 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0320 08:42:50.094406 11 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0320 08:42:50.094909 11 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0320 08:42:50.095441 11 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0320 08:42:50.096021 11 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0320 08:42:50.096765 11 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0320 08:42:50.097197 11 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0320 08:42:50.097570 11 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0320 08:42:50.098009 11 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0320 08:42:50.098507 11 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0320 08:42:50.098882 11 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0320 08:42:50.099391 11 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0320 08:42:50.100133 11 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0320 08:42:50.100812 11 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0320 08:42:50.101258 11 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0320 08:42:50.101653 11 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0320 08:42:50.102084 11 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0320 08:42:50.102536 11 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0320 08:42:50.102914 11 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0320 08:42:50.106162 11 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0320 08:42:50.107077 11 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0320 08:42:50.107439 11 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0320 08:42:50.107909 11 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0320 08:42:50.108215 11 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0320 08:42:50.108657 11 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0320 08:42:50.109133 11 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0320 08:42:50.112097 11 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0320 08:42:50.112719 11 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0320 08:42:50.113369 11 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0320 08:42:50.114401 11 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0320 08:42:50.115418 11 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0320 08:42:50.116057 11 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0320 08:42:50.116697 11 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0320 08:42:50.117125 11 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0320 08:42:50.117784 11 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0320 08:42:50.118917 11 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0320 08:42:50.119382 11 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0320 08:42:50.119747 11 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0320 08:42:50.120920 11 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0320 08:42:50.122000 11 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0320 08:42:50.122778 11 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0320 08:42:50.124081 11 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0320 08:42:50.124909 11 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0320 08:42:50.125759 11 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0320 08:42:50.126376 11 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0320 08:42:50.128461 11 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0320 08:42:50.129150 11 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0320 08:42:50.129616 11 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0320 08:42:50.130310 11 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0320 08:42:50.132344 11 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0320 08:42:50.132955 11 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0320 08:42:50.133886 11 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0320 08:42:50.135946 11 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0320 08:42:50.136534 11 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0320 08:42:50.136970 11 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0320 08:42:50.137763 11 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0320 08:42:50.138608 11 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0320 08:42:50.139171 11 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0320 08:42:50.139704 11 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0320 08:42:50.141417 11 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0320 08:42:50.141805 11 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0320 08:42:50.142514 11 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0320 08:42:50.143400 11 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0320 08:42:50.144062 11 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0320 08:42:50.144778 11 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0320 08:42:50.145308 11 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0320 08:42:50.145928 11 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0320 08:42:50.146607 11 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0320 08:42:50.149119 11 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0320 08:42:50.149579 11 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0320 08:42:50.150070 11 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io W0320 08:42:50.150495 11 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0320 08:42:50.151222 11 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0320 08:42:50.151625 11 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0320 08:42:50.152587 11 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0320 08:42:50.153030 11 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0320 08:42:50.153867 11 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0320 08:42:50.154568 11 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0320 08:42:50.155071 11 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0320 08:42:50.155919 11 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io W0320 08:42:50.156388 11 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0320 08:42:50.156942 11 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0320 08:42:50.158199 11 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0320 08:42:50.158997 11 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0320 08:42:50.159836 11 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0320 08:42:50.162790 11 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0320 08:42:50.163145 11 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0320 08:42:50.163750 11 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0320 08:42:50.164288 11 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0320 08:42:50.165597 11 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0320 08:42:50.166385 11 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0320 08:42:50.166838 11 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0320 08:42:50.167208 11 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0320 08:42:50.167634 11 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0320 08:42:50.168048 11 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0320 08:42:50.168913 11 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0320 08:42:50.169624 11 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0320 08:42:50.170145 11 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0320 08:42:50.170798 11 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0320 08:42:50.171691 11 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0320 08:42:50.173039 11 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0320 08:42:50.173670 11 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0320 08:42:50.176225 11 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0320 08:42:50.176905 11 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0320 08:42:50.177801 11 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0320 08:42:50.178361 11 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0320 08:42:50.179065 11 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0320 08:42:50.180214 11 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0320 08:42:50.180877 11 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0320 08:42:50.181961 11 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0320 08:42:50.182984 11 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0320 08:42:50.184474 11 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io I0320 08:42:50.220697 1 main.go:235] Termination finished with exit code 0 I0320 08:42:50.220775 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" --- I0320 08:51:25.411719 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0320 08:51:25.412079 13 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0320 08:51:25.412111 13 controller.go:128] Shutting down kubernetes service endpoint reconciler I0320 08:51:25.412245 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0320 08:51:25.422495 13 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0320 08:51:25.422532 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0320 08:51:25.431824 13 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0320 08:51:25.448247 13 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0320 08:51:25.448297 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0320 08:51:25.448514 13 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0320 08:51:25.448539 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0320 08:51:25.448665 13 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0320 08:51:25.455243 13 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0320 08:51:25.455299 13 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0320 08:51:25.455350 13 controller.go:157] Shutting down quota evaluator I0320 08:51:25.455378 13 controller.go:176] quota evaluator worker shutdown I0320 08:51:25.455401 13 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0320 08:51:25.455471 13 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0320 08:51:25.455488 13 controller.go:176] quota evaluator worker shutdown I0320 08:51:25.455516 13 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0320 08:51:25.455545 13 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0320 08:51:25.455576 13 controller.go:132] Ending legacy_token_tracking_controller I0320 08:51:25.455588 13 controller.go:133] Shutting down legacy_token_tracking_controller I0320 08:51:25.455605 13 local_available_controller.go:172] Shutting down LocalAvailability controller I0320 08:51:25.455624 13 system_namespaces_controller.go:76] Shutting down system namespaces controller I0320 08:51:25.455643 13 gc_controller.go:91] Shutting down apiserver lease garbage collector I0320 08:51:25.455742 13 controller.go:176] quota evaluator worker shutdown I0320 08:51:25.455796 13 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0320 08:51:25.455844 13 controller.go:176] quota evaluator worker shutdown I0320 08:51:25.455864 13 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0320 08:51:25.455928 13 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0320 08:51:25.455973 13 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0320 08:51:25.456008 13 controller.go:84] Shutting down OpenAPI AggregationController I0320 08:51:25.456027 13 controller.go:86] Shutting down OpenAPI V3 AggregationController I0320 08:51:25.456058 13 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0320 08:51:25.456386 13 controller.go:120] Shutting down OpenAPI V3 controller I0320 08:51:25.456490 13 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0320 08:51:25.456500 13 autoregister_controller.go:168] Shutting down autoregister controller I0320 08:51:25.456518 13 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0320 08:51:25.456568 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0320 08:51:25.456588 13 naming_controller.go:305] Shutting down NamingConditionController I0320 08:51:25.456604 13 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0320 08:51:25.456556 13 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0320 08:51:25.456618 13 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0320 08:51:25.456603 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0320 08:51:25.456635 13 crd_finalizer.go:281] Shutting down CRDFinalizer I0320 08:51:25.456764 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0320 08:51:25.456594 13 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0320 08:51:25.456682 13 controller.go:170] Shutting down OpenAPI controller I0320 08:51:25.456907 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0320 08:51:25.456953 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0320 08:51:25.455887 13 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0320 08:51:25.456697 13 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0320 08:51:25.456582 13 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0320 08:51:25.456708 13 establishing_controller.go:92] Shutting down EstablishingController I0320 08:51:25.456724 13 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0320 08:51:25.455876 13 controller.go:176] quota evaluator worker shutdown I0320 08:51:25.457703 13 secure_serving.go:258] Stopped listening on [::]:6443 I0320 08:51:25.457745 13 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0320 08:51:25.457775 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0320 08:51:25.458139 13 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" E0320 08:51:25.460436 13 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=15680&timeout=7m25s&timeoutSeconds=445&watch=true" auditID="56710146-d551-4cb3-b48e-689a920f9750" I0320 08:51:27.457787 13 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0320 08:51:27.457856 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0320 08:51:27.461463 13 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0320 08:51:27.463162 13 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0320 08:51:27.464563 13 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0320 08:51:27.465575 13 cacher.go:171] Terminating all watchers from cacher configmaps W0320 08:51:27.477972 13 cacher.go:171] Terminating all watchers from cacher resourcequotas W0320 08:51:27.478635 13 cacher.go:171] Terminating all watchers from cacher namespaces W0320 08:51:27.482594 13 cacher.go:171] Terminating all watchers from cacher endpoints W0320 08:51:27.486702 13 cacher.go:171] Terminating all watchers from cacher limitranges W0320 08:51:27.487950 13 cacher.go:171] Terminating all watchers from cacher secrets W0320 08:51:27.492234 13 cacher.go:171] Terminating all watchers from cacher services W0320 08:51:27.496781 13 cacher.go:171] Terminating all watchers from cacher nodes W0320 08:51:27.497740 13 cacher.go:171] Terminating all watchers from cacher pods W0320 08:51:27.498647 13 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0320 08:51:27.499153 13 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0320 08:51:27.499714 13 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0320 08:51:27.500753 13 cacher.go:171] Terminating all watchers from cacher jobs.batch W0320 08:51:27.501657 13 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0320 08:51:27.502336 13 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0320 08:51:27.506179 13 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0320 08:51:27.506770 13 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0320 08:51:27.507302 13 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0320 08:51:27.507875 13 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0320 08:51:27.508466 13 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0320 08:51:27.508992 13 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0320 08:51:27.509604 13 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0320 08:51:27.510755 13 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0320 08:51:27.513068 13 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0320 08:51:27.514587 13 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0320 08:51:27.516142 13 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0320 08:51:27.517379 13 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0320 08:51:27.519710 13 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0320 08:51:27.520179 13 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0320 08:51:27.520716 13 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0320 08:51:27.521171 13 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0320 08:51:27.523784 13 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0320 08:51:27.525356 13 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0320 08:51:27.527604 13 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0320 08:51:27.528313 13 cacher.go:171] Terminating all watchers from cacher deployments.apps W0320 08:51:27.530442 13 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0320 08:51:27.531493 13 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0320 08:51:27.532900 13 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0320 08:51:27.534014 13 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0320 08:51:27.536326 13 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0320 08:51:27.537746 13 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0320 08:51:27.538388 13 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0320 08:51:27.539636 13 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0320 08:51:27.540073 13 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0320 08:51:27.540611 13 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0320 08:51:27.541264 13 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0320 08:51:27.542158 13 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0320 08:51:27.542605 13 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0320 08:51:27.544756 13 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0320 08:51:27.547302 13 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0320 08:51:27.548096 13 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0320 08:51:27.549133 13 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0320 08:51:27.550175 13 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0320 08:51:27.550669 13 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0320 08:51:27.551020 13 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0320 08:51:27.551618 13 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0320 08:51:27.552586 13 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0320 08:51:27.553287 13 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0320 08:51:27.555292 13 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0320 08:51:27.556029 13 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0320 08:51:27.557069 13 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0320 08:51:27.557838 13 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0320 08:51:27.558734 13 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0320 08:51:27.559603 13 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0320 08:51:27.560492 13 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0320 08:51:27.561151 13 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0320 08:51:27.562239 13 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0320 08:51:27.563099 13 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0320 08:51:27.564012 13 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0320 08:51:27.565157 13 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0320 08:51:27.565795 13 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0320 08:51:27.566565 13 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0320 08:51:27.567089 13 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0320 08:51:27.567557 13 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0320 08:51:27.569084 13 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0320 08:51:27.570314 13 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0320 08:51:27.571568 13 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0320 08:51:27.572596 13 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0320 08:51:27.573901 13 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0320 08:51:27.574413 13 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0320 08:51:27.575415 13 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0320 08:51:27.576515 13 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0320 08:51:27.576982 13 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0320 08:51:27.578444 13 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0320 08:51:27.579337 13 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0320 08:51:27.579957 13 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0320 08:51:27.580601 13 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0320 08:51:27.581152 13 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0320 08:51:27.581629 13 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0320 08:51:27.582426 13 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0320 08:51:27.584490 13 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0320 08:51:27.585282 13 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0320 08:51:27.585790 13 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0320 08:51:27.587555 13 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0320 08:51:27.589216 13 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0320 08:51:27.589946 13 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0320 08:51:27.590537 13 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0320 08:51:27.591321 13 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0320 08:51:27.592408 13 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0320 08:51:27.594332 13 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0320 08:51:27.595127 13 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0320 08:51:27.595580 13 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0320 08:51:27.596862 13 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0320 08:51:27.598809 13 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0320 08:51:27.599875 13 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0320 08:51:27.600488 13 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0320 08:51:27.600915 13 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0320 08:51:27.601621 13 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0320 08:51:27.602786 13 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0320 08:51:27.603550 13 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0320 08:51:27.604304 13 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0320 08:51:27.604717 13 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0320 08:51:27.605668 13 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0320 08:51:27.606444 13 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0320 08:51:27.607306 13 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0320 08:51:27.608529 13 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0320 08:51:27.610023 13 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0320 08:51:27.610736 13 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0320 08:51:27.611372 13 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0320 08:51:27.612000 13 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0320 08:51:27.613319 13 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0320 08:51:27.614868 13 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0320 08:51:27.615453 13 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0320 08:51:27.615887 13 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0320 08:51:27.617285 13 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0320 08:51:27.622916 13 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io I0320 08:51:27.683373 1 main.go:235] Termination finished with exit code 0 I0320 08:51:27.683815 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" ---