--- I0319 12:01:47.579806 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0319 12:01:47.580282 13 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0319 12:01:47.580314 13 controller.go:128] Shutting down kubernetes service endpoint reconciler I0319 12:01:47.580335 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0319 12:01:47.587587 13 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0319 12:01:47.587635 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0319 12:01:47.592614 13 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0319 12:01:47.618254 13 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0319 12:01:47.618289 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0319 12:01:47.618513 13 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0319 12:01:47.618533 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0319 12:01:47.618772 13 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0319 12:01:47.640362 13 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0319 12:01:47.640409 13 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0319 12:01:47.640428 13 controller.go:157] Shutting down quota evaluator I0319 12:01:47.640450 13 controller.go:176] quota evaluator worker shutdown I0319 12:01:47.640461 13 controller.go:176] quota evaluator worker shutdown I0319 12:01:47.640497 13 controller.go:176] quota evaluator worker shutdown I0319 12:01:47.640432 13 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0319 12:01:47.640556 13 controller.go:176] quota evaluator worker shutdown I0319 12:01:47.640670 13 autoregister_controller.go:168] Shutting down autoregister controller I0319 12:01:47.640694 13 controller.go:170] Shutting down OpenAPI controller I0319 12:01:47.640765 13 crd_finalizer.go:281] Shutting down CRDFinalizer I0319 12:01:47.640784 13 naming_controller.go:305] Shutting down NamingConditionController I0319 12:01:47.640799 13 gc_controller.go:91] Shutting down apiserver lease garbage collector I0319 12:01:47.640806 13 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0319 12:01:47.640816 13 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0319 12:01:47.640840 13 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0319 12:01:47.640849 13 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0319 12:01:47.640840 13 establishing_controller.go:92] Shutting down EstablishingController I0319 12:01:47.640873 13 system_namespaces_controller.go:76] Shutting down system namespaces controller I0319 12:01:47.640882 13 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0319 12:01:47.640894 13 controller.go:120] Shutting down OpenAPI V3 controller I0319 12:01:47.640932 13 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0319 12:01:47.641010 13 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0319 12:01:47.640466 13 controller.go:176] quota evaluator worker shutdown I0319 12:01:47.641074 13 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0319 12:01:47.640783 13 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0319 12:01:47.641163 13 local_available_controller.go:172] Shutting down LocalAvailability controller I0319 12:01:47.641183 13 controller.go:132] Ending legacy_token_tracking_controller I0319 12:01:47.641191 13 controller.go:133] Shutting down legacy_token_tracking_controller I0319 12:01:47.640933 13 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0319 12:01:47.641236 13 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0319 12:01:47.641305 13 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0319 12:01:47.640679 13 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0319 12:01:47.641351 13 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0319 12:01:47.641611 13 controller.go:86] Shutting down OpenAPI V3 AggregationController I0319 12:01:47.641672 13 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0319 12:01:47.641697 13 controller.go:84] Shutting down OpenAPI AggregationController I0319 12:01:47.641784 13 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0319 12:01:47.641847 13 secure_serving.go:258] Stopped listening on [::]:6443 I0319 12:01:47.641873 13 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0319 12:01:47.641898 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0319 12:01:47.641889 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0319 12:01:47.641997 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" E0319 12:01:47.643167 13 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=11191&timeout=8m45s&timeoutSeconds=525&watch=true" auditID="0e2b8b54-a99c-4a70-b2d5-4af06638863a" I0319 12:01:47.643245 13 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0319 12:01:47.643274 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0319 12:01:47.643304 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0319 12:01:47.643322 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0319 12:01:47.643339 13 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0319 12:01:47.643357 13 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0319 12:01:49.642089 13 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0319 12:01:49.642135 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0319 12:01:49.646582 13 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0319 12:01:49.647208 13 cacher.go:171] Terminating all watchers from cacher configmaps W0319 12:01:49.651247 13 cacher.go:171] Terminating all watchers from cacher services W0319 12:01:49.653068 13 cacher.go:171] Terminating all watchers from cacher limitranges W0319 12:01:49.655048 13 cacher.go:171] Terminating all watchers from cacher resourcequotas W0319 12:01:49.655442 13 cacher.go:171] Terminating all watchers from cacher namespaces W0319 12:01:49.656236 13 cacher.go:171] Terminating all watchers from cacher endpoints W0319 12:01:49.656689 13 cacher.go:171] Terminating all watchers from cacher podtemplates W0319 12:01:49.657159 13 cacher.go:171] Terminating all watchers from cacher nodes W0319 12:01:49.658245 13 cacher.go:171] Terminating all watchers from cacher secrets W0319 12:01:49.660256 13 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0319 12:01:49.664295 13 cacher.go:171] Terminating all watchers from cacher pods W0319 12:01:49.666243 13 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0319 12:01:49.667428 13 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0319 12:01:49.667911 13 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0319 12:01:49.668354 13 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0319 12:01:49.669529 13 cacher.go:171] Terminating all watchers from cacher jobs.batch W0319 12:01:49.670377 13 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0319 12:01:49.671668 13 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0319 12:01:49.672519 13 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0319 12:01:49.673028 13 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0319 12:01:49.673475 13 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0319 12:01:49.675818 13 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0319 12:01:49.677070 13 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0319 12:01:49.679893 13 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0319 12:01:49.680477 13 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0319 12:01:49.681403 13 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0319 12:01:49.682665 13 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0319 12:01:49.688017 13 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0319 12:01:49.688825 13 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0319 12:01:49.690068 13 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0319 12:01:49.690316 13 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0319 12:01:49.690657 13 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0319 12:01:49.691242 13 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0319 12:01:49.692364 13 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0319 12:01:49.693425 13 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0319 12:01:49.695016 13 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0319 12:01:49.695678 13 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0319 12:01:49.696219 13 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0319 12:01:49.696703 13 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0319 12:01:49.697972 13 cacher.go:171] Terminating all watchers from cacher deployments.apps W0319 12:01:49.699462 13 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0319 12:01:49.700063 13 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0319 12:01:49.700579 13 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0319 12:01:49.704212 13 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0319 12:01:49.705711 13 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0319 12:01:49.706423 13 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0319 12:01:49.708188 13 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0319 12:01:49.711058 13 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0319 12:01:49.711491 13 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0319 12:01:49.711785 13 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0319 12:01:49.712554 13 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0319 12:01:49.713039 13 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0319 12:01:49.713540 13 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0319 12:01:49.714249 13 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0319 12:01:49.715310 13 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0319 12:01:49.716568 13 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0319 12:01:49.717406 13 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0319 12:01:49.718007 13 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0319 12:01:49.718470 13 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0319 12:01:49.719273 13 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0319 12:01:49.719581 13 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0319 12:01:49.720174 13 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0319 12:01:49.720677 13 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0319 12:01:49.721447 13 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0319 12:01:49.722554 13 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0319 12:01:49.723066 13 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0319 12:01:49.723676 13 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0319 12:01:49.724511 13 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0319 12:01:49.725449 13 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0319 12:01:49.726029 13 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0319 12:01:49.727321 13 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0319 12:01:49.727921 13 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0319 12:01:49.728319 13 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0319 12:01:49.729583 13 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0319 12:01:49.730246 13 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0319 12:01:49.731173 13 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0319 12:01:49.731600 13 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0319 12:01:49.731990 13 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0319 12:01:49.732454 13 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0319 12:01:49.733032 13 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0319 12:01:49.733799 13 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0319 12:01:49.734356 13 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0319 12:01:49.734751 13 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0319 12:01:49.735201 13 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0319 12:01:49.737257 13 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0319 12:01:49.737755 13 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0319 12:01:49.738121 13 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0319 12:01:49.738825 13 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0319 12:01:49.739348 13 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0319 12:01:49.739955 13 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0319 12:01:49.740678 13 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0319 12:01:49.741062 13 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0319 12:01:49.741788 13 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0319 12:01:49.742298 13 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0319 12:01:49.742925 13 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0319 12:01:49.743335 13 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0319 12:01:49.744047 13 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0319 12:01:49.744453 13 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0319 12:01:49.745233 13 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0319 12:01:49.745776 13 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0319 12:01:49.746802 13 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io W0319 12:01:49.747239 13 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0319 12:01:49.747755 13 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0319 12:01:49.748308 13 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0319 12:01:49.749024 13 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0319 12:01:49.751179 13 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0319 12:01:49.752247 13 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0319 12:01:49.752916 13 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0319 12:01:49.753591 13 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0319 12:01:49.754073 13 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0319 12:01:49.754623 13 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0319 12:01:49.755494 13 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0319 12:01:49.756169 13 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0319 12:01:49.756540 13 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0319 12:01:49.757228 13 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0319 12:01:49.757781 13 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0319 12:01:49.758396 13 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0319 12:01:49.759262 13 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0319 12:01:49.760583 13 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0319 12:01:49.761141 13 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0319 12:01:49.761597 13 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0319 12:01:49.762071 13 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0319 12:01:49.763412 13 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0319 12:01:49.764134 13 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0319 12:01:49.764597 13 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0319 12:01:49.765003 13 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0319 12:01:49.765436 13 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0319 12:01:49.766028 13 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0319 12:01:49.766411 13 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io W0319 12:01:49.766791 13 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0319 12:01:49.767205 13 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0319 12:01:49.767791 13 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0319 12:01:49.768168 13 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0319 12:01:49.768654 13 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0319 12:01:49.769109 13 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0319 12:01:49.769478 13 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0319 12:01:49.769941 13 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0319 12:01:49.770666 13 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0319 12:01:49.771107 13 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0319 12:01:49.771841 13 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0319 12:01:49.772631 13 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0319 12:01:49.774596 13 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0319 12:01:49.775299 13 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0319 12:01:49.775867 13 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0319 12:01:49.776366 13 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0319 12:01:49.776788 13 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0319 12:01:49.777396 13 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0319 12:01:49.779563 13 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0319 12:01:49.780575 13 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0319 12:01:49.780940 13 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0319 12:01:49.781314 13 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0319 12:01:49.781714 13 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0319 12:01:49.782288 13 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0319 12:01:49.782920 13 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0319 12:01:49.784247 13 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0319 12:01:49.785135 13 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0319 12:01:49.785910 13 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0319 12:01:49.786368 13 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0319 12:01:49.786932 13 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0319 12:01:49.787307 13 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0319 12:01:49.788284 13 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0319 12:01:49.790312 13 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0319 12:01:49.790775 13 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0319 12:01:49.791877 13 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0319 12:01:49.792478 13 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0319 12:01:49.792906 13 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0319 12:01:49.793366 13 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0319 12:01:49.794706 13 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0319 12:01:49.795439 13 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0319 12:01:49.796005 13 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0319 12:01:49.796843 13 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0319 12:01:49.797313 13 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0319 12:01:49.797656 13 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0319 12:01:49.798648 13 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0319 12:01:49.799307 13 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0319 12:01:49.800048 13 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0319 12:01:49.801010 13 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0319 12:01:49.801454 13 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0319 12:01:49.801794 13 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0319 12:01:49.802233 13 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0319 12:01:49.803774 13 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0319 12:01:49.804291 13 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io I0319 12:01:49.831711 1 main.go:235] Termination finished with exit code 0 I0319 12:01:49.831794 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" --- I0319 12:09:56.881042 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0319 12:09:56.881461 12 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0319 12:09:56.881498 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0319 12:09:56.881698 12 controller.go:128] Shutting down kubernetes service endpoint reconciler I0319 12:09:56.891459 12 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0319 12:09:56.891495 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0319 12:09:56.903652 12 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0319 12:09:56.917435 12 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0319 12:09:56.917662 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0319 12:09:56.917879 12 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0319 12:09:56.917897 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0319 12:09:56.918029 12 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0319 12:10:00.396016 12 trace.go:236] Trace[658659284]: "Get" accept:application/json,audit-id:ff405601-aa89-448f-95d7-1961098208ec,client:192.168.32.10,api-group:config.openshift.io,api-version:v1,name:cluster,subresource:,namespace:,protocol:HTTP/2.0,resource:featuregates,scope:resource,url:/apis/config.openshift.io/v1/featuregates/cluster,user-agent:cluster-version-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (19-Mar-2026 12:09:34.298) (total time: 26097ms): Trace[658659284]: ---"About to write a response" 26097ms (12:10:00.395) Trace[658659284]: [26.097745722s] [26.097745722s] END I0319 12:10:00.396318 12 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0319 12:10:00.396357 12 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0319 12:10:00.396400 12 controller.go:157] Shutting down quota evaluator I0319 12:10:00.396421 12 controller.go:176] quota evaluator worker shutdown I0319 12:10:00.396441 12 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0319 12:10:00.396494 12 controller.go:84] Shutting down OpenAPI AggregationController I0319 12:10:00.396499 12 controller.go:176] quota evaluator worker shutdown I0319 12:10:00.396522 12 controller.go:176] quota evaluator worker shutdown I0319 12:10:00.396532 12 controller.go:176] quota evaluator worker shutdown I0319 12:10:00.396495 12 controller.go:176] quota evaluator worker shutdown I0319 12:10:00.396653 12 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0319 12:10:00.396743 12 controller.go:170] Shutting down OpenAPI controller I0319 12:10:00.396800 12 autoregister_controller.go:168] Shutting down autoregister controller I0319 12:10:00.396844 12 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0319 12:10:00.396873 12 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0319 12:10:00.396843 12 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0319 12:10:00.396877 12 crd_finalizer.go:281] Shutting down CRDFinalizer I0319 12:10:00.396860 12 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0319 12:10:00.397136 12 controller.go:86] Shutting down OpenAPI V3 AggregationController I0319 12:10:00.397161 12 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0319 12:10:00.397170 12 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0319 12:10:00.396884 12 naming_controller.go:305] Shutting down NamingConditionController I0319 12:10:00.397184 12 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0319 12:10:00.396868 12 establishing_controller.go:92] Shutting down EstablishingController I0319 12:10:00.396891 12 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0319 12:10:00.396900 12 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0319 12:10:00.396657 12 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0319 12:10:00.397295 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0319 12:10:00.397145 12 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0319 12:10:00.397321 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0319 12:10:00.397337 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0319 12:10:00.396946 12 controller.go:132] Ending legacy_token_tracking_controller I0319 12:10:00.397353 12 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0319 12:10:00.397359 12 controller.go:133] Shutting down legacy_token_tracking_controller I0319 12:10:00.397372 12 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0319 12:10:00.396864 12 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0319 12:10:00.397398 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0319 12:10:00.396953 12 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0319 12:10:00.396971 12 system_namespaces_controller.go:76] Shutting down system namespaces controller I0319 12:10:00.396978 12 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0319 12:10:00.397013 12 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0319 12:10:00.397035 12 controller.go:120] Shutting down OpenAPI V3 controller I0319 12:10:00.396938 12 local_available_controller.go:172] Shutting down LocalAvailability controller I0319 12:10:00.396963 12 gc_controller.go:91] Shutting down apiserver lease garbage collector I0319 12:10:00.397493 12 secure_serving.go:258] Stopped listening on [::]:6443 I0319 12:10:00.397590 12 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0319 12:10:00.397611 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0319 12:10:00.397421 12 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0319 12:10:00.398659 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" E0319 12:10:00.401016 12 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=15224&timeout=5m10s&timeoutSeconds=310&watch=true" auditID="272eca1e-9608-4401-a854-d30a62868028" I0319 12:10:02.398219 12 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0319 12:10:02.398263 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0319 12:10:02.400780 12 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0319 12:10:02.401404 12 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0319 12:10:02.401827 12 cacher.go:171] Terminating all watchers from cacher resourcequotas W0319 12:10:02.403459 12 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0319 12:10:02.404121 12 cacher.go:171] Terminating all watchers from cacher nodes W0319 12:10:02.405917 12 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0319 12:10:02.410973 12 cacher.go:171] Terminating all watchers from cacher configmaps W0319 12:10:02.414246 12 cacher.go:171] Terminating all watchers from cacher pods W0319 12:10:02.417021 12 cacher.go:171] Terminating all watchers from cacher namespaces W0319 12:10:02.419247 12 cacher.go:171] Terminating all watchers from cacher secrets W0319 12:10:02.421624 12 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0319 12:10:02.422344 12 cacher.go:171] Terminating all watchers from cacher services W0319 12:10:02.425998 12 cacher.go:171] Terminating all watchers from cacher limitranges W0319 12:10:02.426863 12 cacher.go:171] Terminating all watchers from cacher endpoints W0319 12:10:02.428290 12 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0319 12:10:02.429057 12 cacher.go:171] Terminating all watchers from cacher jobs.batch W0319 12:10:02.429484 12 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0319 12:10:02.430101 12 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0319 12:10:02.430625 12 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0319 12:10:02.431065 12 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0319 12:10:02.431447 12 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0319 12:10:02.432518 12 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0319 12:10:02.433018 12 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0319 12:10:02.433481 12 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0319 12:10:02.433940 12 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0319 12:10:02.440577 12 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0319 12:10:02.447252 12 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0319 12:10:02.449305 12 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0319 12:10:02.449898 12 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0319 12:10:02.450485 12 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0319 12:10:02.451297 12 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0319 12:10:02.451919 12 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0319 12:10:02.453339 12 cacher.go:171] Terminating all watchers from cacher deployments.apps W0319 12:10:02.455361 12 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0319 12:10:02.456050 12 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0319 12:10:02.456846 12 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0319 12:10:02.457544 12 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0319 12:10:02.458091 12 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0319 12:10:02.458549 12 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0319 12:10:02.459210 12 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0319 12:10:02.460805 12 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0319 12:10:02.462333 12 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0319 12:10:02.462708 12 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0319 12:10:02.463403 12 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0319 12:10:02.463900 12 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0319 12:10:02.464325 12 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0319 12:10:02.465498 12 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0319 12:10:02.466342 12 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0319 12:10:02.466927 12 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0319 12:10:02.467348 12 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0319 12:10:02.469991 12 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0319 12:10:02.470423 12 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0319 12:10:02.470914 12 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0319 12:10:02.471288 12 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0319 12:10:02.471689 12 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0319 12:10:02.472387 12 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0319 12:10:02.472887 12 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0319 12:10:02.473227 12 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0319 12:10:02.474709 12 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0319 12:10:02.475803 12 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0319 12:10:02.476613 12 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0319 12:10:02.477141 12 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0319 12:10:02.477812 12 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0319 12:10:02.478138 12 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0319 12:10:02.478678 12 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0319 12:10:02.479217 12 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0319 12:10:02.479795 12 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0319 12:10:02.480255 12 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0319 12:10:02.481123 12 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0319 12:10:02.481850 12 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0319 12:10:02.482625 12 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0319 12:10:02.483231 12 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0319 12:10:02.483807 12 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0319 12:10:02.484250 12 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0319 12:10:02.484931 12 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0319 12:10:02.485561 12 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0319 12:10:02.487012 12 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0319 12:10:02.488070 12 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0319 12:10:02.488660 12 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0319 12:10:02.489104 12 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0319 12:10:02.489560 12 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0319 12:10:02.490034 12 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0319 12:10:02.490416 12 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0319 12:10:02.491378 12 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0319 12:10:02.491868 12 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0319 12:10:02.492279 12 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0319 12:10:02.492902 12 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0319 12:10:02.493501 12 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0319 12:10:02.494332 12 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0319 12:10:02.494968 12 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0319 12:10:02.495384 12 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0319 12:10:02.498940 12 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0319 12:10:02.499675 12 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0319 12:10:02.500097 12 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0319 12:10:02.500943 12 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0319 12:10:02.501808 12 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0319 12:10:02.502263 12 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0319 12:10:02.503512 12 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0319 12:10:02.503897 12 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0319 12:10:02.504624 12 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0319 12:10:02.505095 12 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0319 12:10:02.507932 12 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0319 12:10:02.508394 12 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0319 12:10:02.508933 12 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0319 12:10:02.509276 12 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0319 12:10:02.509660 12 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0319 12:10:02.510014 12 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0319 12:10:02.510694 12 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0319 12:10:02.511416 12 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0319 12:10:02.512264 12 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0319 12:10:02.512677 12 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0319 12:10:02.513221 12 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0319 12:10:02.513773 12 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0319 12:10:02.515222 12 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0319 12:10:02.515911 12 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0319 12:10:02.516622 12 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0319 12:10:02.517090 12 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0319 12:10:02.517664 12 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0319 12:10:02.519013 12 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0319 12:10:02.519656 12 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0319 12:10:02.520099 12 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0319 12:10:02.520453 12 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0319 12:10:02.524950 12 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0319 12:10:02.525376 12 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0319 12:10:02.526946 12 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0319 12:10:02.527800 12 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0319 12:10:02.528307 12 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0319 12:10:02.530101 12 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0319 12:10:02.530506 12 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0319 12:10:02.530970 12 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0319 12:10:02.531667 12 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0319 12:10:02.532116 12 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0319 12:10:02.533582 12 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0319 12:10:02.534005 12 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0319 12:10:02.534313 12 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0319 12:10:02.534978 12 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0319 12:10:02.536480 12 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0319 12:10:02.536977 12 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0319 12:10:02.537346 12 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0319 12:10:02.538820 12 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0319 12:10:02.539440 12 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0319 12:10:02.539633 12 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0319 12:10:02.540081 12 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io I0319 12:10:02.589285 1 main.go:235] Termination finished with exit code 0 I0319 12:10:02.589342 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" ---