--- I0312 18:30:47.762337 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0312 18:30:47.762607 9 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0312 18:30:47.762652 9 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0312 18:30:47.762887 9 controller.go:128] Shutting down kubernetes service endpoint reconciler I0312 18:30:47.823392 9 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0312 18:30:47.823433 9 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0312 18:30:47.860126 9 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0312 18:30:47.896531 9 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0312 18:30:47.896558 9 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0312 18:30:47.896713 9 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0312 18:30:47.896728 9 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0312 18:30:47.896823 9 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0312 18:30:48.633486 9 healthz.go:278] shutdown check failed: readyz [-]shutdown failed: process is shutting down I0312 18:30:50.822036 9 admission.go:602] provider creation error: error fetching namespace "openshift-ingress-canary": unable to find annotation openshift.io/sa.scc.uid-range I0312 18:30:50.822196 9 trace.go:236] Trace[1567900920]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f29892c2-b104-4a4c-a77e-8754639d1623,client:192.168.32.10,api-group:,api-version:v1,name:,subresource:,namespace:openshift-ingress-canary,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openshift-ingress-canary/pods,user-agent:kube-controller-manager/v1.31.14 (linux/amd64) kubernetes/8311c4d/system:serviceaccount:kube-system:daemon-set-controller,verb:POST (12-Mar-2026 18:30:40.819) (total time: 10002ms): Trace[1567900920]: ---"Write to database call failed" len:1475,err:pods "ingress-canary-" is forbidden: error fetching namespace "openshift-ingress-canary": unable to find annotation openshift.io/sa.scc.uid-range 10002ms (18:30:50.822) Trace[1567900920]: [10.00234083s] [10.00234083s] END I0312 18:30:53.245938 9 admission.go:602] provider creation error: error fetching namespace "openshift-console-operator": unable to find annotation openshift.io/sa.scc.uid-range I0312 18:30:53.246235 9 trace.go:236] Trace[947451081]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e9610500-d3a7-4e29-ac1b-5d1eb33230f7,client:192.168.32.10,api-group:,api-version:v1,name:,subresource:,namespace:openshift-console-operator,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openshift-console-operator/pods,user-agent:kube-controller-manager/v1.31.14 (linux/amd64) kubernetes/8311c4d/system:serviceaccount:kube-system:replicaset-controller,verb:POST (12-Mar-2026 18:30:43.243) (total time: 10002ms): Trace[947451081]: ---"Write to database call failed" len:1861,err:pods "console-operator-6c7fb6b958-" is forbidden: error fetching namespace "openshift-console-operator": unable to find annotation openshift.io/sa.scc.uid-range 10001ms (18:30:53.246) Trace[947451081]: [10.002253168s] [10.002253168s] END I0312 18:30:53.246692 9 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0312 18:30:53.246758 9 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0312 18:30:53.246822 9 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0312 18:30:53.246852 9 controller.go:157] Shutting down quota evaluator I0312 18:30:53.246877 9 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0312 18:30:53.246888 9 controller.go:176] quota evaluator worker shutdown I0312 18:30:53.246923 9 controller.go:176] quota evaluator worker shutdown I0312 18:30:53.246950 9 controller.go:176] quota evaluator worker shutdown I0312 18:30:53.246961 9 controller.go:176] quota evaluator worker shutdown I0312 18:30:53.246973 9 controller.go:176] quota evaluator worker shutdown I0312 18:30:53.247235 9 controller.go:86] Shutting down OpenAPI V3 AggregationController I0312 18:30:53.247254 9 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0312 18:30:53.247265 9 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0312 18:30:53.247286 9 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0312 18:30:53.247375 9 controller.go:84] Shutting down OpenAPI AggregationController I0312 18:30:53.247402 9 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0312 18:30:53.247413 9 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0312 18:30:53.247431 9 system_namespaces_controller.go:76] Shutting down system namespaces controller I0312 18:30:53.247460 9 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0312 18:30:53.247542 9 naming_controller.go:305] Shutting down NamingConditionController I0312 18:30:53.247569 9 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0312 18:30:53.247587 9 establishing_controller.go:92] Shutting down EstablishingController I0312 18:30:53.247592 9 local_available_controller.go:172] Shutting down LocalAvailability controller I0312 18:30:53.247607 9 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0312 18:30:53.247610 9 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0312 18:30:53.247624 9 controller.go:170] Shutting down OpenAPI controller I0312 18:30:53.247635 9 crd_finalizer.go:281] Shutting down CRDFinalizer I0312 18:30:53.247659 9 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0312 18:30:53.247684 9 autoregister_controller.go:168] Shutting down autoregister controller I0312 18:30:53.247694 9 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0312 18:30:53.247706 9 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0312 18:30:53.247462 9 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0312 18:30:53.247707 9 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0312 18:30:53.247600 9 controller.go:120] Shutting down OpenAPI V3 controller I0312 18:30:53.247761 9 gc_controller.go:91] Shutting down apiserver lease garbage collector I0312 18:30:53.247795 9 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0312 18:30:53.247824 9 controller.go:132] Ending legacy_token_tracking_controller I0312 18:30:53.247834 9 controller.go:133] Shutting down legacy_token_tracking_controller I0312 18:30:53.247838 9 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0312 18:30:53.247901 9 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0312 18:30:53.248000 9 secure_serving.go:258] Stopped listening on [::]:6443 I0312 18:30:53.248022 9 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0312 18:30:53.248034 9 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0312 18:30:53.248133 9 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0312 18:30:53.248172 9 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0312 18:30:53.248196 9 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0312 18:30:53.248232 9 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0312 18:30:53.248249 9 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0312 18:30:53.248278 9 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" E0312 18:30:53.250416 9 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=12826&timeout=6m17s&timeoutSeconds=377&watch=true" auditID="2070e786-4a96-4cb6-a1b7-7291bb680121" I0312 18:30:55.248230 9 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0312 18:30:55.248275 9 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0312 18:30:55.269103 9 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0312 18:30:55.269677 9 cacher.go:171] Terminating all watchers from cacher resourcequotas W0312 18:30:55.270302 9 cacher.go:171] Terminating all watchers from cacher endpoints W0312 18:30:55.271116 9 cacher.go:171] Terminating all watchers from cacher configmaps W0312 18:30:55.273153 9 cacher.go:171] Terminating all watchers from cacher limitranges W0312 18:30:55.278803 9 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0312 18:30:55.279421 9 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0312 18:30:55.280065 9 cacher.go:171] Terminating all watchers from cacher namespaces W0312 18:30:55.280767 9 cacher.go:171] Terminating all watchers from cacher pods W0312 18:30:55.281819 9 cacher.go:171] Terminating all watchers from cacher nodes W0312 18:30:55.284313 9 cacher.go:171] Terminating all watchers from cacher secrets W0312 18:30:55.292622 9 cacher.go:171] Terminating all watchers from cacher podtemplates W0312 18:30:55.293887 9 cacher.go:171] Terminating all watchers from cacher services W0312 18:30:55.297095 9 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0312 18:30:55.306880 9 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0312 18:30:55.308808 9 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0312 18:30:55.312836 9 cacher.go:171] Terminating all watchers from cacher jobs.batch W0312 18:30:55.314305 9 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0312 18:30:55.316718 9 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0312 18:30:55.317461 9 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0312 18:30:55.318014 9 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0312 18:30:55.319196 9 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0312 18:30:55.319944 9 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0312 18:30:55.320594 9 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0312 18:30:55.320909 9 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0312 18:30:55.321348 9 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0312 18:30:55.322302 9 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0312 18:30:55.326286 9 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0312 18:30:55.328035 9 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0312 18:30:55.328632 9 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0312 18:30:55.329879 9 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0312 18:30:55.330305 9 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0312 18:30:55.330821 9 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0312 18:30:55.331618 9 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0312 18:30:55.332214 9 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0312 18:30:55.332726 9 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0312 18:30:55.333441 9 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0312 18:30:55.333805 9 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0312 18:30:55.334146 9 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0312 18:30:55.336046 9 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0312 18:30:55.337037 9 cacher.go:171] Terminating all watchers from cacher deployments.apps W0312 18:30:55.339903 9 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0312 18:30:55.341759 9 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0312 18:30:55.342967 9 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0312 18:30:55.343671 9 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0312 18:30:55.344331 9 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0312 18:30:55.344945 9 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0312 18:30:55.345743 9 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0312 18:30:55.348603 9 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0312 18:30:55.349011 9 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0312 18:30:55.349344 9 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0312 18:30:55.349664 9 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0312 18:30:55.350198 9 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0312 18:30:55.350583 9 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0312 18:30:55.351737 9 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0312 18:30:55.352140 9 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0312 18:30:55.353069 9 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0312 18:30:55.353564 9 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0312 18:30:55.354352 9 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0312 18:30:55.355538 9 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0312 18:30:55.356142 9 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0312 18:30:55.356690 9 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0312 18:30:55.357615 9 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0312 18:30:55.358928 9 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0312 18:30:55.359429 9 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0312 18:30:55.359929 9 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0312 18:30:55.360370 9 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0312 18:30:55.360784 9 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0312 18:30:55.361222 9 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0312 18:30:55.362145 9 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0312 18:30:55.362818 9 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0312 18:30:55.363056 9 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0312 18:30:55.363350 9 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0312 18:30:55.363758 9 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0312 18:30:55.364245 9 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0312 18:30:55.365209 9 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0312 18:30:55.365725 9 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0312 18:30:55.366119 9 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0312 18:30:55.366557 9 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0312 18:30:55.367045 9 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0312 18:30:55.367614 9 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0312 18:30:55.368041 9 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0312 18:30:55.368413 9 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io W0312 18:30:55.369245 9 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0312 18:30:55.369964 9 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0312 18:30:55.370392 9 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0312 18:30:55.371145 9 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0312 18:30:55.371872 9 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0312 18:30:55.372802 9 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0312 18:30:55.373265 9 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0312 18:30:55.373710 9 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0312 18:30:55.374177 9 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0312 18:30:55.376801 9 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0312 18:30:55.377484 9 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0312 18:30:55.377922 9 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0312 18:30:55.379408 9 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0312 18:30:55.379929 9 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0312 18:30:55.380433 9 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0312 18:30:55.380854 9 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0312 18:30:55.381461 9 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0312 18:30:55.382176 9 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0312 18:30:55.383245 9 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0312 18:30:55.385817 9 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0312 18:30:55.386635 9 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0312 18:30:55.387680 9 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0312 18:30:55.388266 9 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0312 18:30:55.389258 9 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0312 18:30:55.390140 9 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0312 18:30:55.391021 9 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0312 18:30:55.392460 9 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0312 18:30:55.392946 9 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0312 18:30:55.394576 9 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0312 18:30:55.395315 9 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0312 18:30:55.396164 9 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0312 18:30:55.397145 9 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0312 18:30:55.398261 9 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0312 18:30:55.399180 9 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0312 18:30:55.399836 9 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io W0312 18:30:55.400377 9 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0312 18:30:55.401115 9 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0312 18:30:55.401844 9 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0312 18:30:55.402536 9 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0312 18:30:55.402983 9 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0312 18:30:55.403454 9 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0312 18:30:55.403761 9 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0312 18:30:55.404146 9 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0312 18:30:55.404689 9 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0312 18:30:55.405197 9 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0312 18:30:55.406689 9 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0312 18:30:55.407888 9 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0312 18:30:55.408892 9 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0312 18:30:55.409872 9 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0312 18:30:55.410337 9 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0312 18:30:55.410814 9 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0312 18:30:55.411315 9 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0312 18:30:55.411756 9 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0312 18:30:55.412592 9 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0312 18:30:55.412941 9 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0312 18:30:55.413474 9 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0312 18:30:55.414242 9 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0312 18:30:55.415050 9 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0312 18:30:55.416476 9 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0312 18:30:55.417477 9 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0312 18:30:55.418139 9 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0312 18:30:55.418578 9 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0312 18:30:55.419081 9 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0312 18:30:55.420134 9 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0312 18:30:55.420499 9 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0312 18:30:55.421091 9 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0312 18:30:55.421488 9 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0312 18:30:55.422208 9 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0312 18:30:55.422697 9 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0312 18:30:55.423095 9 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0312 18:30:55.424068 9 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0312 18:30:55.424944 9 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0312 18:30:55.425929 9 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0312 18:30:55.426384 9 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0312 18:30:55.430133 9 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0312 18:30:55.430997 9 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0312 18:30:55.431843 9 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0312 18:30:55.432269 9 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0312 18:30:55.432739 9 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0312 18:30:55.433312 9 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0312 18:30:55.434086 9 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0312 18:30:55.435008 9 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0312 18:30:55.435583 9 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0312 18:30:55.436066 9 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0312 18:30:55.436575 9 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0312 18:30:55.437021 9 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0312 18:30:55.437647 9 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0312 18:30:55.438598 9 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0312 18:30:55.439298 9 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0312 18:30:55.439799 9 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0312 18:30:55.440330 9 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0312 18:30:55.442422 9 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0312 18:30:55.442948 9 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0312 18:30:55.444109 9 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0312 18:30:55.444806 9 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0312 18:30:55.445497 9 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0312 18:30:55.446220 9 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0312 18:30:55.446809 9 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0312 18:30:55.447926 9 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0312 18:30:55.448197 9 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org I0312 18:30:55.482295 1 main.go:235] Termination finished with exit code 0 I0312 18:30:55.482359 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" --- I0312 18:35:27.440423 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0312 18:35:27.440659 16 controller.go:128] Shutting down kubernetes service endpoint reconciler I0312 18:35:27.440660 16 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0312 18:35:27.440813 16 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0312 18:35:27.449277 16 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0312 18:35:27.449331 16 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0312 18:35:27.452200 16 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0312 18:35:27.469083 16 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0312 18:35:27.469119 16 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0312 18:35:27.469160 16 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0312 18:35:27.469184 16 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0312 18:35:27.469233 16 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0312 18:35:27.506276 16 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0312 18:35:27.506318 16 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0312 18:35:27.506345 16 controller.go:157] Shutting down quota evaluator I0312 18:35:27.506365 16 controller.go:176] quota evaluator worker shutdown I0312 18:35:27.506378 16 controller.go:176] quota evaluator worker shutdown I0312 18:35:27.506384 16 controller.go:176] quota evaluator worker shutdown I0312 18:35:27.506392 16 controller.go:176] quota evaluator worker shutdown I0312 18:35:27.506410 16 controller.go:176] quota evaluator worker shutdown I0312 18:35:27.506424 16 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0312 18:35:27.506597 16 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0312 18:35:27.506631 16 controller.go:132] Ending legacy_token_tracking_controller I0312 18:35:27.506766 16 controller.go:133] Shutting down legacy_token_tracking_controller I0312 18:35:27.506784 16 gc_controller.go:91] Shutting down apiserver lease garbage collector I0312 18:35:27.506786 16 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0312 18:35:27.506820 16 controller.go:170] Shutting down OpenAPI controller I0312 18:35:27.506823 16 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0312 18:35:27.506848 16 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0312 18:35:27.506882 16 naming_controller.go:305] Shutting down NamingConditionController I0312 18:35:27.506903 16 establishing_controller.go:92] Shutting down EstablishingController I0312 18:35:27.506935 16 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0312 18:35:27.506962 16 crd_finalizer.go:281] Shutting down CRDFinalizer I0312 18:35:27.506971 16 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0312 18:35:27.506986 16 controller.go:84] Shutting down OpenAPI AggregationController I0312 18:35:27.506992 16 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0312 18:35:27.507018 16 system_namespaces_controller.go:76] Shutting down system namespaces controller I0312 18:35:27.507018 16 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0312 18:35:27.507029 16 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0312 18:35:27.507048 16 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0312 18:35:27.507056 16 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0312 18:35:27.507075 16 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0312 18:35:27.506794 16 local_available_controller.go:172] Shutting down LocalAvailability controller I0312 18:35:27.506654 16 autoregister_controller.go:168] Shutting down autoregister controller I0312 18:35:27.506857 16 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0312 18:35:27.507189 16 secure_serving.go:258] Stopped listening on [::]:6443 I0312 18:35:27.507207 16 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0312 18:35:27.507062 16 controller.go:86] Shutting down OpenAPI V3 AggregationController I0312 18:35:27.507224 16 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0312 18:35:27.506735 16 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0312 18:35:27.507371 16 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0312 18:35:27.507407 16 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0312 18:35:27.507438 16 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0312 18:35:27.507463 16 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0312 18:35:27.506728 16 controller.go:120] Shutting down OpenAPI V3 controller I0312 18:35:27.507577 16 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0312 18:35:27.507623 16 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0312 18:35:27.507638 16 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0312 18:35:27.507664 16 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0312 18:35:27.506709 16 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller E0312 18:35:27.508816 16 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=15711&timeout=8m6s&timeoutSeconds=486&watch=true" auditID="fad39277-72ee-4947-8fe7-19574c5703ab" I0312 18:35:27.510150 16 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0312 18:35:29.507833 16 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0312 18:35:29.507894 16 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0312 18:35:29.591292 16 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0312 18:35:29.592604 16 cacher.go:171] Terminating all watchers from cacher configmaps W0312 18:35:29.600237 16 cacher.go:171] Terminating all watchers from cacher podtemplates W0312 18:35:29.603410 16 cacher.go:171] Terminating all watchers from cacher limitranges W0312 18:35:29.607507 16 cacher.go:171] Terminating all watchers from cacher namespaces W0312 18:35:29.608494 16 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0312 18:35:29.609436 16 cacher.go:171] Terminating all watchers from cacher pods W0312 18:35:29.611985 16 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0312 18:35:29.613517 16 cacher.go:171] Terminating all watchers from cacher services W0312 18:35:29.630015 16 cacher.go:171] Terminating all watchers from cacher endpoints W0312 18:35:29.632198 16 cacher.go:171] Terminating all watchers from cacher resourcequotas W0312 18:35:29.632525 16 cacher.go:171] Terminating all watchers from cacher secrets W0312 18:35:29.638443 16 cacher.go:171] Terminating all watchers from cacher nodes W0312 18:35:29.639956 16 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0312 18:35:29.641182 16 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0312 18:35:29.645349 16 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0312 18:35:29.646445 16 cacher.go:171] Terminating all watchers from cacher jobs.batch W0312 18:35:29.647360 16 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0312 18:35:29.648493 16 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0312 18:35:29.648901 16 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0312 18:35:29.649266 16 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0312 18:35:29.651148 16 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0312 18:35:29.651976 16 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0312 18:35:29.652313 16 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0312 18:35:29.652702 16 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0312 18:35:29.653030 16 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0312 18:35:29.655372 16 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0312 18:35:29.656951 16 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0312 18:35:29.658374 16 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0312 18:35:29.659507 16 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0312 18:35:29.662962 16 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0312 18:35:29.663474 16 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0312 18:35:29.664325 16 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0312 18:35:29.665253 16 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0312 18:35:29.666133 16 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0312 18:35:29.666489 16 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0312 18:35:29.667377 16 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0312 18:35:29.667765 16 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0312 18:35:29.668335 16 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0312 18:35:29.668806 16 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0312 18:35:29.671276 16 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0312 18:35:29.672017 16 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0312 18:35:29.672850 16 cacher.go:171] Terminating all watchers from cacher deployments.apps W0312 18:35:29.673883 16 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0312 18:35:29.674848 16 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0312 18:35:29.675426 16 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0312 18:35:29.676020 16 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0312 18:35:29.677610 16 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0312 18:35:29.678421 16 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0312 18:35:29.679232 16 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0312 18:35:29.679638 16 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0312 18:35:29.680389 16 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0312 18:35:29.681231 16 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0312 18:35:29.681693 16 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0312 18:35:29.682138 16 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io W0312 18:35:29.682615 16 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0312 18:35:29.683531 16 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0312 18:35:29.684000 16 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0312 18:35:29.684392 16 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0312 18:35:29.685036 16 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0312 18:35:29.685277 16 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0312 18:35:29.685772 16 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0312 18:35:29.687070 16 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0312 18:35:29.687591 16 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0312 18:35:29.688044 16 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0312 18:35:29.688400 16 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0312 18:35:29.689509 16 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0312 18:35:29.690150 16 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0312 18:35:29.690659 16 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0312 18:35:29.691582 16 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0312 18:35:29.692813 16 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0312 18:35:29.693176 16 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0312 18:35:29.697146 16 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0312 18:35:29.697391 16 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0312 18:35:29.697812 16 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0312 18:35:29.698339 16 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0312 18:35:29.698948 16 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0312 18:35:29.699491 16 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0312 18:35:29.699980 16 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0312 18:35:29.700704 16 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0312 18:35:29.703067 16 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0312 18:35:29.703766 16 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0312 18:35:29.704303 16 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0312 18:35:29.706183 16 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0312 18:35:29.706621 16 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0312 18:35:29.707133 16 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0312 18:35:29.707772 16 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0312 18:35:29.708335 16 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0312 18:35:29.708580 16 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0312 18:35:29.708989 16 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0312 18:35:29.709588 16 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0312 18:35:29.710088 16 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0312 18:35:29.710665 16 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0312 18:35:29.711191 16 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0312 18:35:29.711436 16 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0312 18:35:29.711887 16 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0312 18:35:29.712205 16 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0312 18:35:29.712476 16 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0312 18:35:29.713057 16 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0312 18:35:29.713744 16 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0312 18:35:29.714731 16 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0312 18:35:29.715250 16 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0312 18:35:29.715824 16 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0312 18:35:29.716261 16 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0312 18:35:29.716699 16 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0312 18:35:29.717043 16 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0312 18:35:29.717634 16 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0312 18:35:29.718092 16 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0312 18:35:29.718601 16 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0312 18:35:29.719072 16 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0312 18:35:29.719415 16 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0312 18:35:29.719911 16 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0312 18:35:29.720351 16 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0312 18:35:29.720814 16 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0312 18:35:29.721398 16 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0312 18:35:29.722218 16 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0312 18:35:29.722586 16 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0312 18:35:29.722881 16 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0312 18:35:29.723257 16 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0312 18:35:29.723762 16 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0312 18:35:29.724133 16 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0312 18:35:29.726557 16 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io W0312 18:35:29.726894 16 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0312 18:35:29.727477 16 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0312 18:35:29.727799 16 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0312 18:35:29.728168 16 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0312 18:35:29.728708 16 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0312 18:35:29.729310 16 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0312 18:35:29.729794 16 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0312 18:35:29.730369 16 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0312 18:35:29.730806 16 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0312 18:35:29.731435 16 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0312 18:35:29.732011 16 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0312 18:35:29.732667 16 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0312 18:35:29.733364 16 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0312 18:35:29.734803 16 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0312 18:35:29.735281 16 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0312 18:35:29.736127 16 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0312 18:35:29.736765 16 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0312 18:35:29.737276 16 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0312 18:35:29.737789 16 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0312 18:35:29.738492 16 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0312 18:35:29.738756 16 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0312 18:35:29.739083 16 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0312 18:35:29.739400 16 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0312 18:35:29.739643 16 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0312 18:35:29.739869 16 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0312 18:35:29.740407 16 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0312 18:35:29.740756 16 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0312 18:35:29.741248 16 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0312 18:35:29.741655 16 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0312 18:35:29.743526 16 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0312 18:35:29.744608 16 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0312 18:35:29.745018 16 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0312 18:35:29.745983 16 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0312 18:35:29.746378 16 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0312 18:35:29.746799 16 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0312 18:35:29.747144 16 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0312 18:35:29.747495 16 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0312 18:35:29.747986 16 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0312 18:35:29.748564 16 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0312 18:35:29.750027 16 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0312 18:35:29.750607 16 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0312 18:35:29.751107 16 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0312 18:35:29.751716 16 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0312 18:35:29.752098 16 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0312 18:35:29.753036 16 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0312 18:35:29.754299 16 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0312 18:35:29.754809 16 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0312 18:35:29.755139 16 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0312 18:35:29.755467 16 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0312 18:35:29.755968 16 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0312 18:35:29.756580 16 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0312 18:35:29.757226 16 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0312 18:35:29.757870 16 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0312 18:35:29.758565 16 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0312 18:35:29.759110 16 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0312 18:35:29.760392 16 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0312 18:35:29.761109 16 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0312 18:35:29.761353 16 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0312 18:35:29.761753 16 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0312 18:35:29.762109 16 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0312 18:35:29.762595 16 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org I0312 18:35:29.794805 1 main.go:235] Termination finished with exit code 0 I0312 18:35:29.795012 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" ---