--- I0308 03:54:35.147133 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0308 03:54:35.151874 12 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0308 03:54:35.151944 12 controller.go:128] Shutting down kubernetes service endpoint reconciler I0308 03:54:35.152052 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0308 03:54:35.170179 12 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0308 03:54:35.170242 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0308 03:54:35.173151 12 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0308 03:54:35.187598 12 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0308 03:54:35.187622 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0308 03:54:35.187768 12 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0308 03:54:35.187787 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0308 03:54:35.187886 12 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0308 03:54:35.187899 12 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0308 03:54:35.187910 12 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0308 03:54:35.187981 12 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0308 03:54:35.188009 12 controller.go:157] Shutting down quota evaluator I0308 03:54:35.188016 12 controller.go:176] quota evaluator worker shutdown I0308 03:54:35.188366 12 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0308 03:54:35.188390 12 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0308 03:54:35.188401 12 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0308 03:54:35.188413 12 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0308 03:54:35.188427 12 controller.go:84] Shutting down OpenAPI AggregationController I0308 03:54:35.188438 12 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0308 03:54:35.188449 12 controller.go:86] Shutting down OpenAPI V3 AggregationController I0308 03:54:35.188486 12 secure_serving.go:258] Stopped listening on [::]:6443 I0308 03:54:35.188500 12 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0308 03:54:35.188508 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0308 03:54:35.188589 12 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0308 03:54:35.188633 12 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0308 03:54:35.188691 12 controller.go:120] Shutting down OpenAPI V3 controller I0308 03:54:35.188715 12 controller.go:170] Shutting down OpenAPI controller I0308 03:54:35.188739 12 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0308 03:54:35.188762 12 establishing_controller.go:92] Shutting down EstablishingController I0308 03:54:35.188783 12 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0308 03:54:35.188819 12 naming_controller.go:305] Shutting down NamingConditionController I0308 03:54:35.188867 12 crd_finalizer.go:281] Shutting down CRDFinalizer I0308 03:54:35.188888 12 autoregister_controller.go:168] Shutting down autoregister controller I0308 03:54:35.188907 12 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0308 03:54:35.188927 12 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0308 03:54:35.188962 12 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0308 03:54:35.189091 12 gc_controller.go:91] Shutting down apiserver lease garbage collector I0308 03:54:35.189160 12 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0308 03:54:35.189183 12 system_namespaces_controller.go:76] Shutting down system namespaces controller I0308 03:54:35.189192 12 local_available_controller.go:172] Shutting down LocalAvailability controller I0308 03:54:35.189202 12 controller.go:132] Ending legacy_token_tracking_controller I0308 03:54:35.189207 12 controller.go:133] Shutting down legacy_token_tracking_controller I0308 03:54:35.189215 12 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0308 03:54:35.189326 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0308 03:54:35.189453 12 controller.go:176] quota evaluator worker shutdown I0308 03:54:35.189471 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0308 03:54:35.189483 12 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0308 03:54:35.189504 12 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0308 03:54:35.189514 12 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0308 03:54:35.189602 12 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0308 03:54:35.191065 12 controller.go:176] quota evaluator worker shutdown I0308 03:54:35.191097 12 controller.go:176] quota evaluator worker shutdown I0308 03:54:35.191115 12 controller.go:176] quota evaluator worker shutdown I0308 03:54:35.192405 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0308 03:54:35.192440 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0308 03:54:35.192468 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" E0308 03:54:35.194137 12 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=10911&timeout=8m56s&timeoutSeconds=536&watch=true" auditID="be2861cd-bc76-41e8-8e95-6211ff2a6f63" I0308 03:54:35.196134 12 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0308 03:54:37.189461 12 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0308 03:54:37.189498 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0308 03:54:37.197052 12 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0308 03:54:37.199499 12 cacher.go:171] Terminating all watchers from cacher pods W0308 03:54:37.202078 12 cacher.go:171] Terminating all watchers from cacher podtemplates W0308 03:54:37.202493 12 cacher.go:171] Terminating all watchers from cacher resourcequotas W0308 03:54:37.202750 12 cacher.go:171] Terminating all watchers from cacher configmaps W0308 03:54:37.205515 12 cacher.go:171] Terminating all watchers from cacher limitranges W0308 03:54:37.205996 12 cacher.go:171] Terminating all watchers from cacher namespaces W0308 03:54:37.207101 12 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0308 03:54:37.207790 12 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0308 03:54:37.208372 12 cacher.go:171] Terminating all watchers from cacher secrets W0308 03:54:37.213070 12 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0308 03:54:37.213876 12 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0308 03:54:37.214400 12 cacher.go:171] Terminating all watchers from cacher services W0308 03:54:37.225141 12 cacher.go:171] Terminating all watchers from cacher endpoints W0308 03:54:37.225969 12 cacher.go:171] Terminating all watchers from cacher nodes W0308 03:54:37.228119 12 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0308 03:54:37.228784 12 cacher.go:171] Terminating all watchers from cacher jobs.batch W0308 03:54:37.229528 12 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0308 03:54:37.230158 12 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0308 03:54:37.231225 12 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0308 03:54:37.231713 12 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0308 03:54:37.232810 12 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0308 03:54:37.238688 12 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0308 03:54:37.239577 12 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0308 03:54:37.240784 12 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0308 03:54:37.241189 12 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0308 03:54:37.242239 12 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0308 03:54:37.243568 12 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0308 03:54:37.244288 12 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0308 03:54:37.244609 12 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0308 03:54:37.245466 12 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0308 03:54:37.245906 12 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0308 03:54:37.246415 12 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0308 03:54:37.246910 12 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0308 03:54:37.247267 12 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0308 03:54:37.248721 12 cacher.go:171] Terminating all watchers from cacher deployments.apps W0308 03:54:37.249777 12 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0308 03:54:37.250328 12 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0308 03:54:37.250646 12 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0308 03:54:37.250976 12 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0308 03:54:37.251384 12 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0308 03:54:37.252103 12 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0308 03:54:37.253097 12 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0308 03:54:37.254023 12 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0308 03:54:37.255108 12 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0308 03:54:37.255523 12 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0308 03:54:37.256202 12 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0308 03:54:37.256678 12 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0308 03:54:37.257098 12 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0308 03:54:37.257581 12 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0308 03:54:37.258184 12 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0308 03:54:37.259734 12 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0308 03:54:37.260077 12 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0308 03:54:37.262282 12 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0308 03:54:37.262665 12 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0308 03:54:37.263457 12 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0308 03:54:37.264106 12 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0308 03:54:37.264662 12 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0308 03:54:37.265144 12 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0308 03:54:37.265586 12 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0308 03:54:37.265952 12 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0308 03:54:37.266680 12 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0308 03:54:37.267793 12 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0308 03:54:37.268149 12 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0308 03:54:37.268666 12 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0308 03:54:37.270641 12 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0308 03:54:37.271070 12 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0308 03:54:37.272319 12 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0308 03:54:37.272790 12 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0308 03:54:37.273548 12 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0308 03:54:37.274333 12 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0308 03:54:37.274695 12 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0308 03:54:37.275327 12 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0308 03:54:37.276059 12 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0308 03:54:37.276599 12 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0308 03:54:37.277369 12 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0308 03:54:37.278150 12 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0308 03:54:37.278458 12 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0308 03:54:37.279128 12 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0308 03:54:37.279724 12 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0308 03:54:37.280214 12 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0308 03:54:37.280646 12 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0308 03:54:37.280991 12 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0308 03:54:37.281354 12 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0308 03:54:37.281896 12 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0308 03:54:37.282260 12 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0308 03:54:37.283447 12 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0308 03:54:37.283753 12 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0308 03:54:37.285346 12 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0308 03:54:37.285799 12 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0308 03:54:37.287112 12 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0308 03:54:37.288143 12 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0308 03:54:37.288468 12 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0308 03:54:37.291708 12 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0308 03:54:37.292200 12 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0308 03:54:37.292549 12 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0308 03:54:37.294066 12 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0308 03:54:37.294478 12 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0308 03:54:37.295114 12 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0308 03:54:37.296644 12 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0308 03:54:37.297041 12 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0308 03:54:37.298004 12 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0308 03:54:37.298621 12 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0308 03:54:37.299593 12 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0308 03:54:37.299975 12 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0308 03:54:37.300357 12 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0308 03:54:37.300674 12 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0308 03:54:37.301055 12 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0308 03:54:37.301359 12 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0308 03:54:37.301898 12 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0308 03:54:37.302539 12 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0308 03:54:37.303269 12 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0308 03:54:37.303676 12 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0308 03:54:37.304095 12 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0308 03:54:37.304610 12 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0308 03:54:37.305105 12 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0308 03:54:37.305684 12 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0308 03:54:37.306058 12 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0308 03:54:37.306707 12 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0308 03:54:37.307298 12 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0308 03:54:37.307642 12 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0308 03:54:37.308340 12 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0308 03:54:37.308691 12 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0308 03:54:37.309504 12 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0308 03:54:37.309924 12 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0308 03:54:37.310285 12 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0308 03:54:37.311341 12 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0308 03:54:37.312252 12 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0308 03:54:37.312784 12 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0308 03:54:37.313251 12 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0308 03:54:37.314028 12 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0308 03:54:37.314657 12 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0308 03:54:37.315778 12 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0308 03:54:37.316968 12 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0308 03:54:37.317507 12 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0308 03:54:37.318389 12 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0308 03:54:37.318969 12 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0308 03:54:37.320397 12 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0308 03:54:37.320818 12 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0308 03:54:37.321603 12 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0308 03:54:37.322476 12 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0308 03:54:37.323359 12 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0308 03:54:37.323678 12 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0308 03:54:37.324230 12 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0308 03:54:37.324589 12 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0308 03:54:37.324886 12 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0308 03:54:37.325502 12 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0308 03:54:37.325804 12 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0308 03:54:37.326644 12 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0308 03:54:37.327081 12 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0308 03:54:37.327745 12 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com I0308 03:54:37.357191 1 main.go:235] Termination finished with exit code 0 I0308 03:54:37.357261 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" --- I0308 04:04:08.552646 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0308 04:04:08.555270 11 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0308 04:04:08.555268 11 controller.go:128] Shutting down kubernetes service endpoint reconciler I0308 04:04:08.555319 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0308 04:04:08.560807 11 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0308 04:04:08.560875 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0308 04:04:08.567400 11 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0308 04:04:08.582218 11 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0308 04:04:08.582267 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0308 04:04:08.582415 11 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0308 04:04:08.582436 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0308 04:04:08.582530 11 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0308 04:04:08.634628 11 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0308 04:04:08.634696 11 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0308 04:04:08.634806 11 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0308 04:04:08.634917 11 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0308 04:04:08.634960 11 controller.go:157] Shutting down quota evaluator I0308 04:04:08.634977 11 controller.go:176] quota evaluator worker shutdown I0308 04:04:08.636030 11 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0308 04:04:08.636122 11 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0308 04:04:08.636453 11 controller.go:176] quota evaluator worker shutdown I0308 04:04:08.637193 11 controller.go:176] quota evaluator worker shutdown I0308 04:04:08.637221 11 controller.go:176] quota evaluator worker shutdown I0308 04:04:08.637230 11 controller.go:176] quota evaluator worker shutdown I0308 04:04:08.637535 11 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0308 04:04:08.637549 11 controller.go:86] Shutting down OpenAPI V3 AggregationController I0308 04:04:08.637577 11 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0308 04:04:08.637650 11 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0308 04:04:08.637690 11 controller.go:120] Shutting down OpenAPI V3 controller I0308 04:04:08.637707 11 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0308 04:04:08.637722 11 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0308 04:04:08.637737 11 autoregister_controller.go:168] Shutting down autoregister controller I0308 04:04:08.637750 11 controller.go:170] Shutting down OpenAPI controller I0308 04:04:08.637765 11 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0308 04:04:08.637789 11 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0308 04:04:08.637802 11 naming_controller.go:305] Shutting down NamingConditionController I0308 04:04:08.637812 11 establishing_controller.go:92] Shutting down EstablishingController I0308 04:04:08.637836 11 crd_finalizer.go:281] Shutting down CRDFinalizer I0308 04:04:08.637848 11 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0308 04:04:08.637865 11 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0308 04:04:08.637887 11 controller.go:132] Ending legacy_token_tracking_controller I0308 04:04:08.637892 11 controller.go:133] Shutting down legacy_token_tracking_controller E0308 04:04:08.637895 11 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=14629&timeout=8m33s&timeoutSeconds=513&watch=true" auditID="28224973-abdb-486e-b96e-c7d4cbbc85c1" I0308 04:04:08.637905 11 gc_controller.go:91] Shutting down apiserver lease garbage collector I0308 04:04:08.637913 11 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0308 04:04:08.637929 11 local_available_controller.go:172] Shutting down LocalAvailability controller I0308 04:04:08.637945 11 system_namespaces_controller.go:76] Shutting down system namespaces controller I0308 04:04:08.638076 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0308 04:04:08.638096 11 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0308 04:04:08.638206 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0308 04:04:08.638278 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0308 04:04:08.638330 11 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0308 04:04:08.638388 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0308 04:04:08.638408 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0308 04:04:08.638455 11 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0308 04:04:08.638478 11 controller.go:84] Shutting down OpenAPI AggregationController I0308 04:04:08.638501 11 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0308 04:04:08.638598 11 secure_serving.go:258] Stopped listening on [::]:6443 I0308 04:04:08.638625 11 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0308 04:04:08.638650 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0308 04:04:08.643319 11 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0308 04:04:08.643371 11 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0308 04:04:10.639256 11 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0308 04:04:10.639312 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0308 04:04:10.642344 11 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0308 04:04:10.642903 11 cacher.go:171] Terminating all watchers from cacher nodes W0308 04:04:10.644443 11 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0308 04:04:10.645680 11 cacher.go:171] Terminating all watchers from cacher endpoints W0308 04:04:10.649712 11 cacher.go:171] Terminating all watchers from cacher secrets W0308 04:04:10.661345 11 cacher.go:171] Terminating all watchers from cacher configmaps W0308 04:04:10.666031 11 cacher.go:171] Terminating all watchers from cacher limitranges W0308 04:04:10.666813 11 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0308 04:04:10.668562 11 cacher.go:171] Terminating all watchers from cacher services W0308 04:04:10.681188 11 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0308 04:04:10.682030 11 cacher.go:171] Terminating all watchers from cacher resourcequotas W0308 04:04:10.682768 11 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0308 04:04:10.683506 11 cacher.go:171] Terminating all watchers from cacher pods W0308 04:04:10.684620 11 cacher.go:171] Terminating all watchers from cacher namespaces W0308 04:04:10.685628 11 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0308 04:04:10.691134 11 cacher.go:171] Terminating all watchers from cacher jobs.batch W0308 04:04:10.692502 11 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0308 04:04:10.693391 11 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0308 04:04:10.694155 11 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0308 04:04:10.694642 11 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0308 04:04:10.695276 11 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0308 04:04:10.695970 11 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0308 04:04:10.704513 11 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0308 04:04:10.705144 11 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0308 04:04:10.705616 11 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0308 04:04:10.706250 11 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0308 04:04:10.707616 11 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0308 04:04:10.712492 11 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0308 04:04:10.713970 11 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0308 04:04:10.718093 11 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0308 04:04:10.718810 11 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0308 04:04:10.719207 11 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0308 04:04:10.719815 11 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0308 04:04:10.720478 11 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0308 04:04:10.722159 11 cacher.go:171] Terminating all watchers from cacher deployments.apps W0308 04:04:10.725873 11 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0308 04:04:10.726903 11 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0308 04:04:10.727281 11 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0308 04:04:10.728008 11 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0308 04:04:10.728411 11 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0308 04:04:10.728896 11 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0308 04:04:10.729570 11 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0308 04:04:10.731021 11 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0308 04:04:10.732336 11 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0308 04:04:10.733354 11 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0308 04:04:10.734062 11 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0308 04:04:10.734727 11 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0308 04:04:10.735443 11 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0308 04:04:10.736602 11 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0308 04:04:10.737516 11 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0308 04:04:10.738250 11 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0308 04:04:10.739197 11 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0308 04:04:10.740196 11 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0308 04:04:10.741609 11 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0308 04:04:10.742570 11 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0308 04:04:10.743506 11 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0308 04:04:10.744306 11 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0308 04:04:10.744734 11 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0308 04:04:10.745343 11 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0308 04:04:10.745663 11 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0308 04:04:10.747447 11 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0308 04:04:10.748053 11 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0308 04:04:10.748684 11 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0308 04:04:10.750620 11 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0308 04:04:10.750952 11 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0308 04:04:10.751720 11 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0308 04:04:10.752379 11 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0308 04:04:10.752916 11 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0308 04:04:10.754018 11 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0308 04:04:10.755376 11 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0308 04:04:10.756002 11 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0308 04:04:10.756558 11 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0308 04:04:10.757084 11 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0308 04:04:10.757572 11 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0308 04:04:10.758167 11 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0308 04:04:10.758972 11 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0308 04:04:10.759686 11 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0308 04:04:10.760157 11 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0308 04:04:10.760569 11 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0308 04:04:10.762114 11 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0308 04:04:10.762513 11 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0308 04:04:10.763027 11 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0308 04:04:10.763861 11 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0308 04:04:10.764416 11 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0308 04:04:10.764929 11 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0308 04:04:10.765407 11 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0308 04:04:10.766104 11 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0308 04:04:10.766802 11 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0308 04:04:10.767424 11 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0308 04:04:10.773619 11 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0308 04:04:10.774323 11 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0308 04:04:10.775182 11 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0308 04:04:10.775585 11 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0308 04:04:10.777115 11 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0308 04:04:10.777488 11 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0308 04:04:10.777938 11 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0308 04:04:10.778532 11 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0308 04:04:10.779082 11 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0308 04:04:10.779508 11 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0308 04:04:10.780101 11 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0308 04:04:10.781895 11 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0308 04:04:10.782349 11 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0308 04:04:10.783142 11 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0308 04:04:10.783756 11 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0308 04:04:10.784320 11 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0308 04:04:10.784921 11 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0308 04:04:10.785610 11 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0308 04:04:10.786494 11 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0308 04:04:10.786979 11 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0308 04:04:10.787355 11 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0308 04:04:10.788371 11 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0308 04:04:10.789548 11 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0308 04:04:10.790460 11 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0308 04:04:10.791760 11 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0308 04:04:10.792718 11 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0308 04:04:10.793424 11 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0308 04:04:10.793988 11 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0308 04:04:10.794364 11 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0308 04:04:10.795594 11 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0308 04:04:10.796758 11 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0308 04:04:10.797233 11 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0308 04:04:10.797566 11 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0308 04:04:10.798786 11 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0308 04:04:10.799468 11 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0308 04:04:10.799784 11 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0308 04:04:10.801686 11 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0308 04:04:10.803667 11 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0308 04:04:10.804607 11 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0308 04:04:10.805213 11 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0308 04:04:10.806511 11 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0308 04:04:10.807334 11 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0308 04:04:10.807721 11 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0308 04:04:10.809267 11 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0308 04:04:10.809925 11 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0308 04:04:10.810360 11 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0308 04:04:10.810750 11 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0308 04:04:10.811529 11 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0308 04:04:10.811994 11 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0308 04:04:10.812446 11 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0308 04:04:10.812840 11 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0308 04:04:10.813261 11 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0308 04:04:10.813952 11 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0308 04:04:10.815204 11 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io I0308 04:04:10.861678 1 main.go:235] Termination finished with exit code 0 I0308 04:04:10.861736 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" ---