--- I0318 18:02:58.570117 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0318 18:02:58.571468 12 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0318 18:02:58.571470 12 controller.go:128] Shutting down kubernetes service endpoint reconciler I0318 18:02:58.571514 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0318 18:02:58.577376 12 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0318 18:02:58.577406 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0318 18:02:58.588387 12 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0318 18:02:58.600020 12 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0318 18:02:58.600058 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0318 18:02:58.600248 12 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0318 18:02:58.600265 12 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0318 18:02:58.600294 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0318 18:02:58.626378 12 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0318 18:02:58.626444 12 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0318 18:02:58.626483 12 controller.go:157] Shutting down quota evaluator I0318 18:02:58.626515 12 controller.go:176] quota evaluator worker shutdown I0318 18:02:58.626555 12 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0318 18:02:58.626636 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0318 18:02:58.626673 12 controller.go:176] quota evaluator worker shutdown I0318 18:02:58.626685 12 controller.go:176] quota evaluator worker shutdown I0318 18:02:58.626695 12 controller.go:176] quota evaluator worker shutdown I0318 18:02:58.626701 12 controller.go:176] quota evaluator worker shutdown I0318 18:02:58.627427 12 controller.go:86] Shutting down OpenAPI V3 AggregationController I0318 18:02:58.627474 12 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0318 18:02:58.627528 12 controller.go:120] Shutting down OpenAPI V3 controller I0318 18:02:58.627529 12 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0318 18:02:58.627555 12 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0318 18:02:58.627556 12 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0318 18:02:58.627577 12 naming_controller.go:305] Shutting down NamingConditionController I0318 18:02:58.627602 12 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0318 18:02:58.627615 12 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0318 18:02:58.627643 12 controller.go:170] Shutting down OpenAPI controller I0318 18:02:58.627663 12 autoregister_controller.go:168] Shutting down autoregister controller I0318 18:02:58.627662 12 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0318 18:02:58.627672 12 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0318 18:02:58.627686 12 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0318 18:02:58.627700 12 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0318 18:02:58.627710 12 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0318 18:02:58.627716 12 controller.go:84] Shutting down OpenAPI AggregationController I0318 18:02:58.627448 12 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0318 18:02:58.627730 12 crd_finalizer.go:281] Shutting down CRDFinalizer I0318 18:02:58.627810 12 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0318 18:02:58.627844 12 local_available_controller.go:172] Shutting down LocalAvailability controller I0318 18:02:58.627864 12 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0318 18:02:58.627887 12 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0318 18:02:58.627936 12 gc_controller.go:91] Shutting down apiserver lease garbage collector I0318 18:02:58.627955 12 system_namespaces_controller.go:76] Shutting down system namespaces controller I0318 18:02:58.627966 12 controller.go:132] Ending legacy_token_tracking_controller I0318 18:02:58.627971 12 controller.go:133] Shutting down legacy_token_tracking_controller I0318 18:02:58.627606 12 establishing_controller.go:92] Shutting down EstablishingController I0318 18:02:58.628338 12 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0318 18:02:58.628360 12 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0318 18:02:58.628379 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0318 18:02:58.628392 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0318 18:02:58.628420 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0318 18:02:58.628441 12 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0318 18:02:58.628668 12 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0318 18:02:58.628770 12 secure_serving.go:258] Stopped listening on [::]:6443 I0318 18:02:58.628343 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0318 18:02:58.628868 12 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0318 18:02:58.628897 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening E0318 18:02:58.629827 12 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=12244&timeout=5m14s&timeoutSeconds=314&watch=true" auditID="7fd99aec-a26f-4b9a-89ca-6bd7473a3bb3" I0318 18:03:00.629704 12 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0318 18:03:00.629775 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0318 18:03:00.633650 12 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0318 18:03:00.634238 12 cacher.go:171] Terminating all watchers from cacher secrets W0318 18:03:00.639967 12 cacher.go:171] Terminating all watchers from cacher nodes W0318 18:03:00.640857 12 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0318 18:03:00.641515 12 cacher.go:171] Terminating all watchers from cacher limitranges W0318 18:03:00.642216 12 cacher.go:171] Terminating all watchers from cacher resourcequotas W0318 18:03:00.642709 12 cacher.go:171] Terminating all watchers from cacher configmaps W0318 18:03:00.644348 12 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0318 18:03:00.644759 12 cacher.go:171] Terminating all watchers from cacher services W0318 18:03:00.646720 12 cacher.go:171] Terminating all watchers from cacher endpoints W0318 18:03:00.655745 12 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0318 18:03:00.657116 12 cacher.go:171] Terminating all watchers from cacher podtemplates W0318 18:03:00.657772 12 cacher.go:171] Terminating all watchers from cacher namespaces W0318 18:03:00.659933 12 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0318 18:03:00.661890 12 cacher.go:171] Terminating all watchers from cacher pods W0318 18:03:00.664756 12 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0318 18:03:00.665687 12 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0318 18:03:00.666846 12 cacher.go:171] Terminating all watchers from cacher jobs.batch W0318 18:03:00.667786 12 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0318 18:03:00.669391 12 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0318 18:03:00.669944 12 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0318 18:03:00.670532 12 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0318 18:03:00.670929 12 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0318 18:03:00.672166 12 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0318 18:03:00.672614 12 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0318 18:03:00.673007 12 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0318 18:03:00.673617 12 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0318 18:03:00.674045 12 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0318 18:03:00.674967 12 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0318 18:03:00.675936 12 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0318 18:03:00.676962 12 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0318 18:03:00.677420 12 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0318 18:03:00.678128 12 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0318 18:03:00.678792 12 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0318 18:03:00.679599 12 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0318 18:03:00.680575 12 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0318 18:03:00.682010 12 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0318 18:03:00.682482 12 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0318 18:03:00.682879 12 cacher.go:171] Terminating all watchers from cacher deployments.apps W0318 18:03:00.687517 12 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0318 18:03:00.688542 12 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0318 18:03:00.689147 12 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0318 18:03:00.690970 12 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0318 18:03:00.694066 12 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0318 18:03:00.695516 12 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0318 18:03:00.699097 12 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0318 18:03:00.700056 12 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0318 18:03:00.702290 12 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0318 18:03:00.703286 12 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0318 18:03:00.704032 12 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0318 18:03:00.704525 12 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0318 18:03:00.704831 12 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0318 18:03:00.706233 12 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0318 18:03:00.706896 12 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0318 18:03:00.707704 12 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0318 18:03:00.709214 12 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0318 18:03:00.710087 12 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0318 18:03:00.710644 12 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0318 18:03:00.711502 12 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0318 18:03:00.712186 12 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0318 18:03:00.712835 12 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0318 18:03:00.713418 12 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0318 18:03:00.714114 12 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0318 18:03:00.714847 12 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0318 18:03:00.716372 12 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0318 18:03:00.716857 12 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0318 18:03:00.717340 12 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0318 18:03:00.717983 12 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0318 18:03:00.718545 12 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0318 18:03:00.719552 12 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0318 18:03:00.720014 12 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0318 18:03:00.720807 12 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0318 18:03:00.721257 12 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0318 18:03:00.721933 12 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0318 18:03:00.722481 12 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0318 18:03:00.723009 12 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0318 18:03:00.723665 12 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0318 18:03:00.724109 12 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0318 18:03:00.724722 12 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0318 18:03:00.725355 12 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0318 18:03:00.725906 12 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0318 18:03:00.726414 12 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0318 18:03:00.727197 12 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0318 18:03:00.727798 12 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0318 18:03:00.728749 12 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0318 18:03:00.730526 12 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0318 18:03:00.731094 12 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0318 18:03:00.731775 12 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0318 18:03:00.732364 12 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0318 18:03:00.732653 12 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0318 18:03:00.733160 12 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0318 18:03:00.733918 12 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0318 18:03:00.734484 12 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0318 18:03:00.735378 12 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0318 18:03:00.735959 12 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0318 18:03:00.736449 12 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0318 18:03:00.737113 12 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0318 18:03:00.737665 12 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0318 18:03:00.738400 12 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0318 18:03:00.738963 12 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0318 18:03:00.739470 12 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0318 18:03:00.739945 12 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0318 18:03:00.740502 12 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0318 18:03:00.740920 12 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0318 18:03:00.741789 12 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0318 18:03:00.742435 12 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0318 18:03:00.742893 12 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0318 18:03:00.743757 12 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0318 18:03:00.744468 12 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0318 18:03:00.745676 12 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0318 18:03:00.746816 12 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0318 18:03:00.747332 12 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0318 18:03:00.748267 12 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0318 18:03:00.748994 12 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0318 18:03:00.750725 12 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0318 18:03:00.752498 12 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0318 18:03:00.753540 12 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0318 18:03:00.754233 12 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0318 18:03:00.755246 12 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0318 18:03:00.755980 12 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0318 18:03:00.756488 12 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0318 18:03:00.757381 12 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0318 18:03:00.758637 12 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0318 18:03:00.759117 12 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0318 18:03:00.759700 12 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0318 18:03:00.760489 12 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0318 18:03:00.762091 12 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0318 18:03:00.762951 12 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0318 18:03:00.763963 12 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0318 18:03:00.764597 12 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0318 18:03:00.765297 12 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0318 18:03:00.765637 12 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0318 18:03:00.766614 12 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0318 18:03:00.767342 12 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0318 18:03:00.768034 12 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0318 18:03:00.768842 12 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0318 18:03:00.769241 12 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0318 18:03:00.769712 12 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0318 18:03:00.772329 12 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0318 18:03:00.774403 12 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0318 18:03:00.774824 12 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0318 18:03:00.775450 12 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0318 18:03:00.777175 12 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0318 18:03:00.777993 12 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0318 18:03:00.778600 12 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0318 18:03:00.781220 12 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0318 18:03:00.781905 12 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0318 18:03:00.782788 12 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0318 18:03:00.783592 12 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0318 18:03:00.786249 12 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0318 18:03:00.787909 12 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0318 18:03:00.788490 12 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0318 18:03:00.788925 12 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0318 18:03:00.789509 12 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io W0318 18:03:00.790079 12 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0318 18:03:00.790738 12 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0318 18:03:00.791180 12 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0318 18:03:00.791696 12 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0318 18:03:00.792766 12 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0318 18:03:00.793238 12 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0318 18:03:00.794398 12 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0318 18:03:00.795020 12 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0318 18:03:00.795536 12 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0318 18:03:00.796415 12 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0318 18:03:00.797392 12 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0318 18:03:00.798420 12 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0318 18:03:00.799397 12 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0318 18:03:00.800360 12 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0318 18:03:00.800778 12 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0318 18:03:00.801396 12 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0318 18:03:00.802095 12 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0318 18:03:00.802687 12 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0318 18:03:00.803802 12 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0318 18:03:00.804343 12 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0318 18:03:00.805226 12 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0318 18:03:00.806268 12 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0318 18:03:00.806889 12 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0318 18:03:00.807634 12 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0318 18:03:00.808194 12 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0318 18:03:00.808706 12 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0318 18:03:00.809400 12 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io W0318 18:03:00.809970 12 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io I0318 18:03:00.842495 1 main.go:235] Termination finished with exit code 0 I0318 18:03:00.842553 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" --- I0318 18:05:37.307505 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0318 18:05:37.308481 10 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0318 18:05:37.308533 10 controller.go:128] Shutting down kubernetes service endpoint reconciler I0318 18:05:37.308541 10 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0318 18:05:37.922526 10 trace.go:236] Trace[373308913]: "Create etcd3" audit-id:,key:/events/openshift-kube-apiserver/kube-apiserver-master-0.189e01ab0790bab1,type:*core.Event,resource:events (18-Mar-2026 18:05:37.308) (total time: 613ms): Trace[373308913]: ---"TransformToStorage succeeded" 396ms (18:05:37.704) Trace[373308913]: ---"Txn call succeeded" 217ms (18:05:37.922) Trace[373308913]: [613.749688ms] [613.749688ms] END I0318 18:05:37.922753 10 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0318 18:05:37.922811 10 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished I0318 18:05:37.923000 10 trace.go:236] Trace[1967554236]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:865b2409-7e13-408b-964c-dec9d6bbedf2,client:192.168.32.10,api-group:,api-version:v1,name:,subresource:,namespace:openshift-kube-apiserver,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openshift-kube-apiserver/pods,user-agent:kubelet/v1.31.14 (linux/amd64) kubernetes/8311c4d,verb:POST (18-Mar-2026 18:05:37.362) (total time: 560ms): Trace[1967554236]: [560.393878ms] [560.393878ms] END W0318 18:05:37.983850 10 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0318 18:05:38.390875 10 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0318 18:05:38.390937 10 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0318 18:05:38.391389 10 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0318 18:05:38.391428 10 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0318 18:05:38.391717 10 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0318 18:05:38.566256 10 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0318 18:05:38.566370 10 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0318 18:05:38.566486 10 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0318 18:05:38.566562 10 controller.go:157] Shutting down quota evaluator I0318 18:05:38.566622 10 controller.go:176] quota evaluator worker shutdown I0318 18:05:38.566581 10 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0318 18:05:38.566719 10 controller.go:176] quota evaluator worker shutdown I0318 18:05:38.566751 10 controller.go:176] quota evaluator worker shutdown I0318 18:05:38.566785 10 controller.go:176] quota evaluator worker shutdown I0318 18:05:38.566821 10 controller.go:176] quota evaluator worker shutdown I0318 18:05:38.567192 10 system_namespaces_controller.go:76] Shutting down system namespaces controller I0318 18:05:38.567343 10 controller.go:132] Ending legacy_token_tracking_controller I0318 18:05:38.567370 10 controller.go:133] Shutting down legacy_token_tracking_controller I0318 18:05:38.567405 10 gc_controller.go:91] Shutting down apiserver lease garbage collector I0318 18:05:38.567436 10 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0318 18:05:38.567898 10 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0318 18:05:38.567961 10 controller.go:120] Shutting down OpenAPI V3 controller I0318 18:05:38.567993 10 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0318 18:05:38.568130 10 autoregister_controller.go:168] Shutting down autoregister controller I0318 18:05:38.568164 10 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0318 18:05:38.568205 10 controller.go:170] Shutting down OpenAPI controller I0318 18:05:38.568231 10 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0318 18:05:38.568250 10 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0318 18:05:38.568265 10 controller.go:86] Shutting down OpenAPI V3 AggregationController I0318 18:05:38.568305 10 crd_finalizer.go:281] Shutting down CRDFinalizer I0318 18:05:38.568325 10 naming_controller.go:305] Shutting down NamingConditionController I0318 18:05:38.568339 10 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0318 18:05:38.568378 10 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0318 18:05:38.568412 10 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0318 18:05:38.568570 10 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0318 18:05:38.568432 10 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0318 18:05:38.568445 10 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0318 18:05:38.568296 10 establishing_controller.go:92] Shutting down EstablishingController I0318 18:05:38.569074 10 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0318 18:05:38.569171 10 secure_serving.go:258] Stopped listening on [::]:6443 I0318 18:05:38.568417 10 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0318 18:05:38.569214 10 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0318 18:05:38.568457 10 controller.go:84] Shutting down OpenAPI AggregationController I0318 18:05:38.569494 10 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0318 18:05:38.569532 10 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0318 18:05:38.569559 10 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0318 18:05:38.569581 10 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0318 18:05:38.569256 10 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0318 18:05:38.569810 10 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0318 18:05:38.568556 10 local_available_controller.go:172] Shutting down LocalAvailability controller I0318 18:05:38.570375 10 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0318 18:05:38.569173 10 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0318 18:05:38.575028 10 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0318 18:05:38.575079 10 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller E0318 18:05:38.575325 10 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=15849&timeout=5m53s&timeoutSeconds=353&watch=true" auditID="ab88c098-94bd-4b5b-8324-36c8a96f5b82" I0318 18:05:40.569592 10 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0318 18:05:40.569638 10 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0318 18:05:40.597879 10 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0318 18:05:40.599005 10 cacher.go:171] Terminating all watchers from cacher namespaces W0318 18:05:40.605570 10 cacher.go:171] Terminating all watchers from cacher services W0318 18:05:40.610908 10 cacher.go:171] Terminating all watchers from cacher nodes W0318 18:05:40.612650 10 cacher.go:171] Terminating all watchers from cacher limitranges W0318 18:05:40.613199 10 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0318 18:05:40.620234 10 cacher.go:171] Terminating all watchers from cacher endpoints W0318 18:05:40.624469 10 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0318 18:05:40.624996 10 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0318 18:05:40.625414 10 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0318 18:05:40.626969 10 cacher.go:171] Terminating all watchers from cacher resourcequotas W0318 18:05:40.627522 10 cacher.go:171] Terminating all watchers from cacher pods W0318 18:05:40.631113 10 cacher.go:171] Terminating all watchers from cacher secrets W0318 18:05:40.642942 10 cacher.go:171] Terminating all watchers from cacher configmaps W0318 18:05:40.659497 10 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0318 18:05:40.660521 10 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0318 18:05:40.661912 10 cacher.go:171] Terminating all watchers from cacher jobs.batch W0318 18:05:40.674010 10 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0318 18:05:40.674813 10 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0318 18:05:40.678772 10 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0318 18:05:40.680370 10 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0318 18:05:40.680708 10 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0318 18:05:40.681181 10 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0318 18:05:40.681669 10 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0318 18:05:40.682464 10 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0318 18:05:40.683878 10 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0318 18:05:40.686040 10 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0318 18:05:40.687354 10 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0318 18:05:40.687979 10 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0318 18:05:40.689511 10 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0318 18:05:40.692416 10 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0318 18:05:40.693024 10 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0318 18:05:40.693982 10 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0318 18:05:40.694529 10 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0318 18:05:40.696802 10 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0318 18:05:40.698469 10 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0318 18:05:40.699136 10 cacher.go:171] Terminating all watchers from cacher deployments.apps W0318 18:05:40.701906 10 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0318 18:05:40.705750 10 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0318 18:05:40.707213 10 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0318 18:05:40.708959 10 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0318 18:05:40.709616 10 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0318 18:05:40.711886 10 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0318 18:05:40.712504 10 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0318 18:05:40.712875 10 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0318 18:05:40.713624 10 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0318 18:05:40.714254 10 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0318 18:05:40.717856 10 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0318 18:05:40.718502 10 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0318 18:05:40.719511 10 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0318 18:05:40.720656 10 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0318 18:05:40.721191 10 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0318 18:05:40.721682 10 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0318 18:05:40.722150 10 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0318 18:05:40.726342 10 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0318 18:05:40.726963 10 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0318 18:05:40.727501 10 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0318 18:05:40.728233 10 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0318 18:05:40.728863 10 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0318 18:05:40.729652 10 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0318 18:05:40.731080 10 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0318 18:05:40.731782 10 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0318 18:05:40.732395 10 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0318 18:05:40.733249 10 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0318 18:05:40.733834 10 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0318 18:05:40.734380 10 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0318 18:05:40.735049 10 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0318 18:05:40.735673 10 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0318 18:05:40.736414 10 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0318 18:05:40.737118 10 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0318 18:05:40.737736 10 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0318 18:05:40.738353 10 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0318 18:05:40.739092 10 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0318 18:05:40.739686 10 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0318 18:05:40.740721 10 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0318 18:05:40.742805 10 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0318 18:05:40.743371 10 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0318 18:05:40.743813 10 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0318 18:05:40.744463 10 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0318 18:05:40.745195 10 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0318 18:05:40.746092 10 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0318 18:05:40.746432 10 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0318 18:05:40.747027 10 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0318 18:05:40.747400 10 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0318 18:05:40.747895 10 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0318 18:05:40.749495 10 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0318 18:05:40.749959 10 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0318 18:05:40.750864 10 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0318 18:05:40.752704 10 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0318 18:05:40.753381 10 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0318 18:05:40.753999 10 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0318 18:05:40.755115 10 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0318 18:05:40.755479 10 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0318 18:05:40.755973 10 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0318 18:05:40.756861 10 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0318 18:05:40.758288 10 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0318 18:05:40.758985 10 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0318 18:05:40.759464 10 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0318 18:05:40.760021 10 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0318 18:05:40.761028 10 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0318 18:05:40.761944 10 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0318 18:05:40.762365 10 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0318 18:05:40.762863 10 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0318 18:05:40.764908 10 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0318 18:05:40.766582 10 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0318 18:05:40.766940 10 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0318 18:05:40.768941 10 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0318 18:05:40.770747 10 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0318 18:05:40.771607 10 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0318 18:05:40.772356 10 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0318 18:05:40.773008 10 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0318 18:05:40.773513 10 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0318 18:05:40.773934 10 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0318 18:05:40.775744 10 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0318 18:05:40.776246 10 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0318 18:05:40.778390 10 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0318 18:05:40.780468 10 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0318 18:05:40.780852 10 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0318 18:05:40.782862 10 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0318 18:05:40.785573 10 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0318 18:05:40.785995 10 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0318 18:05:40.786813 10 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0318 18:05:40.787156 10 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0318 18:05:40.787967 10 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0318 18:05:40.788932 10 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0318 18:05:40.789765 10 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0318 18:05:40.790309 10 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0318 18:05:40.791334 10 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0318 18:05:40.792417 10 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0318 18:05:40.794624 10 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0318 18:05:40.796309 10 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0318 18:05:40.797055 10 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0318 18:05:40.798092 10 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0318 18:05:40.800403 10 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0318 18:05:40.801378 10 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0318 18:05:40.802257 10 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0318 18:05:40.803648 10 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0318 18:05:40.804023 10 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0318 18:05:40.804878 10 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0318 18:05:40.805412 10 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0318 18:05:40.805968 10 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0318 18:05:40.806488 10 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0318 18:05:40.807015 10 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0318 18:05:40.807641 10 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0318 18:05:40.808136 10 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io I0318 18:05:40.846173 1 main.go:235] Termination finished with exit code 0 I0318 18:05:40.846767 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" ---