--- I0319 12:11:54.089492 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0319 12:11:54.090956 11 controller.go:128] Shutting down kubernetes service endpoint reconciler I0319 12:11:54.090959 11 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0319 12:11:54.091121 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0319 12:11:54.100650 11 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0319 12:11:54.100679 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0319 12:11:54.104029 11 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0319 12:11:54.119131 11 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0319 12:11:54.119163 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0319 12:11:54.119433 11 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0319 12:11:54.119453 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0319 12:11:54.119596 11 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0319 12:11:54.595932 11 healthz.go:278] shutdown check failed: readyz [-]shutdown failed: process is shutting down I0319 12:11:56.198979 11 apf_controller.go:493] "Update CurrentCL" plName="exempt" seatDemandHighWatermark=1 seatDemandAvg=0.006233154680991391 seatDemandStdev=0.07870389103287223 seatDemandSmoothed=10.89676765694713 fairFrac=2.2796127562642368 currentCL=1 concurrencyDenominator=1 backstop=false I0319 12:11:57.647362 11 admission.go:602] provider creation error: error fetching namespace "openshift-console-operator": unable to find annotation openshift.io/sa.scc.uid-range I0319 12:11:57.647626 11 trace.go:236] Trace[1751594498]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7c1d646f-8639-4805-86d8-7b7ef9a8e73c,client:192.168.32.10,api-group:,api-version:v1,name:,subresource:,namespace:openshift-console-operator,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openshift-console-operator/pods,user-agent:kube-controller-manager/v1.31.14 (linux/amd64) kubernetes/8311c4d/system:serviceaccount:kube-system:replicaset-controller,verb:POST (19-Mar-2026 12:11:47.644) (total time: 10002ms): Trace[1751594498]: ---"Write to database call failed" len:1861,err:pods "console-operator-76b6568d85-" is forbidden: error fetching namespace "openshift-console-operator": unable to find annotation openshift.io/sa.scc.uid-range 10002ms (12:11:57.647) Trace[1751594498]: [10.002675458s] [10.002675458s] END I0319 12:12:01.745537 11 admission.go:602] provider creation error: error fetching namespace "openshift-network-console": unable to find annotation openshift.io/sa.scc.uid-range E0319 12:12:01.745580 11 patch_podspecextractor.go:100] "failed to mutate object for PSA using SCC" err="pods \"pod-for-container-named-networking-console-plugin-7c6b76c555\" is forbidden: error fetching namespace \"openshift-network-console\": unable to find annotation openshift.io/sa.scc.uid-range" E0319 12:12:01.745598 11 patch_podspecextractor.go:101] "Unhandled Error" err="failed to mutate object for PSA using SCC: pods \"pod-for-container-named-networking-console-plugin-7c6b76c555\" is forbidden: error fetching namespace \"openshift-network-console\": unable to find annotation openshift.io/sa.scc.uid-range" logger="UnhandledError" I0319 12:12:01.757937 11 trace.go:236] Trace[1944499730]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e2d3907c-0219-4ed7-9d17-f15c7d750cc5,client:192.168.32.10,api-group:apps,api-version:v1,name:,subresource:,namespace:openshift-network-console,protocol:HTTP/2.0,resource:replicasets,scope:resource,url:/apis/apps/v1/namespaces/openshift-network-console/replicasets,user-agent:kube-controller-manager/v1.31.14 (linux/amd64) kubernetes/8311c4d/system:serviceaccount:kube-system:deployment-controller,verb:POST (19-Mar-2026 12:11:51.743) (total time: 10014ms): Trace[1944499730]: [10.01402481s] [10.01402481s] END I0319 12:12:01.758340 11 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0319 12:12:01.758364 11 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0319 12:12:01.758403 11 controller.go:157] Shutting down quota evaluator I0319 12:12:01.758426 11 controller.go:176] quota evaluator worker shutdown I0319 12:12:01.758454 11 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0319 12:12:01.758544 11 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0319 12:12:01.758557 11 controller.go:176] quota evaluator worker shutdown I0319 12:12:01.758569 11 controller.go:176] quota evaluator worker shutdown I0319 12:12:01.758577 11 controller.go:176] quota evaluator worker shutdown I0319 12:12:01.758587 11 controller.go:176] quota evaluator worker shutdown I0319 12:12:01.759309 11 gc_controller.go:91] Shutting down apiserver lease garbage collector I0319 12:12:01.759323 11 controller.go:132] Ending legacy_token_tracking_controller I0319 12:12:01.759328 11 controller.go:133] Shutting down legacy_token_tracking_controller I0319 12:12:01.759356 11 local_available_controller.go:172] Shutting down LocalAvailability controller I0319 12:12:01.759396 11 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0319 12:12:01.759407 11 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0319 12:12:01.759903 11 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting E0319 12:12:01.760031 11 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=14158&timeout=5m13s&timeoutSeconds=313&watch=true" auditID="6ac0e524-6d31-4941-93a8-e69a2bfa2f8f" I0319 12:12:01.760071 11 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0319 12:12:01.760380 11 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0319 12:12:01.760457 11 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0319 12:12:01.760468 11 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0319 12:12:01.760508 11 controller.go:120] Shutting down OpenAPI V3 controller I0319 12:12:01.760523 11 autoregister_controller.go:168] Shutting down autoregister controller I0319 12:12:01.760541 11 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0319 12:12:01.760556 11 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0319 12:12:01.760571 11 naming_controller.go:305] Shutting down NamingConditionController I0319 12:12:01.760575 11 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0319 12:12:01.760589 11 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0319 12:12:01.760604 11 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0319 12:12:01.760618 11 establishing_controller.go:92] Shutting down EstablishingController I0319 12:12:01.760628 11 crd_finalizer.go:281] Shutting down CRDFinalizer I0319 12:12:01.760662 11 controller.go:170] Shutting down OpenAPI controller I0319 12:12:01.760682 11 system_namespaces_controller.go:76] Shutting down system namespaces controller I0319 12:12:01.760692 11 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0319 12:12:01.760710 11 secure_serving.go:258] Stopped listening on [::]:6443 I0319 12:12:01.760735 11 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0319 12:12:01.760735 11 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0319 12:12:01.760837 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0319 12:12:01.760899 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0319 12:12:01.760919 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0319 12:12:01.760851 11 controller.go:84] Shutting down OpenAPI AggregationController I0319 12:12:01.760970 11 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0319 12:12:01.760989 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0319 12:12:01.761003 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0319 12:12:01.761012 11 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0319 12:12:01.760876 11 controller.go:86] Shutting down OpenAPI V3 AggregationController I0319 12:12:01.761032 11 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0319 12:12:01.760711 11 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0319 12:12:01.760752 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0319 12:12:03.760996 11 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0319 12:12:03.761063 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0319 12:12:03.765932 11 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0319 12:12:03.766828 11 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0319 12:12:03.768024 11 cacher.go:171] Terminating all watchers from cacher endpoints W0319 12:12:03.769314 11 cacher.go:171] Terminating all watchers from cacher namespaces W0319 12:12:03.772098 11 cacher.go:171] Terminating all watchers from cacher nodes W0319 12:12:03.774240 11 cacher.go:171] Terminating all watchers from cacher secrets W0319 12:12:03.780464 11 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0319 12:12:03.782991 11 cacher.go:171] Terminating all watchers from cacher resourcequotas W0319 12:12:03.786595 11 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0319 12:12:03.788204 11 cacher.go:171] Terminating all watchers from cacher podtemplates W0319 12:12:03.788655 11 cacher.go:171] Terminating all watchers from cacher services W0319 12:12:03.794385 11 cacher.go:171] Terminating all watchers from cacher limitranges W0319 12:12:03.795511 11 cacher.go:171] Terminating all watchers from cacher configmaps W0319 12:12:03.807539 11 cacher.go:171] Terminating all watchers from cacher pods W0319 12:12:03.809850 11 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0319 12:12:03.812295 11 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0319 12:12:03.812788 11 cacher.go:171] Terminating all watchers from cacher jobs.batch W0319 12:12:03.813146 11 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0319 12:12:03.817189 11 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0319 12:12:03.818956 11 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0319 12:12:03.819789 11 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0319 12:12:03.821074 11 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0319 12:12:03.822393 11 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0319 12:12:03.823744 11 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0319 12:12:03.824542 11 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0319 12:12:03.825329 11 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0319 12:12:03.827299 11 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0319 12:12:03.828961 11 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0319 12:12:03.831576 11 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0319 12:12:03.832673 11 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0319 12:12:03.833949 11 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0319 12:12:03.834324 11 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0319 12:12:03.834888 11 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0319 12:12:03.835817 11 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0319 12:12:03.836454 11 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0319 12:12:03.836939 11 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0319 12:12:03.838247 11 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0319 12:12:03.838950 11 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0319 12:12:03.839563 11 cacher.go:171] Terminating all watchers from cacher deployments.apps W0319 12:12:03.841729 11 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0319 12:12:03.845037 11 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0319 12:12:03.847347 11 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0319 12:12:03.848239 11 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0319 12:12:03.849021 11 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0319 12:12:03.850401 11 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0319 12:12:03.851532 11 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0319 12:12:03.852510 11 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0319 12:12:03.853876 11 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0319 12:12:03.855123 11 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0319 12:12:03.855820 11 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0319 12:12:03.856190 11 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0319 12:12:03.857182 11 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0319 12:12:03.857758 11 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0319 12:12:03.858483 11 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0319 12:12:03.859301 11 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0319 12:12:03.859907 11 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0319 12:12:03.860307 11 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0319 12:12:03.860866 11 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0319 12:12:03.861349 11 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0319 12:12:03.861807 11 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0319 12:12:03.862168 11 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0319 12:12:03.862594 11 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0319 12:12:03.863268 11 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0319 12:12:03.863793 11 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0319 12:12:03.864555 11 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0319 12:12:03.865212 11 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0319 12:12:03.865698 11 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0319 12:12:03.866378 11 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0319 12:12:03.867256 11 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0319 12:12:03.868105 11 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0319 12:12:03.869769 11 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0319 12:12:03.871183 11 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0319 12:12:03.871713 11 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0319 12:12:03.872989 11 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0319 12:12:03.873505 11 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0319 12:12:03.874019 11 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0319 12:12:03.874786 11 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0319 12:12:03.876042 11 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0319 12:12:03.876583 11 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0319 12:12:03.877121 11 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0319 12:12:03.877894 11 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0319 12:12:03.879719 11 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0319 12:12:03.880391 11 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0319 12:12:03.880874 11 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0319 12:12:03.881396 11 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0319 12:12:03.882121 11 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0319 12:12:03.883008 11 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0319 12:12:03.883875 11 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0319 12:12:03.884481 11 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0319 12:12:03.885164 11 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0319 12:12:03.885853 11 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0319 12:12:03.886920 11 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0319 12:12:03.887942 11 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0319 12:12:03.888531 11 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0319 12:12:03.889390 11 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0319 12:12:03.890100 11 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0319 12:12:03.890432 11 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0319 12:12:03.890962 11 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0319 12:12:03.891856 11 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0319 12:12:03.892250 11 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0319 12:12:03.892857 11 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0319 12:12:03.893577 11 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0319 12:12:03.894277 11 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0319 12:12:03.895608 11 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0319 12:12:03.896527 11 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0319 12:12:03.897248 11 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0319 12:12:03.897917 11 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0319 12:12:03.898768 11 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0319 12:12:03.899411 11 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0319 12:12:03.900122 11 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0319 12:12:03.900691 11 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0319 12:12:03.901239 11 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0319 12:12:03.902363 11 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0319 12:12:03.905473 11 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0319 12:12:03.906564 11 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0319 12:12:03.907244 11 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0319 12:12:03.907793 11 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0319 12:12:03.908316 11 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0319 12:12:03.908827 11 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0319 12:12:03.909585 11 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0319 12:12:03.911151 11 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0319 12:12:03.911754 11 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0319 12:12:03.912170 11 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0319 12:12:03.913243 11 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0319 12:12:03.913753 11 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0319 12:12:03.915558 11 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0319 12:12:03.916012 11 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0319 12:12:03.916339 11 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0319 12:12:03.916842 11 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0319 12:12:03.917328 11 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0319 12:12:03.917907 11 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0319 12:12:03.918620 11 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0319 12:12:03.919057 11 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0319 12:12:03.919516 11 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0319 12:12:03.920553 11 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0319 12:12:03.921343 11 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0319 12:12:03.921747 11 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0319 12:12:03.922120 11 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0319 12:12:03.922716 11 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0319 12:12:03.923201 11 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0319 12:12:03.923613 11 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0319 12:12:03.924417 11 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0319 12:12:03.925084 11 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0319 12:12:03.925537 11 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0319 12:12:03.925938 11 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0319 12:12:03.926356 11 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0319 12:12:03.927295 11 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0319 12:12:03.928142 11 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0319 12:12:03.928558 11 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0319 12:12:03.929344 11 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io W0319 12:12:03.929853 11 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0319 12:12:03.930344 11 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0319 12:12:03.930943 11 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0319 12:12:03.931347 11 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0319 12:12:03.931768 11 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0319 12:12:03.932176 11 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0319 12:12:03.933037 11 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0319 12:12:03.933430 11 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0319 12:12:03.935183 11 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io W0319 12:12:03.935779 11 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0319 12:12:03.936543 11 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0319 12:12:03.937122 11 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0319 12:12:03.937792 11 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0319 12:12:03.938945 11 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0319 12:12:03.939382 11 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0319 12:12:03.939725 11 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0319 12:12:03.940402 11 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0319 12:12:03.940931 11 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0319 12:12:03.941513 11 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0319 12:12:03.942048 11 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0319 12:12:03.942658 11 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0319 12:12:03.943592 11 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0319 12:12:03.944105 11 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0319 12:12:03.944471 11 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0319 12:12:03.945158 11 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0319 12:12:03.945436 11 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0319 12:12:03.945977 11 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0319 12:12:03.947019 11 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0319 12:12:03.948913 11 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0319 12:12:03.949835 11 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0319 12:12:03.950322 11 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0319 12:12:03.951084 11 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0319 12:12:03.951909 11 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io I0319 12:12:03.990544 1 main.go:235] Termination finished with exit code 0 I0319 12:12:03.990595 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" --- I0319 12:15:09.163614 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0319 12:15:09.164015 12 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0319 12:15:09.164026 12 controller.go:128] Shutting down kubernetes service endpoint reconciler I0319 12:15:09.164058 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0319 12:15:09.174924 12 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0319 12:15:09.175040 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0319 12:15:09.180427 12 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0319 12:15:09.200217 12 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0319 12:15:09.200276 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0319 12:15:09.200282 12 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0319 12:15:09.200330 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0319 12:15:09.200351 12 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0319 12:15:09.233030 12 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0319 12:15:09.233080 12 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0319 12:15:09.233087 12 controller.go:157] Shutting down quota evaluator I0319 12:15:09.233107 12 controller.go:176] quota evaluator worker shutdown I0319 12:15:09.233132 12 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0319 12:15:09.233174 12 controller.go:86] Shutting down OpenAPI V3 AggregationController I0319 12:15:09.233190 12 controller.go:176] quota evaluator worker shutdown I0319 12:15:09.233199 12 controller.go:176] quota evaluator worker shutdown I0319 12:15:09.233208 12 controller.go:176] quota evaluator worker shutdown I0319 12:15:09.233213 12 controller.go:176] quota evaluator worker shutdown I0319 12:15:09.233783 12 system_namespaces_controller.go:76] Shutting down system namespaces controller I0319 12:15:09.233797 12 autoregister_controller.go:168] Shutting down autoregister controller I0319 12:15:09.233903 12 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0319 12:15:09.233974 12 crd_finalizer.go:281] Shutting down CRDFinalizer I0319 12:15:09.234030 12 naming_controller.go:305] Shutting down NamingConditionController I0319 12:15:09.234047 12 controller.go:170] Shutting down OpenAPI controller I0319 12:15:09.234071 12 establishing_controller.go:92] Shutting down EstablishingController I0319 12:15:09.234084 12 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0319 12:15:09.234103 12 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0319 12:15:09.234126 12 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0319 12:15:09.234136 12 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0319 12:15:09.234154 12 controller.go:132] Ending legacy_token_tracking_controller I0319 12:15:09.234162 12 controller.go:120] Shutting down OpenAPI V3 controller I0319 12:15:09.234171 12 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0319 12:15:09.234176 12 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0319 12:15:09.234185 12 gc_controller.go:91] Shutting down apiserver lease garbage collector I0319 12:15:09.234194 12 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0319 12:15:09.234205 12 local_available_controller.go:172] Shutting down LocalAvailability controller I0319 12:15:09.234378 12 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0319 12:15:09.234162 12 controller.go:133] Shutting down legacy_token_tracking_controller I0319 12:15:09.234417 12 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0319 12:15:09.234506 12 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0319 12:15:09.234306 12 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0319 12:15:09.234532 12 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0319 12:15:09.234683 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0319 12:15:09.234540 12 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0319 12:15:09.234564 12 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0319 12:15:09.234444 12 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0319 12:15:09.234547 12 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0319 12:15:09.234694 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0319 12:15:09.234704 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0319 12:15:09.234714 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0319 12:15:09.234723 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0319 12:15:09.234733 12 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0319 12:15:09.234551 12 controller.go:84] Shutting down OpenAPI AggregationController I0319 12:15:09.234742 12 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0319 12:15:09.234627 12 secure_serving.go:258] Stopped listening on [::]:6443 I0319 12:15:09.235453 12 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0319 12:15:09.235471 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening E0319 12:15:09.238234 12 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=16984&timeout=5m46s&timeoutSeconds=346&watch=true" auditID="696b1e43-492d-46e0-aa95-92b9d30cf5be" I0319 12:15:11.234817 12 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0319 12:15:11.234872 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0319 12:15:11.336875 12 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0319 12:15:11.337811 12 cacher.go:171] Terminating all watchers from cacher endpoints W0319 12:15:11.339200 12 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0319 12:15:11.339930 12 cacher.go:171] Terminating all watchers from cacher namespaces W0319 12:15:11.342176 12 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0319 12:15:11.343269 12 cacher.go:171] Terminating all watchers from cacher configmaps W0319 12:15:11.370501 12 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0319 12:15:11.372846 12 cacher.go:171] Terminating all watchers from cacher resourcequotas W0319 12:15:11.373411 12 cacher.go:171] Terminating all watchers from cacher secrets W0319 12:15:11.379237 12 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0319 12:15:11.380106 12 cacher.go:171] Terminating all watchers from cacher podtemplates W0319 12:15:11.380451 12 cacher.go:171] Terminating all watchers from cacher pods W0319 12:15:11.381552 12 cacher.go:171] Terminating all watchers from cacher services W0319 12:15:11.383527 12 cacher.go:171] Terminating all watchers from cacher nodes W0319 12:15:11.384696 12 cacher.go:171] Terminating all watchers from cacher limitranges W0319 12:15:11.385458 12 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0319 12:15:11.386432 12 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0319 12:15:11.386920 12 cacher.go:171] Terminating all watchers from cacher jobs.batch W0319 12:15:11.387311 12 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0319 12:15:11.389286 12 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0319 12:15:11.390079 12 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0319 12:15:11.390655 12 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0319 12:15:11.391151 12 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0319 12:15:11.391556 12 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0319 12:15:11.392970 12 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0319 12:15:11.393672 12 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0319 12:15:11.394592 12 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0319 12:15:11.401248 12 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0319 12:15:11.405364 12 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0319 12:15:11.406252 12 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0319 12:15:11.409760 12 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0319 12:15:11.410454 12 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0319 12:15:11.411139 12 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0319 12:15:11.411968 12 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0319 12:15:11.413736 12 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0319 12:15:11.414173 12 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0319 12:15:11.415443 12 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0319 12:15:11.416015 12 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0319 12:15:11.417678 12 cacher.go:171] Terminating all watchers from cacher deployments.apps W0319 12:15:11.423126 12 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0319 12:15:11.424156 12 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0319 12:15:11.425693 12 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0319 12:15:11.427446 12 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0319 12:15:11.429112 12 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0319 12:15:11.430282 12 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0319 12:15:11.431085 12 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0319 12:15:11.431917 12 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0319 12:15:11.434555 12 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0319 12:15:11.436028 12 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0319 12:15:11.437054 12 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0319 12:15:11.437968 12 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0319 12:15:11.438616 12 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0319 12:15:11.439286 12 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0319 12:15:11.440214 12 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0319 12:15:11.441239 12 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0319 12:15:11.441990 12 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0319 12:15:11.442568 12 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0319 12:15:11.448229 12 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0319 12:15:11.449573 12 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0319 12:15:11.450879 12 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0319 12:15:11.451745 12 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0319 12:15:11.453705 12 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0319 12:15:11.454759 12 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0319 12:15:11.456100 12 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0319 12:15:11.457013 12 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0319 12:15:11.457700 12 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0319 12:15:11.459164 12 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0319 12:15:11.461612 12 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0319 12:15:11.462542 12 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0319 12:15:11.463849 12 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0319 12:15:11.464424 12 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0319 12:15:11.464942 12 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0319 12:15:11.465349 12 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0319 12:15:11.465921 12 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0319 12:15:11.466550 12 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0319 12:15:11.467111 12 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0319 12:15:11.467614 12 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0319 12:15:11.468581 12 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0319 12:15:11.469274 12 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0319 12:15:11.469746 12 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0319 12:15:11.470520 12 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0319 12:15:11.471218 12 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0319 12:15:11.471919 12 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0319 12:15:11.472914 12 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0319 12:15:11.474238 12 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0319 12:15:11.475283 12 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0319 12:15:11.475898 12 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0319 12:15:11.476763 12 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0319 12:15:11.477727 12 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0319 12:15:11.478196 12 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0319 12:15:11.478611 12 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0319 12:15:11.479128 12 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0319 12:15:11.480439 12 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0319 12:15:11.481290 12 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0319 12:15:11.481914 12 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0319 12:15:11.482724 12 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0319 12:15:11.485385 12 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0319 12:15:11.486044 12 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0319 12:15:11.486518 12 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0319 12:15:11.487580 12 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0319 12:15:11.488070 12 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0319 12:15:11.488524 12 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0319 12:15:11.489170 12 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0319 12:15:11.489581 12 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0319 12:15:11.490206 12 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0319 12:15:11.490945 12 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0319 12:15:11.491488 12 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0319 12:15:11.491914 12 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io W0319 12:15:11.492248 12 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0319 12:15:11.492875 12 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0319 12:15:11.493345 12 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0319 12:15:11.493756 12 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0319 12:15:11.494118 12 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0319 12:15:11.494827 12 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0319 12:15:11.495435 12 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0319 12:15:11.496231 12 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0319 12:15:11.497244 12 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0319 12:15:11.497977 12 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0319 12:15:11.498508 12 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0319 12:15:11.499196 12 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0319 12:15:11.499689 12 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0319 12:15:11.500180 12 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0319 12:15:11.500722 12 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0319 12:15:11.501095 12 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0319 12:15:11.501450 12 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0319 12:15:11.501982 12 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0319 12:15:11.502663 12 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0319 12:15:11.503202 12 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0319 12:15:11.503582 12 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0319 12:15:11.507425 12 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0319 12:15:11.508112 12 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0319 12:15:11.508698 12 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0319 12:15:11.509213 12 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0319 12:15:11.509732 12 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0319 12:15:11.510159 12 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0319 12:15:11.510803 12 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0319 12:15:11.511463 12 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0319 12:15:11.512089 12 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0319 12:15:11.513062 12 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0319 12:15:11.513708 12 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0319 12:15:11.514547 12 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0319 12:15:11.515259 12 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0319 12:15:11.516362 12 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0319 12:15:11.517014 12 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0319 12:15:11.517512 12 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0319 12:15:11.517937 12 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0319 12:15:11.518373 12 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0319 12:15:11.518863 12 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0319 12:15:11.519669 12 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0319 12:15:11.520055 12 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0319 12:15:11.520770 12 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0319 12:15:11.521105 12 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0319 12:15:11.521471 12 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0319 12:15:11.522249 12 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0319 12:15:11.522673 12 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0319 12:15:11.523100 12 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0319 12:15:11.524333 12 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0319 12:15:11.524886 12 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0319 12:15:11.525163 12 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0319 12:15:11.526395 12 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0319 12:15:11.526945 12 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0319 12:15:11.527609 12 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0319 12:15:11.529964 12 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0319 12:15:11.530420 12 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0319 12:15:11.530831 12 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0319 12:15:11.531204 12 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0319 12:15:11.531732 12 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0319 12:15:11.532694 12 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0319 12:15:11.533178 12 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0319 12:15:11.534002 12 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0319 12:15:11.534446 12 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0319 12:15:11.535090 12 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0319 12:15:11.535660 12 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0319 12:15:11.536250 12 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0319 12:15:11.536864 12 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0319 12:15:11.537505 12 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0319 12:15:11.538104 12 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0319 12:15:11.538583 12 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0319 12:15:11.539116 12 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0319 12:15:11.539696 12 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0319 12:15:11.540402 12 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0319 12:15:11.541499 12 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0319 12:15:11.541913 12 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io I0319 12:15:11.579866 1 main.go:235] Termination finished with exit code 0 I0319 12:15:11.579918 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" ---