--- I0318 10:12:51.725687 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0318 10:12:51.726206 12 controller.go:128] Shutting down kubernetes service endpoint reconciler I0318 10:12:51.726220 12 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0318 10:12:51.726389 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0318 10:12:51.742564 12 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0318 10:12:51.742631 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0318 10:12:51.748112 12 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0318 10:12:51.768001 12 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0318 10:12:51.768037 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0318 10:12:51.768312 12 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0318 10:12:51.768370 12 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0318 10:12:51.768386 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0318 10:12:51.795151 12 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0318 10:12:51.795183 12 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0318 10:12:51.795230 12 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0318 10:12:51.795273 12 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0318 10:12:51.795312 12 controller.go:157] Shutting down quota evaluator I0318 10:12:51.795320 12 controller.go:176] quota evaluator worker shutdown I0318 10:12:51.798207 12 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0318 10:12:51.798227 12 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0318 10:12:51.798435 12 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0318 10:12:51.798459 12 controller.go:120] Shutting down OpenAPI V3 controller I0318 10:12:51.798470 12 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0318 10:12:51.798483 12 controller.go:170] Shutting down OpenAPI controller I0318 10:12:51.798494 12 autoregister_controller.go:168] Shutting down autoregister controller I0318 10:12:51.798504 12 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0318 10:12:51.798515 12 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0318 10:12:51.798524 12 naming_controller.go:305] Shutting down NamingConditionController I0318 10:12:51.798533 12 establishing_controller.go:92] Shutting down EstablishingController I0318 10:12:51.798541 12 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0318 10:12:51.798550 12 crd_finalizer.go:281] Shutting down CRDFinalizer I0318 10:12:51.798563 12 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0318 10:12:51.798574 12 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0318 10:12:51.798585 12 local_available_controller.go:172] Shutting down LocalAvailability controller I0318 10:12:51.798593 12 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0318 10:12:51.798603 12 system_namespaces_controller.go:76] Shutting down system namespaces controller I0318 10:12:51.798633 12 gc_controller.go:91] Shutting down apiserver lease garbage collector I0318 10:12:51.798640 12 controller.go:132] Ending legacy_token_tracking_controller I0318 10:12:51.798644 12 controller.go:133] Shutting down legacy_token_tracking_controller I0318 10:12:51.798872 12 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0318 10:12:51.798883 12 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0318 10:12:51.798891 12 controller.go:86] Shutting down OpenAPI V3 AggregationController I0318 10:12:51.798904 12 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0318 10:12:51.798927 12 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0318 10:12:51.798935 12 controller.go:84] Shutting down OpenAPI AggregationController I0318 10:12:51.798943 12 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0318 10:12:51.798955 12 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0318 10:12:51.798988 12 secure_serving.go:258] Stopped listening on [::]:6443 I0318 10:12:51.798999 12 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0318 10:12:51.799010 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening E0318 10:12:51.802214 12 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=14055&timeout=5m1s&timeoutSeconds=301&watch=true" auditID="cbda10bc-ca72-494c-9a12-9b16c43c1f11" I0318 10:12:51.808211 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0318 10:12:51.808254 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0318 10:12:51.808271 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0318 10:12:51.808287 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0318 10:12:51.808305 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0318 10:12:51.808318 12 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0318 10:12:51.808333 12 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0318 10:12:51.808742 12 controller.go:176] quota evaluator worker shutdown I0318 10:12:51.808761 12 controller.go:176] quota evaluator worker shutdown I0318 10:12:51.808767 12 controller.go:176] quota evaluator worker shutdown I0318 10:12:51.808773 12 controller.go:176] quota evaluator worker shutdown I0318 10:12:53.799578 12 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0318 10:12:53.799644 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0318 10:12:53.824638 12 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0318 10:12:53.825928 12 cacher.go:171] Terminating all watchers from cacher configmaps W0318 10:12:53.839792 12 cacher.go:171] Terminating all watchers from cacher endpoints W0318 10:12:53.846020 12 cacher.go:171] Terminating all watchers from cacher nodes W0318 10:12:53.852102 12 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0318 10:12:53.852926 12 cacher.go:171] Terminating all watchers from cacher namespaces W0318 10:12:53.855714 12 cacher.go:171] Terminating all watchers from cacher secrets W0318 10:12:53.859661 12 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0318 10:12:53.871426 12 cacher.go:171] Terminating all watchers from cacher services W0318 10:12:53.876716 12 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0318 10:12:53.879106 12 cacher.go:171] Terminating all watchers from cacher limitranges W0318 10:12:53.882300 12 cacher.go:171] Terminating all watchers from cacher pods W0318 10:12:53.884548 12 cacher.go:171] Terminating all watchers from cacher podtemplates W0318 10:12:53.886660 12 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0318 10:12:53.887344 12 cacher.go:171] Terminating all watchers from cacher resourcequotas W0318 10:12:53.887765 12 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0318 10:12:53.888508 12 cacher.go:171] Terminating all watchers from cacher jobs.batch W0318 10:12:53.889276 12 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0318 10:12:53.890338 12 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0318 10:12:53.890741 12 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0318 10:12:53.891249 12 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0318 10:12:53.891856 12 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0318 10:12:53.892313 12 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0318 10:12:53.895107 12 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0318 10:12:53.895611 12 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0318 10:12:53.896309 12 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0318 10:12:53.897163 12 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0318 10:12:53.897926 12 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0318 10:12:53.898460 12 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0318 10:12:53.899094 12 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0318 10:12:53.900051 12 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0318 10:12:53.900398 12 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0318 10:12:53.901068 12 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0318 10:12:53.901693 12 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0318 10:12:53.902287 12 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0318 10:12:53.903233 12 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0318 10:12:53.904496 12 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0318 10:12:53.905049 12 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0318 10:12:53.905657 12 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0318 10:12:53.906125 12 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0318 10:12:53.906592 12 cacher.go:171] Terminating all watchers from cacher deployments.apps W0318 10:12:53.907649 12 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0318 10:12:53.908364 12 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0318 10:12:53.909103 12 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0318 10:12:53.911361 12 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0318 10:12:53.912464 12 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0318 10:12:53.913166 12 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0318 10:12:53.915512 12 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0318 10:12:53.916144 12 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0318 10:12:53.916552 12 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0318 10:12:53.917087 12 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0318 10:12:53.917500 12 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0318 10:12:53.918028 12 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0318 10:12:53.919044 12 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0318 10:12:53.919444 12 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0318 10:12:53.919936 12 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0318 10:12:53.920569 12 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0318 10:12:53.920903 12 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0318 10:12:53.921314 12 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0318 10:12:53.921641 12 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0318 10:12:53.922343 12 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0318 10:12:53.922652 12 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0318 10:12:53.924505 12 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0318 10:12:53.925141 12 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0318 10:12:53.925776 12 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0318 10:12:53.926488 12 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0318 10:12:53.926846 12 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0318 10:12:53.927189 12 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0318 10:12:53.927744 12 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0318 10:12:53.928396 12 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0318 10:12:53.929084 12 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0318 10:12:53.929608 12 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0318 10:12:53.930039 12 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0318 10:12:53.930700 12 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0318 10:12:53.931071 12 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0318 10:12:53.931571 12 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0318 10:12:53.932051 12 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0318 10:12:53.932336 12 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0318 10:12:53.932699 12 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0318 10:12:53.933295 12 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0318 10:12:53.933844 12 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0318 10:12:53.934513 12 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0318 10:12:53.935114 12 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0318 10:12:53.935637 12 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0318 10:12:53.935997 12 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0318 10:12:53.936493 12 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0318 10:12:53.936997 12 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0318 10:12:53.937899 12 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0318 10:12:53.938469 12 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0318 10:12:53.939067 12 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0318 10:12:53.939732 12 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0318 10:12:53.940883 12 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0318 10:12:53.941310 12 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0318 10:12:53.941902 12 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0318 10:12:53.942868 12 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0318 10:12:53.943539 12 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0318 10:12:53.944087 12 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0318 10:12:53.944544 12 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0318 10:12:53.944876 12 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0318 10:12:53.947443 12 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0318 10:12:53.948073 12 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0318 10:12:53.948381 12 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0318 10:12:53.949126 12 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0318 10:12:53.949691 12 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0318 10:12:53.950208 12 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0318 10:12:53.950906 12 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0318 10:12:53.951571 12 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0318 10:12:53.952659 12 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0318 10:12:53.953149 12 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0318 10:12:53.953517 12 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0318 10:12:53.954325 12 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0318 10:12:53.954701 12 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0318 10:12:53.954983 12 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0318 10:12:53.955488 12 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0318 10:12:53.956233 12 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0318 10:12:53.956643 12 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0318 10:12:53.958000 12 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0318 10:12:53.958522 12 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0318 10:12:53.959416 12 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0318 10:12:53.960481 12 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0318 10:12:53.960970 12 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0318 10:12:53.961607 12 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0318 10:12:53.962572 12 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0318 10:12:53.962954 12 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0318 10:12:53.963678 12 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0318 10:12:53.964075 12 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0318 10:12:53.964348 12 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0318 10:12:53.964740 12 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0318 10:12:53.965365 12 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0318 10:12:53.966163 12 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0318 10:12:53.966479 12 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0318 10:12:53.967025 12 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0318 10:12:53.967355 12 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0318 10:12:53.968170 12 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0318 10:12:53.968534 12 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0318 10:12:53.969064 12 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0318 10:12:53.969580 12 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0318 10:12:53.969943 12 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0318 10:12:53.970327 12 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0318 10:12:53.971020 12 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0318 10:12:53.971526 12 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0318 10:12:53.972415 12 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0318 10:12:53.972981 12 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0318 10:12:53.973401 12 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0318 10:12:53.973716 12 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0318 10:12:53.974089 12 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0318 10:12:53.974478 12 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0318 10:12:53.974806 12 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0318 10:12:53.975406 12 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0318 10:12:53.976004 12 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0318 10:12:53.976546 12 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0318 10:12:53.976876 12 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0318 10:12:53.977424 12 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0318 10:12:53.977843 12 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0318 10:12:53.978296 12 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0318 10:12:53.978698 12 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0318 10:12:53.979041 12 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0318 10:12:53.979482 12 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0318 10:12:53.979900 12 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0318 10:12:53.980784 12 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0318 10:12:53.981590 12 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0318 10:12:53.981942 12 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0318 10:12:53.982331 12 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0318 10:12:53.982694 12 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0318 10:12:53.983435 12 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io W0318 10:12:53.983754 12 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0318 10:12:53.984067 12 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0318 10:12:53.984448 12 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0318 10:12:53.984807 12 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0318 10:12:53.985485 12 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0318 10:12:53.985865 12 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0318 10:12:53.986181 12 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0318 10:12:53.986741 12 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0318 10:12:53.987119 12 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0318 10:12:53.988420 12 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0318 10:12:53.989239 12 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0318 10:12:53.989751 12 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0318 10:12:53.990264 12 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0318 10:12:53.990621 12 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0318 10:12:53.991171 12 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0318 10:12:53.992009 12 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0318 10:12:53.992682 12 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io I0318 10:12:54.018370 1 main.go:235] Termination finished with exit code 0 I0318 10:12:54.018419 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" ---