--- I0318 13:25:44.480150 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0318 13:25:44.480359 13 controller.go:128] Shutting down kubernetes service endpoint reconciler I0318 13:25:44.480362 13 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0318 13:25:44.480617 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0318 13:25:44.536777 13 trace.go:236] Trace[72325752]: "Delete" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2ca6a284-2da1-4cce-92e2-9c184d887181,client:192.168.32.10,api-group:,api-version:v1,name:controller-manager-d7c95db55-d6lqm,subresource:,namespace:openshift-controller-manager,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-d7c95db55-d6lqm,user-agent:kubelet/v1.31.14 (linux/amd64) kubernetes/8311c4d,verb:DELETE (18-Mar-2026 13:25:42.174) (total time: 2362ms): Trace[72325752]: ["GuaranteedUpdate etcd3" audit-id:2ca6a284-2da1-4cce-92e2-9c184d887181,key:/pods/openshift-controller-manager/controller-manager-d7c95db55-d6lqm,type:*core.Pod,resource:pods 1067ms (13:25:43.468) Trace[72325752]: ---"Txn call completed" 655ms (13:25:44.124)] Trace[72325752]: ---"Object deleted from database" 411ms (13:25:44.536) Trace[72325752]: [2.362454456s] [2.362454456s] END I0318 13:25:44.684730 13 apf_controller.go:493] "Update CurrentCL" plName="exempt" seatDemandHighWatermark=2 seatDemandAvg=0.17888523575938867 seatDemandStdev=0.3849661591496468 seatDemandSmoothed=21.901153727556665 fairFrac=2.2796127562642368 currentCL=2 concurrencyDenominator=2 backstop=false I0318 13:25:44.972156 13 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0318 13:25:44.972268 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished I0318 13:25:45.540088 13 trace.go:236] Trace[1550444277]: "Create etcd3" audit-id:,key:/events/openshift-kube-apiserver/kube-apiserver-master-0.189df2654252ebed,type:*core.Event,resource:events (18-Mar-2026 13:25:44.972) (total time: 567ms): Trace[1550444277]: ---"Txn call succeeded" 567ms (13:25:45.540) Trace[1550444277]: [567.606306ms] [567.606306ms] END I0318 13:25:45.999825 13 trace.go:236] Trace[1792365929]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5c4cb477-a451-4977-80be-1f2eff07f2ec,client:192.168.32.10,api-group:rbac.authorization.k8s.io,api-version:v1,name:aggregate-olm-view,subresource:,namespace:,protocol:HTTP/2.0,resource:clusterroles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterroles/aggregate-olm-view,user-agent:cluster-version-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:44.978) (total time: 1021ms): Trace[1792365929]: ---"About to write a response" 1021ms (13:25:45.999) Trace[1792365929]: [1.021784687s] [1.021784687s] END I0318 13:25:45.999873 13 trace.go:236] Trace[1140830699]: "Get" accept:application/json, */*,audit-id:30b4c1a4-1367-41cc-80f3-32045f4bd761,client:10.128.0.28,api-group:monitoring.coreos.com,api-version:v1,name:k8s,subresource:,namespace:openshift-monitoring,protocol:HTTP/2.0,resource:prometheuses,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/openshift-monitoring/prometheuses/k8s,user-agent:operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:45.087) (total time: 912ms): Trace[1140830699]: [912.506626ms] [912.506626ms] END I0318 13:25:46.000010 13 trace.go:236] Trace[863715264]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9de68da1-3960-40fc-a09e-b3a3688c83dc,client:10.128.0.29,api-group:,api-version:v1,name:audit,subresource:,namespace:openshift-oauth-apiserver,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/openshift-oauth-apiserver/configmaps/audit,user-agent:authentication-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:45.186) (total time: 813ms): Trace[863715264]: ---"About to write a response" 813ms (13:25:45.999) Trace[863715264]: [813.843273ms] [813.843273ms] END I0318 13:25:45.999832 13 trace.go:236] Trace[2104726494]: "Get" accept:application/json,audit-id:111994eb-7c3b-44cd-b47d-3c7e7892c3e0,client:192.168.32.10,api-group:flowcontrol.apiserver.k8s.io,api-version:v1,name:openshift-control-plane-operators,subresource:,namespace:,protocol:HTTP/2.0,resource:prioritylevelconfigurations,scope:resource,url:/apis/flowcontrol.apiserver.k8s.io/v1/prioritylevelconfigurations/openshift-control-plane-operators,user-agent:cluster-version-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:44.979) (total time: 1020ms): Trace[2104726494]: ---"About to write a response" 1020ms (13:25:45.999) Trace[2104726494]: [1.020698983s] [1.020698983s] END I0318 13:25:46.000383 13 trace.go:236] Trace[196917406]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2fb7da4c-9c59-4790-a371-05c54c49da72,client:192.168.32.10,api-group:rbac.authorization.k8s.io,api-version:v1,name:console-extensions-reader,subresource:,namespace:,protocol:HTTP/2.0,resource:clusterrolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/console-extensions-reader,user-agent:cluster-version-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:44.978) (total time: 1021ms): Trace[196917406]: ---"About to write a response" 1021ms (13:25:46.000) Trace[196917406]: [1.021392824s] [1.021392824s] END I0318 13:25:46.000607 13 trace.go:236] Trace[411721517]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:67231f2d-c742-403c-9401-4c543c94ef70,client:192.168.32.10,api-group:rbac.authorization.k8s.io,api-version:v1,name:host-networking-system-node,subresource:,namespace:openshift-openstack-infra,protocol:HTTP/2.0,resource:rolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/namespaces/openshift-openstack-infra/rolebindings/host-networking-system-node,user-agent:cluster-version-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:44.979) (total time: 1021ms): Trace[411721517]: ---"About to write a response" 1021ms (13:25:46.000) Trace[411721517]: [1.021431425s] [1.021431425s] END I0318 13:25:46.000690 13 trace.go:236] Trace[1248227968]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:aca68858-bd64-4598-9fb3-671c9f85c267,client:192.168.32.10,api-group:,api-version:v1,name:,subresource:,namespace:openshift-route-controller-manager,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openshift-route-controller-manager/events,user-agent:kubelet/v1.31.14 (linux/amd64) kubernetes/8311c4d,verb:POST (18-Mar-2026 13:25:44.986) (total time: 1013ms): Trace[1248227968]: ["Create etcd3" audit-id:aca68858-bd64-4598-9fb3-671c9f85c267,key:/events/openshift-route-controller-manager/route-controller-manager-6c597dfd69-w66v8.189df264b33b0df5,type:*core.Event,resource:events 1013ms (13:25:44.987) Trace[1248227968]: ---"Txn call succeeded" 1013ms (13:25:46.000)] Trace[1248227968]: [1.013991703s] [1.013991703s] END I0318 13:25:46.000776 13 trace.go:236] Trace[1125498524]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:aaa0d9b1-0782-43d6-bf0f-0ed4a624516a,client:10.128.0.13,api-group:rbac.authorization.k8s.io,api-version:v1,name:system:openshift:controller:kube-apiserver-check-endpoints,subresource:,namespace:kube-system,protocol:HTTP/2.0,resource:rolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings/system:openshift:controller:kube-apiserver-check-endpoints,user-agent:cluster-kube-apiserver-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:44.984) (total time: 1015ms): Trace[1125498524]: ---"About to write a response" 1015ms (13:25:46.000) Trace[1125498524]: [1.015883959s] [1.015883959s] END I0318 13:25:46.000802 13 trace.go:236] Trace[1192348986]: "Get" accept:application/json,audit-id:c8ea4361-6bf2-432d-9578-44789a8ef6f9,client:192.168.32.10,api-group:cloudcredential.openshift.io,api-version:v1,name:openshift-openstack-cloud-controller-manager,subresource:,namespace:openshift-cloud-credential-operator,protocol:HTTP/2.0,resource:credentialsrequests,scope:resource,url:/apis/cloudcredential.openshift.io/v1/namespaces/openshift-cloud-credential-operator/credentialsrequests/openshift-openstack-cloud-controller-manager,user-agent:cluster-version-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:44.981) (total time: 1019ms): Trace[1192348986]: ---"About to write a response" 1019ms (13:25:46.000) Trace[1192348986]: [1.01924024s] [1.01924024s] END I0318 13:25:46.000943 13 trace.go:236] Trace[1256931864]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ae1b118f-ddf7-4546-9dd1-a31c89eb6b9d,client:::1,api-group:,api-version:v1,name:kubernetes,subresource:,namespace:default,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/default/endpoints/kubernetes,user-agent:kube-apiserver/v1.31.14 (linux/amd64) kubernetes/8311c4d,verb:GET (18-Mar-2026 13:25:44.975) (total time: 1025ms): Trace[1256931864]: ---"About to write a response" 1025ms (13:25:46.000) Trace[1256931864]: [1.025615661s] [1.025615661s] END I0318 13:25:46.000966 13 trace.go:236] Trace[932700312]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:146e5b6e-8164-4f90-9d75-6a340386ae7e,client:192.168.32.10,api-group:rbac.authorization.k8s.io,api-version:v1,name:prometheus-k8s,subresource:,namespace:openshift-cluster-samples-operator,protocol:HTTP/2.0,resource:rolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/namespaces/openshift-cluster-samples-operator/rolebindings/prometheus-k8s,user-agent:cluster-version-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:44.977) (total time: 1023ms): Trace[932700312]: ---"About to write a response" 1023ms (13:25:46.000) Trace[932700312]: [1.023827657s] [1.023827657s] END I0318 13:25:46.000967 13 trace.go:236] Trace[1562851351]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:52668247-a953-442c-9b22-2839f25ae8c0,client:10.128.0.13,api-group:,api-version:v1,name:node-kubeconfigs,subresource:,namespace:openshift-kube-apiserver,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/openshift-kube-apiserver/secrets/node-kubeconfigs,user-agent:cluster-kube-apiserver-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:45.045) (total time: 954ms): Trace[1562851351]: ---"About to write a response" 954ms (13:25:46.000) Trace[1562851351]: [954.972487ms] [954.972487ms] END I0318 13:25:46.000999 13 trace.go:236] Trace[414628059]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a98439c8-3982-4e96-a8e2-6ae001d1b7b7,client:192.168.32.10,api-group:,api-version:v1,name:master-0,subresource:status,namespace:,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/master-0/status,user-agent:kubelet/v1.31.14 (linux/amd64) kubernetes/8311c4d,verb:PATCH (18-Mar-2026 13:25:45.033) (total time: 967ms): Trace[414628059]: ["GuaranteedUpdate etcd3" audit-id:a98439c8-3982-4e96-a8e2-6ae001d1b7b7,key:/minions/master-0,type:*core.Node,resource:nodes 967ms (13:25:45.033) Trace[414628059]: ---"Txn call completed" 960ms (13:25:45.999)] Trace[414628059]: ---"Object stored in database" 960ms (13:25:45.999) Trace[414628059]: [967.763129ms] [967.763129ms] END I0318 13:25:46.001356 13 trace.go:236] Trace[1511709419]: "Update" accept:application/json, */*,audit-id:60dd9169-7018-4313-a211-b447352acf85,client:169.254.0.1,api-group:coordination.k8s.io,api-version:v1,name:cluster-machine-approver-leader,subresource:,namespace:openshift-cluster-machine-approver,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openshift-cluster-machine-approver/leases/cluster-machine-approver-leader,user-agent:machine-approver/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (18-Mar-2026 13:25:45.042) (total time: 958ms): Trace[1511709419]: ["GuaranteedUpdate etcd3" audit-id:60dd9169-7018-4313-a211-b447352acf85,key:/leases/openshift-cluster-machine-approver/cluster-machine-approver-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 958ms (13:25:45.042) Trace[1511709419]: ---"Txn call completed" 957ms (13:25:46.001)] Trace[1511709419]: [958.787212ms] [958.787212ms] END I0318 13:25:46.000454 13 trace.go:236] Trace[504777972]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fcf0f342-aebf-4376-8fcd-67b3fb138ee0,client:10.128.0.91,api-group:coordination.k8s.io,api-version:v1,name:openshift-route-controllers,subresource:,namespace:openshift-route-controller-manager,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openshift-route-controller-manager/leases/openshift-route-controllers,user-agent:route-controller-manager/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (18-Mar-2026 13:25:44.977) (total time: 1022ms): Trace[504777972]: ["GuaranteedUpdate etcd3" audit-id:fcf0f342-aebf-4376-8fcd-67b3fb138ee0,key:/leases/openshift-route-controller-manager/openshift-route-controllers,type:*coordination.Lease,resource:leases.coordination.k8s.io 1022ms (13:25:44.977) Trace[504777972]: ---"Txn call completed" 1021ms (13:25:46.000)] Trace[504777972]: [1.022722224s] [1.022722224s] END I0318 13:25:46.000466 13 trace.go:236] Trace[1252754485]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e6c88998-4675-4091-a8c2-c47a2fbe7a6c,client:10.128.0.13,api-group:,api-version:v1,name:kube-apiserver-audit-policies,subresource:,namespace:openshift-kube-apiserver,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/openshift-kube-apiserver/configmaps/kube-apiserver-audit-policies,user-agent:cluster-kube-apiserver-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:45.246) (total time: 754ms): Trace[1252754485]: ---"About to write a response" 754ms (13:25:46.000) Trace[1252754485]: [754.118987ms] [754.118987ms] END I0318 13:25:46.012029 13 trace.go:236] Trace[1596341330]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d011d5f2-c608-4fbb-87e7-1dcbc49a80a8,client:192.168.32.10,api-group:rbac.authorization.k8s.io,api-version:v1,name:machine-api-controllers,subresource:,namespace:openshift-config-managed,protocol:HTTP/2.0,resource:rolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/namespaces/openshift-config-managed/rolebindings/machine-api-controllers,user-agent:cluster-version-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:44.979) (total time: 1032ms): Trace[1596341330]: ---"About to write a response" 1030ms (13:25:46.009) Trace[1596341330]: [1.032230648s] [1.032230648s] END I0318 13:25:47.065543 13 trace.go:236] Trace[841070313]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8720a140-4cdf-4f1c-92aa-4050fb0d8e7b,client:192.168.32.10,api-group:,api-version:v1,name:,subresource:,namespace:openshift-route-controller-manager,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openshift-route-controller-manager/events,user-agent:kubelet/v1.31.14 (linux/amd64) kubernetes/8311c4d,verb:POST (18-Mar-2026 13:25:46.002) (total time: 1062ms): Trace[841070313]: ["Create etcd3" audit-id:8720a140-4cdf-4f1c-92aa-4050fb0d8e7b,key:/events/openshift-route-controller-manager/route-controller-manager-6c597dfd69-w66v8.189df264c9747b09,type:*core.Event,resource:events 1055ms (13:25:46.009) Trace[841070313]: ---"Txn call succeeded" 1055ms (13:25:47.065)] Trace[841070313]: [1.062930707s] [1.062930707s] END I0318 13:25:47.065927 13 trace.go:236] Trace[1398360833]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:63d2053a-11e2-4604-8778-33b6120baefd,client:10.128.0.29,api-group:apiregistration.k8s.io,api-version:v1,name:v1.user.openshift.io,subresource:,namespace:,protocol:HTTP/2.0,resource:apiservices,scope:resource,url:/apis/apiregistration.k8s.io/v1/apiservices/v1.user.openshift.io,user-agent:authentication-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.008) (total time: 1057ms): Trace[1398360833]: ---"About to write a response" 1056ms (13:25:47.065) Trace[1398360833]: [1.057073812s] [1.057073812s] END I0318 13:25:47.455128 13 trace.go:236] Trace[1938279577]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f292dd97-fdda-47c9-9ea4-b586d3ae6510,client:10.128.0.91,api-group:,api-version:v1,name:,subresource:,namespace:openshift-route-controller-manager,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openshift-route-controller-manager/events,user-agent:route-controller-manager/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (18-Mar-2026 13:25:46.010) (total time: 1444ms): Trace[1938279577]: ["Create etcd3" audit-id:f292dd97-fdda-47c9-9ea4-b586d3ae6510,key:/events/openshift-route-controller-manager/openshift-route-controllers.189df265801a0128,type:*core.Event,resource:events 1443ms (13:25:46.011) Trace[1938279577]: ---"Txn call succeeded" 1443ms (13:25:47.454)] Trace[1938279577]: [1.444644269s] [1.444644269s] END I0318 13:25:47.455128 13 trace.go:236] Trace[1868668602]: "Create" accept:application/json, */*,audit-id:d822890d-72a0-4c26-baca-24657ca027e3,client:10.128.0.13,api-group:,api-version:v1,name:,subresource:,namespace:openshift-kube-apiserver-operator,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openshift-kube-apiserver-operator/events,user-agent:cluster-kube-apiserver-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (18-Mar-2026 13:25:46.019) (total time: 1435ms): Trace[1868668602]: ["Create etcd3" audit-id:d822890d-72a0-4c26-baca-24657ca027e3,key:/events/openshift-kube-apiserver-operator/kube-apiserver-operator.189df265809df184,type:*core.Event,resource:events 1433ms (13:25:46.021) Trace[1868668602]: ---"Txn call succeeded" 1433ms (13:25:47.454)] Trace[1868668602]: [1.43599572s] [1.43599572s] END I0318 13:25:47.455923 13 trace.go:236] Trace[172407648]: "Delete" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:321f2cbb-ab54-4643-9391-e9bf17c0732a,client:10.128.0.13,api-group:,api-version:v1,name:installer-4-master-0,subresource:,namespace:openshift-kube-apiserver,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0,user-agent:cluster-kube-apiserver-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:DELETE (18-Mar-2026 13:25:45.445) (total time: 2010ms): Trace[172407648]: ["GuaranteedUpdate etcd3" audit-id:321f2cbb-ab54-4643-9391-e9bf17c0732a,key:/pods/openshift-kube-apiserver/installer-4-master-0,type:*core.Pod,resource:pods 1455ms (13:25:46.000) Trace[172407648]: ---"Txn call completed" 1454ms (13:25:47.455)] Trace[172407648]: [2.010044089s] [2.010044089s] END I0318 13:25:47.460897 13 trace.go:236] Trace[106011328]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c3d5d079-dab0-40b6-abb4-fa682906837a,client:10.128.0.29,api-group:,api-version:v1,name:etcd-client,subresource:,namespace:openshift-oauth-apiserver,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/openshift-oauth-apiserver/secrets/etcd-client,user-agent:authentication-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.023) (total time: 1437ms): Trace[106011328]: ---"About to write a response" 1437ms (13:25:47.460) Trace[106011328]: [1.437403594s] [1.437403594s] END I0318 13:25:47.461166 13 trace.go:236] Trace[442657258]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1e9c5fcf-7249-43d8-8685-f45bec8eedf7,client:192.168.32.10,api-group:rbac.authorization.k8s.io,api-version:v1,name:console-operator-auth-delegator,subresource:,namespace:,protocol:HTTP/2.0,resource:clusterrolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/console-operator-auth-delegator,user-agent:cluster-version-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.017) (total time: 1444ms): Trace[442657258]: ---"About to write a response" 1443ms (13:25:47.460) Trace[442657258]: [1.444008532s] [1.444008532s] END I0318 13:25:47.461215 13 trace.go:236] Trace[783363632]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2ce8c53f-b40b-41d2-842d-81f74434e09d,client:192.168.32.10,api-group:rbac.authorization.k8s.io,api-version:v1,name:machine-api-operator,subresource:,namespace:,protocol:HTTP/2.0,resource:clusterrolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/machine-api-operator,user-agent:cluster-version-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.017) (total time: 1443ms): Trace[783363632]: ---"About to write a response" 1443ms (13:25:47.461) Trace[783363632]: [1.443851487s] [1.443851487s] END I0318 13:25:47.461173 13 trace.go:236] Trace[1491931168]: "Get" accept:application/json, */*,audit-id:a583bc34-43d0-4433-a22e-b95ef5cd0af6,client:10.128.0.24,api-group:rbac.authorization.k8s.io,api-version:v1,name:machine-os-builder-events,subresource:,namespace:,protocol:HTTP/2.0,resource:clusterroles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterroles/machine-os-builder-events,user-agent:machine-config-operator/v0.0.0 (linux/amd64) kubernetes/$Format/machine-config,verb:GET (18-Mar-2026 13:25:46.028) (total time: 1433ms): Trace[1491931168]: ---"About to write a response" 1432ms (13:25:47.461) Trace[1491931168]: [1.433049723s] [1.433049723s] END I0318 13:25:47.461510 13 trace.go:236] Trace[1046304869]: "Get" accept:application/json,audit-id:ae685548-5b1a-471b-a4a5-3b37f8f9d9fa,client:192.168.32.10,api-group:flowcontrol.apiserver.k8s.io,api-version:v1,name:openshift-monitoring-metrics,subresource:,namespace:,protocol:HTTP/2.0,resource:flowschemas,scope:resource,url:/apis/flowcontrol.apiserver.k8s.io/v1/flowschemas/openshift-monitoring-metrics,user-agent:cluster-version-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.021) (total time: 1440ms): Trace[1046304869]: ---"About to write a response" 1440ms (13:25:47.461) Trace[1046304869]: [1.440416273s] [1.440416273s] END I0318 13:25:47.461911 13 trace.go:236] Trace[1969856901]: "List(recursive=true) etcd3" audit-id:,key:/masterleases/,resourceVersion:0,resourceVersionMatch:NotOlderThan,limit:0,continue: (18-Mar-2026 13:25:46.003) (total time: 1458ms): Trace[1969856901]: [1.458696631s] [1.458696631s] END W0318 13:25:47.461954 13 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0318 13:25:47.461983 13 trace.go:236] Trace[812197164]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:01d79a6e-2011-4121-bb4c-00de8c010031,client:10.128.0.29,api-group:,api-version:v1,name:oauth-serving-cert,subresource:,namespace:openshift-config-managed,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/openshift-config-managed/configmaps/oauth-serving-cert,user-agent:authentication-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.082) (total time: 1379ms): Trace[812197164]: ---"About to write a response" 1378ms (13:25:47.461) Trace[812197164]: [1.379029017s] [1.379029017s] END I0318 13:25:47.462129 13 trace.go:236] Trace[1273969067]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3f09ed36-3c71-4faf-aa6a-f6038d9d9680,client:192.168.32.10,api-group:rbac.authorization.k8s.io,api-version:v1,name:host-networking-system-node,subresource:,namespace:openshift-kni-infra,protocol:HTTP/2.0,resource:rolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/namespaces/openshift-kni-infra/rolebindings/host-networking-system-node,user-agent:cluster-version-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.022) (total time: 1439ms): Trace[1273969067]: ---"About to write a response" 1439ms (13:25:47.461) Trace[1273969067]: [1.439557488s] [1.439557488s] END I0318 13:25:47.462205 13 trace.go:236] Trace[2027329976]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b2958ef5-3fca-45cb-ae5b-343a72a8f703,client:10.128.0.91,api-group:coordination.k8s.io,api-version:v1,name:openshift-route-controllers,subresource:,namespace:openshift-route-controller-manager,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openshift-route-controller-manager/leases/openshift-route-controllers,user-agent:route-controller-manager/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (18-Mar-2026 13:25:46.009) (total time: 1452ms): Trace[2027329976]: ["GuaranteedUpdate etcd3" audit-id:b2958ef5-3fca-45cb-ae5b-343a72a8f703,key:/leases/openshift-route-controller-manager/openshift-route-controllers,type:*coordination.Lease,resource:leases.coordination.k8s.io 1452ms (13:25:46.010) Trace[2027329976]: ---"Txn call completed" 1450ms (13:25:47.461)] Trace[2027329976]: [1.452309539s] [1.452309539s] END I0318 13:25:47.462785 13 trace.go:236] Trace[1313740279]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9ee5ad21-89d6-4ae0-ab89-aab0d5248a48,client:192.168.32.10,api-group:coordination.k8s.io,api-version:v1,name:kube-controller-manager,subresource:,namespace:kube-system,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.31.14 (linux/amd64) kubernetes/8311c4d/leader-election,verb:PUT (18-Mar-2026 13:25:46.465) (total time: 997ms): Trace[1313740279]: ["GuaranteedUpdate etcd3" audit-id:9ee5ad21-89d6-4ae0-ab89-aab0d5248a48,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 996ms (13:25:46.465) Trace[1313740279]: ---"Txn call completed" 995ms (13:25:47.462)] Trace[1313740279]: [997.030396ms] [997.030396ms] END I0318 13:25:47.463219 13 trace.go:236] Trace[189248249]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2a4f77ea-cd6e-4c9b-8118-3631aae4d81c,client:192.168.32.10,api-group:coordination.k8s.io,api-version:v1,name:ovnkube-identity,subresource:,namespace:openshift-network-node-identity,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openshift-network-node-identity/leases/ovnkube-identity,user-agent:ovnkube-identity/v0.33.3 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (18-Mar-2026 13:25:46.691) (total time: 771ms): Trace[189248249]: ["GuaranteedUpdate etcd3" audit-id:2a4f77ea-cd6e-4c9b-8118-3631aae4d81c,key:/leases/openshift-network-node-identity/ovnkube-identity,type:*coordination.Lease,resource:leases.coordination.k8s.io 771ms (13:25:46.691) Trace[189248249]: ---"Txn call completed" 770ms (13:25:47.463)] Trace[189248249]: [771.811736ms] [771.811736ms] END I0318 13:25:47.463220 13 trace.go:236] Trace[1229101388]: "Get" accept:application/json,audit-id:ccef4b5d-5dd5-43d4-b10a-2bd5424b7045,client:192.168.32.10,api-group:cloudcredential.openshift.io,api-version:v1,name:openshift-azure-cloud-controller-manager,subresource:,namespace:openshift-cloud-credential-operator,protocol:HTTP/2.0,resource:credentialsrequests,scope:resource,url:/apis/cloudcredential.openshift.io/v1/namespaces/openshift-cloud-credential-operator/credentialsrequests/openshift-azure-cloud-controller-manager,user-agent:cluster-version-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.009) (total time: 1454ms): Trace[1229101388]: ---"About to write a response" 1453ms (13:25:47.463) Trace[1229101388]: [1.4540232s] [1.4540232s] END I0318 13:25:47.463798 13 trace.go:236] Trace[1179898675]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:96f11735-73ea-4314-b6a4-3cde561b8e43,client:10.128.0.13,api-group:,api-version:v1,name:kube-apiserver-master-0,subresource:,namespace:openshift-kube-apiserver,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0,user-agent:cluster-kube-apiserver-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.246) (total time: 1217ms): Trace[1179898675]: ---"About to write a response" 1216ms (13:25:47.462) Trace[1179898675]: [1.217433112s] [1.217433112s] END I0318 13:25:47.463951 13 trace.go:236] Trace[1165085936]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0dc3445d-66bb-445b-b7c3-2ba5f44f1b01,client:10.128.0.13,api-group:,api-version:v1,name:,subresource:,namespace:openshift-kube-apiserver,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/openshift-kube-apiserver/configmaps,user-agent:cluster-kube-apiserver-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (18-Mar-2026 13:25:46.645) (total time: 818ms): Trace[1165085936]: ["Create etcd3" audit-id:0dc3445d-66bb-445b-b7c3-2ba5f44f1b01,key:/configmaps/openshift-kube-apiserver/kubelet-serving-ca-6,type:*core.ConfigMap,resource:configmaps 817ms (13:25:46.646) Trace[1165085936]: ---"Txn call succeeded" 817ms (13:25:47.463)] Trace[1165085936]: [818.538575ms] [818.538575ms] END I0318 13:25:47.464241 13 trace.go:236] Trace[1530898026]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1450a0ea-b341-4b53-ad70-64a6a1c8d2c1,client:10.128.0.29,api-group:,api-version:v1,name:kubeadmin,subresource:,namespace:kube-system,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/kube-system/secrets/kubeadmin,user-agent:authentication-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.018) (total time: 1446ms): Trace[1530898026]: ---"About to write a response" 1445ms (13:25:47.464) Trace[1530898026]: [1.446038651s] [1.446038651s] END I0318 13:25:47.464291 13 trace.go:236] Trace[106581469]: "Get" accept:application/json, */*,audit-id:1e674d1c-d7b3-4e8b-bcdc-4645ed121f9e,client:192.168.32.254,api-group:config.openshift.io,api-version:v1,name:version,subresource:,namespace:,protocol:HTTP/2.0,resource:clusterversions,scope:resource,url:/apis/config.openshift.io/v1/clusterversions/version,user-agent:openshift-install/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.460) (total time: 1003ms): Trace[106581469]: ---"About to write a response" 1002ms (13:25:47.463) Trace[106581469]: [1.003338074s] [1.003338074s] END I0318 13:25:47.464361 13 trace.go:236] Trace[1282598527]: "Get" accept:application/json, */*,audit-id:c0736262-3de6-4a45-acb2-4e6647a2e061,client:10.128.0.91,api-group:,api-version:v1,name:ingress-to-route-controller,subresource:,namespace:openshift-infra,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/openshift-infra/serviceaccounts/ingress-to-route-controller,user-agent:route-controller-manager/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.010) (total time: 1453ms): Trace[1282598527]: ---"About to write a response" 1453ms (13:25:47.464) Trace[1282598527]: [1.45332548s] [1.45332548s] END I0318 13:25:47.464856 13 trace.go:236] Trace[1916250059]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:15d5665f-df30-4d20-a5bc-1f60cbf35467,client:10.128.0.13,api-group:rbac.authorization.k8s.io,api-version:v1,name:system:openshift:controller:check-endpoints,subresource:,namespace:openshift-kube-apiserver,protocol:HTTP/2.0,resource:rolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/namespaces/openshift-kube-apiserver/rolebindings/system:openshift:controller:check-endpoints,user-agent:cluster-kube-apiserver-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.019) (total time: 1445ms): Trace[1916250059]: ---"About to write a response" 1445ms (13:25:47.464) Trace[1916250059]: [1.445544597s] [1.445544597s] END I0318 13:25:47.465098 13 trace.go:236] Trace[1819348559]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:df6c72e5-4a3a-489c-ab59-d7b12c21338e,client:10.128.0.85,api-group:,api-version:v1,name:console-config,subresource:,namespace:openshift-console,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/openshift-console/configmaps/console-config,user-agent:console/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.024) (total time: 1440ms): Trace[1819348559]: ---"About to write a response" 1440ms (13:25:47.465) Trace[1819348559]: [1.440114354s] [1.440114354s] END I0318 13:25:47.465263 13 trace.go:236] Trace[724853390]: "Patch" accept:application/json, */*,audit-id:64b2b0a3-f1f0-4139-a4d6-df754e4d1707,client:10.128.0.54,api-group:,api-version:v1,name:master-0,subresource:,namespace:,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/master-0,user-agent:machine-config-controller/v0.0.0 (linux/amd64) kubernetes/$Format/node-update-controller,verb:PATCH (18-Mar-2026 13:25:46.025) (total time: 1440ms): Trace[724853390]: ["GuaranteedUpdate etcd3" audit-id:64b2b0a3-f1f0-4139-a4d6-df754e4d1707,key:/minions/master-0,type:*core.Node,resource:nodes 1439ms (13:25:46.025)] Trace[724853390]: ---"Object stored in database" 1432ms (13:25:47.463) Trace[724853390]: [1.440019181s] [1.440019181s] END I0318 13:25:47.465636 13 trace.go:236] Trace[12480998]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:886a2dbb-d4b7-4942-985d-798d099b27f7,client:10.128.0.10,api-group:,api-version:v1,name:etcd-all-bundles,subresource:,namespace:openshift-etcd,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/openshift-etcd/configmaps/etcd-all-bundles,user-agent:cluster-etcd-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.018) (total time: 1447ms): Trace[12480998]: ---"About to write a response" 1447ms (13:25:47.465) Trace[12480998]: [1.447209396s] [1.447209396s] END I0318 13:25:47.466104 13 trace.go:236] Trace[718197103]: "List" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7ecd47c0-86a9-45aa-9e7c-4c2523cb4ef7,client:10.128.0.13,api-group:,api-version:v1,name:,subresource:,namespace:openshift-kube-apiserver,protocol:HTTP/2.0,resource:pods,scope:namespace,url:/api/v1/namespaces/openshift-kube-apiserver/pods,user-agent:cluster-kube-apiserver-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:LIST (18-Mar-2026 13:25:46.047) (total time: 1418ms): Trace[718197103]: ["List(recursive=false) etcd3" audit-id:7ecd47c0-86a9-45aa-9e7c-4c2523cb4ef7,key:/pods,resourceVersion:,resourceVersionMatch:,limit:1,continue: 1418ms (13:25:46.047)] Trace[718197103]: [1.418738855s] [1.418738855s] END I0318 13:25:47.466985 13 trace.go:236] Trace[19044013]: "Get" accept:application/json, */*,audit-id:fca768b7-6406-4b7f-9614-77af557ab6d2,client:10.128.0.6,api-group:apps,api-version:v1,name:csi-snapshot-controller,subresource:,namespace:openshift-cluster-storage-operator,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/openshift-cluster-storage-operator/deployments/csi-snapshot-controller,user-agent:csi-snapshot-controller-operator/v0.0.0 (linux/amd64) kubernetes/$Format/csi-snapshot-controller,verb:GET (18-Mar-2026 13:25:46.013) (total time: 1453ms): Trace[19044013]: ---"About to write a response" 1449ms (13:25:47.462) Trace[19044013]: [1.453383751s] [1.453383751s] END I0318 13:25:47.467501 13 trace.go:236] Trace[1022815641]: "Get" accept:application/json, */*,audit-id:609a678b-df24-4e97-94e9-243c18749766,client:10.128.0.17,api-group:operator.openshift.io,api-version:v1,name:cluster,subresource:,namespace:,protocol:HTTP/2.0,resource:openshiftapiservers,scope:resource,url:/apis/operator.openshift.io/v1/openshiftapiservers/cluster,user-agent:cluster-openshift-apiserver-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.028) (total time: 1438ms): Trace[1022815641]: ---"About to write a response" 1437ms (13:25:47.465) Trace[1022815641]: [1.438431004s] [1.438431004s] END I0318 13:25:47.468059 13 trace.go:236] Trace[912741736]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fbf9cae7-14dc-4959-b88d-9e48fa5d14cd,client:10.128.0.10,api-group:,api-version:v1,name:etcd-pod,subresource:,namespace:openshift-etcd,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/openshift-etcd/configmaps/etcd-pod,user-agent:cluster-etcd-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.019) (total time: 1448ms): Trace[912741736]: ---"About to write a response" 1443ms (13:25:47.463) Trace[912741736]: [1.448170116s] [1.448170116s] END I0318 13:25:47.469040 13 trace.go:236] Trace[2099382494]: "Delete" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:248b5d20-1a8b-43da-892a-586a61d6bb4f,client:192.168.32.10,api-group:,api-version:v1,name:route-controller-manager-c8888769b-8mxp6,subresource:,namespace:openshift-route-controller-manager,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-c8888769b-8mxp6,user-agent:kubelet/v1.31.14 (linux/amd64) kubernetes/8311c4d,verb:DELETE (18-Mar-2026 13:25:44.709) (total time: 2759ms): Trace[2099382494]: ["GuaranteedUpdate etcd3" audit-id:248b5d20-1a8b-43da-892a-586a61d6bb4f,key:/pods/openshift-route-controller-manager/route-controller-manager-c8888769b-8mxp6,type:*core.Pod,resource:pods 2494ms (13:25:44.974) Trace[2099382494]: ---"Txn call completed" 1026ms (13:25:46.001)] Trace[2099382494]: ---"Object deleted from database" 1467ms (13:25:47.468) Trace[2099382494]: [2.759827406s] [2.759827406s] END I0318 13:25:47.470839 13 trace.go:236] Trace[1867588412]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0657d9e5-6051-4178-adf1-f2b762ba9e9b,client:192.168.32.10,api-group:,api-version:v1,name:olm-operators,subresource:,namespace:openshift-operator-lifecycle-manager,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/openshift-operator-lifecycle-manager/configmaps/olm-operators,user-agent:cluster-version-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.008) (total time: 1462ms): Trace[1867588412]: [1.462094272s] [1.462094272s] END I0318 13:25:47.473077 13 trace.go:236] Trace[957201584]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8fa56411-8f3e-44b2-860f-9c3abf4fd682,client:10.128.0.13,api-group:,api-version:v1,name:node-kubeconfigs,subresource:,namespace:openshift-kube-apiserver,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/openshift-kube-apiserver/secrets/node-kubeconfigs,user-agent:cluster-kube-apiserver-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.846) (total time: 626ms): Trace[957201584]: ---"About to write a response" 618ms (13:25:47.464) Trace[957201584]: [626.992963ms] [626.992963ms] END I0318 13:25:47.475668 13 trace.go:236] Trace[1247798614]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e37aed39-d8ed-4272-9ba7-abfea15aec9e,client:10.128.0.13,api-group:,api-version:v1,name:trusted-ca-bundle,subresource:,namespace:openshift-kube-apiserver,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/openshift-kube-apiserver/configmaps/trusted-ca-bundle,user-agent:cluster-kube-apiserver-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 13:25:46.445) (total time: 1029ms): Trace[1247798614]: ---"About to write a response" 1020ms (13:25:47.465) Trace[1247798614]: [1.029861559s] [1.029861559s] END I0318 13:25:47.524886 13 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0318 13:25:47.524932 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0318 13:25:47.525147 13 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0318 13:25:47.525176 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0318 13:25:47.525221 13 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0318 13:25:47.630249 13 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0318 13:25:47.630300 13 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0318 13:25:47.630385 13 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0318 13:25:47.630823 13 controller.go:157] Shutting down quota evaluator I0318 13:25:47.630848 13 controller.go:176] quota evaluator worker shutdown I0318 13:25:47.631214 13 controller.go:176] quota evaluator worker shutdown I0318 13:25:47.631227 13 controller.go:176] quota evaluator worker shutdown I0318 13:25:47.631232 13 controller.go:176] quota evaluator worker shutdown I0318 13:25:47.631238 13 controller.go:176] quota evaluator worker shutdown I0318 13:25:47.639598 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0318 13:25:47.643533 13 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0318 13:25:47.643587 13 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0318 13:25:47.643617 13 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0318 13:25:47.643687 13 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0318 13:25:47.643795 13 controller.go:86] Shutting down OpenAPI V3 AggregationController I0318 13:25:47.643829 13 controller.go:84] Shutting down OpenAPI AggregationController I0318 13:25:47.643866 13 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0318 13:25:47.643947 13 secure_serving.go:258] Stopped listening on [::]:6443 I0318 13:25:47.643967 13 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0318 13:25:47.643984 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0318 13:25:47.644251 13 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0318 13:25:47.644440 13 controller.go:120] Shutting down OpenAPI V3 controller I0318 13:25:47.644473 13 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0318 13:25:47.644488 13 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0318 13:25:47.644500 13 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0318 13:25:47.644525 13 establishing_controller.go:92] Shutting down EstablishingController I0318 13:25:47.644538 13 crd_finalizer.go:281] Shutting down CRDFinalizer I0318 13:25:47.644551 13 controller.go:170] Shutting down OpenAPI controller I0318 13:25:47.644560 13 naming_controller.go:305] Shutting down NamingConditionController I0318 13:25:47.644576 13 autoregister_controller.go:168] Shutting down autoregister controller I0318 13:25:47.644592 13 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0318 13:25:47.644609 13 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0318 13:25:47.644637 13 local_available_controller.go:172] Shutting down LocalAvailability controller I0318 13:25:47.644650 13 system_namespaces_controller.go:76] Shutting down system namespaces controller I0318 13:25:47.644660 13 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0318 13:25:47.644701 13 gc_controller.go:91] Shutting down apiserver lease garbage collector I0318 13:25:47.644713 13 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0318 13:25:47.644726 13 controller.go:132] Ending legacy_token_tracking_controller I0318 13:25:47.644730 13 controller.go:133] Shutting down legacy_token_tracking_controller I0318 13:25:47.644437 13 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0318 13:25:47.645004 13 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0318 13:25:47.645103 13 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting E0318 13:25:47.645606 13 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=12838&timeout=9m14s&timeoutSeconds=554&watch=true" auditID="bcccb425-1f5d-42e4-b6e6-a048a0360d40" I0318 13:25:47.647924 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0318 13:25:47.647943 13 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0318 13:25:47.647975 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0318 13:25:47.647989 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0318 13:25:47.648002 13 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0318 13:25:47.648425 13 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0318 13:25:47.648737 13 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0318 13:25:49.644216 13 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0318 13:25:49.644276 13 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0318 13:25:49.650178 13 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0318 13:25:49.651197 13 cacher.go:171] Terminating all watchers from cacher pods W0318 13:25:49.652393 13 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0318 13:25:49.653717 13 cacher.go:171] Terminating all watchers from cacher secrets W0318 13:25:49.660078 13 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0318 13:25:49.668119 13 cacher.go:171] Terminating all watchers from cacher limitranges W0318 13:25:49.668718 13 cacher.go:171] Terminating all watchers from cacher resourcequotas W0318 13:25:49.669954 13 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0318 13:25:49.670401 13 cacher.go:171] Terminating all watchers from cacher services W0318 13:25:49.672077 13 cacher.go:171] Terminating all watchers from cacher endpoints W0318 13:25:49.672982 13 cacher.go:171] Terminating all watchers from cacher namespaces W0318 13:25:49.676304 13 cacher.go:171] Terminating all watchers from cacher configmaps W0318 13:25:49.679761 13 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0318 13:25:49.680802 13 cacher.go:171] Terminating all watchers from cacher podtemplates W0318 13:25:49.681708 13 cacher.go:171] Terminating all watchers from cacher nodes W0318 13:25:49.684268 13 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0318 13:25:49.692777 13 cacher.go:171] Terminating all watchers from cacher jobs.batch W0318 13:25:49.694035 13 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0318 13:25:49.695171 13 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0318 13:25:49.695894 13 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0318 13:25:49.697552 13 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0318 13:25:49.698998 13 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0318 13:25:49.700093 13 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0318 13:25:49.700705 13 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0318 13:25:49.701910 13 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0318 13:25:49.702438 13 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0318 13:25:49.703684 13 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0318 13:25:49.707334 13 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0318 13:25:49.710625 13 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0318 13:25:49.711332 13 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0318 13:25:49.712059 13 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0318 13:25:49.712674 13 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0318 13:25:49.713231 13 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0318 13:25:49.713811 13 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0318 13:25:49.714209 13 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0318 13:25:49.714604 13 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0318 13:25:49.714865 13 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0318 13:25:49.717852 13 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0318 13:25:49.719011 13 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0318 13:25:49.719652 13 cacher.go:171] Terminating all watchers from cacher deployments.apps W0318 13:25:49.720516 13 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0318 13:25:49.721135 13 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0318 13:25:49.721524 13 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0318 13:25:49.722120 13 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0318 13:25:49.722899 13 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0318 13:25:49.724005 13 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0318 13:25:49.724638 13 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0318 13:25:49.725885 13 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0318 13:25:49.727022 13 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0318 13:25:49.728021 13 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0318 13:25:49.728731 13 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0318 13:25:49.729596 13 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0318 13:25:49.730659 13 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0318 13:25:49.732116 13 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0318 13:25:49.732838 13 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0318 13:25:49.733271 13 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0318 13:25:49.733989 13 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0318 13:25:49.734616 13 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0318 13:25:49.735512 13 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0318 13:25:49.736564 13 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0318 13:25:49.738760 13 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0318 13:25:49.739308 13 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0318 13:25:49.739749 13 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0318 13:25:49.742501 13 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0318 13:25:49.743362 13 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0318 13:25:49.744529 13 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0318 13:25:49.745343 13 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0318 13:25:49.745733 13 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0318 13:25:49.746392 13 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io W0318 13:25:49.746882 13 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0318 13:25:49.747178 13 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0318 13:25:49.747838 13 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io W0318 13:25:49.748343 13 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0318 13:25:49.749101 13 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0318 13:25:49.749623 13 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0318 13:25:49.750210 13 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0318 13:25:49.751048 13 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0318 13:25:49.751403 13 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0318 13:25:49.752032 13 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0318 13:25:49.752587 13 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0318 13:25:49.752987 13 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0318 13:25:49.753740 13 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0318 13:25:49.754115 13 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0318 13:25:49.754606 13 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0318 13:25:49.755019 13 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0318 13:25:49.755440 13 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0318 13:25:49.755806 13 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0318 13:25:49.756350 13 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0318 13:25:49.756802 13 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0318 13:25:49.757250 13 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0318 13:25:49.758241 13 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0318 13:25:49.758864 13 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0318 13:25:49.759579 13 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0318 13:25:49.759979 13 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0318 13:25:49.760625 13 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0318 13:25:49.761280 13 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0318 13:25:49.762367 13 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0318 13:25:49.763252 13 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0318 13:25:49.763783 13 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0318 13:25:49.764133 13 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0318 13:25:49.764736 13 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0318 13:25:49.765616 13 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0318 13:25:49.766004 13 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0318 13:25:49.766469 13 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0318 13:25:49.767250 13 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0318 13:25:49.767707 13 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0318 13:25:49.768030 13 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0318 13:25:49.768336 13 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0318 13:25:49.768742 13 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0318 13:25:49.769054 13 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0318 13:25:49.769292 13 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0318 13:25:49.769859 13 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0318 13:25:49.771085 13 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0318 13:25:49.772259 13 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0318 13:25:49.773223 13 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0318 13:25:49.773723 13 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0318 13:25:49.774153 13 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0318 13:25:49.774700 13 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0318 13:25:49.775530 13 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0318 13:25:49.775939 13 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0318 13:25:49.776372 13 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0318 13:25:49.776722 13 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0318 13:25:49.777127 13 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0318 13:25:49.779963 13 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0318 13:25:49.780709 13 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0318 13:25:49.781273 13 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0318 13:25:49.781890 13 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0318 13:25:49.782358 13 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0318 13:25:49.782931 13 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0318 13:25:49.783323 13 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0318 13:25:49.787139 13 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0318 13:25:49.787671 13 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0318 13:25:49.788155 13 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0318 13:25:49.788959 13 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0318 13:25:49.789752 13 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0318 13:25:49.791707 13 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0318 13:25:49.792071 13 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0318 13:25:49.792461 13 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0318 13:25:49.792933 13 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0318 13:25:49.793432 13 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0318 13:25:49.794030 13 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0318 13:25:49.794259 13 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0318 13:25:49.795283 13 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0318 13:25:49.795852 13 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0318 13:25:49.796357 13 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0318 13:25:49.796793 13 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0318 13:25:49.797298 13 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0318 13:25:49.797724 13 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0318 13:25:49.798206 13 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0318 13:25:49.799061 13 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0318 13:25:49.799610 13 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0318 13:25:49.800617 13 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0318 13:25:49.801014 13 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0318 13:25:49.801538 13 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0318 13:25:49.802017 13 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0318 13:25:49.802687 13 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0318 13:25:49.803357 13 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0318 13:25:49.803913 13 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0318 13:25:49.804272 13 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0318 13:25:49.804706 13 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0318 13:25:49.805136 13 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0318 13:25:49.805619 13 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0318 13:25:49.806153 13 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0318 13:25:49.806554 13 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0318 13:25:49.807589 13 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0318 13:25:49.808715 13 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0318 13:25:49.809064 13 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0318 13:25:49.809473 13 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0318 13:25:49.809933 13 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0318 13:25:49.810241 13 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0318 13:25:49.810789 13 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0318 13:25:49.811035 13 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0318 13:25:49.811519 13 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0318 13:25:49.812068 13 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0318 13:25:49.812514 13 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0318 13:25:49.812954 13 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0318 13:25:49.813511 13 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0318 13:25:49.814303 13 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0318 13:25:49.814855 13 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0318 13:25:49.816778 13 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0318 13:25:49.817732 13 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0318 13:25:49.818204 13 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0318 13:25:49.818699 13 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com I0318 13:25:49.844216 1 main.go:235] Termination finished with exit code 0 I0318 13:25:49.844306 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" --- I0318 13:27:40.857199 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0318 13:27:40.857455 11 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0318 13:27:40.857493 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0318 13:27:40.857552 11 controller.go:128] Shutting down kubernetes service endpoint reconciler I0318 13:27:40.864389 11 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0318 13:27:40.864431 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0318 13:27:40.872217 11 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0318 13:27:40.884278 11 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0318 13:27:40.884310 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0318 13:27:40.884497 11 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0318 13:27:40.884511 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0318 13:27:40.884614 11 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0318 13:27:40.910963 11 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0318 13:27:40.911009 11 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0318 13:27:40.911045 11 controller.go:157] Shutting down quota evaluator I0318 13:27:40.911219 11 controller.go:176] quota evaluator worker shutdown I0318 13:27:40.911201 11 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0318 13:27:40.911243 11 controller.go:176] quota evaluator worker shutdown I0318 13:27:40.911249 11 controller.go:176] quota evaluator worker shutdown I0318 13:27:40.911258 11 controller.go:176] quota evaluator worker shutdown I0318 13:27:40.911253 11 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0318 13:27:40.911279 11 controller.go:176] quota evaluator worker shutdown I0318 13:27:40.911469 11 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0318 13:27:40.911505 11 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0318 13:27:40.911543 11 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0318 13:27:40.911637 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0318 13:27:40.911694 11 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0318 13:27:40.911745 11 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0318 13:27:40.911771 11 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0318 13:27:40.911794 11 controller.go:86] Shutting down OpenAPI V3 AggregationController I0318 13:27:40.911809 11 controller.go:84] Shutting down OpenAPI AggregationController I0318 13:27:40.911816 11 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0318 13:27:40.911808 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0318 13:27:40.911852 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" I0318 13:27:40.911893 11 secure_serving.go:258] Stopped listening on [::]:6443 I0318 13:27:40.911927 11 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0318 13:27:40.911946 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0318 13:27:40.911969 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0318 13:27:40.912206 11 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0318 13:27:40.912238 11 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0318 13:27:40.912290 11 controller.go:120] Shutting down OpenAPI V3 controller I0318 13:27:40.912312 11 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0318 13:27:40.912328 11 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0318 13:27:40.912346 11 controller.go:170] Shutting down OpenAPI controller I0318 13:27:40.912357 11 naming_controller.go:305] Shutting down NamingConditionController I0318 13:27:40.912369 11 establishing_controller.go:92] Shutting down EstablishingController I0318 13:27:40.912390 11 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0318 13:27:40.912406 11 autoregister_controller.go:168] Shutting down autoregister controller I0318 13:27:40.912448 11 crd_finalizer.go:281] Shutting down CRDFinalizer I0318 13:27:40.912469 11 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0318 13:27:40.912490 11 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0318 13:27:40.911938 11 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0318 13:27:40.912526 11 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0318 13:27:40.912542 11 system_namespaces_controller.go:76] Shutting down system namespaces controller I0318 13:27:40.912557 11 local_available_controller.go:172] Shutting down LocalAvailability controller I0318 13:27:40.912570 11 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0318 13:27:40.912584 11 controller.go:132] Ending legacy_token_tracking_controller I0318 13:27:40.912590 11 controller.go:133] Shutting down legacy_token_tracking_controller I0318 13:27:40.912604 11 gc_controller.go:91] Shutting down apiserver lease garbage collector I0318 13:27:40.913063 11 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0318 13:27:40.913097 11 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting E0318 13:27:40.913826 11 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=16034&timeout=9m2s&timeoutSeconds=542&watch=true" auditID="6f4cc69e-f46b-4150-9fe4-ac1a616ac997" I0318 13:27:42.912187 11 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0318 13:27:42.912239 11 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0318 13:27:42.922614 11 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0318 13:27:42.923175 11 cacher.go:171] Terminating all watchers from cacher endpoints W0318 13:27:42.925135 11 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0318 13:27:42.926179 11 cacher.go:171] Terminating all watchers from cacher pods W0318 13:27:42.929446 11 cacher.go:171] Terminating all watchers from cacher podtemplates W0318 13:27:42.929811 11 cacher.go:171] Terminating all watchers from cacher services W0318 13:27:42.931165 11 cacher.go:171] Terminating all watchers from cacher limitranges W0318 13:27:42.931468 11 cacher.go:171] Terminating all watchers from cacher namespaces W0318 13:27:42.932067 11 cacher.go:171] Terminating all watchers from cacher secrets W0318 13:27:42.934573 11 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0318 13:27:42.935272 11 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0318 13:27:42.935853 11 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0318 13:27:42.936471 11 cacher.go:171] Terminating all watchers from cacher nodes W0318 13:27:42.937602 11 cacher.go:171] Terminating all watchers from cacher resourcequotas W0318 13:27:42.937950 11 cacher.go:171] Terminating all watchers from cacher configmaps W0318 13:27:42.944049 11 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0318 13:27:42.944519 11 cacher.go:171] Terminating all watchers from cacher jobs.batch W0318 13:27:42.944929 11 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0318 13:27:42.945425 11 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0318 13:27:42.945999 11 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0318 13:27:42.946372 11 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0318 13:27:42.950303 11 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0318 13:27:42.953850 11 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0318 13:27:42.957116 11 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0318 13:27:42.957872 11 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0318 13:27:42.958285 11 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0318 13:27:42.965789 11 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0318 13:27:42.967948 11 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0318 13:27:42.976427 11 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0318 13:27:42.977321 11 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0318 13:27:42.978043 11 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0318 13:27:42.978294 11 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0318 13:27:42.978582 11 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0318 13:27:42.979097 11 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0318 13:27:42.979618 11 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0318 13:27:42.980057 11 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0318 13:27:42.980544 11 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0318 13:27:42.981016 11 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0318 13:27:42.982761 11 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0318 13:27:42.986516 11 cacher.go:171] Terminating all watchers from cacher deployments.apps W0318 13:27:42.988879 11 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0318 13:27:42.990452 11 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0318 13:27:42.992577 11 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0318 13:27:42.993746 11 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0318 13:27:42.994666 11 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0318 13:27:42.994919 11 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0318 13:27:42.995508 11 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0318 13:27:42.997168 11 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0318 13:27:42.998610 11 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0318 13:27:42.999366 11 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0318 13:27:42.999945 11 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0318 13:27:43.000486 11 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0318 13:27:43.001581 11 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0318 13:27:43.012347 11 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0318 13:27:43.013127 11 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0318 13:27:43.013874 11 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0318 13:27:43.014483 11 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0318 13:27:43.015128 11 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0318 13:27:43.015588 11 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0318 13:27:43.015974 11 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0318 13:27:43.016900 11 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0318 13:27:43.017599 11 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0318 13:27:43.018235 11 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0318 13:27:43.018937 11 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0318 13:27:43.019460 11 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0318 13:27:43.019962 11 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0318 13:27:43.020659 11 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0318 13:27:43.021153 11 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0318 13:27:43.021640 11 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0318 13:27:43.026178 11 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0318 13:27:43.026978 11 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0318 13:27:43.027629 11 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0318 13:27:43.028195 11 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0318 13:27:43.030910 11 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0318 13:27:43.031955 11 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0318 13:27:43.032822 11 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0318 13:27:43.033297 11 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0318 13:27:43.033599 11 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0318 13:27:43.034059 11 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0318 13:27:43.034542 11 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0318 13:27:43.035195 11 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0318 13:27:43.036081 11 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0318 13:27:43.036779 11 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0318 13:27:43.037673 11 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0318 13:27:43.038201 11 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0318 13:27:43.038574 11 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0318 13:27:43.039201 11 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0318 13:27:43.039821 11 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0318 13:27:43.040637 11 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0318 13:27:43.041014 11 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0318 13:27:43.041619 11 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0318 13:27:43.042377 11 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0318 13:27:43.042887 11 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0318 13:27:43.043285 11 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0318 13:27:43.044063 11 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0318 13:27:43.044867 11 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0318 13:27:43.045119 11 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io W0318 13:27:43.045680 11 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0318 13:27:43.046753 11 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0318 13:27:43.047121 11 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0318 13:27:43.047386 11 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0318 13:27:43.047702 11 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0318 13:27:43.048016 11 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0318 13:27:43.048687 11 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0318 13:27:43.049165 11 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0318 13:27:43.049554 11 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0318 13:27:43.050186 11 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0318 13:27:43.050780 11 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0318 13:27:43.051899 11 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0318 13:27:43.052810 11 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0318 13:27:43.053266 11 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0318 13:27:43.053732 11 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0318 13:27:43.054259 11 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0318 13:27:43.054602 11 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0318 13:27:43.055084 11 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0318 13:27:43.055983 11 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0318 13:27:43.056510 11 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0318 13:27:43.057676 11 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0318 13:27:43.058291 11 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0318 13:27:43.058724 11 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0318 13:27:43.059214 11 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0318 13:27:43.061840 11 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0318 13:27:43.062239 11 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0318 13:27:43.062798 11 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io W0318 13:27:43.063469 11 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0318 13:27:43.063919 11 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0318 13:27:43.064642 11 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0318 13:27:43.065685 11 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0318 13:27:43.066117 11 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0318 13:27:43.066993 11 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0318 13:27:43.068888 11 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0318 13:27:43.069209 11 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0318 13:27:43.069559 11 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0318 13:27:43.070069 11 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0318 13:27:43.070467 11 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0318 13:27:43.070941 11 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0318 13:27:43.071392 11 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0318 13:27:43.071978 11 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0318 13:27:43.072345 11 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0318 13:27:43.072793 11 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0318 13:27:43.073289 11 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0318 13:27:43.073744 11 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0318 13:27:43.074334 11 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0318 13:27:43.074736 11 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0318 13:27:43.075056 11 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0318 13:27:43.075647 11 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0318 13:27:43.076100 11 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0318 13:27:43.076720 11 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0318 13:27:43.076991 11 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0318 13:27:43.077396 11 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0318 13:27:43.078087 11 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0318 13:27:43.078561 11 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0318 13:27:43.078908 11 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0318 13:27:43.079318 11 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0318 13:27:43.079707 11 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0318 13:27:43.080131 11 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0318 13:27:43.080577 11 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0318 13:27:43.080894 11 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0318 13:27:43.081504 11 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0318 13:27:43.081993 11 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0318 13:27:43.082789 11 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0318 13:27:43.083202 11 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0318 13:27:43.083764 11 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0318 13:27:43.084466 11 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0318 13:27:43.084873 11 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0318 13:27:43.085217 11 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0318 13:27:43.085661 11 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0318 13:27:43.086144 11 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0318 13:27:43.086845 11 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0318 13:27:43.087181 11 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0318 13:27:43.087586 11 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0318 13:27:43.088065 11 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0318 13:27:43.089636 11 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0318 13:27:43.090187 11 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0318 13:27:43.090684 11 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0318 13:27:43.091014 11 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io W0318 13:27:43.091335 11 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0318 13:27:43.091866 11 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0318 13:27:43.092386 11 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0318 13:27:43.093648 11 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0318 13:27:43.094818 11 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0318 13:27:43.095582 11 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io I0318 13:27:43.127111 1 main.go:235] Termination finished with exit code 0 I0318 13:27:43.127172 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" --- I0318 13:31:03.364242 1 main.go:213] Received signal terminated. Forwarding to sub-process "hyperkube". I0318 13:31:03.364998 12 genericapiserver.go:554] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0318 13:31:03.365050 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ShutdownInitiated' Received signal to terminate, becoming unready, but keeping serving I0318 13:31:03.365358 12 controller.go:128] Shutting down kubernetes service endpoint reconciler I0318 13:31:03.421342 12 genericapiserver.go:544] "[graceful-termination] shutdown event" name="AfterShutdownDelayDuration" I0318 13:31:03.421394 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'AfterShutdownDelayDuration' The minimal shutdown duration of 0s finished W0318 13:31:03.424769 12 lease.go:265] Resetting endpoints for master service "kubernetes" to [] I0318 13:31:03.450228 12 genericapiserver.go:721] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0318 13:31:03.450277 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationPreShutdownHooksFinished' All pre-shutdown hooks have been finished I0318 13:31:03.450353 12 genericapiserver.go:633] "[graceful-termination] shutdown event" name="NotAcceptingNewRequest" I0318 13:31:03.450381 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'InFlightRequestsDrained' All non long-running request(s) in-flight have drained I0318 13:31:03.450396 12 genericapiserver.go:679] "[graceful-termination] not going to wait for active watch request(s) to drain" I0318 13:31:03.468333 12 genericapiserver.go:670] [graceful-termination] in-flight non long-running request(s) have drained I0318 13:31:03.468373 12 genericapiserver.go:711] "[graceful-termination] shutdown event" name="InFlightRequestsDrained" I0318 13:31:03.468455 12 controller.go:157] Shutting down quota evaluator I0318 13:31:03.468479 12 controller.go:176] quota evaluator worker shutdown I0318 13:31:03.468481 12 genericapiserver.go:735] "[graceful-termination] audit backend shutdown completed" I0318 13:31:03.468498 12 controller.go:176] quota evaluator worker shutdown I0318 13:31:03.468511 12 controller.go:176] quota evaluator worker shutdown I0318 13:31:03.468521 12 controller.go:176] quota evaluator worker shutdown I0318 13:31:03.468564 12 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0318 13:31:03.468586 12 controller.go:176] quota evaluator worker shutdown I0318 13:31:03.468892 12 apiaccess_count_controller.go:95] Shutting down APIRequestCount controller. I0318 13:31:03.468909 12 controller.go:86] Shutting down OpenAPI V3 AggregationController I0318 13:31:03.469010 12 dynamic_cafile_content.go:175] "Shutting down controller" name="request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt" I0318 13:31:03.469108 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/external-loadbalancer-serving-certkey/tls.key" I0318 13:31:03.469240 12 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0318 13:31:03.469288 12 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0318 13:31:03.469264 12 apiservice_controller.go:134] Shutting down APIServiceRegistrationController I0318 13:31:03.469391 12 storage_flowcontrol.go:186] APF bootstrap ensurer is exiting I0318 13:31:03.469233 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/localhost-serving-cert-certkey/tls.key" I0318 13:31:03.469459 12 cluster_authentication_trust_controller.go:466] Shutting down cluster_authentication_trust_controller controller I0318 13:31:03.469626 12 secure_serving.go:258] Stopped listening on [::]:6443 I0318 13:31:03.469649 12 apf_controller.go:389] Shutting down API Priority and Fairness config worker I0318 13:31:03.469658 12 genericapiserver.go:624] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening" I0318 13:31:03.469673 12 controller.go:132] Ending legacy_token_tracking_controller I0318 13:31:03.469678 12 controller.go:133] Shutting down legacy_token_tracking_controller I0318 13:31:03.469690 12 system_namespaces_controller.go:76] Shutting down system namespaces controller I0318 13:31:03.469682 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'HTTPServerStoppedListening' HTTP Server has stopped listening I0318 13:31:03.469806 12 clusterquotamapping.go:142] Shutting down ClusterQuotaMappingController controller I0318 13:31:03.470096 12 remote_available_controller.go:449] Shutting down RemoteAvailability controller I0318 13:31:03.470117 12 controller.go:120] Shutting down OpenAPI V3 controller I0318 13:31:03.470131 12 gc_controller.go:91] Shutting down apiserver lease garbage collector I0318 13:31:03.470145 12 local_available_controller.go:172] Shutting down LocalAvailability controller I0318 13:31:03.469332 12 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0318 13:31:03.469344 12 dynamic_serving_content.go:149] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.crt::/etc/kubernetes/static-pod-certs/secrets/aggregator-client/tls.key" I0318 13:31:03.469115 12 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt" I0318 13:31:03.469173 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/internal-loadbalancer-serving-certkey/tls.key" I0318 13:31:03.470237 12 customresource_discovery_controller.go:328] Shutting down DiscoveryController I0318 13:31:03.470269 12 autoregister_controller.go:168] Shutting down autoregister controller I0318 13:31:03.470349 12 crdregistration_controller.go:146] Shutting down crd-autoregister controller I0318 13:31:03.470485 12 apiapproval_controller.go:201] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0318 13:31:03.470519 12 crd_finalizer.go:281] Shutting down CRDFinalizer I0318 13:31:03.470541 12 controller.go:170] Shutting down OpenAPI controller I0318 13:31:03.470556 12 nonstructuralschema_controller.go:207] Shutting down NonStructuralSchemaConditionController I0318 13:31:03.470630 12 naming_controller.go:305] Shutting down NamingConditionController I0318 13:31:03.470651 12 establishing_controller.go:92] Shutting down EstablishingController I0318 13:31:03.469178 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.crt::/etc/kubernetes/static-pod-certs/secrets/service-network-serving-certkey/tls.key" I0318 13:31:03.469275 12 controller.go:84] Shutting down OpenAPI AggregationController I0318 13:31:03.469125 12 dynamic_serving_content.go:149] "Shutting down controller" name="sni-serving-cert::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.crt::/etc/kubernetes/static-pod-resources/secrets/localhost-recovery-serving-certkey/tls.key" E0318 13:31:03.471287 12 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="GET" URI="/apis/user.openshift.io/v1/groups?allowWatchBookmarks=true&resourceVersion=16996&timeout=8m51s&timeoutSeconds=531&watch=true" auditID="db1e48dc-dfb4-411d-831b-48a297ec70c5" I0318 13:31:03.471371 12 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0318 13:31:05.469680 12 genericapiserver.go:742] [graceful-termination] apiserver is exiting I0318 13:31:05.469718 12 patch_genericapiserver.go:97] Event(v1.ObjectReference{Kind:"Pod", Namespace:"openshift-kube-apiserver", Name:"kube-apiserver-master-0", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'TerminationGracefulTerminationFinished' All pending requests processed W0318 13:31:05.472505 12 cacher.go:171] Terminating all watchers from cacher apiservices.apiregistration.k8s.io W0318 13:31:05.473171 12 cacher.go:171] Terminating all watchers from cacher secrets W0318 13:31:05.479126 12 cacher.go:171] Terminating all watchers from cacher podtemplates W0318 13:31:05.480191 12 cacher.go:171] Terminating all watchers from cacher endpoints W0318 13:31:05.482300 12 cacher.go:171] Terminating all watchers from cacher nodes W0318 13:31:05.483358 12 cacher.go:171] Terminating all watchers from cacher resourcequotas W0318 13:31:05.485262 12 cacher.go:171] Terminating all watchers from cacher namespaces W0318 13:31:05.489116 12 cacher.go:171] Terminating all watchers from cacher limitranges W0318 13:31:05.489693 12 cacher.go:171] Terminating all watchers from cacher services W0318 13:31:05.495246 12 cacher.go:171] Terminating all watchers from cacher persistentvolumes W0318 13:31:05.496149 12 cacher.go:171] Terminating all watchers from cacher persistentvolumeclaims W0318 13:31:05.497470 12 cacher.go:171] Terminating all watchers from cacher serviceaccounts W0318 13:31:05.500300 12 cacher.go:171] Terminating all watchers from cacher replicationcontrollers W0318 13:31:05.500925 12 cacher.go:171] Terminating all watchers from cacher configmaps W0318 13:31:05.504929 12 cacher.go:171] Terminating all watchers from cacher pods W0318 13:31:05.525286 12 cacher.go:171] Terminating all watchers from cacher horizontalpodautoscalers.autoscaling W0318 13:31:05.526676 12 cacher.go:171] Terminating all watchers from cacher jobs.batch W0318 13:31:05.533040 12 cacher.go:171] Terminating all watchers from cacher cronjobs.batch W0318 13:31:05.533593 12 cacher.go:171] Terminating all watchers from cacher certificatesigningrequests.certificates.k8s.io W0318 13:31:05.534332 12 cacher.go:171] Terminating all watchers from cacher leases.coordination.k8s.io W0318 13:31:05.534743 12 cacher.go:171] Terminating all watchers from cacher endpointslices.discovery.k8s.io W0318 13:31:05.535518 12 cacher.go:171] Terminating all watchers from cacher ingresses.networking.k8s.io W0318 13:31:05.536915 12 cacher.go:171] Terminating all watchers from cacher ingressclasses.networking.k8s.io W0318 13:31:05.537702 12 cacher.go:171] Terminating all watchers from cacher networkpolicies.networking.k8s.io W0318 13:31:05.538554 12 cacher.go:171] Terminating all watchers from cacher runtimeclasses.node.k8s.io W0318 13:31:05.539233 12 cacher.go:171] Terminating all watchers from cacher poddisruptionbudgets.policy W0318 13:31:05.540706 12 cacher.go:171] Terminating all watchers from cacher roles.rbac.authorization.k8s.io W0318 13:31:05.542683 12 cacher.go:171] Terminating all watchers from cacher rolebindings.rbac.authorization.k8s.io W0318 13:31:05.545783 12 cacher.go:171] Terminating all watchers from cacher clusterroles.rbac.authorization.k8s.io W0318 13:31:05.546401 12 cacher.go:171] Terminating all watchers from cacher clusterrolebindings.rbac.authorization.k8s.io W0318 13:31:05.547274 12 cacher.go:171] Terminating all watchers from cacher priorityclasses.scheduling.k8s.io W0318 13:31:05.547678 12 cacher.go:171] Terminating all watchers from cacher storageclasses.storage.k8s.io W0318 13:31:05.548145 12 cacher.go:171] Terminating all watchers from cacher volumeattachments.storage.k8s.io W0318 13:31:05.549719 12 cacher.go:171] Terminating all watchers from cacher csinodes.storage.k8s.io W0318 13:31:05.550193 12 cacher.go:171] Terminating all watchers from cacher csidrivers.storage.k8s.io W0318 13:31:05.550887 12 cacher.go:171] Terminating all watchers from cacher csistoragecapacities.storage.k8s.io W0318 13:31:05.554084 12 cacher.go:171] Terminating all watchers from cacher flowschemas.flowcontrol.apiserver.k8s.io W0318 13:31:05.554660 12 cacher.go:171] Terminating all watchers from cacher prioritylevelconfigurations.flowcontrol.apiserver.k8s.io W0318 13:31:05.555075 12 cacher.go:171] Terminating all watchers from cacher deployments.apps W0318 13:31:05.558072 12 cacher.go:171] Terminating all watchers from cacher replicasets.apps W0318 13:31:05.559223 12 cacher.go:171] Terminating all watchers from cacher controllerrevisions.apps W0318 13:31:05.559934 12 cacher.go:171] Terminating all watchers from cacher statefulsets.apps W0318 13:31:05.560608 12 cacher.go:171] Terminating all watchers from cacher daemonsets.apps W0318 13:31:05.564323 12 cacher.go:171] Terminating all watchers from cacher validatingwebhookconfigurations.admissionregistration.k8s.io W0318 13:31:05.565545 12 cacher.go:171] Terminating all watchers from cacher mutatingwebhookconfigurations.admissionregistration.k8s.io W0318 13:31:05.566407 12 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicies.admissionregistration.k8s.io W0318 13:31:05.567156 12 cacher.go:171] Terminating all watchers from cacher validatingadmissionpolicybindings.admissionregistration.k8s.io W0318 13:31:05.568101 12 cacher.go:171] Terminating all watchers from cacher customresourcedefinitions.apiextensions.k8s.io W0318 13:31:05.569643 12 cacher.go:171] Terminating all watchers from cacher adminpolicybasedexternalroutes.k8s.ovn.org W0318 13:31:05.570075 12 cacher.go:171] Terminating all watchers from cacher provisionings.metal3.io W0318 13:31:05.570575 12 cacher.go:171] Terminating all watchers from cacher consoleyamlsamples.console.openshift.io W0318 13:31:05.570959 12 cacher.go:171] Terminating all watchers from cacher thanosrulers.monitoring.coreos.com W0318 13:31:05.572202 12 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io W0318 13:31:05.573104 12 cacher.go:171] Terminating all watchers from cacher consoles.operator.openshift.io W0318 13:31:05.573740 12 cacher.go:171] Terminating all watchers from cacher storageversionmigrations.migration.k8s.io W0318 13:31:05.574641 12 cacher.go:171] Terminating all watchers from cacher prometheusrules.monitoring.coreos.com W0318 13:31:05.575272 12 cacher.go:171] Terminating all watchers from cacher nodeslicepools.whereabouts.cni.cncf.io W0318 13:31:05.575648 12 cacher.go:171] Terminating all watchers from cacher podmonitors.monitoring.coreos.com W0318 13:31:05.576174 12 cacher.go:171] Terminating all watchers from cacher nodes.config.openshift.io W0318 13:31:05.576613 12 cacher.go:171] Terminating all watchers from cacher alertingrules.monitoring.openshift.io W0318 13:31:05.577042 12 cacher.go:171] Terminating all watchers from cacher egressrouters.network.operator.openshift.io W0318 13:31:05.577782 12 cacher.go:171] Terminating all watchers from cacher clusteroperators.config.openshift.io W0318 13:31:05.580802 12 cacher.go:171] Terminating all watchers from cacher machinesets.machine.openshift.io W0318 13:31:05.581229 12 cacher.go:171] Terminating all watchers from cacher projecthelmchartrepositories.helm.openshift.io W0318 13:31:05.581720 12 cacher.go:171] Terminating all watchers from cacher egressservices.k8s.ovn.org W0318 13:31:05.582289 12 cacher.go:171] Terminating all watchers from cacher profiles.tuned.openshift.io W0318 13:31:05.582881 12 cacher.go:171] Terminating all watchers from cacher egressqoses.k8s.ovn.org W0318 13:31:05.583653 12 cacher.go:171] Terminating all watchers from cacher apirequestcounts.apiserver.openshift.io W0318 13:31:05.584023 12 cacher.go:171] Terminating all watchers from cacher consolenotifications.console.openshift.io W0318 13:31:05.584352 12 cacher.go:171] Terminating all watchers from cacher baselineadminnetworkpolicies.policy.networking.k8s.io W0318 13:31:05.584957 12 cacher.go:171] Terminating all watchers from cacher imagetagmirrorsets.config.openshift.io W0318 13:31:05.585800 12 cacher.go:171] Terminating all watchers from cacher authentications.config.openshift.io W0318 13:31:05.588484 12 cacher.go:171] Terminating all watchers from cacher userdefinednetworks.k8s.ovn.org W0318 13:31:05.589260 12 cacher.go:171] Terminating all watchers from cacher preprovisioningimages.metal3.io W0318 13:31:05.589735 12 cacher.go:171] Terminating all watchers from cacher machineosconfigs.machineconfiguration.openshift.io W0318 13:31:05.590324 12 cacher.go:171] Terminating all watchers from cacher kubeletconfigs.machineconfiguration.openshift.io W0318 13:31:05.590941 12 cacher.go:171] Terminating all watchers from cacher tuneds.tuned.openshift.io W0318 13:31:05.591765 12 cacher.go:171] Terminating all watchers from cacher olms.operator.openshift.io W0318 13:31:05.592226 12 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0318 13:31:05.592725 12 cacher.go:171] Terminating all watchers from cacher alertmanagerconfigs.monitoring.coreos.com W0318 13:31:05.593132 12 cacher.go:171] Terminating all watchers from cacher operatorgroups.operators.coreos.com W0318 13:31:05.593888 12 cacher.go:171] Terminating all watchers from cacher infrastructures.config.openshift.io W0318 13:31:05.595314 12 cacher.go:171] Terminating all watchers from cacher performanceprofiles.performance.openshift.io W0318 13:31:05.596321 12 cacher.go:171] Terminating all watchers from cacher kubeschedulers.operator.openshift.io W0318 13:31:05.597248 12 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io W0318 13:31:05.598358 12 cacher.go:171] Terminating all watchers from cacher helmchartrepositories.helm.openshift.io W0318 13:31:05.598968 12 cacher.go:171] Terminating all watchers from cacher hardwaredata.metal3.io W0318 13:31:05.599626 12 cacher.go:171] Terminating all watchers from cacher storagestates.migration.k8s.io W0318 13:31:05.599930 12 cacher.go:171] Terminating all watchers from cacher clusterversions.config.openshift.io W0318 13:31:05.601553 12 cacher.go:171] Terminating all watchers from cacher openshiftapiservers.operator.openshift.io W0318 13:31:05.602204 12 cacher.go:171] Terminating all watchers from cacher probes.monitoring.coreos.com W0318 13:31:05.602516 12 cacher.go:171] Terminating all watchers from cacher rolebindingrestrictions.authorization.openshift.io W0318 13:31:05.602863 12 cacher.go:171] Terminating all watchers from cacher machineconfigs.machineconfiguration.openshift.io W0318 13:31:05.603362 12 cacher.go:171] Terminating all watchers from cacher baremetalhosts.metal3.io W0318 13:31:05.603742 12 cacher.go:171] Terminating all watchers from cacher proxies.config.openshift.io W0318 13:31:05.604317 12 cacher.go:171] Terminating all watchers from cacher imagedigestmirrorsets.config.openshift.io W0318 13:31:05.604758 12 cacher.go:171] Terminating all watchers from cacher oauths.config.openshift.io W0318 13:31:05.605120 12 cacher.go:171] Terminating all watchers from cacher consoleplugins.console.openshift.io W0318 13:31:05.607784 12 cacher.go:171] Terminating all watchers from cacher kubestorageversionmigrators.operator.openshift.io W0318 13:31:05.608340 12 cacher.go:171] Terminating all watchers from cacher kubecontrollermanagers.operator.openshift.io W0318 13:31:05.608704 12 cacher.go:171] Terminating all watchers from cacher machinehealthchecks.machine.openshift.io W0318 13:31:05.609035 12 cacher.go:171] Terminating all watchers from cacher networks.operator.openshift.io W0318 13:31:05.609602 12 cacher.go:171] Terminating all watchers from cacher images.config.openshift.io W0318 13:31:05.610397 12 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io W0318 13:31:05.612376 12 cacher.go:171] Terminating all watchers from cacher servicecas.operator.openshift.io W0318 13:31:05.612844 12 cacher.go:171] Terminating all watchers from cacher egressfirewalls.k8s.ovn.org W0318 13:31:05.613892 12 cacher.go:171] Terminating all watchers from cacher ipaddresses.ipam.cluster.x-k8s.io W0318 13:31:05.614519 12 cacher.go:171] Terminating all watchers from cacher network-attachment-definitions.k8s.cni.cncf.io W0318 13:31:05.614941 12 cacher.go:171] Terminating all watchers from cacher overlappingrangeipreservations.whereabouts.cni.cncf.io W0318 13:31:05.615363 12 cacher.go:171] Terminating all watchers from cacher clusterresourcequotas.quota.openshift.io W0318 13:31:05.616170 12 cacher.go:171] Terminating all watchers from cacher insightsoperators.operator.openshift.io W0318 13:31:05.616650 12 cacher.go:171] Terminating all watchers from cacher consolesamples.console.openshift.io W0318 13:31:05.616913 12 cacher.go:171] Terminating all watchers from cacher ingresses.config.openshift.io W0318 13:31:05.617814 12 cacher.go:171] Terminating all watchers from cacher bmceventsubscriptions.metal3.io W0318 13:31:05.618279 12 cacher.go:171] Terminating all watchers from cacher firmwareschemas.metal3.io W0318 13:31:05.618806 12 cacher.go:171] Terminating all watchers from cacher ipamclaims.k8s.cni.cncf.io W0318 13:31:05.619261 12 cacher.go:171] Terminating all watchers from cacher featuregates.config.openshift.io W0318 13:31:05.620870 12 cacher.go:171] Terminating all watchers from cacher operatorconditions.operators.coreos.com W0318 13:31:05.621641 12 cacher.go:171] Terminating all watchers from cacher cloudcredentials.operator.openshift.io W0318 13:31:05.622041 12 cacher.go:171] Terminating all watchers from cacher dnses.operator.openshift.io W0318 13:31:05.622484 12 cacher.go:171] Terminating all watchers from cacher hostfirmwaresettings.metal3.io W0318 13:31:05.623095 12 cacher.go:171] Terminating all watchers from cacher dnses.config.openshift.io W0318 13:31:05.623548 12 cacher.go:171] Terminating all watchers from cacher clustercatalogs.olm.operatorframework.io W0318 13:31:05.623977 12 cacher.go:171] Terminating all watchers from cacher imagecontentpolicies.config.openshift.io W0318 13:31:05.624677 12 cacher.go:171] Terminating all watchers from cacher ipaddressclaims.ipam.cluster.x-k8s.io W0318 13:31:05.624979 12 cacher.go:171] Terminating all watchers from cacher prometheuses.monitoring.coreos.com W0318 13:31:05.625331 12 cacher.go:171] Terminating all watchers from cacher dnsrecords.ingress.operator.openshift.io W0318 13:31:05.625995 12 cacher.go:171] Terminating all watchers from cacher subscriptions.operators.coreos.com W0318 13:31:05.627009 12 cacher.go:171] Terminating all watchers from cacher clusterextensions.olm.operatorframework.io W0318 13:31:05.628172 12 cacher.go:171] Terminating all watchers from cacher metal3remediationtemplates.infrastructure.cluster.x-k8s.io W0318 13:31:05.628700 12 cacher.go:171] Terminating all watchers from cacher operatorhubs.config.openshift.io W0318 13:31:05.629890 12 cacher.go:171] Terminating all watchers from cacher projects.config.openshift.io W0318 13:31:05.630391 12 cacher.go:171] Terminating all watchers from cacher openshiftcontrollermanagers.operator.openshift.io W0318 13:31:05.631024 12 cacher.go:171] Terminating all watchers from cacher configs.operator.openshift.io W0318 13:31:05.631796 12 cacher.go:171] Terminating all watchers from cacher consoleexternalloglinks.console.openshift.io W0318 13:31:05.632088 12 cacher.go:171] Terminating all watchers from cacher controllerconfigs.machineconfiguration.openshift.io W0318 13:31:05.632594 12 cacher.go:171] Terminating all watchers from cacher containerruntimeconfigs.machineconfiguration.openshift.io W0318 13:31:05.632960 12 cacher.go:171] Terminating all watchers from cacher installplans.operators.coreos.com W0318 13:31:05.633356 12 cacher.go:171] Terminating all watchers from cacher storages.operator.openshift.io W0318 13:31:05.633836 12 cacher.go:171] Terminating all watchers from cacher olmconfigs.operators.coreos.com W0318 13:31:05.634858 12 cacher.go:171] Terminating all watchers from cacher operatorpkis.network.operator.openshift.io W0318 13:31:05.635304 12 cacher.go:171] Terminating all watchers from cacher catalogsources.operators.coreos.com W0318 13:31:05.635881 12 cacher.go:171] Terminating all watchers from cacher egressips.k8s.ovn.org W0318 13:31:05.636364 12 cacher.go:171] Terminating all watchers from cacher consoles.config.openshift.io W0318 13:31:05.636983 12 cacher.go:171] Terminating all watchers from cacher hostfirmwarecomponents.metal3.io W0318 13:31:05.637481 12 cacher.go:171] Terminating all watchers from cacher schedulers.config.openshift.io W0318 13:31:05.638132 12 cacher.go:171] Terminating all watchers from cacher machineosbuilds.machineconfiguration.openshift.io W0318 13:31:05.638635 12 cacher.go:171] Terminating all watchers from cacher apiservers.config.openshift.io W0318 13:31:05.639229 12 cacher.go:171] Terminating all watchers from cacher imagepruners.imageregistry.operator.openshift.io W0318 13:31:05.639624 12 cacher.go:171] Terminating all watchers from cacher securitycontextconstraints.security.openshift.io W0318 13:31:05.640053 12 cacher.go:171] Terminating all watchers from cacher machineautoscalers.autoscaling.openshift.io W0318 13:31:05.640534 12 cacher.go:171] Terminating all watchers from cacher machines.machine.openshift.io W0318 13:31:05.641177 12 cacher.go:171] Terminating all watchers from cacher alertrelabelconfigs.monitoring.openshift.io W0318 13:31:05.641752 12 cacher.go:171] Terminating all watchers from cacher clustercsidrivers.operator.openshift.io W0318 13:31:05.642167 12 cacher.go:171] Terminating all watchers from cacher machineconfigpools.machineconfiguration.openshift.io W0318 13:31:05.642846 12 cacher.go:171] Terminating all watchers from cacher networks.config.openshift.io W0318 13:31:05.643710 12 cacher.go:171] Terminating all watchers from cacher etcds.operator.openshift.io W0318 13:31:05.644467 12 cacher.go:171] Terminating all watchers from cacher consoleclidownloads.console.openshift.io W0318 13:31:05.644774 12 cacher.go:171] Terminating all watchers from cacher clusterautoscalers.autoscaling.openshift.io W0318 13:31:05.645255 12 cacher.go:171] Terminating all watchers from cacher csisnapshotcontrollers.operator.openshift.io W0318 13:31:05.645695 12 cacher.go:171] Terminating all watchers from cacher hostupdatepolicies.metal3.io W0318 13:31:05.646197 12 cacher.go:171] Terminating all watchers from cacher machineconfigurations.operator.openshift.io W0318 13:31:05.646716 12 cacher.go:171] Terminating all watchers from cacher ingresscontrollers.operator.openshift.io W0318 13:31:05.647370 12 cacher.go:171] Terminating all watchers from cacher servicemonitors.monitoring.coreos.com W0318 13:31:05.647826 12 cacher.go:171] Terminating all watchers from cacher ippools.whereabouts.cni.cncf.io W0318 13:31:05.648169 12 cacher.go:171] Terminating all watchers from cacher builds.config.openshift.io W0318 13:31:05.648845 12 cacher.go:171] Terminating all watchers from cacher clusterserviceversions.operators.coreos.com W0318 13:31:05.649705 12 cacher.go:171] Terminating all watchers from cacher controlplanemachinesets.machine.openshift.io W0318 13:31:05.650188 12 cacher.go:171] Terminating all watchers from cacher dataimages.metal3.io W0318 13:31:05.650592 12 cacher.go:171] Terminating all watchers from cacher kubeapiservers.operator.openshift.io W0318 13:31:05.651356 12 cacher.go:171] Terminating all watchers from cacher alertmanagers.monitoring.coreos.com W0318 13:31:05.651993 12 cacher.go:171] Terminating all watchers from cacher operators.operators.coreos.com W0318 13:31:05.652553 12 cacher.go:171] Terminating all watchers from cacher imagecontentsourcepolicies.operator.openshift.io W0318 13:31:05.652878 12 cacher.go:171] Terminating all watchers from cacher consolequickstarts.console.openshift.io W0318 13:31:05.653200 12 cacher.go:171] Terminating all watchers from cacher clusteruserdefinednetworks.k8s.ovn.org W0318 13:31:05.653744 12 cacher.go:171] Terminating all watchers from cacher configs.samples.operator.openshift.io W0318 13:31:05.654284 12 cacher.go:171] Terminating all watchers from cacher rangeallocations.security.internal.openshift.io W0318 13:31:05.654700 12 cacher.go:171] Terminating all watchers from cacher credentialsrequests.cloudcredential.openshift.io W0318 13:31:05.655155 12 cacher.go:171] Terminating all watchers from cacher authentications.operator.openshift.io W0318 13:31:05.655504 12 cacher.go:171] Terminating all watchers from cacher consolelinks.console.openshift.io W0318 13:31:05.655901 12 cacher.go:171] Terminating all watchers from cacher adminnetworkpolicies.policy.networking.k8s.io W0318 13:31:05.656687 12 cacher.go:171] Terminating all watchers from cacher metal3remediations.infrastructure.cluster.x-k8s.io W0318 13:31:05.657271 12 cacher.go:171] Terminating all watchers from cacher configs.imageregistry.operator.openshift.io I0318 13:31:05.690385 1 main.go:235] Termination finished with exit code 0 I0318 13:31:05.690548 1 main.go:188] Deleting termination lock file "/var/log/kube-apiserver/.terminating" ---