2026-03-12T18:55:03.424208160Z volume percentage checker started.....
2026-03-12T18:55:03.442651508Z volume usage percentage 0
2026-03-12T18:55:04.641848189Z Gathering data for ns/openshift-cluster-version...
2026-03-12T18:55:07.656297481Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-03-12T18:55:07.985958764Z Gathering data for ns/default...
2026-03-12T18:55:08.305963387Z Waiting on subprocesses to finish execution.
2026-03-12T18:55:08.311664198Z INFO: Collecting host service logs for crio
2026-03-12T18:55:08.312100639Z INFO: Collecting host service logs for kubelet
2026-03-12T18:55:08.312428788Z INFO: Collecting host service logs for rpm-ostreed
2026-03-12T18:55:08.312780696Z INFO: Collecting host service logs for ostree-finalize-staged
2026-03-12T18:55:08.313144005Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-03-12T18:55:08.313541525Z INFO: Collecting host service logs for machine-config-daemon-host
2026-03-12T18:55:08.313650728Z INFO: Gathering HAProxy config files
2026-03-12T18:55:08.313914814Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-03-12T18:55:08.314427567Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-03-12T18:55:08.314819907Z INFO: Collecting host service logs for NetworkManager
2026-03-12T18:55:08.315195106Z INFO: Collecting host service logs for openvswitch
2026-03-12T18:55:08.315550575Z INFO: Collecting host service logs for ovs-configuration
2026-03-12T18:55:08.315889514Z INFO: Collecting host service logs for ovsdb-server
2026-03-12T18:55:08.316208782Z INFO: Collecting host service logs for ovs-vswitchd
2026-03-12T18:55:08.316600241Z INFO: Waiting for worker host service log collection to complete ...
2026-03-12T18:55:08.389683290Z INFO: Waiting for node performance related collection to complete ...
2026-03-12T18:55:08.501347159Z volume usage percentage 0
2026-03-12T18:55:08.897094016Z INFO: Started  downloading kube-apiserver/termination.log from master-0
2026-03-12T18:55:08.945432329Z INFO: Collecting Insights Archives from insights-operator-8f89dfddd-m6z6d
2026-03-12T18:55:08.961043758Z No resources found
2026-03-12T18:55:09.034310901Z Gathering data for ns/openshift...
2026-03-12T18:55:09.112332443Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-03-12T18:55:09.112332443Z INFO: on-disk MachineConfig config collection complete.
2026-03-12T18:55:09.155617800Z INFO: Found 1 replicas - prometheus-k8s-0
2026-03-12T18:55:09.172481939Z INFO: "sriov-network-operator" not detected. Skipping.
2026-03-12T18:55:09.446767125Z Wrote inspect data to must-gather.
2026-03-12T18:55:09.893113522Z INFO: Worker host service log collection to complete.
2026-03-12T18:55:09.916405371Z No resources found
2026-03-12T18:55:09.944534991Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-03-12T18:55:10.037099435Z INFO: Finished downloading kube-apiserver/termination.log from master-0
2026-03-12T18:55:10.131189326Z Wrote inspect data to must-gather.
2026-03-12T18:55:10.187999320Z INFO: Waiting for HAProxy config collection to complete ...
2026-03-12T18:55:10.192406659Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-03-12T18:55:10.236606149Z Getting information from pod "etcd-master-0", container "etcdctl"
2026-03-12T18:55:10.236606149Z Using endpoints: https://192.168.32.10:2379
2026-03-12T18:55:10.256178966Z INFO: Starting getting etcd information
2026-03-12T18:55:10.256178966Z INFO: Getting etcdctl member list
2026-03-12T18:55:10.256431553Z INFO: Getting etcdctl endpoint status
2026-03-12T18:55:10.256732990Z INFO: Getting etcdctl endpoint health
2026-03-12T18:55:10.256917495Z INFO: Getting etcdctl alarm list
2026-03-12T18:55:10.257093489Z INFO: Getting object count
2026-03-12T18:55:10.258682359Z INFO: Waiting for etcd info collection to complete ...
2026-03-12T18:55:10.452618985Z Gathering data for ns/metallb-system...
2026-03-12T18:55:10.564822257Z Wrote inspect data to must-gather.
2026-03-12T18:55:10.572741984Z Wrote inspect data to must-gather.
2026-03-12T18:55:10.572916828Z Gathering data for ns/openshift-nmstate...
2026-03-12T18:55:10.680027634Z Wrote inspect data to must-gather.
2026-03-12T18:55:10.832837626Z Wrote inspect data to must-gather.
2026-03-12T18:55:10.947745156Z Wrote inspect data to must-gather.
2026-03-12T18:55:10.948193887Z tar: Removing leading `/' from member names
2026-03-12T18:55:10.965175539Z INFO: HAProxy config collection complete.
2026-03-12T18:55:11.080411997Z receiving incremental file list
2026-03-12T18:55:11.090909178Z insights-operator/
2026-03-12T18:55:11.090989440Z insights-operator/insights-2026-03-12-181837.tar.gz
2026-03-12T18:55:11.157975317Z 
2026-03-12T18:55:11.157975317Z sent 47 bytes  received 170,352 bytes  113,599.33 bytes/sec
2026-03-12T18:55:11.157975317Z total size is 170,152  speedup is 1.00
2026-03-12T18:55:11.236796588Z INFO: Getting rules from prometheus-k8s-0
2026-03-12T18:55:11.388176234Z INFO: Done collecting etcd information
2026-03-12T18:55:11.395459966Z Wrote inspect data to must-gather.
2026-03-12T18:55:11.449290375Z INFO: Collecting /debug/api_priority_and_fairness endpoint from kube-apiserver-master-0
2026-03-12T18:55:11.587871804Z Gathering data for ns/kube-system...
2026-03-12T18:55:11.594636042Z Gathering data for ns/openshift-config...
2026-03-12T18:55:11.738489192Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-03-12T18:55:11.895395736Z Wrote inspect data to must-gather.
2026-03-12T18:55:12.140787263Z Wrote inspect data to must-gather.
2026-03-12T18:55:12.169724153Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-03-12T18:55:12.300594429Z INFO: Getting status/config from prometheus-k8s-0
2026-03-12T18:55:12.496145055Z Wrote inspect data to must-gather.
2026-03-12T18:55:12.677927139Z Gathering data for ns/openshift-config-managed...
2026-03-12T18:55:12.824150848Z Wrote inspect data to must-gather.
2026-03-12T18:55:12.927814717Z INFO: INTERCONNECT MODE
2026-03-12T18:55:12.927814717Z INFO: Gathering ovn-kubernetes DBs
2026-03-12T18:55:12.945127738Z Gathering data for ns/openshift-etcd...
2026-03-12T18:55:13.067477113Z Wrote inspect data to must-gather.
2026-03-12T18:55:13.223173947Z INFO: Getting status/flags from prometheus-k8s-0
2026-03-12T18:55:13.313877764Z INFO: Gathering OVN_Northbound from ovnkube-node-hx8q8...
2026-03-12T18:55:13.314681144Z INFO: Gathering OVN_Southbound from ovnkube-node-hx8q8...
2026-03-12T18:55:13.442720450Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-03-12T18:55:13.515064841Z Wrote inspect data to must-gather.
2026-03-12T18:55:13.571966606Z volume usage percentage 0
2026-03-12T18:55:13.659976017Z tar: Removing leading `/' from member names
2026-03-12T18:55:13.689074891Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-03-12T18:55:13.722085832Z tar: Removing leading `/' from member names
2026-03-12T18:55:13.766285482Z Wrote inspect data to must-gather.
2026-03-12T18:55:14.190169310Z Wrote inspect data to must-gather.
2026-03-12T18:55:14.261070774Z INFO: Waiting for network log collection to complete ...
2026-03-12T18:55:14.261070774Z INFO: Waiting for ovnk database copies to complete ...
2026-03-12T18:55:14.261416393Z INFO: Copying ovnk databases complete.
2026-03-12T18:55:14.278463447Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-03-12T18:55:14.294896656Z 4.4M	must-gather/network_logs/ovnk_database_store
2026-03-12T18:55:14.313625522Z Wrote inspect data to must-gather.
2026-03-12T18:55:14.329401095Z Gathering data for ns/openshift-authentication...
2026-03-12T18:55:14.357533735Z ovnk_database_store/
2026-03-12T18:55:14.357533735Z ovnk_database_store/ovnkube-node-hx8q8_sbdb
2026-03-12T18:55:14.495301193Z Wrote inspect data to must-gather.
2026-03-12T18:55:14.576966255Z ovnk_database_store/ovnkube-node-hx8q8_nbdb
2026-03-12T18:55:14.613408242Z INFO: Network log collection complete.
2026-03-12T18:55:14.664999396Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-03-12T18:55:14.723953593Z Gathering data for ns/assisted-installer...
2026-03-12T18:55:15.041097574Z Wrote inspect data to must-gather.
2026-03-12T18:55:15.074982577Z Wrote inspect data to must-gather.
2026-03-12T18:55:15.112642644Z Wrote inspect data to must-gather.
2026-03-12T18:55:15.470465688Z INFO: Getting status from alertmanager-main-0
2026-03-12T18:55:15.586108386Z Wrote inspect data to must-gather.
2026-03-12T18:55:15.656662042Z Gathering data for ns/openshift-authentication-operator...
2026-03-12T18:55:15.753755478Z Wrote inspect data to must-gather.
2026-03-12T18:55:15.864782700Z Wrote inspect data to must-gather.
2026-03-12T18:55:16.137579629Z Wrote inspect data to must-gather.
2026-03-12T18:55:16.293333475Z Wrote inspect data to must-gather.
2026-03-12T18:55:16.788820665Z Wrote inspect data to must-gather.
2026-03-12T18:55:16.830926392Z Wrote inspect data to must-gather.
2026-03-12T18:55:16.915538108Z Gathering data for ns/openshift-ingress...
2026-03-12T18:55:17.351937027Z Wrote inspect data to must-gather.
2026-03-12T18:55:17.416282228Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f34dc492c80a3dee4643cc2291044750ac51e6e919b973de8723fa8b70bde70
2026-03-12T18:55:17.724745094Z daemonset.apps/perf-node-gather-daemonset created
2026-03-12T18:55:17.792691525Z Gathering data for ns/openshift-oauth-apiserver...
2026-03-12T18:55:17.933851798Z Wrote inspect data to must-gather.
2026-03-12T18:55:18.112815421Z Waiting for performance profile collector pods to become ready: 1
2026-03-12T18:55:19.022192029Z volume usage percentage 0
2026-03-12T18:55:19.301107220Z Wrote inspect data to must-gather.
2026-03-12T18:55:19.331670151Z Wrote inspect data to must-gather.
2026-03-12T18:55:19.432780127Z Waiting for performance profile collector pods to become ready: 2
2026-03-12T18:55:19.665607430Z Gathering data for ns/openshift-machine-api...
2026-03-12T18:55:20.075371657Z Wrote inspect data to must-gather.
2026-03-12T18:55:20.681570112Z Waiting for performance profile collector pods to become ready: 3
2026-03-12T18:55:21.021006609Z /usr/bin/gather_metallb: line 53: must-gather/namespaces/metallb-system/pods/speaker-49mjh/reloader/reloader/logs/reloader.pid: No such file or directory
2026-03-12T18:55:21.021447770Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-49mjh/frr/frr/logs/frr.conf: No such file or directory
2026-03-12T18:55:21.024921996Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-49mjh/frr/frr/logs/frr.log: No such file or directory
2026-03-12T18:55:21.024921996Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-49mjh/frr/frr/logs/daemons: No such file or directory
2026-03-12T18:55:21.025341056Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-49mjh/frr/frr/logs/vtysh.conf: No such file or directory
2026-03-12T18:55:21.025651304Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-49mjh/frr/frr/logs/dump_frr: No such file or directory
2026-03-12T18:55:21.282439024Z Error from server (BadRequest): container frr is not valid for pod speaker-49mjh
2026-03-12T18:55:21.307796695Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-49mjh/frr/frr/logs/dump_frr: No such file or directory
2026-03-12T18:55:21.307796695Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-49mjh/frr/frr/logs/dump_frr: No such file or directory
2026-03-12T18:55:21.612902107Z Gathering data for ns/openshift-cloud-controller-manager-operator...
2026-03-12T18:55:21.646263778Z Error from server (BadRequest): container frr is not valid for pod speaker-49mjh
2026-03-12T18:55:21.657426255Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-49mjh/frr/frr/logs/dump_frr: No such file or directory
2026-03-12T18:55:21.657426255Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-49mjh/frr/frr/logs/dump_frr: No such file or directory
2026-03-12T18:55:21.922841980Z Waiting for performance profile collector pods to become ready: 4
2026-03-12T18:55:21.946559100Z Error from server (BadRequest): container frr is not valid for pod speaker-49mjh
2026-03-12T18:55:21.954598190Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-49mjh/frr/frr/logs/dump_frr: No such file or directory
2026-03-12T18:55:21.954598190Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-49mjh/frr/frr/logs/dump_frr: No such file or directory
2026-03-12T18:55:22.274668954Z Error from server (BadRequest): container frr is not valid for pod speaker-49mjh
2026-03-12T18:55:22.295976304Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-49mjh/frr/frr/logs/dump_frr: No such file or directory
2026-03-12T18:55:22.295976304Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-49mjh/frr/frr/logs/dump_frr: No such file or directory
2026-03-12T18:55:22.498292099Z Error from server (BadRequest): container frr is not valid for pod speaker-49mjh
2026-03-12T18:55:22.526342077Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-49mjh/frr/frr/logs/dump_frr: No such file or directory
2026-03-12T18:55:23.173152872Z Waiting for performance profile collector pods to become ready: 5
2026-03-12T18:55:23.248446836Z Gathering data for ns/openshift-cloud-controller-manager...
2026-03-12T18:55:24.082085970Z volume usage percentage 0
2026-03-12T18:55:24.536129939Z Waiting for performance profile collector pods to become ready: 6
2026-03-12T18:55:24.844580904Z Gathering data for ns/openshift-cloud-credential-operator...
2026-03-12T18:55:25.744785624Z Waiting for performance profile collector pods to become ready: 7
2026-03-12T18:55:27.009422544Z Waiting for performance profile collector pods to become ready: 8
2026-03-12T18:55:27.019660549Z Gathering data for ns/openshift-config-operator...
2026-03-12T18:55:28.184967196Z Gathering data for ns/openshift-console-operator...
2026-03-12T18:55:28.316005117Z Waiting for performance profile collector pods to become ready: 9
2026-03-12T18:55:29.135702985Z volume usage percentage 0
2026-03-12T18:55:29.159442705Z Gathering data for ns/openshift-console...
2026-03-12T18:55:29.573658162Z Daemonset perf-node-gather-daemonset ready 1 out of 1
2026-03-12T18:55:30.007905768Z Collecting performance related data for node master-0
2026-03-12T18:55:30.420609618Z Gathering data for ns/openshift-cluster-storage-operator...
2026-03-12T18:55:31.449773848Z Gathering data for ns/openshift-dns-operator...
2026-03-12T18:55:32.925828077Z Gathering data for ns/openshift-dns...
2026-03-12T18:55:33.865836559Z Gathering data for ns/openshift-etcd-operator...
2026-03-12T18:55:34.171596797Z volume usage percentage 0
2026-03-12T18:55:34.863474423Z Gathering data for ns/openshift-etcd...
2026-03-12T18:55:36.395308941Z Gathering data for ns/openshift-image-registry...
2026-03-12T18:55:37.214709471Z Gathering data for ns/openshift-ingress-operator...
2026-03-12T18:55:38.001650524Z Gathering data for ns/openshift-ingress-canary...
2026-03-12T18:55:38.592675291Z Gathering data for ns/openshift-insights...
2026-03-12T18:55:39.219747755Z volume usage percentage 0
2026-03-12T18:55:40.537058264Z Gathering data for ns/openshift-monitoring...
2026-03-12T18:55:43.409878323Z Gathering data for ns/metallb-system...
2026-03-12T18:55:44.288098756Z volume usage percentage 0
2026-03-12T18:55:47.348277145Z Collecting kubelet logs for node master-0
2026-03-12T18:55:48.524251078Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-03-12T18:55:48.540592135Z INFO: Node performance data collection complete.
2026-03-12T18:55:49.042242608Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-03-12T18:55:49.376744392Z volume usage percentage 0
2026-03-12T18:55:51.093719257Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-03-12T18:55:52.171019444Z Gathering data for ns/openshift-kube-apiserver...
2026-03-12T18:55:53.589134343Z Gathering data for ns/openshift-catalogd...
2026-03-12T18:55:54.431574106Z volume usage percentage 0
2026-03-12T18:55:54.585563848Z Gathering data for ns/cert-manager...
2026-03-12T18:55:55.406887396Z Gathering data for ns/openstack-operators...
2026-03-12T18:55:59.471201362Z volume usage percentage 0
2026-03-12T18:56:03.529734925Z Gathering data for ns/openshift-nmstate...
2026-03-12T18:56:04.527682578Z volume usage percentage 0
2026-03-12T18:56:04.762008209Z Gathering data for ns/openshift-operators...
2026-03-12T18:56:05.824371725Z Gathering data for ns/openshift-multus...
2026-03-12T18:56:07.262746337Z Gathering data for ns/openshift-storage...
2026-03-12T18:56:08.168001204Z Gathering data for ns/openshift-kube-controller-manager...
2026-03-12T18:56:09.428584522Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-03-12T18:56:09.576564714Z volume usage percentage 0
2026-03-12T18:56:10.274042190Z Gathering data for ns/kube-system...
2026-03-12T18:56:11.198458644Z Gathering data for ns/openshift-kube-scheduler...
2026-03-12T18:56:12.294128528Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-03-12T18:56:13.218448569Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-03-12T18:56:13.899342442Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-03-12T18:56:14.638381141Z volume usage percentage 0
2026-03-12T18:56:14.740920293Z Gathering data for ns/openshift-cluster-machine-approver...
2026-03-12T18:56:15.516127303Z Gathering data for ns/openshift-machine-config-operator...
2026-03-12T18:56:16.628571234Z Gathering data for ns/openshift-kni-infra...
2026-03-12T18:56:17.132240798Z Gathering data for ns/openshift-openstack-infra...
2026-03-12T18:56:17.942188503Z Gathering data for ns/openshift-ovirt-infra...
2026-03-12T18:56:18.967038795Z Gathering data for ns/openshift-vsphere-infra...
2026-03-12T18:56:19.503430442Z Gathering data for ns/openshift-nutanix-infra...
2026-03-12T18:56:19.704860234Z volume usage percentage 0
2026-03-12T18:56:20.031556534Z Gathering data for ns/openshift-cloud-platform-infra...
2026-03-12T18:56:20.567834249Z Gathering data for ns/openshift-marketplace...
2026-03-12T18:56:23.599275112Z Gathering data for ns/openshift-user-workload-monitoring...
2026-03-12T18:56:24.799455438Z volume usage percentage 0
2026-03-12T18:56:25.460923828Z Gathering data for ns/openshift-ovn-kubernetes...
2026-03-12T18:56:27.640150296Z Gathering data for ns/openshift-host-network...
2026-03-12T18:56:28.506461103Z Gathering data for ns/openshift-network-diagnostics...
2026-03-12T18:56:29.431808730Z Gathering data for ns/openshift-network-node-identity...
2026-03-12T18:56:29.874339752Z volume usage percentage 0
2026-03-12T18:56:30.253047845Z Gathering data for ns/openshift-network-console...
2026-03-12T18:56:31.000559956Z Gathering data for ns/openshift-network-operator...
2026-03-12T18:56:31.989818873Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-03-12T18:56:32.919827356Z Gathering data for ns/openshift-operator-controller...
2026-03-12T18:56:34.099844279Z Gathering data for ns/openshift-cluster-olm-operator...
2026-03-12T18:56:34.903218720Z Gathering data for ns/openshift-apiserver-operator...
2026-03-12T18:56:34.949438430Z volume usage percentage 0
2026-03-12T18:56:35.637643666Z Gathering data for ns/openshift-apiserver...
2026-03-12T18:56:37.077409133Z Gathering data for ns/openshift-controller-manager-operator...
2026-03-12T18:56:37.867204956Z Gathering data for ns/openshift-controller-manager...
2026-03-12T18:56:38.751593023Z Gathering data for ns/openshift-route-controller-manager...
2026-03-12T18:56:39.567861006Z Gathering data for ns/openshift-cluster-samples-operator...
2026-03-12T18:56:40.013056514Z volume usage percentage 0
2026-03-12T18:56:40.970939879Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-03-12T18:56:42.241835745Z Gathering data for ns/openshift-service-ca-operator...
2026-03-12T18:56:43.233175283Z Gathering data for ns/openshift-service-ca...
2026-03-12T18:56:44.164626622Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-03-12T18:56:45.084034450Z volume usage percentage 0
2026-03-12T18:56:46.022608305Z Wrote inspect data to must-gather.
2026-03-12T18:56:46.022670047Z error: inspection completed with the errors occurred while gathering data:
2026-03-12T18:56:46.022670047Z     [skipping gathering clusterroles.rbac.authorization.k8s.io/system:registry due to error: clusterroles.rbac.authorization.k8s.io "system:registry" not found, skipping gathering clusterrolebindings.rbac.authorization.k8s.io/registry-registry-role due to error: clusterrolebindings.rbac.authorization.k8s.io "registry-registry-role" not found, skipping gathering secrets/support due to error: secrets "support" not found, skipping gathering endpoints/host-etcd-2 due to error: endpoints "host-etcd-2" not found]
2026-03-12T18:56:46.254057325Z error: the server doesn't have a resource type "clusters"