2025-12-03T20:29:40.853197965Z volume percentage checker started.....
2025-12-03T20:29:40.861868920Z volume usage percentage 0
2025-12-03T20:29:41.144645646Z Gathering data for ns/openshift-cluster-version...
2025-12-03T20:29:42.871527057Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2025-12-03T20:29:43.171712135Z Gathering data for ns/default...
2025-12-03T20:29:43.680256231Z Gathering data for ns/openshift...
2025-12-03T20:29:43.958332689Z Waiting on subprocesses to finish execution.
2025-12-03T20:29:43.965651412Z INFO: Gathering HAProxy config files
2025-12-03T20:29:43.966605175Z INFO: Gathering on-disk MachineConfig from degraded nodes
2025-12-03T20:29:43.966645586Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2025-12-03T20:29:43.967648901Z INFO: Collecting host service logs for crio
2025-12-03T20:29:43.968025620Z INFO: Collecting host service logs for kubelet
2025-12-03T20:29:43.968327498Z INFO: Collecting host service logs for rpm-ostreed
2025-12-03T20:29:43.968643646Z INFO: Collecting host service logs for ostree-finalize-staged
2025-12-03T20:29:43.968973244Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2025-12-03T20:29:43.969277511Z INFO: Collecting host service logs for machine-config-daemon-host
2025-12-03T20:29:43.969908867Z INFO: Collecting host service logs for NetworkManager
2025-12-03T20:29:43.970219365Z INFO: Collecting host service logs for openvswitch
2025-12-03T20:29:43.970895061Z INFO: Collecting host service logs for ovs-configuration
2025-12-03T20:29:43.971231090Z INFO: Collecting host service logs for ovsdb-server
2025-12-03T20:29:43.971526427Z INFO: Collecting host service logs for ovs-vswitchd
2025-12-03T20:29:43.971928907Z INFO: Waiting for worker host service log collection to complete ...
2025-12-03T20:29:44.180822579Z INFO: Waiting for node performance related collection to complete ...
2025-12-03T20:29:44.690110754Z INFO: Found 1 replicas - prometheus-k8s-0
2025-12-03T20:29:44.714104729Z No resources found
2025-12-03T20:29:44.763117005Z INFO: "sriov-network-operator" not detected. Skipping.
2025-12-03T20:29:44.763548157Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2025-12-03T20:29:44.763561497Z INFO: on-disk MachineConfig config collection complete.
2025-12-03T20:29:45.008214146Z INFO: Started  downloading kube-apiserver/termination.log from master-0
2025-12-03T20:29:45.474859524Z INFO: Worker host service log collection to complete.
2025-12-03T20:29:45.647768623Z Wrote inspect data to must-gather.
2025-12-03T20:29:45.820445246Z Wrote inspect data to must-gather.
2025-12-03T20:29:45.876556349Z volume usage percentage 0
2025-12-03T20:29:46.329555767Z error: the server doesn't have a resource type "multi-networkpolicy"
2025-12-03T20:29:46.397736339Z No resources found
2025-12-03T20:29:46.398124868Z INFO: Waiting for HAProxy config collection to complete ...
2025-12-03T20:29:46.419466407Z INFO: Collecting Insights Archives from insights-operator-59d99f9b7b-h64kt
2025-12-03T20:29:46.483658330Z Gathering data for ns/metallb-system...
2025-12-03T20:29:46.539304761Z INFO: Finished downloading kube-apiserver/termination.log from master-0
2025-12-03T20:29:46.573038758Z INFO: Getting alertmanagers from prometheus-k8s-0
2025-12-03T20:29:46.652843458Z Gathering data for ns/kube-system...
2025-12-03T20:29:46.712603950Z Wrote inspect data to must-gather.
2025-12-03T20:29:46.727293874Z Wrote inspect data to must-gather.
2025-12-03T20:29:46.738381350Z Wrote inspect data to must-gather.
2025-12-03T20:29:46.817529174Z tar: Removing leading `/' from member names
2025-12-03T20:29:46.827222243Z INFO: HAProxy config collection complete.
2025-12-03T20:29:46.887104459Z Getting information from pod "etcd-master-0", container "etcdctl"
2025-12-03T20:29:46.887176661Z Using endpoints: https://192.168.32.10:2379
2025-12-03T20:29:46.908675205Z INFO: Starting getting etcd information
2025-12-03T20:29:46.908746386Z INFO: Getting etcdctl member list
2025-12-03T20:29:46.909011793Z INFO: Getting etcdctl endpoint status
2025-12-03T20:29:46.909231108Z INFO: Getting etcdctl endpoint health
2025-12-03T20:29:46.909428973Z INFO: Getting etcdctl alarm list
2025-12-03T20:29:46.909633878Z INFO: Getting object count
2025-12-03T20:29:46.916446857Z INFO: Waiting for etcd info collection to complete ...
2025-12-03T20:29:46.938304080Z Gathering data for ns/openshift-nmstate...
2025-12-03T20:29:46.949436446Z Wrote inspect data to must-gather.
2025-12-03T20:29:46.995121769Z Wrote inspect data to must-gather.
2025-12-03T20:29:47.155972009Z INFO: Collecting /debug/api_priority_and_fairness endpoint from kube-apiserver-master-0
2025-12-03T20:29:47.162297277Z receiving incremental file list
2025-12-03T20:29:47.187551373Z insights-operator/
2025-12-03T20:29:47.189033630Z 
2025-12-03T20:29:47.189051790Z sent 28 bytes  received 67 bytes  63.33 bytes/sec
2025-12-03T20:29:47.189051790Z total size is 0  speedup is 0.00
2025-12-03T20:29:47.288143639Z INFO: Getting rules from prometheus-k8s-0
2025-12-03T20:29:47.472585794Z Wrote inspect data to must-gather.
2025-12-03T20:29:47.651891092Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2025-12-03T20:29:47.705483872Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2025-12-03T20:29:47.739573668Z Gathering data for ns/openshift-config...
2025-12-03T20:29:47.748071669Z INFO: Done collecting etcd information
2025-12-03T20:29:47.848754926Z Wrote inspect data to must-gather.
2025-12-03T20:29:47.900564862Z Gathering data for ns/openshift-etcd...
2025-12-03T20:29:48.103619279Z Wrote inspect data to must-gather.
2025-12-03T20:29:48.129261915Z INFO: Getting status/config from prometheus-k8s-0
2025-12-03T20:29:48.194737110Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2025-12-03T20:29:48.359600810Z Wrote inspect data to must-gather.
2025-12-03T20:29:48.475744482Z Wrote inspect data to must-gather.
2025-12-03T20:29:48.538101348Z Wrote inspect data to must-gather.
2025-12-03T20:29:48.697869043Z Gathering data for ns/openshift-config-managed...
2025-12-03T20:29:48.721357885Z Wrote inspect data to must-gather.
2025-12-03T20:29:48.801770240Z INFO: Getting status/flags from prometheus-k8s-0
2025-12-03T20:29:48.851534944Z Wrote inspect data to must-gather.
2025-12-03T20:29:49.043054096Z Wrote inspect data to must-gather.
2025-12-03T20:29:49.082302939Z W1203 20:29:49.082235    1700 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2025-12-03T20:29:49.102009238Z INFO: INTERCONNECT MODE
2025-12-03T20:29:49.102009238Z INFO: Gathering ovn-kubernetes DBs
2025-12-03T20:29:49.114365505Z Wrote inspect data to must-gather.
2025-12-03T20:29:49.274686912Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2025-12-03T20:29:49.601254884Z Gathering data for ns/assisted-installer...
2025-12-03T20:29:49.617901397Z INFO: Gathering OVN_Northbound from ovnkube-node-l9m2r...
2025-12-03T20:29:49.617901397Z INFO: Gathering OVN_Southbound from ovnkube-node-l9m2r...
2025-12-03T20:29:49.793019552Z INFO: Getting targets?state=active from prometheus-k8s-0
2025-12-03T20:29:49.863957271Z Wrote inspect data to must-gather.
2025-12-03T20:29:49.900678473Z Wrote inspect data to must-gather.
2025-12-03T20:29:49.970430852Z tar: Removing leading `/' from member names
2025-12-03T20:29:49.986327508Z tar: Removing leading `/' from member names
2025-12-03T20:29:49.991452564Z Wrote inspect data to must-gather.
2025-12-03T20:29:50.002982591Z Gathering data for ns/openshift-authentication...
2025-12-03T20:29:50.150884209Z INFO: Getting status/tsdb from prometheus-k8s-0
2025-12-03T20:29:50.256273535Z INFO: Waiting for network log collection to complete ...
2025-12-03T20:29:50.256397218Z INFO: Waiting for ovnk database copies to complete ...
2025-12-03T20:29:50.256845209Z INFO: Copying ovnk databases complete.
2025-12-03T20:29:50.258992201Z 2.3M	must-gather/network_logs/ovnk_database_store
2025-12-03T20:29:50.263346850Z ovnk_database_store/
2025-12-03T20:29:50.263346850Z ovnk_database_store/ovnkube-node-l9m2r_sbdb
2025-12-03T20:29:50.334357631Z ovnk_database_store/ovnkube-node-l9m2r_nbdb
2025-12-03T20:29:50.357016484Z INFO: Network log collection complete.
2025-12-03T20:29:50.414952191Z Wrote inspect data to must-gather.
2025-12-03T20:29:50.415722940Z Wrote inspect data to must-gather.
2025-12-03T20:29:50.553159390Z Wrote inspect data to must-gather.
2025-12-03T20:29:50.916593876Z volume usage percentage 0
2025-12-03T20:29:51.073617991Z Wrote inspect data to must-gather.
2025-12-03T20:29:51.153220216Z Wrote inspect data to must-gather.
2025-12-03T20:29:51.153220216Z Wrote inspect data to must-gather.
2025-12-03T20:29:51.313939614Z Wrote inspect data to must-gather.
2025-12-03T20:29:51.447046026Z Wrote inspect data to must-gather.
2025-12-03T20:29:51.489152490Z INFO: Getting status from alertmanager-main-0
2025-12-03T20:29:51.658433030Z Gathering data for ns/openshift-authentication-operator...
2025-12-03T20:29:52.310510838Z Gathering data for ns/openshift-ingress...
2025-12-03T20:29:52.454284134Z Wrote inspect data to must-gather.
2025-12-03T20:29:52.889178203Z Wrote inspect data to must-gather.
2025-12-03T20:29:52.973620448Z Gathering data for ns/openshift-oauth-apiserver...
2025-12-03T20:29:53.033281979Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b99ce0f31213291444482af4af36345dc93acdbe965868073e8232797b8a2f14
2025-12-03T20:29:53.169812015Z daemonset.apps/perf-node-gather-daemonset created
2025-12-03T20:29:53.357926183Z Wrote inspect data to must-gather.
2025-12-03T20:29:53.396027018Z Waiting for performance profile collector pods to become ready: 1
2025-12-03T20:29:53.775971983Z Gathering data for ns/openshift-machine-api...
2025-12-03T20:29:53.832385504Z Wrote inspect data to must-gather.
2025-12-03T20:29:54.110666597Z Wrote inspect data to must-gather.
2025-12-03T20:29:54.546908580Z /usr/bin/gather_metallb: line 53: must-gather/namespaces/metallb-system/pods/speaker-j26tj/reloader/reloader/logs/reloader.pid: No such file or directory
2025-12-03T20:29:54.547419712Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-j26tj/frr/frr/logs/frr.conf: No such file or directory
2025-12-03T20:29:54.549147776Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-j26tj/frr/frr/logs/frr.log: No such file or directory
2025-12-03T20:29:54.550057028Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-j26tj/frr/frr/logs/daemons: No such file or directory
2025-12-03T20:29:54.554301103Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-j26tj/frr/frr/logs/vtysh.conf: No such file or directory
2025-12-03T20:29:54.554341674Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-j26tj/frr/frr/logs/dump_frr: No such file or directory
2025-12-03T20:29:54.670735451Z Waiting for performance profile collector pods to become ready: 2
2025-12-03T20:29:54.758174371Z Error from server (BadRequest): container frr is not valid for pod speaker-j26tj
2025-12-03T20:29:54.767351318Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-j26tj/frr/frr/logs/dump_frr: No such file or directory
2025-12-03T20:29:54.767351318Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-j26tj/frr/frr/logs/dump_frr: No such file or directory
2025-12-03T20:29:54.989161362Z Error from server (BadRequest): container frr is not valid for pod speaker-j26tj
2025-12-03T20:29:55.000114494Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-j26tj/frr/frr/logs/dump_frr: No such file or directory
2025-12-03T20:29:55.000114494Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-j26tj/frr/frr/logs/dump_frr: No such file or directory
2025-12-03T20:29:55.188450616Z Error from server (BadRequest): container frr is not valid for pod speaker-j26tj
2025-12-03T20:29:55.197329276Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-j26tj/frr/frr/logs/dump_frr: No such file or directory
2025-12-03T20:29:55.197329276Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-j26tj/frr/frr/logs/dump_frr: No such file or directory
2025-12-03T20:29:55.197553102Z Gathering data for ns/openshift-cloud-controller-manager-operator...
2025-12-03T20:29:55.472938293Z Error from server (BadRequest): container frr is not valid for pod speaker-j26tj
2025-12-03T20:29:55.490937880Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-j26tj/frr/frr/logs/dump_frr: No such file or directory
2025-12-03T20:29:55.490937880Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-j26tj/frr/frr/logs/dump_frr: No such file or directory
2025-12-03T20:29:55.676975785Z Error from server (BadRequest): container frr is not valid for pod speaker-j26tj
2025-12-03T20:29:55.685497967Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-j26tj/frr/frr/logs/dump_frr: No such file or directory
2025-12-03T20:29:55.874257130Z Waiting for performance profile collector pods to become ready: 3
2025-12-03T20:29:55.949983628Z Gathering data for ns/openshift-cloud-controller-manager...
2025-12-03T20:29:55.954957342Z volume usage percentage 0
2025-12-03T20:29:56.839846405Z Gathering data for ns/openshift-cloud-credential-operator...
2025-12-03T20:29:57.089261343Z Waiting for performance profile collector pods to become ready: 4
2025-12-03T20:29:58.297681152Z Waiting for performance profile collector pods to become ready: 5
2025-12-03T20:29:58.538855705Z Gathering data for ns/openshift-config-operator...
2025-12-03T20:29:59.382584667Z Gathering data for ns/openshift-console-operator...
2025-12-03T20:29:59.498480032Z Waiting for performance profile collector pods to become ready: 6
2025-12-03T20:29:59.956801923Z Gathering data for ns/openshift-console...
2025-12-03T20:30:00.725449562Z Waiting for performance profile collector pods to become ready: 7
2025-12-03T20:30:00.788704901Z Gathering data for ns/openshift-cluster-storage-operator...
2025-12-03T20:30:00.984508479Z volume usage percentage 0
2025-12-03T20:30:01.492110902Z Gathering data for ns/openshift-dns-operator...
2025-12-03T20:30:01.897447148Z Waiting for performance profile collector pods to become ready: 8
2025-12-03T20:30:01.952526474Z Gathering data for ns/openshift-dns...
2025-12-03T20:30:02.571950872Z Gathering data for ns/openshift-etcd-operator...
2025-12-03T20:30:03.167080366Z Waiting for performance profile collector pods to become ready: 9
2025-12-03T20:30:03.283505264Z Gathering data for ns/openshift-etcd...
2025-12-03T20:30:04.338182559Z Daemonset perf-node-gather-daemonset ready 1 out of 1
2025-12-03T20:30:04.411547999Z Gathering data for ns/openshift-image-registry...
2025-12-03T20:30:04.704172579Z Collecting performance related data for node master-0
2025-12-03T20:30:05.053652650Z Gathering data for ns/openshift-ingress-operator...
2025-12-03T20:30:05.795845293Z Gathering data for ns/openshift-ingress-canary...
2025-12-03T20:30:06.029720005Z volume usage percentage 0
2025-12-03T20:30:06.343457879Z Gathering data for ns/openshift-insights...
2025-12-03T20:30:08.108649581Z Gathering data for ns/openshift-monitoring...
2025-12-03T20:30:10.368501876Z Gathering data for ns/metallb-system...
2025-12-03T20:30:11.070892861Z volume usage percentage 0
2025-12-03T20:30:13.129370980Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2025-12-03T20:30:14.642993471Z Gathering data for ns/openshift-kube-apiserver-operator...
2025-12-03T20:30:15.568319627Z Gathering data for ns/openshift-kube-apiserver...
2025-12-03T20:30:16.119014989Z volume usage percentage 0
2025-12-03T20:30:16.732131340Z Gathering data for ns/openshift-catalogd...
2025-12-03T20:30:17.344629625Z Gathering data for ns/cert-manager...
2025-12-03T20:30:17.943994775Z Gathering data for ns/openstack-operators...
2025-12-03T20:30:20.472053902Z Gathering data for ns/openshift-nmstate...
2025-12-03T20:30:21.166078661Z volume usage percentage 0
2025-12-03T20:30:21.215487246Z Gathering data for ns/openshift-operators...
2025-12-03T20:30:21.945651691Z Gathering data for ns/openshift-multus...
2025-12-03T20:30:22.945340312Z Gathering data for ns/openshift-storage...
2025-12-03T20:30:23.186150076Z Collecting kubelet logs for node master-0
2025-12-03T20:30:24.081979155Z Gathering data for ns/openshift-kube-controller-manager...
2025-12-03T20:30:24.303738540Z daemonset.apps "perf-node-gather-daemonset" deleted
2025-12-03T20:30:24.318063010Z INFO: Node performance data collection complete.
2025-12-03T20:30:25.097464788Z Gathering data for ns/openshift-kube-controller-manager-operator...
2025-12-03T20:30:25.854546589Z Gathering data for ns/kube-system...
2025-12-03T20:30:26.224224862Z volume usage percentage 0
2025-12-03T20:30:26.602241530Z Gathering data for ns/openshift-kube-scheduler...
2025-12-03T20:30:27.236451576Z Gathering data for ns/openshift-kube-scheduler-operator...
2025-12-03T20:30:27.892755652Z Gathering data for ns/openshift-kube-storage-version-migrator...
2025-12-03T20:30:28.345854277Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2025-12-03T20:30:28.993832018Z Gathering data for ns/openshift-cluster-machine-approver...
2025-12-03T20:30:29.532716461Z Gathering data for ns/openshift-machine-config-operator...
2025-12-03T20:30:30.476198183Z Gathering data for ns/openshift-kni-infra...
2025-12-03T20:30:30.911456191Z Gathering data for ns/openshift-openstack-infra...
2025-12-03T20:30:31.294220605Z volume usage percentage 0
2025-12-03T20:30:31.573299633Z Gathering data for ns/openshift-ovirt-infra...
2025-12-03T20:30:32.215380950Z Gathering data for ns/openshift-vsphere-infra...
2025-12-03T20:30:32.745835007Z Gathering data for ns/openshift-nutanix-infra...
2025-12-03T20:30:33.188201319Z Gathering data for ns/openshift-cloud-platform-infra...
2025-12-03T20:30:33.628652205Z Gathering data for ns/openshift-marketplace...
2025-12-03T20:30:36.357202845Z volume usage percentage 0
2025-12-03T20:30:36.657816170Z Gathering data for ns/openshift-user-workload-monitoring...
2025-12-03T20:30:38.378599337Z Gathering data for ns/openshift-ovn-kubernetes...
2025-12-03T20:30:40.186069875Z Gathering data for ns/openshift-host-network...
2025-12-03T20:30:40.881666992Z Gathering data for ns/openshift-network-diagnostics...
2025-12-03T20:30:41.417008469Z volume usage percentage 0
2025-12-03T20:30:41.743539416Z Gathering data for ns/openshift-network-node-identity...
2025-12-03T20:30:42.676139313Z Gathering data for ns/openshift-network-console...
2025-12-03T20:30:43.178209805Z Gathering data for ns/openshift-network-operator...
2025-12-03T20:30:43.936109576Z Gathering data for ns/openshift-cloud-network-config-controller...
2025-12-03T20:30:44.924202839Z Gathering data for ns/openshift-operator-controller...
2025-12-03T20:30:45.898017382Z Gathering data for ns/openshift-cluster-olm-operator...
2025-12-03T20:30:46.515001056Z volume usage percentage 0
2025-12-03T20:30:46.567100381Z Gathering data for ns/openshift-apiserver-operator...
2025-12-03T20:30:47.184097205Z Gathering data for ns/openshift-apiserver...
2025-12-03T20:30:48.720855382Z Gathering data for ns/openshift-controller-manager-operator...
2025-12-03T20:30:49.307363190Z Gathering data for ns/openshift-controller-manager...
2025-12-03T20:30:49.930106114Z Gathering data for ns/openshift-route-controller-manager...
2025-12-03T20:30:50.587846896Z Gathering data for ns/openshift-cluster-samples-operator...
2025-12-03T20:30:51.587253296Z volume usage percentage 0
2025-12-03T20:30:51.835072878Z Gathering data for ns/openshift-operator-lifecycle-manager...
2025-12-03T20:30:53.326019283Z Gathering data for ns/openshift-service-ca-operator...
2025-12-03T20:30:54.415912816Z Gathering data for ns/openshift-service-ca...
2025-12-03T20:30:55.070336776Z Gathering data for ns/openshift-cluster-csi-drivers...
2025-12-03T20:30:56.659776430Z volume usage percentage 0
2025-12-03T20:30:57.647711978Z Wrote inspect data to must-gather.
2025-12-03T20:30:57.647764530Z error: inspection completed with the errors occurred while gathering data:
2025-12-03T20:30:57.647764530Z     [skipping gathering clusterroles.rbac.authorization.k8s.io/system:registry due to error: clusterroles.rbac.authorization.k8s.io "system:registry" not found, skipping gathering clusterrolebindings.rbac.authorization.k8s.io/registry-registry-role due to error: clusterrolebindings.rbac.authorization.k8s.io "registry-registry-role" not found, skipping gathering secrets/support due to error: secrets "support" not found, skipping gathering endpoints/host-etcd-2 due to error: endpoints "host-etcd-2" not found]
2025-12-03T20:30:57.864826151Z error: the server doesn't have a resource type "clusters"