2025-12-04T12:47:07.823836324Z volume percentage checker started.....
2025-12-04T12:47:07.835104903Z volume usage percentage 0
2025-12-04T12:47:08.252977129Z Gathering data for ns/openshift-cluster-version...
2025-12-04T12:47:11.467909211Z Waiting on subprocesses to finish execution.
2025-12-04T12:47:11.470603187Z INFO: Gathering HAProxy config files
2025-12-04T12:47:11.484253191Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2025-12-04T12:47:11.485036067Z INFO: Gathering on-disk MachineConfig from degraded nodes
2025-12-04T12:47:11.503367071Z INFO: Waiting for node performance related collection to complete ...
2025-12-04T12:47:11.506604223Z INFO: Collecting host service logs for crio
2025-12-04T12:47:11.507008476Z INFO: Collecting host service logs for kubelet
2025-12-04T12:47:11.507338937Z INFO: Collecting host service logs for rpm-ostreed
2025-12-04T12:47:11.507673598Z INFO: Collecting host service logs for ostree-finalize-staged
2025-12-04T12:47:11.508113312Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2025-12-04T12:47:11.508361850Z INFO: Collecting host service logs for machine-config-daemon-host
2025-12-04T12:47:11.508669290Z INFO: Collecting host service logs for NetworkManager
2025-12-04T12:47:11.509106794Z INFO: Collecting host service logs for openvswitch
2025-12-04T12:47:11.509273269Z INFO: Collecting host service logs for ovs-configuration
2025-12-04T12:47:11.509688521Z INFO: Collecting host service logs for ovsdb-server
2025-12-04T12:47:11.509999541Z INFO: Collecting host service logs for ovs-vswitchd
2025-12-04T12:47:11.510354243Z INFO: Waiting for worker host service log collection to complete ...
2025-12-04T12:47:11.910263487Z No resources found
2025-12-04T12:47:12.038192881Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2025-12-04T12:47:12.038192881Z INFO: on-disk MachineConfig config collection complete.
2025-12-04T12:47:12.094701330Z INFO: "sriov-network-operator" not detected. Skipping.
2025-12-04T12:47:12.239367927Z INFO: Found 1 replicas - prometheus-k8s-0
2025-12-04T12:47:12.618967474Z Wrote inspect data to must-gather.
2025-12-04T12:47:12.850590900Z volume usage percentage 0
2025-12-04T12:47:12.971436258Z INFO: Collecting Insights Archives from insights-operator-55965856b6-skbmb
2025-12-04T12:47:13.011191914Z INFO: Getting alertmanagers from prometheus-k8s-0
2025-12-04T12:47:13.015732918Z INFO: Waiting for HAProxy config collection to complete ...
2025-12-04T12:47:13.067865229Z INFO: Started  downloading kube-apiserver/termination.log from master-0
2025-12-04T12:47:13.142371831Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2025-12-04T12:47:13.474474027Z Gathering data for ns/openshift-nmstate...
2025-12-04T12:47:13.528131914Z Wrote inspect data to must-gather.
2025-12-04T12:47:13.997484331Z INFO: Worker host service log collection to complete.
2025-12-04T12:47:14.061736177Z Wrote inspect data to must-gather.
2025-12-04T12:47:14.112479743Z Gathering data for ns/metallb-system...
2025-12-04T12:47:14.121445567Z tar: Removing leading `/' from member names
2025-12-04T12:47:14.138314034Z No resources found
2025-12-04T12:47:14.162198086Z Getting information from pod "etcd-master-0", container "etcdctl"
2025-12-04T12:47:14.162198086Z Using endpoints: https://192.168.32.10:2379
2025-12-04T12:47:14.162198086Z INFO: Starting getting etcd information
2025-12-04T12:47:14.162198086Z INFO: Getting etcdctl member list
2025-12-04T12:47:14.162198086Z INFO: Getting etcdctl endpoint status
2025-12-04T12:47:14.162198086Z INFO: Getting etcdctl endpoint health
2025-12-04T12:47:14.162198086Z INFO: Getting etcdctl alarm list
2025-12-04T12:47:14.162198086Z INFO: Getting object count
2025-12-04T12:47:14.179502777Z INFO: Waiting for etcd info collection to complete ...
2025-12-04T12:47:14.181619064Z INFO: HAProxy config collection complete.
2025-12-04T12:47:14.270478033Z INFO: Finished downloading kube-apiserver/termination.log from master-0
2025-12-04T12:47:14.271061372Z error: the server doesn't have a resource type "multi-networkpolicy"
2025-12-04T12:47:14.471562276Z Wrote inspect data to must-gather.
2025-12-04T12:47:14.532692343Z Gathering data for ns/default...
2025-12-04T12:47:14.650136833Z Wrote inspect data to must-gather.
2025-12-04T12:47:14.676009066Z Gathering data for ns/openshift-config...
2025-12-04T12:47:14.740199670Z INFO: Collecting /debug/api_priority_and_fairness endpoint from kube-apiserver-master-0
2025-12-04T12:47:14.778048836Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2025-12-04T12:47:14.820875460Z Wrote inspect data to must-gather.
2025-12-04T12:47:14.839115620Z Wrote inspect data to must-gather.
2025-12-04T12:47:14.984052695Z receiving incremental file list
2025-12-04T12:47:14.988130136Z insights-operator/
2025-12-04T12:47:14.988130136Z insights-operator/insights-2025-12-04-120218.tar.gz
2025-12-04T12:47:15.019337760Z 
2025-12-04T12:47:15.019337760Z sent 47 bytes  received 207,828 bytes  138,583.33 bytes/sec
2025-12-04T12:47:15.019337760Z total size is 207,622  speedup is 1.00
2025-12-04T12:47:15.200786017Z INFO: Getting rules from prometheus-k8s-0
2025-12-04T12:47:15.418487169Z INFO: Done collecting etcd information
2025-12-04T12:47:15.615324617Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2025-12-04T12:47:15.814397336Z Wrote inspect data to must-gather.
2025-12-04T12:47:16.036132227Z Wrote inspect data to must-gather.
2025-12-04T12:47:16.070139479Z Wrote inspect data to must-gather.
2025-12-04T12:47:16.248994376Z Gathering data for ns/openshift...
2025-12-04T12:47:16.307646153Z Wrote inspect data to must-gather.
2025-12-04T12:47:16.584975584Z Gathering data for ns/openshift-config-managed...
2025-12-04T12:47:16.797220862Z INFO: Getting status/config from prometheus-k8s-0
2025-12-04T12:47:16.842892256Z Wrote inspect data to must-gather.
2025-12-04T12:47:16.977923966Z Wrote inspect data to must-gather.
2025-12-04T12:47:17.131995962Z Wrote inspect data to must-gather.
2025-12-04T12:47:17.257952133Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2025-12-04T12:47:17.573184572Z Wrote inspect data to must-gather.
2025-12-04T12:47:17.655186792Z Wrote inspect data to must-gather.
2025-12-04T12:47:17.754531686Z INFO: INTERCONNECT MODE
2025-12-04T12:47:17.754531686Z INFO: Gathering ovn-kubernetes DBs
2025-12-04T12:47:17.798521996Z INFO: Getting status/flags from prometheus-k8s-0
2025-12-04T12:47:17.876610033Z volume usage percentage 0
2025-12-04T12:47:18.089828482Z INFO: Gathering OVN_Northbound from ovnkube-node-z4qvm...
2025-12-04T12:47:18.090160383Z INFO: Gathering OVN_Southbound from ovnkube-node-z4qvm...
2025-12-04T12:47:18.166912727Z Gathering data for ns/kube-system...
2025-12-04T12:47:18.354627874Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2025-12-04T12:47:18.442150181Z Gathering data for ns/openshift-authentication...
2025-12-04T12:47:18.456954873Z Wrote inspect data to must-gather.
2025-12-04T12:47:18.511536940Z tar: Removing leading `/' from member names
2025-12-04T12:47:18.552002599Z Wrote inspect data to must-gather.
2025-12-04T12:47:18.552111443Z tar: Removing leading `/' from member names
2025-12-04T12:47:18.801089501Z Wrote inspect data to must-gather.
2025-12-04T12:47:19.075053245Z INFO: Getting targets?state=active from prometheus-k8s-0
2025-12-04T12:47:19.213643928Z INFO: Waiting for network log collection to complete ...
2025-12-04T12:47:19.213643928Z INFO: Waiting for ovnk database copies to complete ...
2025-12-04T12:47:19.214034380Z INFO: Copying ovnk databases complete.
2025-12-04T12:47:19.216246811Z 4.2M	must-gather/network_logs/ovnk_database_store
2025-12-04T12:47:19.220224207Z ovnk_database_store/
2025-12-04T12:47:19.220224207Z ovnk_database_store/ovnkube-node-z4qvm_sbdb
2025-12-04T12:47:19.378453896Z Wrote inspect data to must-gather.
2025-12-04T12:47:19.466987945Z Wrote inspect data to must-gather.
2025-12-04T12:47:19.488925774Z ovnk_database_store/ovnkube-node-z4qvm_nbdb
2025-12-04T12:47:19.547503929Z INFO: Network log collection complete.
2025-12-04T12:47:19.678427868Z INFO: Getting status/tsdb from prometheus-k8s-0
2025-12-04T12:47:19.684634455Z Wrote inspect data to must-gather.
2025-12-04T12:47:19.840683605Z Gathering data for ns/openshift-etcd...
2025-12-04T12:47:20.209450517Z Gathering data for ns/openshift-authentication-operator...
2025-12-04T12:47:20.356912693Z Wrote inspect data to must-gather.
2025-12-04T12:47:20.403098294Z Wrote inspect data to must-gather.
2025-12-04T12:47:20.535958764Z INFO: Getting status from alertmanager-main-0
2025-12-04T12:47:21.073544842Z Wrote inspect data to must-gather.
2025-12-04T12:47:21.194182964Z Wrote inspect data to must-gather.
2025-12-04T12:47:21.709269556Z Gathering data for ns/openshift-ingress...
2025-12-04T12:47:21.736786912Z Wrote inspect data to must-gather.
2025-12-04T12:47:21.858264611Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5451aa441e5b8d8689c032405d410c8049a849ef2edf77e5b6a5ce2838c6569b
2025-12-04T12:47:22.139836446Z daemonset.apps/perf-node-gather-daemonset created
2025-12-04T12:47:22.434501659Z Waiting for performance profile collector pods to become ready: 1
2025-12-04T12:47:22.480930087Z Wrote inspect data to must-gather.
2025-12-04T12:47:22.575547911Z Wrote inspect data to must-gather.
2025-12-04T12:47:22.878935101Z Gathering data for ns/openshift-oauth-apiserver...
2025-12-04T12:47:22.916327942Z volume usage percentage 0
2025-12-04T12:47:23.192972171Z Gathering data for ns/assisted-installer...
2025-12-04T12:47:23.343920318Z Wrote inspect data to must-gather.
2025-12-04T12:47:23.799588917Z Waiting for performance profile collector pods to become ready: 2
2025-12-04T12:47:23.897835736Z Wrote inspect data to must-gather.
2025-12-04T12:47:24.115721205Z Gathering data for ns/openshift-machine-api...
2025-12-04T12:47:24.309173284Z Wrote inspect data to must-gather.
2025-12-04T12:47:24.438638817Z Wrote inspect data to must-gather.
2025-12-04T12:47:25.056523482Z /usr/bin/gather_metallb: line 53: must-gather/namespaces/metallb-system/pods/speaker-868rl/reloader/reloader/logs/reloader.pid: No such file or directory
2025-12-04T12:47:25.056523482Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-868rl/frr/frr/logs/frr.conf: No such file or directory
2025-12-04T12:47:25.056523482Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-868rl/frr/frr/logs/frr.log: No such file or directory
2025-12-04T12:47:25.063202615Z Waiting for performance profile collector pods to become ready: 3
2025-12-04T12:47:25.063792914Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-868rl/frr/frr/logs/daemons: No such file or directory
2025-12-04T12:47:25.064549198Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-868rl/frr/frr/logs/vtysh.conf: No such file or directory
2025-12-04T12:47:25.064939570Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-868rl/frr/frr/logs/dump_frr: No such file or directory
2025-12-04T12:47:25.294856521Z Error from server (BadRequest): container frr is not valid for pod speaker-868rl
2025-12-04T12:47:25.304206769Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-868rl/frr/frr/logs/dump_frr: No such file or directory
2025-12-04T12:47:25.304206769Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-868rl/frr/frr/logs/dump_frr: No such file or directory
2025-12-04T12:47:25.559101036Z Error from server (BadRequest): container frr is not valid for pod speaker-868rl
2025-12-04T12:47:25.568309339Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-868rl/frr/frr/logs/dump_frr: No such file or directory
2025-12-04T12:47:25.568353931Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-868rl/frr/frr/logs/dump_frr: No such file or directory
2025-12-04T12:47:25.645221818Z Gathering data for ns/openshift-cloud-controller-manager-operator...
2025-12-04T12:47:25.823062711Z Error from server (BadRequest): container frr is not valid for pod speaker-868rl
2025-12-04T12:47:25.836026774Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-868rl/frr/frr/logs/dump_frr: No such file or directory
2025-12-04T12:47:25.836026774Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-868rl/frr/frr/logs/dump_frr: No such file or directory
2025-12-04T12:47:26.072182434Z Error from server (BadRequest): container frr is not valid for pod speaker-868rl
2025-12-04T12:47:26.083037840Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-868rl/frr/frr/logs/dump_frr: No such file or directory
2025-12-04T12:47:26.083037840Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-868rl/frr/frr/logs/dump_frr: No such file or directory
2025-12-04T12:47:26.366208097Z Waiting for performance profile collector pods to become ready: 4
2025-12-04T12:47:26.384903812Z Error from server (BadRequest): container frr is not valid for pod speaker-868rl
2025-12-04T12:47:26.392272576Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-868rl/frr/frr/logs/dump_frr: No such file or directory
2025-12-04T12:47:26.504733457Z Gathering data for ns/openshift-cloud-controller-manager...
2025-12-04T12:47:27.954943326Z volume usage percentage 0
2025-12-04T12:47:28.222898358Z Gathering data for ns/openshift-cloud-credential-operator...
2025-12-04T12:47:28.226210124Z Waiting for performance profile collector pods to become ready: 5
2025-12-04T12:47:29.460897800Z Waiting for performance profile collector pods to become ready: 6
2025-12-04T12:47:30.417379538Z Gathering data for ns/openshift-config-operator...
2025-12-04T12:47:30.687244631Z Waiting for performance profile collector pods to become ready: 7
2025-12-04T12:47:31.303939928Z Gathering data for ns/openshift-console-operator...
2025-12-04T12:47:31.904598895Z Waiting for performance profile collector pods to become ready: 8
2025-12-04T12:47:31.982660240Z Gathering data for ns/openshift-console...
2025-12-04T12:47:32.862602430Z Gathering data for ns/openshift-cluster-storage-operator...
2025-12-04T12:47:32.999186209Z volume usage percentage 0
2025-12-04T12:47:33.120873365Z Daemonset perf-node-gather-daemonset ready 1 out of 1
2025-12-04T12:47:33.553868772Z Collecting performance related data for node master-0
2025-12-04T12:47:33.656894233Z Gathering data for ns/openshift-dns-operator...
2025-12-04T12:47:34.400424179Z Gathering data for ns/openshift-dns...
2025-12-04T12:47:35.078668957Z Gathering data for ns/openshift-etcd-operator...
2025-12-04T12:47:35.703715539Z Gathering data for ns/openshift-etcd...
2025-12-04T12:47:38.052077729Z volume usage percentage 0
2025-12-04T12:47:38.483751804Z Gathering data for ns/openshift-image-registry...
2025-12-04T12:47:39.198504514Z Gathering data for ns/openshift-ingress-operator...
2025-12-04T12:47:40.056537767Z Gathering data for ns/openshift-ingress-canary...
2025-12-04T12:47:40.722545664Z Gathering data for ns/openshift-insights...
2025-12-04T12:47:43.169293886Z volume usage percentage 0
2025-12-04T12:47:43.541881340Z Gathering data for ns/openshift-monitoring...
2025-12-04T12:47:48.022108913Z Gathering data for ns/metallb-system...
2025-12-04T12:47:48.217841235Z volume usage percentage 0
2025-12-04T12:47:52.537900319Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2025-12-04T12:47:53.264831787Z volume usage percentage 0
2025-12-04T12:47:54.160324802Z Gathering data for ns/openshift-kube-apiserver-operator...
2025-12-04T12:47:54.966977838Z Gathering data for ns/openshift-kube-apiserver...
2025-12-04T12:47:56.705359823Z Gathering data for ns/openshift-catalogd...
2025-12-04T12:47:57.368695186Z Gathering data for ns/cert-manager...
2025-12-04T12:47:57.979285429Z Gathering data for ns/openstack-operators...
2025-12-04T12:47:58.297240833Z Collecting kubelet logs for node master-0
2025-12-04T12:47:58.359216476Z volume usage percentage 0
2025-12-04T12:47:59.336229037Z daemonset.apps "perf-node-gather-daemonset" deleted
2025-12-04T12:47:59.356040498Z INFO: Node performance data collection complete.
2025-12-04T12:48:02.169264119Z Gathering data for ns/openshift-nmstate...
2025-12-04T12:48:03.085869187Z Gathering data for ns/openshift-operators...
2025-12-04T12:48:03.403777860Z volume usage percentage 0
2025-12-04T12:48:03.849494913Z Gathering data for ns/openshift-multus...
2025-12-04T12:48:05.123173251Z Gathering data for ns/openshift-storage...
2025-12-04T12:48:05.934558598Z Gathering data for ns/openshift-kube-controller-manager...
2025-12-04T12:48:07.477168809Z Gathering data for ns/openshift-kube-controller-manager-operator...
2025-12-04T12:48:08.217674069Z Gathering data for ns/kube-system...
2025-12-04T12:48:08.916705639Z Gathering data for ns/openshift-kube-scheduler...
2025-12-04T12:48:09.046465390Z volume usage percentage 0
2025-12-04T12:48:09.795470601Z Gathering data for ns/openshift-kube-scheduler-operator...
2025-12-04T12:48:10.783941247Z Gathering data for ns/openshift-kube-storage-version-migrator...
2025-12-04T12:48:11.335126098Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2025-12-04T12:48:12.097941528Z Gathering data for ns/openshift-cluster-machine-approver...
2025-12-04T12:48:12.716206596Z Gathering data for ns/openshift-machine-config-operator...
2025-12-04T12:48:13.838686649Z Gathering data for ns/openshift-kni-infra...
2025-12-04T12:48:14.099520794Z volume usage percentage 0
2025-12-04T12:48:14.345964621Z Gathering data for ns/openshift-openstack-infra...
2025-12-04T12:48:14.840021374Z Gathering data for ns/openshift-ovirt-infra...
2025-12-04T12:48:15.515633128Z Gathering data for ns/openshift-vsphere-infra...
2025-12-04T12:48:16.109020493Z Gathering data for ns/openshift-nutanix-infra...
2025-12-04T12:48:16.668723365Z Gathering data for ns/openshift-cloud-platform-infra...
2025-12-04T12:48:17.220102743Z Gathering data for ns/openshift-marketplace...
2025-12-04T12:48:19.171156450Z volume usage percentage 0
2025-12-04T12:48:21.236760474Z Gathering data for ns/openshift-user-workload-monitoring...
2025-12-04T12:48:22.889994699Z Gathering data for ns/openshift-ovn-kubernetes...
2025-12-04T12:48:24.247788025Z volume usage percentage 0
2025-12-04T12:48:25.047922473Z Gathering data for ns/openshift-host-network...
2025-12-04T12:48:25.741963143Z Gathering data for ns/openshift-network-diagnostics...
2025-12-04T12:48:26.637348595Z Gathering data for ns/openshift-network-node-identity...
2025-12-04T12:48:27.339642628Z Gathering data for ns/openshift-network-console...
2025-12-04T12:48:27.824100924Z Gathering data for ns/openshift-network-operator...
2025-12-04T12:48:28.762122194Z Gathering data for ns/openshift-cloud-network-config-controller...
2025-12-04T12:48:29.474400025Z volume usage percentage 0
2025-12-04T12:48:29.720675337Z Gathering data for ns/openshift-operator-controller...
2025-12-04T12:48:30.862893449Z Gathering data for ns/openshift-cluster-olm-operator...
2025-12-04T12:48:31.628566380Z Gathering data for ns/openshift-apiserver-operator...
2025-12-04T12:48:32.407237625Z Gathering data for ns/openshift-apiserver...
2025-12-04T12:48:33.817977967Z Gathering data for ns/openshift-controller-manager-operator...
2025-12-04T12:48:34.537144057Z volume usage percentage 0
2025-12-04T12:48:34.691039057Z Gathering data for ns/openshift-controller-manager...
2025-12-04T12:48:35.715458388Z Gathering data for ns/openshift-route-controller-manager...
2025-12-04T12:48:36.608280598Z Gathering data for ns/openshift-cluster-samples-operator...
2025-12-04T12:48:38.065929025Z Gathering data for ns/openshift-operator-lifecycle-manager...
2025-12-04T12:48:40.303525806Z volume usage percentage 0
2025-12-04T12:48:40.964634488Z Gathering data for ns/openshift-service-ca-operator...
2025-12-04T12:48:41.787737968Z Gathering data for ns/openshift-service-ca...
2025-12-04T12:48:42.718459985Z Gathering data for ns/openshift-cluster-csi-drivers...
2025-12-04T12:48:45.382975531Z volume usage percentage 0
2025-12-04T12:48:45.583321711Z Wrote inspect data to must-gather.
2025-12-04T12:48:45.583501586Z error: inspection completed with the errors occurred while gathering data:
2025-12-04T12:48:45.583501586Z     [skipping gathering clusterroles.rbac.authorization.k8s.io/system:registry due to error: clusterroles.rbac.authorization.k8s.io "system:registry" not found, skipping gathering clusterrolebindings.rbac.authorization.k8s.io/registry-registry-role due to error: clusterrolebindings.rbac.authorization.k8s.io "registry-registry-role" not found, skipping gathering secrets/support due to error: secrets "support" not found, skipping gathering endpoints/host-etcd-2 due to error: endpoints "host-etcd-2" not found]
2025-12-04T12:48:46.007380444Z error: the server doesn't have a resource type "clusters"