2026-03-12T21:36:03.548060135Z volume percentage checker started..... 2026-03-12T21:36:03.567167099Z volume usage percentage 0 2026-03-12T21:36:04.126590104Z Gathering data for ns/openshift-cluster-version... 2026-03-12T21:36:07.646495943Z Waiting on subprocesses to finish execution. 2026-03-12T21:36:07.653730589Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-03-12T21:36:07.678684103Z INFO: Waiting for node performance related collection to complete ... 2026-03-12T21:36:07.687868777Z INFO: Gathering HAProxy config files 2026-03-12T21:36:07.689994428Z INFO: Collecting host service logs for crio 2026-03-12T21:36:07.691089554Z INFO: Collecting host service logs for kubelet 2026-03-12T21:36:07.695447190Z INFO: Collecting host service logs for rpm-ostreed 2026-03-12T21:36:07.697176993Z INFO: Collecting host service logs for ostree-finalize-staged 2026-03-12T21:36:07.697176993Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-03-12T21:36:07.697176993Z INFO: Collecting host service logs for machine-config-daemon-host 2026-03-12T21:36:07.697176993Z INFO: Collecting host service logs for NetworkManager 2026-03-12T21:36:07.697176993Z INFO: Collecting host service logs for openvswitch 2026-03-12T21:36:07.697176993Z INFO: Collecting host service logs for ovs-configuration 2026-03-12T21:36:07.697330956Z INFO: Collecting host service logs for ovsdb-server 2026-03-12T21:36:07.697587492Z INFO: Collecting host service logs for ovs-vswitchd 2026-03-12T21:36:07.697835608Z INFO: Waiting for worker host service log collection to complete ... 2026-03-12T21:36:07.736938196Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-03-12T21:36:08.253779320Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-03-12T21:36:08.282905586Z INFO: Collecting Insights Archives from insights-operator-8f89dfddd-lc7jk 2026-03-12T21:36:08.319096014Z No resources found 2026-03-12T21:36:08.361165294Z INFO: Started downloading kube-apiserver/termination.log from master-0 2026-03-12T21:36:08.372857247Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-03-12T21:36:08.372857247Z INFO: on-disk MachineConfig config collection complete. 2026-03-12T21:36:08.519672578Z INFO: Found 1 replicas - prometheus-k8s-0 2026-03-12T21:36:08.544127930Z INFO: "sriov-network-operator" not detected. Skipping. 2026-03-12T21:36:08.617349617Z volume usage percentage 0 2026-03-12T21:36:08.760574910Z Wrote inspect data to must-gather. 2026-03-12T21:36:08.997700880Z Wrote inspect data to must-gather. 2026-03-12T21:36:09.043442719Z INFO: Finished downloading kube-apiserver/termination.log from master-0 2026-03-12T21:36:09.089178579Z Gathering data for ns/default... 2026-03-12T21:36:09.109065361Z Getting information from pod "etcd-master-0", container "etcdctl" 2026-03-12T21:36:09.109065361Z Using endpoints: https://192.168.32.10:2379 2026-03-12T21:36:09.124945166Z INFO: Starting getting etcd information 2026-03-12T21:36:09.124945166Z INFO: Getting etcdctl member list 2026-03-12T21:36:09.125192711Z INFO: Getting etcdctl endpoint status 2026-03-12T21:36:09.125381967Z INFO: Getting etcdctl endpoint health 2026-03-12T21:36:09.125550101Z INFO: Getting etcdctl alarm list 2026-03-12T21:36:09.125741295Z INFO: Getting object count 2026-03-12T21:36:09.127043037Z INFO: Waiting for etcd info collection to complete ... 2026-03-12T21:36:09.216596149Z INFO: Worker host service log collection to complete. 2026-03-12T21:36:09.494300193Z INFO: Waiting for HAProxy config collection to complete ... 2026-03-12T21:36:09.556450489Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-03-12T21:36:09.625000812Z No resources found 2026-03-12T21:36:09.843012509Z Wrote inspect data to must-gather. 2026-03-12T21:36:10.109420149Z Gathering data for ns/metallb-system... 2026-03-12T21:36:10.175230785Z Wrote inspect data to must-gather. 2026-03-12T21:36:10.397518656Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-03-12T21:36:10.453935504Z Wrote inspect data to must-gather. 2026-03-12T21:36:10.456215289Z receiving incremental file list 2026-03-12T21:36:10.462069901Z Wrote inspect data to must-gather. 2026-03-12T21:36:10.494102038Z insights-operator/ 2026-03-12T21:36:10.494102038Z insights-operator/insights-2026-03-12-205729.tar.gz 2026-03-12T21:36:10.503011885Z Wrote inspect data to must-gather. 2026-03-12T21:36:10.518583292Z 2026-03-12T21:36:10.518583292Z sent 47 bytes received 173,026 bytes 115,382.00 bytes/sec 2026-03-12T21:36:10.518583292Z total size is 172,828 speedup is 1.00 2026-03-12T21:36:10.524598788Z Gathering data for ns/openshift-nmstate... 2026-03-12T21:36:10.707014291Z tar: Removing leading `/' from member names 2026-03-12T21:36:10.732718305Z INFO: HAProxy config collection complete. 2026-03-12T21:36:10.837414183Z INFO: Done collecting etcd information 2026-03-12T21:36:11.012733886Z Wrote inspect data to must-gather. 2026-03-12T21:36:11.194058082Z Wrote inspect data to must-gather. 2026-03-12T21:36:11.231949331Z Gathering data for ns/openshift... 2026-03-12T21:36:11.358000298Z INFO: Collecting /debug/api_priority_and_fairness endpoint from kube-apiserver-master-0 2026-03-12T21:36:11.390140197Z INFO: Getting rules from prometheus-k8s-0 2026-03-12T21:36:11.502215225Z Gathering data for ns/openshift-config... 2026-03-12T21:36:11.633021408Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-03-12T21:36:11.865633789Z Wrote inspect data to must-gather. 2026-03-12T21:36:12.016061356Z Wrote inspect data to must-gather. 2026-03-12T21:36:12.243969603Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-03-12T21:36:12.409262101Z Wrote inspect data to must-gather. 2026-03-12T21:36:12.513531419Z Wrote inspect data to must-gather. 2026-03-12T21:36:12.580246888Z INFO: Getting status/config from prometheus-k8s-0 2026-03-12T21:36:12.688663427Z Gathering data for ns/kube-system... 2026-03-12T21:36:12.798694025Z INFO: INTERCONNECT MODE 2026-03-12T21:36:12.798694025Z INFO: Gathering ovn-kubernetes DBs 2026-03-12T21:36:12.800048898Z Gathering data for ns/openshift-config-managed... 2026-03-12T21:36:12.868837866Z Wrote inspect data to must-gather. 2026-03-12T21:36:13.020331039Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-03-12T21:36:13.078435519Z Wrote inspect data to must-gather. 2026-03-12T21:36:13.160599382Z INFO: Gathering OVN_Northbound from ovnkube-node-nhrpd... 2026-03-12T21:36:13.160599382Z INFO: Gathering OVN_Southbound from ovnkube-node-nhrpd... 2026-03-12T21:36:13.543015205Z tar: Removing leading `/' from member names 2026-03-12T21:36:13.652065790Z volume usage percentage 0 2026-03-12T21:36:13.662499563Z Wrote inspect data to must-gather. 2026-03-12T21:36:13.748673603Z INFO: Getting status/flags from prometheus-k8s-0 2026-03-12T21:36:13.789437881Z tar: Removing leading `/' from member names 2026-03-12T21:36:13.858212369Z INFO: Waiting for network log collection to complete ... 2026-03-12T21:36:13.858212369Z INFO: Waiting for ovnk database copies to complete ... 2026-03-12T21:36:13.858536267Z INFO: Copying ovnk databases complete. 2026-03-12T21:36:13.872585667Z 4.3M must-gather/network_logs/ovnk_database_store 2026-03-12T21:36:13.875396305Z ovnk_database_store/ 2026-03-12T21:36:13.875396305Z ovnk_database_store/ovnkube-node-nhrpd_nbdb 2026-03-12T21:36:13.909104353Z Wrote inspect data to must-gather. 2026-03-12T21:36:13.921888113Z ovnk_database_store/ovnkube-node-nhrpd_sbdb 2026-03-12T21:36:13.961537565Z Gathering data for ns/openshift-etcd... 2026-03-12T21:36:14.044285201Z INFO: Network log collection complete. 2026-03-12T21:36:14.139854419Z Wrote inspect data to must-gather. 2026-03-12T21:36:14.214514749Z Wrote inspect data to must-gather. 2026-03-12T21:36:14.227534235Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-03-12T21:36:14.432342602Z Gathering data for ns/openshift-authentication... 2026-03-12T21:36:14.444826414Z Wrote inspect data to must-gather. 2026-03-12T21:36:14.639339471Z Wrote inspect data to must-gather. 2026-03-12T21:36:14.713831398Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-03-12T21:36:14.799693430Z Wrote inspect data to must-gather. 2026-03-12T21:36:15.055489433Z Wrote inspect data to must-gather. 2026-03-12T21:36:15.120467908Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-03-12T21:36:15.196668307Z Wrote inspect data to must-gather. 2026-03-12T21:36:15.453845673Z Gathering data for ns/assisted-installer... 2026-03-12T21:36:15.631127032Z Gathering data for ns/openshift-authentication-operator... 2026-03-12T21:36:15.637026145Z Wrote inspect data to must-gather. 2026-03-12T21:36:15.707946115Z Wrote inspect data to must-gather. 2026-03-12T21:36:15.753589282Z INFO: Getting status from alertmanager-main-0 2026-03-12T21:36:16.208884473Z Wrote inspect data to must-gather. 2026-03-12T21:36:16.234682439Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f34dc492c80a3dee4643cc2291044750ac51e6e919b973de8723fa8b70bde70 2026-03-12T21:36:16.382741829Z W0312 21:36:16.382672 8 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' 2026-03-12T21:36:16.411654861Z daemonset.apps/perf-node-gather-daemonset created 2026-03-12T21:36:16.466742776Z Wrote inspect data to must-gather. 2026-03-12T21:36:16.648582036Z Waiting for performance profile collector pods to become ready: 1 2026-03-12T21:36:16.669657787Z Gathering data for ns/openshift-ingress... 2026-03-12T21:36:16.688199387Z Wrote inspect data to must-gather. 2026-03-12T21:36:17.259536031Z Wrote inspect data to must-gather. 2026-03-12T21:36:17.601784902Z Gathering data for ns/openshift-oauth-apiserver... 2026-03-12T21:36:17.669122484Z Wrote inspect data to must-gather. 2026-03-12T21:36:17.804799555Z Wrote inspect data to must-gather. 2026-03-12T21:36:17.973129197Z Waiting for performance profile collector pods to become ready: 2 2026-03-12T21:36:18.461196012Z Wrote inspect data to must-gather. 2026-03-12T21:36:18.615867363Z Gathering data for ns/openshift-machine-api... 2026-03-12T21:36:18.682761156Z volume usage percentage 0 2026-03-12T21:36:19.248959266Z Waiting for performance profile collector pods to become ready: 3 2026-03-12T21:36:19.295855082Z /usr/bin/gather_metallb: line 53: must-gather/namespaces/metallb-system/pods/speaker-94r48/reloader/reloader/logs/reloader.pid: No such file or directory 2026-03-12T21:36:19.295855082Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-94r48/frr/frr/logs/frr.conf: No such file or directory 2026-03-12T21:36:19.295855082Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-94r48/frr/frr/logs/frr.log: No such file or directory 2026-03-12T21:36:19.295855082Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-94r48/frr/frr/logs/daemons: No such file or directory 2026-03-12T21:36:19.296508709Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-94r48/frr/frr/logs/vtysh.conf: No such file or directory 2026-03-12T21:36:19.296508709Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-94r48/frr/frr/logs/dump_frr: No such file or directory 2026-03-12T21:36:19.474401693Z Error from server (BadRequest): container frr is not valid for pod speaker-94r48 2026-03-12T21:36:19.483023192Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-94r48/frr/frr/logs/dump_frr: No such file or directory 2026-03-12T21:36:19.483023192Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-94r48/frr/frr/logs/dump_frr: No such file or directory 2026-03-12T21:36:19.688257739Z Error from server (BadRequest): container frr is not valid for pod speaker-94r48 2026-03-12T21:36:19.694074120Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-94r48/frr/frr/logs/dump_frr: No such file or directory 2026-03-12T21:36:19.694122141Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-94r48/frr/frr/logs/dump_frr: No such file or directory 2026-03-12T21:36:19.901364077Z Error from server (BadRequest): container frr is not valid for pod speaker-94r48 2026-03-12T21:36:19.924452696Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-94r48/frr/frr/logs/dump_frr: No such file or directory 2026-03-12T21:36:19.924452696Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-94r48/frr/frr/logs/dump_frr: No such file or directory 2026-03-12T21:36:20.060841744Z Gathering data for ns/openshift-cloud-controller-manager-operator... 2026-03-12T21:36:20.114888784Z Error from server (BadRequest): container frr is not valid for pod speaker-94r48 2026-03-12T21:36:20.128882234Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-94r48/frr/frr/logs/dump_frr: No such file or directory 2026-03-12T21:36:20.128882234Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-94r48/frr/frr/logs/dump_frr: No such file or directory 2026-03-12T21:36:20.411886067Z Error from server (BadRequest): container frr is not valid for pod speaker-94r48 2026-03-12T21:36:20.439891936Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-94r48/frr/frr/logs/dump_frr: No such file or directory 2026-03-12T21:36:20.682873558Z Waiting for performance profile collector pods to become ready: 4 2026-03-12T21:36:21.248292250Z Gathering data for ns/openshift-cloud-controller-manager... 2026-03-12T21:36:22.000394279Z Waiting for performance profile collector pods to become ready: 5 2026-03-12T21:36:22.716865793Z Gathering data for ns/openshift-cloud-credential-operator... 2026-03-12T21:36:23.299970433Z Waiting for performance profile collector pods to become ready: 6 2026-03-12T21:36:23.716764821Z volume usage percentage 0 2026-03-12T21:36:24.571427566Z Waiting for performance profile collector pods to become ready: 7 2026-03-12T21:36:24.797434138Z Gathering data for ns/openshift-config-operator... 2026-03-12T21:36:25.899464342Z Waiting for performance profile collector pods to become ready: 8 2026-03-12T21:36:26.010740730Z Gathering data for ns/openshift-console-operator... 2026-03-12T21:36:26.890335931Z Gathering data for ns/openshift-console... 2026-03-12T21:36:27.210602917Z Daemonset perf-node-gather-daemonset ready 1 out of 1 2026-03-12T21:36:27.772035792Z Collecting performance related data for node master-0 2026-03-12T21:36:28.202749207Z Gathering data for ns/openshift-cluster-storage-operator... 2026-03-12T21:36:28.773675843Z volume usage percentage 0 2026-03-12T21:36:29.570053234Z Gathering data for ns/openshift-dns-operator... 2026-03-12T21:36:30.827624482Z Gathering data for ns/openshift-dns... 2026-03-12T21:36:32.100079808Z Gathering data for ns/openshift-etcd-operator... 2026-03-12T21:36:33.065431508Z Gathering data for ns/openshift-etcd... 2026-03-12T21:36:33.829026616Z volume usage percentage 0 2026-03-12T21:36:34.331994254Z Gathering data for ns/openshift-image-registry... 2026-03-12T21:36:35.594469218Z Gathering data for ns/openshift-ingress-operator... 2026-03-12T21:36:36.540223013Z Gathering data for ns/openshift-ingress-canary... 2026-03-12T21:36:37.273356511Z Gathering data for ns/openshift-insights... 2026-03-12T21:36:38.875593917Z volume usage percentage 0 2026-03-12T21:36:39.366620133Z Gathering data for ns/openshift-monitoring... 2026-03-12T21:36:41.795855273Z Gathering data for ns/metallb-system... 2026-03-12T21:36:43.981076015Z volume usage percentage 0 2026-03-12T21:36:46.361870430Z Collecting kubelet logs for node master-0 2026-03-12T21:36:46.654192109Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-03-12T21:36:47.557407642Z daemonset.apps "perf-node-gather-daemonset" deleted 2026-03-12T21:36:47.581084046Z INFO: Node performance data collection complete. 2026-03-12T21:36:48.735305667Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-03-12T21:36:49.038598361Z volume usage percentage 0 2026-03-12T21:36:49.979894507Z Gathering data for ns/openshift-kube-apiserver... 2026-03-12T21:36:51.853591146Z Gathering data for ns/openshift-catalogd... 2026-03-12T21:36:52.576469475Z Gathering data for ns/cert-manager... 2026-03-12T21:36:53.315239861Z Gathering data for ns/openstack-operators... 2026-03-12T21:36:54.084262910Z volume usage percentage 0 2026-03-12T21:36:59.147405622Z volume usage percentage 0 2026-03-12T21:37:00.517533539Z Gathering data for ns/openshift-nmstate... 2026-03-12T21:37:01.448353650Z Gathering data for ns/openshift-operators... 2026-03-12T21:37:02.185221050Z Gathering data for ns/openshift-multus... 2026-03-12T21:37:03.443457922Z Gathering data for ns/openshift-storage... 2026-03-12T21:37:04.222889884Z volume usage percentage 0 2026-03-12T21:37:04.518020701Z Gathering data for ns/openshift-kube-controller-manager... 2026-03-12T21:37:05.710929520Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-03-12T21:37:06.390105910Z Gathering data for ns/kube-system... 2026-03-12T21:37:07.208491975Z Gathering data for ns/openshift-kube-scheduler... 2026-03-12T21:37:08.003987317Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-03-12T21:37:08.752222202Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-03-12T21:37:09.315559782Z volume usage percentage 0 2026-03-12T21:37:09.480557784Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-03-12T21:37:10.518212277Z Gathering data for ns/openshift-cluster-machine-approver... 2026-03-12T21:37:11.137036764Z Gathering data for ns/openshift-machine-config-operator... 2026-03-12T21:37:12.415974829Z Gathering data for ns/openshift-kni-infra... 2026-03-12T21:37:12.983785748Z Gathering data for ns/openshift-openstack-infra... 2026-03-12T21:37:13.541451351Z Gathering data for ns/openshift-ovirt-infra... 2026-03-12T21:37:14.058670324Z Gathering data for ns/openshift-vsphere-infra... 2026-03-12T21:37:14.374501363Z volume usage percentage 0 2026-03-12T21:37:14.647262737Z Gathering data for ns/openshift-nutanix-infra... 2026-03-12T21:37:15.155421281Z Gathering data for ns/openshift-cloud-platform-infra... 2026-03-12T21:37:15.791083894Z Gathering data for ns/openshift-marketplace... 2026-03-12T21:37:18.539369521Z Gathering data for ns/openshift-user-workload-monitoring... 2026-03-12T21:37:19.455867356Z volume usage percentage 0 2026-03-12T21:37:20.194927228Z Gathering data for ns/openshift-ovn-kubernetes... 2026-03-12T21:37:22.674640302Z Gathering data for ns/openshift-host-network... 2026-03-12T21:37:23.483445915Z Gathering data for ns/openshift-network-diagnostics... 2026-03-12T21:37:24.453738845Z Gathering data for ns/openshift-network-node-identity... 2026-03-12T21:37:24.553362901Z volume usage percentage 0 2026-03-12T21:37:25.305304396Z Gathering data for ns/openshift-network-console... 2026-03-12T21:37:25.871378344Z Gathering data for ns/openshift-network-operator... 2026-03-12T21:37:26.721730995Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-03-12T21:37:27.838075846Z Gathering data for ns/openshift-operator-controller... 2026-03-12T21:37:29.321537281Z Gathering data for ns/openshift-cluster-olm-operator... 2026-03-12T21:37:29.621360061Z volume usage percentage 0 2026-03-12T21:37:30.051023691Z Gathering data for ns/openshift-apiserver-operator... 2026-03-12T21:37:30.678039596Z Gathering data for ns/openshift-apiserver... 2026-03-12T21:37:31.906959277Z Gathering data for ns/openshift-controller-manager-operator... 2026-03-12T21:37:32.718337844Z Gathering data for ns/openshift-controller-manager... 2026-03-12T21:37:33.485326224Z Gathering data for ns/openshift-route-controller-manager... 2026-03-12T21:37:34.326960824Z Gathering data for ns/openshift-cluster-samples-operator... 2026-03-12T21:37:34.683200822Z volume usage percentage 0 2026-03-12T21:37:35.664010837Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-03-12T21:37:36.908053065Z Gathering data for ns/openshift-service-ca-operator... 2026-03-12T21:37:37.642072075Z Gathering data for ns/openshift-service-ca... 2026-03-12T21:37:38.415599224Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-03-12T21:37:39.870868824Z volume usage percentage 0 2026-03-12T21:37:40.634671167Z Wrote inspect data to must-gather. 2026-03-12T21:37:40.635434855Z error: inspection completed with the errors occurred while gathering data: 2026-03-12T21:37:40.635434855Z [skipping gathering clusterroles.rbac.authorization.k8s.io/system:registry due to error: clusterroles.rbac.authorization.k8s.io "system:registry" not found, skipping gathering clusterrolebindings.rbac.authorization.k8s.io/registry-registry-role due to error: clusterrolebindings.rbac.authorization.k8s.io "registry-registry-role" not found, skipping gathering secrets/support due to error: secrets "support" not found, skipping gathering endpoints/host-etcd-2 due to error: endpoints "host-etcd-2" not found] 2026-03-12T21:37:40.917915515Z error: the server doesn't have a resource type "clusters"