2026-03-19T09:50:34.584478896Z volume percentage checker started..... 2026-03-19T09:50:34.604255897Z volume usage percentage 0 2026-03-19T09:50:34.844985876Z Gathering data for ns/openshift-cluster-version... 2026-03-19T09:50:37.507138786Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-03-19T09:50:38.578130070Z INFO: Gathering HAProxy config files 2026-03-19T09:50:38.580701503Z Waiting on subprocesses to finish execution. 2026-03-19T09:50:38.587514079Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-03-19T09:50:38.597223584Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-03-19T09:50:38.611586353Z INFO: Collecting host service logs for crio 2026-03-19T09:50:38.612182207Z INFO: Collecting host service logs for kubelet 2026-03-19T09:50:38.612662870Z INFO: Collecting host service logs for rpm-ostreed 2026-03-19T09:50:38.614472754Z INFO: Collecting host service logs for ostree-finalize-staged 2026-03-19T09:50:38.617560408Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-03-19T09:50:38.618136142Z INFO: Collecting host service logs for machine-config-daemon-host 2026-03-19T09:50:38.620961241Z INFO: Collecting host service logs for NetworkManager 2026-03-19T09:50:38.621455893Z INFO: Collecting host service logs for openvswitch 2026-03-19T09:50:38.622311403Z INFO: Collecting host service logs for ovs-configuration 2026-03-19T09:50:38.622949619Z INFO: Collecting host service logs for ovsdb-server 2026-03-19T09:50:38.624443056Z INFO: Collecting host service logs for ovs-vswitchd 2026-03-19T09:50:38.625298947Z INFO: Waiting for worker host service log collection to complete ... 2026-03-19T09:50:38.739090142Z INFO: Waiting for node performance related collection to complete ... 2026-03-19T09:50:38.817270782Z Gathering data for ns/default... 2026-03-19T09:50:38.952622890Z INFO: "sriov-network-operator" not detected. Skipping. 2026-03-19T09:50:39.077472334Z INFO: Found 1 replicas - prometheus-k8s-0 2026-03-19T09:50:39.211654634Z INFO: Collecting Insights Archives from insights-operator-68bf6ff9d6-4qq6m 2026-03-19T09:50:39.392436867Z No resources found 2026-03-19T09:50:39.444505513Z INFO: Started downloading kube-apiserver/termination.log from master-0 2026-03-19T09:50:39.520568811Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-03-19T09:50:39.575297791Z W0319 09:50:39.575061 626 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' 2026-03-19T09:50:39.597737186Z Wrote inspect data to must-gather. 2026-03-19T09:50:39.616868572Z volume usage percentage 0 2026-03-19T09:50:39.717893086Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-03-19T09:50:39.717893086Z INFO: on-disk MachineConfig config collection complete. 2026-03-19T09:50:39.773886357Z Gathering data for ns/metallb-system... 2026-03-19T09:50:39.965151104Z Gathering data for ns/openshift-nmstate... 2026-03-19T09:50:40.057879848Z INFO: Finished downloading kube-apiserver/termination.log from master-0 2026-03-19T09:50:40.077754531Z Wrote inspect data to must-gather. 2026-03-19T09:50:40.155483839Z Getting information from pod "etcd-master-0", container "etcdctl" 2026-03-19T09:50:40.155483839Z Using endpoints: https://192.168.32.10:2379 2026-03-19T09:50:40.159221360Z INFO: Starting getting etcd information 2026-03-19T09:50:40.159237811Z INFO: Getting etcdctl member list 2026-03-19T09:50:40.159551798Z INFO: Getting etcdctl endpoint status 2026-03-19T09:50:40.159797844Z INFO: Getting etcdctl endpoint health 2026-03-19T09:50:40.159961649Z INFO: Getting etcdctl alarm list 2026-03-19T09:50:40.160127943Z INFO: Getting object count 2026-03-19T09:50:40.161596178Z INFO: Waiting for etcd info collection to complete ... 2026-03-19T09:50:40.294550789Z INFO: Waiting for HAProxy config collection to complete ... 2026-03-19T09:50:40.382090076Z Gathering data for ns/openshift... 2026-03-19T09:50:40.449623087Z No resources found 2026-03-19T09:50:40.511833299Z INFO: Worker host service log collection to complete. 2026-03-19T09:50:40.551914173Z Wrote inspect data to must-gather. 2026-03-19T09:50:40.661228270Z receiving incremental file list 2026-03-19T09:50:40.684869914Z insights-operator/ 2026-03-19T09:50:40.690430588Z insights-operator/insights-2026-03-19-092543.tar.gz 2026-03-19T09:50:40.710711302Z 2026-03-19T09:50:40.710768143Z sent 47 bytes received 250,317 bytes 166,909.33 bytes/sec 2026-03-19T09:50:40.710787913Z total size is 250,103 speedup is 1.00 2026-03-19T09:50:40.738133258Z Wrote inspect data to must-gather. 2026-03-19T09:50:40.754791022Z Wrote inspect data to must-gather. 2026-03-19T09:50:40.811498741Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-03-19T09:50:40.827000027Z Wrote inspect data to must-gather. 2026-03-19T09:50:40.835883813Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-03-19T09:50:40.854098145Z INFO: Getting rules from prometheus-k8s-0 2026-03-19T09:50:40.926200628Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-03-19T09:50:41.244846670Z Wrote inspect data to must-gather. 2026-03-19T09:50:41.255408538Z tar: Removing leading `/' from member names 2026-03-19T09:50:41.268756612Z INFO: HAProxy config collection complete. 2026-03-19T09:50:41.398982927Z Wrote inspect data to must-gather. 2026-03-19T09:50:41.408923168Z INFO: Collecting /debug/api_priority_and_fairness endpoint from kube-apiserver-master-0 2026-03-19T09:50:41.414442553Z INFO: Done collecting etcd information 2026-03-19T09:50:41.475629569Z Gathering data for ns/openshift-config... 2026-03-19T09:50:41.515729353Z Wrote inspect data to must-gather. 2026-03-19T09:50:41.611279605Z INFO: Getting status/config from prometheus-k8s-0 2026-03-19T09:50:41.630911652Z Wrote inspect data to must-gather. 2026-03-19T09:50:41.713862487Z Wrote inspect data to must-gather. 2026-03-19T09:50:41.727391067Z Gathering data for ns/kube-system... 2026-03-19T09:50:41.765332008Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-03-19T09:50:41.927836327Z Wrote inspect data to must-gather. 2026-03-19T09:50:42.139675365Z Wrote inspect data to must-gather. 2026-03-19T09:50:42.209648976Z Gathering data for ns/openshift-config-managed... 2026-03-19T09:50:42.211471400Z Wrote inspect data to must-gather. 2026-03-19T09:50:42.371643212Z Wrote inspect data to must-gather. 2026-03-19T09:50:42.372416641Z INFO: Getting status/flags from prometheus-k8s-0 2026-03-19T09:50:42.606296254Z Gathering data for ns/openshift-etcd... 2026-03-19T09:50:42.616863380Z INFO: INTERCONNECT MODE 2026-03-19T09:50:42.616863380Z INFO: Gathering ovn-kubernetes DBs 2026-03-19T09:50:42.752602289Z Wrote inspect data to must-gather. 2026-03-19T09:50:42.781463680Z Wrote inspect data to must-gather. 2026-03-19T09:50:42.963483474Z INFO: Gathering OVN_Northbound from ovnkube-node-vcxjs... 2026-03-19T09:50:42.963944714Z INFO: Gathering OVN_Southbound from ovnkube-node-vcxjs... 2026-03-19T09:50:42.980093797Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-03-19T09:50:42.982009864Z Wrote inspect data to must-gather. 2026-03-19T09:50:43.254309381Z Wrote inspect data to must-gather. 2026-03-19T09:50:43.266215330Z Wrote inspect data to must-gather. 2026-03-19T09:50:43.298399352Z tar: Removing leading `/' from member names 2026-03-19T09:50:43.346052480Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-03-19T09:50:43.361573627Z Gathering data for ns/openshift-authentication... 2026-03-19T09:50:43.428020062Z tar: Removing leading `/' from member names 2026-03-19T09:50:43.641319245Z Wrote inspect data to must-gather. 2026-03-19T09:50:43.648786126Z INFO: Waiting for network log collection to complete ... 2026-03-19T09:50:43.648786126Z INFO: Waiting for ovnk database copies to complete ... 2026-03-19T09:50:43.649362330Z INFO: Copying ovnk databases complete. 2026-03-19T09:50:43.651440170Z 2.0M must-gather/network_logs/ovnk_database_store 2026-03-19T09:50:43.654335651Z ovnk_database_store/ 2026-03-19T09:50:43.654399352Z ovnk_database_store/ovnkube-node-vcxjs_sbdb 2026-03-19T09:50:43.698130906Z ovnk_database_store/ovnkube-node-vcxjs_nbdb 2026-03-19T09:50:43.715244461Z INFO: Network log collection complete. 2026-03-19T09:50:43.737199155Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-03-19T09:50:43.871641562Z Wrote inspect data to must-gather. 2026-03-19T09:50:43.950180390Z Gathering data for ns/assisted-installer... 2026-03-19T09:50:44.083243774Z Wrote inspect data to must-gather. 2026-03-19T09:50:44.187588579Z Gathering data for ns/openshift-authentication-operator... 2026-03-19T09:50:44.296610808Z INFO: Getting status from alertmanager-main-0 2026-03-19T09:50:44.425601503Z Wrote inspect data to must-gather. 2026-03-19T09:50:44.672470692Z volume usage percentage 0 2026-03-19T09:50:44.709453260Z Wrote inspect data to must-gather. 2026-03-19T09:50:45.491797831Z Wrote inspect data to must-gather. 2026-03-19T09:50:45.550358185Z Wrote inspect data to must-gather. 2026-03-19T09:50:45.570913893Z W0319 09:50:45.570843 1887 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' 2026-03-19T09:50:45.585646072Z Wrote inspect data to must-gather. 2026-03-19T09:50:45.629096828Z Wrote inspect data to must-gather. 2026-03-19T09:50:45.784268158Z Gathering data for ns/openshift-ingress... 2026-03-19T09:50:45.953197173Z Wrote inspect data to must-gather. 2026-03-19T09:50:46.134338425Z Wrote inspect data to must-gather. 2026-03-19T09:50:46.439977292Z Gathering data for ns/openshift-oauth-apiserver... 2026-03-19T09:50:46.461303370Z Wrote inspect data to must-gather. 2026-03-19T09:50:46.648578061Z Wrote inspect data to must-gather. 2026-03-19T09:50:47.062555690Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:aa5e782406f71c048b1ac3a4bf5d1227ff4be81111114083ad4c7a209c6bfb5a 2026-03-19T09:50:47.171170709Z Gathering data for ns/openshift-machine-api... 2026-03-19T09:50:47.222277792Z daemonset.apps/perf-node-gather-daemonset created 2026-03-19T09:50:47.319625757Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-dvddw/frr/frr/logs/frr.conf: No such file or directory 2026-03-19T09:50:47.322469056Z /usr/bin/gather_metallb: line 53: must-gather/namespaces/metallb-system/pods/speaker-dvddw/reloader/reloader/logs/reloader.pid: No such file or directory 2026-03-19T09:50:47.325588161Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-dvddw/frr/frr/logs/frr.log: No such file or directory 2026-03-19T09:50:47.332092160Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-dvddw/frr/frr/logs/daemons: No such file or directory 2026-03-19T09:50:47.332391037Z /usr/bin/gather_metallb: line 23: must-gather/namespaces/metallb-system/pods/speaker-dvddw/frr/frr/logs/vtysh.conf: No such file or directory 2026-03-19T09:50:47.335675527Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-dvddw/frr/frr/logs/dump_frr: No such file or directory 2026-03-19T09:50:47.479376049Z Waiting for performance profile collector pods to become ready: 1 2026-03-19T09:50:47.590557241Z Error from server (BadRequest): container frr is not valid for pod speaker-dvddw 2026-03-19T09:50:47.597611702Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-dvddw/frr/frr/logs/dump_frr: No such file or directory 2026-03-19T09:50:47.597611702Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-dvddw/frr/frr/logs/dump_frr: No such file or directory 2026-03-19T09:50:47.844908021Z Error from server (BadRequest): container frr is not valid for pod speaker-dvddw 2026-03-19T09:50:47.867642864Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-dvddw/frr/frr/logs/dump_frr: No such file or directory 2026-03-19T09:50:47.867642864Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-dvddw/frr/frr/logs/dump_frr: No such file or directory 2026-03-19T09:50:48.079884871Z Error from server (BadRequest): container frr is not valid for pod speaker-dvddw 2026-03-19T09:50:48.096011913Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-dvddw/frr/frr/logs/dump_frr: No such file or directory 2026-03-19T09:50:48.096011913Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-dvddw/frr/frr/logs/dump_frr: No such file or directory 2026-03-19T09:50:48.332956851Z Error from server (BadRequest): container frr is not valid for pod speaker-dvddw 2026-03-19T09:50:48.356318319Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-dvddw/frr/frr/logs/dump_frr: No such file or directory 2026-03-19T09:50:48.356318319Z /usr/bin/gather_metallb: line 27: must-gather/namespaces/metallb-system/pods/speaker-dvddw/frr/frr/logs/dump_frr: No such file or directory 2026-03-19T09:50:48.530904350Z Gathering data for ns/openshift-cloud-controller-manager-operator... 2026-03-19T09:50:48.608688751Z Error from server (BadRequest): container frr is not valid for pod speaker-dvddw 2026-03-19T09:50:48.622979848Z /usr/bin/gather_metallb: line 28: must-gather/namespaces/metallb-system/pods/speaker-dvddw/frr/frr/logs/dump_frr: No such file or directory 2026-03-19T09:50:48.921085232Z Waiting for performance profile collector pods to become ready: 2 2026-03-19T09:50:49.425782066Z Gathering data for ns/openshift-cloud-controller-manager... 2026-03-19T09:50:49.702597243Z volume usage percentage 0 2026-03-19T09:50:50.032601902Z Gathering data for ns/openshift-cloud-credential-operator... 2026-03-19T09:50:50.112839001Z Waiting for performance profile collector pods to become ready: 3 2026-03-19T09:50:51.306910407Z Gathering data for ns/openshift-config-operator... 2026-03-19T09:50:51.314128602Z Waiting for performance profile collector pods to become ready: 4 2026-03-19T09:50:51.995721495Z Gathering data for ns/openshift-console-operator... 2026-03-19T09:50:52.511778965Z Waiting for performance profile collector pods to become ready: 5 2026-03-19T09:50:52.640547184Z Gathering data for ns/openshift-console... 2026-03-19T09:50:53.431896834Z Gathering data for ns/openshift-cluster-storage-operator... 2026-03-19T09:50:53.742950743Z Waiting for performance profile collector pods to become ready: 6 2026-03-19T09:50:54.025314043Z Gathering data for ns/openshift-dns-operator... 2026-03-19T09:50:54.500823159Z Gathering data for ns/openshift-dns... 2026-03-19T09:50:54.737681954Z volume usage percentage 0 2026-03-19T09:50:55.037660733Z Waiting for performance profile collector pods to become ready: 7 2026-03-19T09:50:55.237406797Z Gathering data for ns/openshift-etcd-operator... 2026-03-19T09:50:55.715622838Z Gathering data for ns/openshift-etcd... 2026-03-19T09:50:56.241942658Z Waiting for performance profile collector pods to become ready: 8 2026-03-19T09:50:56.691541613Z Gathering data for ns/openshift-image-registry... 2026-03-19T09:50:57.187050254Z Gathering data for ns/openshift-ingress-operator... 2026-03-19T09:50:57.402331404Z Waiting for performance profile collector pods to become ready: 9 2026-03-19T09:50:57.976155618Z Gathering data for ns/openshift-ingress-canary... 2026-03-19T09:50:58.522061394Z Gathering data for ns/openshift-insights... 2026-03-19T09:50:58.639633261Z Daemonset perf-node-gather-daemonset ready 1 out of 1 2026-03-19T09:50:58.991979733Z Collecting performance related data for node master-0 2026-03-19T09:50:59.764092965Z volume usage percentage 0 2026-03-19T09:51:00.071365022Z Gathering data for ns/openshift-monitoring... 2026-03-19T09:51:02.193932500Z Gathering data for ns/metallb-system... 2026-03-19T09:51:03.809233751Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-03-19T09:51:04.501007321Z Gathering data for ns/openshift-operators... 2026-03-19T09:51:04.798910150Z volume usage percentage 0 2026-03-19T09:51:05.950701889Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-03-19T09:51:06.844643301Z Gathering data for ns/openshift-kube-apiserver... 2026-03-19T09:51:07.974069536Z Gathering data for ns/openshift-catalogd... 2026-03-19T09:51:08.581252570Z Gathering data for ns/cert-manager... 2026-03-19T09:51:09.085653737Z Gathering data for ns/openshift-nmstate... 2026-03-19T09:51:09.835514778Z Gathering data for ns/openshift-multus... 2026-03-19T09:51:09.838019609Z volume usage percentage 0 2026-03-19T09:51:10.621583080Z Gathering data for ns/openshift-storage... 2026-03-19T09:51:11.175953851Z Gathering data for ns/openshift-kube-controller-manager... 2026-03-19T09:51:12.199324809Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-03-19T09:51:12.914119508Z Gathering data for ns/kube-system... 2026-03-19T09:51:13.996299935Z Gathering data for ns/openshift-kube-scheduler... 2026-03-19T09:51:14.664207615Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-03-19T09:51:14.836291227Z Collecting kubelet logs for node master-0 2026-03-19T09:51:14.879570198Z volume usage percentage 0 2026-03-19T09:51:15.322155573Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-03-19T09:51:15.461679264Z daemonset.apps "perf-node-gather-daemonset" deleted 2026-03-19T09:51:15.471494292Z INFO: Node performance data collection complete. 2026-03-19T09:51:15.864187014Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-03-19T09:51:16.495035914Z Gathering data for ns/openshift-cluster-machine-approver... 2026-03-19T09:51:17.005384925Z Gathering data for ns/openshift-machine-config-operator... 2026-03-19T09:51:17.973972040Z Gathering data for ns/openshift-kni-infra... 2026-03-19T09:51:18.372555366Z Gathering data for ns/openshift-openstack-infra... 2026-03-19T09:51:18.829746675Z Gathering data for ns/openshift-ovirt-infra... 2026-03-19T09:51:19.387925929Z Gathering data for ns/openshift-vsphere-infra... 2026-03-19T09:51:19.828176796Z Gathering data for ns/openshift-nutanix-infra... 2026-03-19T09:51:19.959572179Z volume usage percentage 0 2026-03-19T09:51:20.232018610Z Gathering data for ns/openshift-cloud-platform-infra... 2026-03-19T09:51:20.602980444Z Gathering data for ns/openshift-marketplace... 2026-03-19T09:51:23.060201644Z Gathering data for ns/openshift-user-workload-monitoring... 2026-03-19T09:51:24.285168320Z Gathering data for ns/openshift-ovn-kubernetes... 2026-03-19T09:51:25.015065367Z volume usage percentage 0 2026-03-19T09:51:25.745668001Z Gathering data for ns/openshift-host-network... 2026-03-19T09:51:26.243027246Z Gathering data for ns/openshift-network-diagnostics... 2026-03-19T09:51:26.970133804Z Gathering data for ns/openshift-network-node-identity... 2026-03-19T09:51:27.543543029Z Gathering data for ns/openshift-network-console... 2026-03-19T09:51:27.970042372Z Gathering data for ns/openshift-network-operator... 2026-03-19T09:51:28.759999907Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-03-19T09:51:29.443627790Z Gathering data for ns/openshift-operator-controller... 2026-03-19T09:51:30.077809791Z volume usage percentage 0 2026-03-19T09:51:30.354324880Z Gathering data for ns/openshift-cluster-olm-operator... 2026-03-19T09:51:31.113206280Z Gathering data for ns/openshift-apiserver-operator... 2026-03-19T09:51:31.585114258Z Gathering data for ns/openshift-apiserver... 2026-03-19T09:51:32.533868232Z Gathering data for ns/openshift-controller-manager-operator... 2026-03-19T09:51:33.078579809Z Gathering data for ns/openshift-controller-manager... 2026-03-19T09:51:33.576617651Z Gathering data for ns/openshift-route-controller-manager... 2026-03-19T09:51:34.014587713Z Gathering data for ns/openshift-cluster-samples-operator... 2026-03-19T09:51:34.978703031Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-03-19T09:51:35.148641770Z volume usage percentage 0 2026-03-19T09:51:35.961050952Z Gathering data for ns/openshift-service-ca-operator... 2026-03-19T09:51:36.430559151Z Gathering data for ns/openshift-service-ca... 2026-03-19T09:51:36.889965094Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-03-19T09:51:38.526695337Z Wrote inspect data to must-gather. 2026-03-19T09:51:38.526760028Z error: inspection completed with the errors occurred while gathering data: 2026-03-19T09:51:38.526760028Z [skipping gathering clusterroles.rbac.authorization.k8s.io/system:registry due to error: clusterroles.rbac.authorization.k8s.io "system:registry" not found, skipping gathering clusterrolebindings.rbac.authorization.k8s.io/registry-registry-role due to error: clusterrolebindings.rbac.authorization.k8s.io "registry-registry-role" not found, skipping gathering secrets/support due to error: secrets "support" not found, skipping gathering endpoints/host-etcd-2 due to error: endpoints "host-etcd-2" not found] 2026-03-19T09:51:38.784265626Z error: the server doesn't have a resource type "clusters" 2026-03-19T09:51:40.201725689Z volume usage percentage 0