[must-gather ] OUT 2025-10-03T04:26:46.781448773Z Using must-gather plug-in image: quay.io/openstack-k8s-operators/openstack-must-gather:latest When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 1f554581-b381-451f-a07a-fe0586b6d650 ClientVersion: 4.18.1 ClusterVersion: Stable at "4.18.1" ClusterOperators: clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing [must-gather ] OUT 2025-10-03T04:26:46.842241391Z namespace/openshift-must-gather-2zdg5 created [must-gather ] OUT 2025-10-03T04:26:46.903720282Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-m6gvb created [must-gather ] OUT 2025-10-03T04:26:47.042404542Z pod for plug-in image quay.io/openstack-k8s-operators/openstack-must-gather:latest created [must-gather-nzscv] OUT 2025-10-03T04:29:11.394196963Z waiting for gather to complete [must-gather-nzscv] OUT 2025-10-03T04:29:11.403284404Z downloading gather output [must-gather-nzscv] OUT 2025-10-03T04:29:11.739060069Z receiving incremental file list [must-gather-nzscv] OUT 2025-10-03T04:29:11.757086778Z ./ [must-gather-nzscv] OUT 2025-10-03T04:29:11.757242083Z must-gather.tar.xz [must-gather-nzscv] OUT 2025-10-03T04:29:11.951853614Z packagemanifests [must-gather-nzscv] OUT 2025-10-03T04:29:13.015519575Z run.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.015656909Z version [must-gather-nzscv] OUT 2025-10-03T04:29:13.015743722Z crd/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.015752712Z csv/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.015757632Z ctlplane/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.015804053Z ctlplane/endpoints [must-gather-nzscv] OUT 2025-10-03T04:29:13.015917427Z ctlplane/services [must-gather-nzscv] OUT 2025-10-03T04:29:13.015973239Z ctlplane/ovn/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.015981649Z ctlplane/rabbitmq/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.01598697Z dbs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.01599214Z namespaces/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.0159984Z namespaces/openshift-machine-api/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.016049351Z namespaces/openshift-machine-api/all_resources.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.016203486Z namespaces/openshift-machine-api/events.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.016453403Z namespaces/openshift-machine-api/nad.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.016538696Z namespaces/openshift-machine-api/pvc.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.016580428Z namespaces/openshift-machine-api/buildconfig/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.016587358Z namespaces/openshift-machine-api/cert/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.016592288Z namespaces/openshift-machine-api/certificaterequests/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.016600318Z namespaces/openshift-machine-api/configmaps/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.016604939Z namespaces/openshift-machine-api/cronjobs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.016609699Z namespaces/openshift-machine-api/daemonset/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.016614449Z namespaces/openshift-machine-api/deployments/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.016681441Z namespaces/openshift-machine-api/deployments/control-plane-machine-set-operator.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.016872246Z namespaces/openshift-machine-api/deployments/machine-api-operator.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.01699529Z namespaces/openshift-machine-api/imagestream/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.017004411Z namespaces/openshift-machine-api/installplans/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.017009711Z namespaces/openshift-machine-api/issuer/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.017014571Z namespaces/openshift-machine-api/jobs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.017020041Z namespaces/openshift-machine-api/pods/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.017036412Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.017117464Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/control-plane-machine-set-operator-78cbb6b69f-hwgbz-describe [must-gather-nzscv] OUT 2025-10-03T04:29:13.017249949Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/logs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.01730994Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/logs/control-plane-machine-set-operator-previous.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.017469575Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/logs/control-plane-machine-set-operator.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.01759609Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.017661981Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/machine-api-operator-5694c8668f-w7rtg-describe [must-gather-nzscv] OUT 2025-10-03T04:29:13.017769115Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/logs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.017854927Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/logs/kube-rbac-proxy.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.018040993Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/logs/machine-api-operator.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.018153426Z namespaces/openshift-machine-api/replicaset/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.018216079Z namespaces/openshift-machine-api/replicaset/control-plane-machine-set-operator-78cbb6b69f.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.018328692Z namespaces/openshift-machine-api/replicaset/machine-api-operator-5694c8668f.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.018521758Z namespaces/openshift-machine-api/routes/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.018530628Z namespaces/openshift-machine-api/services/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.018577679Z namespaces/openshift-machine-api/services/cluster-autoscaler-operator.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.018731844Z namespaces/openshift-machine-api/services/control-plane-machine-set-operator.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.018869769Z namespaces/openshift-machine-api/services/machine-api-controllers.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.019115726Z namespaces/openshift-machine-api/services/machine-api-operator-machine-webhook.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.019221599Z namespaces/openshift-machine-api/services/machine-api-operator-webhook.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.019364564Z namespaces/openshift-machine-api/services/machine-api-operator.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.019439176Z namespaces/openshift-machine-api/statefulset/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.019447646Z namespaces/openshift-machine-api/subscriptions/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.019453086Z namespaces/openshift-marketplace/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.019494388Z namespaces/openshift-marketplace/all_resources.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.019618132Z namespaces/openshift-marketplace/events.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.02019756Z namespaces/openshift-marketplace/nad.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.020326004Z namespaces/openshift-marketplace/pvc.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.020361775Z namespaces/openshift-marketplace/buildconfig/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.020367705Z namespaces/openshift-marketplace/cert/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.020371766Z namespaces/openshift-marketplace/certificaterequests/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.020375906Z namespaces/openshift-marketplace/configmaps/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.020387705Z namespaces/openshift-marketplace/cronjobs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.020391625Z namespaces/openshift-marketplace/daemonset/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.020398966Z namespaces/openshift-marketplace/deployments/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.020440767Z namespaces/openshift-marketplace/deployments/marketplace-operator.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.02053404Z namespaces/openshift-marketplace/imagestream/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.020542Z namespaces/openshift-marketplace/installplans/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.020546181Z namespaces/openshift-marketplace/issuer/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.020550491Z namespaces/openshift-marketplace/jobs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.020554301Z namespaces/openshift-marketplace/pods/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.020558081Z namespaces/openshift-marketplace/pods/certified-operators-grjnm/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.020598722Z namespaces/openshift-marketplace/pods/certified-operators-grjnm/certified-operators-grjnm-describe [must-gather-nzscv] OUT 2025-10-03T04:29:13.020700296Z namespaces/openshift-marketplace/pods/certified-operators-grjnm/logs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.020780108Z namespaces/openshift-marketplace/pods/certified-operators-grjnm/logs/extract-content.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.020889321Z namespaces/openshift-marketplace/pods/certified-operators-grjnm/logs/extract-utilities.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.020974664Z namespaces/openshift-marketplace/pods/certified-operators-grjnm/logs/registry-server.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.028125685Z namespaces/openshift-marketplace/pods/community-operators-r4mzs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.028193657Z namespaces/openshift-marketplace/pods/community-operators-r4mzs/community-operators-r4mzs-describe [must-gather-nzscv] OUT 2025-10-03T04:29:13.028301291Z namespaces/openshift-marketplace/pods/community-operators-r4mzs/logs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.028389063Z namespaces/openshift-marketplace/pods/community-operators-r4mzs/logs/extract-content.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.028468366Z namespaces/openshift-marketplace/pods/community-operators-r4mzs/logs/extract-utilities.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.02859334Z namespaces/openshift-marketplace/pods/community-operators-r4mzs/logs/registry-server.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.036530396Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-9mgkw/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.036620428Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-9mgkw/marketplace-operator-79b997595-9mgkw-describe [must-gather-nzscv] OUT 2025-10-03T04:29:13.036627589Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-9mgkw/logs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.036750583Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-9mgkw/logs/marketplace-operator-previous.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.036862976Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-9mgkw/logs/marketplace-operator.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.036959179Z namespaces/openshift-marketplace/pods/redhat-marketplace-zgbnb/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.037080553Z namespaces/openshift-marketplace/pods/redhat-marketplace-zgbnb/redhat-marketplace-zgbnb-describe [must-gather-nzscv] OUT 2025-10-03T04:29:13.037181916Z namespaces/openshift-marketplace/pods/redhat-marketplace-zgbnb/logs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.037244077Z namespaces/openshift-marketplace/pods/redhat-marketplace-zgbnb/logs/extract-content.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.037330551Z namespaces/openshift-marketplace/pods/redhat-marketplace-zgbnb/logs/extract-utilities.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.037409593Z namespaces/openshift-marketplace/pods/redhat-marketplace-zgbnb/logs/registry-server.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.038373153Z namespaces/openshift-marketplace/pods/redhat-operators-kqxll/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.038439195Z namespaces/openshift-marketplace/pods/redhat-operators-kqxll/redhat-operators-kqxll-describe [must-gather-nzscv] OUT 2025-10-03T04:29:13.038531547Z namespaces/openshift-marketplace/pods/redhat-operators-kqxll/logs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.03859063Z namespaces/openshift-marketplace/pods/redhat-operators-kqxll/logs/extract-content.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.038689923Z namespaces/openshift-marketplace/pods/redhat-operators-kqxll/logs/extract-utilities.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.038764425Z namespaces/openshift-marketplace/pods/redhat-operators-kqxll/logs/registry-server.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.0431218Z namespaces/openshift-marketplace/replicaset/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.043189912Z namespaces/openshift-marketplace/replicaset/marketplace-operator-79b997595.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.043280465Z namespaces/openshift-marketplace/routes/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.043289615Z namespaces/openshift-marketplace/services/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.043334806Z namespaces/openshift-marketplace/services/certified-operators.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.043467411Z namespaces/openshift-marketplace/services/community-operators.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.043603045Z namespaces/openshift-marketplace/services/marketplace-operator-metrics.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.043724579Z namespaces/openshift-marketplace/services/redhat-marketplace.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.043864733Z namespaces/openshift-marketplace/services/redhat-operators.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.044030958Z namespaces/openshift-marketplace/statefulset/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044039949Z namespaces/openshift-marketplace/subscriptions/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044045449Z namespaces/openshift-operators/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.04409377Z namespaces/openshift-operators/all_resources.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.044186083Z namespaces/openshift-operators/events.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.044267746Z namespaces/openshift-operators/nad.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.044430331Z namespaces/openshift-operators/pvc.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.044447471Z namespaces/openshift-operators/buildconfig/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044453301Z namespaces/openshift-operators/cert/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044461922Z namespaces/openshift-operators/certificaterequests/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044467202Z namespaces/openshift-operators/configmaps/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044472462Z namespaces/openshift-operators/cronjobs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044477652Z namespaces/openshift-operators/daemonset/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044483293Z namespaces/openshift-operators/deployments/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044491133Z namespaces/openshift-operators/imagestream/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044496363Z namespaces/openshift-operators/installplans/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044501593Z namespaces/openshift-operators/issuer/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044510173Z namespaces/openshift-operators/jobs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044515983Z namespaces/openshift-operators/pods/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044527493Z namespaces/openshift-operators/pods/-describe [must-gather-nzscv] OUT 2025-10-03T04:29:13.044581726Z namespaces/openshift-operators/pods/logs/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044589596Z namespaces/openshift-operators/replicaset/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044595556Z namespaces/openshift-operators/routes/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044607137Z namespaces/openshift-operators/services/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044612367Z namespaces/openshift-operators/statefulset/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044617526Z namespaces/openshift-operators/subscriptions/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044622636Z network/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044631187Z network/l2advertisement.log [must-gather-nzscv] OUT 2025-10-03T04:29:13.044688629Z network/ipaddresspools/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044696939Z network/nnce/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044702439Z network/nncp/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.04470925Z network/nns/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.04471819Z nodes/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.044761871Z nodes/crc.describe [must-gather-nzscv] OUT 2025-10-03T04:29:13.044971817Z nodes/crc.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.045131083Z sos-reports/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.045140443Z sos-reports/sos-report- -> ../_all_nodes/sosreport- [must-gather-nzscv] OUT 2025-10-03T04:29:13.045149273Z sos-reports/_all_nodes/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.045155013Z webhooks/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.045160133Z webhooks/mutating/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.045165243Z webhooks/validating/ [must-gather-nzscv] OUT 2025-10-03T04:29:13.045328569Z webhooks/validating/controlplanemachineset.machine.openshift.io.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.04535122Z webhooks/validating/monitoringconfigmaps.openshift.io.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.045481633Z webhooks/validating/multus.openshift.io.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.045628948Z webhooks/validating/network-node-identity.openshift.io.yaml [must-gather-nzscv] OUT 2025-10-03T04:29:13.049370794Z [must-gather-nzscv] OUT 2025-10-03T04:29:13.049389585Z sent 1,694 bytes received 31,553,302 bytes 12,621,998.40 bytes/sec [must-gather-nzscv] OUT 2025-10-03T04:29:13.049395585Z total size is 208,420,837 speedup is 6.61 [must-gather ] OUT 2025-10-03T04:29:13.085282276Z namespace/openshift-must-gather-2zdg5 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 1f554581-b381-451f-a07a-fe0586b6d650 ClientVersion: 4.18.1 ClusterVersion: Stable at "4.18.1" ClusterOperators: clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing