[must-gather ] OUT 2025-10-03T13:15:27.579528518Z Using must-gather plug-in image: quay.io/openstack-k8s-operators/openstack-must-gather:latest When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 1f554581-b381-451f-a07a-fe0586b6d650 ClientVersion: 4.18.1 ClusterVersion: Stable at "4.18.1" ClusterOperators: clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing [must-gather ] OUT 2025-10-03T13:15:27.647727501Z namespace/openshift-must-gather-7qs2x created [must-gather ] OUT 2025-10-03T13:15:27.656603045Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-htms5 created [must-gather ] OUT 2025-10-03T13:15:27.918737159Z pod for plug-in image quay.io/openstack-k8s-operators/openstack-must-gather:latest created [must-gather-ndxf6] OUT 2025-10-03T13:17:44.037123948Z waiting for gather to complete [must-gather-ndxf6] OUT 2025-10-03T13:17:44.236430232Z downloading gather output [must-gather-ndxf6] OUT 2025-10-03T13:17:44.946206096Z receiving incremental file list [must-gather-ndxf6] OUT 2025-10-03T13:17:44.963937312Z ./ [must-gather-ndxf6] OUT 2025-10-03T13:17:44.964108738Z must-gather.tar.xz [must-gather-ndxf6] OUT 2025-10-03T13:17:45.299644572Z packagemanifests [must-gather-ndxf6] OUT 2025-10-03T13:17:46.911933322Z run.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.912000574Z version [must-gather-ndxf6] OUT 2025-10-03T13:17:46.91220372Z crd/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.912220601Z csv/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.912228361Z ctlplane/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.912239951Z ctlplane/endpoints [must-gather-ndxf6] OUT 2025-10-03T13:17:46.912291352Z ctlplane/services [must-gather-ndxf6] OUT 2025-10-03T13:17:46.912302383Z ctlplane/ovn/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.912308343Z ctlplane/rabbitmq/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.912314203Z dbs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.912319934Z namespaces/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.912325824Z namespaces/openshift-machine-api/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.912357655Z namespaces/openshift-machine-api/all_resources.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.91253011Z namespaces/openshift-machine-api/events.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.912785578Z namespaces/openshift-machine-api/nad.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.912922492Z namespaces/openshift-machine-api/pvc.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.912986614Z namespaces/openshift-machine-api/buildconfig/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.913014166Z namespaces/openshift-machine-api/cert/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.913045126Z namespaces/openshift-machine-api/certificaterequests/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.913058536Z namespaces/openshift-machine-api/configmaps/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.913066977Z namespaces/openshift-machine-api/cronjobs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.913072107Z namespaces/openshift-machine-api/daemonset/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.913077107Z namespaces/openshift-machine-api/deployments/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.913219782Z namespaces/openshift-machine-api/deployments/control-plane-machine-set-operator.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.920213327Z namespaces/openshift-machine-api/deployments/machine-api-operator.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.920284829Z namespaces/openshift-machine-api/imagestream/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.920291999Z namespaces/openshift-machine-api/installplans/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.920296039Z namespaces/openshift-machine-api/issuer/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.92030037Z namespaces/openshift-machine-api/jobs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.92030509Z namespaces/openshift-machine-api/pods/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.92031781Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.920336441Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/control-plane-machine-set-operator-78cbb6b69f-hwgbz-describe [must-gather-ndxf6] OUT 2025-10-03T13:17:46.920433104Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/logs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.920515556Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/logs/control-plane-machine-set-operator-previous.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.920752414Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/logs/control-plane-machine-set-operator.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.920865737Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.920973271Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/machine-api-operator-5694c8668f-w7rtg-describe [must-gather-ndxf6] OUT 2025-10-03T13:17:46.921091775Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/logs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.921204328Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/logs/kube-rbac-proxy.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.921356322Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/logs/machine-api-operator-previous.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.921494817Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/logs/machine-api-operator.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.921625901Z namespaces/openshift-machine-api/replicaset/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.921706083Z namespaces/openshift-machine-api/replicaset/control-plane-machine-set-operator-78cbb6b69f.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.92191507Z namespaces/openshift-machine-api/replicaset/machine-api-operator-5694c8668f.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.922030553Z namespaces/openshift-machine-api/routes/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.922088965Z namespaces/openshift-machine-api/services/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.922217789Z namespaces/openshift-machine-api/services/cluster-autoscaler-operator.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.922346383Z namespaces/openshift-machine-api/services/control-plane-machine-set-operator.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.922461377Z namespaces/openshift-machine-api/services/machine-api-controllers.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.92259452Z namespaces/openshift-machine-api/services/machine-api-operator-machine-webhook.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.922786176Z namespaces/openshift-machine-api/services/machine-api-operator-webhook.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.922988513Z namespaces/openshift-machine-api/services/machine-api-operator.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.923076676Z namespaces/openshift-machine-api/statefulset/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.923115666Z namespaces/openshift-machine-api/subscriptions/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.923156608Z namespaces/openshift-marketplace/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.923275442Z namespaces/openshift-marketplace/all_resources.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.923395296Z namespaces/openshift-marketplace/events.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.923998824Z namespaces/openshift-marketplace/nad.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924158668Z namespaces/openshift-marketplace/pvc.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924222211Z namespaces/openshift-marketplace/buildconfig/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924249032Z namespaces/openshift-marketplace/cert/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924268452Z namespaces/openshift-marketplace/certificaterequests/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924292723Z namespaces/openshift-marketplace/configmaps/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924311744Z namespaces/openshift-marketplace/cronjobs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924328314Z namespaces/openshift-marketplace/daemonset/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924346255Z namespaces/openshift-marketplace/deployments/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924440818Z namespaces/openshift-marketplace/deployments/marketplace-operator.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924552171Z namespaces/openshift-marketplace/imagestream/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924580231Z namespaces/openshift-marketplace/installplans/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924642054Z namespaces/openshift-marketplace/issuer/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924665175Z namespaces/openshift-marketplace/jobs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924672395Z namespaces/openshift-marketplace/pods/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924681384Z namespaces/openshift-marketplace/pods/certified-operators-6kc6d/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924705585Z namespaces/openshift-marketplace/pods/certified-operators-6kc6d/certified-operators-6kc6d-describe [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924788798Z namespaces/openshift-marketplace/pods/certified-operators-6kc6d/logs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924866821Z namespaces/openshift-marketplace/pods/certified-operators-6kc6d/logs/extract-content.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.924985305Z namespaces/openshift-marketplace/pods/certified-operators-6kc6d/logs/extract-utilities.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.925115678Z namespaces/openshift-marketplace/pods/certified-operators-6kc6d/logs/registry-server.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.932002381Z namespaces/openshift-marketplace/pods/community-operators-w6wxd/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.932046702Z namespaces/openshift-marketplace/pods/community-operators-w6wxd/community-operators-w6wxd-describe [must-gather-ndxf6] OUT 2025-10-03T13:17:46.932203777Z namespaces/openshift-marketplace/pods/community-operators-w6wxd/logs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.932374232Z namespaces/openshift-marketplace/pods/community-operators-w6wxd/logs/extract-content.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.932501496Z namespaces/openshift-marketplace/pods/community-operators-w6wxd/logs/extract-utilities.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.93262412Z namespaces/openshift-marketplace/pods/community-operators-w6wxd/logs/registry-server.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.936896691Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-krs78/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.936997194Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-krs78/marketplace-operator-79b997595-krs78-describe [must-gather-ndxf6] OUT 2025-10-03T13:17:46.937114628Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-krs78/logs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.937295134Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-krs78/logs/marketplace-operator-previous.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.937456999Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-krs78/logs/marketplace-operator.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.937568733Z namespaces/openshift-marketplace/pods/redhat-marketplace-6ddwv/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.937663915Z namespaces/openshift-marketplace/pods/redhat-marketplace-6ddwv/redhat-marketplace-6ddwv-describe [must-gather-ndxf6] OUT 2025-10-03T13:17:46.937780489Z namespaces/openshift-marketplace/pods/redhat-marketplace-6ddwv/logs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.937868022Z namespaces/openshift-marketplace/pods/redhat-marketplace-6ddwv/logs/extract-content.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.937997506Z namespaces/openshift-marketplace/pods/redhat-marketplace-6ddwv/logs/extract-utilities.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.938180191Z namespaces/openshift-marketplace/pods/redhat-marketplace-6ddwv/logs/registry-server.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.93879463Z namespaces/openshift-marketplace/pods/redhat-operators-hpfqn/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.938886773Z namespaces/openshift-marketplace/pods/redhat-operators-hpfqn/redhat-operators-hpfqn-describe [must-gather-ndxf6] OUT 2025-10-03T13:17:46.938962805Z namespaces/openshift-marketplace/pods/redhat-operators-hpfqn/logs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.938979115Z namespaces/openshift-marketplace/pods/redhat-operators-hpfqn/logs/extract-content.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.939066758Z namespaces/openshift-marketplace/pods/redhat-operators-hpfqn/logs/extract-utilities.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.939149491Z namespaces/openshift-marketplace/pods/redhat-operators-hpfqn/logs/registry-server.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.943874237Z namespaces/openshift-marketplace/replicaset/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.943914118Z namespaces/openshift-marketplace/replicaset/marketplace-operator-79b997595.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944050782Z namespaces/openshift-marketplace/routes/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944064473Z namespaces/openshift-marketplace/services/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944074513Z namespaces/openshift-marketplace/services/certified-operators.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944191107Z namespaces/openshift-marketplace/services/community-operators.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.9442831Z namespaces/openshift-marketplace/services/marketplace-operator-metrics.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944359902Z namespaces/openshift-marketplace/services/redhat-marketplace.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944506607Z namespaces/openshift-marketplace/services/redhat-operators.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944577158Z namespaces/openshift-marketplace/statefulset/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944593689Z namespaces/openshift-marketplace/subscriptions/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944600369Z namespaces/openshift-operators/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.94460976Z namespaces/openshift-operators/all_resources.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944707713Z namespaces/openshift-operators/events.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944790225Z namespaces/openshift-operators/nad.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944878868Z namespaces/openshift-operators/pvc.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944891388Z namespaces/openshift-operators/buildconfig/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944901378Z namespaces/openshift-operators/cert/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944911369Z namespaces/openshift-operators/certificaterequests/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944916419Z namespaces/openshift-operators/configmaps/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944921669Z namespaces/openshift-operators/cronjobs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.94492853Z namespaces/openshift-operators/daemonset/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944937589Z namespaces/openshift-operators/deployments/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944942479Z namespaces/openshift-operators/imagestream/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.944947129Z namespaces/openshift-operators/installplans/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.94495268Z namespaces/openshift-operators/issuer/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.94496155Z namespaces/openshift-operators/jobs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.94496616Z namespaces/openshift-operators/pods/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945014072Z namespaces/openshift-operators/pods/-describe [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945039683Z namespaces/openshift-operators/pods/logs/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945065203Z namespaces/openshift-operators/replicaset/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945072273Z namespaces/openshift-operators/routes/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945083154Z namespaces/openshift-operators/services/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945088924Z namespaces/openshift-operators/statefulset/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945094814Z namespaces/openshift-operators/subscriptions/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945111765Z network/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945145855Z network/l2advertisement.log [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945204568Z network/ipaddresspools/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945217688Z network/nnce/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945223959Z network/nncp/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945232559Z network/nns/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945242389Z nodes/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945259899Z nodes/crc.describe [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945473106Z nodes/crc.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945534168Z sos-reports/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945553299Z sos-reports/sos-report- -> ../_all_nodes/sosreport- [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945562879Z sos-reports/_all_nodes/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945587119Z webhooks/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.94559965Z webhooks/mutating/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.94560779Z webhooks/validating/ [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945624701Z webhooks/validating/controlplanemachineset.machine.openshift.io.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945739304Z webhooks/validating/monitoringconfigmaps.openshift.io.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.945862128Z webhooks/validating/multus.openshift.io.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.946025113Z webhooks/validating/network-node-identity.openshift.io.yaml [must-gather-ndxf6] OUT 2025-10-03T13:17:46.95080887Z [must-gather-ndxf6] OUT 2025-10-03T13:17:46.950832741Z sent 1,717 bytes received 30,729,737 bytes 12,292,581.60 bytes/sec [must-gather-ndxf6] OUT 2025-10-03T13:17:46.950841261Z total size is 206,899,221 speedup is 6.73 [must-gather ] OUT 2025-10-03T13:17:46.992600819Z namespace/openshift-must-gather-7qs2x deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 1f554581-b381-451f-a07a-fe0586b6d650 ClientVersion: 4.18.1 ClusterVersion: Stable at "4.18.1" ClusterOperators: clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing