[must-gather ] OUT 2025-11-24T08:58:05.561035224Z Using must-gather plug-in image: quay.io/openstack-k8s-operators/openstack-must-gather:latest When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 1f554581-b381-451f-a07a-fe0586b6d650 ClientVersion: 4.18.1 ClusterVersion: Stable at "4.18.1" ClusterOperators: clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing [must-gather ] OUT 2025-11-24T08:58:05.620312311Z namespace/openshift-must-gather-jfvcf created [must-gather ] OUT 2025-11-24T08:58:05.634599823Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-kh6tw created [must-gather ] OUT 2025-11-24T08:58:05.858680585Z pod for plug-in image quay.io/openstack-k8s-operators/openstack-must-gather:latest created [must-gather-rjbtf] OUT 2025-11-24T09:00:28.390394409Z waiting for gather to complete [must-gather-rjbtf] OUT 2025-11-24T09:00:28.40228225Z downloading gather output [must-gather-rjbtf] OUT 2025-11-24T09:00:28.671697179Z receiving incremental file list [must-gather-rjbtf] OUT 2025-11-24T09:00:28.681333286Z ./ [must-gather-rjbtf] OUT 2025-11-24T09:00:28.681456089Z must-gather.tar.xz [must-gather-rjbtf] OUT 2025-11-24T09:00:28.858392701Z packagemanifests [must-gather-rjbtf] OUT 2025-11-24T09:00:30.119443783Z run.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.119617398Z version [must-gather-rjbtf] OUT 2025-11-24T09:00:30.11969586Z crd/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.119710891Z csv/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.119716221Z ctlplane/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.119790483Z ctlplane/endpoints [must-gather-rjbtf] OUT 2025-11-24T09:00:30.119994519Z ctlplane/services [must-gather-rjbtf] OUT 2025-11-24T09:00:30.120014099Z ctlplane/ovn/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.12002042Z ctlplane/rabbitmq/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.1200255Z dbs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.12003047Z namespaces/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.12003691Z namespaces/openshift-machine-api/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.120173994Z namespaces/openshift-machine-api/all_resources.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.120342969Z namespaces/openshift-machine-api/events.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.120667878Z namespaces/openshift-machine-api/nad.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.120804732Z namespaces/openshift-machine-api/pvc.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.120844423Z namespaces/openshift-machine-api/buildconfig/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.120859004Z namespaces/openshift-machine-api/cert/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.120875294Z namespaces/openshift-machine-api/certificaterequests/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.120899725Z namespaces/openshift-machine-api/configmaps/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.120905595Z namespaces/openshift-machine-api/cronjobs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.120910265Z namespaces/openshift-machine-api/daemonset/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.120914755Z namespaces/openshift-machine-api/deployments/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.121117451Z namespaces/openshift-machine-api/deployments/control-plane-machine-set-operator.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.121297546Z namespaces/openshift-machine-api/deployments/machine-api-operator.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.12142381Z namespaces/openshift-machine-api/imagestream/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.12143667Z namespaces/openshift-machine-api/installplans/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.12144318Z namespaces/openshift-machine-api/issuer/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.121449401Z namespaces/openshift-machine-api/jobs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.121453881Z namespaces/openshift-machine-api/pods/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.121494902Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.121550764Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/control-plane-machine-set-operator-78cbb6b69f-hwgbz-describe [must-gather-rjbtf] OUT 2025-11-24T09:00:30.121706138Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/logs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.12176611Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/logs/control-plane-machine-set-operator-previous.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.121987906Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-hwgbz/logs/control-plane-machine-set-operator.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.128339399Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.128471732Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/machine-api-operator-5694c8668f-w7rtg-describe [must-gather-rjbtf] OUT 2025-11-24T09:00:30.128648017Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/logs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.128674118Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/logs/kube-rbac-proxy.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.128880844Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-w7rtg/logs/machine-api-operator.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.129109701Z namespaces/openshift-machine-api/replicaset/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.129188443Z namespaces/openshift-machine-api/replicaset/control-plane-machine-set-operator-78cbb6b69f.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.129380389Z namespaces/openshift-machine-api/replicaset/machine-api-operator-5694c8668f.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.129490022Z namespaces/openshift-machine-api/routes/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.129503192Z namespaces/openshift-machine-api/services/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.129559884Z namespaces/openshift-machine-api/services/cluster-autoscaler-operator.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.129722588Z namespaces/openshift-machine-api/services/control-plane-machine-set-operator.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.129857202Z namespaces/openshift-machine-api/services/machine-api-controllers.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.129989656Z namespaces/openshift-machine-api/services/machine-api-operator-machine-webhook.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.130304325Z namespaces/openshift-machine-api/services/machine-api-operator-webhook.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.130452349Z namespaces/openshift-machine-api/services/machine-api-operator.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.130529372Z namespaces/openshift-machine-api/statefulset/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.130545652Z namespaces/openshift-machine-api/subscriptions/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.130551402Z namespaces/openshift-marketplace/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.130626324Z namespaces/openshift-marketplace/all_resources.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.130769948Z namespaces/openshift-marketplace/events.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.131573352Z namespaces/openshift-marketplace/nad.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.131690115Z namespaces/openshift-marketplace/pvc.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.131704455Z namespaces/openshift-marketplace/buildconfig/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.131709595Z namespaces/openshift-marketplace/cert/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.131714846Z namespaces/openshift-marketplace/certificaterequests/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.131763237Z namespaces/openshift-marketplace/configmaps/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.131791038Z namespaces/openshift-marketplace/cronjobs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.131802548Z namespaces/openshift-marketplace/daemonset/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.131807018Z namespaces/openshift-marketplace/deployments/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.13186192Z namespaces/openshift-marketplace/deployments/marketplace-operator.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.131981283Z namespaces/openshift-marketplace/imagestream/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.131993424Z namespaces/openshift-marketplace/installplans/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.131998654Z namespaces/openshift-marketplace/issuer/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.132004194Z namespaces/openshift-marketplace/jobs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.132009694Z namespaces/openshift-marketplace/pods/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.132015494Z namespaces/openshift-marketplace/pods/certified-operators-x7kt7/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.132099777Z namespaces/openshift-marketplace/pods/certified-operators-x7kt7/certified-operators-x7kt7-describe [must-gather-rjbtf] OUT 2025-11-24T09:00:30.13223179Z namespaces/openshift-marketplace/pods/certified-operators-x7kt7/logs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.132263161Z namespaces/openshift-marketplace/pods/certified-operators-x7kt7/logs/extract-content.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.132475207Z namespaces/openshift-marketplace/pods/certified-operators-x7kt7/logs/extract-utilities.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.132594151Z namespaces/openshift-marketplace/pods/certified-operators-x7kt7/logs/registry-server.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.13953569Z namespaces/openshift-marketplace/pods/community-operators-ftsds/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.139628503Z namespaces/openshift-marketplace/pods/community-operators-ftsds/community-operators-ftsds-describe [must-gather-rjbtf] OUT 2025-11-24T09:00:30.139735806Z namespaces/openshift-marketplace/pods/community-operators-ftsds/logs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.139766057Z namespaces/openshift-marketplace/pods/community-operators-ftsds/logs/extract-content.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.13989073Z namespaces/openshift-marketplace/pods/community-operators-ftsds/logs/extract-utilities.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.139958232Z namespaces/openshift-marketplace/pods/community-operators-ftsds/logs/registry-server.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.146949823Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-nmmvw/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.147129008Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-nmmvw/marketplace-operator-79b997595-nmmvw-describe [must-gather-rjbtf] OUT 2025-11-24T09:00:30.147135788Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-nmmvw/logs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.147161729Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-nmmvw/logs/marketplace-operator-previous.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.147282033Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-nmmvw/logs/marketplace-operator.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.147354675Z namespaces/openshift-marketplace/pods/redhat-marketplace-qdv8v/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.147419867Z namespaces/openshift-marketplace/pods/redhat-marketplace-qdv8v/redhat-marketplace-qdv8v-describe [must-gather-rjbtf] OUT 2025-11-24T09:00:30.14751951Z namespaces/openshift-marketplace/pods/redhat-marketplace-qdv8v/logs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.147590142Z namespaces/openshift-marketplace/pods/redhat-marketplace-qdv8v/logs/extract-content.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.147669304Z namespaces/openshift-marketplace/pods/redhat-marketplace-qdv8v/logs/extract-utilities.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.147751976Z namespaces/openshift-marketplace/pods/redhat-marketplace-qdv8v/logs/registry-server.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.149108715Z namespaces/openshift-marketplace/pods/redhat-operators-cb7cj/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.149157507Z namespaces/openshift-marketplace/pods/redhat-operators-cb7cj/redhat-operators-cb7cj-describe [must-gather-rjbtf] OUT 2025-11-24T09:00:30.149358972Z namespaces/openshift-marketplace/pods/redhat-operators-cb7cj/logs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.149376823Z namespaces/openshift-marketplace/pods/redhat-operators-cb7cj/logs/extract-content.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.149495766Z namespaces/openshift-marketplace/pods/redhat-operators-cb7cj/logs/extract-utilities.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.149587359Z namespaces/openshift-marketplace/pods/redhat-operators-cb7cj/logs/registry-server.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.153564243Z namespaces/openshift-marketplace/replicaset/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.153655906Z namespaces/openshift-marketplace/replicaset/marketplace-operator-79b997595.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.153745388Z namespaces/openshift-marketplace/routes/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.153752119Z namespaces/openshift-marketplace/services/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.153784319Z namespaces/openshift-marketplace/services/certified-operators.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154012716Z namespaces/openshift-marketplace/services/community-operators.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154103129Z namespaces/openshift-marketplace/services/marketplace-operator-metrics.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154208752Z namespaces/openshift-marketplace/services/redhat-marketplace.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154359286Z namespaces/openshift-marketplace/services/redhat-operators.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154474559Z namespaces/openshift-marketplace/statefulset/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.15448479Z namespaces/openshift-marketplace/subscriptions/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.1544984Z namespaces/openshift-operators/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154534021Z namespaces/openshift-operators/all_resources.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154623014Z namespaces/openshift-operators/events.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154705006Z namespaces/openshift-operators/nad.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154805529Z namespaces/openshift-operators/pvc.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.15484556Z namespaces/openshift-operators/buildconfig/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.15485914Z namespaces/openshift-operators/cert/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154865081Z namespaces/openshift-operators/certificaterequests/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154870241Z namespaces/openshift-operators/configmaps/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154875431Z namespaces/openshift-operators/cronjobs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154880141Z namespaces/openshift-operators/daemonset/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154884811Z namespaces/openshift-operators/deployments/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154896811Z namespaces/openshift-operators/imagestream/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154902552Z namespaces/openshift-operators/installplans/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154907132Z namespaces/openshift-operators/issuer/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154911952Z namespaces/openshift-operators/jobs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154916782Z namespaces/openshift-operators/pods/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.154938853Z namespaces/openshift-operators/pods/-describe [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155070686Z namespaces/openshift-operators/pods/logs/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155079497Z namespaces/openshift-operators/replicaset/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155084097Z namespaces/openshift-operators/routes/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155093417Z namespaces/openshift-operators/services/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155098187Z namespaces/openshift-operators/statefulset/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155102377Z namespaces/openshift-operators/subscriptions/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155107027Z network/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155139468Z network/l2advertisement.log [must-gather-rjbtf] OUT 2025-11-24T09:00:30.15518044Z network/ipaddresspools/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.15518899Z network/nnce/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.15519373Z network/nncp/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155213441Z network/nns/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155224941Z nodes/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155272682Z nodes/crc.describe [must-gather-rjbtf] OUT 2025-11-24T09:00:30.15554905Z nodes/crc.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155636383Z sos-reports/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155648693Z sos-reports/sos-report- -> ../_all_nodes/sosreport- [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155654193Z sos-reports/_all_nodes/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155659383Z webhooks/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155664183Z webhooks/mutating/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155668864Z webhooks/validating/ [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155733515Z webhooks/validating/controlplanemachineset.machine.openshift.io.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155847859Z webhooks/validating/monitoringconfigmaps.openshift.io.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.155958102Z webhooks/validating/multus.openshift.io.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.156193419Z webhooks/validating/network-node-identity.openshift.io.yaml [must-gather-rjbtf] OUT 2025-11-24T09:00:30.160356328Z [must-gather-rjbtf] OUT 2025-11-24T09:00:30.160382839Z sent 1,690 bytes received 31,753,849 bytes 12,702,215.60 bytes/sec [must-gather-rjbtf] OUT 2025-11-24T09:00:30.160388609Z total size is 218,539,530 speedup is 6.88 [must-gather ] OUT 2025-11-24T09:00:30.194295243Z namespace/openshift-must-gather-jfvcf deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 1f554581-b381-451f-a07a-fe0586b6d650 ClientVersion: 4.18.1 ClusterVersion: Stable at "4.18.1" ClusterOperators: clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing