[must-gather ] OUT 2025-11-25T14:23:02.859884433Z Using must-gather plug-in image: quay.io/openstack-k8s-operators/openstack-must-gather:latest When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 7dec01f8-89a2-484c-b000-0ae6c3570049 ClientVersion: 4.18.1 ClusterVersion: Stable at "4.18.1" ClusterOperators: clusteroperator/machine-config is degraded because Failed to resync 4.18.1 because: the required MachineConfigPool master was paused with no pending updates; no further syncing will occur until it is unpaused clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing [must-gather ] OUT 2025-11-25T14:23:02.936199755Z namespace/openshift-must-gather-pjphw created [must-gather ] OUT 2025-11-25T14:23:02.958213005Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-jhjv7 created [must-gather ] OUT 2025-11-25T14:23:03.050637476Z pod for plug-in image quay.io/openstack-k8s-operators/openstack-must-gather:latest created [must-gather-vdkwc] OUT 2025-11-25T14:25:26.340656727Z waiting for gather to complete [must-gather-vdkwc] OUT 2025-11-25T14:25:26.346525366Z downloading gather output [must-gather-vdkwc] OUT 2025-11-25T14:25:26.653209259Z receiving incremental file list [must-gather-vdkwc] OUT 2025-11-25T14:25:26.662460944Z ./ [must-gather-vdkwc] OUT 2025-11-25T14:25:26.662938827Z must-gather.tar.xz [must-gather-vdkwc] OUT 2025-11-25T14:25:26.885380976Z packagemanifests [must-gather-vdkwc] OUT 2025-11-25T14:25:28.069610436Z run.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.069719229Z version [must-gather-vdkwc] OUT 2025-11-25T14:25:28.06977136Z crd/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.069781471Z csv/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.069785831Z ctlplane/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.069811761Z ctlplane/endpoints [must-gather-vdkwc] OUT 2025-11-25T14:25:28.069915424Z ctlplane/services [must-gather-vdkwc] OUT 2025-11-25T14:25:28.069929544Z ctlplane/ovn/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.069934284Z ctlplane/rabbitmq/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.069938055Z dbs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.069941985Z namespaces/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.069946595Z namespaces/openshift-machine-api/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070013636Z namespaces/openshift-machine-api/all_resources.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070109829Z namespaces/openshift-machine-api/events.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070355355Z namespaces/openshift-machine-api/nad.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070444937Z namespaces/openshift-machine-api/pvc.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070477448Z namespaces/openshift-machine-api/buildconfig/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070493879Z namespaces/openshift-machine-api/cert/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070499789Z namespaces/openshift-machine-api/certificaterequests/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070504939Z namespaces/openshift-machine-api/configmaps/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070519519Z namespaces/openshift-machine-api/cronjobs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070523469Z namespaces/openshift-machine-api/daemonset/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07052765Z namespaces/openshift-machine-api/deployments/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07055343Z namespaces/openshift-machine-api/deployments/control-plane-machine-set-operator.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070684584Z namespaces/openshift-machine-api/deployments/machine-api-operator.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070798506Z namespaces/openshift-machine-api/imagestream/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070809157Z namespaces/openshift-machine-api/installplans/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070813427Z namespaces/openshift-machine-api/issuer/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070841628Z namespaces/openshift-machine-api/jobs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070847098Z namespaces/openshift-machine-api/pods/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070861948Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-rnsxf/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070892959Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-rnsxf/control-plane-machine-set-operator-78cbb6b69f-rnsxf-describe [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07093243Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-rnsxf/logs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.070960121Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-rnsxf/logs/control-plane-machine-set-operator-previous.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.071109364Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-rnsxf/logs/control-plane-machine-set-operator.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.071181556Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-chf57/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.071237668Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-chf57/machine-api-operator-5694c8668f-chf57-describe [must-gather-vdkwc] OUT 2025-11-25T14:25:28.071303789Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-chf57/logs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.071369681Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-chf57/logs/kube-rbac-proxy.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.071690679Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-chf57/logs/machine-api-operator-previous.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.071698689Z namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-chf57/logs/machine-api-operator.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.071702649Z namespaces/openshift-machine-api/replicaset/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07171134Z namespaces/openshift-machine-api/replicaset/control-plane-machine-set-operator-78cbb6b69f.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.071803572Z namespaces/openshift-machine-api/replicaset/machine-api-operator-5694c8668f.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.071873014Z namespaces/openshift-machine-api/routes/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.071879674Z namespaces/openshift-machine-api/services/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.071932735Z namespaces/openshift-machine-api/services/cluster-autoscaler-operator.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.072026828Z namespaces/openshift-machine-api/services/control-plane-machine-set-operator.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07210386Z namespaces/openshift-machine-api/services/machine-api-controllers.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.072170611Z namespaces/openshift-machine-api/services/machine-api-operator-machine-webhook.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.072363856Z namespaces/openshift-machine-api/services/machine-api-operator-webhook.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.072443858Z namespaces/openshift-machine-api/services/machine-api-operator.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07250294Z namespaces/openshift-machine-api/statefulset/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07250985Z namespaces/openshift-machine-api/subscriptions/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07251403Z namespaces/openshift-marketplace/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.072572102Z namespaces/openshift-marketplace/all_resources.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.072644113Z namespaces/openshift-marketplace/events.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.073178027Z namespaces/openshift-marketplace/nad.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.073251399Z namespaces/openshift-marketplace/pvc.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07327709Z namespaces/openshift-marketplace/buildconfig/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07328151Z namespaces/openshift-marketplace/cert/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.0732857Z namespaces/openshift-marketplace/certificaterequests/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07328978Z namespaces/openshift-marketplace/configmaps/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07329377Z namespaces/openshift-marketplace/cronjobs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07329755Z namespaces/openshift-marketplace/daemonset/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07330144Z namespaces/openshift-marketplace/deployments/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.073383702Z namespaces/openshift-marketplace/deployments/marketplace-operator.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.073444874Z namespaces/openshift-marketplace/imagestream/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.073450844Z namespaces/openshift-marketplace/installplans/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.073454854Z namespaces/openshift-marketplace/issuer/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.073458594Z namespaces/openshift-marketplace/jobs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.073462354Z namespaces/openshift-marketplace/pods/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.073466144Z namespaces/openshift-marketplace/pods/certified-operators-t2fst/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.073481695Z namespaces/openshift-marketplace/pods/certified-operators-t2fst/certified-operators-t2fst-describe [must-gather-vdkwc] OUT 2025-11-25T14:25:28.073610798Z namespaces/openshift-marketplace/pods/certified-operators-t2fst/logs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.073624788Z namespaces/openshift-marketplace/pods/certified-operators-t2fst/logs/extract-content.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.07369575Z namespaces/openshift-marketplace/pods/certified-operators-t2fst/logs/extract-utilities.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.073771512Z namespaces/openshift-marketplace/pods/certified-operators-t2fst/logs/registry-server.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.084275979Z namespaces/openshift-marketplace/pods/community-operators-jzhx6/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.084365462Z namespaces/openshift-marketplace/pods/community-operators-jzhx6/community-operators-jzhx6-describe [must-gather-vdkwc] OUT 2025-11-25T14:25:28.084558287Z namespaces/openshift-marketplace/pods/community-operators-jzhx6/logs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.084578057Z namespaces/openshift-marketplace/pods/community-operators-jzhx6/logs/extract-content.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.084583187Z namespaces/openshift-marketplace/pods/community-operators-jzhx6/logs/extract-utilities.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.084594477Z namespaces/openshift-marketplace/pods/community-operators-jzhx6/logs/registry-server.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.08824093Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-lmdjl/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.088271861Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-lmdjl/marketplace-operator-79b997595-lmdjl-describe [must-gather-vdkwc] OUT 2025-11-25T14:25:28.088398324Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-lmdjl/logs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.088411445Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-lmdjl/logs/marketplace-operator-previous.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.088538838Z namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-lmdjl/logs/marketplace-operator.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.08861408Z namespaces/openshift-marketplace/pods/redhat-marketplace-rr2j6/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.08862273Z namespaces/openshift-marketplace/pods/redhat-marketplace-rr2j6/redhat-marketplace-rr2j6-describe [must-gather-vdkwc] OUT 2025-11-25T14:25:28.088694442Z namespaces/openshift-marketplace/pods/redhat-marketplace-rr2j6/logs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.088732533Z namespaces/openshift-marketplace/pods/redhat-marketplace-rr2j6/logs/extract-content.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.088801625Z namespaces/openshift-marketplace/pods/redhat-marketplace-rr2j6/logs/extract-utilities.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.088877886Z namespaces/openshift-marketplace/pods/redhat-marketplace-rr2j6/logs/registry-server.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.089189904Z namespaces/openshift-marketplace/pods/redhat-operators-8rmxr/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.089205775Z namespaces/openshift-marketplace/pods/redhat-operators-8rmxr/redhat-operators-8rmxr-describe [must-gather-vdkwc] OUT 2025-11-25T14:25:28.089322838Z namespaces/openshift-marketplace/pods/redhat-operators-8rmxr/logs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.089351949Z namespaces/openshift-marketplace/pods/redhat-operators-8rmxr/logs/extract-content.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.08942504Z namespaces/openshift-marketplace/pods/redhat-operators-8rmxr/logs/extract-utilities.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.089505352Z namespaces/openshift-marketplace/pods/redhat-operators-8rmxr/logs/registry-server.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.093904034Z namespaces/openshift-marketplace/replicaset/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.093929095Z namespaces/openshift-marketplace/replicaset/marketplace-operator-79b997595.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094036988Z namespaces/openshift-marketplace/routes/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094046438Z namespaces/openshift-marketplace/services/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094055558Z namespaces/openshift-marketplace/services/certified-operators.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.09414248Z namespaces/openshift-marketplace/services/community-operators.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094225773Z namespaces/openshift-marketplace/services/marketplace-operator-metrics.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094310825Z namespaces/openshift-marketplace/services/redhat-marketplace.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094449758Z namespaces/openshift-marketplace/services/redhat-operators.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094586422Z namespaces/openshift-marketplace/statefulset/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094596302Z namespaces/openshift-marketplace/subscriptions/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094601232Z namespaces/openshift-operators/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094610272Z namespaces/openshift-operators/all_resources.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094731745Z namespaces/openshift-operators/events.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094798537Z namespaces/openshift-operators/nad.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094881229Z namespaces/openshift-operators/pvc.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094890529Z namespaces/openshift-operators/buildconfig/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.0948962Z namespaces/openshift-operators/cert/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.09490576Z namespaces/openshift-operators/certificaterequests/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.09491134Z namespaces/openshift-operators/configmaps/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.09491691Z namespaces/openshift-operators/cronjobs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.09492273Z namespaces/openshift-operators/daemonset/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.09492798Z namespaces/openshift-operators/deployments/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094933471Z namespaces/openshift-operators/imagestream/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094938701Z namespaces/openshift-operators/installplans/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094944071Z namespaces/openshift-operators/issuer/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094949351Z namespaces/openshift-operators/jobs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094954591Z namespaces/openshift-operators/pods/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094973942Z namespaces/openshift-operators/pods/-describe [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094979712Z namespaces/openshift-operators/pods/logs/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094984982Z namespaces/openshift-operators/replicaset/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094989912Z namespaces/openshift-operators/routes/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094994722Z namespaces/openshift-operators/services/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.094999332Z namespaces/openshift-operators/statefulset/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.095007212Z namespaces/openshift-operators/subscriptions/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.095012983Z network/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.095022103Z network/l2advertisement.log [must-gather-vdkwc] OUT 2025-11-25T14:25:28.095101615Z network/ipaddresspools/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.095110135Z network/nnce/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.095115625Z network/nncp/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.095131876Z network/nns/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.095137066Z nodes/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.095142566Z nodes/crc.describe [must-gather-vdkwc] OUT 2025-11-25T14:25:28.095272789Z nodes/crc.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.095662089Z sos-reports/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.095674599Z sos-reports/sos-report- -> ../_all_nodes/sosreport- [must-gather-vdkwc] OUT 2025-11-25T14:25:28.09568021Z sos-reports/_all_nodes/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.09568475Z webhooks/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.09568958Z webhooks/mutating/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.09569474Z webhooks/validating/ [must-gather-vdkwc] OUT 2025-11-25T14:25:28.09569978Z webhooks/validating/controlplanemachineset.machine.openshift.io.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.09570479Z webhooks/validating/monitoringconfigmaps.openshift.io.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.09571246Z webhooks/validating/multus.openshift.io.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.095785512Z webhooks/validating/network-node-identity.openshift.io.yaml [must-gather-vdkwc] OUT 2025-11-25T14:25:28.099810605Z [must-gather-vdkwc] OUT 2025-11-25T14:25:28.099827995Z sent 1,713 bytes received 32,301,400 bytes 12,921,245.20 bytes/sec [must-gather-vdkwc] OUT 2025-11-25T14:25:28.099838765Z total size is 218,666,342 speedup is 6.77 [must-gather ] OUT 2025-11-25T14:25:28.141194608Z namespace/openshift-must-gather-pjphw deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 7dec01f8-89a2-484c-b000-0ae6c3570049 ClientVersion: 4.18.1 ClusterVersion: Stable at "4.18.1" ClusterOperators: clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing