[must-gather ] OUT 2026-01-26T22:54:04.617786842Z Using must-gather plug-in image: quay.io/openstack-k8s-operators/openstack-must-gather:latest When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: a84dabf3-edcf-4828-b6a1-f9d3a6f02304 ClientVersion: 4.20.10 ClusterVersion: Stable at "4.16.0" ClusterOperators: clusteroperator/kube-apiserver is progressing: NodeInstallerProgressing: 1 node is at revision 12; 0 nodes have achieved new revision 13 clusteroperator/machine-config is degraded because Failed to resync 4.16.0 because: error required MachineConfigPool master is paused and cannot sync until it is unpaused clusteroperator/network is progressing: DaemonSet "/openshift-ovn-kubernetes/ovnkube-node" is not available (awaiting 1 nodes) DaemonSet "/openshift-multus/multus" is not available (awaiting 1 nodes) clusteroperator/openshift-samples is degraded because Samples installation in error at 4.16.0: &errors.errorString{s:"global openshift image configuration prevents the creation of imagestreams using the registry "} clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing [must-gather ] OUT 2026-01-26T22:54:04.680179363Z namespace/openshift-must-gather-72dkc created [must-gather ] OUT 2026-01-26T22:54:04.685214284Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-6qh26 created [must-gather ] OUT 2026-01-26T22:54:04.827962785Z pod for plug-in image quay.io/openstack-k8s-operators/openstack-must-gather:latest created [must-gather-m7hbq] OUT 2026-01-26T22:56:19.13132589Z waiting for gather to complete [must-gather-m7hbq] OUT 2026-01-26T22:56:19.135714175Z downloading gather output [must-gather-m7hbq] OUT 2026-01-26T22:56:19.405941263Z receiving incremental file list [must-gather-m7hbq] OUT 2026-01-26T22:56:19.41661423Z ./ [must-gather-m7hbq] OUT 2026-01-26T22:56:19.417891781Z must-gather.tar.xz [must-gather-m7hbq] OUT 2026-01-26T22:56:19.521946632Z packagemanifests [must-gather-m7hbq] OUT 2026-01-26T22:56:20.352044962Z run.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.352200395Z version [must-gather-m7hbq] OUT 2026-01-26T22:56:20.352306448Z crd/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.352337579Z csv/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.352356839Z ctlplane/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.352439801Z ctlplane/endpoints [must-gather-m7hbq] OUT 2026-01-26T22:56:20.352653837Z ctlplane/services [must-gather-m7hbq] OUT 2026-01-26T22:56:20.352725429Z ctlplane/ovn/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.35276281Z ctlplane/rabbitmq/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.35278049Z dbs/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.35279755Z namespaces/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.352814611Z namespaces/openshift-machine-api/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.353030376Z namespaces/openshift-machine-api/all_resources.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.353317503Z namespaces/openshift-machine-api/events.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.353960728Z namespaces/openshift-machine-api/nad.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.353978219Z namespaces/openshift-machine-api/pvc.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.353987139Z namespaces/openshift-machine-api/buildconfig/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.353995739Z namespaces/openshift-machine-api/cert/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.35400422Z namespaces/openshift-machine-api/certificaterequests/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.35401257Z namespaces/openshift-machine-api/configmaps/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.35402086Z namespaces/openshift-machine-api/cronjobs/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.35402912Z namespaces/openshift-machine-api/daemonset/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.35403786Z namespaces/openshift-machine-api/deployments/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.354046101Z namespaces/openshift-machine-api/deployments/control-plane-machine-set-operator.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.354084262Z namespaces/openshift-machine-api/deployments/machine-api-operator.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.354093202Z namespaces/openshift-machine-api/imagestream/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.354101382Z namespaces/openshift-machine-api/installplans/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.354109652Z namespaces/openshift-machine-api/issuer/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.354117702Z namespaces/openshift-machine-api/jobs/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357278628Z namespaces/openshift-machine-api/poddisruptionbudgets/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357311739Z namespaces/openshift-machine-api/pods/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357323099Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357335809Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/control-plane-machine-set-operator-649bd778b4-tt5tw-describe [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357405091Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/logs/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357419231Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/logs/control-plane-machine-set-operator.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357446522Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357458572Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/machine-api-operator-788b7c6b6c-ctdmb-describe [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357469182Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/logs/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357479993Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/logs/kube-rbac-proxy.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357489863Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/logs/machine-api-operator.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357498503Z namespaces/openshift-machine-api/replicaset/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357506643Z namespaces/openshift-machine-api/replicaset/control-plane-machine-set-operator-649bd778b4.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357515054Z namespaces/openshift-machine-api/replicaset/machine-api-operator-788b7c6b6c.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357523274Z namespaces/openshift-machine-api/routes/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357531424Z namespaces/openshift-machine-api/services/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357539634Z namespaces/openshift-machine-api/services/cluster-autoscaler-operator.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357547734Z namespaces/openshift-machine-api/services/control-plane-machine-set-operator.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357555825Z namespaces/openshift-machine-api/services/machine-api-controllers.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357564275Z namespaces/openshift-machine-api/services/machine-api-operator-machine-webhook.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357572415Z namespaces/openshift-machine-api/services/machine-api-operator-webhook.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357580495Z namespaces/openshift-machine-api/services/machine-api-operator.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357588585Z namespaces/openshift-machine-api/statefulset/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357596835Z namespaces/openshift-machine-api/subscriptions/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357605006Z namespaces/openshift-operators/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357613206Z namespaces/openshift-operators/all_resources.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357621326Z namespaces/openshift-operators/events.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357643637Z namespaces/openshift-operators/nad.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357651977Z namespaces/openshift-operators/pvc.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357660057Z namespaces/openshift-operators/buildconfig/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357668127Z namespaces/openshift-operators/cert/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357676537Z namespaces/openshift-operators/certificaterequests/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357684678Z namespaces/openshift-operators/configmaps/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357704938Z namespaces/openshift-operators/cronjobs/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357713118Z namespaces/openshift-operators/daemonset/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357723058Z namespaces/openshift-operators/deployments/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357731349Z namespaces/openshift-operators/imagestream/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357739459Z namespaces/openshift-operators/installplans/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357747509Z namespaces/openshift-operators/issuer/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357755629Z namespaces/openshift-operators/jobs/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357763749Z namespaces/openshift-operators/poddisruptionbudgets/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.35777181Z namespaces/openshift-operators/pods/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.35777991Z namespaces/openshift-operators/pods/-describe [must-gather-m7hbq] OUT 2026-01-26T22:56:20.35778821Z namespaces/openshift-operators/pods/logs/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.35779634Z namespaces/openshift-operators/replicaset/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.35780446Z namespaces/openshift-operators/routes/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357812501Z namespaces/openshift-operators/services/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357820711Z namespaces/openshift-operators/statefulset/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357828741Z namespaces/openshift-operators/subscriptions/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357836791Z namespaces/openstack-operators/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357863682Z namespaces/openstack-operators/all_resources.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357872402Z namespaces/openstack-operators/events.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357881082Z namespaces/openstack-operators/nad.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357904403Z namespaces/openstack-operators/pvc.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357917763Z namespaces/openstack-operators/buildconfig/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357927983Z namespaces/openstack-operators/cert/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357938513Z namespaces/openstack-operators/certificaterequests/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357948864Z namespaces/openstack-operators/configmaps/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357959254Z namespaces/openstack-operators/cronjobs/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357970194Z namespaces/openstack-operators/daemonset/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357980494Z namespaces/openstack-operators/deployments/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.357990455Z namespaces/openstack-operators/imagestream/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.358002515Z namespaces/openstack-operators/installplans/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.358012365Z namespaces/openstack-operators/issuer/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.358022765Z namespaces/openstack-operators/jobs/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.358032666Z namespaces/openstack-operators/poddisruptionbudgets/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.358042786Z namespaces/openstack-operators/pods/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.358052656Z namespaces/openstack-operators/pods/-describe [must-gather-m7hbq] OUT 2026-01-26T22:56:20.358062216Z namespaces/openstack-operators/pods/logs/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.358084697Z namespaces/openstack-operators/replicaset/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.358095877Z namespaces/openstack-operators/routes/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.358106117Z namespaces/openstack-operators/services/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.358116868Z namespaces/openstack-operators/statefulset/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360187588Z namespaces/openstack-operators/subscriptions/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360199648Z namespaces/openstack/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360207178Z namespaces/openstack/all_resources.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360226589Z namespaces/openstack/events.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360233789Z namespaces/openstack/nad.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360249129Z namespaces/openstack/pvc.log [must-gather-m7hbq] OUT 2026-01-26T22:56:20.36026689Z namespaces/openstack/buildconfig/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.36027109Z namespaces/openstack/cert/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.36027511Z namespaces/openstack/certificaterequests/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.36027919Z namespaces/openstack/configmaps/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.36028644Z namespaces/openstack/cronjobs/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.36029058Z namespaces/openstack/daemonset/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.3602944Z namespaces/openstack/deployments/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.36029821Z namespaces/openstack/imagestream/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360301841Z namespaces/openstack/installplans/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360305611Z namespaces/openstack/issuer/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360309971Z namespaces/openstack/jobs/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360314431Z namespaces/openstack/poddisruptionbudgets/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360320261Z namespaces/openstack/pods/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360324101Z namespaces/openstack/pods/-describe [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360327851Z namespaces/openstack/pods/logs/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360331631Z namespaces/openstack/replicaset/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360335291Z namespaces/openstack/routes/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360338871Z namespaces/openstack/services/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360342471Z namespaces/openstack/statefulset/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360357242Z namespaces/openstack/subscriptions/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360361162Z network/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360365112Z network/l2advertisement.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360368912Z network/ipaddresspools/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360372702Z network/nnce/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360376492Z network/nncp/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360380232Z network/nns/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360383912Z nodes/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360387773Z nodes/crc.describe [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360391463Z nodes/crc.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360396013Z sos-reports/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360400503Z sos-reports/sos-report- -> ../_all_nodes/sosreport- [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360405243Z sos-reports/_all_nodes/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360409503Z webhooks/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360413163Z webhooks/mutating/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360416953Z webhooks/validating/ [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360420803Z webhooks/validating/controlplanemachineset.machine.openshift.io.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360425113Z webhooks/validating/multus.openshift.io.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.360429124Z webhooks/validating/network-node-identity.openshift.io.yaml [must-gather-m7hbq] OUT 2026-01-26T22:56:20.369471522Z [must-gather-m7hbq] OUT 2026-01-26T22:56:20.369503432Z sent 1,316 bytes received 30,044,038 bytes 20,030,236.00 bytes/sec [must-gather-m7hbq] OUT 2026-01-26T22:56:20.369513172Z total size is 212,549,058 speedup is 7.07 [must-gather ] OUT 2026-01-26T22:56:20.399152205Z namespace/openshift-must-gather-72dkc deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: a84dabf3-edcf-4828-b6a1-f9d3a6f02304 ClientVersion: 4.20.10 ClusterVersion: Stable at "4.16.0" ClusterOperators: clusteroperator/machine-config is degraded because Failed to resync 4.16.0 because: error required MachineConfigPool master is paused and cannot sync until it is unpaused clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing