[must-gather ] OUT 2026-01-06T00:16:07.657639623Z Using must-gather plug-in image: quay.io/openstack-k8s-operators/openstack-must-gather:latest When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: a84dabf3-edcf-4828-b6a1-f9d3a6f02304 ClientVersion: 4.20.8 ClusterVersion: Stable at "4.16.0" ClusterOperators: clusteroperator/kube-apiserver is progressing: NodeInstallerProgressing: 1 node is at revision 12; 0 nodes have achieved new revision 13 clusteroperator/machine-config is degraded because Failed to resync 4.16.0 because: error required MachineConfigPool master is paused and cannot sync until it is unpaused clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing [must-gather ] OUT 2026-01-06T00:16:07.718224087Z namespace/openshift-must-gather-wcpwz created [must-gather ] OUT 2026-01-06T00:16:07.722354275Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-mp9rj created [must-gather ] OUT 2026-01-06T00:16:07.877037989Z pod for plug-in image quay.io/openstack-k8s-operators/openstack-must-gather:latest created [must-gather-j7vmj] OUT 2026-01-06T00:17:56.992396889Z waiting for gather to complete [must-gather-j7vmj] OUT 2026-01-06T00:17:56.996855945Z downloading gather output [must-gather-j7vmj] OUT 2026-01-06T00:17:57.303771737Z receiving incremental file list [must-gather-j7vmj] OUT 2026-01-06T00:17:57.311822267Z ./ [must-gather-j7vmj] OUT 2026-01-06T00:17:57.312043863Z must-gather.tar.xz [must-gather-j7vmj] OUT 2026-01-06T00:17:57.383364742Z packagemanifests [must-gather-j7vmj] OUT 2026-01-06T00:17:58.210781638Z run.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.210893511Z version [must-gather-j7vmj] OUT 2026-01-06T00:17:58.210901682Z crd/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.210905842Z csv/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.210909822Z ctlplane/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.211011104Z ctlplane/endpoints [must-gather-j7vmj] OUT 2026-01-06T00:17:58.21123635Z ctlplane/services [must-gather-j7vmj] OUT 2026-01-06T00:17:58.211247571Z ctlplane/ovn/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.211253511Z ctlplane/rabbitmq/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.211258211Z dbs/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.211266971Z namespaces/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.211326883Z namespaces/openshift-machine-api/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.211529958Z namespaces/openshift-machine-api/all_resources.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.211732283Z namespaces/openshift-machine-api/events.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.21200721Z namespaces/openshift-machine-api/nad.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.212163844Z namespaces/openshift-machine-api/pvc.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.212177135Z namespaces/openshift-machine-api/buildconfig/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.212181775Z namespaces/openshift-machine-api/cert/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.212186615Z namespaces/openshift-machine-api/certificaterequests/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.212191015Z namespaces/openshift-machine-api/configmaps/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.212195525Z namespaces/openshift-machine-api/cronjobs/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.212199815Z namespaces/openshift-machine-api/daemonset/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.212204606Z namespaces/openshift-machine-api/deployments/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.212414591Z namespaces/openshift-machine-api/deployments/control-plane-machine-set-operator.yaml [must-gather-j7vmj] OUT 2026-01-06T00:17:58.212516614Z namespaces/openshift-machine-api/deployments/machine-api-operator.yaml [must-gather-j7vmj] OUT 2026-01-06T00:17:58.212700598Z namespaces/openshift-machine-api/imagestream/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.212717969Z namespaces/openshift-machine-api/installplans/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.212744Z namespaces/openshift-machine-api/issuer/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.21275038Z namespaces/openshift-machine-api/jobs/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.21275697Z namespaces/openshift-machine-api/poddisruptionbudgets/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.21276209Z namespaces/openshift-machine-api/pods/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.21276763Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.212781041Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/control-plane-machine-set-operator-649bd778b4-tt5tw-describe [must-gather-j7vmj] OUT 2026-01-06T00:17:58.213010387Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/logs/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.213057458Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/logs/control-plane-machine-set-operator.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.213266083Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.213323315Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/machine-api-operator-788b7c6b6c-ctdmb-describe [must-gather-j7vmj] OUT 2026-01-06T00:17:58.21350988Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/logs/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.213572191Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/logs/kube-rbac-proxy.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.213804447Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/logs/machine-api-operator.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.213946301Z namespaces/openshift-machine-api/replicaset/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.213965021Z namespaces/openshift-machine-api/replicaset/control-plane-machine-set-operator-649bd778b4.yaml [must-gather-j7vmj] OUT 2026-01-06T00:17:58.214163617Z namespaces/openshift-machine-api/replicaset/machine-api-operator-788b7c6b6c.yaml [must-gather-j7vmj] OUT 2026-01-06T00:17:58.214226868Z namespaces/openshift-machine-api/routes/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.21429053Z namespaces/openshift-machine-api/services/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.214386222Z namespaces/openshift-machine-api/services/cluster-autoscaler-operator.yaml [must-gather-j7vmj] OUT 2026-01-06T00:17:58.214566907Z namespaces/openshift-machine-api/services/control-plane-machine-set-operator.yaml [must-gather-j7vmj] OUT 2026-01-06T00:17:58.214735902Z namespaces/openshift-machine-api/services/machine-api-controllers.yaml [must-gather-j7vmj] OUT 2026-01-06T00:17:58.214891926Z namespaces/openshift-machine-api/services/machine-api-operator-machine-webhook.yaml [must-gather-j7vmj] OUT 2026-01-06T00:17:58.215114491Z namespaces/openshift-machine-api/services/machine-api-operator-webhook.yaml [must-gather-j7vmj] OUT 2026-01-06T00:17:58.215263325Z namespaces/openshift-machine-api/services/machine-api-operator.yaml [must-gather-j7vmj] OUT 2026-01-06T00:17:58.215325137Z namespaces/openshift-machine-api/statefulset/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.215332517Z namespaces/openshift-machine-api/subscriptions/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.215337317Z namespaces/openstack-operators/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.215499091Z namespaces/openstack-operators/all_resources.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.215633495Z namespaces/openstack-operators/events.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.215789189Z namespaces/openstack-operators/nad.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.215969414Z namespaces/openstack-operators/pvc.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.215984154Z namespaces/openstack-operators/buildconfig/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216005745Z namespaces/openstack-operators/cert/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216018555Z namespaces/openstack-operators/certificaterequests/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216027845Z namespaces/openstack-operators/configmaps/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216032885Z namespaces/openstack-operators/cronjobs/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216037875Z namespaces/openstack-operators/daemonset/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216042536Z namespaces/openstack-operators/deployments/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216047786Z namespaces/openstack-operators/imagestream/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216052526Z namespaces/openstack-operators/installplans/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216056956Z namespaces/openstack-operators/issuer/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216061926Z namespaces/openstack-operators/jobs/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216066946Z namespaces/openstack-operators/poddisruptionbudgets/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216071366Z namespaces/openstack-operators/pods/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216083757Z namespaces/openstack-operators/pods/-describe [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216098217Z namespaces/openstack-operators/pods/logs/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216105737Z namespaces/openstack-operators/replicaset/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216112427Z namespaces/openstack-operators/routes/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216118368Z namespaces/openstack-operators/services/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216124038Z namespaces/openstack-operators/statefulset/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216135258Z namespaces/openstack-operators/subscriptions/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216141198Z namespaces/openstack/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216441916Z namespaces/openstack/all_resources.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.21657807Z namespaces/openstack/events.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216767114Z namespaces/openstack/nad.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.216908618Z namespaces/openstack/pvc.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217146304Z namespaces/openstack/buildconfig/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217165645Z namespaces/openstack/cert/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217175645Z namespaces/openstack/certificaterequests/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217185455Z namespaces/openstack/configmaps/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217223916Z namespaces/openstack/cronjobs/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217234587Z namespaces/openstack/daemonset/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217403331Z namespaces/openstack/deployments/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217412971Z namespaces/openstack/imagestream/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217422302Z namespaces/openstack/installplans/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217430522Z namespaces/openstack/issuer/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217440282Z namespaces/openstack/jobs/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217448652Z namespaces/openstack/poddisruptionbudgets/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217457893Z namespaces/openstack/pods/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217466783Z namespaces/openstack/pods/-describe [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217475203Z namespaces/openstack/pods/logs/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217503464Z namespaces/openstack/replicaset/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217540105Z namespaces/openstack/routes/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217566725Z namespaces/openstack/services/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217575606Z namespaces/openstack/statefulset/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217584056Z namespaces/openstack/subscriptions/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217592996Z network/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217617467Z network/l2advertisement.log [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217704399Z network/ipaddresspools/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.21773119Z network/nnce/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217793751Z network/nncp/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217843313Z network/nns/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217852773Z nodes/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.217870973Z nodes/crc.describe [must-gather-j7vmj] OUT 2026-01-06T00:17:58.218193682Z nodes/crc.yaml [must-gather-j7vmj] OUT 2026-01-06T00:17:58.218289924Z sos-reports/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.218345886Z sos-reports/sos-report- -> ../_all_nodes/sosreport- [must-gather-j7vmj] OUT 2026-01-06T00:17:58.218359096Z sos-reports/_all_nodes/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.218383197Z webhooks/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.218390187Z webhooks/mutating/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.218397307Z webhooks/validating/ [must-gather-j7vmj] OUT 2026-01-06T00:17:58.218545351Z webhooks/validating/controlplanemachineset.machine.openshift.io.yaml [must-gather-j7vmj] OUT 2026-01-06T00:17:58.218604782Z webhooks/validating/multus.openshift.io.yaml [must-gather-j7vmj] OUT 2026-01-06T00:17:58.218867389Z webhooks/validating/network-node-identity.openshift.io.yaml [must-gather-j7vmj] OUT 2026-01-06T00:17:58.222574496Z [must-gather-j7vmj] OUT 2026-01-06T00:17:58.222593556Z sent 1,145 bytes received 26,978,910 bytes 17,986,703.33 bytes/sec [must-gather-j7vmj] OUT 2026-01-06T00:17:58.222611547Z total size is 188,103,257 speedup is 6.97 [must-gather ] OUT 2026-01-06T00:17:58.256010287Z namespace/openshift-must-gather-wcpwz deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: a84dabf3-edcf-4828-b6a1-f9d3a6f02304 ClientVersion: 4.20.8 ClusterVersion: Stable at "4.16.0" ClusterOperators: clusteroperator/machine-config is degraded because Failed to resync 4.16.0 because: error required MachineConfigPool master is paused and cannot sync until it is unpaused clusteroperator/openshift-controller-manager is progressing: Progressing: deployment/route-controller-manager: observed generation is 17, desired generation is 18. clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing