[must-gather ] OUT 2025-09-30T13:50:49.947545712Z Using must-gather plug-in image: quay.io/openstack-k8s-operators/openstack-must-gather:latest When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: a84dabf3-edcf-4828-b6a1-f9d3a6f02304 ClientVersion: 4.19.13 ClusterVersion: Stable at "4.16.0" ClusterOperators: clusteroperator/kube-apiserver is progressing: NodeInstallerProgressing: 1 node is at revision 12; 0 nodes have achieved new revision 13 clusteroperator/machine-config is not upgradeable because One or more machine config pools are degraded, please see `oc get mcp` for further details and resolve before upgrading clusteroperator/openshift-samples is degraded because Samples installation in error at 4.16.0: &errors.errorString{s:"global openshift image configuration prevents the creation of imagestreams using the registry "} clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing [must-gather ] OUT 2025-09-30T13:50:50.064300399Z namespace/openshift-must-gather-ljgbx created [must-gather ] OUT 2025-09-30T13:50:50.067505387Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-ftgf5 created [must-gather ] OUT 2025-09-30T13:50:50.188610063Z pod for plug-in image quay.io/openstack-k8s-operators/openstack-must-gather:latest created [must-gather-dlq95] OUT 2025-09-30T13:52:23.986291068Z waiting for gather to complete [must-gather-dlq95] OUT 2025-09-30T13:52:23.989428314Z downloading gather output [must-gather-dlq95] OUT 2025-09-30T13:52:24.319369578Z receiving incremental file list [must-gather-dlq95] OUT 2025-09-30T13:52:24.328224391Z ./ [must-gather-dlq95] OUT 2025-09-30T13:52:24.328786636Z must-gather.tar.xz [must-gather-dlq95] OUT 2025-09-30T13:52:24.404599492Z packagemanifests [must-gather-dlq95] OUT 2025-09-30T13:52:25.11297547Z run.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.113058252Z version [must-gather-dlq95] OUT 2025-09-30T13:52:25.113064462Z crd/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.113088313Z csv/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.113094813Z ctlplane/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.113104233Z ctlplane/endpoints [must-gather-dlq95] OUT 2025-09-30T13:52:25.113180615Z ctlplane/services [must-gather-dlq95] OUT 2025-09-30T13:52:25.113215096Z ctlplane/ovn/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.113230617Z ctlplane/rabbitmq/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.113235527Z dbs/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.113241147Z namespaces/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.113246777Z namespaces/openshift-machine-api/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.113790732Z namespaces/openshift-machine-api/all_resources.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.113878244Z namespaces/openshift-machine-api/events.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.114055459Z namespaces/openshift-machine-api/nad.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.114175912Z namespaces/openshift-machine-api/pvc.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.114191923Z namespaces/openshift-machine-api/buildconfig/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.114197813Z namespaces/openshift-machine-api/cert/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.114203353Z namespaces/openshift-machine-api/certificaterequests/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.114208993Z namespaces/openshift-machine-api/configmaps/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.114214343Z namespaces/openshift-machine-api/cronjobs/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.114219494Z namespaces/openshift-machine-api/daemonset/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.114224594Z namespaces/openshift-machine-api/deployments/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.114251234Z namespaces/openshift-machine-api/deployments/control-plane-machine-set-operator.yaml [must-gather-dlq95] OUT 2025-09-30T13:52:25.114407999Z namespaces/openshift-machine-api/deployments/machine-api-operator.yaml [must-gather-dlq95] OUT 2025-09-30T13:52:25.11444561Z namespaces/openshift-machine-api/imagestream/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.11445496Z namespaces/openshift-machine-api/installplans/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.1144633Z namespaces/openshift-machine-api/issuer/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.11446939Z namespaces/openshift-machine-api/jobs/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.114481681Z namespaces/openshift-machine-api/pods/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.114486851Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.115015545Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/control-plane-machine-set-operator-649bd778b4-tt5tw-describe [must-gather-dlq95] OUT 2025-09-30T13:52:25.115138829Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/logs/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.11517295Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/logs/control-plane-machine-set-operator.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.115723745Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.115735165Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/machine-api-operator-788b7c6b6c-ctdmb-describe [must-gather-dlq95] OUT 2025-09-30T13:52:25.115747245Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/logs/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.115753236Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/logs/kube-rbac-proxy.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.115758856Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/logs/machine-api-operator.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.115770426Z namespaces/openshift-machine-api/replicaset/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.115881729Z namespaces/openshift-machine-api/replicaset/control-plane-machine-set-operator-649bd778b4.yaml [must-gather-dlq95] OUT 2025-09-30T13:52:25.116411684Z namespaces/openshift-machine-api/replicaset/machine-api-operator-788b7c6b6c.yaml [must-gather-dlq95] OUT 2025-09-30T13:52:25.116487476Z namespaces/openshift-machine-api/routes/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.116494986Z namespaces/openshift-machine-api/services/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.116577478Z namespaces/openshift-machine-api/services/cluster-autoscaler-operator.yaml [must-gather-dlq95] OUT 2025-09-30T13:52:25.116747983Z namespaces/openshift-machine-api/services/control-plane-machine-set-operator.yaml [must-gather-dlq95] OUT 2025-09-30T13:52:25.117137454Z namespaces/openshift-machine-api/services/machine-api-controllers.yaml [must-gather-dlq95] OUT 2025-09-30T13:52:25.117210546Z namespaces/openshift-machine-api/services/machine-api-operator-machine-webhook.yaml [must-gather-dlq95] OUT 2025-09-30T13:52:25.117402681Z namespaces/openshift-machine-api/services/machine-api-operator-webhook.yaml [must-gather-dlq95] OUT 2025-09-30T13:52:25.117967946Z namespaces/openshift-machine-api/services/machine-api-operator.yaml [must-gather-dlq95] OUT 2025-09-30T13:52:25.118008407Z namespaces/openshift-machine-api/statefulset/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.118014398Z namespaces/openshift-machine-api/subscriptions/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.118019868Z namespaces/openstack-operators/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.11810196Z namespaces/openstack-operators/all_resources.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.118179172Z namespaces/openstack-operators/events.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.118246614Z namespaces/openstack-operators/nad.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.118393768Z namespaces/openstack-operators/pvc.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.118400838Z namespaces/openstack-operators/buildconfig/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119218071Z namespaces/openstack-operators/cert/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119227381Z namespaces/openstack-operators/certificaterequests/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119247531Z namespaces/openstack-operators/configmaps/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119253201Z namespaces/openstack-operators/cronjobs/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119285722Z namespaces/openstack-operators/daemonset/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119292533Z namespaces/openstack-operators/deployments/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119297603Z namespaces/openstack-operators/imagestream/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119302573Z namespaces/openstack-operators/installplans/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119307493Z namespaces/openstack-operators/issuer/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119312493Z namespaces/openstack-operators/jobs/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119326093Z namespaces/openstack-operators/pods/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119331924Z namespaces/openstack-operators/pods/-describe [must-gather-dlq95] OUT 2025-09-30T13:52:25.119337344Z namespaces/openstack-operators/pods/logs/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119342474Z namespaces/openstack-operators/replicaset/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119453817Z namespaces/openstack-operators/routes/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119460087Z namespaces/openstack-operators/services/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119466027Z namespaces/openstack-operators/statefulset/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119472378Z namespaces/openstack-operators/subscriptions/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119478688Z namespaces/openstack/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119484838Z namespaces/openstack/all_resources.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.119491248Z namespaces/openstack/events.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.119496938Z namespaces/openstack/nad.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.119520869Z namespaces/openstack/pvc.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.119527059Z namespaces/openstack/buildconfig/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.119533059Z namespaces/openstack/cert/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.11955324Z namespaces/openstack/certificaterequests/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.11955891Z namespaces/openstack/configmaps/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.1195645Z namespaces/openstack/cronjobs/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.11956994Z namespaces/openstack/daemonset/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.11957541Z namespaces/openstack/deployments/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.11958022Z namespaces/openstack/imagestream/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120159266Z namespaces/openstack/installplans/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120173997Z namespaces/openstack/issuer/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120178917Z namespaces/openstack/jobs/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120183697Z namespaces/openstack/pods/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120188497Z namespaces/openstack/pods/-describe [must-gather-dlq95] OUT 2025-09-30T13:52:25.120193287Z namespaces/openstack/pods/logs/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120198267Z namespaces/openstack/replicaset/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120203068Z namespaces/openstack/routes/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120207828Z namespaces/openstack/services/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120212578Z namespaces/openstack/statefulset/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120218928Z namespaces/openstack/subscriptions/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120239489Z network/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120244389Z network/l2advertisement.log [must-gather-dlq95] OUT 2025-09-30T13:52:25.120249159Z network/ipaddresspools/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120259749Z network/nnce/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120264789Z network/nncp/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120269609Z network/nns/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120274499Z nodes/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.12027941Z nodes/crc.describe [must-gather-dlq95] OUT 2025-09-30T13:52:25.12029783Z nodes/crc.yaml [must-gather-dlq95] OUT 2025-09-30T13:52:25.120321101Z sos-reports/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120330161Z sos-reports/sos-report- -> ../_all_nodes/sosreport- [must-gather-dlq95] OUT 2025-09-30T13:52:25.120335051Z sos-reports/_all_nodes/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120340041Z webhooks/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120345521Z webhooks/mutating/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120351062Z webhooks/validating/ [must-gather-dlq95] OUT 2025-09-30T13:52:25.120357062Z webhooks/validating/controlplanemachineset.machine.openshift.io.yaml [must-gather-dlq95] OUT 2025-09-30T13:52:25.120363022Z webhooks/validating/multus.openshift.io.yaml [must-gather-dlq95] OUT 2025-09-30T13:52:25.120371092Z webhooks/validating/network-node-identity.openshift.io.yaml [must-gather-dlq95] OUT 2025-09-30T13:52:25.124066863Z [must-gather-dlq95] OUT 2025-09-30T13:52:25.124153606Z sent 1,129 bytes received 26,357,270 bytes 17,572,266.00 bytes/sec [must-gather-dlq95] OUT 2025-09-30T13:52:25.124159986Z total size is 175,835,364 speedup is 6.67 [must-gather ] OUT 2025-09-30T13:52:25.154180888Z namespace/openshift-must-gather-ljgbx deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: a84dabf3-edcf-4828-b6a1-f9d3a6f02304 ClientVersion: 4.19.13 ClusterVersion: Stable at "4.16.0" ClusterOperators: clusteroperator/machine-config is not upgradeable because One or more machine config pools are degraded, please see `oc get mcp` for further details and resolve before upgrading clusteroperator/openshift-samples is degraded because Samples installation in error at 4.16.0: &errors.errorString{s:"global openshift image configuration prevents the creation of imagestreams using the registry "} clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing