[must-gather ] OUT 2025-09-30T10:55:07.450911694Z Using must-gather plug-in image: quay.io/openstack-k8s-operators/openstack-must-gather:latest When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: a84dabf3-edcf-4828-b6a1-f9d3a6f02304 ClientVersion: 4.19.13 ClusterVersion: Stable at "4.16.0" ClusterOperators: clusteroperator/authentication is not available (WellKnownAvailable: The well-known endpoint is not yet available: failed to get API server IPs: unable to find kube api server endpointLister port: &v1.Endpoints{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kubernetes", GenerateName:"", Namespace:"default", SelfLink:"", UID:"9374e9d0-f290-4faa-94c7-262a199a1d45", ResourceVersion:"43169", Generation:0, CreationTimestamp:time.Date(2024, time.June, 26, 12, 38, 3, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"endpointslice.kubernetes.io/skip-mirror":"true"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-apiserver", Operation:"Update", APIVersion:"v1", Time:time.Date(2025, time.August, 13, 20, 8, 43, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc002418c60), Subresource:""}}}, Subsets:[]v1.EndpointSubset(nil)} (check kube-apiserver that it deploys correctly)) because All is well clusteroperator/kube-apiserver is progressing: NodeInstallerProgressing: 1 node is at revision 12; 0 nodes have achieved new revision 13 clusteroperator/machine-config is degraded because Failed to resync 4.16.0 because: error required MachineConfigPool master is paused and cannot sync until it is unpaused clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing [must-gather ] OUT 2025-09-30T10:55:07.499499805Z namespace/openshift-must-gather-zfjp5 created [must-gather ] OUT 2025-09-30T10:55:07.504564267Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-2sttx created [must-gather ] OUT 2025-09-30T10:55:07.707885185Z pod for plug-in image quay.io/openstack-k8s-operators/openstack-must-gather:latest created [must-gather-fshwz] POD 2025-09-30T10:55:14.345905183Z volume percentage checker started..... [must-gather-fshwz] POD 2025-09-30T10:55:14.353442443Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:55:14.510022887Z Error from server (NotFound): pods "openstackclient" not found [must-gather-fshwz] POD 2025-09-30T10:55:14.659166264Z Will retrieve SOS reports from nodes [must-gather-fshwz] POD 2025-09-30T10:55:14.800581085Z error: the server doesn't have a resource type "openstackdataplanenodesets" [must-gather-fshwz] POD 2025-09-30T10:55:15.452489412Z Gathering CRDs [must-gather-fshwz] POD 2025-09-30T10:55:15.726527080Z Gathering CRs [must-gather-fshwz] POD 2025-09-30T10:55:15.875061410Z Writing validating webhooks [must-gather-fshwz] POD 2025-09-30T10:55:16.019964294Z Writing mutating webhooks [must-gather-fshwz] POD 2025-09-30T10:55:19.365064274Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:55:20.675076333Z Gathering secrets in namespace openstack [must-gather-fshwz] POD 2025-09-30T10:55:24.375387721Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:55:24.380170188Z Gathering csv [must-gather-fshwz] POD 2025-09-30T10:55:24.565776124Z Gathering subscription [must-gather-fshwz] POD 2025-09-30T10:55:24.693037318Z Gathering installplan [must-gather-fshwz] POD 2025-09-30T10:55:25.099847066Z No resources found in openstack namespace. [must-gather-fshwz] POD 2025-09-30T10:55:25.107219332Z No resources found in openstack namespace. [must-gather-fshwz] POD 2025-09-30T10:55:25.265282096Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather-fshwz] POD 2025-09-30T10:55:25.290332052Z No resources found in openstack namespace. [must-gather-fshwz] POD 2025-09-30T10:55:25.327478980Z No resources found in openstack namespace. [must-gather-fshwz] POD 2025-09-30T10:55:29.388233203Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:55:30.496495797Z Gathering secrets in namespace openstack-operators [must-gather-fshwz] POD 2025-09-30T10:55:34.133885181Z Gathering csv [must-gather-fshwz] POD 2025-09-30T10:55:34.327105719Z Gathering subscription [must-gather-fshwz] POD 2025-09-30T10:55:34.400918192Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:55:34.477555470Z Gathering installplan [must-gather-fshwz] POD 2025-09-30T10:55:34.927127317Z No resources found in openstack-operators namespace. [must-gather-fshwz] POD 2025-09-30T10:55:34.981389360Z No resources found in openstack-operators namespace. [must-gather-fshwz] POD 2025-09-30T10:55:35.068495566Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather-fshwz] POD 2025-09-30T10:55:35.092723901Z No resources found in openstack-operators namespace. [must-gather-fshwz] POD 2025-09-30T10:55:35.145506984Z No resources found in openstack-operators namespace. [must-gather-fshwz] POD 2025-09-30T10:55:37.098967578Z Gathering secrets in namespace baremetal-operator-system [must-gather-fshwz] POD 2025-09-30T10:55:39.413044615Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:55:41.216777023Z Gathering secrets in namespace openshift-machine-api [must-gather-fshwz] POD 2025-09-30T10:55:44.422916292Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:55:45.001620771Z Gathering csv [must-gather-fshwz] POD 2025-09-30T10:55:45.148958335Z Gathering subscription [must-gather-fshwz] POD 2025-09-30T10:55:45.295484886Z Gathering installplan [must-gather-fshwz] POD 2025-09-30T10:55:45.725729172Z No resources found in openshift-machine-api namespace. [must-gather-fshwz] POD 2025-09-30T10:55:45.752632019Z Dump logs for control-plane-machine-set-operator from control-plane-machine-set-operator-649bd778b4-tt5tw pod [must-gather-fshwz] POD 2025-09-30T10:55:45.768796189Z Dump logs for kube-rbac-proxy from machine-api-operator-788b7c6b6c-ctdmb pod [must-gather-fshwz] POD 2025-09-30T10:55:45.883051962Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather-fshwz] POD 2025-09-30T10:55:45.930148466Z Dump logs for machine-api-operator from machine-api-operator-788b7c6b6c-ctdmb pod [must-gather-fshwz] POD 2025-09-30T10:55:46.160177190Z Dump services: cluster-autoscaler-operator [must-gather-fshwz] POD 2025-09-30T10:55:46.164262159Z Dump services: control-plane-machine-set-operator [must-gather-fshwz] POD 2025-09-30T10:55:46.168340558Z Dump services: machine-api-controllers [must-gather-fshwz] POD 2025-09-30T10:55:46.176106025Z Dump services: machine-api-operator [must-gather-fshwz] POD 2025-09-30T10:55:46.180670126Z Dump services: machine-api-operator-machine-webhook [must-gather-fshwz] POD 2025-09-30T10:55:46.345394591Z Dump services: machine-api-operator-webhook [must-gather-fshwz] POD 2025-09-30T10:55:46.792465366Z Dump replicaset: control-plane-machine-set-operator-649bd778b4 [must-gather-fshwz] POD 2025-09-30T10:55:46.795615329Z Dump replicaset: machine-api-operator-788b7c6b6c [must-gather-fshwz] POD 2025-09-30T10:55:46.945548072Z Dump deployments: control-plane-machine-set-operator [must-gather-fshwz] POD 2025-09-30T10:55:46.949337203Z Dump deployments: machine-api-operator [must-gather-fshwz] POD 2025-09-30T10:55:49.437551587Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:55:51.656156251Z Gathering secrets in namespace cert-manager [must-gather-fshwz] POD 2025-09-30T10:55:54.456738041Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:55:55.449324871Z Gathering csv [must-gather-fshwz] POD 2025-09-30T10:55:55.611337755Z Gathering subscription [must-gather-fshwz] POD 2025-09-30T10:55:55.749894654Z Gathering installplan [must-gather-fshwz] POD 2025-09-30T10:55:56.211879416Z No resources found in cert-manager namespace. [must-gather-fshwz] POD 2025-09-30T10:55:56.301213384Z Dump logs for cert-manager-controller from cert-manager-67c98b89c8-czjj6 pod [must-gather-fshwz] POD 2025-09-30T10:55:56.319605814Z Dump logs for cert-manager-cainjector from cert-manager-cainjector-5c5695d979-zjh57 pod [must-gather-fshwz] POD 2025-09-30T10:55:56.354559335Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather-fshwz] POD 2025-09-30T10:55:56.494096470Z Dump logs for cert-manager-webhook from cert-manager-webhook-7f9f8648b9-44xtp pod [must-gather-fshwz] POD 2025-09-30T10:55:56.690555731Z Dump services: cert-manager [must-gather-fshwz] POD 2025-09-30T10:55:56.693921031Z Dump services: cert-manager-webhook [must-gather-fshwz] POD 2025-09-30T10:55:57.117042857Z Dump replicaset: cert-manager-67c98b89c8 [must-gather-fshwz] POD 2025-09-30T10:55:57.120468168Z Dump replicaset: cert-manager-cainjector-5c5695d979 [must-gather-fshwz] POD 2025-09-30T10:55:57.124028393Z Dump replicaset: cert-manager-webhook-7f9f8648b9 [must-gather-fshwz] POD 2025-09-30T10:55:57.285285356Z Dump deployments: cert-manager [must-gather-fshwz] POD 2025-09-30T10:55:57.289070557Z Dump deployments: cert-manager-cainjector [must-gather-fshwz] POD 2025-09-30T10:55:57.293143466Z Dump deployments: cert-manager-webhook [must-gather-fshwz] POD 2025-09-30T10:55:58.695524417Z Gathering secrets in namespace openshift-nmstate [must-gather-fshwz] POD 2025-09-30T10:55:59.298714138Z Gathering secrets in namespace openshift-operators-redhat [must-gather-fshwz] POD 2025-09-30T10:55:59.471589471Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:55:59.988075054Z Gathering secrets in namespace openshift-logging [must-gather-fshwz] POD 2025-09-30T10:56:00.972478885Z Gathering secrets in namespace metallb-system [must-gather-fshwz] POD 2025-09-30T10:56:02.052167694Z error: the server doesn't have a resource type "nncp" [must-gather-fshwz] POD 2025-09-30T10:56:02.326273262Z error: the server doesn't have a resource type "nnce" [must-gather-fshwz] POD 2025-09-30T10:56:02.665655129Z error: the server doesn't have a resource type "nns" [must-gather-fshwz] POD 2025-09-30T10:56:02.894341328Z error: the server doesn't have a resource type "ipaddresspools" [must-gather-fshwz] POD 2025-09-30T10:56:03.124403124Z error: the server doesn't have a resource type "l2advertisement" [must-gather-fshwz] POD 2025-09-30T10:56:03.149691658Z Gather ctlplane service info: openstack [must-gather-fshwz] POD 2025-09-30T10:56:03.180597401Z Gather ctlplane service info: ovn [must-gather-fshwz] POD 2025-09-30T10:56:03.343221081Z Error from server (NotFound): pods "openstackclient" not found [must-gather-fshwz] POD 2025-09-30T10:56:03.434984604Z Error from server (NotFound): pods "openstackclient" not found [must-gather-fshwz] POD 2025-09-30T10:56:03.478378030Z Pod ovsdbserver-nb-0 not found in namespace openstack, skipping OVN NB database collection [must-gather-fshwz] POD 2025-09-30T10:56:03.700509514Z Pod ovsdbserver-sb-0 not found in namespace openstack, skipping OVN SB database collection [must-gather-fshwz] POD 2025-09-30T10:56:03.703144745Z Gather ctlplane service info: rabbitmq [must-gather-fshwz] POD 2025-09-30T10:56:03.999696401Z Error from server (NotFound): pods "openstackclient" not found [must-gather-fshwz] POD 2025-09-30T10:56:04.316846505Z error: the server doesn't have a resource type "openstackcontrolplane" [must-gather-fshwz] POD 2025-09-30T10:56:04.492536183Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:56:06.826560671Z tar: Removing leading `/' from member names [must-gather-fshwz] POD 2025-09-30T10:56:09.511850292Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:56:14.541612749Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:56:19.557627599Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:56:24.586614546Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:56:29.603895360Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:56:34.624839542Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:56:39.630077256Z volume usage percentage 0 [must-gather-fshwz] POD 2025-09-30T10:56:44.197446659Z The /must-gather/must-gather.tar.xz now can be attached to the support case. [must-gather-fshwz] OUT 2025-09-30T10:56:45.22562733Z waiting for gather to complete [must-gather-fshwz] OUT 2025-09-30T10:56:45.228183082Z downloading gather output [must-gather-fshwz] OUT 2025-09-30T10:56:45.467607433Z receiving incremental file list [must-gather-fshwz] OUT 2025-09-30T10:56:45.477183298Z ./ [must-gather-fshwz] OUT 2025-09-30T10:56:45.47754264Z must-gather.tar.xz [must-gather-fshwz] OUT 2025-09-30T10:56:45.525616394Z packagemanifests [must-gather-fshwz] OUT 2025-09-30T10:56:46.282362254Z run.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.282482578Z version [must-gather-fshwz] OUT 2025-09-30T10:56:46.282668503Z crd/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.282677454Z csv/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.282682814Z ctlplane/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.282796388Z ctlplane/endpoints [must-gather-fshwz] OUT 2025-09-30T10:56:46.282934072Z ctlplane/services [must-gather-fshwz] OUT 2025-09-30T10:56:46.282963243Z ctlplane/ovn/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.283000014Z ctlplane/rabbitmq/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.283005764Z dbs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.283010765Z namespaces/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.283015735Z namespaces/cert-manager/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.283070656Z namespaces/cert-manager/all_resources.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.283299393Z namespaces/cert-manager/events.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.283464438Z namespaces/cert-manager/nad.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.283582352Z namespaces/cert-manager/pvc.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.283631444Z namespaces/cert-manager/buildconfig/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.283649354Z namespaces/cert-manager/cert/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.283654494Z namespaces/cert-manager/certificaterequests/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.283659434Z namespaces/cert-manager/configmaps/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.283664375Z namespaces/cert-manager/cronjobs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.283669335Z namespaces/cert-manager/daemonset/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.283677175Z namespaces/cert-manager/deployments/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.283710936Z namespaces/cert-manager/deployments/cert-manager-cainjector.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.283846531Z namespaces/cert-manager/deployments/cert-manager-webhook.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.284003956Z namespaces/cert-manager/deployments/cert-manager.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.284086828Z namespaces/cert-manager/imagestream/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.284097469Z namespaces/cert-manager/installplans/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.284103279Z namespaces/cert-manager/issuer/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.284108889Z namespaces/cert-manager/jobs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.284114759Z namespaces/cert-manager/pods/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.284123639Z namespaces/cert-manager/pods/cert-manager-67c98b89c8-czjj6/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.284161651Z namespaces/cert-manager/pods/cert-manager-67c98b89c8-czjj6/cert-manager-67c98b89c8-czjj6-describe [must-gather-fshwz] OUT 2025-09-30T10:56:46.284241823Z namespaces/cert-manager/pods/cert-manager-67c98b89c8-czjj6/logs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.284303185Z namespaces/cert-manager/pods/cert-manager-67c98b89c8-czjj6/logs/cert-manager-controller.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.28474746Z namespaces/cert-manager/pods/cert-manager-cainjector-5c5695d979-zjh57/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.284852683Z namespaces/cert-manager/pods/cert-manager-cainjector-5c5695d979-zjh57/cert-manager-cainjector-5c5695d979-zjh57-describe [must-gather-fshwz] OUT 2025-09-30T10:56:46.285006348Z namespaces/cert-manager/pods/cert-manager-cainjector-5c5695d979-zjh57/logs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.285045469Z namespaces/cert-manager/pods/cert-manager-cainjector-5c5695d979-zjh57/logs/cert-manager-cainjector.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.285159683Z namespaces/cert-manager/pods/cert-manager-webhook-7f9f8648b9-44xtp/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.285222125Z namespaces/cert-manager/pods/cert-manager-webhook-7f9f8648b9-44xtp/cert-manager-webhook-7f9f8648b9-44xtp-describe [must-gather-fshwz] OUT 2025-09-30T10:56:46.285313538Z namespaces/cert-manager/pods/cert-manager-webhook-7f9f8648b9-44xtp/logs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.28537341Z namespaces/cert-manager/pods/cert-manager-webhook-7f9f8648b9-44xtp/logs/cert-manager-webhook.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.285447642Z namespaces/cert-manager/replicaset/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.285515054Z namespaces/cert-manager/replicaset/cert-manager-67c98b89c8.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.285658159Z namespaces/cert-manager/replicaset/cert-manager-cainjector-5c5695d979.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.285771503Z namespaces/cert-manager/replicaset/cert-manager-webhook-7f9f8648b9.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.285848345Z namespaces/cert-manager/routes/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.285873426Z namespaces/cert-manager/services/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.285914537Z namespaces/cert-manager/services/cert-manager-webhook.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.286068601Z namespaces/cert-manager/services/cert-manager.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.286135223Z namespaces/cert-manager/statefulset/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.286140834Z namespaces/cert-manager/subscriptions/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.286151854Z namespaces/openshift-machine-api/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.286198355Z namespaces/openshift-machine-api/all_resources.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.286319869Z namespaces/openshift-machine-api/events.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.286523246Z namespaces/openshift-machine-api/nad.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.28664719Z namespaces/openshift-machine-api/pvc.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.286691491Z namespaces/openshift-machine-api/buildconfig/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.286698002Z namespaces/openshift-machine-api/cert/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.286703222Z namespaces/openshift-machine-api/certificaterequests/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.286711082Z namespaces/openshift-machine-api/configmaps/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.286716082Z namespaces/openshift-machine-api/cronjobs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.286720992Z namespaces/openshift-machine-api/daemonset/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.286726082Z namespaces/openshift-machine-api/deployments/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.286763054Z namespaces/openshift-machine-api/deployments/control-plane-machine-set-operator.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.286885738Z namespaces/openshift-machine-api/deployments/machine-api-operator.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.287028422Z namespaces/openshift-machine-api/imagestream/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.287040253Z namespaces/openshift-machine-api/installplans/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.287045193Z namespaces/openshift-machine-api/issuer/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.287050073Z namespaces/openshift-machine-api/jobs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.287066913Z namespaces/openshift-machine-api/pods/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.287071874Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.287101735Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/control-plane-machine-set-operator-649bd778b4-tt5tw-describe [must-gather-fshwz] OUT 2025-09-30T10:56:46.287220378Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/logs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.28727208Z namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-649bd778b4-tt5tw/logs/control-plane-machine-set-operator.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.287380984Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.287432935Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/machine-api-operator-788b7c6b6c-ctdmb-describe [must-gather-fshwz] OUT 2025-09-30T10:56:46.287543519Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/logs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.28759396Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/logs/kube-rbac-proxy.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.287737395Z namespaces/openshift-machine-api/pods/machine-api-operator-788b7c6b6c-ctdmb/logs/machine-api-operator.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.287816568Z namespaces/openshift-machine-api/replicaset/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.28789089Z namespaces/openshift-machine-api/replicaset/control-plane-machine-set-operator-649bd778b4.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.288066056Z namespaces/openshift-machine-api/replicaset/machine-api-operator-788b7c6b6c.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.288163129Z namespaces/openshift-machine-api/routes/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.288170309Z namespaces/openshift-machine-api/services/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.288219361Z namespaces/openshift-machine-api/services/cluster-autoscaler-operator.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.288332314Z namespaces/openshift-machine-api/services/control-plane-machine-set-operator.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.288458018Z namespaces/openshift-machine-api/services/machine-api-controllers.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.288570302Z namespaces/openshift-machine-api/services/machine-api-operator-machine-webhook.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.288743718Z namespaces/openshift-machine-api/services/machine-api-operator-webhook.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.288879501Z namespaces/openshift-machine-api/services/machine-api-operator.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.288933273Z namespaces/openshift-machine-api/statefulset/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.288939373Z namespaces/openshift-machine-api/subscriptions/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.288946733Z namespaces/openstack-operators/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289026466Z namespaces/openstack-operators/all_resources.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.289140909Z namespaces/openstack-operators/events.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.289248193Z namespaces/openstack-operators/nad.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.289355526Z namespaces/openstack-operators/pvc.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.289404478Z namespaces/openstack-operators/buildconfig/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289410588Z namespaces/openstack-operators/cert/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289417118Z namespaces/openstack-operators/certificaterequests/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289424499Z namespaces/openstack-operators/configmaps/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289429619Z namespaces/openstack-operators/cronjobs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289434519Z namespaces/openstack-operators/daemonset/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289439989Z namespaces/openstack-operators/deployments/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289445249Z namespaces/openstack-operators/imagestream/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.28945802Z namespaces/openstack-operators/installplans/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.28946521Z namespaces/openstack-operators/issuer/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.28947176Z namespaces/openstack-operators/jobs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.28947766Z namespaces/openstack-operators/pods/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289487341Z namespaces/openstack-operators/pods/-describe [must-gather-fshwz] OUT 2025-09-30T10:56:46.289514691Z namespaces/openstack-operators/pods/logs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289522882Z namespaces/openstack-operators/replicaset/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289529882Z namespaces/openstack-operators/routes/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289534812Z namespaces/openstack-operators/services/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289539622Z namespaces/openstack-operators/statefulset/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289544542Z namespaces/openstack-operators/subscriptions/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289549403Z namespaces/openstack/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289586464Z namespaces/openstack/all_resources.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.289699667Z namespaces/openstack/events.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.28978759Z namespaces/openstack/nad.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.289910704Z namespaces/openstack/pvc.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.289942555Z namespaces/openstack/buildconfig/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289949315Z namespaces/openstack/cert/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.289992057Z namespaces/openstack/certificaterequests/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290005107Z namespaces/openstack/configmaps/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290050109Z namespaces/openstack/cronjobs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290057619Z namespaces/openstack/daemonset/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290069469Z namespaces/openstack/deployments/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.29007547Z namespaces/openstack/imagestream/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.2900979Z namespaces/openstack/installplans/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.29010426Z namespaces/openstack/issuer/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290110311Z namespaces/openstack/jobs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290116361Z namespaces/openstack/pods/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290130811Z namespaces/openstack/pods/-describe [must-gather-fshwz] OUT 2025-09-30T10:56:46.290142762Z namespaces/openstack/pods/logs/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290149462Z namespaces/openstack/replicaset/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290156532Z namespaces/openstack/routes/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290162802Z namespaces/openstack/services/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290168883Z namespaces/openstack/statefulset/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290174793Z namespaces/openstack/subscriptions/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290182033Z network/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290200974Z network/l2advertisement.log [must-gather-fshwz] OUT 2025-09-30T10:56:46.290272176Z network/ipaddresspools/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290278346Z network/nnce/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290283366Z network/nncp/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290288306Z network/nns/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290295587Z nodes/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290333798Z nodes/crc.describe [must-gather-fshwz] OUT 2025-09-30T10:56:46.290519164Z nodes/crc.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.290642268Z sos-reports/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290662078Z sos-reports/sos-report- -> ../_all_nodes/sosreport- [must-gather-fshwz] OUT 2025-09-30T10:56:46.290668029Z sos-reports/_all_nodes/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290673009Z webhooks/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290685279Z webhooks/mutating/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.29072196Z webhooks/mutating/cert-manager-webhook.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.290801533Z webhooks/validating/ [must-gather-fshwz] OUT 2025-09-30T10:56:46.290883576Z webhooks/validating/cert-manager-webhook.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.291061171Z webhooks/validating/controlplanemachineset.machine.openshift.io.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.291198796Z webhooks/validating/multus.openshift.io.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.291367321Z webhooks/validating/network-node-identity.openshift.io.yaml [must-gather-fshwz] OUT 2025-09-30T10:56:46.294363817Z [must-gather-fshwz] OUT 2025-09-30T10:56:46.294389168Z sent 1,605 bytes received 25,924,079 bytes 17,283,789.33 bytes/sec [must-gather-fshwz] OUT 2025-09-30T10:56:46.294396428Z total size is 175,018,711 speedup is 6.75 [must-gather ] OUT 2025-09-30T10:56:46.32424752Z namespace/openshift-must-gather-zfjp5 deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: a84dabf3-edcf-4828-b6a1-f9d3a6f02304 ClientVersion: 4.19.13 ClusterVersion: Stable at "4.16.0" ClusterOperators: clusteroperator/machine-config is degraded because Failed to resync 4.16.0 because: error required MachineConfigPool master is paused and cannot sync until it is unpaused clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing