[must-gather ] OUT 2026-01-30T10:16:33.187848249Z Using must-gather plug-in image: quay.io/openstack-k8s-operators/openstack-must-gather:latest W0130 10:16:33.187995 20218 mustgather.go:390] volume percentage greater than or equal to 80 might cause filling up the disk space and have an impact on other components running on master When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 7dec01f8-89a2-484c-b000-0ae6c3570049 ClientVersion: 4.18.1 ClusterVersion: Stable at "4.18.1" ClusterOperators: clusteroperator/authentication is not available (OAuthServerDeploymentAvailable: no oauth-openshift.openshift-authentication pods available on any node.) because All is well clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/insights is missing clusteroperator/monitoring is missing clusteroperator/storage is missing [must-gather ] OUT 2026-01-30T10:16:33.229751831Z namespace/openshift-must-gather-q765f created [must-gather ] OUT 2026-01-30T10:16:33.249472656Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-xtvfb created Warning: spec.nodeSelector[node-role.kubernetes.io/master]: use "node-role.kubernetes.io/control-plane" instead [must-gather ] OUT 2026-01-30T10:16:33.383840604Z pod for plug-in image quay.io/openstack-k8s-operators/openstack-must-gather:latest created [must-gather-w9cd9] POD 2026-01-30T10:16:47.565811140Z volume percentage checker started..... [must-gather-w9cd9] POD 2026-01-30T10:16:47.603613603Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:16:47.809647247Z Error from server (NotFound): namespaces "openstack" not found [must-gather-w9cd9] POD 2026-01-30T10:16:48.018957166Z Will retrieve SOS reports from nodes [must-gather-w9cd9] POD 2026-01-30T10:16:48.019207262Z Journal size limit not set or invalid: ignoring [must-gather-w9cd9] POD 2026-01-30T10:16:48.302914563Z error: the server doesn't have a resource type "openstackdataplanenodesets" [must-gather-w9cd9] POD 2026-01-30T10:16:50.569615031Z Writing validating webhooks [must-gather-w9cd9] POD 2026-01-30T10:16:50.829461588Z Writing mutating webhooks [must-gather-w9cd9] POD 2026-01-30T10:16:51.552593813Z Gathering CRDs [must-gather-w9cd9] POD 2026-01-30T10:16:51.773681114Z Gathering CRs [must-gather-w9cd9] POD 2026-01-30T10:16:52.650036658Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:16:52.869533218Z error: the server doesn't have a resource type "nncp" [must-gather-w9cd9] POD 2026-01-30T10:16:53.207706918Z error: the server doesn't have a resource type "nnce" [must-gather-w9cd9] POD 2026-01-30T10:16:53.416084132Z error: the server doesn't have a resource type "nns" [must-gather-w9cd9] POD 2026-01-30T10:16:53.670962115Z error: the server doesn't have a resource type "ipaddresspools" [must-gather-w9cd9] POD 2026-01-30T10:16:53.906551657Z error: the server doesn't have a resource type "l2advertisement" [must-gather-w9cd9] POD 2026-01-30T10:16:54.966924258Z Gathering secrets in namespace openstack [must-gather-w9cd9] POD 2026-01-30T10:16:56.994292180Z Gathering secrets in namespace openstack-operators [must-gather-w9cd9] POD 2026-01-30T10:16:57.720891112Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:16:58.592542868Z Gathering secrets in namespace baremetal-operator-system [must-gather-w9cd9] POD 2026-01-30T10:17:02.894230250Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:17:08.016409524Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:17:13.060354508Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:17:16.537968250Z Gathering secrets in namespace openshift-machine-api [must-gather-w9cd9] POD 2026-01-30T10:17:18.097020850Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:17:23.129378695Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:17:24.872349710Z Gathering csv [must-gather-w9cd9] POD 2026-01-30T10:17:25.113944041Z Gathering subscription [must-gather-w9cd9] POD 2026-01-30T10:17:25.581859974Z Gathering installplan [must-gather-w9cd9] POD 2026-01-30T10:17:26.599668314Z No resources found in openshift-machine-api namespace. [must-gather-w9cd9] POD 2026-01-30T10:17:26.659094916Z Dump logs for control-plane-machine-set-operator from control-plane-machine-set-operator-78cbb6b69f-rnsxf pod [must-gather-w9cd9] POD 2026-01-30T10:17:26.984939868Z Dump logs for kube-rbac-proxy from machine-api-operator-5694c8668f-chf57 pod [must-gather-w9cd9] POD 2026-01-30T10:17:27.046537122Z Dump logs for machine-api-operator from machine-api-operator-5694c8668f-chf57 pod [must-gather-w9cd9] POD 2026-01-30T10:17:27.095601935Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather-w9cd9] POD 2026-01-30T10:17:27.526336002Z Dump services: cluster-autoscaler-operator [must-gather-w9cd9] POD 2026-01-30T10:17:27.533421228Z Dump services: control-plane-machine-set-operator [must-gather-w9cd9] POD 2026-01-30T10:17:27.539628963Z Dump services: machine-api-controllers [must-gather-w9cd9] POD 2026-01-30T10:17:27.550469463Z Dump services: machine-api-operator [must-gather-w9cd9] POD 2026-01-30T10:17:27.561927180Z Dump services: machine-api-operator-machine-webhook [must-gather-w9cd9] POD 2026-01-30T10:17:27.758646702Z Dump services: machine-api-operator-webhook [must-gather-w9cd9] POD 2026-01-30T10:17:28.147080954Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:17:28.550467618Z Dump replicaset: control-plane-machine-set-operator-78cbb6b69f [must-gather-w9cd9] POD 2026-01-30T10:17:28.559009952Z Dump replicaset: machine-api-operator-5694c8668f [must-gather-w9cd9] POD 2026-01-30T10:17:28.865660306Z Dump deployments: control-plane-machine-set-operator [must-gather-w9cd9] POD 2026-01-30T10:17:28.872313471Z Dump deployments: machine-api-operator [must-gather-w9cd9] POD 2026-01-30T10:17:30.134755838Z error: the server doesn't have a resource type "cert" [must-gather-w9cd9] POD 2026-01-30T10:17:30.378316979Z error: the server doesn't have a resource type "issuer" [must-gather-w9cd9] POD 2026-01-30T10:17:30.645620132Z error: the server doesn't have a resource type "certificaterequests" [must-gather-w9cd9] POD 2026-01-30T10:17:31.470094972Z Gathering secrets in namespace cert-manager [must-gather-w9cd9] POD 2026-01-30T10:17:32.786970456Z Gathering secrets in namespace openshift-nmstate [must-gather-w9cd9] POD 2026-01-30T10:17:33.204394221Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:17:33.762776889Z Gathering secrets in namespace openshift-operators-redhat [must-gather-w9cd9] POD 2026-01-30T10:17:38.327335113Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:17:42.859784808Z Gathering secrets in namespace openshift-operators [must-gather-w9cd9] POD 2026-01-30T10:17:43.359281397Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:17:48.376916682Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:17:48.497376822Z Gathering csv [must-gather-w9cd9] POD 2026-01-30T10:17:48.801147001Z Gathering subscription [must-gather-w9cd9] POD 2026-01-30T10:17:49.030283177Z Gathering installplan [must-gather-w9cd9] POD 2026-01-30T10:17:49.784404058Z No resources found in openshift-operators namespace. [must-gather-w9cd9] POD 2026-01-30T10:17:49.860481625Z No resources found in openshift-operators namespace. [must-gather-w9cd9] POD 2026-01-30T10:17:50.186279336Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather-w9cd9] POD 2026-01-30T10:17:50.232630738Z No resources found in openshift-operators namespace. [must-gather-w9cd9] POD 2026-01-30T10:17:50.328297266Z No resources found in openshift-operators namespace. [must-gather-w9cd9] POD 2026-01-30T10:17:52.683287592Z error: the server doesn't have a resource type "cert" [must-gather-w9cd9] POD 2026-01-30T10:17:52.927316111Z error: the server doesn't have a resource type "issuer" [must-gather-w9cd9] POD 2026-01-30T10:17:53.141612766Z error: the server doesn't have a resource type "certificaterequests" [must-gather-w9cd9] POD 2026-01-30T10:17:53.402181058Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:17:53.758468485Z Gathering secrets in namespace openshift-logging [must-gather-w9cd9] POD 2026-01-30T10:17:55.337152135Z Gathering secrets in namespace metallb-system [must-gather-w9cd9] POD 2026-01-30T10:17:58.429009350Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:18:02.434341222Z Gathering secrets in namespace openshift-marketplace [must-gather-w9cd9] POD 2026-01-30T10:18:03.449754865Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:18:08.145987302Z Gathering csv [must-gather-w9cd9] POD 2026-01-30T10:18:08.442036697Z Gathering subscription [must-gather-w9cd9] POD 2026-01-30T10:18:08.508496573Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:18:08.695646016Z Gathering installplan [must-gather-w9cd9] POD 2026-01-30T10:18:09.433346595Z No resources found in openshift-marketplace namespace. [must-gather-w9cd9] POD 2026-01-30T10:18:09.503212677Z Dump logs for extract-utilities from certified-operators-npj4n pod [must-gather-w9cd9] POD 2026-01-30T10:18:09.527983008Z Dump init container logs from certified-operators-npj4n pod [must-gather-w9cd9] POD 2026-01-30T10:18:09.619453322Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather-w9cd9] POD 2026-01-30T10:18:09.898446438Z Dump logs for extract-content from certified-operators-npj4n pod [must-gather-w9cd9] POD 2026-01-30T10:18:09.910433639Z Dump init container logs from certified-operators-npj4n pod [must-gather-w9cd9] POD 2026-01-30T10:18:10.293785373Z Dump logs for registry-server from certified-operators-npj4n pod [must-gather-w9cd9] POD 2026-01-30T10:18:10.313213670Z Dump logs for extract-utilities from community-operators-9tv57 pod [must-gather-w9cd9] POD 2026-01-30T10:18:10.618669260Z Dump init container logs from community-operators-9tv57 pod [must-gather-w9cd9] POD 2026-01-30T10:18:11.108777170Z Dump logs for extract-content from community-operators-9tv57 pod [must-gather-w9cd9] POD 2026-01-30T10:18:11.114699538Z Dump init container logs from community-operators-9tv57 pod [must-gather-w9cd9] POD 2026-01-30T10:18:11.449818522Z Dump logs for registry-server from community-operators-9tv57 pod [must-gather-w9cd9] POD 2026-01-30T10:18:11.466519991Z Dump logs for marketplace-operator from marketplace-operator-79b997595-xb876 pod [must-gather-w9cd9] POD 2026-01-30T10:18:11.907658994Z Dump logs for extract-utilities from redhat-marketplace-6qdx9 pod [must-gather-w9cd9] POD 2026-01-30T10:18:12.099476693Z Dump init container logs from redhat-marketplace-6qdx9 pod [must-gather-w9cd9] POD 2026-01-30T10:18:12.414756340Z Dump logs for extract-content from redhat-marketplace-6qdx9 pod [must-gather-w9cd9] POD 2026-01-30T10:18:12.424777991Z Dump init container logs from redhat-marketplace-6qdx9 pod [must-gather-w9cd9] POD 2026-01-30T10:18:12.801592550Z Dump logs for registry-server from redhat-marketplace-6qdx9 pod [must-gather-w9cd9] POD 2026-01-30T10:18:12.837641745Z Dump logs for extract-utilities from redhat-operators-knt2m pod [must-gather-w9cd9] POD 2026-01-30T10:18:13.047703382Z Dump init container logs from redhat-operators-knt2m pod [must-gather-w9cd9] POD 2026-01-30T10:18:13.402034228Z Dump logs for extract-content from redhat-operators-knt2m pod [must-gather-w9cd9] POD 2026-01-30T10:18:13.421002724Z Dump init container logs from redhat-operators-knt2m pod [must-gather-w9cd9] POD 2026-01-30T10:18:13.569517887Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:18:13.670525331Z Dump logs for registry-server from redhat-operators-knt2m pod [must-gather-w9cd9] POD 2026-01-30T10:18:14.012513477Z Dump services: certified-operators [must-gather-w9cd9] POD 2026-01-30T10:18:14.019925513Z Dump services: community-operators [must-gather-w9cd9] POD 2026-01-30T10:18:14.038405987Z Dump services: marketplace-operator-metrics [must-gather-w9cd9] POD 2026-01-30T10:18:14.050334405Z Dump services: redhat-marketplace [must-gather-w9cd9] POD 2026-01-30T10:18:14.227974720Z Dump services: redhat-operators [must-gather-w9cd9] POD 2026-01-30T10:18:15.012018861Z Dump replicaset: marketplace-operator-79b997595 [must-gather-w9cd9] POD 2026-01-30T10:18:15.315455711Z Dump deployments: marketplace-operator [must-gather-w9cd9] POD 2026-01-30T10:18:16.365089283Z error: the server doesn't have a resource type "cert" [must-gather-w9cd9] POD 2026-01-30T10:18:16.584351581Z error: the server doesn't have a resource type "issuer" [must-gather-w9cd9] POD 2026-01-30T10:18:17.374998858Z error: the server doesn't have a resource type "certificaterequests" [must-gather-w9cd9] POD 2026-01-30T10:18:18.597818812Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:18:23.213633863Z Gathering secrets in namespace openshift-operators [must-gather-w9cd9] POD 2026-01-30T10:18:23.614286670Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:18:28.634381789Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:18:29.109498393Z Gathering csv [must-gather-w9cd9] POD 2026-01-30T10:18:29.347362688Z Gathering subscription [must-gather-w9cd9] POD 2026-01-30T10:18:29.586776962Z Gathering installplan [must-gather-w9cd9] POD 2026-01-30T10:18:30.256634890Z No resources found in openshift-operators namespace. [must-gather-w9cd9] POD 2026-01-30T10:18:30.292356457Z No resources found in openshift-operators namespace. [must-gather-w9cd9] POD 2026-01-30T10:18:30.496099416Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather-w9cd9] POD 2026-01-30T10:18:30.548044987Z No resources found in openshift-operators namespace. [must-gather-w9cd9] POD 2026-01-30T10:18:32.586653740Z error: the server doesn't have a resource type "cert" [must-gather-w9cd9] POD 2026-01-30T10:18:32.859415380Z error: the server doesn't have a resource type "issuer" [must-gather-w9cd9] POD 2026-01-30T10:18:33.078003281Z error: the server doesn't have a resource type "certificaterequests" [must-gather-w9cd9] POD 2026-01-30T10:18:33.685394003Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:18:33.762999489Z error: the server doesn't have a resource type "openstackcontrolplane" [must-gather-w9cd9] POD 2026-01-30T10:18:33.784882108Z Gather ctlplane service info: openstack [must-gather-w9cd9] POD 2026-01-30T10:18:33.794548410Z Gather ctlplane service info: ovn [must-gather-w9cd9] POD 2026-01-30T10:18:33.816571652Z Gather ctlplane service info: rabbitmq [must-gather-w9cd9] POD 2026-01-30T10:18:34.213779663Z Error from server (NotFound): namespaces "openstack" not found [must-gather-w9cd9] POD 2026-01-30T10:18:34.216164892Z Error from server (NotFound): namespaces "openstack" not found [must-gather-w9cd9] POD 2026-01-30T10:18:34.220436520Z Error from server (NotFound): namespaces "openstack" not found [must-gather-w9cd9] POD 2026-01-30T10:18:34.233239561Z Pod ovsdbserver-nb-0 not found in namespace openstack, skipping OVN NB database collection [must-gather-w9cd9] POD 2026-01-30T10:18:34.449240177Z Pod ovsdbserver-sb-0 not found in namespace openstack, skipping OVN SB database collection [must-gather-w9cd9] POD 2026-01-30T10:18:34.934861505Z tar: Removing leading `/' from member names [must-gather-w9cd9] POD 2026-01-30T10:18:38.717608146Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:18:43.740522675Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:18:48.801749635Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:18:53.827482636Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:18:58.846616180Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:19:03.894225809Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:19:08.912062341Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:19:13.932533479Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:19:18.964659820Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:19:24.003315165Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:19:29.033446625Z volume usage percentage 0 [must-gather-w9cd9] POD 2026-01-30T10:19:34.060753685Z volume usage percentage 0