Trigger GMR for Service cinder Trigger GMR for Nova services Will retrieve SOS reports from nodes crc Generating SOS Report for crc Starting pod/crc-debug-npwmq ... To use host binaries, run `chroot /host` Generating SOS Report for EDPM standalone.ooo.test Warning: Permanently added '192.168.122.100' (ED25519) to the list of known hosts. +--------------------------------------+----------------+------------------------+----------+---------+-------+----------------------------+ | ID | Binary | Host | Zone | Status | State | Updated At | +--------------------------------------+----------------+------------------------+----------+---------+-------+----------------------------+ | 2e9d33e2-e1b5-4845-a37b-0810ebdfeb9b | nova-scheduler | nova-scheduler-0 | internal | enabled | up | 2025-10-08T09:29:14.000000 | | f118e243-5479-4253-9ece-b16026d911b4 | nova-conductor | nova-cell0-conductor-0 | internal | enabled | up | 2025-10-08T09:29:13.000000 | | e3bcdcbb-5cb4-4255-9617-5fc17bbca6eb | nova-compute | standalone.ooo.test | nova | enabled | up | 2025-10-08T09:29:16.000000 | | 9ac3a5b8-68be-4802-abb0-ebf3ecd6bb0b | nova-conductor | nova-cell1-conductor-0 | internal | enabled | up | 2025-10-08T09:29:13.000000 | +--------------------------------------+----------------+------------------------+----------+---------+-------+----------------------------+ sos report (version 4.8.2) This command will collect diagnostic and configuration information from this Red Hat Enterprise Linux system and installed applications. An archive containing the collected information will be generated in /var/tmp/sos-osp/sos.jotn9c7n and may be provided to a Red Hat support representative. Any information provided to Red Hat will be treated in accordance with the published support policies at: Distribution Website : https://www.redhat.com/ Commercial Support : https://access.redhat.com/ The generated archive may contain data considered sensitive and its content should be reviewed by the originating organization before being passed to any third party. No changes will be made to system configuration. Setting up archive ... Setting up plugins ... Gathering CRDs [plugin:fwupd] skipped command 'fwupdmgr get-approved-firmware': required services missing: fwupd. [plugin:fwupd] skipped command 'fwupdmgr get-devices --no-unreported-check': required services missing: fwupd. [plugin:fwupd] skipped command 'fwupdmgr get-history': required services missing: fwupd. [plugin:fwupd] skipped command 'fwupdmgr get-remotes': required services missing: fwupd. [plugin:fwupd] skipped command '/usr/libexec/fwupd/fwupdagent get-devices': required services missing: fwupd. [plugin:fwupd] skipped command '/usr/libexec/fwupd/fwupdagent get-updates': required services missing: fwupd. [plugin:networking] skipped command 'ip -s macsec show': required kmods missing: macsec. Use '--allow-system-changes' to enable collection. Not all environment variables set. Source the environment file for the user intended to connect to the OpenStack environment. [plugin:systemd] skipped command 'systemd-resolve --status': required services missing: systemd-resolved. [plugin:systemd] skipped command 'systemd-resolve --statistics': required services missing: systemd-resolved. Running plugins. Please wait ... Starting 3/81 auditd [Running: auditd] Starting 4/81 autofs [Running: auditd autofs] Starting 1/81 anacron [Running: auditd autofs anacron] Starting 2/81 ata [Running: auditd autofs anacron ata] Starting 5/81 block [Running: auditd autofs anacron block] Starting 6/81 boot [Running: auditd autofs block boot] Starting 7/81 buildah [Running: auditd block boot buildah] Starting 8/81 ceph_common [Running: block boot buildah ceph_common] Starting 9/81 cgroups [Running: block boot buildah cgroups] Starting 10/81 chrony [Running: boot buildah cgroups chrony] Starting 11/81 console [Running: boot buildah cgroups console] Starting 12/81 containers_common [Running: boot buildah cgroups containers_common] Starting 13/81 coredump [Running: boot buildah cgroups coredump] Starting 14/81 cron [Running: boot buildah cgroups cron] Starting 15/81 crypto [Running: boot buildah cgroups crypto] Starting 16/81 dbus [Running: boot buildah cgroups dbus] Starting 17/81 devicemapper [Running: boot buildah cgroups devicemapper] Starting 18/81 devices [Running: boot buildah cgroups devices] Starting 19/81 dnf [Running: boot buildah cgroups dnf] Starting 20/81 filesys [Running: boot buildah dnf filesys] Starting 21/81 firewall_tables [Running: boot buildah dnf firewall_tables] Starting 22/81 fwupd [Running: boot buildah dnf fwupd] Starting 23/81 hardware [Running: boot buildah dnf hardware] Starting 24/81 host [Running: boot buildah dnf host] Gathering CRs Starting 25/81 i18n [Running: boot buildah dnf i18n] Starting 26/81 insights [Running: boot buildah dnf insights] Starting 27/81 iscsi [Running: buildah dnf insights iscsi] Starting 28/81 kdump [Running: buildah dnf insights kdump] Starting 29/81 kernel [Running: buildah dnf insights kernel] Starting 30/81 keyutils [Running: buildah dnf kernel keyutils] Starting 31/81 krb5 [Running: buildah dnf kernel krb5] Starting 32/81 kvm [Running: buildah dnf krb5 kvm] Starting 33/81 ldap [Running: buildah dnf kvm ldap] Starting 34/81 libraries [Running: buildah dnf kvm libraries] Starting 35/81 libvirt [Running: buildah dnf kvm libvirt] Starting 36/81 login [Running: buildah dnf kvm login] Starting 37/81 logrotate [Running: buildah dnf kvm logrotate] Starting 38/81 logs [Running: buildah dnf kvm logs] Trying to pull registry.redhat.io/rhel9/support-tools:latest... Starting 39/81 lvm2 [Running: buildah kvm logs lvm2] Getting image source signatures Starting 40/81 md [Running: buildah kvm logs md] Starting 41/81 memory [Running: buildah kvm logs memory] Starting 42/81 multipath [Running: buildah kvm logs multipath] Starting 43/81 networking [Running: buildah kvm logs networking] Checking if image destination supports signatures Copying blob sha256:97718391176c91bbeea71172faf017b5982e3e383b2d2a6652ade6b25910938e Copying blob sha256:74956640af323393be3edafd6bbf4d02e5336ac16c17bd052e9127b7a9f77159 Starting 44/81 networkmanager [Running: buildah logs networking networkmanager] Starting 45/81 nfs [Running: buildah logs networking nfs] Starting 46/81 numa [Running: buildah logs networking numa] Starting 47/81 nvme [Running: buildah logs networking nvme] Starting 48/81 openhpi [Running: buildah logs networking openhpi] Starting 49/81 openstack_edpm [Running: buildah logs networking openstack_edpm] Copying config sha256:a46baefd96eef0f353f3454364d157bbbd4c6e35b14a551dee466c297887355c Writing manifest to image destination Storing signatures Starting 50/81 openstack_neutron [Running: buildah networking openstack_edpm openstack_neutron] a46baefd96eef0f353f3454364d157bbbd4c6e35b14a551dee466c297887355c .toolboxrc file detected, overriding defaults... Checking if there is a newer version of registry.redhat.io/rhel9/support-tools available... Starting 51/81 openstack_nova [Running: buildah networking openstack_edpm openstack_nova] Starting 52/81 openvswitch [Running: buildah networking openstack_edpm openvswitch] Starting 53/81 ovn_host [Running: networking openstack_edpm openvswitch ovn_host] Starting 54/81 pam [Running: networking openstack_edpm openvswitch pam] Starting 55/81 pci [Running: networking openstack_edpm openvswitch pci] Starting 56/81 podman [Running: networking openstack_edpm openvswitch podman] Spawning a container 'toolbox-osp' with image 'registry.redhat.io/rhel9/support-tools' Detected RUN label in the container image. Using that as the default... 1465022ae2dcc4d4bafa2869a850653e5dfd9a464445230aa99c514c6761609b Starting 57/81 process [Running: networking openstack_edpm podman process] toolbox-osp sos report --batch --all-logs --only-plugins block,cifs,crio,devicemapper,devices,firewall_tables,firewalld,iscsi,lvm2,memory,multipath,nfs,nis,nvme,podman,process,processor,selinux,scsi,udev,logs,crypto --tmp-dir=/var/tmp/sos-osp; exit Starting 58/81 processor [Running: openstack_edpm podman process processor] [?2004l sos report (version 4.9.2) Starting 59/81 python [Running: openstack_edpm podman processor python] Starting 60/81 release [Running: openstack_edpm podman processor release] Starting 61/81 rpm [Running: openstack_edpm podman processor rpm] Starting 62/81 sar [Running: openstack_edpm podman processor sar] Starting 63/81 scsi [Running: openstack_edpm podman processor scsi] Starting 64/81 selinux [Running: openstack_edpm podman processor selinux] This command will collect diagnostic and configuration information from this Red Hat Enterprise Linux system and installed applications. An archive containing the collected information will be generated in /host/var/tmp/sos-osp/sos.y23nb5z7 and may be provided to a Red Hat support representative. Any information provided to Red Hat will be treated in accordance with the published support policies at: Distribution Website : https://www.redhat.com/ Commercial Support : https://access.redhat.com/ The generated archive may contain data considered sensitive and its content should be reviewed by the originating organization before being passed to any third party. No changes will be made to system configuration. Setting up archive ... Setting up plugins ... Starting 65/81 services [Running: podman processor selinux services] Starting 66/81 snmp [Running: podman processor selinux snmp] Starting 67/81 ssh [Running: podman processor selinux ssh] Starting 68/81 subscription_manager [Running: podman processor selinux subscription_manager] Starting 69/81 sudo [Running: podman selinux subscription_manager sudo] Starting 70/81 sunrpc [Running: podman selinux subscription_manager sunrpc] Starting 71/81 system [Running: podman selinux subscription_manager system] Running plugins. Please wait ... Starting 3/22 crio [Running: crio] Starting 1/22 block [Running: crio block] Starting 2/22 cifs [Running: crio block cifs] Starting 4/22 crypto [Running: crio block cifs crypto] Starting 5/22 devicemapper [Running: crio block crypto devicemapper] Starting 72/81 systemd [Running: podman subscription_manager system systemd] Starting 6/22 devices [Running: crio block crypto devices] Starting 7/22 firewall_tables [Running: crio block devices firewall_tables] Starting 8/22 firewalld [Running: crio block firewall_tables firewalld] Starting 9/22 iscsi [Running: crio block firewalld iscsi] Starting 10/22 logs [Running: crio block firewalld logs] Starting 11/22 lvm2 [Running: crio firewalld logs lvm2] Starting 73/81 sysvipc [Running: podman subscription_manager systemd sysvipc] Starting 74/81 tpm2 [Running: podman subscription_manager systemd tpm2] Starting 75/81 tuned [Running: podman subscription_manager systemd tuned] Starting 12/22 memory [Running: crio logs lvm2 memory] Starting 76/81 udev [Running: podman subscription_manager systemd udev] Starting 77/81 unbound [Running: podman subscription_manager systemd unbound] Starting 78/81 vhostmd [Running: podman subscription_manager systemd vhostmd] Starting 79/81 virsh [Running: podman subscription_manager systemd virsh] Starting 80/81 xen [Running: podman systemd virsh xen] Finishing plugins [Running: podman systemd virsh] Starting 81/81 xfs [Running: podman systemd virsh xfs] Finishing plugins [Running: systemd virsh xfs] Finishing plugins [Running: systemd xfs] Finishing plugins [Running: systemd] Starting 13/22 multipath [Running: crio logs lvm2 multipath] Starting 14/22 nfs [Running: crio logs multipath nfs] Starting 15/22 nis [Running: crio logs nfs nis] Starting 16/22 nvme [Running: crio logs nfs nvme] Starting 17/22 podman [Running: crio logs nfs podman] Starting 18/22 process [Running: crio logs podman process] Finished running plugins Writing validating webhooks Writing mutating webhooks Extracting ConfigMap: rabbitmq-cell1-config-data Extracting ConfigMap: rabbitmq-cell1-plugins-conf Extracting ConfigMap: rabbitmq-cell1-server-conf Extracting ConfigMap: rabbitmq-config-data Extracting ConfigMap: rabbitmq-plugins-conf Extracting ConfigMap: rabbitmq-server-conf Extracting ConfigMap: nova-cells-global-config Extracting ConfigMap: horizon-config-data Extracting ConfigMap: horizon-scripts Starting 19/22 processor [Running: crio logs podman processor] Extracting ConfigMap: octavia-hmport-map Extracting ConfigMap: octavia-ssh-pubkey Starting 20/22 scsi [Running: crio logs podman scsi] Extracting ConfigMap: swift-ring-config-data Extracting ConfigMap: swift-ring-files Extracting ConfigMap: swift-ring-scripts Extracting ConfigMap: swift-storage-config-data Extracting ConfigMap: ovncontroller-config Extracting ConfigMap: ovncontroller-extra-scripts Extracting ConfigMap: ovncontroller-metrics-config Extracting ConfigMap: ovncontroller-scripts Extracting ConfigMap: ovndbcluster-nb-config Extracting ConfigMap: ovndbcluster-nb-scripts Extracting ConfigMap: ovndbcluster-sb-config Starting 21/22 selinux [Running: crio logs podman selinux] Extracting ConfigMap: ovndbcluster-sb-scripts Extracting ConfigMap: ovnnorthd-config Extracting ConfigMap: ovnnorthd-scripts Extracting ConfigMap: ovsdbserver-nb Extracting ConfigMap: ovsdbserver-sb Extracting ConfigMap: prometheus-metric-storage-rulefiles-0 Extracting ConfigMap: infra-instanceha-config Gathering secrets in namespace openstack Finishing plugins [Running: crio podman selinux] Starting 22/22 udev [Running: crio podman selinux udev] Finishing plugins [Running: crio podman selinux] Finishing plugins [Running: crio podman] Finishing plugins [Running: podman] Finished running plugins Creating compressed archive... Error while masking key: alertmanager.yaml.gz, for file: /must-gather/namespaces/openstack/secrets/metric-storage/alertmanager-metric-storage-generated.yaml Error while masking key: prometheus.yaml.gz, for file: /must-gather/namespaces/openstack/secrets/metric-storage/prometheus-metric-storage.yaml Gathering csv Gathering subscription Gathering installplan Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for init-config-reloader from alertmanager-metric-storage-0 pod Dump init container logs from alertmanager-metric-storage-0 pod Dump logs for alertmanager from alertmanager-metric-storage-0 pod Dump logs for config-reloader from alertmanager-metric-storage-0 pod Dump logs for aodh-api from aodh-0 pod Dump logs for aodh-evaluator from aodh-0 pod Dump logs for aodh-listener from aodh-0 pod Dump logs for aodh-notifier from aodh-0 pod Dump logs for barbican-api from barbican-api-6987778d5b-jzqd7 pod Dump logs for barbican-api-log from barbican-api-6987778d5b-jzqd7 pod Dump logs for barbican-keystone-listener from barbican-keystone-listener-6b48b74b7d-8p6dz pod Dump logs for barbican-keystone-listener-log from barbican-keystone-listener-6b48b74b7d-8p6dz pod Dump logs for barbican-worker from barbican-worker-7bf5f9d487-99dwt pod Dump logs for barbican-worker-log from barbican-worker-7bf5f9d487-99dwt pod Dump logs for bootstrap-openstack-openstack-cell1 from bootstrap-openstack-openstack-cell1-8bxd8 pod Dump logs for ceilometer-central-agent from ceilometer-0 pod Dump logs for ceilometer-notification-agent from ceilometer-0 pod Dump logs for proxy-httpd from ceilometer-0 pod Dump logs for sg-core from ceilometer-0 pod Dump logs for cinder-api from cinder-api-0 pod Dump logs for cinder-api-log from cinder-api-0 pod Dump logs for cinder-scheduler from cinder-scheduler-0 pod Dump logs for probe from cinder-scheduler-0 pod Dump logs for configure-network-openstack-openstack-cell1 from configure-network-openstack-openstack-cell1-xl85k pod Dump logs for configure-os-openstack-openstack-cell1 from configure-os-openstack-openstack-cell1-lf2pg pod Dump logs for init from dnsmasq-dns-599688d56f-pv87c pod Dump init container logs from dnsmasq-dns-599688d56f-pv87c pod Dump logs for dnsmasq-dns from dnsmasq-dns-599688d56f-pv87c pod Dump logs for download-cache-openstack-openstack-cell1 from download-cache-openstack-openstack-cell1-fthbc pod Dump logs for glance-httpd from glance-default-external-api-0 pod Dump logs for glance-log from glance-default-external-api-0 pod Dump logs for glance-httpd from glance-default-internal-api-0 pod Dump logs for glance-log from glance-default-internal-api-0 pod Dump logs for heat-api from heat-api-85bf9f6694-scp7q pod Dump logs for heat-cfnapi from heat-cfnapi-67d857f9d-4g9rh pod Dump logs for heat-engine from heat-engine-6d9898f7cb-8bmkv pod Dump logs for horizon from horizon-5db9c89c9d-78bjw pod Dump logs for horizon-log from horizon-5db9c89c9d-78bjw pod Dump logs for install-certs-openstack-openstack-cell1 from install-certs-openstack-openstack-cell1-l6x9j pod Dump logs for install-os-openstack-openstack-cell1 from install-os-openstack-openstack-cell1-l4sgd pod Dump logs for keystone-api from keystone-64cb5f589-zm624 pod Dump logs for keystone-cron from keystone-cron-29331901-zk49x pod Dump logs for kube-state-metrics from kube-state-metrics-0 pod Dump logs for libvirt-openstack-openstack-cell1 from libvirt-openstack-openstack-cell1-pndgl pod Dump logs for memcached from memcached-0 pod Dump logs for neutron-api from neutron-695f697977-q27xm pod Dump logs for neutron-httpd from neutron-695f697977-q27xm pod Dump logs for neutron-dhcp-openstack-openstack-cell1 from neutron-dhcp-openstack-openstack-cell1-xsjwr pod Dump logs for neutron-metadata-openstack-openstack-cell1 from neutron-metadata-openstack-openstack-cell1-529p8 pod Dump logs for neutron-sriov-openstack-openstack-cell1 from neutron-sriov-openstack-openstack-cell1-nzcg9 pod Dump logs for nova-api-api from nova-api-0 pod Dump logs for nova-api-log from nova-api-0 pod Dump logs for nova-cell0-conductor-conductor from nova-cell0-conductor-0 pod Dump logs for nova-cell1-conductor-conductor from nova-cell1-conductor-0 pod Dump logs for nova-cell1-novncproxy-novncproxy from nova-cell1-novncproxy-0 pod Dump logs for nova-cell1-openstack-nova-compute-ffu-cell1-openstack-cell1 from nova-cell1-openstack-nova-compute-ffu-cell1-openstack-cellvq4sr pod Dump logs for nova-cell1-openstack-openstack-cell1 from nova-cell1-openstack-openstack-cell1-7qrs9 pod Dump logs for nova-metadata-log from nova-metadata-0 pod Dump logs for nova-metadata-metadata from nova-metadata-0 pod Dump logs for nova-scheduler-scheduler from nova-scheduler-0 pod Dump logs for init from octavia-api-6c7c5889cc-cf95j pod Dump init container logs from octavia-api-6c7c5889cc-cf95j pod Dump logs for octavia-api from octavia-api-6c7c5889cc-cf95j pod Dump logs for octavia-api-provider-agent from octavia-api-6c7c5889cc-cf95j pod Dump logs for init from octavia-healthmanager-jdcv4 pod Dump init container logs from octavia-healthmanager-jdcv4 pod Dump logs for octavia-healthmanager from octavia-healthmanager-jdcv4 pod Dump logs for init from octavia-housekeeping-qcctv pod Dump init container logs from octavia-housekeeping-qcctv pod Dump logs for octavia-housekeeping from octavia-housekeeping-qcctv pod Dump logs for init from octavia-image-upload-678599687f-7w6sz pod Dump init container logs from octavia-image-upload-678599687f-7w6sz pod Dump logs for octavia-amphora-httpd from octavia-image-upload-678599687f-7w6sz pod Dump logs for init from octavia-rsyslog-9nlmv pod Dump init container logs from octavia-rsyslog-9nlmv pod Dump logs for octavia-rsyslog from octavia-rsyslog-9nlmv pod Dump logs for init from octavia-worker-dsclk pod Dump init container logs from octavia-worker-dsclk pod Dump logs for octavia-worker from octavia-worker-dsclk pod Dump logs for mysql-bootstrap from openstack-cell1-galera-0 pod Dump init container logs from openstack-cell1-galera-0 pod Dump logs for galera from openstack-cell1-galera-0 pod Dump logs for mysql-bootstrap from openstack-galera-0 pod Dump init container logs from openstack-galera-0 pod Dump logs for galera from openstack-galera-0 pod Dump logs for openstackclient from openstackclient pod Dump logs for ovn-controller from ovn-controller-6tbx2 pod Dump logs for openstack-network-exporter from ovn-controller-metrics-shpqz pod Dump logs for ovsdb-server-init from ovn-controller-ovs-hrj56 pod Dump init container logs from ovn-controller-ovs-hrj56 pod Dump logs for ovs-vswitchd from ovn-controller-ovs-hrj56 pod Dump logs for ovsdb-server from ovn-controller-ovs-hrj56 pod Dump logs for openstack-network-exporter from ovn-northd-0 pod Dump logs for ovn-northd from ovn-northd-0 pod Dump logs for ovn-openstack-openstack-cell1 from ovn-openstack-openstack-cell1-fxgb2 pod Dump logs for openstack-network-exporter from ovsdbserver-nb-0 pod Dump logs for ovsdbserver-nb from ovsdbserver-nb-0 pod Dump logs for openstack-network-exporter from ovsdbserver-nb-1 pod Dump logs for ovsdbserver-nb from ovsdbserver-nb-1 pod Dump logs for openstack-network-exporter from ovsdbserver-nb-2 pod Dump logs for ovsdbserver-nb from ovsdbserver-nb-2 pod Dump logs for openstack-network-exporter from ovsdbserver-sb-0 pod Dump logs for ovsdbserver-sb from ovsdbserver-sb-0 pod Dump logs for openstack-network-exporter from ovsdbserver-sb-1 pod Dump logs for ovsdbserver-sb from ovsdbserver-sb-1 pod Dump logs for openstack-network-exporter from ovsdbserver-sb-2 pod Dump logs for ovsdbserver-sb from ovsdbserver-sb-2 pod Dump logs for placement-api from placement-9c4cb9494-k7nws pod Dump logs for placement-log from placement-9c4cb9494-k7nws pod Dump logs for pre-adoption-validation-openstack-pre-adoption-openstack-cell1 from pre-adoption-validation-openstack-pre-adoption-openstack-c9kcsp pod Dump logs for init-config-reloader from prometheus-metric-storage-0 pod Dump init container logs from prometheus-metric-storage-0 pod Dump logs for config-reloader from prometheus-metric-storage-0 pod Dump logs for prometheus from prometheus-metric-storage-0 pod Dump logs for thanos-sidecar from prometheus-metric-storage-0 pod Dump logs for setup-container from rabbitmq-cell1-server-0 pod Dump init container logs from rabbitmq-cell1-server-0 pod Dump logs for rabbitmq from rabbitmq-cell1-server-0 pod Dump logs for setup-container from rabbitmq-server-0 pod Dump init container logs from rabbitmq-server-0 pod Dump logs for rabbitmq from rabbitmq-server-0 pod Dump logs for reboot-os-openstack-openstack-cell1 from reboot-os-openstack-openstack-cell1-958gs pod Dump logs for run-os-openstack-openstack-cell1 from run-os-openstack-openstack-cell1-dnxt5 pod Dump logs for ssh-known-hosts-openstack from ssh-known-hosts-openstack-r9wb9 pod Dump logs for proxy-httpd from swift-proxy-6cc64ff97c-4bpv7 pod Dump logs for proxy-server from swift-proxy-6cc64ff97c-4bpv7 pod Dump logs for swift-ring-rebalance from swift-ring-rebalance-zz6vr pod Dump logs for telemetry-openstack-openstack-cell1 from telemetry-openstack-openstack-cell1-5ggmb pod Dump logs for tripleo-cleanup-tripleo-cleanup-openstack-cell1 from tripleo-cleanup-tripleo-cleanup-openstack-cell1-8hs4v pod Dump logs for validate-network-openstack-openstack-cell1 from validate-network-openstack-openstack-cell1-jds6t pod Dump services: alertmanager-operated Dump services: aodh-internal Dump services: aodh-public Dump services: barbican-internal Dump services: barbican-public Dump services: ceilometer-internal Dump services: cinder-internal Dump services: cinder-public Dump services: dnsmasq-dns Dump services: glance-default-external-api Dump services: glance-default-internal Dump services: glance-default-internal-api Dump services: glance-default-public Dump services: heat-api-internal Dump services: heat-api-public Dump services: heat-cfnapi-internal Dump services: heat-cfnapi-public Dump services: horizon Dump services: keystone-internal Dump services: keystone-public Dump services: kube-state-metrics Dump services: memcached Dump services: metric-storage-alertmanager Dump services: metric-storage-prometheus Dump services: metric-storage-thanos-sidecar Dump services: neutron-internal Dump services: neutron-public Dump services: nova-internal Dump services: nova-metadata-internal Dump services: nova-novncproxy-cell1-public Dump services: nova-public Dump services: octavia-image-upload-internal Dump services: octavia-internal Dump services: octavia-public Dump services: openstack Dump services: openstack-cell1 Dump services: openstack-cell1-galera Dump services: openstack-galera Dump services: ovn-controller-metrics Dump services: ovn-northd-0 Dump services: ovsdbserver-nb Dump services: ovsdbserver-nb-0 Dump services: ovsdbserver-nb-1 Dump services: ovsdbserver-nb-2 Dump services: ovsdbserver-sb Dump services: ovsdbserver-sb-0 Dump services: ovsdbserver-sb-1 Dump services: ovsdbserver-sb-2 Dump services: placement-internal Dump services: placement-public Dump services: prometheus-operated Dump services: rabbitmq Dump services: rabbitmq-cell1 Dump services: rabbitmq-cell1-nodes Dump services: rabbitmq-nodes Dump services: swift-internal Dump services: swift-public Dump services: swift-storage Dump routes: aodh-public Dump routes: barbican-public Dump routes: cinder-public Dump routes: glance-default-public Dump routes: heat-api-public Dump routes: heat-cfnapi-public Dump routes: horizon Dump routes: keystone-public Dump routes: neutron-public Dump routes: nova-novncproxy-cell1-public Dump routes: nova-public Dump routes: octavia-public Dump routes: placement-public Dump routes: swift-public Dump daemonset: octavia-healthmanager Dump daemonset: octavia-housekeeping Dump daemonset: octavia-rsyslog Dump daemonset: octavia-worker Dump daemonset: ovn-controller Dump daemonset: ovn-controller-metrics Dump daemonset: ovn-controller-ovs Dump replicaset: barbican-api-54b75c7988 Dump replicaset: barbican-api-6987778d5b Dump replicaset: barbican-keystone-listener-6b48b74b7d Dump replicaset: barbican-worker-7bf5f9d487 Dump replicaset: dnsmasq-dns-56ccf77c9 Dump replicaset: dnsmasq-dns-599688d56f Dump replicaset: dnsmasq-dns-6849ffbbb9 Dump replicaset: dnsmasq-dns-784cb9b9cc Dump replicaset: dnsmasq-dns-7855b8cc9 Dump replicaset: dnsmasq-dns-78f6dfd77 Dump replicaset: dnsmasq-dns-7d96845bf9 Dump replicaset: dnsmasq-dns-7dfb96c8bc Dump replicaset: dnsmasq-dns-86656fcf55 Dump replicaset: dnsmasq-dns-87d5d4c4c Dump replicaset: dnsmasq-dns-f6bcf6c4c Dump replicaset: heat-api-5cbb648c89 Dump replicaset: heat-api-85bf9f6694 Dump replicaset: heat-api-f95fb56bf Dump replicaset: heat-cfnapi-5b649fd949 Dump replicaset: heat-cfnapi-67d857f9d Dump replicaset: heat-cfnapi-77b75c75ff Dump replicaset: heat-engine-57f66797bb Dump replicaset: heat-engine-6d9898f7cb Dump replicaset: horizon-5c89555865 Dump replicaset: horizon-5db9c89c9d Dump replicaset: horizon-676fb56878 Dump replicaset: horizon-7b6f87784b Dump replicaset: horizon-86ddbdcb65 Dump replicaset: keystone-64cb5f589 Dump replicaset: neutron-695f697977 Dump replicaset: neutron-9bdc48756 Dump replicaset: octavia-api-6547b87d77 Dump replicaset: octavia-api-6c7c5889cc Dump replicaset: octavia-image-upload-678599687f Dump replicaset: placement-9c4cb9494 Dump replicaset: swift-proxy-57f8789489 Dump replicaset: swift-proxy-6cc64ff97c Dump deployments: barbican-api Dump deployments: barbican-keystone-listener Dump deployments: barbican-worker Dump deployments: dnsmasq-dns Dump deployments: heat-api Dump deployments: heat-cfnapi Dump deployments: heat-engine Dump deployments: horizon Dump deployments: keystone Dump deployments: neutron Dump deployments: octavia-api Dump deployments: octavia-image-upload Dump deployments: placement Dump deployments: swift-proxy Dump statefulset: alertmanager-metric-storage Dump statefulset: aodh Dump statefulset: ceilometer Dump statefulset: cinder-api Dump statefulset: cinder-scheduler Dump statefulset: cinder-volume-volume1 Dump statefulset: glance-default-external-api Dump statefulset: glance-default-internal-api Dump statefulset: kube-state-metrics Dump statefulset: memcached Dump statefulset: nova-api Dump statefulset: nova-cell0-conductor Dump statefulset: nova-cell1-conductor Dump statefulset: nova-cell1-novncproxy Dump statefulset: nova-metadata Dump statefulset: nova-scheduler Dump statefulset: openstack-cell1-galera Dump statefulset: openstack-galera Dump statefulset: ovn-northd Dump statefulset: ovsdbserver-nb Dump statefulset: ovsdbserver-sb Dump statefulset: prometheus-metric-storage Dump statefulset: rabbitmq-cell1-server Dump statefulset: rabbitmq-server Dump statefulset: swift-storage Dump jobs: bootstrap-openstack-openstack-cell1 Dump jobs: configure-network-openstack-openstack-cell1 Dump jobs: configure-os-openstack-openstack-cell1 Dump jobs: download-cache-openstack-openstack-cell1 Dump jobs: install-certs-openstack-openstack-cell1 Dump jobs: install-os-openstack-openstack-cell1 Dump jobs: keystone-cron-29331901 Dump jobs: libvirt-openstack-openstack-cell1 Dump jobs: neutron-dhcp-openstack-openstack-cell1 Dump jobs: neutron-metadata-openstack-openstack-cell1 Dump jobs: neutron-sriov-openstack-openstack-cell1 Dump jobs: nova-cell1-openstack-nova-compute-ffu-cell1-openstack-cell1 Dump jobs: nova-cell1-openstack-openstack-cell1 Dump jobs: ovn-openstack-openstack-cell1 Dump jobs: pre-adoption-validation-openstack-pre-adoption-openstack-cell1 Dump jobs: reboot-os-openstack-openstack-cell1 Dump jobs: run-os-openstack-openstack-cell1 Dump jobs: ssh-known-hosts-openstack Dump jobs: swift-ring-rebalance Dump jobs: telemetry-openstack-openstack-cell1 Dump jobs: tripleo-cleanup-tripleo-cleanup-openstack-cell1 Dump jobs: validate-network-openstack-openstack-cell1 Dump cronjobs: cinder-db-purge Dump cronjobs: glance-db-purge Dump cronjobs: keystone-cron Dump cronjobs: nova-cell0-db-purge Dump cronjobs: nova-cell1-db-purge Dump cert: aodh-internal-svc Dump cert: aodh-public-route Dump cert: aodh-public-svc Dump cert: barbican-internal-svc Dump cert: barbican-public-route Dump cert: barbican-public-svc Dump cert: ceilometer-internal-svc Dump cert: cinder-internal-svc Dump cert: cinder-public-route Dump cert: cinder-public-svc Dump cert: galera-openstack-cell1-svc Dump cert: galera-openstack-svc Dump cert: glance-default-internal-svc Dump cert: glance-default-public-route Dump cert: glance-default-public-svc Dump cert: heat-api-internal-svc Dump cert: heat-api-public-route Dump cert: heat-api-public-svc Dump cert: heat-cfnapi-internal-svc Dump cert: heat-cfnapi-public-route Dump cert: heat-cfnapi-public-svc Dump cert: horizon-route Dump cert: horizon-svc Dump cert: keystone-internal-svc Dump cert: keystone-public-route Dump cert: keystone-public-svc Dump cert: kube-state-metrics-svc Dump cert: libvirt-default-standalone.ooo.test Dump cert: memcached-svc Dump cert: metric-storage-prometheus-svc Dump cert: neutron-internal-svc Dump cert: neutron-metadata-default-standalone.ooo.test Dump cert: neutron-ovndbs Dump cert: neutron-public-route Dump cert: neutron-public-svc Dump cert: nova-internal-svc Dump cert: nova-metadata-internal-svc Dump cert: nova-novncproxy-cell1-public-route Dump cert: nova-novncproxy-cell1-public-svc Dump cert: nova-novncproxy-cell1-vencrypt Dump cert: nova-public-route Dump cert: nova-public-svc Dump cert: octavia-internal-svc Dump cert: octavia-ovndbs Dump cert: octavia-public-route Dump cert: octavia-public-svc Your sos report has been generated and saved in: /host/var/tmp/sos-osp/sosreport-crc-2025-10-08-gnowabx.tar.xz Size 69.26MiB Owner root sha256 41647d5fd2d2b6c325abb51a7a116dab734a818d451b64eacb90e53f73c8c39c Please send this file to your support representative. exit Dump cert: ovn-default-standalone.ooo.test Dump cert: ovn-metrics Dump cert: ovncontroller-ovndbs Dump cert: ovndbcluster-nb-ovndbs Dump cert: ovndbcluster-sb-ovndbs Dump cert: ovnnorthd-ovndbs tar: Removing leading `/' from member names tar: /var/log/pods/*/*.log.*: Warning: Cannot stat: No such file or directory Dump cert: placement-internal-svc Dump cert: placement-public-route Dump cert: placement-public-svc Dump cert: rabbitmq-cell1-svc Dump cert: rabbitmq-svc Dump cert: swift-internal-svc Dump cert: swift-public-route Dump cert: swift-public-svc Dump cert: telemetry-default-standalone.ooo.test Dump issuer: rootca-internal Dump issuer: selfsigned-issuer Dump certificaterequests: aodh-internal-svc-1 Dump certificaterequests: aodh-public-route-1 Dump certificaterequests: aodh-public-svc-1 Dump certificaterequests: barbican-internal-svc-1 Dump certificaterequests: barbican-public-route-1 Dump certificaterequests: barbican-public-svc-1 Dump certificaterequests: ceilometer-internal-svc-1 Dump certificaterequests: cinder-internal-svc-1 Dump certificaterequests: cinder-public-route-1 Dump certificaterequests: cinder-public-svc-1 Dump certificaterequests: galera-openstack-cell1-svc-1 Dump certificaterequests: galera-openstack-svc-1 Dump certificaterequests: glance-default-internal-svc-1 Dump certificaterequests: glance-default-public-route-1 Dump certificaterequests: glance-default-public-svc-1 Dump certificaterequests: heat-api-internal-svc-1 Dump certificaterequests: heat-api-public-route-1 Dump certificaterequests: heat-api-public-svc-1 Dump certificaterequests: heat-cfnapi-internal-svc-1 Dump certificaterequests: heat-cfnapi-public-route-1 Dump certificaterequests: heat-cfnapi-public-svc-1 Dump certificaterequests: horizon-route-1 Dump certificaterequests: horizon-svc-1 Dump certificaterequests: keystone-internal-svc-1 Dump certificaterequests: keystone-public-route-1 Dump certificaterequests: keystone-public-svc-1 Dump certificaterequests: kube-state-metrics-svc-1 Dump certificaterequests: libvirt-default-standalone.ooo.test-1 Dump certificaterequests: memcached-svc-1 Dump certificaterequests: metric-storage-prometheus-svc-1 Dump certificaterequests: neutron-internal-svc-1 Dump certificaterequests: neutron-metadata-default-standalone.ooo.test-1 Dump certificaterequests: neutron-ovndbs-1 Dump certificaterequests: neutron-public-route-1 Dump certificaterequests: neutron-public-svc-1 Dump certificaterequests: nova-internal-svc-1 Dump certificaterequests: nova-metadata-internal-svc-1 Dump certificaterequests: nova-novncproxy-cell1-public-route-1 Dump certificaterequests: nova-novncproxy-cell1-public-svc-1 Dump certificaterequests: nova-novncproxy-cell1-vencrypt-1 Dump certificaterequests: nova-public-route-1 Dump certificaterequests: nova-public-svc-1 Dump certificaterequests: octavia-internal-svc-1 Dump certificaterequests: octavia-ovndbs-1 Dump certificaterequests: octavia-public-route-1 Dump certificaterequests: octavia-public-svc-1 Dump certificaterequests: ovn-default-standalone.ooo.test-1 Dump certificaterequests: ovn-metrics-1 Dump certificaterequests: ovncontroller-ovndbs-1 Dump certificaterequests: ovndbcluster-nb-ovndbs-1 Dump certificaterequests: ovndbcluster-sb-ovndbs-1 Dump certificaterequests: ovnnorthd-ovndbs-1 Dump certificaterequests: placement-internal-svc-1 Dump certificaterequests: placement-public-route-1 Dump certificaterequests: placement-public-svc-1 Dump certificaterequests: rabbitmq-cell1-svc-1 Dump certificaterequests: rabbitmq-svc-1 Dump certificaterequests: swift-internal-svc-1 Dump certificaterequests: swift-public-route-1 Dump certificaterequests: swift-public-svc-1 Dump certificaterequests: telemetry-default-standalone.ooo.test-1 Gathering secrets in namespace openstack-operators tar: Removing leading `/' from hard link targets Removing debug pod ... Retrieving SOS Report for crc Creating compressed archive... Your sos report has been generated and saved in: /var/tmp/sos-osp/sosreport-standalone-2025-10-08-kwreeer.tar.xz Size 57.90MiB Owner root sha256 7eb21bb11a8ed4ff68e0c76555a1a96280c15fe82748a895b382cb61dceb0edf Please send this file to your support representative. Retrieving SOS Report for standalone.ooo.test Finished retrieving SOS Report for standalone.ooo.test Starting pod/crc-debug-k2v2g ... To use host binaries, run `chroot /host` Removing debug pod ... Gathering csv Gathering subscription Gathering installplan No resources found in openstack-operators namespace. Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for util from 36122a92e6b12339df3c30325af8b6d046b31b95ba79e8e607770040959j6fn pod Dump init container logs from 36122a92e6b12339df3c30325af8b6d046b31b95ba79e8e607770040959j6fn pod Dump logs for pull from 36122a92e6b12339df3c30325af8b6d046b31b95ba79e8e607770040959j6fn pod Dump init container logs from 36122a92e6b12339df3c30325af8b6d046b31b95ba79e8e607770040959j6fn pod Dump logs for extract from 36122a92e6b12339df3c30325af8b6d046b31b95ba79e8e607770040959j6fn pod Dump logs for kube-rbac-proxy from barbican-operator-controller-manager-64f56ff694-6fjfx pod Dump logs for manager from barbican-operator-controller-manager-64f56ff694-6fjfx pod Dump logs for kube-rbac-proxy from cinder-operator-controller-manager-84bd8f6848-zh97x pod Dump logs for manager from cinder-operator-controller-manager-84bd8f6848-zh97x pod Dump logs for kube-rbac-proxy from designate-operator-controller-manager-58d86cd59d-f8h2l pod Dump logs for manager from designate-operator-controller-manager-58d86cd59d-f8h2l pod Dump logs for kube-rbac-proxy from glance-operator-controller-manager-fd648f65-7l7c8 pod Dump logs for manager from glance-operator-controller-manager-fd648f65-7l7c8 pod Dump logs for kube-rbac-proxy from heat-operator-controller-manager-7ccfc8cf49-wmvbd pod Dump logs for manager from heat-operator-controller-manager-7ccfc8cf49-wmvbd pod Dump logs for kube-rbac-proxy from horizon-operator-controller-manager-5b477879bc-l8tj8 pod Dump logs for manager from horizon-operator-controller-manager-5b477879bc-l8tj8 pod Dump logs for kube-rbac-proxy from infra-operator-controller-manager-84788b6bc5-6pggm pod Dump logs for manager from infra-operator-controller-manager-84788b6bc5-6pggm pod Dump logs for kube-rbac-proxy from ironic-operator-controller-manager-5467f8988c-wklfs pod Dump logs for manager from ironic-operator-controller-manager-5467f8988c-wklfs pod Dump logs for kube-rbac-proxy from keystone-operator-controller-manager-5b84cc7657-v9mbt pod Dump logs for manager from keystone-operator-controller-manager-5b84cc7657-v9mbt pod Dump logs for kube-rbac-proxy from manila-operator-controller-manager-7cb48dbc-qftvm pod Dump logs for manager from manila-operator-controller-manager-7cb48dbc-qftvm pod Dump logs for kube-rbac-proxy from mariadb-operator-controller-manager-d6c9dc5bc-fhpnh pod Dump logs for manager from mariadb-operator-controller-manager-d6c9dc5bc-fhpnh pod Dump logs for kube-rbac-proxy from neutron-operator-controller-manager-69b956fbf6-zc5vg pod Dump logs for manager from neutron-operator-controller-manager-69b956fbf6-zc5vg pod Dump logs for kube-rbac-proxy from nova-operator-controller-manager-6c9b57c67-f58xh pod Dump logs for manager from nova-operator-controller-manager-6c9b57c67-f58xh pod Dump logs for kube-rbac-proxy from octavia-operator-controller-manager-69f59f9d8-xbgdv pod Dump logs for manager from octavia-operator-controller-manager-69f59f9d8-xbgdv pod Dump logs for kube-rbac-proxy from openstack-baremetal-operator-controller-manager-6875c66686z426p pod Dump logs for manager from openstack-baremetal-operator-controller-manager-6875c66686z426p pod Dump logs for kube-rbac-proxy from openstack-operator-controller-manager-6bfd56c677-mtx9b pod Dump logs for manager from openstack-operator-controller-manager-6bfd56c677-mtx9b pod Dump logs for kube-rbac-proxy from openstack-operator-controller-operator-b6d857f89-4vq4b pod Dump logs for operator from openstack-operator-controller-operator-b6d857f89-4vq4b pod Dump logs for registry-server from openstack-operator-index-n5wdt pod Dump logs for kube-rbac-proxy from ovn-operator-controller-manager-54d485fd9-98gw2 pod Dump logs for manager from ovn-operator-controller-manager-54d485fd9-98gw2 pod Dump logs for kube-rbac-proxy from placement-operator-controller-manager-66f6d6849b-j85xs pod Dump logs for manager from placement-operator-controller-manager-66f6d6849b-j85xs pod Dump logs for operator from rabbitmq-cluster-operator-manager-5f97d8c699-qq7r8 pod Dump logs for kube-rbac-proxy from swift-operator-controller-manager-76d5577b-pgq5t pod Dump logs for manager from swift-operator-controller-manager-76d5577b-pgq5t pod Dump logs for kube-rbac-proxy from telemetry-operator-controller-manager-f589c7597-p9q6v pod Dump logs for manager from telemetry-operator-controller-manager-f589c7597-p9q6v pod Dump logs for kube-rbac-proxy from test-operator-controller-manager-6bb6dcddc-lcqsc pod Dump logs for manager from test-operator-controller-manager-6bb6dcddc-lcqsc pod Dump logs for kube-rbac-proxy from watcher-operator-controller-manager-5d98cc5575-phmxn pod Dump logs for manager from watcher-operator-controller-manager-5d98cc5575-phmxn pod Dump services: barbican-operator-controller-manager-metrics-service Dump services: cinder-operator-controller-manager-metrics-service Dump services: controller-operator-metrics-service-operator Dump services: designate-operator-controller-manager-metrics-service Dump services: glance-operator-controller-manager-metrics-service Dump services: heat-operator-controller-manager-metrics-service Dump services: horizon-operator-controller-manager-metrics-service Dump services: infra-operator-controller-manager-metrics-service Dump services: infra-operator-webhook-service Dump services: ironic-operator-controller-manager-metrics-service Dump services: keystone-operator-controller-manager-metrics-service Dump services: manila-operator-controller-manager-metrics-service Dump services: mariadb-operator-controller-manager-metrics-service Dump services: neutron-operator-controller-manager-metrics-service Dump services: nova-operator-controller-manager-metrics-service Dump services: octavia-operator-controller-manager-metrics-service Dump services: openstack-baremetal-operator-controller-manager-metrics-service Dump services: openstack-baremetal-operator-webhook-service Dump services: openstack-operator-controller-manager-metrics-service Dump services: openstack-operator-index Dump services: openstack-operator-webhook-service Dump services: ovn-operator-controller-manager-metrics-service Dump services: placement-operator-controller-manager-metrics-service Dump services: rabbitmq-cluster-operator-controller-manager-metrics-service Dump services: swift-operator-controller-manager-metrics-service Dump services: telemetry-operator-controller-manager-metrics-service Dump services: test-operator-controller-manager-metrics-service Dump services: watcher-operator-controller-manager-metrics-service Dump replicaset: barbican-operator-controller-manager-64f56ff694 Dump replicaset: cinder-operator-controller-manager-84bd8f6848 Dump replicaset: designate-operator-controller-manager-58d86cd59d Dump replicaset: glance-operator-controller-manager-fd648f65 Dump replicaset: heat-operator-controller-manager-7ccfc8cf49 Dump replicaset: horizon-operator-controller-manager-5b477879bc Dump replicaset: infra-operator-controller-manager-84788b6bc5 Dump replicaset: ironic-operator-controller-manager-5467f8988c Dump replicaset: keystone-operator-controller-manager-5b84cc7657 Dump replicaset: manila-operator-controller-manager-7cb48dbc Dump replicaset: mariadb-operator-controller-manager-d6c9dc5bc Dump replicaset: neutron-operator-controller-manager-69b956fbf6 Dump replicaset: nova-operator-controller-manager-6c9b57c67 Dump replicaset: octavia-operator-controller-manager-69f59f9d8 Dump replicaset: openstack-baremetal-operator-controller-manager-6875c66686 Dump replicaset: openstack-operator-controller-manager-6bfd56c677 Dump replicaset: openstack-operator-controller-operator-b6d857f89 Dump replicaset: ovn-operator-controller-manager-54d485fd9 Dump replicaset: placement-operator-controller-manager-66f6d6849b Dump replicaset: rabbitmq-cluster-operator-manager-5f97d8c699 Dump replicaset: swift-operator-controller-manager-76d5577b Dump replicaset: telemetry-operator-controller-manager-f589c7597 Dump replicaset: test-operator-controller-manager-6bb6dcddc Dump replicaset: watcher-operator-controller-manager-5d98cc5575 Dump deployments: barbican-operator-controller-manager Dump deployments: cinder-operator-controller-manager Dump deployments: designate-operator-controller-manager Dump deployments: glance-operator-controller-manager Dump deployments: heat-operator-controller-manager Dump deployments: horizon-operator-controller-manager Dump deployments: infra-operator-controller-manager Dump deployments: ironic-operator-controller-manager Dump deployments: keystone-operator-controller-manager Dump deployments: manila-operator-controller-manager Dump deployments: mariadb-operator-controller-manager Dump deployments: neutron-operator-controller-manager Dump deployments: nova-operator-controller-manager Dump deployments: octavia-operator-controller-manager Dump deployments: openstack-baremetal-operator-controller-manager Dump deployments: openstack-operator-controller-manager Dump deployments: openstack-operator-controller-operator Dump deployments: ovn-operator-controller-manager Dump deployments: placement-operator-controller-manager Dump deployments: rabbitmq-cluster-operator-manager Dump deployments: swift-operator-controller-manager Dump deployments: telemetry-operator-controller-manager Dump deployments: test-operator-controller-manager Dump deployments: watcher-operator-controller-manager Dump jobs: 36122a92e6b12339df3c30325af8b6d046b31b95ba79e8e60777004095ac6d3 Dump cert: infra-operator-serving-cert Dump cert: openstack-baremetal-operator-serving-cert Dump cert: openstack-operator-serving-cert Dump issuer: infra-operator-selfsigned-issuer Dump issuer: openstack-baremetal-operator-selfsigned-issuer Dump issuer: openstack-operator-selfsigned-issuer Dump certificaterequests: infra-operator-serving-cert-1 Dump certificaterequests: openstack-baremetal-operator-serving-cert-1 Dump certificaterequests: openstack-operator-serving-cert-1 Gathering secrets in namespace baremetal-operator-system Gathering secrets in namespace openshift-machine-api Gathering csv Gathering subscription Gathering installplan No resources found in openshift-machine-api namespace. Dump logs for control-plane-machine-set-operator from control-plane-machine-set-operator-78cbb6b69f-9dwhm pod Dump logs for kube-rbac-proxy from machine-api-operator-5694c8668f-clxh5 pod Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for machine-api-operator from machine-api-operator-5694c8668f-clxh5 pod Dump services: cluster-autoscaler-operator Dump services: control-plane-machine-set-operator Dump services: machine-api-controllers Dump services: machine-api-operator Dump services: machine-api-operator-machine-webhook Dump services: machine-api-operator-webhook Dump replicaset: control-plane-machine-set-operator-78cbb6b69f Dump replicaset: machine-api-operator-5694c8668f Dump deployments: control-plane-machine-set-operator Dump deployments: machine-api-operator Gathering secrets in namespace cert-manager Gathering csv Gathering subscription Gathering installplan No resources found in cert-manager namespace. Dump logs for cert-manager-controller from cert-manager-7d4cc89fcb-9z5df pod Dump logs for cert-manager-cainjector from cert-manager-cainjector-7d9f95dbf-68v2w pod Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for cert-manager-webhook from cert-manager-webhook-d969966f-6qg2f pod Dump services: cert-manager Dump services: cert-manager-cainjector Dump services: cert-manager-webhook Dump replicaset: cert-manager-7d4cc89fcb Dump replicaset: cert-manager-cainjector-7d9f95dbf Dump replicaset: cert-manager-webhook-d969966f Dump deployments: cert-manager Dump deployments: cert-manager-cainjector Dump deployments: cert-manager-webhook Gathering secrets in namespace openshift-nmstate Gathering csv Gathering subscription Gathering installplan No resources found in openshift-nmstate namespace. Dump logs for nmstate-console-plugin from nmstate-console-plugin-6b874cbd85-f4z6n pod Dump logs for nmstate-handler from nmstate-handler-t28hq pod Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for kube-rbac-proxy from nmstate-metrics-fdff9cb8d-ft9jc pod Dump logs for nmstate-metrics from nmstate-metrics-fdff9cb8d-ft9jc pod Dump logs for nmstate-operator from nmstate-operator-858ddd8f98-sdkfc pod Dump logs for nmstate-webhook from nmstate-webhook-6cdbc54649-kxhxj pod Dump services: nmstate-console-plugin Dump services: nmstate-monitor Dump services: nmstate-webhook Dump daemonset: nmstate-handler Dump replicaset: nmstate-console-plugin-6b874cbd85 Dump replicaset: nmstate-metrics-fdff9cb8d Dump replicaset: nmstate-operator-858ddd8f98 Dump replicaset: nmstate-webhook-6cdbc54649 Dump deployments: nmstate-console-plugin Dump deployments: nmstate-metrics Dump deployments: nmstate-operator Dump deployments: nmstate-webhook Gathering secrets in namespace openshift-operators-redhat Gathering secrets in namespace openshift-logging Gathering secrets in namespace metallb-system Gathering csv Gathering subscription Gathering installplan No resources found in metallb-system namespace. Dump logs for controller from controller-68d546b9d8-gtdwt pod Dump logs for kube-rbac-proxy from controller-68d546b9d8-gtdwt pod Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for cp-frr-files from frr-k8s-67rh4 pod Dump init container logs from frr-k8s-67rh4 pod Dump logs for cp-reloader from frr-k8s-67rh4 pod Dump init container logs from frr-k8s-67rh4 pod Dump logs for cp-metrics from frr-k8s-67rh4 pod Dump init container logs from frr-k8s-67rh4 pod Dump logs for controller from frr-k8s-67rh4 pod Dump logs for frr from frr-k8s-67rh4 pod Dump logs for frr-metrics from frr-k8s-67rh4 pod Dump logs for kube-rbac-proxy from frr-k8s-67rh4 pod Dump logs for kube-rbac-proxy-frr from frr-k8s-67rh4 pod Dump logs for reloader from frr-k8s-67rh4 pod Dump logs for frr-k8s-webhook-server from frr-k8s-webhook-server-64bf5d555-5jj6g pod Dump logs for manager from metallb-operator-controller-manager-6c464c978f-r4jsv pod Dump logs for webhook-server from metallb-operator-webhook-server-67bdd4c657-nfh8t pod Dump logs for kube-rbac-proxy from speaker-b4xgg pod Dump logs for speaker from speaker-b4xgg pod Dump services: controller-monitor-service Dump services: frr-k8s-monitor-service Dump services: frr-k8s-webhook-service Dump services: metallb-operator-controller-manager-service Dump services: metallb-operator-webhook-server-service Dump services: metallb-operator-webhook-service Dump services: speaker-monitor-service Dump services: webhook-service Dump daemonset: frr-k8s Dump daemonset: speaker Dump replicaset: controller-68d546b9d8 Dump replicaset: frr-k8s-webhook-server-64bf5d555 Dump replicaset: metallb-operator-controller-manager-6c464c978f Dump replicaset: metallb-operator-webhook-server-67bdd4c657 Dump deployments: controller Dump deployments: frr-k8s-webhook-server Dump deployments: metallb-operator-controller-manager Dump deployments: metallb-operator-webhook-server Gathering secrets in namespace openshift-marketplace Gathering csv Gathering subscription Gathering installplan No resources found in openshift-marketplace namespace. Dump logs for util from 695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb69j9xjh pod Dump init container logs from 695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb69j9xjh pod Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for pull from 695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb69j9xjh pod Dump init container logs from 695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb69j9xjh pod Dump logs for extract from 695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb69j9xjh pod Dump logs for util from 8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d22tlrj pod Dump init container logs from 8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d22tlrj pod Dump logs for pull from 8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d22tlrj pod Dump init container logs from 8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d22tlrj pod Dump logs for extract from 8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d22tlrj pod Dump logs for util from a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2d9pp9x pod Dump init container logs from a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2d9pp9x pod Dump logs for pull from a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2d9pp9x pod Dump init container logs from a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2d9pp9x pod Dump logs for extract from a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2d9pp9x pod Dump logs for extract-utilities from certified-operators-wc56k pod Dump init container logs from certified-operators-wc56k pod Dump logs for extract-content from certified-operators-wc56k pod Dump init container logs from certified-operators-wc56k pod Dump logs for registry-server from certified-operators-wc56k pod Dump logs for extract-utilities from community-operators-kk8np pod Dump init container logs from community-operators-kk8np pod Dump logs for extract-content from community-operators-kk8np pod Dump init container logs from community-operators-kk8np pod Dump logs for registry-server from community-operators-kk8np pod Dump logs for util from fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cnbpr8 pod Dump init container logs from fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cnbpr8 pod Dump logs for pull from fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cnbpr8 pod Dump init container logs from fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cnbpr8 pod Dump logs for extract from fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cnbpr8 pod Dump logs for marketplace-operator from marketplace-operator-79b997595-zbtmm pod Dump logs for extract-utilities from redhat-marketplace-xz5ng pod Dump init container logs from redhat-marketplace-xz5ng pod Dump logs for extract-content from redhat-marketplace-xz5ng pod Dump init container logs from redhat-marketplace-xz5ng pod Dump logs for registry-server from redhat-marketplace-xz5ng pod Dump logs for extract-utilities from redhat-operators-j6jqg pod Dump init container logs from redhat-operators-j6jqg pod Dump logs for extract-content from redhat-operators-j6jqg pod Dump init container logs from redhat-operators-j6jqg pod Dump logs for registry-server from redhat-operators-j6jqg pod Dump services: certified-operators Dump services: community-operators Dump services: marketplace-operator-metrics Dump services: redhat-marketplace Dump services: redhat-operators Dump replicaset: marketplace-operator-79b997595 Dump deployments: marketplace-operator Dump jobs: 695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb692b16c Dump jobs: 8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2f2057 Dump jobs: a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2d8e94a Dump jobs: fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbc47b Gathering secrets in namespace openshift-operators Gathering csv Gathering subscription Gathering installplan No resources found in openshift-operators namespace. Dump logs for prometheus-operator from obo-prometheus-operator-7c8cf85677-f29ft pod Dump logs for prometheus-operator-admission-webhook from obo-prometheus-operator-admission-webhook-56b988d98c-6229j pod Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for prometheus-operator-admission-webhook from obo-prometheus-operator-admission-webhook-56b988d98c-s98xq pod Dump logs for operator from observability-operator-cc5f78dfc-29nr5 pod Dump logs for perses-operator from perses-operator-54bc95c9fb-2vdst pod Dump services: obo-prometheus-operator Dump services: obo-prometheus-operator-admission-webhook Dump services: obo-prometheus-operator-admission-webhook-service Dump services: observability-operator Dump replicaset: obo-prometheus-operator-7c8cf85677 Dump replicaset: obo-prometheus-operator-admission-webhook-56b988d98c Dump replicaset: observability-operator-cc5f78dfc Dump replicaset: perses-operator-54bc95c9fb Dump deployments: obo-prometheus-operator Dump deployments: obo-prometheus-operator-admission-webhook Dump deployments: observability-operator Dump deployments: perses-operator Gather ctlplane service info: openstack Gather ctlplane service info: ovn Gather ctlplane service info: rabbitmq Copying OVN NB database from ovsdbserver-nb-0 Defaulted container "ovsdbserver-nb" out of: ovsdbserver-nb, openstack-network-exporter Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Copying OVN SB database from ovsdbserver-sb-0 Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "ovsdbserver-sb" out of: ovsdbserver-sb, openstack-network-exporter tar: Removing leading `/' from member names tar: Removing leading `/' from member names Gather ctlplane service info: keystone Gather ctlplane service info: glance Gather ctlplane service info: cinder Gather ctlplane service info: nova Gather ctlplane service info: heat Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) ERROR: You are not authorized to use service:index. command terminated with exit code 1 Gather ctlplane service info: octavia Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Gather ctlplane service info: placement Gather ctlplane service info: neutron Gather ctlplane service info: swift Gather ctlplane service info: barbican Gather ctlplane service info: ceilometer Gather ctlplane service info: aodh Extensions list not supported by Identity API --- Logging error --- Traceback (most recent call last): File "/usr/lib/python3.9/site-packages/cliff/app.py", line 410, in run_subcommand result = cmd.run(parsed_args) File "/usr/lib/python3.9/site-packages/osc_lib/command/command.py", line 39, in run return super(Command, self).run(parsed_args) File "/usr/lib/python3.9/site-packages/cliff/display.py", line 117, in run column_names, data = self.take_action(parsed_args) File "/usr/lib/python3.9/site-packages/observabilityclient/v1/cli.py", line 27, in take_action metrics = client.query.list(disable_rbac=parsed_args.disable_rbac) File "/usr/lib/python3.9/site-packages/observabilityclient/v1/python_api.py", line 27, in list metric_names = self.prom.label_values("__name__") File "/usr/lib/python3.9/site-packages/observabilityclient/prometheus_client.py", line 143, in label_values decoded = self._get(f"label/{label}/values") File "/usr/lib/python3.9/site-packages/observabilityclient/prometheus_client.py", line 79, in _get raise PrometheusAPIClientError(resp) observabilityclient.prometheus_client.PrometheusAPIClientError: During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib64/python3.9/logging/__init__.py", line 1083, in emit msg = self.format(record) File "/usr/lib64/python3.9/logging/__init__.py", line 927, in format return fmt.format(record) File "/usr/lib64/python3.9/logging/__init__.py", line 663, in format record.message = record.getMessage() File "/usr/lib64/python3.9/logging/__init__.py", line 365, in getMessage msg = str(self.msg) File "/usr/lib/python3.9/site-packages/observabilityclient/prometheus_client.py", line 30, in __str__ decoded = self.resp.json() File "/usr/lib/python3.9/site-packages/requests/models.py", line 891, in json return complexjson.loads( File "/usr/lib64/python3.9/site-packages/simplejson/__init__.py", line 525, in loads return _default_decoder.decode(s) File "/usr/lib64/python3.9/site-packages/simplejson/decoder.py", line 370, in decode obj, end = self.raw_decode(s) File "/usr/lib64/python3.9/site-packages/simplejson/decoder.py", line 400, in raw_decode return self.scan_once(s, idx=_w(s, idx).end()) simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0) Call stack: File "/usr/bin/openstack", line 10, in sys.exit(main()) File "/usr/lib/python3.9/site-packages/openstackclient/shell.py", line 145, in main return OpenStackShell().run(argv) File "/usr/lib/python3.9/site-packages/osc_lib/shell.py", line 134, in run ret_val = super(OpenStackShell, self).run(argv) File "/usr/lib/python3.9/site-packages/cliff/app.py", line 278, in run result = self.run_subcommand(remainder) File "/usr/lib/python3.9/site-packages/osc_lib/shell.py", line 175, in run_subcommand ret_value = super(OpenStackShell, self).run_subcommand(argv) File "/usr/lib/python3.9/site-packages/cliff/app.py", line 422, in run_subcommand self.LOG.error(err) Unable to print the message and arguments - possible formatting error. Use the traceback above to help find the error. command terminated with exit code 1 tar: Removing leading `/' from member names The /must-gather/must-gather.tar.xz now can be attached to the support case.