Trigger GMR for Service cinder Trigger GMR for Nova services Will retrieve SOS reports from nodes crc Generating SOS Report for crc Generating SOS Report for EDPM compute-0 Starting pod/crc-debug-8zh8b ... To use host binaries, run `chroot /host` Warning: Permanently added '192.168.122.100' (ED25519) to the list of known hosts. +--------------------------------------+----------------+--------------------------------+----------+---------+-------+----------------------------+ | ID | Binary | Host | Zone | Status | State | Updated At | +--------------------------------------+----------------+--------------------------------+----------+---------+-------+----------------------------+ | 689d31b4-da95-4f80-84b6-3ac9ef32d6a4 | nova-conductor | nova-cell0-conductor-0 | internal | enabled | up | 2025-10-07T12:32:33.000000 | | 957339ba-f573-4db9-b633-575dd7b72f72 | nova-scheduler | nova-scheduler-0 | internal | enabled | up | 2025-10-07T12:32:28.000000 | | 5d8b2146-d377-4c22-80ff-f2e04e4d4a65 | nova-conductor | nova-cell1-conductor-0 | internal | enabled | up | 2025-10-07T12:32:27.000000 | | c8dad02d-397a-4069-ab15-fa3d82a0cfa5 | nova-compute | compute-0.ctlplane.example.com | nova | enabled | up | 2025-10-07T12:32:32.000000 | +--------------------------------------+----------------+--------------------------------+----------+---------+-------+----------------------------+ sos report (version 4.10.0) This command will collect diagnostic and configuration information from this CentOS Linux system and installed applications. An archive containing the collected information will be generated in /var/tmp/sos-osp/sos.puodhb1f and may be provided to a CentOS support representative. Any information provided to CentOS will be treated in accordance with the published support policies at: Community Website : https://www.centos.org/ The generated archive may contain data considered sensitive and its content should be reviewed by the originating organization before being passed to any third party. No changes will be made to system configuration. Setting up archive ... Setting up plugins ... toolbox-osp Gathering CRDs Trying to pull registry.redhat.io/rhel9/support-tools:latest... Getting image source signatures Checking if image destination supports signatures Copying blob sha256:97718391176c91bbeea71172faf017b5982e3e383b2d2a6652ade6b25910938e Copying blob sha256:74956640af323393be3edafd6bbf4d02e5336ac16c17bd052e9127b7a9f77159 Copying config sha256:a46baefd96eef0f353f3454364d157bbbd4c6e35b14a551dee466c297887355c Writing manifest to image destination Storing signatures a46baefd96eef0f353f3454364d157bbbd4c6e35b14a551dee466c297887355c .toolboxrc file detected, overriding defaults... Checking if there is a newer version of registry.redhat.io/rhel9/support-tools available... [plugin:networking] skipped command 'ip -s macsec show': required kmods missing: macsec. Use '--allow-system-changes' to enable collection. [plugin:openstack_neutron] Could not open conf file /etc/neutron/plugins/ml2/ml2_conf.ini: [Errno 2] No such file or directory: '/etc/neutron/plugins/ml2/ml2_conf.ini' Not all environment variables set. Source the environment file for the user intended to connect to the OpenStack environment. [plugin:systemd] skipped command 'systemd-resolve --status': required services missing: systemd-resolved. [plugin:systemd] skipped command 'systemd-resolve --statistics': required services missing: systemd-resolved. Running plugins. Please wait ... Starting 2/77 anacron [Running: anacron] Starting 1/77 anaconda [Running: anacron anaconda] Starting 3/77 ata [Running: anacron anaconda ata] Starting 4/77 auditd [Running: anacron anaconda auditd] Starting 5/77 block [Running: anacron anaconda auditd block] Starting 6/77 boot [Running: anaconda auditd block boot] Starting 7/77 buildah [Running: auditd block boot buildah] Starting 8/77 ceph_common [Running: block boot buildah ceph_common] Starting 9/77 cgroups [Running: block boot buildah cgroups] Spawning a container 'toolbox-osp' with image 'registry.redhat.io/rhel9/support-tools' Detected RUN label in the container image. Using that as the default... Starting 10/77 chrony [Running: boot buildah cgroups chrony] 4aeb7a1e796f7defdb3482317e9e24ce6a164f13ed8b5056a52b615060cfef44 Starting 11/77 console [Running: boot cgroups chrony console] Starting 12/77 containers_common [Running: boot cgroups console containers_common] Starting 13/77 coredump [Running: boot cgroups console coredump] Starting 14/77 cron [Running: boot cgroups console cron] Starting 15/77 crypto [Running: boot cgroups console crypto] Starting 16/77 dbus [Running: boot cgroups crypto dbus] Starting 17/77 devicemapper [Running: boot cgroups crypto devicemapper] Starting 18/77 devices [Running: boot cgroups devicemapper devices] Starting 19/77 dnf [Running: boot cgroups devices dnf] Starting 20/77 filesys [Running: boot cgroups dnf filesys] toolbox-osp Starting 21/77 firewall_tables [Running: boot cgroups dnf firewall_tables] sos report --batch --all-logs --only-plugins block,cifs,crio,devicemapper,devices,firewall_tables,firewalld,iscsi,lvm2,memory,multipath,nfs,nis,nvme,podman,process,processor,selinux,scsi,udev,logs,crypto --tmp-dir=/var/tmp/sos-osp; exit Starting 22/77 hardware [Running: boot cgroups dnf hardware] Starting 23/77 host [Running: boot cgroups dnf host] Starting 24/77 i18n [Running: boot dnf host i18n] Starting 25/77 iscsi [Running: boot dnf host iscsi] Starting 26/77 kdump [Running: boot dnf host kdump] Starting 27/77 kernel [Running: boot dnf kdump kernel] Starting 28/77 keyutils [Running: boot dnf kernel keyutils] Starting 29/77 krb5 [Running: boot dnf kernel krb5] Starting 30/77 kvm [Running: boot dnf kernel kvm] Gathering CRs Starting 31/77 ldap [Running: boot dnf kvm ldap] Starting 32/77 libraries [Running: boot dnf kvm libraries] Starting 33/77 libvirt [Running: boot dnf kvm libvirt] Starting 34/77 login [Running: boot dnf kvm login] Starting 35/77 logrotate [Running: boot dnf kvm logrotate] Starting 36/77 logs [Running: boot dnf kvm logs] Starting 37/77 lvm2 [Running: dnf kvm logs lvm2] Starting 38/77 md [Running: dnf kvm logs md] Starting 39/77 memory [Running: dnf kvm logs memory] Starting 40/77 multipath [Running: dnf logs memory multipath] Starting 41/77 networking [Running: dnf logs memory networking] Starting 42/77 networkmanager [Running: dnf logs networking networkmanager] Starting 43/77 nfs [Running: dnf networking networkmanager nfs] Starting 44/77 numa [Running: dnf networking networkmanager numa] Starting 45/77 nvme [Running: dnf networking networkmanager nvme] [?2004l sos report (version 4.9.2) Starting 46/77 openhpi [Running: dnf networking networkmanager openhpi] Starting 47/77 openstack_edpm [Running: dnf networking networkmanager openstack_edpm] Starting 48/77 openstack_neutron [Running: dnf networking networkmanager openstack_neutron] Starting 49/77 openstack_nova [Running: dnf networking networkmanager openstack_nova] Starting 50/77 openvswitch [Running: dnf networking networkmanager openvswitch] Starting 51/77 ovn_host [Running: dnf networking openvswitch ovn_host] Starting 52/77 pam [Running: dnf networking openvswitch pam] Starting 53/77 pci [Running: dnf networking openvswitch pci] Starting 54/77 podman [Running: dnf networking openvswitch podman] Starting 55/77 process [Running: dnf networking podman process] Starting 56/77 processor [Running: dnf networking process processor] Starting 57/77 python [Running: dnf process processor python] Starting 58/77 release [Running: dnf process processor release] Starting 59/77 rpm [Running: dnf process processor rpm] Starting 60/77 sar [Running: process processor rpm sar] Starting 61/77 scsi [Running: process processor rpm scsi] Starting 62/77 selinux [Running: processor rpm scsi selinux] Starting 63/77 services [Running: processor rpm selinux services] Starting 64/77 ssh [Running: processor selinux services ssh] Starting 65/77 sudo [Running: processor selinux services sudo] Starting 66/77 sunrpc [Running: processor selinux services sunrpc] Starting 67/77 system [Running: processor selinux sunrpc system] Starting 68/77 systemd [Running: processor selinux system systemd] This command will collect diagnostic and configuration information from this Red Hat Enterprise Linux system and installed applications. An archive containing the collected information will be generated in /host/var/tmp/sos-osp/sos.clbz1eky and may be provided to a Red Hat support representative. Any information provided to Red Hat will be treated in accordance with the published support policies at: Distribution Website : https://www.redhat.com/ Commercial Support : https://access.redhat.com/ The generated archive may contain data considered sensitive and its content should be reviewed by the originating organization before being passed to any third party. No changes will be made to system configuration. Setting up archive ... Setting up plugins ... Starting 69/77 sysvipc [Running: processor selinux systemd sysvipc] Starting 70/77 tpm2 [Running: processor selinux systemd tpm2] Starting 71/77 tuned [Running: processor selinux systemd tuned] Starting 72/77 udev [Running: processor selinux systemd udev] Starting 73/77 unbound [Running: processor selinux systemd unbound] Starting 74/77 vhostmd [Running: processor selinux systemd vhostmd] Starting 75/77 virsh [Running: processor selinux systemd virsh] Running plugins. Please wait ... Starting 2/22 cifs [Running: cifs] Starting 1/22 block [Running: cifs block] Starting 4/22 crypto [Running: cifs block crypto] Starting 3/22 crio [Running: cifs block crypto crio] Starting 5/22 devicemapper [Running: block crypto crio devicemapper] Starting 6/22 devices [Running: block crypto crio devices] Starting 76/77 xen [Running: processor systemd virsh xen] Finishing plugins [Running: processor systemd virsh] Starting 77/77 xfs [Running: processor systemd virsh xfs] Starting 7/22 firewall_tables [Running: block crypto crio firewall_tables] Starting 8/22 firewalld [Running: block crio firewall_tables firewalld] Finishing plugins [Running: processor systemd virsh] Starting 9/22 iscsi [Running: block crio firewalld iscsi] Starting 10/22 logs [Running: block crio firewalld logs] Finishing plugins [Running: processor virsh] Starting 11/22 lvm2 [Running: crio logs lvm2] Starting 12/22 memory [Running: crio logs lvm2 memory] Finishing plugins [Running: processor] Starting 13/22 multipath [Running: crio logs lvm2 multipath] Starting 14/22 nfs [Running: crio logs multipath nfs] Starting 15/22 nis [Running: crio logs nfs nis] Starting 16/22 nvme [Running: crio logs nfs nvme] Starting 17/22 podman [Running: crio logs nfs podman] Starting 18/22 process [Running: crio logs podman process] Finished running plugins Starting 19/22 processor [Running: crio podman process processor] Starting 20/22 scsi [Running: crio podman processor scsi] Starting 21/22 selinux [Running: crio podman scsi selinux] Finishing plugins [Running: crio podman selinux] Starting 22/22 udev [Running: crio podman selinux udev] Creating compressed archive... Your sos report has been generated and saved in: /var/tmp/sos-osp/sosreport-compute-0-2025-10-07-nynnzld.tar.xz Size 15.49MiB Owner root sha256 96619f0860b28cf7ebf24a977cd6201e7a82bb3dbb150f1f052d23df57528ab4 Please send this file to your support representative. Retrieving SOS Report for compute-0 Finished retrieving SOS Report for compute-0 Finishing plugins [Running: crio podman selinux] Writing validating webhooks Writing mutating webhooks Extracting ConfigMap: rabbitmq-cell1-config-data Extracting ConfigMap: rabbitmq-cell1-plugins-conf Extracting ConfigMap: rabbitmq-cell1-server-conf Extracting ConfigMap: rabbitmq-config-data Extracting ConfigMap: rabbitmq-plugins-conf Extracting ConfigMap: rabbitmq-server-conf Extracting ConfigMap: nova-extra-config Extracting ConfigMap: neutron-edpm-ipam Extracting ConfigMap: dns-swift-storage-0 Extracting ConfigMap: swift-ring-config-data Extracting ConfigMap: swift-ring-files Extracting ConfigMap: swift-ring-scripts Extracting ConfigMap: swift-storage-config-data Extracting ConfigMap: ovncontroller-config Extracting ConfigMap: ovncontroller-extra-scripts Extracting ConfigMap: ovncontroller-metrics-config Extracting ConfigMap: ovncontroller-scripts Extracting ConfigMap: ovndbcluster-nb-config Extracting ConfigMap: ovndbcluster-nb-scripts Extracting ConfigMap: ovndbcluster-sb-config Extracting ConfigMap: ovndbcluster-sb-scripts Extracting ConfigMap: ovnnorthd-config Extracting ConfigMap: ovnnorthd-scripts Extracting ConfigMap: ovsdbserver-nb Extracting ConfigMap: ovsdbserver-sb Extracting ConfigMap: prometheus-metric-storage-rulefiles-0 Extracting ConfigMap: infra-instanceha-config Gathering secrets in namespace openstack Finishing plugins [Running: podman selinux] Finishing plugins [Running: podman] Finished running plugins Creating compressed archive... Error while masking key: alertmanager.yaml.gz, for file: /must-gather/namespaces/openstack/secrets/metric-storage/alertmanager-metric-storage-generated.yaml Error while masking key: prometheus.yaml.gz, for file: /must-gather/namespaces/openstack/secrets/metric-storage/prometheus-metric-storage.yaml Gathering csv Gathering subscription Gathering installplan Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for init-config-reloader from alertmanager-metric-storage-0 pod Dump init container logs from alertmanager-metric-storage-0 pod Dump logs for alertmanager from alertmanager-metric-storage-0 pod Dump logs for config-reloader from alertmanager-metric-storage-0 pod Dump logs for aodh-api from aodh-0 pod Dump logs for aodh-evaluator from aodh-0 pod Dump logs for aodh-listener from aodh-0 pod Dump logs for aodh-notifier from aodh-0 pod Dump logs for barbican-api from barbican-api-746789dcd4-wsdtq pod Dump logs for barbican-api-log from barbican-api-746789dcd4-wsdtq pod Dump logs for barbican-keystone-listener from barbican-keystone-listener-65bb648478-f5h6h pod Dump logs for barbican-keystone-listener-log from barbican-keystone-listener-65bb648478-f5h6h pod Dump logs for barbican-worker from barbican-worker-55444c599f-s65df pod Dump logs for barbican-worker-log from barbican-worker-55444c599f-s65df pod Dump logs for bootstrap-edpm-deployment-openstack-edpm-ipam from bootstrap-edpm-deployment-openstack-edpm-ipam-2jkzx pod Dump logs for ceilometer-central-agent from ceilometer-0 pod Dump logs for ceilometer-notification-agent from ceilometer-0 pod Dump logs for proxy-httpd from ceilometer-0 pod Dump logs for sg-core from ceilometer-0 pod Dump logs for cinder-api from cinder-api-0 pod Dump logs for cinder-api-log from cinder-api-0 pod Dump logs for cinder-scheduler from cinder-scheduler-0 pod Dump logs for probe from cinder-scheduler-0 pod Dump logs for configure-network-edpm-deployment-openstack-edpm-ipam from configure-network-edpm-deployment-openstack-edpm-ipam-hxcml pod Dump logs for configure-os-edpm-deployment-openstack-edpm-ipam from configure-os-edpm-deployment-openstack-edpm-ipam-6gh6p pod Dump logs for configure-os-edpm-deployment-openstack-edpm-ipam from configure-os-edpm-deployment-openstack-edpm-ipam-9rwp9 pod Dump logs for init from dnsmasq-dns-bb85b8995-42kbj pod Dump init container logs from dnsmasq-dns-bb85b8995-42kbj pod Dump logs for dnsmasq-dns from dnsmasq-dns-bb85b8995-42kbj pod Dump logs for download-cache-edpm-deployment-openstack-edpm-ipam from download-cache-edpm-deployment-openstack-edpm-ipam-wkfzn pod Dump logs for glance-httpd from glance-default-external-api-0 pod Dump logs for glance-log from glance-default-external-api-0 pod Dump logs for glance-httpd from glance-default-internal-api-0 pod Dump logs for glance-log from glance-default-internal-api-0 pod Dump logs for heat-api from heat-api-5bd5586b7f-mt9tb pod Dump logs for heat-cfnapi from heat-cfnapi-764bc4c4ff-fb769 pod Dump logs for heat-engine from heat-engine-575565f88c-czn8g pod Dump logs for install-certs-edpm-deployment-openstack-edpm-ipam from install-certs-edpm-deployment-openstack-edpm-ipam-nwbdh pod Dump logs for install-os-edpm-deployment-openstack-edpm-ipam from install-os-edpm-deployment-openstack-edpm-ipam-lnpzk pod Dump logs for keystone-api from keystone-8444f487fd-js794 pod Dump logs for keystone-cron from keystone-cron-29330641-xmvkv pod Dump logs for kube-state-metrics from kube-state-metrics-0 pod Dump logs for libvirt-edpm-deployment-openstack-edpm-ipam from libvirt-edpm-deployment-openstack-edpm-ipam-5kf4n pod Dump logs for memcached from memcached-0 pod Dump logs for neutron-api from neutron-744b8f5559-c67wh pod Dump logs for neutron-httpd from neutron-744b8f5559-c67wh pod Dump logs for neutron-metadata-edpm-deployment-openstack-edpm-ipam from neutron-metadata-edpm-deployment-openstack-edpm-ipam-kdt2d pod Dump logs for nova-api-api from nova-api-0 pod Dump logs for nova-api-log from nova-api-0 pod Dump logs for nova-cell0-conductor-conductor from nova-cell0-conductor-0 pod Dump logs for nova-cell1-conductor-conductor from nova-cell1-conductor-0 pod Dump logs for nova-cell1-novncproxy-novncproxy from nova-cell1-novncproxy-0 pod Dump logs for nova-edpm-deployment-openstack-edpm-ipam from nova-edpm-deployment-openstack-edpm-ipam-wlkdf pod Dump logs for nova-metadata-log from nova-metadata-0 pod Dump logs for nova-metadata-metadata from nova-metadata-0 pod Dump logs for nova-scheduler-scheduler from nova-scheduler-0 pod Dump logs for mysql-bootstrap from openstack-cell1-galera-0 pod Dump init container logs from openstack-cell1-galera-0 pod Dump logs for galera from openstack-cell1-galera-0 pod Dump logs for mysql-bootstrap from openstack-galera-0 pod Dump init container logs from openstack-galera-0 pod Dump logs for galera from openstack-galera-0 pod Dump logs for openstackclient from openstackclient pod Dump logs for ovn-controller from ovn-controller-m9nzp pod Dump logs for openstack-network-exporter from ovn-controller-metrics-44drg pod Dump logs for ovsdb-server-init from ovn-controller-ovs-ksvhb pod Dump init container logs from ovn-controller-ovs-ksvhb pod Dump logs for ovs-vswitchd from ovn-controller-ovs-ksvhb pod Dump logs for ovsdb-server from ovn-controller-ovs-ksvhb pod Dump logs for ovn-edpm-deployment-openstack-edpm-ipam from ovn-edpm-deployment-openstack-edpm-ipam-s25ms pod Dump logs for openstack-network-exporter from ovn-northd-0 pod Dump logs for ovn-northd from ovn-northd-0 pod Dump logs for openstack-network-exporter from ovsdbserver-nb-0 pod Dump logs for ovsdbserver-nb from ovsdbserver-nb-0 pod Dump logs for openstack-network-exporter from ovsdbserver-sb-0 pod Dump logs for ovsdbserver-sb from ovsdbserver-sb-0 pod Dump logs for placement-api from placement-7d99cbbb56-xqb5x pod Dump logs for placement-log from placement-7d99cbbb56-xqb5x pod Dump logs for init-config-reloader from prometheus-metric-storage-0 pod Dump init container logs from prometheus-metric-storage-0 pod Dump logs for config-reloader from prometheus-metric-storage-0 pod Dump logs for prometheus from prometheus-metric-storage-0 pod Dump logs for thanos-sidecar from prometheus-metric-storage-0 pod Dump logs for setup-container from rabbitmq-cell1-server-0 pod Dump init container logs from rabbitmq-cell1-server-0 pod Dump logs for rabbitmq from rabbitmq-cell1-server-0 pod Dump logs for setup-container from rabbitmq-server-0 pod Dump init container logs from rabbitmq-server-0 pod Dump logs for rabbitmq from rabbitmq-server-0 pod Dump logs for reboot-os-edpm-deployment-openstack-edpm-ipam from reboot-os-edpm-deployment-openstack-edpm-ipam-2p4sb pod Dump logs for redhat-edpm-deployment-openstack-edpm-ipam from redhat-edpm-deployment-openstack-edpm-ipam-7926j pod Dump logs for repo-setup-edpm-deployment-openstack-edpm-ipam from repo-setup-edpm-deployment-openstack-edpm-ipam-2dkc5 pod Dump logs for run-os-edpm-deployment-openstack-edpm-ipam from run-os-edpm-deployment-openstack-edpm-ipam-h694x pod Dump logs for ssh-known-hosts-edpm-deployment from ssh-known-hosts-edpm-deployment-zdwmq pod Dump logs for proxy-httpd from swift-proxy-7cd7d44d75-xs58b pod Dump logs for proxy-server from swift-proxy-7cd7d44d75-xs58b pod Dump logs for swift-ring-rebalance from swift-ring-rebalance-pfsbd pod Dump logs for account-auditor from swift-storage-0 pod Dump logs for account-reaper from swift-storage-0 pod Dump logs for account-replicator from swift-storage-0 pod Dump logs for account-server from swift-storage-0 pod Dump logs for container-auditor from swift-storage-0 pod Dump logs for container-replicator from swift-storage-0 pod Dump logs for container-server from swift-storage-0 pod Dump logs for container-updater from swift-storage-0 pod Dump logs for object-auditor from swift-storage-0 pod Dump logs for object-expirer from swift-storage-0 pod Dump logs for object-replicator from swift-storage-0 pod Dump logs for object-server from swift-storage-0 pod Dump logs for object-updater from swift-storage-0 pod Dump logs for rsync from swift-storage-0 pod Dump logs for swift-recon-cron from swift-storage-0 pod Dump logs for telemetry-edpm-deployment-openstack-edpm-ipam from telemetry-edpm-deployment-openstack-edpm-ipam-v2p2q pod Dump logs for validate-network-edpm-deployment-openstack-edpm-ipam from validate-network-edpm-deployment-openstack-edpm-ipam-4xzsk pod Dump services: alertmanager-operated Dump services: aodh-internal Dump services: aodh-public Dump services: barbican-internal Dump services: barbican-public Dump services: ceilometer-internal Dump services: cinder-internal Dump services: cinder-public Dump services: dnsmasq-dns Dump services: glance-default-external-api Dump services: glance-default-internal Dump services: glance-default-internal-api Dump services: glance-default-public Dump services: heat-api-internal Dump services: heat-api-public Dump services: heat-cfnapi-internal Dump services: heat-cfnapi-public Dump services: keystone-internal Dump services: keystone-public Dump services: kube-state-metrics Dump services: memcached Dump services: metric-storage-alertmanager Dump services: metric-storage-prometheus Dump services: metric-storage-thanos-sidecar Dump services: neutron-internal Dump services: neutron-public Dump services: nova-internal Dump services: nova-metadata-internal Dump services: nova-novncproxy-cell1-public Dump services: nova-public Dump services: openstack Dump services: openstack-cell1 Dump services: openstack-cell1-galera Dump services: openstack-galera Dump services: ovn-controller-metrics Dump services: ovn-northd-0 Dump services: ovsdbserver-nb Dump services: ovsdbserver-nb-0 Dump services: ovsdbserver-sb Dump services: ovsdbserver-sb-0 Dump services: placement-internal Dump services: placement-public Dump services: prometheus-operated Dump services: rabbitmq Dump services: rabbitmq-cell1 Dump services: rabbitmq-cell1-nodes Dump services: rabbitmq-nodes Dump services: swift-internal Dump services: swift-public Dump services: swift-storage Dump routes: aodh-public Dump routes: barbican-public Dump routes: cinder-public Dump routes: glance-default-public Dump routes: heat-api-public Dump routes: heat-cfnapi-public Dump routes: keystone-public Dump routes: neutron-public Dump routes: nova-novncproxy-cell1-public Dump routes: nova-public Dump routes: placement-public Dump routes: swift-public Dump daemonset: ovn-controller Dump daemonset: ovn-controller-metrics Dump daemonset: ovn-controller-ovs Dump replicaset: barbican-api-746789dcd4 Dump replicaset: barbican-api-85c8cc6bbb Dump replicaset: barbican-keystone-listener-65bb648478 Dump replicaset: barbican-worker-55444c599f Dump replicaset: dnsmasq-dns-5784cf869f Dump replicaset: dnsmasq-dns-59d5ff467f Dump replicaset: dnsmasq-dns-5c5cc7c5ff Dump replicaset: dnsmasq-dns-5fbc4d444f Dump replicaset: dnsmasq-dns-68df85789f Dump replicaset: dnsmasq-dns-69c986f6d7 Dump replicaset: dnsmasq-dns-79b5d74c8c Dump replicaset: dnsmasq-dns-7ff5475cc9 Dump replicaset: dnsmasq-dns-8b5c85b87 Dump replicaset: dnsmasq-dns-bb85b8995 Dump replicaset: dnsmasq-dns-f6bc4c6c9 Dump replicaset: heat-api-5bd5586b7f Dump replicaset: heat-api-7f979f4f58 Dump replicaset: heat-api-89899c7cb Dump replicaset: heat-cfnapi-764bc4c4ff Dump replicaset: heat-cfnapi-79dfccd884 Dump replicaset: heat-cfnapi-dbfd865bb Dump replicaset: heat-engine-575565f88c Dump replicaset: heat-engine-759f9b554d Dump replicaset: keystone-8444f487fd Dump replicaset: neutron-744b8f5559 Dump replicaset: neutron-7554f5f8dd Dump replicaset: placement-7d99cbbb56 Dump replicaset: swift-proxy-7cd7d44d75 Dump deployments: barbican-api Dump deployments: barbican-keystone-listener Dump deployments: barbican-worker Dump deployments: dnsmasq-dns Dump deployments: heat-api Dump deployments: heat-cfnapi Dump deployments: heat-engine Dump deployments: keystone Dump deployments: neutron Dump deployments: placement Dump deployments: swift-proxy Dump statefulset: alertmanager-metric-storage Dump statefulset: aodh Dump statefulset: ceilometer Dump statefulset: cinder-api Dump statefulset: cinder-scheduler Dump statefulset: cinder-volume-volume1 Dump statefulset: glance-default-external-api Dump statefulset: glance-default-internal-api Dump statefulset: kube-state-metrics Dump statefulset: memcached Dump statefulset: nova-api Dump statefulset: nova-cell0-conductor Dump statefulset: nova-cell1-conductor Dump statefulset: nova-cell1-novncproxy Dump statefulset: nova-metadata Dump statefulset: nova-scheduler Dump statefulset: openstack-cell1-galera Dump statefulset: openstack-galera Dump statefulset: ovn-northd Dump statefulset: ovsdbserver-nb Dump statefulset: ovsdbserver-sb Dump statefulset: prometheus-metric-storage Dump statefulset: rabbitmq-cell1-server Dump statefulset: rabbitmq-server Dump statefulset: swift-storage Dump jobs: bootstrap-edpm-deployment-openstack-edpm-ipam Dump jobs: configure-network-edpm-deployment-openstack-edpm-ipam Dump jobs: configure-os-edpm-deployment-openstack-edpm-ipam Dump jobs: download-cache-edpm-deployment-openstack-edpm-ipam Dump jobs: install-certs-edpm-deployment-openstack-edpm-ipam Dump jobs: install-os-edpm-deployment-openstack-edpm-ipam Dump jobs: keystone-cron-29330641 Dump jobs: libvirt-edpm-deployment-openstack-edpm-ipam Dump jobs: neutron-metadata-edpm-deployment-openstack-edpm-ipam Dump jobs: nova-edpm-deployment-openstack-edpm-ipam Dump jobs: ovn-edpm-deployment-openstack-edpm-ipam Dump jobs: reboot-os-edpm-deployment-openstack-edpm-ipam Dump jobs: redhat-edpm-deployment-openstack-edpm-ipam Dump jobs: repo-setup-edpm-deployment-openstack-edpm-ipam Dump jobs: run-os-edpm-deployment-openstack-edpm-ipam Dump jobs: ssh-known-hosts-edpm-deployment Dump jobs: swift-ring-rebalance Dump jobs: telemetry-edpm-deployment-openstack-edpm-ipam Dump jobs: validate-network-edpm-deployment-openstack-edpm-ipam Dump cronjobs: cinder-db-purge Dump cronjobs: glance-db-purge Dump cronjobs: keystone-cron Dump cronjobs: nova-cell0-db-purge Dump cronjobs: nova-cell1-db-purge Your sos report has been generated and saved in: /host/var/tmp/sos-osp/sosreport-crc-2025-10-07-xoojqsb.tar.xz Size 44.09MiB Owner root sha256 c6c8719b25834275afdc8c958636d0732dc93e32cd1621faf09f7345ccb7371b Please send this file to your support representative. exit Dump cert: aodh-internal-svc Dump cert: aodh-public-route Dump cert: aodh-public-svc Dump cert: barbican-internal-svc Dump cert: barbican-public-route Dump cert: barbican-public-svc Dump cert: ceilometer-internal-svc Dump cert: cinder-internal-svc Dump cert: cinder-public-route Dump cert: cinder-public-svc Dump cert: galera-openstack-cell1-svc Dump cert: galera-openstack-svc Dump cert: glance-default-internal-svc Dump cert: glance-default-public-route Dump cert: glance-default-public-svc Dump cert: heat-api-internal-svc Dump cert: heat-api-public-route Dump cert: heat-api-public-svc Dump cert: heat-cfnapi-internal-svc Dump cert: heat-cfnapi-public-route Dump cert: heat-cfnapi-public-svc Dump cert: keystone-internal-svc Dump cert: keystone-public-route Dump cert: keystone-public-svc Dump cert: kube-state-metrics-svc Dump cert: libvirt-default-compute-0 Dump cert: memcached-svc Dump cert: metric-storage-prometheus-svc Dump cert: neutron-internal-svc Dump cert: neutron-metadata-default-compute-0 Dump cert: neutron-ovndbs Dump cert: neutron-public-route Dump cert: neutron-public-svc Dump cert: nova-internal-svc Dump cert: nova-metadata-internal-svc Dump cert: nova-novncproxy-cell1-public-route Removing debug pod ... Dump cert: nova-novncproxy-cell1-public-svc Dump cert: nova-novncproxy-cell1-vencrypt Dump cert: nova-public-route Dump cert: nova-public-svc Dump cert: ovn-default-compute-0 Dump cert: ovn-metrics Dump cert: ovncontroller-ovndbs Dump cert: ovndbcluster-nb-ovndbs Dump cert: ovndbcluster-sb-ovndbs Dump cert: ovnnorthd-ovndbs Dump cert: placement-internal-svc Dump cert: placement-public-route Dump cert: placement-public-svc Dump cert: rabbitmq-cell1-svc Dump cert: rabbitmq-svc Dump cert: rootca-internal Dump cert: rootca-libvirt Dump cert: rootca-ovn Dump cert: rootca-public Dump cert: swift-internal-svc Dump cert: swift-public-route Retrieving SOS Report for crc Dump cert: swift-public-svc Dump cert: telemetry-default-compute-0 Dump issuer: rootca-internal Dump issuer: rootca-libvirt Dump issuer: rootca-ovn Dump issuer: rootca-public Dump issuer: selfsigned-issuer Dump certificaterequests: aodh-internal-svc-1 Dump certificaterequests: aodh-public-route-1 Dump certificaterequests: aodh-public-svc-1 Dump certificaterequests: barbican-internal-svc-1 Dump certificaterequests: barbican-public-route-1 Dump certificaterequests: barbican-public-svc-1 Dump certificaterequests: ceilometer-internal-svc-1 Dump certificaterequests: cinder-internal-svc-1 Dump certificaterequests: cinder-public-route-1 Dump certificaterequests: cinder-public-svc-1 Dump certificaterequests: galera-openstack-cell1-svc-1 Dump certificaterequests: galera-openstack-svc-1 Dump certificaterequests: glance-default-internal-svc-1 Dump certificaterequests: glance-default-public-route-1 Dump certificaterequests: glance-default-public-svc-1 Dump certificaterequests: heat-api-internal-svc-1 Dump certificaterequests: heat-api-public-route-1 Dump certificaterequests: heat-api-public-svc-1 Dump certificaterequests: heat-cfnapi-internal-svc-1 Dump certificaterequests: heat-cfnapi-public-route-1 Dump certificaterequests: heat-cfnapi-public-svc-1 Dump certificaterequests: keystone-internal-svc-1 Dump certificaterequests: keystone-public-route-1 Dump certificaterequests: keystone-public-svc-1 Dump certificaterequests: kube-state-metrics-svc-1 Dump certificaterequests: libvirt-default-compute-0-1 Dump certificaterequests: memcached-svc-1 Dump certificaterequests: metric-storage-prometheus-svc-1 Dump certificaterequests: neutron-internal-svc-1 Dump certificaterequests: neutron-metadata-default-compute-0-1 Dump certificaterequests: neutron-ovndbs-1 Dump certificaterequests: neutron-public-route-1 Dump certificaterequests: neutron-public-svc-1 Dump certificaterequests: nova-internal-svc-1 Dump certificaterequests: nova-metadata-internal-svc-1 Dump certificaterequests: nova-novncproxy-cell1-public-route-1 Dump certificaterequests: nova-novncproxy-cell1-public-svc-1 Dump certificaterequests: nova-novncproxy-cell1-vencrypt-1 Dump certificaterequests: nova-public-route-1 Dump certificaterequests: nova-public-svc-1 Dump certificaterequests: ovn-default-compute-0-1 Dump certificaterequests: ovn-metrics-1 Dump certificaterequests: ovncontroller-ovndbs-1 Dump certificaterequests: ovndbcluster-nb-ovndbs-1 Dump certificaterequests: ovndbcluster-sb-ovndbs-1 Dump certificaterequests: ovnnorthd-ovndbs-1 Dump certificaterequests: placement-internal-svc-1 Dump certificaterequests: placement-public-route-1 Dump certificaterequests: placement-public-svc-1 Dump certificaterequests: rabbitmq-cell1-svc-1 Dump certificaterequests: rabbitmq-svc-1 Dump certificaterequests: rootca-internal-1 Dump certificaterequests: rootca-libvirt-1 Dump certificaterequests: rootca-ovn-1 Dump certificaterequests: rootca-public-1 Dump certificaterequests: swift-internal-svc-1 Dump certificaterequests: swift-public-route-1 Dump certificaterequests: swift-public-svc-1 Dump certificaterequests: telemetry-default-compute-0-1 Starting pod/crc-debug-qpsbw ... To use host binaries, run `chroot /host` Gathering secrets in namespace openstack-operators Removing debug pod ... Gathering csv Gathering subscription Gathering installplan No resources found in openstack-operators namespace. Dump logs for util from 673cb1016b9a8da3abb39c6f91d73e044ad6743308c34072552731c296466ml pod Dump init container logs from 673cb1016b9a8da3abb39c6f91d73e044ad6743308c34072552731c296466ml pod Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for pull from 673cb1016b9a8da3abb39c6f91d73e044ad6743308c34072552731c296466ml pod Dump init container logs from 673cb1016b9a8da3abb39c6f91d73e044ad6743308c34072552731c296466ml pod Dump logs for extract from 673cb1016b9a8da3abb39c6f91d73e044ad6743308c34072552731c296466ml pod Dump logs for kube-rbac-proxy from barbican-operator-controller-manager-58c4cd55f4-vvp7c pod Dump logs for manager from barbican-operator-controller-manager-58c4cd55f4-vvp7c pod Dump logs for kube-rbac-proxy from cinder-operator-controller-manager-7d4d4f8d-mg8jv pod Dump logs for manager from cinder-operator-controller-manager-7d4d4f8d-mg8jv pod Dump logs for kube-rbac-proxy from designate-operator-controller-manager-75dfd9b554-9xkbh pod Dump logs for manager from designate-operator-controller-manager-75dfd9b554-9xkbh pod Dump logs for kube-rbac-proxy from glance-operator-controller-manager-5dc44df7d5-8dhrp pod Dump logs for manager from glance-operator-controller-manager-5dc44df7d5-8dhrp pod Dump logs for kube-rbac-proxy from heat-operator-controller-manager-54b4974c45-s2qwp pod Dump logs for manager from heat-operator-controller-manager-54b4974c45-s2qwp pod Dump logs for kube-rbac-proxy from horizon-operator-controller-manager-76d5b87f47-69f5t pod Dump logs for manager from horizon-operator-controller-manager-76d5b87f47-69f5t pod Dump logs for kube-rbac-proxy from infra-operator-controller-manager-658588b8c9-5nnwj pod Dump logs for manager from infra-operator-controller-manager-658588b8c9-5nnwj pod Dump logs for kube-rbac-proxy from ironic-operator-controller-manager-649675d675-dfs4r pod Dump logs for manager from ironic-operator-controller-manager-649675d675-dfs4r pod Dump logs for kube-rbac-proxy from keystone-operator-controller-manager-7b5ccf6d9c-dnn6x pod Dump logs for manager from keystone-operator-controller-manager-7b5ccf6d9c-dnn6x pod Dump logs for kube-rbac-proxy from manila-operator-controller-manager-65d89cfd9f-n4w8d pod Dump logs for manager from manila-operator-controller-manager-65d89cfd9f-n4w8d pod Dump logs for kube-rbac-proxy from mariadb-operator-controller-manager-6cd6d7bdf5-5szjk pod Dump logs for manager from mariadb-operator-controller-manager-6cd6d7bdf5-5szjk pod Dump logs for kube-rbac-proxy from neutron-operator-controller-manager-8d984cc4d-jrw6r pod Dump logs for manager from neutron-operator-controller-manager-8d984cc4d-jrw6r pod Dump logs for kube-rbac-proxy from nova-operator-controller-manager-7c7fc454ff-xxzx6 pod Dump logs for manager from nova-operator-controller-manager-7c7fc454ff-xxzx6 pod Dump logs for kube-rbac-proxy from octavia-operator-controller-manager-7468f855d8-x8twn pod Dump logs for manager from octavia-operator-controller-manager-7468f855d8-x8twn pod Dump logs for kube-rbac-proxy from openstack-baremetal-operator-controller-manager-5dfbbd665ctqg6s pod Dump logs for manager from openstack-baremetal-operator-controller-manager-5dfbbd665ctqg6s pod Dump logs for kube-rbac-proxy from openstack-operator-controller-manager-589f7cdddc-lk7np pod Dump logs for manager from openstack-operator-controller-manager-589f7cdddc-lk7np pod Dump logs for kube-rbac-proxy from openstack-operator-controller-operator-6489b698cc-vp52r pod Dump logs for operator from openstack-operator-controller-operator-6489b698cc-vp52r pod Dump logs for registry-server from openstack-operator-index-7lqzz pod Dump logs for kube-rbac-proxy from ovn-operator-controller-manager-6d8b6f9b9-jv8c7 pod Dump logs for manager from ovn-operator-controller-manager-6d8b6f9b9-jv8c7 pod Dump logs for kube-rbac-proxy from placement-operator-controller-manager-54689d9f88-xvtgc pod Dump logs for manager from placement-operator-controller-manager-54689d9f88-xvtgc pod Dump logs for operator from rabbitmq-cluster-operator-manager-5f97d8c699-rcxsc pod Dump logs for kube-rbac-proxy from swift-operator-controller-manager-6859f9b676-nq2r8 pod Dump logs for manager from swift-operator-controller-manager-6859f9b676-nq2r8 pod Dump logs for kube-rbac-proxy from telemetry-operator-controller-manager-bf98bb7b6-ghwv9 pod Dump logs for manager from telemetry-operator-controller-manager-bf98bb7b6-ghwv9 pod Dump logs for kube-rbac-proxy from test-operator-controller-manager-5cd5cb47d7-9zh29 pod Dump logs for manager from test-operator-controller-manager-5cd5cb47d7-9zh29 pod Dump logs for kube-rbac-proxy from watcher-operator-controller-manager-6cbc6dd547-khdlk pod Dump logs for manager from watcher-operator-controller-manager-6cbc6dd547-khdlk pod Dump services: barbican-operator-controller-manager-metrics-service Dump services: cinder-operator-controller-manager-metrics-service Dump services: controller-operator-metrics-service-operator Dump services: designate-operator-controller-manager-metrics-service Dump services: glance-operator-controller-manager-metrics-service Dump services: heat-operator-controller-manager-metrics-service Dump services: horizon-operator-controller-manager-metrics-service Dump services: infra-operator-controller-manager-metrics-service Dump services: infra-operator-webhook-service Dump services: ironic-operator-controller-manager-metrics-service Dump services: keystone-operator-controller-manager-metrics-service Dump services: manila-operator-controller-manager-metrics-service Dump services: mariadb-operator-controller-manager-metrics-service Dump services: neutron-operator-controller-manager-metrics-service Dump services: nova-operator-controller-manager-metrics-service Dump services: octavia-operator-controller-manager-metrics-service Dump services: openstack-baremetal-operator-controller-manager-metrics-service Dump services: openstack-baremetal-operator-webhook-service Dump services: openstack-operator-controller-manager-metrics-service Dump services: openstack-operator-index Dump services: openstack-operator-webhook-service Dump services: ovn-operator-controller-manager-metrics-service Dump services: placement-operator-controller-manager-metrics-service Dump services: rabbitmq-cluster-operator-controller-manager-metrics-service Dump services: swift-operator-controller-manager-metrics-service Dump services: telemetry-operator-controller-manager-metrics-service Dump services: test-operator-controller-manager-metrics-service Dump services: watcher-operator-controller-manager-metrics-service Dump replicaset: barbican-operator-controller-manager-58c4cd55f4 Dump replicaset: cinder-operator-controller-manager-7d4d4f8d Dump replicaset: designate-operator-controller-manager-75dfd9b554 Dump replicaset: glance-operator-controller-manager-5dc44df7d5 Dump replicaset: heat-operator-controller-manager-54b4974c45 Dump replicaset: horizon-operator-controller-manager-76d5b87f47 Dump replicaset: infra-operator-controller-manager-658588b8c9 Dump replicaset: ironic-operator-controller-manager-649675d675 Dump replicaset: keystone-operator-controller-manager-7b5ccf6d9c Dump replicaset: manila-operator-controller-manager-65d89cfd9f Dump replicaset: mariadb-operator-controller-manager-6cd6d7bdf5 Dump replicaset: neutron-operator-controller-manager-8d984cc4d Dump replicaset: nova-operator-controller-manager-7c7fc454ff Dump replicaset: octavia-operator-controller-manager-7468f855d8 Dump replicaset: openstack-baremetal-operator-controller-manager-5dfbbd665c Dump replicaset: openstack-operator-controller-manager-589f7cdddc Dump replicaset: openstack-operator-controller-operator-6489b698cc Dump replicaset: ovn-operator-controller-manager-6d8b6f9b9 Dump replicaset: placement-operator-controller-manager-54689d9f88 Dump replicaset: rabbitmq-cluster-operator-manager-5f97d8c699 Dump replicaset: swift-operator-controller-manager-6859f9b676 Dump replicaset: telemetry-operator-controller-manager-bf98bb7b6 Dump replicaset: test-operator-controller-manager-5cd5cb47d7 Dump replicaset: watcher-operator-controller-manager-6cbc6dd547 Dump deployments: barbican-operator-controller-manager Dump deployments: cinder-operator-controller-manager Dump deployments: designate-operator-controller-manager Dump deployments: glance-operator-controller-manager Dump deployments: heat-operator-controller-manager Dump deployments: horizon-operator-controller-manager Dump deployments: infra-operator-controller-manager Dump deployments: ironic-operator-controller-manager Dump deployments: keystone-operator-controller-manager Dump deployments: manila-operator-controller-manager Dump deployments: mariadb-operator-controller-manager Dump deployments: neutron-operator-controller-manager Dump deployments: nova-operator-controller-manager Dump deployments: octavia-operator-controller-manager Dump deployments: openstack-baremetal-operator-controller-manager Dump deployments: openstack-operator-controller-manager Dump deployments: openstack-operator-controller-operator Dump deployments: ovn-operator-controller-manager Dump deployments: placement-operator-controller-manager Dump deployments: rabbitmq-cluster-operator-manager Dump deployments: swift-operator-controller-manager Dump deployments: telemetry-operator-controller-manager Dump deployments: test-operator-controller-manager Dump deployments: watcher-operator-controller-manager Dump jobs: 673cb1016b9a8da3abb39c6f91d73e044ad6743308c34072552731c29685301 Dump cert: infra-operator-serving-cert Dump cert: openstack-baremetal-operator-serving-cert Dump cert: openstack-operator-serving-cert Dump issuer: infra-operator-selfsigned-issuer Dump issuer: openstack-baremetal-operator-selfsigned-issuer Dump issuer: openstack-operator-selfsigned-issuer Dump certificaterequests: infra-operator-serving-cert-1 Dump certificaterequests: openstack-baremetal-operator-serving-cert-1 Dump certificaterequests: openstack-operator-serving-cert-1 Gathering secrets in namespace baremetal-operator-system Gathering secrets in namespace openshift-machine-api Gathering csv Gathering subscription Gathering installplan No resources found in openshift-machine-api namespace. Dump logs for control-plane-machine-set-operator from control-plane-machine-set-operator-78cbb6b69f-wcjjj pod Dump logs for kube-rbac-proxy from machine-api-operator-5694c8668f-hbprv pod Dump logs for machine-api-operator from machine-api-operator-5694c8668f-hbprv pod Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump services: cluster-autoscaler-operator Dump services: control-plane-machine-set-operator Dump services: machine-api-controllers Dump services: machine-api-operator Dump services: machine-api-operator-machine-webhook Dump services: machine-api-operator-webhook Dump replicaset: control-plane-machine-set-operator-78cbb6b69f Dump replicaset: machine-api-operator-5694c8668f Dump deployments: control-plane-machine-set-operator Dump deployments: machine-api-operator Gathering secrets in namespace cert-manager Gathering csv Gathering subscription Gathering installplan No resources found in cert-manager namespace. Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for cert-manager-controller from cert-manager-5b446d88c5-lv822 pod Dump logs for cert-manager-cainjector from cert-manager-cainjector-7f985d654d-x2cvv pod Dump logs for cert-manager-webhook from cert-manager-webhook-5655c58dd6-nxpb9 pod Dump services: cert-manager Dump services: cert-manager-webhook Dump replicaset: cert-manager-5b446d88c5 Dump replicaset: cert-manager-cainjector-7f985d654d Dump replicaset: cert-manager-webhook-5655c58dd6 Dump deployments: cert-manager Dump deployments: cert-manager-cainjector Dump deployments: cert-manager-webhook Gathering secrets in namespace openshift-nmstate Gathering csv Gathering subscription Gathering installplan No resources found in openshift-nmstate namespace. Dump logs for nmstate-console-plugin from nmstate-console-plugin-6b874cbd85-9r6fx pod Dump logs for nmstate-handler from nmstate-handler-7q2md pod Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for kube-rbac-proxy from nmstate-metrics-fdff9cb8d-svznx pod Dump logs for nmstate-metrics from nmstate-metrics-fdff9cb8d-svznx pod Dump logs for nmstate-operator from nmstate-operator-858ddd8f98-h9nxf pod Dump logs for nmstate-webhook from nmstate-webhook-6cdbc54649-k4h2w pod Dump services: nmstate-console-plugin Dump services: nmstate-monitor Dump services: nmstate-webhook Dump daemonset: nmstate-handler Dump replicaset: nmstate-console-plugin-6b874cbd85 Dump replicaset: nmstate-metrics-fdff9cb8d Dump replicaset: nmstate-operator-858ddd8f98 Dump replicaset: nmstate-webhook-6cdbc54649 Dump deployments: nmstate-console-plugin Dump deployments: nmstate-metrics Dump deployments: nmstate-operator Dump deployments: nmstate-webhook Gathering secrets in namespace openshift-operators-redhat Gathering secrets in namespace openshift-logging Gathering secrets in namespace metallb-system Gathering csv Gathering subscription Gathering installplan No resources found in metallb-system namespace. Dump logs for controller from controller-68d546b9d8-47w4l pod Dump logs for kube-rbac-proxy from controller-68d546b9d8-47w4l pod Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for frr-k8s-webhook-server from frr-k8s-webhook-server-64bf5d555-59fcf pod Dump logs for cp-frr-files from frr-k8s-zz4cl pod Dump init container logs from frr-k8s-zz4cl pod Dump logs for cp-reloader from frr-k8s-zz4cl pod Dump init container logs from frr-k8s-zz4cl pod Dump logs for cp-metrics from frr-k8s-zz4cl pod Dump init container logs from frr-k8s-zz4cl pod Dump logs for controller from frr-k8s-zz4cl pod Dump logs for frr from frr-k8s-zz4cl pod Dump logs for frr-metrics from frr-k8s-zz4cl pod Dump logs for kube-rbac-proxy from frr-k8s-zz4cl pod Dump logs for kube-rbac-proxy-frr from frr-k8s-zz4cl pod Dump logs for reloader from frr-k8s-zz4cl pod Dump logs for manager from metallb-operator-controller-manager-779847879b-zbmnp pod Dump logs for webhook-server from metallb-operator-webhook-server-654f9bf6d-jll85 pod Dump logs for kube-rbac-proxy from speaker-pv9ct pod Dump logs for speaker from speaker-pv9ct pod Dump services: controller-monitor-service Dump services: frr-k8s-monitor-service Dump services: frr-k8s-webhook-service Dump services: metallb-operator-controller-manager-service Dump services: metallb-operator-webhook-server-service Dump services: metallb-operator-webhook-service Dump services: speaker-monitor-service Dump services: webhook-service Dump daemonset: frr-k8s Dump daemonset: speaker Dump replicaset: controller-68d546b9d8 Dump replicaset: frr-k8s-webhook-server-64bf5d555 Dump replicaset: metallb-operator-controller-manager-779847879b Dump replicaset: metallb-operator-webhook-server-654f9bf6d Dump deployments: controller Dump deployments: frr-k8s-webhook-server Dump deployments: metallb-operator-controller-manager Dump deployments: metallb-operator-webhook-server Gathering secrets in namespace openshift-marketplace Gathering csv Gathering subscription Gathering installplan No resources found in openshift-marketplace namespace. Dump logs for util from 8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2pc9tk pod Dump init container logs from 8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2pc9tk pod Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for pull from 8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2pc9tk pod Dump init container logs from 8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2pc9tk pod Dump logs for extract from 8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2pc9tk pod Dump logs for util from a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dnns6m pod Dump init container logs from a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dnns6m pod Dump logs for pull from a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dnns6m pod Dump init container logs from a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dnns6m pod Dump logs for extract from a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dnns6m pod Dump logs for extract-utilities from certified-operators-ngg7w pod Dump init container logs from certified-operators-ngg7w pod Dump logs for extract-content from certified-operators-ngg7w pod Dump init container logs from certified-operators-ngg7w pod Dump logs for registry-server from certified-operators-ngg7w pod Dump logs for extract-utilities from community-operators-k5jbs pod Dump init container logs from community-operators-k5jbs pod Dump logs for extract-content from community-operators-k5jbs pod Dump init container logs from community-operators-k5jbs pod Dump logs for registry-server from community-operators-k5jbs pod Dump logs for util from fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835clvsb7 pod Dump init container logs from fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835clvsb7 pod Dump logs for pull from fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835clvsb7 pod Dump init container logs from fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835clvsb7 pod Dump logs for extract from fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835clvsb7 pod Dump logs for marketplace-operator from marketplace-operator-79b997595-4vqf8 pod Dump logs for extract-utilities from redhat-marketplace-fvvh8 pod Dump init container logs from redhat-marketplace-fvvh8 pod Dump logs for extract-content from redhat-marketplace-fvvh8 pod Dump init container logs from redhat-marketplace-fvvh8 pod Dump logs for registry-server from redhat-marketplace-fvvh8 pod Dump logs for extract-utilities from redhat-operators-pw4v8 pod Dump init container logs from redhat-operators-pw4v8 pod Dump logs for extract-content from redhat-operators-pw4v8 pod Dump init container logs from redhat-operators-pw4v8 pod Dump logs for registry-server from redhat-operators-pw4v8 pod Dump services: certified-operators Dump services: community-operators Dump services: marketplace-operator-metrics Dump services: redhat-marketplace Dump services: redhat-operators Dump replicaset: marketplace-operator-79b997595 Dump deployments: marketplace-operator Dump jobs: 8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2f2057 Dump jobs: a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2d8e94a Dump jobs: fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbc47b Gathering secrets in namespace openshift-operators Gathering csv Gathering subscription Gathering installplan No resources found in openshift-operators namespace. Dump logs for prometheus-operator from obo-prometheus-operator-7c8cf85677-8xvhj pod Dump logs for prometheus-operator-admission-webhook from obo-prometheus-operator-admission-webhook-76fc5d7d48-7mcmz pod Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Dump logs for prometheus-operator-admission-webhook from obo-prometheus-operator-admission-webhook-76fc5d7d48-82r7d pod Dump logs for operator from observability-operator-cc5f78dfc-w5vqc pod Dump logs for perses-operator from perses-operator-54bc95c9fb-fnrbp pod Dump services: obo-prometheus-operator Dump services: obo-prometheus-operator-admission-webhook Dump services: obo-prometheus-operator-admission-webhook-service Dump services: observability-operator Dump replicaset: obo-prometheus-operator-7c8cf85677 Dump replicaset: obo-prometheus-operator-admission-webhook-76fc5d7d48 Dump replicaset: observability-operator-cc5f78dfc Dump replicaset: perses-operator-54bc95c9fb Dump deployments: obo-prometheus-operator Dump deployments: obo-prometheus-operator-admission-webhook Dump deployments: observability-operator Dump deployments: perses-operator Gather ctlplane service info: openstack Gather ctlplane service info: ovn Gather ctlplane service info: rabbitmq Copying OVN NB database from ovsdbserver-nb-0 Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Copying OVN SB database from ovsdbserver-sb-0 Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "ovsdbserver-nb" out of: ovsdbserver-nb, openstack-network-exporter Defaulted container "ovsdbserver-sb" out of: ovsdbserver-sb, openstack-network-exporter tar: Removing leading `/' from member names Gather ctlplane service info: keystone Gather ctlplane service info: glance Gather ctlplane service info: cinder Gather ctlplane service info: nova Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Gather ctlplane service info: heat Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) ERROR: You are not authorized to use service:index. command terminated with exit code 1 Gather ctlplane service info: placement Gather ctlplane service info: neutron Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Extensions list not supported by Identity API Gather ctlplane service info: swift Gather ctlplane service info: barbican Gather ctlplane service info: ceilometer Gather ctlplane service info: aodh --- Logging error --- Traceback (most recent call last): File "/usr/lib/python3.9/site-packages/cliff/app.py", line 410, in run_subcommand result = cmd.run(parsed_args) File "/usr/lib/python3.9/site-packages/osc_lib/command/command.py", line 39, in run return super(Command, self).run(parsed_args) File "/usr/lib/python3.9/site-packages/cliff/display.py", line 117, in run column_names, data = self.take_action(parsed_args) File "/usr/lib/python3.9/site-packages/observabilityclient/v1/cli.py", line 27, in take_action metrics = client.query.list(disable_rbac=parsed_args.disable_rbac) File "/usr/lib/python3.9/site-packages/observabilityclient/v1/python_api.py", line 27, in list metric_names = self.prom.label_values("__name__") File "/usr/lib/python3.9/site-packages/observabilityclient/prometheus_client.py", line 143, in label_values decoded = self._get(f"label/{label}/values") File "/usr/lib/python3.9/site-packages/observabilityclient/prometheus_client.py", line 79, in _get raise PrometheusAPIClientError(resp) observabilityclient.prometheus_client.PrometheusAPIClientError: During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib64/python3.9/logging/__init__.py", line 1083, in emit msg = self.format(record) File "/usr/lib64/python3.9/logging/__init__.py", line 927, in format return fmt.format(record) File "/usr/lib64/python3.9/logging/__init__.py", line 663, in format record.message = record.getMessage() File "/usr/lib64/python3.9/logging/__init__.py", line 365, in getMessage msg = str(self.msg) File "/usr/lib/python3.9/site-packages/observabilityclient/prometheus_client.py", line 30, in __str__ decoded = self.resp.json() File "/usr/lib/python3.9/site-packages/requests/models.py", line 891, in json return complexjson.loads( File "/usr/lib64/python3.9/site-packages/simplejson/__init__.py", line 525, in loads return _default_decoder.decode(s) File "/usr/lib64/python3.9/site-packages/simplejson/decoder.py", line 370, in decode obj, end = self.raw_decode(s) File "/usr/lib64/python3.9/site-packages/simplejson/decoder.py", line 400, in raw_decode return self.scan_once(s, idx=_w(s, idx).end()) simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0) Call stack: File "/usr/bin/openstack", line 10, in sys.exit(main()) File "/usr/lib/python3.9/site-packages/openstackclient/shell.py", line 145, in main return OpenStackShell().run(argv) File "/usr/lib/python3.9/site-packages/osc_lib/shell.py", line 134, in run ret_val = super(OpenStackShell, self).run(argv) File "/usr/lib/python3.9/site-packages/cliff/app.py", line 278, in run result = self.run_subcommand(remainder) File "/usr/lib/python3.9/site-packages/osc_lib/shell.py", line 175, in run_subcommand ret_value = super(OpenStackShell, self).run_subcommand(argv) File "/usr/lib/python3.9/site-packages/cliff/app.py", line 422, in run_subcommand self.LOG.error(err) Unable to print the message and arguments - possible formatting error. Use the traceback above to help find the error. command terminated with exit code 1 tar: Removing leading `/' from member names The /must-gather/must-gather.tar.xz now can be attached to the support case.