Trigger GMR for Service cinder Trigger GMR for Nova services Will retrieve SOS reports from nodes crc Generating SOS Report for crc Journal size limit not set or invalid: ignoring Starting pod/crc-debug-9r66k ... To use host binaries, run `chroot /host` Generating SOS Report for EDPM compute-0 Warning: Permanently added '192.168.122.100' (ED25519) to the list of known hosts. OMC mode: Collecting OLM resources (subscriptions, CSVs, etc.) in OMC format +--------------------------------------+----------------+--------------------------------+----------+---------+-------+----------------------------+ | ID | Binary | Host | Zone | Status | State | Updated At | +--------------------------------------+----------------+--------------------------------+----------+---------+-------+----------------------------+ | b4ef3c81-2e72-4fcf-aacd-92097f10d197 | nova-conductor | nova-cell0-conductor-0 | internal | enabled | up | 2026-01-21T16:59:50.000000 | | 4c6a0d1e-39c7-44f1-a83c-b7230cdee719 | nova-scheduler | nova-scheduler-0 | internal | enabled | up | 2026-01-21T16:59:53.000000 | | 23bcb5c6-92c8-45d5-8626-63f77b4b1cdf | nova-conductor | nova-cell1-conductor-0 | internal | enabled | up | 2026-01-21T16:59:48.000000 | | cee78169-e49d-46e2-ab70-8c9a31c9f6b7 | nova-compute | compute-0.ctlplane.example.com | nova | enabled | up | 2026-01-21T16:59:55.000000 | +--------------------------------------+----------------+--------------------------------+----------+---------+-------+----------------------------+ sos report (version 4.10.1) This command will collect diagnostic and configuration information from this CentOS Linux system and installed applications. An archive containing the collected information will be generated in /var/tmp/sos-osp/sos.wd5u9z4r and may be provided to a CentOS support representative. Any information provided to CentOS will be treated in accordance with the published support policies at: Community Website : https://www.centos.org/ The generated archive may contain data considered sensitive and its content should be reviewed by the originating organization before being passed to any third party. No changes will be made to system configuration. Setting up archive ... Setting up plugins ... Gathering data for ns/openstack... Wrote inspect data to /must-gather. toolbox-osp Wrote inspect data to /must-gather. Gathering secrets in namespace openstack Trying to pull registry.redhat.io/rhel9/support-tools:latest... Getting image source signatures Wrote inspect data to /must-gather. Checking if image destination supports signatures Copying blob sha256:b98104ab0e1239a911fc1ca3c8589101c7fa3eb521b2c4b1fb1120038f55fbe9 Copying blob sha256:34b5c851d9cf523f162ceb72c260f1c6d1e556f8f4422e15258572766f2afc28 Copying config sha256:907c6f8a1bbc29560332663e8e9c85244e317088310a19891a847689ebec5226 Writing manifest to image destination Storing signatures 907c6f8a1bbc29560332663e8e9c85244e317088310a19891a847689ebec5226 .toolboxrc file detected, overriding defaults... Checking if there is a newer version of registry.redhat.io/rhel9/support-tools available... [plugin:networking] skipped command 'ip -s macsec show': required kmods missing: macsec. Use '--allow-system-changes' to enable collection. [plugin:openstack_neutron] Could not open conf file /etc/neutron/plugins/ml2/ml2_conf.ini: [Errno 2] No such file or directory: '/etc/neutron/plugins/ml2/ml2_conf.ini' Not all environment variables set. Source the environment file for the user intended to connect to the OpenStack environment. Wrote inspect data to /must-gather. [plugin:systemd] skipped command 'systemd-resolve --status': required services missing: systemd-resolved. [plugin:systemd] skipped command 'systemd-resolve --statistics': required services missing: systemd-resolved. Running plugins. Please wait ... Starting 3/77 ata [Running: ata] Starting 4/77 auditd [Running: auditd] Starting 1/77 anaconda [Running: auditd anaconda] Starting 2/77 anacron [Running: auditd anaconda anacron] Starting 5/77 block [Running: auditd anaconda anacron block] Starting 6/77 boot [Running: auditd anaconda block boot] Starting 7/77 buildah [Running: auditd block boot buildah] Starting 8/77 ceph_common [Running: block boot buildah ceph_common] Starting 9/77 cgroups [Running: block boot buildah cgroups] Starting 10/77 chrony [Running: block boot cgroups chrony] Starting 11/77 console [Running: boot cgroups chrony console] Starting 12/77 containers_common [Running: boot cgroups chrony containers_common] Starting 13/77 coredump [Running: boot cgroups chrony coredump] Starting 14/77 cron [Running: boot cgroups coredump cron] Starting 15/77 crypto [Running: boot cgroups cron crypto] Starting 16/77 dbus [Running: boot cgroups crypto dbus] Starting 17/77 devicemapper [Running: boot cgroups crypto devicemapper] Starting 18/77 devices [Running: boot cgroups devicemapper devices] Starting 19/77 dnf [Running: boot cgroups devices dnf] Starting 20/77 filesys [Running: boot cgroups dnf filesys] Spawning a container 'toolbox-osp' with image 'registry.redhat.io/rhel9/support-tools' Detected RUN label in the container image. Using that as the default... acc2b2ac80b7401951116b3d4829391206cf3fc47b69e4da4ea898cbcc88de64 Starting 21/77 firewall_tables [Running: boot cgroups dnf firewall_tables] Starting 22/77 hardware [Running: boot cgroups dnf hardware] toolbox-osp sos report --batch --all-logs --only-plugins block,cifs,crio,devicemapper,devices,firewall_tables,firewalld,iscsi,lvm2,memory,multipath,nfs,nis,nvme,podman,process,processor,selinux,scsi,udev,logs,crypto --tmp-dir=/var/tmp/sos-osp; exit Starting 23/77 host [Running: boot cgroups dnf host] Starting 24/77 i18n [Running: boot cgroups dnf i18n] Starting 25/77 iscsi [Running: boot cgroups dnf iscsi] Starting 26/77 kdump [Running: boot dnf iscsi kdump] Starting 27/77 kernel [Running: boot dnf kdump kernel] Starting 28/77 keyutils [Running: boot dnf kernel keyutils] Starting 29/77 krb5 [Running: boot dnf kernel krb5] Starting 30/77 kvm [Running: boot dnf kernel kvm] Starting 31/77 ldap [Running: boot dnf kvm ldap] Starting 32/77 libraries [Running: boot dnf kvm libraries] Starting 33/77 libvirt [Running: boot dnf kvm libvirt] Starting 34/77 login [Running: boot dnf kvm login] Starting 35/77 logrotate [Running: boot dnf kvm logrotate] Starting 36/77 logs [Running: boot dnf kvm logs] Starting 37/77 lvm2 [Running: dnf kvm logs lvm2] Starting 38/77 md [Running: dnf kvm logs md] Starting 39/77 memory [Running: dnf kvm logs memory] [?2004l temporary directory /var/tmp/sos-osp does not exist or is not writable exit Starting 40/77 multipath [Running: dnf kvm logs multipath] Starting 41/77 networking [Running: dnf kvm logs networking] tar: Removing leading `/' from member names tar: /var/log/pods/*/*.log.*: Warning: Cannot stat: No such file or directory Starting 42/77 networkmanager [Running: dnf logs networking networkmanager] Starting 43/77 nfs [Running: dnf networking networkmanager nfs] Starting 44/77 numa [Running: dnf networking networkmanager numa] Starting 45/77 nvme [Running: dnf networking networkmanager nvme] Starting 46/77 openhpi [Running: dnf networking networkmanager openhpi] Starting 47/77 openstack_edpm [Running: dnf networking networkmanager openstack_edpm] Starting 48/77 openstack_neutron [Running: dnf networking networkmanager openstack_neutron] Starting 49/77 openstack_nova [Running: dnf networking networkmanager openstack_nova] Starting 50/77 openvswitch [Running: dnf networking networkmanager openvswitch] Starting 51/77 ovn_host [Running: dnf networking openvswitch ovn_host] Starting 52/77 pam [Running: dnf networking openvswitch pam] Starting 53/77 pci [Running: dnf networking openvswitch pci] Starting 54/77 podman [Running: dnf networking openvswitch podman] Starting 55/77 process [Running: dnf networking podman process] Starting 56/77 processor [Running: dnf networking process processor] Starting 57/77 python [Running: dnf process processor python] Starting 58/77 release [Running: dnf process processor release] Starting 59/77 rpm [Running: dnf process processor rpm] Starting 60/77 sar [Running: process processor rpm sar] Starting 61/77 scsi [Running: process processor scsi] Starting 62/77 selinux [Running: process processor scsi selinux] Starting 63/77 services [Running: processor scsi selinux services] Starting 64/77 ssh [Running: processor scsi selinux ssh] Starting 65/77 sudo [Running: processor selinux ssh sudo] Starting 66/77 sunrpc [Running: processor selinux ssh sunrpc] Starting 67/77 system [Running: processor selinux sunrpc system] Starting 68/77 systemd [Running: processor selinux system systemd] Starting 69/77 sysvipc [Running: processor selinux systemd sysvipc] Starting 70/77 tpm2 [Running: processor selinux systemd tpm2] Starting 71/77 tuned [Running: processor selinux systemd tuned] Gathering data for ns/metallb-system... Starting 72/77 udev [Running: processor selinux systemd udev] Starting 73/77 unbound [Running: processor selinux systemd unbound] Starting 74/77 vhostmd [Running: processor selinux systemd vhostmd] Starting 75/77 virsh [Running: processor selinux systemd virsh] Starting 76/77 xen [Running: processor systemd virsh xen] Finishing plugins [Running: processor systemd virsh] Starting 77/77 xfs [Running: processor systemd virsh xfs] Finishing plugins [Running: processor systemd virsh] Finishing plugins [Running: processor systemd] Finishing plugins [Running: processor] Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Wrote inspect data to /must-gather. Finished running plugins Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Gathering data for ns/openstack-operators... W0121 17:00:28.710871 4479 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' Wrote inspect data to /must-gather. Gathering secrets in namespace openstack-operators W0121 17:00:29.010139 4513 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' Wrote inspect data to /must-gather. W0121 17:00:29.163213 4548 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ tar: Removing leading `/' from hard link targets Wrote inspect data to /must-gather. Removing debug pod ... Gathering data for ns/openshift-machine-api... Retrieving SOS Report for crc Gathering secrets in namespace openshift-machine-api Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Starting pod/crc-debug-kxxbh ... To use host binaries, run `chroot /host` Removing debug pod ... Creating compressed archive... Your sos report has been generated and saved in: /var/tmp/sos-osp/sosreport-compute-0-2026-01-21-abhfbcf.tar.xz Size 16.99MiB Owner root sha256 781b5187ec4efca826b8a1d551b399e6dd07676cedf54b7503181bca806d002c Please send this file to your support representative. Retrieving SOS Report for compute-0 Finished retrieving SOS Report for compute-0 Gathering data for ns/cert-manager... Gathering secrets in namespace cert-manager Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Gathering data for ns/openshift-nmstate... Gathering secrets in namespace openshift-nmstate Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ W0121 17:00:50.108599 6956 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Gathering data for ns/openshift-operators... Gathering secrets in namespace openshift-operators Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Gathering data for ns/metallb-system... Gathering secrets in namespace metallb-system Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Wrote inspect data to /must-gather. Gathering data for ns/openshift-marketplace... Gathering secrets in namespace openshift-marketplace Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Wrote inspect data to /must-gather. Gathering data for ns/openshift-operators... Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Gathering secrets in namespace openshift-operators Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Gathering data for ns/metallb-system... Gathering data for ns/cert-manager... Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Gathering data for ns/openstack-operators... Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Wrote inspect data to /must-gather. Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ Wrote inspect data to /must-gather. Gathering data for ns/cert-manager... Wrote inspect data to /must-gather. Gathering data for ns/openshift-machine-api... Gathering data for ns/openstack-operators... Gathering data for ns/openshift-nmstate... Wrote inspect data to /must-gather. Gathering data for ns/openshift-monitoring... Gathering data for ns/openshift-multus... Wrote inspect data to /must-gather. Gather ctlplane service info: openstack Gather ctlplane service info: ovn Gather ctlplane service info: rabbitmq Copying OVN NB database from ovsdbserver-nb-0 Defaulted container "ovsdbserver-nb" out of: ovsdbserver-nb, openstack-network-exporter tar: Removing leading `/' from member names Copying OVN SB database from ovsdbserver-sb-0 Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "ovsdbserver-sb" out of: ovsdbserver-sb, openstack-network-exporter Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) tar: Removing leading `/' from member names Gather ctlplane service info: keystone Gather ctlplane service info: glance Gather ctlplane service info: cinder Gather ctlplane service info: nova Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Gather ctlplane service info: placement Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Gather ctlplane service info: neutron Defaulted container "rabbitmq" out of: rabbitmq, setup-container (init) Gather ctlplane service info: swift Gather ctlplane service info: barbican Gather ctlplane service info: ceilometer Extensions list not supported by Identity API tar: Removing leading `/' from member names The /must-gather/must-gather.tar.xz now can be attached to the support case.