2026-03-14 07:51:14,138 7ff7e762e740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'check-host', '--expect-hostname', 'np0005647026.localdomain']
2026-03-14 07:51:14,215 7ff7e762e740 INFO podman (/bin/podman) version 4.4.1 is present
2026-03-14 07:51:14,216 7ff7e762e740 INFO systemctl is present
2026-03-14 07:51:14,216 7ff7e762e740 INFO lvcreate is present
2026-03-14 07:51:14,275 7ff7e762e740 INFO Unit chronyd.service is enabled and running
2026-03-14 07:51:14,275 7ff7e762e740 INFO Hostname "np0005647026.localdomain" matches what is expected.
2026-03-14 07:51:14,275 7ff7e762e740 INFO Host looks OK
2026-03-14 07:51:30,982 7f5ca6844740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'check-host']
2026-03-14 07:51:31,046 7f5ca6844740 INFO podman (/bin/podman) version 4.4.1 is present
2026-03-14 07:51:31,046 7f5ca6844740 INFO systemctl is present
2026-03-14 07:51:31,046 7f5ca6844740 INFO lvcreate is present
2026-03-14 07:51:31,098 7f5ca6844740 INFO Unit chronyd.service is enabled and running
2026-03-14 07:51:31,098 7f5ca6844740 INFO Host looks OK
2026-03-14 07:51:31,529 7f2375d97740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls']
2026-03-14 07:51:32,154 7fe0c741e740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 07:51:33,070 7fe04e3f7740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'list-networks']
2026-03-14 07:51:33,591 7fa687c5c740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283', '--', 'inventory', '--format=json-pretty', '--filter-for-batch']
2026-03-14 07:51:33,781 7fa687c5c740 DEBUG Using specified fsid: 829ce43b-dec9-5380-a4c0-eff58e9f1283
2026-03-14 07:51:56,982 7f1bc79a7740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', '_orch', 'set-coredump-overrides', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283', '--coredump-max-size=32G']
2026-03-14 07:51:57,051 7f1bc79a7740 INFO Set coredump max sizes in /etc/systemd/coredump.conf.d/90-cephadm-829ce43b-dec9-5380-a4c0-eff58e9f1283-coredumps-overrides.conf to 32G. Restarting systemd-coredump.socket
2026-03-14 07:51:57,068 7f1bc79a7740 INFO systemd-coredump.socket restarted successfully
2026-03-14 07:52:30,056 7fcf5e564740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', '_orch', 'deploy', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283']
2026-03-14 07:52:30,127 7fcf5e564740 DEBUG Loaded deploy configuration: {'fsid': '829ce43b-dec9-5380-a4c0-eff58e9f1283', 'name': 'crash.np0005647026', 'image': '', 'deploy_arguments': [], 'params': {'limit_core_infinity': True}, 'meta': {'service_name': 'crash', 'ports': [], 'ip': None, 'deployed_by': ['registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:50945286dae5941044aa91c7700ff058ab2cb308d5d1d6d6bb2daf28aa7a0ca3', 'registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:485411749726179fe5cd880e2cf308261b35150e4b356ddb7100f52e02b2e353'], 'rank': None, 'rank_generation': None, 'extra_container_args': None, 'extra_entrypoint_args': None}, 'config_blobs': {'config': '# minimal ceph.conf for 829ce43b-dec9-5380-a4c0-eff58e9f1283\n[global]\n\tfsid = 829ce43b-dec9-5380-a4c0-eff58e9f1283\n\tmon_host = [v2:172.18.0.103:3300/0,v1:172.18.0.103:6789/0] [v2:172.18.0.104:3300/0,v1:172.18.0.104:6789/0] [v2:172.18.0.105:3300/0,v1:172.18.0.105:6789/0]\n', 'keyring': '[client.crash.np0005647026]\nkey = AQC9E7VphhFWJxAAuNbSB511mQIpEaXBjd5YZA==\n'}}
2026-03-14 07:52:30,127 7fcf5e564740 DEBUG Determined image: 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest'
2026-03-14 07:52:30,224 7fcf5e564740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-crash-np0005647026
2026-03-14 07:52:30,224 7fcf5e564740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-crash-np0005647026
2026-03-14 07:52:30,275 7fcf5e564740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-crash.np0005647026
2026-03-14 07:52:30,275 7fcf5e564740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-crash.np0005647026
2026-03-14 07:52:30,275 7fcf5e564740 INFO Deploy daemon crash.np0005647026 ...
2026-03-14 07:52:31,091 7fcf5e564740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target.
2026-03-14 07:52:31,313 7fcf5e564740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283.target → /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283.target.
2026-03-14 07:52:31,313 7fcf5e564740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283.target → /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283.target.
2026-03-14 07:52:31,577 7fcf5e564740 DEBUG Non-zero exit code 1 from systemctl reset-failed ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@crash.np0005647026
2026-03-14 07:52:31,578 7fcf5e564740 DEBUG systemctl: stderr Failed to reset failed state of unit ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@crash.np0005647026.service: Unit ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@crash.np0005647026.service not loaded.
2026-03-14 07:52:31,781 7fcf5e564740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283.target.wants/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@crash.np0005647026.service → /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@.service.
2026-03-14 07:52:32,267 7fcf5e564740 DEBUG firewalld does not appear to be present
2026-03-14 07:52:32,267 7fcf5e564740 DEBUG Not possible to enable service <crash>. firewalld.service is not available
2026-03-14 07:52:32,777 7f033ea0e740 DEBUG --------------------------------------------------------------------------------
cephadm ['--env', 'CEPH_VOLUME_OSDSPEC_AFFINITY=default_drive_group', '--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283', '--config-json', '-', '--', 'lvm', 'batch', '--no-auto', '/dev/ceph_vg0/ceph_lv0', '/dev/ceph_vg1/ceph_lv1', '--yes', '--no-systemd']
2026-03-14 07:52:32,936 7f033ea0e740 DEBUG Using specified fsid: 829ce43b-dec9-5380-a4c0-eff58e9f1283
2026-03-14 07:52:42,010 7f29b8411740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283', '--', 'lvm', 'list', '--format', 'json']
2026-03-14 07:52:42,207 7f29b8411740 DEBUG Using specified fsid: 829ce43b-dec9-5380-a4c0-eff58e9f1283
2026-03-14 07:52:43,642 7f925d834740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', '_orch', 'deploy', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283']
2026-03-14 07:52:43,717 7f925d834740 DEBUG Loaded deploy configuration: {'fsid': '829ce43b-dec9-5380-a4c0-eff58e9f1283', 'name': 'osd.0', 'image': '', 'deploy_arguments': [], 'params': {'osd_fsid': '65ba6d4f-871c-42e4-894e-6611cce2216a', 'limit_core_infinity': True}, 'meta': {'service_name': 'osd.default_drive_group', 'ports': [], 'ip': None, 'deployed_by': ['registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:50945286dae5941044aa91c7700ff058ab2cb308d5d1d6d6bb2daf28aa7a0ca3', 'registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:485411749726179fe5cd880e2cf308261b35150e4b356ddb7100f52e02b2e353'], 'rank': None, 'rank_generation': None, 'extra_container_args': None, 'extra_entrypoint_args': None}, 'config_blobs': {'config': '# minimal ceph.conf for 829ce43b-dec9-5380-a4c0-eff58e9f1283\n[global]\n\tfsid = 829ce43b-dec9-5380-a4c0-eff58e9f1283\n\tmon_host = [v2:172.18.0.103:3300/0,v1:172.18.0.103:6789/0] [v2:172.18.0.104:3300/0,v1:172.18.0.104:6789/0] [v2:172.18.0.105:3300/0,v1:172.18.0.105:6789/0]\n', 'keyring': '[osd.0]\n\tkey = AQDCE7VpoyCJAxAAEIpfgGxrd1GC08d364ecKg==\n\tcaps mgr = "allow profile osd"\n\tcaps mon = "allow profile osd"\n\tcaps osd = "allow *"\n'}}
2026-03-14 07:52:43,717 7f925d834740 DEBUG Determined image: 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest'
2026-03-14 07:52:43,823 7f925d834740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd-0
2026-03-14 07:52:43,824 7f925d834740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd-0
2026-03-14 07:52:43,886 7f925d834740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd.0
2026-03-14 07:52:43,886 7f925d834740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd.0
2026-03-14 07:52:43,886 7f925d834740 INFO Deploy daemon osd.0 ...
2026-03-14 07:52:45,145 7f925d834740 DEBUG sysctl: stdout 65536
2026-03-14 07:52:45,151 7f925d834740 DEBUG sysctl: stdout 4194304
2026-03-14 07:52:45,159 7f925d834740 DEBUG sysctl: stdout * Applying /usr/lib/sysctl.d/10-default-yama-scope.conf ...
2026-03-14 07:52:45,159 7f925d834740 DEBUG sysctl: stdout * Applying /usr/lib/sysctl.d/50-coredump.conf ...
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout * Applying /usr/lib/sysctl.d/50-default.conf ...
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout * Applying /usr/lib/sysctl.d/50-libkcapi-optmem_max.conf ...
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout * Applying /usr/lib/sysctl.d/50-pid-max.conf ...
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout * Applying /usr/lib/sysctl.d/50-redhat.conf ...
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout * Applying /etc/sysctl.d/90-ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd.conf ...
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout * Applying /etc/sysctl.d/99-sysctl.conf ...
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout * Applying /etc/sysctl.conf ...
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout kernel.yama.ptrace_scope = 0
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout kernel.core_pattern = |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout kernel.core_pipe_limit = 16
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout fs.suid_dumpable = 2
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout kernel.sysrq = 16
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout kernel.core_uses_pid = 1
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.default.rp_filter = 2
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.br-ex.rp_filter = 2
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.eth0.rp_filter = 2
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.eth1.rp_filter = 2
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.lo.rp_filter = 2
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.ovs-system.rp_filter = 2
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan20.rp_filter = 2
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan21.rp_filter = 2
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan22.rp_filter = 2
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan23.rp_filter = 2
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan44.rp_filter = 2
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.default.accept_source_route = 0
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.br-ex.accept_source_route = 0
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.eth0.accept_source_route = 0
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.eth1.accept_source_route = 0
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.lo.accept_source_route = 0
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.ovs-system.accept_source_route = 0
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan20.accept_source_route = 0
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan21.accept_source_route = 0
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan22.accept_source_route = 0
2026-03-14 07:52:45,160 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan23.accept_source_route = 0
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan44.accept_source_route = 0
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.default.promote_secondaries = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.br-ex.promote_secondaries = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.eth0.promote_secondaries = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.eth1.promote_secondaries = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.lo.promote_secondaries = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.ovs-system.promote_secondaries = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan20.promote_secondaries = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan21.promote_secondaries = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan22.promote_secondaries = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan23.promote_secondaries = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan44.promote_secondaries = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.ping_group_range = 0 2147483647
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.core.default_qdisc = fq_codel
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout fs.protected_hardlinks = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout fs.protected_symlinks = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout fs.protected_regular = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout fs.protected_fifos = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.core.optmem_max = 81920
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout kernel.pid_max = 4194304
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout kernel.kptr_restrict = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.default.rp_filter = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.br-ex.rp_filter = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.eth0.rp_filter = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.eth1.rp_filter = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.lo.rp_filter = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.ovs-system.rp_filter = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan20.rp_filter = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan21.rp_filter = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan22.rp_filter = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan23.rp_filter = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout net.ipv4.conf.vlan44.rp_filter = 1
2026-03-14 07:52:45,161 7f925d834740 DEBUG sysctl: stdout fs.aio-max-nr = 1048576
2026-03-14 07:52:45,453 7f925d834740 DEBUG Non-zero exit code 1 from systemctl reset-failed ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.0
2026-03-14 07:52:45,454 7f925d834740 DEBUG systemctl: stderr Failed to reset failed state of unit ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.0.service: Unit ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.0.service not loaded.
2026-03-14 07:52:45,704 7f925d834740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283.target.wants/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.0.service → /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@.service.
2026-03-14 07:52:47,500 7f925d834740 DEBUG firewalld does not appear to be present
2026-03-14 07:52:47,501 7f925d834740 DEBUG Not possible to enable service <osd>. firewalld.service is not available
2026-03-14 07:52:47,988 7f9045ba2740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', '_orch', 'deploy', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283']
2026-03-14 07:52:48,054 7f9045ba2740 DEBUG Loaded deploy configuration: {'fsid': '829ce43b-dec9-5380-a4c0-eff58e9f1283', 'name': 'osd.3', 'image': '', 'deploy_arguments': [], 'params': {'osd_fsid': '074a64d9-1c7a-47ea-ae7a-1ad0d82a42ef', 'limit_core_infinity': True}, 'meta': {'service_name': 'osd.default_drive_group', 'ports': [], 'ip': None, 'deployed_by': ['registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:50945286dae5941044aa91c7700ff058ab2cb308d5d1d6d6bb2daf28aa7a0ca3', 'registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:485411749726179fe5cd880e2cf308261b35150e4b356ddb7100f52e02b2e353'], 'rank': None, 'rank_generation': None, 'extra_container_args': None, 'extra_entrypoint_args': None}, 'config_blobs': {'config': '# minimal ceph.conf for 829ce43b-dec9-5380-a4c0-eff58e9f1283\n[global]\n\tfsid = 829ce43b-dec9-5380-a4c0-eff58e9f1283\n\tmon_host = [v2:172.18.0.103:3300/0,v1:172.18.0.103:6789/0] [v2:172.18.0.104:3300/0,v1:172.18.0.104:6789/0] [v2:172.18.0.105:3300/0,v1:172.18.0.105:6789/0]\n', 'keyring': '[osd.3]\n\tkey = AQDFE7VpxpkaMBAAoJde+73ADmkQ2UYjKkSefg==\n\tcaps mgr = "allow profile osd"\n\tcaps mon = "allow profile osd"\n\tcaps osd = "allow *"\n'}}
2026-03-14 07:52:48,055 7f9045ba2740 DEBUG Determined image: 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest'
2026-03-14 07:52:48,178 7f9045ba2740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd-3
2026-03-14 07:52:48,179 7f9045ba2740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd-3
2026-03-14 07:52:48,242 7f9045ba2740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd.3
2026-03-14 07:52:48,242 7f9045ba2740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd.3
2026-03-14 07:52:48,242 7f9045ba2740 INFO Deploy daemon osd.3 ...
2026-03-14 07:52:49,568 7f9045ba2740 DEBUG sysctl: stdout 1048576
2026-03-14 07:52:49,573 7f9045ba2740 DEBUG sysctl: stdout 4194304
2026-03-14 07:52:49,906 7f9045ba2740 DEBUG Non-zero exit code 1 from systemctl reset-failed ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.3
2026-03-14 07:52:49,907 7f9045ba2740 DEBUG systemctl: stderr Failed to reset failed state of unit ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.3.service: Unit ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.3.service not loaded.
2026-03-14 07:52:50,146 7f9045ba2740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283.target.wants/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.3.service → /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@.service.
2026-03-14 07:52:51,890 7f9045ba2740 DEBUG firewalld does not appear to be present
2026-03-14 07:52:51,890 7f9045ba2740 DEBUG Not possible to enable service <osd>. firewalld.service is not available
2026-03-14 07:52:52,382 7fb051f7b740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283', '--', 'raw', 'list', '--format', 'json']
2026-03-14 07:52:52,608 7fb051f7b740 DEBUG Using specified fsid: 829ce43b-dec9-5380-a4c0-eff58e9f1283
2026-03-14 07:52:55,690 7f9ec2252740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls']
2026-03-14 07:52:57,059 7f8c68dca740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 07:52:57,933 7f4863da0740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283', '--', 'inventory', '--format=json-pretty', '--filter-for-batch']
2026-03-14 07:52:58,151 7f4863da0740 DEBUG Using specified fsid: 829ce43b-dec9-5380-a4c0-eff58e9f1283
2026-03-14 07:53:08,149 7f9fe7456740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls']
2026-03-14 07:54:10,183 7ff4b0c11740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls']
2026-03-14 07:54:11,512 7f64145ed740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 07:55:12,795 7f968b00f740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 07:56:14,368 7fc0c09dd740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 07:57:16,309 7fecb13e2740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 07:58:18,167 7fab1960c740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 07:59:20,193 7ff9875fd740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:00:21,698 7f45b1987740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:01:23,259 7fa3323a7740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:02:26,385 7f935fd92740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'check-host']
2026-03-14 08:02:26,448 7f935fd92740 INFO podman (/bin/podman) version 4.4.1 is present
2026-03-14 08:02:26,449 7f935fd92740 INFO systemctl is present
2026-03-14 08:02:26,449 7f935fd92740 INFO lvcreate is present
2026-03-14 08:02:26,514 7f935fd92740 INFO Unit chronyd.service is enabled and running
2026-03-14 08:02:26,514 7f935fd92740 INFO Host looks OK
2026-03-14 08:02:27,638 7f57a5e0f740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:03:29,078 7fba0b430740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:04:31,489 7f68fc3c2740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls']
2026-03-14 08:04:32,851 7f6b67382740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:05:35,776 7f552cdae740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:06:37,716 7fe8943de740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:07:39,202 7fd7db207740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:08:40,739 7fb2de38f740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:09:42,107 7fe303bae740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:10:43,604 7fdf4858b740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:12:18,041 7f7430d8f740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:13:20,227 7f3da8f8a740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'check-host']
2026-03-14 08:13:20,304 7f3da8f8a740 INFO podman (/bin/podman) version 4.4.1 is present
2026-03-14 08:13:20,305 7f3da8f8a740 INFO systemctl is present
2026-03-14 08:13:20,305 7f3da8f8a740 INFO lvcreate is present
2026-03-14 08:13:20,376 7f3da8f8a740 INFO Unit chronyd.service is enabled and running
2026-03-14 08:13:20,377 7f3da8f8a740 INFO Host looks OK
2026-03-14 08:13:21,004 7f9dcb63d740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:14:22,668 7fe8b5c29740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:15:24,261 7f51e8ffd740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls']
2026-03-14 08:15:25,718 7f03f4d77740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:16:27,061 7f48361b0740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:17:28,589 7f1324d7a740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:18:30,119 7f57f79f6740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:19:31,593 7f796e5e7740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:20:33,136 7f90a63f0740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:21:34,654 7f217cfc4740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:21:35,528 7fa0313d5740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'list-networks']
2026-03-14 08:22:41,115 7f25273ee740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:23:44,978 7f9e9bb22740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'check-host']
2026-03-14 08:23:45,051 7f9e9bb22740 INFO podman (/bin/podman) version 4.4.1 is present
2026-03-14 08:23:45,052 7f9e9bb22740 INFO systemctl is present
2026-03-14 08:23:45,052 7f9e9bb22740 INFO lvcreate is present
2026-03-14 08:23:45,114 7f9e9bb22740 INFO Unit chronyd.service is enabled and running
2026-03-14 08:23:45,115 7f9e9bb22740 INFO Host looks OK
2026-03-14 08:23:45,736 7f0868d7e740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:23:46,659 7f17d87df740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283', '--', 'inventory', '--format=json-pretty', '--filter-for-batch']
2026-03-14 08:23:46,930 7f17d87df740 DEBUG Using specified fsid: 829ce43b-dec9-5380-a4c0-eff58e9f1283
2026-03-14 08:24:49,638 7fc1e2199740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:25:51,697 7f677321e740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls']
2026-03-14 08:25:53,040 7fe2fa1c8740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:26:54,580 7fa6009a2740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:27:56,175 7f98e601a740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:28:57,843 7f7b1619e740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:29:59,455 7fa5bb18a740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:31:01,121 7ff8a7dc2740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:32:02,756 7fec35722740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:33:05,763 7f102a7c3740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']