2026-03-14 07:51:08,924 7fb791c05740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'check-host', '--expect-hostname', 'np0005647025.localdomain']
2026-03-14 07:51:08,994 7fb791c05740 INFO podman (/bin/podman) version 4.4.1 is present
2026-03-14 07:51:08,994 7fb791c05740 INFO systemctl is present
2026-03-14 07:51:08,994 7fb791c05740 INFO lvcreate is present
2026-03-14 07:51:09,061 7fb791c05740 INFO Unit chronyd.service is enabled and running
2026-03-14 07:51:09,061 7fb791c05740 INFO Hostname "np0005647025.localdomain" matches what is expected.
2026-03-14 07:51:09,062 7fb791c05740 INFO Host looks OK
2026-03-14 07:51:31,007 7f696b784740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'check-host']
2026-03-14 07:51:31,069 7f696b784740 INFO podman (/bin/podman) version 4.4.1 is present
2026-03-14 07:51:31,069 7f696b784740 INFO systemctl is present
2026-03-14 07:51:31,069 7f696b784740 INFO lvcreate is present
2026-03-14 07:51:31,120 7f696b784740 INFO Unit chronyd.service is enabled and running
2026-03-14 07:51:31,121 7f696b784740 INFO Host looks OK
2026-03-14 07:51:31,532 7f418b3a9740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls']
2026-03-14 07:51:32,113 7fb06b771740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 07:51:33,073 7f38c5d8c740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'list-networks']
2026-03-14 07:51:33,628 7fdd05bab740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283', '--', 'inventory', '--format=json-pretty', '--filter-for-batch']
2026-03-14 07:51:33,823 7fdd05bab740 DEBUG Using specified fsid: 829ce43b-dec9-5380-a4c0-eff58e9f1283
2026-03-14 07:52:00,706 7f79d4999740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', '_orch', 'set-coredump-overrides', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283', '--coredump-max-size=32G']
2026-03-14 07:52:00,772 7f79d4999740 INFO Set coredump max sizes in /etc/systemd/coredump.conf.d/90-cephadm-829ce43b-dec9-5380-a4c0-eff58e9f1283-coredumps-overrides.conf to 32G. Restarting systemd-coredump.socket
2026-03-14 07:52:00,797 7f79d4999740 INFO systemd-coredump.socket restarted successfully
2026-03-14 07:52:22,282 7ff308c19740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', '_orch', 'deploy', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283']
2026-03-14 07:52:22,359 7ff308c19740 DEBUG Loaded deploy configuration: {'fsid': '829ce43b-dec9-5380-a4c0-eff58e9f1283', 'name': 'crash.np0005647025', 'image': '', 'deploy_arguments': [], 'params': {'limit_core_infinity': True}, 'meta': {'service_name': 'crash', 'ports': [], 'ip': None, 'deployed_by': ['registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:50945286dae5941044aa91c7700ff058ab2cb308d5d1d6d6bb2daf28aa7a0ca3', 'registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:485411749726179fe5cd880e2cf308261b35150e4b356ddb7100f52e02b2e353'], 'rank': None, 'rank_generation': None, 'extra_container_args': None, 'extra_entrypoint_args': None}, 'config_blobs': {'config': '# minimal ceph.conf for 829ce43b-dec9-5380-a4c0-eff58e9f1283\n[global]\n\tfsid = 829ce43b-dec9-5380-a4c0-eff58e9f1283\n\tmon_host = [v2:172.18.0.103:3300/0,v1:172.18.0.103:6789/0] [v2:172.18.0.104:3300/0,v1:172.18.0.104:6789/0] [v2:172.18.0.105:3300/0,v1:172.18.0.105:6789/0]\n', 'keyring': '[client.crash.np0005647025]\nkey = AQC1E7VpzZjmMxAA/qxaLyk5tERjp87nmsNzkA==\n'}}
2026-03-14 07:52:22,360 7ff308c19740 DEBUG Determined image: 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest'
2026-03-14 07:52:22,446 7ff308c19740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-crash-np0005647025
2026-03-14 07:52:22,446 7ff308c19740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-crash-np0005647025
2026-03-14 07:52:22,510 7ff308c19740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-crash.np0005647025
2026-03-14 07:52:22,510 7ff308c19740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-crash.np0005647025
2026-03-14 07:52:22,510 7ff308c19740 INFO Deploy daemon crash.np0005647025 ...
2026-03-14 07:52:23,322 7ff308c19740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target.
2026-03-14 07:52:23,566 7ff308c19740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283.target → /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283.target.
2026-03-14 07:52:23,567 7ff308c19740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283.target → /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283.target.
2026-03-14 07:52:23,843 7ff308c19740 DEBUG Non-zero exit code 1 from systemctl reset-failed ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@crash.np0005647025
2026-03-14 07:52:23,843 7ff308c19740 DEBUG systemctl: stderr Failed to reset failed state of unit ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@crash.np0005647025.service: Unit ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@crash.np0005647025.service not loaded.
2026-03-14 07:52:24,091 7ff308c19740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283.target.wants/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@crash.np0005647025.service → /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@.service.
2026-03-14 07:52:24,606 7ff308c19740 DEBUG firewalld does not appear to be present
2026-03-14 07:52:24,607 7ff308c19740 DEBUG Not possible to enable service <crash>. firewalld.service is not available
2026-03-14 07:52:32,791 7fdb92f72740 DEBUG --------------------------------------------------------------------------------
cephadm ['--env', 'CEPH_VOLUME_OSDSPEC_AFFINITY=default_drive_group', '--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283', '--config-json', '-', '--', 'lvm', 'batch', '--no-auto', '/dev/ceph_vg0/ceph_lv0', '/dev/ceph_vg1/ceph_lv1', '--yes', '--no-systemd']
2026-03-14 07:52:32,991 7fdb92f72740 DEBUG Using specified fsid: 829ce43b-dec9-5380-a4c0-eff58e9f1283
2026-03-14 07:52:42,461 7fdc68f22740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283', '--', 'lvm', 'list', '--format', 'json']
2026-03-14 07:52:42,666 7fdc68f22740 DEBUG Using specified fsid: 829ce43b-dec9-5380-a4c0-eff58e9f1283
2026-03-14 07:52:44,180 7f3a7ff97740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', '_orch', 'deploy', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283']
2026-03-14 07:52:44,242 7f3a7ff97740 DEBUG Loaded deploy configuration: {'fsid': '829ce43b-dec9-5380-a4c0-eff58e9f1283', 'name': 'osd.2', 'image': '', 'deploy_arguments': [], 'params': {'osd_fsid': 'b1ae7d60-4bc7-4c81-aa6e-a54b3bdb4c90', 'limit_core_infinity': True}, 'meta': {'service_name': 'osd.default_drive_group', 'ports': [], 'ip': None, 'deployed_by': ['registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:50945286dae5941044aa91c7700ff058ab2cb308d5d1d6d6bb2daf28aa7a0ca3', 'registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:485411749726179fe5cd880e2cf308261b35150e4b356ddb7100f52e02b2e353'], 'rank': None, 'rank_generation': None, 'extra_container_args': None, 'extra_entrypoint_args': None}, 'config_blobs': {'config': '# minimal ceph.conf for 829ce43b-dec9-5380-a4c0-eff58e9f1283\n[global]\n\tfsid = 829ce43b-dec9-5380-a4c0-eff58e9f1283\n\tmon_host = [v2:172.18.0.103:3300/0,v1:172.18.0.103:6789/0] [v2:172.18.0.104:3300/0,v1:172.18.0.104:6789/0] [v2:172.18.0.105:3300/0,v1:172.18.0.105:6789/0]\n', 'keyring': '[osd.2]\n\tkey = AQDCE7Vp7LH5DRAAHx7ymsfo4TboYmRzTIL1+g==\n\tcaps mgr = "allow profile osd"\n\tcaps mon = "allow profile osd"\n\tcaps osd = "allow *"\n'}}
2026-03-14 07:52:44,243 7f3a7ff97740 DEBUG Determined image: 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest'
2026-03-14 07:52:44,359 7f3a7ff97740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd-2
2026-03-14 07:52:44,359 7f3a7ff97740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd-2
2026-03-14 07:52:44,419 7f3a7ff97740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd.2
2026-03-14 07:52:44,419 7f3a7ff97740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd.2
2026-03-14 07:52:44,419 7f3a7ff97740 INFO Deploy daemon osd.2 ...
2026-03-14 07:52:45,684 7f3a7ff97740 DEBUG sysctl: stdout 65536
2026-03-14 07:52:45,689 7f3a7ff97740 DEBUG sysctl: stdout 4194304
2026-03-14 07:52:45,698 7f3a7ff97740 DEBUG sysctl: stdout * Applying /usr/lib/sysctl.d/10-default-yama-scope.conf ...
2026-03-14 07:52:45,698 7f3a7ff97740 DEBUG sysctl: stdout * Applying /usr/lib/sysctl.d/50-coredump.conf ...
2026-03-14 07:52:45,698 7f3a7ff97740 DEBUG sysctl: stdout * Applying /usr/lib/sysctl.d/50-default.conf ...
2026-03-14 07:52:45,698 7f3a7ff97740 DEBUG sysctl: stdout * Applying /usr/lib/sysctl.d/50-libkcapi-optmem_max.conf ...
2026-03-14 07:52:45,698 7f3a7ff97740 DEBUG sysctl: stdout * Applying /usr/lib/sysctl.d/50-pid-max.conf ...
2026-03-14 07:52:45,698 7f3a7ff97740 DEBUG sysctl: stdout * Applying /usr/lib/sysctl.d/50-redhat.conf ...
2026-03-14 07:52:45,698 7f3a7ff97740 DEBUG sysctl: stdout * Applying /etc/sysctl.d/90-ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd.conf ...
2026-03-14 07:52:45,698 7f3a7ff97740 DEBUG sysctl: stdout * Applying /etc/sysctl.d/99-sysctl.conf ...
2026-03-14 07:52:45,698 7f3a7ff97740 DEBUG sysctl: stdout * Applying /etc/sysctl.conf ...
2026-03-14 07:52:45,698 7f3a7ff97740 DEBUG sysctl: stdout kernel.yama.ptrace_scope = 0
2026-03-14 07:52:45,698 7f3a7ff97740 DEBUG sysctl: stdout kernel.core_pattern = |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h
2026-03-14 07:52:45,698 7f3a7ff97740 DEBUG sysctl: stdout kernel.core_pipe_limit = 16
2026-03-14 07:52:45,698 7f3a7ff97740 DEBUG sysctl: stdout fs.suid_dumpable = 2
2026-03-14 07:52:45,698 7f3a7ff97740 DEBUG sysctl: stdout kernel.sysrq = 16
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout kernel.core_uses_pid = 1
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.default.rp_filter = 2
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.br-ex.rp_filter = 2
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.eth0.rp_filter = 2
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.eth1.rp_filter = 2
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.lo.rp_filter = 2
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.ovs-system.rp_filter = 2
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan20.rp_filter = 2
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan21.rp_filter = 2
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan22.rp_filter = 2
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan23.rp_filter = 2
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan44.rp_filter = 2
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.default.accept_source_route = 0
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.br-ex.accept_source_route = 0
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.eth0.accept_source_route = 0
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.eth1.accept_source_route = 0
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.lo.accept_source_route = 0
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.ovs-system.accept_source_route = 0
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan20.accept_source_route = 0
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan21.accept_source_route = 0
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan22.accept_source_route = 0
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan23.accept_source_route = 0
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan44.accept_source_route = 0
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.default.promote_secondaries = 1
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.br-ex.promote_secondaries = 1
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.eth0.promote_secondaries = 1
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.eth1.promote_secondaries = 1
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.lo.promote_secondaries = 1
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.ovs-system.promote_secondaries = 1
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan20.promote_secondaries = 1
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan21.promote_secondaries = 1
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan22.promote_secondaries = 1
2026-03-14 07:52:45,699 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan23.promote_secondaries = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan44.promote_secondaries = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.ping_group_range = 0 2147483647
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.core.default_qdisc = fq_codel
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout fs.protected_hardlinks = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout fs.protected_symlinks = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout fs.protected_regular = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout fs.protected_fifos = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.core.optmem_max = 81920
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout kernel.pid_max = 4194304
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout kernel.kptr_restrict = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.default.rp_filter = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.br-ex.rp_filter = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.eth0.rp_filter = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.eth1.rp_filter = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.lo.rp_filter = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.ovs-system.rp_filter = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan20.rp_filter = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan21.rp_filter = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan22.rp_filter = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan23.rp_filter = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout net.ipv4.conf.vlan44.rp_filter = 1
2026-03-14 07:52:45,700 7f3a7ff97740 DEBUG sysctl: stdout fs.aio-max-nr = 1048576
2026-03-14 07:52:46,035 7f3a7ff97740 DEBUG Non-zero exit code 1 from systemctl reset-failed ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.2
2026-03-14 07:52:46,035 7f3a7ff97740 DEBUG systemctl: stderr Failed to reset failed state of unit ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.2.service: Unit ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.2.service not loaded.
2026-03-14 07:52:46,281 7f3a7ff97740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283.target.wants/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.2.service → /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@.service.
2026-03-14 07:52:47,982 7f3a7ff97740 DEBUG firewalld does not appear to be present
2026-03-14 07:52:47,982 7f3a7ff97740 DEBUG Not possible to enable service <osd>. firewalld.service is not available
2026-03-14 07:52:48,492 7fd893599740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', '_orch', 'deploy', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283']
2026-03-14 07:52:48,560 7fd893599740 DEBUG Loaded deploy configuration: {'fsid': '829ce43b-dec9-5380-a4c0-eff58e9f1283', 'name': 'osd.5', 'image': '', 'deploy_arguments': [], 'params': {'osd_fsid': 'f5cb5e90-f352-425b-8762-a121610e0268', 'limit_core_infinity': True}, 'meta': {'service_name': 'osd.default_drive_group', 'ports': [], 'ip': None, 'deployed_by': ['registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:50945286dae5941044aa91c7700ff058ab2cb308d5d1d6d6bb2daf28aa7a0ca3', 'registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:485411749726179fe5cd880e2cf308261b35150e4b356ddb7100f52e02b2e353'], 'rank': None, 'rank_generation': None, 'extra_container_args': None, 'extra_entrypoint_args': None}, 'config_blobs': {'config': '# minimal ceph.conf for 829ce43b-dec9-5380-a4c0-eff58e9f1283\n[global]\n\tfsid = 829ce43b-dec9-5380-a4c0-eff58e9f1283\n\tmon_host = [v2:172.18.0.103:3300/0,v1:172.18.0.103:6789/0] [v2:172.18.0.104:3300/0,v1:172.18.0.104:6789/0] [v2:172.18.0.105:3300/0,v1:172.18.0.105:6789/0]\n', 'keyring': '[osd.5]\n\tkey = AQDGE7Vp/2oRBhAAp6oxTkFP/gYl2QPTjWIS0A==\n\tcaps mgr = "allow profile osd"\n\tcaps mon = "allow profile osd"\n\tcaps osd = "allow *"\n'}}
2026-03-14 07:52:48,560 7fd893599740 DEBUG Determined image: 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest'
2026-03-14 07:52:48,654 7fd893599740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd-5
2026-03-14 07:52:48,654 7fd893599740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd-5
2026-03-14 07:52:48,704 7fd893599740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd.5
2026-03-14 07:52:48,705 7fd893599740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283-osd.5
2026-03-14 07:52:48,705 7fd893599740 INFO Deploy daemon osd.5 ...
2026-03-14 07:52:50,042 7fd893599740 DEBUG sysctl: stdout 1048576
2026-03-14 07:52:50,049 7fd893599740 DEBUG sysctl: stdout 4194304
2026-03-14 07:52:50,400 7fd893599740 DEBUG Non-zero exit code 1 from systemctl reset-failed ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.5
2026-03-14 07:52:50,401 7fd893599740 DEBUG systemctl: stderr Failed to reset failed state of unit ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.5.service: Unit ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.5.service not loaded.
2026-03-14 07:52:50,686 7fd893599740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283.target.wants/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@osd.5.service → /etc/systemd/system/ceph-829ce43b-dec9-5380-a4c0-eff58e9f1283@.service.
2026-03-14 07:52:52,537 7fd893599740 DEBUG firewalld does not appear to be present
2026-03-14 07:52:52,537 7fd893599740 DEBUG Not possible to enable service <osd>. firewalld.service is not available
2026-03-14 07:52:53,027 7f5b4f81b740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283', '--', 'raw', 'list', '--format', 'json']
2026-03-14 07:52:53,251 7f5b4f81b740 DEBUG Using specified fsid: 829ce43b-dec9-5380-a4c0-eff58e9f1283
2026-03-14 07:52:55,677 7f97081ca740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls']
2026-03-14 07:52:57,071 7f2aae017740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 07:52:57,960 7f735ef97740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283', '--', 'inventory', '--format=json-pretty', '--filter-for-batch']
2026-03-14 07:52:58,145 7f735ef97740 DEBUG Using specified fsid: 829ce43b-dec9-5380-a4c0-eff58e9f1283
2026-03-14 07:53:08,175 7fb635bf3740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls']
2026-03-14 07:54:10,176 7f3963566740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls']
2026-03-14 07:54:11,520 7ffbf7a48740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 07:55:12,823 7ff6e6636740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 07:56:14,357 7f4c167ad740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 07:57:16,282 7fa9b85ee740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 07:58:18,200 7fcfd700c740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 07:59:20,206 7fc90d9a2740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:00:21,704 7f8f745cc740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:01:23,543 7f88b3d83740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:02:26,299 7fdb69871740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'check-host']
2026-03-14 08:02:26,338 7fdb69871740 INFO podman (/bin/podman) version 4.4.1 is present
2026-03-14 08:02:26,338 7fdb69871740 INFO systemctl is present
2026-03-14 08:02:26,338 7fdb69871740 INFO lvcreate is present
2026-03-14 08:02:26,377 7fdb69871740 INFO Unit chronyd.service is enabled and running
2026-03-14 08:02:26,377 7fdb69871740 INFO Host looks OK
2026-03-14 08:02:27,651 7f96f2a31740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:03:28,985 7fc7dc02f740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:04:31,493 7f95cefef740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls']
2026-03-14 08:04:32,849 7fc987826740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:05:35,761 7f7e90fca740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:06:37,683 7fea889b7740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:07:39,209 7fef60f9a740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:08:40,674 7f91abfb6740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:09:42,156 7fb7d2d7b740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:10:43,573 7efc72e20740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:12:18,006 7f77ef40d740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:13:20,206 7f849f1c5740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'check-host']
2026-03-14 08:13:20,251 7f849f1c5740 INFO podman (/bin/podman) version 4.4.1 is present
2026-03-14 08:13:20,251 7f849f1c5740 INFO systemctl is present
2026-03-14 08:13:20,252 7f849f1c5740 INFO lvcreate is present
2026-03-14 08:13:20,306 7f849f1c5740 INFO Unit chronyd.service is enabled and running
2026-03-14 08:13:20,306 7f849f1c5740 INFO Host looks OK
2026-03-14 08:13:20,784 7f7aec5ef740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:14:22,681 7f926227a740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:15:24,241 7f7481f92740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls']
2026-03-14 08:15:25,606 7fa4a738a740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:16:27,028 7f8ab3f74740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:17:28,513 7f97f1b79740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:18:30,088 7f11653ce740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:19:31,539 7f63f1069740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:20:33,133 7f0460770740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:21:34,616 7fa030c40740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:21:35,515 7f9d85fef740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'list-networks']
2026-03-14 08:22:41,046 7f186300e740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:23:44,976 7fd6dfa79740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'check-host']
2026-03-14 08:23:45,036 7fd6dfa79740 INFO podman (/bin/podman) version 4.4.1 is present
2026-03-14 08:23:45,036 7fd6dfa79740 INFO systemctl is present
2026-03-14 08:23:45,036 7fd6dfa79740 INFO lvcreate is present
2026-03-14 08:23:45,100 7fd6dfa79740 INFO Unit chronyd.service is enabled and running
2026-03-14 08:23:45,100 7fd6dfa79740 INFO Host looks OK
2026-03-14 08:23:45,557 7fb5ebc2a740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:23:46,574 7fc1c59f1740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', '829ce43b-dec9-5380-a4c0-eff58e9f1283', '--', 'inventory', '--format=json-pretty', '--filter-for-batch']
2026-03-14 08:23:46,798 7fc1c59f1740 DEBUG Using specified fsid: 829ce43b-dec9-5380-a4c0-eff58e9f1283
2026-03-14 08:24:49,629 7fd4dc5d7740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:25:51,685 7f30b37b1740 DEBUG --------------------------------------------------------------------------------
cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls']
2026-03-14 08:25:53,088 7fc47317f740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:26:54,603 7fb245068740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:27:56,197 7f90859e3740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:28:57,820 7f6cde9cc740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:29:59,517 7f931ca59740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:31:01,130 7fdf68227740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:32:02,712 7f2114d83740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']
2026-03-14 08:33:05,749 7f97d2d81740 DEBUG --------------------------------------------------------------------------------
cephadm ['--timeout', '895', 'gather-facts']