2026-03-07 07:44:20,584 7ffa0340f740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'check-host', '--expect-hostname', 'np0005641043.localdomain'] 2026-03-07 07:44:20,642 7ffa0340f740 INFO podman (/bin/podman) version 4.4.1 is present 2026-03-07 07:44:20,643 7ffa0340f740 INFO systemctl is present 2026-03-07 07:44:20,643 7ffa0340f740 INFO lvcreate is present 2026-03-07 07:44:20,703 7ffa0340f740 INFO Unit chronyd.service is enabled and running 2026-03-07 07:44:20,703 7ffa0340f740 INFO Hostname "np0005641043.localdomain" matches what is expected. 2026-03-07 07:44:20,704 7ffa0340f740 INFO Host looks OK 2026-03-07 07:44:53,181 7f3065800740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'check-host'] 2026-03-07 07:44:53,241 7f3065800740 INFO podman (/bin/podman) version 4.4.1 is present 2026-03-07 07:44:53,242 7f3065800740 INFO systemctl is present 2026-03-07 07:44:53,242 7f3065800740 INFO lvcreate is present 2026-03-07 07:44:53,303 7f3065800740 INFO Unit chronyd.service is enabled and running 2026-03-07 07:44:53,303 7f3065800740 INFO Host looks OK 2026-03-07 07:44:53,741 7f75e01ab740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls'] 2026-03-07 07:44:54,388 7f6c7461f740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 07:44:55,233 7f5ae6015740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'list-networks'] 2026-03-07 07:44:55,690 7fcbfddd3740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', 'e280dcb7-41fd-5eab-aca3-ea1486340b1b', '--', 'inventory', '--format=json-pretty', '--filter-for-batch'] 2026-03-07 07:44:55,859 7fcbfddd3740 DEBUG Using specified fsid: e280dcb7-41fd-5eab-aca3-ea1486340b1b 2026-03-07 07:45:18,206 7f3b463f0740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', '_orch', 'set-coredump-overrides', '--fsid', 'e280dcb7-41fd-5eab-aca3-ea1486340b1b', '--coredump-max-size=32G'] 2026-03-07 07:45:18,272 7f3b463f0740 INFO Set coredump max sizes in /etc/systemd/coredump.conf.d/90-cephadm-e280dcb7-41fd-5eab-aca3-ea1486340b1b-coredumps-overrides.conf to 32G. Restarting systemd-coredump.socket 2026-03-07 07:45:18,291 7f3b463f0740 INFO systemd-coredump.socket restarted successfully 2026-03-07 07:45:28,729 7fda89bf8740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', '_orch', 'deploy', '--fsid', 'e280dcb7-41fd-5eab-aca3-ea1486340b1b'] 2026-03-07 07:45:28,797 7fda89bf8740 DEBUG Loaded deploy configuration: {'fsid': 'e280dcb7-41fd-5eab-aca3-ea1486340b1b', 'name': 'mon.np0005641043', 'image': '', 'deploy_arguments': [], 'params': {'limit_core_infinity': True}, 'meta': {'service_name': 'mon', 'ports': [], 'ip': None, 'deployed_by': ['registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:485411749726179fe5cd880e2cf308261b35150e4b356ddb7100f52e02b2e353', 'registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:50945286dae5941044aa91c7700ff058ab2cb308d5d1d6d6bb2daf28aa7a0ca3'], 'rank': None, 'rank_generation': None, 'extra_container_args': None, 'extra_entrypoint_args': None}, 'config_blobs': {'config': '# minimal ceph.conf for e280dcb7-41fd-5eab-aca3-ea1486340b1b\n[global]\n\tfsid = e280dcb7-41fd-5eab-aca3-ea1486340b1b\n\tmon_host = [v2:172.18.0.103:3300/0,v1:172.18.0.103:6789/0]\n[mon.np0005641043]\npublic network = 172.18.0.0/24\n', 'keyring': '[mon.]\n\tkey = AQAT16tpRK7RIxAApysX62E8qP14Fqo5DdsM4A==\n\tcaps mon = "allow *"\n', 'files': {'config': '[mon.np0005641043]\npublic network = 172.18.0.0/24\n'}}} 2026-03-07 07:45:28,798 7fda89bf8740 DEBUG Determined image: 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest' 2026-03-07 07:45:28,886 7fda89bf8740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-mon-np0005641043 2026-03-07 07:45:28,887 7fda89bf8740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-mon-np0005641043 2026-03-07 07:45:28,935 7fda89bf8740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-mon.np0005641043 2026-03-07 07:45:28,936 7fda89bf8740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-mon.np0005641043 2026-03-07 07:45:28,936 7fda89bf8740 INFO Deploy daemon mon.np0005641043 ... 2026-03-07 07:45:30,134 7fda89bf8740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-03-07 07:45:30,356 7fda89bf8740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b.target → /etc/systemd/system/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b.target. 2026-03-07 07:45:30,356 7fda89bf8740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b.target → /etc/systemd/system/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b.target. 2026-03-07 07:45:30,622 7fda89bf8740 DEBUG Non-zero exit code 1 from systemctl reset-failed ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@mon.np0005641043 2026-03-07 07:45:30,622 7fda89bf8740 DEBUG systemctl: stderr Failed to reset failed state of unit ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@mon.np0005641043.service: Unit ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@mon.np0005641043.service not loaded. 2026-03-07 07:45:30,824 7fda89bf8740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b.target.wants/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@mon.np0005641043.service → /etc/systemd/system/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@.service. 2026-03-07 07:45:31,272 7fda89bf8740 DEBUG firewalld does not appear to be present 2026-03-07 07:45:31,273 7fda89bf8740 DEBUG Not possible to enable service . firewalld.service is not available 2026-03-07 07:45:36,947 7fd0f4072740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', '_orch', 'deploy', '--fsid', 'e280dcb7-41fd-5eab-aca3-ea1486340b1b'] 2026-03-07 07:45:37,013 7fd0f4072740 DEBUG Loaded deploy configuration: {'fsid': 'e280dcb7-41fd-5eab-aca3-ea1486340b1b', 'name': 'mgr.np0005641043.odxwcn', 'image': '', 'deploy_arguments': [], 'params': {'tcp_ports': [8765], 'limit_core_infinity': True}, 'meta': {'service_name': 'mgr', 'ports': [8765], 'ip': None, 'deployed_by': ['registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:485411749726179fe5cd880e2cf308261b35150e4b356ddb7100f52e02b2e353', 'registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:50945286dae5941044aa91c7700ff058ab2cb308d5d1d6d6bb2daf28aa7a0ca3'], 'rank': None, 'rank_generation': None, 'extra_container_args': None, 'extra_entrypoint_args': None}, 'config_blobs': {'config': '# minimal ceph.conf for e280dcb7-41fd-5eab-aca3-ea1486340b1b\n[global]\n\tfsid = e280dcb7-41fd-5eab-aca3-ea1486340b1b\n\tmon_host = [v2:172.18.0.103:3300/0,v1:172.18.0.103:6789/0] [v2:172.18.0.105:3300/0,v1:172.18.0.105:6789/0]\n', 'keyring': '[mgr.np0005641043.odxwcn]\nkey = AQCg16tpcm0jHhAAyID6gy7Ezk5FN7fQAu1oEw==\n'}} 2026-03-07 07:45:37,013 7fd0f4072740 DEBUG Determined image: 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest' 2026-03-07 07:45:37,104 7fd0f4072740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-mgr-np0005641043-odxwcn 2026-03-07 07:45:37,104 7fd0f4072740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-mgr-np0005641043-odxwcn 2026-03-07 07:45:37,162 7fd0f4072740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-mgr.np0005641043.odxwcn 2026-03-07 07:45:37,163 7fd0f4072740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-mgr.np0005641043.odxwcn 2026-03-07 07:45:37,163 7fd0f4072740 INFO Deploy daemon mgr.np0005641043.odxwcn ... 2026-03-07 07:45:37,418 7fd0f4072740 INFO Verifying port 0.0.0.0:8765 ... 2026-03-07 07:45:37,751 7fd0f4072740 DEBUG Non-zero exit code 1 from systemctl reset-failed ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@mgr.np0005641043.odxwcn 2026-03-07 07:45:37,752 7fd0f4072740 DEBUG systemctl: stderr Failed to reset failed state of unit ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@mgr.np0005641043.odxwcn.service: Unit ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@mgr.np0005641043.odxwcn.service not loaded. 2026-03-07 07:45:38,008 7fd0f4072740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b.target.wants/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@mgr.np0005641043.odxwcn.service → /etc/systemd/system/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@.service. 2026-03-07 07:45:38,498 7fd0f4072740 DEBUG firewalld does not appear to be present 2026-03-07 07:45:38,498 7fd0f4072740 DEBUG Not possible to enable service . firewalld.service is not available 2026-03-07 07:45:38,498 7fd0f4072740 DEBUG firewalld does not appear to be present 2026-03-07 07:45:38,499 7fd0f4072740 DEBUG Not possible to open ports <[8765]>. firewalld.service is not available 2026-03-07 07:45:48,381 7f5d66797740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', '_orch', 'deploy', '--fsid', 'e280dcb7-41fd-5eab-aca3-ea1486340b1b'] 2026-03-07 07:45:48,447 7f5d66797740 DEBUG Loaded deploy configuration: {'fsid': 'e280dcb7-41fd-5eab-aca3-ea1486340b1b', 'name': 'crash.np0005641043', 'image': '', 'deploy_arguments': [], 'params': {'limit_core_infinity': True}, 'meta': {'service_name': 'crash', 'ports': [], 'ip': None, 'deployed_by': ['registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:485411749726179fe5cd880e2cf308261b35150e4b356ddb7100f52e02b2e353', 'registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:50945286dae5941044aa91c7700ff058ab2cb308d5d1d6d6bb2daf28aa7a0ca3'], 'rank': None, 'rank_generation': None, 'extra_container_args': None, 'extra_entrypoint_args': None}, 'config_blobs': {'config': '# minimal ceph.conf for e280dcb7-41fd-5eab-aca3-ea1486340b1b\n[global]\n\tfsid = e280dcb7-41fd-5eab-aca3-ea1486340b1b\n\tmon_host = [v2:172.18.0.103:3300/0,v1:172.18.0.103:6789/0] [v2:172.18.0.104:3300/0,v1:172.18.0.104:6789/0] [v2:172.18.0.105:3300/0,v1:172.18.0.105:6789/0]\n', 'keyring': '[client.crash.np0005641043]\nkey = AQCr16tpgg/mNhAAqWb4EQETnXvTy+EQsxXF2g==\n'}} 2026-03-07 07:45:48,447 7f5d66797740 DEBUG Determined image: 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest' 2026-03-07 07:45:48,546 7f5d66797740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-crash-np0005641043 2026-03-07 07:45:48,551 7f5d66797740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-crash-np0005641043 2026-03-07 07:45:48,633 7f5d66797740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-crash.np0005641043 2026-03-07 07:45:48,634 7f5d66797740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-crash.np0005641043 2026-03-07 07:45:48,634 7f5d66797740 INFO Deploy daemon crash.np0005641043 ... 2026-03-07 07:45:50,675 7f5d66797740 DEBUG Non-zero exit code 1 from systemctl reset-failed ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@crash.np0005641043 2026-03-07 07:45:50,676 7f5d66797740 DEBUG systemctl: stderr Failed to reset failed state of unit ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@crash.np0005641043.service: Unit ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@crash.np0005641043.service not loaded. 2026-03-07 07:45:50,899 7f5d66797740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b.target.wants/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@crash.np0005641043.service → /etc/systemd/system/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@.service. 2026-03-07 07:45:51,350 7f5d66797740 DEBUG firewalld does not appear to be present 2026-03-07 07:45:51,350 7f5d66797740 DEBUG Not possible to enable service . firewalld.service is not available 2026-03-07 07:46:20,432 7fee40da2740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls'] 2026-03-07 07:46:21,706 7fbbf7244740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 07:46:31,562 7f521d375740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', '_orch', 'deploy', '--fsid', 'e280dcb7-41fd-5eab-aca3-ea1486340b1b'] 2026-03-07 07:46:31,624 7f521d375740 DEBUG Loaded deploy configuration: {'fsid': 'e280dcb7-41fd-5eab-aca3-ea1486340b1b', 'name': 'mon.np0005641043', 'image': '', 'deploy_arguments': [], 'params': {'reconfig': True, 'limit_core_infinity': True}, 'meta': {'service_name': 'mon', 'ports': [], 'ip': None, 'deployed_by': ['registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:485411749726179fe5cd880e2cf308261b35150e4b356ddb7100f52e02b2e353', 'registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:50945286dae5941044aa91c7700ff058ab2cb308d5d1d6d6bb2daf28aa7a0ca3'], 'rank': None, 'rank_generation': None, 'extra_container_args': None, 'extra_entrypoint_args': None}, 'config_blobs': {'config': '# minimal ceph.conf for e280dcb7-41fd-5eab-aca3-ea1486340b1b\n[global]\n\tfsid = e280dcb7-41fd-5eab-aca3-ea1486340b1b\n\tmon_host = [v2:172.18.0.103:3300/0,v1:172.18.0.103:6789/0] [v2:172.18.0.104:3300/0,v1:172.18.0.104:6789/0] [v2:172.18.0.105:3300/0,v1:172.18.0.105:6789/0]\n[mon.np0005641043]\npublic network = 172.18.0.0/24\n', 'keyring': '[mon.]\n\tkey = AQAT16tpRK7RIxAApysX62E8qP14Fqo5DdsM4A==\n\tcaps mon = "allow *"\n', 'files': {'config': '[mon.np0005641043]\npublic network = 172.18.0.0/24\n'}}} 2026-03-07 07:46:31,624 7f521d375740 DEBUG Determined image: 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest' 2026-03-07 07:46:31,657 7f521d375740 INFO Reconfig daemon mon.np0005641043 ... 2026-03-07 07:46:31,939 7f521d375740 DEBUG firewalld does not appear to be present 2026-03-07 07:46:31,939 7f521d375740 DEBUG Not possible to enable service . firewalld.service is not available 2026-03-07 07:46:32,393 7f5791bc1740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', '_orch', 'deploy', '--fsid', 'e280dcb7-41fd-5eab-aca3-ea1486340b1b'] 2026-03-07 07:46:32,453 7f5791bc1740 DEBUG Loaded deploy configuration: {'fsid': 'e280dcb7-41fd-5eab-aca3-ea1486340b1b', 'name': 'mgr.np0005641043.odxwcn', 'image': '', 'deploy_arguments': [], 'params': {'tcp_ports': [8765, 8765], 'reconfig': True, 'limit_core_infinity': True}, 'meta': {'service_name': 'mgr', 'ports': [8765, 8765], 'ip': None, 'deployed_by': ['registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:485411749726179fe5cd880e2cf308261b35150e4b356ddb7100f52e02b2e353', 'registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:50945286dae5941044aa91c7700ff058ab2cb308d5d1d6d6bb2daf28aa7a0ca3'], 'rank': None, 'rank_generation': None, 'extra_container_args': None, 'extra_entrypoint_args': None}, 'config_blobs': {'config': '# minimal ceph.conf for e280dcb7-41fd-5eab-aca3-ea1486340b1b\n[global]\n\tfsid = e280dcb7-41fd-5eab-aca3-ea1486340b1b\n\tmon_host = [v2:172.18.0.103:3300/0,v1:172.18.0.103:6789/0] [v2:172.18.0.104:3300/0,v1:172.18.0.104:6789/0] [v2:172.18.0.105:3300/0,v1:172.18.0.105:6789/0]\n', 'keyring': '[mgr.np0005641043.odxwcn]\nkey = AQCg16tpcm0jHhAAyID6gy7Ezk5FN7fQAu1oEw==\n'}} 2026-03-07 07:46:32,454 7f5791bc1740 DEBUG Determined image: 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest' 2026-03-07 07:46:32,482 7f5791bc1740 INFO Reconfig daemon mgr.np0005641043.odxwcn ... 2026-03-07 07:46:32,751 7f5791bc1740 DEBUG firewalld does not appear to be present 2026-03-07 07:46:32,752 7f5791bc1740 DEBUG Not possible to enable service . firewalld.service is not available 2026-03-07 07:46:32,752 7f5791bc1740 DEBUG firewalld does not appear to be present 2026-03-07 07:46:32,752 7f5791bc1740 DEBUG Not possible to open ports <[8765, 8765]>. firewalld.service is not available 2026-03-07 07:46:33,236 7f9d937b2740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls'] 2026-03-07 07:47:35,193 7f0b65c30740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls'] 2026-03-07 07:47:36,486 7f3d23dbc740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 07:48:37,923 7fa295a27740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 07:49:39,405 7fccb3587740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 07:50:40,764 7f689e213740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 07:51:42,303 7fed887d9740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 07:52:43,763 7fa7c01b6740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 07:53:45,211 7f0bca384740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 07:54:46,675 7fd11f196740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 07:55:50,356 7f6406c48740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'check-host'] 2026-03-07 07:55:50,433 7f6406c48740 INFO podman (/bin/podman) version 4.4.1 is present 2026-03-07 07:55:50,433 7f6406c48740 INFO systemctl is present 2026-03-07 07:55:50,433 7f6406c48740 INFO lvcreate is present 2026-03-07 07:55:50,490 7f6406c48740 INFO Unit chronyd.service is enabled and running 2026-03-07 07:55:50,491 7f6406c48740 INFO Host looks OK 2026-03-07 07:55:51,103 7f8ee93a9740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 07:56:52,369 7f46dadcc740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 07:57:55,544 7f9459c0a740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls'] 2026-03-07 07:57:57,657 7fcedc65a740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 07:58:58,768 7f7b473aa740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:00:03,178 7f1a3661c740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:01:06,175 7f078b1b2740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:02:07,600 7f06667de740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:03:09,295 7feb121ea740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:04:10,731 7f4e677d9740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:05:11,015 7f6cb3a40740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', '_orch', 'deploy', '--fsid', 'e280dcb7-41fd-5eab-aca3-ea1486340b1b'] 2026-03-07 08:05:11,065 7f6cb3a40740 DEBUG Loaded deploy configuration: {'fsid': 'e280dcb7-41fd-5eab-aca3-ea1486340b1b', 'name': 'mds.mds.np0005641043.ckttjf', 'image': '', 'deploy_arguments': [], 'params': {'limit_core_infinity': True}, 'meta': {'service_name': 'mds.mds', 'ports': [], 'ip': None, 'deployed_by': ['registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:50945286dae5941044aa91c7700ff058ab2cb308d5d1d6d6bb2daf28aa7a0ca3', 'registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:485411749726179fe5cd880e2cf308261b35150e4b356ddb7100f52e02b2e353'], 'rank': None, 'rank_generation': None, 'extra_container_args': None, 'extra_entrypoint_args': None}, 'config_blobs': {'config': '# minimal ceph.conf for e280dcb7-41fd-5eab-aca3-ea1486340b1b\n[global]\n\tfsid = e280dcb7-41fd-5eab-aca3-ea1486340b1b\n\tmon_host = [v2:172.18.0.103:3300/0,v1:172.18.0.103:6789/0] [v2:172.18.0.104:3300/0,v1:172.18.0.104:6789/0] [v2:172.18.0.105:3300/0,v1:172.18.0.105:6789/0]\n', 'keyring': '[mds.mds.np0005641043.ckttjf]\nkey = AQA23Ktpea6JJBAA8SbcPxrj1Ze3KdT4Jmic+g==\n'}} 2026-03-07 08:05:11,066 7f6cb3a40740 DEBUG Determined image: 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest' 2026-03-07 08:05:11,164 7f6cb3a40740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-mds-mds-np0005641043-ckttjf 2026-03-07 08:05:11,164 7f6cb3a40740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-mds-mds-np0005641043-ckttjf 2026-03-07 08:05:11,230 7f6cb3a40740 INFO Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-mds.mds.np0005641043.ckttjf 2026-03-07 08:05:11,231 7f6cb3a40740 INFO /bin/podman: stderr Error: inspecting object: no such container ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b-mds.mds.np0005641043.ckttjf 2026-03-07 08:05:11,231 7f6cb3a40740 INFO Deploy daemon mds.mds.np0005641043.ckttjf ... 2026-03-07 08:05:11,808 7f6cb3a40740 DEBUG Non-zero exit code 1 from systemctl reset-failed ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@mds.mds.np0005641043.ckttjf 2026-03-07 08:05:11,808 7f6cb3a40740 DEBUG systemctl: stderr Failed to reset failed state of unit ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@mds.mds.np0005641043.ckttjf.service: Unit ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@mds.mds.np0005641043.ckttjf.service not loaded. 2026-03-07 08:05:12,063 7f6cb3a40740 DEBUG systemctl: stderr Created symlink /etc/systemd/system/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b.target.wants/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@mds.mds.np0005641043.ckttjf.service → /etc/systemd/system/ceph-e280dcb7-41fd-5eab-aca3-ea1486340b1b@.service. 2026-03-07 08:05:12,509 7f6cb3a40740 DEBUG firewalld does not appear to be present 2026-03-07 08:05:12,509 7f6cb3a40740 DEBUG Not possible to enable service . firewalld.service is not available 2026-03-07 08:05:18,175 7f8f585b5740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls'] 2026-03-07 08:05:19,542 7fee37b62740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:06:21,427 7f69dd594740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'check-host'] 2026-03-07 08:06:21,491 7f69dd594740 INFO podman (/bin/podman) version 4.4.1 is present 2026-03-07 08:06:21,492 7f69dd594740 INFO systemctl is present 2026-03-07 08:06:21,492 7f69dd594740 INFO lvcreate is present 2026-03-07 08:06:21,546 7f69dd594740 INFO Unit chronyd.service is enabled and running 2026-03-07 08:06:21,547 7f69dd594740 INFO Host looks OK 2026-03-07 08:06:22,003 7f53f2440740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:07:23,515 7f0ed4178740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:08:25,089 7f7a3e3cd740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:09:27,766 7fbf2cdcb740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:10:29,439 7ff7a8632740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:11:30,991 7f19bb632740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:12:32,904 7f255d5f9740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:13:34,410 7f927c22b740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:14:35,897 7fe7c018c740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:15:40,867 7f07dc7df740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls'] 2026-03-07 08:15:42,289 7fd26d277740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:15:43,055 7fda17807740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'list-networks'] 2026-03-07 08:15:43,569 7fa201c55740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', 'e280dcb7-41fd-5eab-aca3-ea1486340b1b', '--', 'inventory', '--format=json-pretty', '--filter-for-batch'] 2026-03-07 08:15:43,848 7fa201c55740 INFO Inferring config /var/lib/ceph/e280dcb7-41fd-5eab-aca3-ea1486340b1b/mon.np0005641043/config 2026-03-07 08:15:43,848 7fa201c55740 DEBUG Using specified fsid: e280dcb7-41fd-5eab-aca3-ea1486340b1b 2026-03-07 08:16:46,750 7f130ca7c740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'check-host'] 2026-03-07 08:16:46,824 7f130ca7c740 INFO podman (/bin/podman) version 4.4.1 is present 2026-03-07 08:16:46,824 7f130ca7c740 INFO systemctl is present 2026-03-07 08:16:46,825 7f130ca7c740 INFO lvcreate is present 2026-03-07 08:16:46,883 7f130ca7c740 INFO Unit chronyd.service is enabled and running 2026-03-07 08:16:46,883 7f130ca7c740 INFO Host looks OK 2026-03-07 08:16:47,346 7f63a858b740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:17:51,042 7f28c9bfd740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:18:52,869 7f4dc037c740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:19:55,782 7fa8b4fea740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:20:57,823 7f1ce5a7a740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:21:59,313 7fdd08812740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:23:01,211 7fc128428740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:24:02,730 7fd134024740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:25:04,521 7fe978171740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:26:06,006 7fc7edd78740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls'] 2026-03-07 08:26:07,915 7fbaff434740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:27:10,269 7f37d020d740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'check-host'] 2026-03-07 08:27:10,353 7f37d020d740 INFO podman (/bin/podman) version 4.4.1 is present 2026-03-07 08:27:10,353 7f37d020d740 INFO systemctl is present 2026-03-07 08:27:10,353 7f37d020d740 INFO lvcreate is present 2026-03-07 08:27:10,418 7f37d020d740 INFO Unit chronyd.service is enabled and running 2026-03-07 08:27:10,418 7f37d020d740 INFO Host looks OK 2026-03-07 08:27:10,907 7ff4a301a740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:28:12,390 7f26cb3ad740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:29:14,050 7f0e69029740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:30:16,705 7f798a981740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:31:18,299 7f294d86b740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:32:19,922 7fbee0033740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:33:21,480 7f60e1b67740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:34:23,087 7fca0b9dc740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:35:24,755 7f5d73178740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:36:26,381 7fedd45fb740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls'] 2026-03-07 08:36:28,211 7f5a5f775740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:37:30,254 7f3b47781740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'check-host'] 2026-03-07 08:37:30,340 7f3b47781740 INFO podman (/bin/podman) version 4.4.1 is present 2026-03-07 08:37:30,341 7f3b47781740 INFO systemctl is present 2026-03-07 08:37:30,341 7f3b47781740 INFO lvcreate is present 2026-03-07 08:37:30,409 7f3b47781740 INFO Unit chronyd.service is enabled and running 2026-03-07 08:37:30,409 7f3b47781740 INFO Host looks OK 2026-03-07 08:37:30,912 7f98b49bb740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:38:32,511 7ff6b3da1740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:39:34,088 7fb4c7feb740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:40:37,033 7f3399a34740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:41:38,652 7fed5b9d5740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:42:40,293 7f4d4d18e740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:43:41,848 7f06963c4740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:44:43,493 7f84601a4740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:45:48,608 7fe2c3210740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:45:49,606 7f30b3030740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'list-networks'] 2026-03-07 08:45:50,137 7f82849b5740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ceph-volume', '--fsid', 'e280dcb7-41fd-5eab-aca3-ea1486340b1b', '--', 'inventory', '--format=json-pretty', '--filter-for-batch'] 2026-03-07 08:45:50,470 7f82849b5740 INFO Inferring config /var/lib/ceph/e280dcb7-41fd-5eab-aca3-ea1486340b1b/mon.np0005641043/config 2026-03-07 08:45:50,470 7f82849b5740 DEBUG Using specified fsid: e280dcb7-41fd-5eab-aca3-ea1486340b1b 2026-03-07 08:46:53,186 7f52d05ca740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls'] 2026-03-07 08:46:54,753 7efd8239b740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:47:57,201 7f998c581740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'check-host'] 2026-03-07 08:47:57,259 7f998c581740 INFO podman (/bin/podman) version 4.4.1 is present 2026-03-07 08:47:57,260 7f998c581740 INFO systemctl is present 2026-03-07 08:47:57,261 7f998c581740 INFO lvcreate is present 2026-03-07 08:47:57,323 7f998c581740 INFO Unit chronyd.service is enabled and running 2026-03-07 08:47:57,323 7f998c581740 INFO Host looks OK 2026-03-07 08:47:57,867 7fc562040740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:48:59,339 7f57aac09740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:50:00,896 7fe183258740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:51:03,741 7ff336018740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:52:05,358 7f048cc67740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:53:06,915 7f583e7ae740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:54:08,531 7f6ac05ba740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:55:10,247 7f935a1c0740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:56:11,820 7f3a58219740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:57:13,486 7f3770c74740 DEBUG -------------------------------------------------------------------------------- cephadm ['--image', 'registry.redhat.io/rhceph/rhceph-7-rhel9:latest', '--timeout', '895', 'ls'] 2026-03-07 08:57:15,221 7ff1127a7740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:58:17,313 7fa956874740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'check-host'] 2026-03-07 08:58:17,362 7fa956874740 INFO podman (/bin/podman) version 4.4.1 is present 2026-03-07 08:58:17,362 7fa956874740 INFO systemctl is present 2026-03-07 08:58:17,363 7fa956874740 INFO lvcreate is present 2026-03-07 08:58:17,409 7fa956874740 INFO Unit chronyd.service is enabled and running 2026-03-07 08:58:17,410 7fa956874740 INFO Host looks OK 2026-03-07 08:58:17,911 7f83b6001740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 08:59:19,627 7fd23e59b740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 09:00:21,252 7f8f917ca740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 09:01:24,088 7f4bcadef740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 09:02:25,728 7f1fd53d7740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 09:03:27,206 7f2cbe7ba740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 09:04:28,898 7f3b3be2d740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts'] 2026-03-07 09:05:30,501 7f7a9d793740 DEBUG -------------------------------------------------------------------------------- cephadm ['--timeout', '895', 'gather-facts']