[WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (edpm_node_hostname). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (edpm_node_ip). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (source_galera_members). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (source_mariadb_ip). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (enable_tlse). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (neutron_qe_test). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (tobiko_qe_test). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (neutron_qe_dir). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (prelaunch_barbican_secret). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (os_cloud_name). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (standalone_ip). Using last defined value only. Using /home/zuul/src/review.rdoproject.org/rdo-jobs/playbooks/data_plane_adoption/ansible.cfg as config file PLAY [Externalize Ceph] ******************************************************** TASK [Gathering Facts] ********************************************************* ok: [np0005546415.localdomain] TASK [ceph_migrate : Check file in the src directory] ************************** [WARNING]: Skipped '/home/tripleo-admin/ceph_client' path due to this access issue: '/home/tripleo-admin/ceph_client' is not a directory ok: [np0005546415.localdomain] => {"changed": false, "examined": 0, "files": [], "matched": 0, "msg": "Not all paths examined, check warnings for details", "skipped_paths": {"/home/tripleo-admin/ceph_client": "'/home/tripleo-admin/ceph_client' is not a directory"}} TASK [ceph_migrate : Restore files] ******************************************** skipping: [np0005546415.localdomain] => (item=ceph.conf) => {"ansible_loop_var": "item", "changed": false, "false_condition": "dir_ceph_files.files | length > 0", "item": "ceph.conf", "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => (item=ceph.client.admin.keyring) => {"ansible_loop_var": "item", "changed": false, "false_condition": "dir_ceph_files.files | length > 0", "item": "ceph.client.admin.keyring", "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => {"changed": false, "msg": "All items skipped"} TASK [ceph_migrate : Ensure backup directory exists] *************************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "dump | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Get Ceph Health] ****************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "-s", "-f", "json"], "delta": "0:00:02.779093", "end": "2025-12-05 09:52:03.542840", "msg": "", "rc": 0, "start": "2025-12-05 09:52:00.763747", "stderr": "Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b\nInferring config /var/lib/ceph/79feddb1-4bfc-557f-83b9-0d57c9f66c1b/mon.np0005546415/config\nUsing ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4", "stderr_lines": ["Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "Inferring config /var/lib/ceph/79feddb1-4bfc-557f-83b9-0d57c9f66c1b/mon.np0005546415/config", "Using ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4"], "stdout": "\n{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":14,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005546415\",\"np0005546418\",\"np0005546416\"],\"quorum_age\":7227,\"monmap\":{\"epoch\":3,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":81,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109571242,\"bytes_used\":565776384,\"bytes_avail\":44506214400,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":6,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546418.rcuuff\",\"status\":\"up:active\",\"gid\":24280}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":2,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":72,\"modified\":\"2025-12-05T09:50:35.802918+0000\",\"services\":{}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":14,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005546415\",\"np0005546418\",\"np0005546416\"],\"quorum_age\":7227,\"monmap\":{\"epoch\":3,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":81,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109571242,\"bytes_used\":565776384,\"bytes_avail\":44506214400,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":6,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546418.rcuuff\",\"status\":\"up:active\",\"gid\":24280}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":2,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":72,\"modified\":\"2025-12-05T09:50:35.802918+0000\",\"services\":{}},\"progress_events\":{}}"]} TASK [ceph_migrate : Load ceph data] ******************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph": {"election_epoch": 14, "fsid": "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "fsmap": {"by_rank": [{"filesystem_id": 1, "gid": 24280, "name": "mds.np0005546418.rcuuff", "rank": 0, "status": "up:active"}], "epoch": 6, "id": 1, "in": 1, "max": 1, "up": 1, "up:standby": 2}, "health": {"checks": {}, "mutes": [], "status": "HEALTH_OK"}, "mgrmap": {"available": true, "modules": ["cephadm", "iostat", "nfs", "restful"], "num_standbys": 2, "services": {}}, "monmap": {"epoch": 3, "min_mon_release_name": "reef", "num_mons": 3}, "osdmap": {"epoch": 81, "num_in_osds": 6, "num_osds": 6, "num_remapped_pgs": 0, "num_up_osds": 6, "osd_in_since": 1764921115, "osd_up_since": 1764921138}, "pgmap": {"bytes_avail": 44506214400, "bytes_total": 45071990784, "bytes_used": 565776384, "data_bytes": 109571242, "num_objects": 69, "num_pgs": 177, "num_pools": 7, "pgs_by_state": [{"count": 177, "state_name": "active+clean"}]}, "progress_events": {}, "quorum": [0, 1, 2], "quorum_age": 7227, "quorum_names": ["np0005546415", "np0005546418", "np0005546416"], "servicemap": {"epoch": 72, "modified": "2025-12-05T09:50:35.802918+0000", "services": {}}}}, "changed": false} TASK [ceph_migrate : Dump ceph -s output to log file] ************************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "dump | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Get Ceph Orch ServiceMap] ********************************* changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "orch", "ls", "-f", "json"], "delta": "0:00:03.020314", "end": "2025-12-05 09:52:07.148490", "msg": "", "rc": 0, "start": "2025-12-05 09:52:04.128176", "stderr": "Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b\nInferring config /var/lib/ceph/79feddb1-4bfc-557f-83b9-0d57c9f66c1b/mon.np0005546415/config\nUsing ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4", "stderr_lines": ["Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "Inferring config /var/lib/ceph/79feddb1-4bfc-557f-83b9-0d57c9f66c1b/mon.np0005546415/config", "Using ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4"], "stdout": "\n[{\"events\": [\"2025-12-05T07:51:49.107597Z service:crash [INFO] \\\"service was created\\\"\"], \"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"crash\", \"service_type\": \"crash\", \"status\": {\"created\": \"2025-12-05T07:49:46.685849Z\", \"last_refresh\": \"2025-12-05T09:44:05.516369Z\", \"running\": 6, \"size\": 6}}, {\"events\": [\"2025-12-05T08:10:31.506287Z service:mds.mds [INFO] \\\"service was created\\\"\"], \"placement\": {\"hosts\": [\"np0005546415.localdomain\", \"np0005546416.localdomain\", \"np0005546418.localdomain\"]}, \"service_id\": \"mds\", \"service_name\": \"mds.mds\", \"service_type\": \"mds\", \"status\": {\"created\": \"2025-12-05T08:10:24.625636Z\", \"last_refresh\": \"2025-12-05T09:44:05.516491Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2025-12-05T07:51:38.343306Z service:mgr [INFO] \\\"service was created\\\"\", \"2025-12-05T07:50:40.121650Z service:mgr [ERROR] \\\"Failed to apply: Cannot place on np0005546418.localdomain: Unknown hosts\\\"\"], \"placement\": {\"hosts\": [\"np0005546415.localdomain\", \"np0005546416.localdomain\", \"np0005546418.localdomain\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\", \"status\": {\"created\": \"2025-12-05T07:50:28.509240Z\", \"last_refresh\": \"2025-12-05T09:44:05.516238Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2025-12-05T07:51:29.366270Z service:mon [INFO] \\\"service was created\\\"\", \"2025-12-05T07:50:40.120252Z service:mon [ERROR] \\\"Failed to apply: Cannot place on np0005546418.localdomain: Unknown hosts\\\"\"], \"placement\": {\"hosts\": [\"np0005546415.localdomain\", \"np0005546416.localdomain\", \"np0005546418.localdomain\"]}, \"service_name\": \"mon\", \"service_type\": \"mon\", \"status\": {\"created\": \"2025-12-05T07:50:28.500741Z\", \"last_refresh\": \"2025-12-05T09:44:05.516023Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2025-12-05T07:50:00.655886Z service:node-proxy [INFO] \\\"service was created\\\"\"], \"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"node-proxy\", \"service_type\": \"node-proxy\", \"status\": {\"created\": \"2025-12-05T07:50:00.628104Z\", \"running\": 0, \"size\": 0}}, {\"events\": [\"2025-12-05T07:50:28.523967Z service:osd.default_drive_group [INFO] \\\"service was created\\\"\"], \"placement\": {\"hosts\": [\"np0005546419.localdomain\", \"np0005546420.localdomain\", \"np0005546421.localdomain\"]}, \"service_id\": \"default_drive_group\", \"service_name\": \"osd.default_drive_group\", \"service_type\": \"osd\", \"spec\": {\"data_devices\": {\"paths\": [\"/dev/ceph_vg0/ceph_lv0\", \"/dev/ceph_vg1/ceph_lv1\"]}, \"filter_logic\": \"AND\", \"objectstore\": \"bluestore\"}, \"status\": {\"created\": \"2025-12-05T07:50:28.517071Z\", \"last_refresh\": \"2025-12-05T09:48:15.211500Z\", \"running\": 6, \"size\": 6}}]", "stdout_lines": ["", "[{\"events\": [\"2025-12-05T07:51:49.107597Z service:crash [INFO] \\\"service was created\\\"\"], \"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"crash\", \"service_type\": \"crash\", \"status\": {\"created\": \"2025-12-05T07:49:46.685849Z\", \"last_refresh\": \"2025-12-05T09:44:05.516369Z\", \"running\": 6, \"size\": 6}}, {\"events\": [\"2025-12-05T08:10:31.506287Z service:mds.mds [INFO] \\\"service was created\\\"\"], \"placement\": {\"hosts\": [\"np0005546415.localdomain\", \"np0005546416.localdomain\", \"np0005546418.localdomain\"]}, \"service_id\": \"mds\", \"service_name\": \"mds.mds\", \"service_type\": \"mds\", \"status\": {\"created\": \"2025-12-05T08:10:24.625636Z\", \"last_refresh\": \"2025-12-05T09:44:05.516491Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2025-12-05T07:51:38.343306Z service:mgr [INFO] \\\"service was created\\\"\", \"2025-12-05T07:50:40.121650Z service:mgr [ERROR] \\\"Failed to apply: Cannot place on np0005546418.localdomain: Unknown hosts\\\"\"], \"placement\": {\"hosts\": [\"np0005546415.localdomain\", \"np0005546416.localdomain\", \"np0005546418.localdomain\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\", \"status\": {\"created\": \"2025-12-05T07:50:28.509240Z\", \"last_refresh\": \"2025-12-05T09:44:05.516238Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2025-12-05T07:51:29.366270Z service:mon [INFO] \\\"service was created\\\"\", \"2025-12-05T07:50:40.120252Z service:mon [ERROR] \\\"Failed to apply: Cannot place on np0005546418.localdomain: Unknown hosts\\\"\"], \"placement\": {\"hosts\": [\"np0005546415.localdomain\", \"np0005546416.localdomain\", \"np0005546418.localdomain\"]}, \"service_name\": \"mon\", \"service_type\": \"mon\", \"status\": {\"created\": \"2025-12-05T07:50:28.500741Z\", \"last_refresh\": \"2025-12-05T09:44:05.516023Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2025-12-05T07:50:00.655886Z service:node-proxy [INFO] \\\"service was created\\\"\"], \"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"node-proxy\", \"service_type\": \"node-proxy\", \"status\": {\"created\": \"2025-12-05T07:50:00.628104Z\", \"running\": 0, \"size\": 0}}, {\"events\": [\"2025-12-05T07:50:28.523967Z service:osd.default_drive_group [INFO] \\\"service was created\\\"\"], \"placement\": {\"hosts\": [\"np0005546419.localdomain\", \"np0005546420.localdomain\", \"np0005546421.localdomain\"]}, \"service_id\": \"default_drive_group\", \"service_name\": \"osd.default_drive_group\", \"service_type\": \"osd\", \"spec\": {\"data_devices\": {\"paths\": [\"/dev/ceph_vg0/ceph_lv0\", \"/dev/ceph_vg1/ceph_lv1\"]}, \"filter_logic\": \"AND\", \"objectstore\": \"bluestore\"}, \"status\": {\"created\": \"2025-12-05T07:50:28.517071Z\", \"last_refresh\": \"2025-12-05T09:48:15.211500Z\", \"running\": 6, \"size\": 6}}]"]} TASK [ceph_migrate : Load Service Map] ***************************************** ok: [np0005546415.localdomain] => {"ansible_facts": {"servicemap": [{"events": ["2025-12-05T07:51:49.107597Z service:crash [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2025-12-05T07:49:46.685849Z", "last_refresh": "2025-12-05T09:44:05.516369Z", "running": 6, "size": 6}}, {"events": ["2025-12-05T08:10:31.506287Z service:mds.mds [INFO] \"service was created\""], "placement": {"hosts": ["np0005546415.localdomain", "np0005546416.localdomain", "np0005546418.localdomain"]}, "service_id": "mds", "service_name": "mds.mds", "service_type": "mds", "status": {"created": "2025-12-05T08:10:24.625636Z", "last_refresh": "2025-12-05T09:44:05.516491Z", "running": 3, "size": 3}}, {"events": ["2025-12-05T07:51:38.343306Z service:mgr [INFO] \"service was created\"", "2025-12-05T07:50:40.121650Z service:mgr [ERROR] \"Failed to apply: Cannot place on np0005546418.localdomain: Unknown hosts\""], "placement": {"hosts": ["np0005546415.localdomain", "np0005546416.localdomain", "np0005546418.localdomain"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2025-12-05T07:50:28.509240Z", "last_refresh": "2025-12-05T09:44:05.516238Z", "running": 3, "size": 3}}, {"events": ["2025-12-05T07:51:29.366270Z service:mon [INFO] \"service was created\"", "2025-12-05T07:50:40.120252Z service:mon [ERROR] \"Failed to apply: Cannot place on np0005546418.localdomain: Unknown hosts\""], "placement": {"hosts": ["np0005546415.localdomain", "np0005546416.localdomain", "np0005546418.localdomain"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2025-12-05T07:50:28.500741Z", "last_refresh": "2025-12-05T09:44:05.516023Z", "running": 3, "size": 3}}, {"events": ["2025-12-05T07:50:00.655886Z service:node-proxy [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_name": "node-proxy", "service_type": "node-proxy", "status": {"created": "2025-12-05T07:50:00.628104Z", "running": 0, "size": 0}}, {"events": ["2025-12-05T07:50:28.523967Z service:osd.default_drive_group [INFO] \"service was created\""], "placement": {"hosts": ["np0005546419.localdomain", "np0005546420.localdomain", "np0005546421.localdomain"]}, "service_id": "default_drive_group", "service_name": "osd.default_drive_group", "service_type": "osd", "spec": {"data_devices": {"paths": ["/dev/ceph_vg0/ceph_lv0", "/dev/ceph_vg1/ceph_lv1"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2025-12-05T07:50:28.517071Z", "last_refresh": "2025-12-05T09:48:15.211500Z", "running": 6, "size": 6}}]}, "changed": false} TASK [ceph_migrate : Print Service Map] **************************************** skipping: [np0005546415.localdomain] => (item={'events': ['2025-12-05T07:51:49.107597Z service:crash [INFO] "service was created"'], 'placement': {'host_pattern': '*'}, 'service_name': 'crash', 'service_type': 'crash', 'status': {'created': '2025-12-05T07:49:46.685849Z', 'last_refresh': '2025-12-05T09:44:05.516369Z', 'running': 6, 'size': 6}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"events": ["2025-12-05T07:51:49.107597Z service:crash [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2025-12-05T07:49:46.685849Z", "last_refresh": "2025-12-05T09:44:05.516369Z", "running": 6, "size": 6}}} skipping: [np0005546415.localdomain] => (item={'events': ['2025-12-05T08:10:31.506287Z service:mds.mds [INFO] "service was created"'], 'placement': {'hosts': ['np0005546415.localdomain', 'np0005546416.localdomain', 'np0005546418.localdomain']}, 'service_id': 'mds', 'service_name': 'mds.mds', 'service_type': 'mds', 'status': {'created': '2025-12-05T08:10:24.625636Z', 'last_refresh': '2025-12-05T09:44:05.516491Z', 'running': 3, 'size': 3}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"events": ["2025-12-05T08:10:31.506287Z service:mds.mds [INFO] \"service was created\""], "placement": {"hosts": ["np0005546415.localdomain", "np0005546416.localdomain", "np0005546418.localdomain"]}, "service_id": "mds", "service_name": "mds.mds", "service_type": "mds", "status": {"created": "2025-12-05T08:10:24.625636Z", "last_refresh": "2025-12-05T09:44:05.516491Z", "running": 3, "size": 3}}} skipping: [np0005546415.localdomain] => (item={'events': ['2025-12-05T07:51:38.343306Z service:mgr [INFO] "service was created"', '2025-12-05T07:50:40.121650Z service:mgr [ERROR] "Failed to apply: Cannot place on np0005546418.localdomain: Unknown hosts"'], 'placement': {'hosts': ['np0005546415.localdomain', 'np0005546416.localdomain', 'np0005546418.localdomain']}, 'service_name': 'mgr', 'service_type': 'mgr', 'status': {'created': '2025-12-05T07:50:28.509240Z', 'last_refresh': '2025-12-05T09:44:05.516238Z', 'running': 3, 'size': 3}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"events": ["2025-12-05T07:51:38.343306Z service:mgr [INFO] \"service was created\"", "2025-12-05T07:50:40.121650Z service:mgr [ERROR] \"Failed to apply: Cannot place on np0005546418.localdomain: Unknown hosts\""], "placement": {"hosts": ["np0005546415.localdomain", "np0005546416.localdomain", "np0005546418.localdomain"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2025-12-05T07:50:28.509240Z", "last_refresh": "2025-12-05T09:44:05.516238Z", "running": 3, "size": 3}}} skipping: [np0005546415.localdomain] => (item={'events': ['2025-12-05T07:51:29.366270Z service:mon [INFO] "service was created"', '2025-12-05T07:50:40.120252Z service:mon [ERROR] "Failed to apply: Cannot place on np0005546418.localdomain: Unknown hosts"'], 'placement': {'hosts': ['np0005546415.localdomain', 'np0005546416.localdomain', 'np0005546418.localdomain']}, 'service_name': 'mon', 'service_type': 'mon', 'status': {'created': '2025-12-05T07:50:28.500741Z', 'last_refresh': '2025-12-05T09:44:05.516023Z', 'running': 3, 'size': 3}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"events": ["2025-12-05T07:51:29.366270Z service:mon [INFO] \"service was created\"", "2025-12-05T07:50:40.120252Z service:mon [ERROR] \"Failed to apply: Cannot place on np0005546418.localdomain: Unknown hosts\""], "placement": {"hosts": ["np0005546415.localdomain", "np0005546416.localdomain", "np0005546418.localdomain"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2025-12-05T07:50:28.500741Z", "last_refresh": "2025-12-05T09:44:05.516023Z", "running": 3, "size": 3}}} skipping: [np0005546415.localdomain] => (item={'events': ['2025-12-05T07:50:00.655886Z service:node-proxy [INFO] "service was created"'], 'placement': {'host_pattern': '*'}, 'service_name': 'node-proxy', 'service_type': 'node-proxy', 'status': {'created': '2025-12-05T07:50:00.628104Z', 'running': 0, 'size': 0}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"events": ["2025-12-05T07:50:00.655886Z service:node-proxy [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_name": "node-proxy", "service_type": "node-proxy", "status": {"created": "2025-12-05T07:50:00.628104Z", "running": 0, "size": 0}}} skipping: [np0005546415.localdomain] => (item={'events': ['2025-12-05T07:50:28.523967Z service:osd.default_drive_group [INFO] "service was created"'], 'placement': {'hosts': ['np0005546419.localdomain', 'np0005546420.localdomain', 'np0005546421.localdomain']}, 'service_id': 'default_drive_group', 'service_name': 'osd.default_drive_group', 'service_type': 'osd', 'spec': {'data_devices': {'paths': ['/dev/ceph_vg0/ceph_lv0', '/dev/ceph_vg1/ceph_lv1']}, 'filter_logic': 'AND', 'objectstore': 'bluestore'}, 'status': {'created': '2025-12-05T07:50:28.517071Z', 'last_refresh': '2025-12-05T09:48:15.211500Z', 'running': 6, 'size': 6}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"events": ["2025-12-05T07:50:28.523967Z service:osd.default_drive_group [INFO] \"service was created\""], "placement": {"hosts": ["np0005546419.localdomain", "np0005546420.localdomain", "np0005546421.localdomain"]}, "service_id": "default_drive_group", "service_name": "osd.default_drive_group", "service_type": "osd", "spec": {"data_devices": {"paths": ["/dev/ceph_vg0/ceph_lv0", "/dev/ceph_vg1/ceph_lv1"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2025-12-05T07:50:28.517071Z", "last_refresh": "2025-12-05T09:48:15.211500Z", "running": 6, "size": 6}}} skipping: [np0005546415.localdomain] => {"msg": "All items skipped"} TASK [ceph_migrate : Dump ceph orch ls output to log file] ********************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "dump | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Get Ceph config] ****************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "config", "dump", "-f", "json"], "delta": "0:00:02.759863", "end": "2025-12-05 09:52:10.605275", "msg": "", "rc": 0, "start": "2025-12-05 09:52:07.845412", "stderr": "Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b\nInferring config /var/lib/ceph/79feddb1-4bfc-557f-83b9-0d57c9f66c1b/mon.np0005546415/config\nUsing ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4", "stderr_lines": ["Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "Inferring config /var/lib/ceph/79feddb1-4bfc-557f-83b9-0d57c9f66c1b/mon.np0005546415/config", "Using ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4"], "stdout": "\n[{\"section\":\"global\",\"name\":\"cluster_network\",\"value\":\"172.20.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"container_image\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\",\"level\":\"basic\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv4\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv6\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"public_network\",\"value\":\"172.18.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mon\",\"name\":\"auth_allow_insecure_global_id_reclaim\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_base\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_init\",\"value\":\"True\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/migration_current\",\"value\":\"7\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/use_repo_digest\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/orchestrator/orchestrator\",\"value\":\"cephadm\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005546419\",\"location_type\":\"host\",\"location_value\":\"np0005546419\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005546420\",\"location_type\":\"host\",\"location_value\":\"np0005546420\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005546421\",\"location_type\":\"host\",\"location_value\":\"np0005546421\"},{\"section\":\"osd\",\"name\":\"osd_memory_target_autotune\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mds.mds\",\"name\":\"mds_join_fs\",\"value\":\"mds\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"\"}]", "stdout_lines": ["", "[{\"section\":\"global\",\"name\":\"cluster_network\",\"value\":\"172.20.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"container_image\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\",\"level\":\"basic\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv4\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv6\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"public_network\",\"value\":\"172.18.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mon\",\"name\":\"auth_allow_insecure_global_id_reclaim\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_base\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_init\",\"value\":\"True\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/migration_current\",\"value\":\"7\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/use_repo_digest\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/orchestrator/orchestrator\",\"value\":\"cephadm\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005546419\",\"location_type\":\"host\",\"location_value\":\"np0005546419\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005546420\",\"location_type\":\"host\",\"location_value\":\"np0005546420\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005546421\",\"location_type\":\"host\",\"location_value\":\"np0005546421\"},{\"section\":\"osd\",\"name\":\"osd_memory_target_autotune\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mds.mds\",\"name\":\"mds_join_fs\",\"value\":\"mds\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"\"}]"]} TASK [ceph_migrate : Print Ceph config dump] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Dump ceph config dump output to log file] ***************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "dump | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Get Ceph Orch Host Map] *********************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "orch", "host", "ls", "-f", "json"], "delta": "0:00:02.275124", "end": "2025-12-05 09:52:13.535455", "msg": "", "rc": 0, "start": "2025-12-05 09:52:11.260331", "stderr": "Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b\nInferring config /var/lib/ceph/79feddb1-4bfc-557f-83b9-0d57c9f66c1b/mon.np0005546415/config\nUsing ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4", "stderr_lines": ["Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "Inferring config /var/lib/ceph/79feddb1-4bfc-557f-83b9-0d57c9f66c1b/mon.np0005546415/config", "Using ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4"], "stdout": "\n[{\"addr\": \"192.168.122.103\", \"hostname\": \"np0005546415.localdomain\", \"labels\": [\"_admin\", \"mon\", \"mgr\"], \"status\": \"\"}, {\"addr\": \"192.168.122.104\", \"hostname\": \"np0005546416.localdomain\", \"labels\": [\"mon\", \"mgr\", \"_admin\"], \"status\": \"\"}, {\"addr\": \"192.168.122.105\", \"hostname\": \"np0005546418.localdomain\", \"labels\": [\"mon\", \"mgr\", \"_admin\"], \"status\": \"\"}, {\"addr\": \"192.168.122.106\", \"hostname\": \"np0005546419.localdomain\", \"labels\": [\"osd\"], \"status\": \"\"}, {\"addr\": \"192.168.122.107\", \"hostname\": \"np0005546420.localdomain\", \"labels\": [\"osd\"], \"status\": \"\"}, {\"addr\": \"192.168.122.108\", \"hostname\": \"np0005546421.localdomain\", \"labels\": [\"osd\"], \"status\": \"\"}]", "stdout_lines": ["", "[{\"addr\": \"192.168.122.103\", \"hostname\": \"np0005546415.localdomain\", \"labels\": [\"_admin\", \"mon\", \"mgr\"], \"status\": \"\"}, {\"addr\": \"192.168.122.104\", \"hostname\": \"np0005546416.localdomain\", \"labels\": [\"mon\", \"mgr\", \"_admin\"], \"status\": \"\"}, {\"addr\": \"192.168.122.105\", \"hostname\": \"np0005546418.localdomain\", \"labels\": [\"mon\", \"mgr\", \"_admin\"], \"status\": \"\"}, {\"addr\": \"192.168.122.106\", \"hostname\": \"np0005546419.localdomain\", \"labels\": [\"osd\"], \"status\": \"\"}, {\"addr\": \"192.168.122.107\", \"hostname\": \"np0005546420.localdomain\", \"labels\": [\"osd\"], \"status\": \"\"}, {\"addr\": \"192.168.122.108\", \"hostname\": \"np0005546421.localdomain\", \"labels\": [\"osd\"], \"status\": \"\"}]"]} TASK [ceph_migrate : Load nodes] *********************************************** ok: [np0005546415.localdomain] => {"ansible_facts": {"nds": [{"addr": "192.168.122.103", "hostname": "np0005546415.localdomain", "labels": ["_admin", "mon", "mgr"], "status": ""}, {"addr": "192.168.122.104", "hostname": "np0005546416.localdomain", "labels": ["mon", "mgr", "_admin"], "status": ""}, {"addr": "192.168.122.105", "hostname": "np0005546418.localdomain", "labels": ["mon", "mgr", "_admin"], "status": ""}, {"addr": "192.168.122.106", "hostname": "np0005546419.localdomain", "labels": ["osd"], "status": ""}, {"addr": "192.168.122.107", "hostname": "np0005546420.localdomain", "labels": ["osd"], "status": ""}, {"addr": "192.168.122.108", "hostname": "np0005546421.localdomain", "labels": ["osd"], "status": ""}]}, "changed": false} TASK [ceph_migrate : Load hostmap List] **************************************** ok: [np0005546415.localdomain] => {"ansible_facts": {"hostmap": {"np0005546415.localdomain": ["_admin", "mon", "mgr"], "np0005546416.localdomain": ["mon", "mgr", "_admin"], "np0005546418.localdomain": ["mon", "mgr", "_admin"], "np0005546419.localdomain": ["osd"], "np0005546420.localdomain": ["osd"], "np0005546421.localdomain": ["osd"]}}, "changed": false} TASK [ceph_migrate : Print Host Map] ******************************************* skipping: [np0005546415.localdomain] => (item=np0005546415.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005546415.localdomain"} skipping: [np0005546415.localdomain] => (item=np0005546416.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005546416.localdomain"} skipping: [np0005546415.localdomain] => (item=np0005546418.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005546418.localdomain"} skipping: [np0005546415.localdomain] => (item=np0005546419.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005546419.localdomain"} skipping: [np0005546415.localdomain] => (item=np0005546420.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005546420.localdomain"} skipping: [np0005546415.localdomain] => (item=np0005546421.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005546421.localdomain"} skipping: [np0005546415.localdomain] => {"msg": "All items skipped"} TASK [ceph_migrate : Dump ceph orch host ls output to log file] **************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "dump | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Get Ceph monmap and load data] **************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "mon", "dump", "-f", "json"], "delta": "0:00:02.775157", "end": "2025-12-05 09:52:17.005708", "msg": "", "rc": 0, "start": "2025-12-05 09:52:14.230551", "stderr": "Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b\nInferring config /var/lib/ceph/79feddb1-4bfc-557f-83b9-0d57c9f66c1b/mon.np0005546415/config\nUsing ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\ndumped monmap epoch 3", "stderr_lines": ["Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "Inferring config /var/lib/ceph/79feddb1-4bfc-557f-83b9-0d57c9f66c1b/mon.np0005546415/config", "Using ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4", "dumped monmap epoch 3"], "stdout": "\n{\"epoch\":3,\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"modified\":\"2025-12-05T07:51:30.832916Z\",\"created\":\"2025-12-05T07:49:07.934655Z\",\"min_mon_release\":18,\"min_mon_release_name\":\"reef\",\"election_strategy\":1,\"disallowed_leaders: \":\"\",\"stretch_mode\":false,\"tiebreaker_mon\":\"\",\"removed_ranks: \":\"\",\"features\":{\"persistent\":[\"kraken\",\"luminous\",\"mimic\",\"osdmap-prune\",\"nautilus\",\"octopus\",\"pacific\",\"elector-pinging\",\"quincy\",\"reef\"],\"optional\":[]},\"mons\":[{\"rank\":0,\"name\":\"np0005546415\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.103:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.103:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.103:6789/0\",\"public_addr\":\"172.18.0.103:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":1,\"name\":\"np0005546418\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.105:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.105:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.105:6789/0\",\"public_addr\":\"172.18.0.105:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":2,\"name\":\"np0005546416\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.104:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.104:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.104:6789/0\",\"public_addr\":\"172.18.0.104:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"}],\"quorum\":[0,1,2]}", "stdout_lines": ["", "{\"epoch\":3,\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"modified\":\"2025-12-05T07:51:30.832916Z\",\"created\":\"2025-12-05T07:49:07.934655Z\",\"min_mon_release\":18,\"min_mon_release_name\":\"reef\",\"election_strategy\":1,\"disallowed_leaders: \":\"\",\"stretch_mode\":false,\"tiebreaker_mon\":\"\",\"removed_ranks: \":\"\",\"features\":{\"persistent\":[\"kraken\",\"luminous\",\"mimic\",\"osdmap-prune\",\"nautilus\",\"octopus\",\"pacific\",\"elector-pinging\",\"quincy\",\"reef\"],\"optional\":[]},\"mons\":[{\"rank\":0,\"name\":\"np0005546415\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.103:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.103:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.103:6789/0\",\"public_addr\":\"172.18.0.103:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":1,\"name\":\"np0005546418\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.105:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.105:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.105:6789/0\",\"public_addr\":\"172.18.0.105:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":2,\"name\":\"np0005546416\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.104:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.104:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.104:6789/0\",\"public_addr\":\"172.18.0.104:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"}],\"quorum\":[0,1,2]}"]} TASK [ceph_migrate : Get Monmap] *********************************************** ok: [np0005546415.localdomain] => {"ansible_facts": {"mon_dump": {"created": "2025-12-05T07:49:07.934655Z", "disallowed_leaders: ": "", "election_strategy": 1, "epoch": 3, "features": {"optional": [], "persistent": ["kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef"]}, "fsid": "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "min_mon_release": 18, "min_mon_release_name": "reef", "modified": "2025-12-05T07:51:30.832916Z", "mons": [{"addr": "172.18.0.103:6789/0", "crush_location": "{}", "name": "np0005546415", "priority": 0, "public_addr": "172.18.0.103:6789/0", "public_addrs": {"addrvec": [{"addr": "172.18.0.103:3300", "nonce": 0, "type": "v2"}, {"addr": "172.18.0.103:6789", "nonce": 0, "type": "v1"}]}, "rank": 0, "weight": 0}, {"addr": "172.18.0.105:6789/0", "crush_location": "{}", "name": "np0005546418", "priority": 0, "public_addr": "172.18.0.105:6789/0", "public_addrs": {"addrvec": [{"addr": "172.18.0.105:3300", "nonce": 0, "type": "v2"}, {"addr": "172.18.0.105:6789", "nonce": 0, "type": "v1"}]}, "rank": 1, "weight": 0}, {"addr": "172.18.0.104:6789/0", "crush_location": "{}", "name": "np0005546416", "priority": 0, "public_addr": "172.18.0.104:6789/0", "public_addrs": {"addrvec": [{"addr": "172.18.0.104:3300", "nonce": 0, "type": "v2"}, {"addr": "172.18.0.104:6789", "nonce": 0, "type": "v1"}]}, "rank": 2, "weight": 0}], "quorum": [0, 1, 2], "removed_ranks: ": "", "stretch_mode": false, "tiebreaker_mon": ""}}, "changed": false} TASK [ceph_migrate : Print monmap] ********************************************* skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Dump ceph mon dump output to log file] ******************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "dump | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Load nodes to decommission] ******************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"decomm_nodes": ["np0005546415.localdomain", "np0005546416.localdomain", "np0005546418.localdomain"]}, "changed": false} TASK [ceph_migrate : Load target nodes] **************************************** ok: [np0005546415.localdomain] => {"ansible_facts": {"target_nodes": ["np0005546419.localdomain", "np0005546420.localdomain", "np0005546421.localdomain"]}, "changed": false} TASK [ceph_migrate : Print target nodes] *************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug|default(false)"} TASK [ceph_migrate : Print decomm_nodes] *************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug|default(false)"} TASK [ceph_migrate : ansible.builtin.fail if input is not provided] ************ skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph is undefined or ceph | length == 0", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Get cluster health] *************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : ansible.builtin.fail if health is HEALTH_WARN || HEALTH_ERR] *** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph.health.status == 'HEALTH_WARN' or ceph.health.status == 'HEALTH_ERR'", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : PgMap] **************************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : ansible.builtin.fail if PGs are not in active+clean state] *** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "pgstate != 'active+clean'", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : OSDMap] *************************************************** ok: [np0005546415.localdomain] => { "msg": "100.0" } TASK [ceph_migrate : ansible.builtin.fail if there is an unacceptable OSDs number] *** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "pct | float < 100", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MonMap] *************************************************** skipping: [np0005546415.localdomain] => {"false_condition": "check_ceph_release | default(false) | bool"} TASK [ceph_migrate : ansible.builtin.fail if Ceph <= Quincy] ******************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "check_ceph_release | default(false) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Mons in quorum] ******************************************* skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : ansible.builtin.fail if Mons are not in quorum] *********** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph.monmap.num_mons < decomm_nodes | length", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : is Ceph Mgr available] ************************************ skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : ansible.builtin.fail if Mgr is not available] ************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "not ceph.mgrmap.available | bool | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : in progress events] *************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : ansible.builtin.fail if there are in progress events] ***** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph.progress_events | length > 0", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Dump Ceph Status] ***************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005546415.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /etc/ceph:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : set container image base in ceph configuration] *********** ok: [np0005546415.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "config", "set", "mgr", "mgr/cephadm/container_image_base", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest"], "delta": "0:00:00.708610", "end": "2025-12-05 09:52:19.435711", "msg": "", "rc": 0, "start": "2025-12-05 09:52:18.727101", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : set alertmanager container image in ceph configuration] *** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : set grafana container image in ceph configuration] ******** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : set node-exporter container image in ceph configuration] *** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : set prometheus container image in ceph configuration] ***** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Set haproxy container image in ceph configuration] ******** ok: [np0005546415.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "config", "set", "mgr", "mgr/cephadm/container_image_haproxy", "registry.redhat.io/rhceph/rhceph-haproxy-rhel9:latest"], "delta": "0:00:00.722386", "end": "2025-12-05 09:52:20.824918", "msg": "", "rc": 0, "start": "2025-12-05 09:52:20.102532", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Set keepalived container image in ceph configuration] ***** ok: [np0005546415.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "config", "set", "mgr", "mgr/cephadm/container_image_keepalived", "registry.redhat.io/rhceph/keepalived-rhel9:latest"], "delta": "0:00:00.762836", "end": "2025-12-05 09:52:22.139914", "msg": "", "rc": 0, "start": "2025-12-05 09:52:21.377078", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Update firewall rules on the target nodes] **************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/firewall.yaml for np0005546415.localdomain => (item=np0005546419.localdomain) included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/firewall.yaml for np0005546415.localdomain => (item=np0005546420.localdomain) included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/firewall.yaml for np0005546415.localdomain => (item=np0005546421.localdomain) TASK [ceph_migrate : Ceph Migration - Apply the Ceph cluster rules (iptables)] *** skipping: [np0005546415.localdomain] => (item=/etc/sysconfig/iptables) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "item": "/etc/sysconfig/iptables", "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => (item=/etc/sysconfig/ip6tables) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "item": "/etc/sysconfig/ip6tables", "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => {"changed": false, "msg": "All items skipped"} TASK [ceph_migrate : Ensure firewall is enabled/started - iptables] ************ skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Ceph Migration - Apply the Ceph cluster rules (nftables)] *** changed: [np0005546415.localdomain -> np0005546419.localdomain(192.168.122.106)] => {"changed": true, "msg": "Block inserted and ownership, perms or SE linux context changed"} TASK [ceph_migrate : Ensure firewall is enabled/started - nftables] ************ changed: [np0005546415.localdomain -> np0005546419.localdomain(192.168.122.106)] => {"changed": true, "enabled": true, "name": "nftables", "state": "started", "status": {"AccessSELinuxContext": "system_u:object_r:systemd_unit_file_t:s0", "ActiveEnterTimestamp": "Fri 2025-12-05 08:00:54 UTC", "ActiveEnterTimestampMonotonic": "4769297750", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target system.slice basic.target systemd-journald.socket", "AllowIsolate": "no", "AssertResult": "yes", "AssertTimestamp": "Fri 2025-12-05 08:00:54 UTC", "AssertTimestampMonotonic": "4769214395", "Before": "shutdown.target multi-user.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "yes", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "30520000", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read cap_perfmon cap_bpf cap_checkpoint_restore", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2025-12-05 08:00:54 UTC", "ConditionTimestampMonotonic": "4769214394", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroupId": "0", "ControlPID": "0", "CoredumpFilter": "0x33", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Netfilter Tables", "DevicePolicy": "auto", "Documentation": "\"man:nft(8)\"", "DynamicUser": "no", "ExecMainCode": "1", "ExecMainExitTimestamp": "Fri 2025-12-05 08:00:54 UTC", "ExecMainExitTimestampMonotonic": "4769297407", "ExecMainPID": "41798", "ExecMainStartTimestamp": "Fri 2025-12-05 08:00:54 UTC", "ExecMainStartTimestampMonotonic": "4769215911", "ExecMainStatus": "0", "ExecReload": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset; include \"/etc/sysconfig/nftables.conf\"; ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset; include \"/etc/sysconfig/nftables.conf\"; ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/sbin/nft ; argv[]=/sbin/nft -f /etc/sysconfig/nftables.conf ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/sbin/nft ; argv[]=/sbin/nft -f /etc/sysconfig/nftables.conf ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExitType": "main", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/usr/lib/systemd/system/nftables.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "yes", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "2", "IOSchedulingPriority": "4", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nftables.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2025-12-05 08:00:54 UTC", "InactiveExitTimestampMonotonic": "4769216097", "InvocationID": "76f103e2a2924de9b197ee4ab5f92e79", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "8388608", "LimitMEMLOCKSoft": "8388608", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "62638", "LimitNPROCSoft": "62638", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "62638", "LimitSIGPENDINGSoft": "62638", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "ManagedOOMMemoryPressure": "auto", "ManagedOOMMemoryPressureLimit": "0", "ManagedOOMPreference": "none", "ManagedOOMSwap": "auto", "MemoryAccounting": "yes", "MemoryAvailable": "infinity", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAPolicy": "n/a", "Names": "nftables.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "OnSuccessJobMode": "fail", "Perpetual": "no", "PrivateDevices": "no", "PrivateIPC": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProcSubset": "all", "ProtectClock": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectProc": "default", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "yes", "RemoveIPC": "no", "Requires": "system.slice sysinit.target", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "RuntimeRandomizedExtraUSec": "0", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2025-12-05 08:00:54 UTC", "StateChangeTimestampMonotonic": "4769297750", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "exited", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "2147483646", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "100220", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartFailureMode": "terminate", "TimeoutStartUSec": "infinity", "TimeoutStopFailureMode": "terminate", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "oneshot", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-pre.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [ceph_migrate : Ceph Migration - Apply the Ceph cluster rules (iptables)] *** skipping: [np0005546415.localdomain] => (item=/etc/sysconfig/iptables) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "item": "/etc/sysconfig/iptables", "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => (item=/etc/sysconfig/ip6tables) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "item": "/etc/sysconfig/ip6tables", "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => {"changed": false, "msg": "All items skipped"} TASK [ceph_migrate : Ensure firewall is enabled/started - iptables] ************ skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Ceph Migration - Apply the Ceph cluster rules (nftables)] *** changed: [np0005546415.localdomain -> np0005546420.localdomain(192.168.122.107)] => {"changed": true, "msg": "Block inserted and ownership, perms or SE linux context changed"} TASK [ceph_migrate : Ensure firewall is enabled/started - nftables] ************ changed: [np0005546415.localdomain -> np0005546420.localdomain(192.168.122.107)] => {"changed": true, "enabled": true, "name": "nftables", "state": "started", "status": {"AccessSELinuxContext": "system_u:object_r:systemd_unit_file_t:s0", "ActiveEnterTimestamp": "Fri 2025-12-05 08:00:54 UTC", "ActiveEnterTimestampMonotonic": "4772721902", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target systemd-journald.socket basic.target system.slice", "AllowIsolate": "no", "AssertResult": "yes", "AssertTimestamp": "Fri 2025-12-05 08:00:54 UTC", "AssertTimestampMonotonic": "4772639927", "Before": "shutdown.target network-pre.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "yes", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "20623000", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read cap_perfmon cap_bpf cap_checkpoint_restore", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2025-12-05 08:00:54 UTC", "ConditionTimestampMonotonic": "4772639926", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroupId": "0", "ControlPID": "0", "CoredumpFilter": "0x33", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Netfilter Tables", "DevicePolicy": "auto", "Documentation": "\"man:nft(8)\"", "DynamicUser": "no", "ExecMainCode": "1", "ExecMainExitTimestamp": "Fri 2025-12-05 08:00:54 UTC", "ExecMainExitTimestampMonotonic": "4772721598", "ExecMainPID": "42851", "ExecMainStartTimestamp": "Fri 2025-12-05 08:00:54 UTC", "ExecMainStartTimestampMonotonic": "4772650263", "ExecMainStatus": "0", "ExecReload": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset; include \"/etc/sysconfig/nftables.conf\"; ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset; include \"/etc/sysconfig/nftables.conf\"; ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/sbin/nft ; argv[]=/sbin/nft -f /etc/sysconfig/nftables.conf ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/sbin/nft ; argv[]=/sbin/nft -f /etc/sysconfig/nftables.conf ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExitType": "main", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/usr/lib/systemd/system/nftables.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "yes", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "2", "IOSchedulingPriority": "4", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nftables.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2025-12-05 08:00:54 UTC", "InactiveExitTimestampMonotonic": "4772650484", "InvocationID": "968b2afbce484282af1214a24e32a5fe", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "8388608", "LimitMEMLOCKSoft": "8388608", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "62638", "LimitNPROCSoft": "62638", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "62638", "LimitSIGPENDINGSoft": "62638", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "ManagedOOMMemoryPressure": "auto", "ManagedOOMMemoryPressureLimit": "0", "ManagedOOMPreference": "none", "ManagedOOMSwap": "auto", "MemoryAccounting": "yes", "MemoryAvailable": "infinity", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAPolicy": "n/a", "Names": "nftables.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "OnSuccessJobMode": "fail", "Perpetual": "no", "PrivateDevices": "no", "PrivateIPC": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProcSubset": "all", "ProtectClock": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectProc": "default", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "yes", "RemoveIPC": "no", "Requires": "sysinit.target system.slice", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "RuntimeRandomizedExtraUSec": "0", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2025-12-05 08:00:54 UTC", "StateChangeTimestampMonotonic": "4772721902", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "exited", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "2147483646", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "100220", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartFailureMode": "terminate", "TimeoutStartUSec": "infinity", "TimeoutStopFailureMode": "terminate", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "oneshot", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-pre.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [ceph_migrate : Ceph Migration - Apply the Ceph cluster rules (iptables)] *** skipping: [np0005546415.localdomain] => (item=/etc/sysconfig/iptables) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "item": "/etc/sysconfig/iptables", "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => (item=/etc/sysconfig/ip6tables) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "item": "/etc/sysconfig/ip6tables", "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => {"changed": false, "msg": "All items skipped"} TASK [ceph_migrate : Ensure firewall is enabled/started - iptables] ************ skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Ceph Migration - Apply the Ceph cluster rules (nftables)] *** changed: [np0005546415.localdomain -> np0005546421.localdomain(192.168.122.108)] => {"changed": true, "msg": "Block inserted and ownership, perms or SE linux context changed"} TASK [ceph_migrate : Ensure firewall is enabled/started - nftables] ************ changed: [np0005546415.localdomain -> np0005546421.localdomain(192.168.122.108)] => {"changed": true, "enabled": true, "name": "nftables", "state": "started", "status": {"AccessSELinuxContext": "system_u:object_r:systemd_unit_file_t:s0", "ActiveEnterTimestamp": "Fri 2025-12-05 08:00:55 UTC", "ActiveEnterTimestampMonotonic": "4495959112", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target system.slice sysinit.target systemd-journald.socket", "AllowIsolate": "no", "AssertResult": "yes", "AssertTimestamp": "Fri 2025-12-05 08:00:55 UTC", "AssertTimestampMonotonic": "4495859878", "Before": "network-pre.target multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "yes", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "36204000", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read cap_perfmon cap_bpf cap_checkpoint_restore", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2025-12-05 08:00:55 UTC", "ConditionTimestampMonotonic": "4495859875", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroupId": "0", "ControlPID": "0", "CoredumpFilter": "0x33", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Netfilter Tables", "DevicePolicy": "auto", "Documentation": "\"man:nft(8)\"", "DynamicUser": "no", "ExecMainCode": "1", "ExecMainExitTimestamp": "Fri 2025-12-05 08:00:55 UTC", "ExecMainExitTimestampMonotonic": "4495958915", "ExecMainPID": "42197", "ExecMainStartTimestamp": "Fri 2025-12-05 08:00:55 UTC", "ExecMainStartTimestampMonotonic": "4495861634", "ExecMainStatus": "0", "ExecReload": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset; include \"/etc/sysconfig/nftables.conf\"; ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset; include \"/etc/sysconfig/nftables.conf\"; ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/sbin/nft ; argv[]=/sbin/nft -f /etc/sysconfig/nftables.conf ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/sbin/nft ; argv[]=/sbin/nft -f /etc/sysconfig/nftables.conf ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExitType": "main", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/usr/lib/systemd/system/nftables.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "yes", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "2", "IOSchedulingPriority": "4", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nftables.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2025-12-05 08:00:55 UTC", "InactiveExitTimestampMonotonic": "4495861835", "InvocationID": "811ed0c8543b42b3ba22b717c3dc5656", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "8388608", "LimitMEMLOCKSoft": "8388608", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "62638", "LimitNPROCSoft": "62638", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "62638", "LimitSIGPENDINGSoft": "62638", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "ManagedOOMMemoryPressure": "auto", "ManagedOOMMemoryPressureLimit": "0", "ManagedOOMPreference": "none", "ManagedOOMSwap": "auto", "MemoryAccounting": "yes", "MemoryAvailable": "infinity", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAPolicy": "n/a", "Names": "nftables.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "OnSuccessJobMode": "fail", "Perpetual": "no", "PrivateDevices": "no", "PrivateIPC": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProcSubset": "all", "ProtectClock": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectProc": "default", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "yes", "RemoveIPC": "no", "Requires": "sysinit.target system.slice", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "RuntimeRandomizedExtraUSec": "0", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2025-12-05 08:00:55 UTC", "StateChangeTimestampMonotonic": "4495959112", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "exited", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "2147483646", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "100220", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartFailureMode": "terminate", "TimeoutStartUSec": "infinity", "TimeoutStopFailureMode": "terminate", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "oneshot", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-pre.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [ceph_migrate : Get ceph_cli] ********************************************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Set the dashboard port] *********************************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Set the dashboard ssl port] ******************************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Disable mgr dashboard module (restart)] ******************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Enable mgr dashboard module (restart)] ******************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Set the prometheus server port] *************************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Set the prometheus server address] ************************ skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Enable prometheus module] ********************************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "ceph_daemons_layout.monitoring | default(true) | bool"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005546415.localdomain] => {"false_condition": "ceph_daemons_layout.monitoring | default(true) | bool"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** skipping: [np0005546415.localdomain] => (item=['np0005546419.localdomain', 'monitoring']) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "item": ["np0005546419.localdomain", "monitoring"], "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => (item=['np0005546420.localdomain', 'monitoring']) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "item": ["np0005546420.localdomain", "monitoring"], "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => (item=['np0005546421.localdomain', 'monitoring']) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "item": ["np0005546421.localdomain", "monitoring"], "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => {"changed": false, "msg": "All items skipped"} TASK [ceph_migrate : MONITORING - Load Spec from the orchestrator] ************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Print the loaded data] ************************************ skipping: [np0005546415.localdomain] => {"false_condition": "ceph_daemons_layout.monitoring | default(true) | bool"} TASK [ceph_migrate : Update the Monitoring Stack spec definition] ************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005546415.localdomain] => {"false_condition": "ceph_daemons_layout.monitoring | default(true) | bool"} TASK [ceph_migrate : MONITORING - wait daemons] ******************************** skipping: [np0005546415.localdomain] => (item=grafana) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "item": "grafana", "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => (item=prometheus) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "item": "prometheus", "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => (item=alertmanager) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "item": "alertmanager", "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => {"changed": false, "msg": "All items skipped"} TASK [ceph_migrate : Sleep before moving to the next daemon] ******************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005546415.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /etc/ceph:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : MDS - Load Spec from the orchestrator] ******************** ok: [np0005546415.localdomain] => {"ansible_facts": {"mds_spec": {"service_name": "mds.mds", "service_type": "mds", "spec": {}}}, "changed": false} TASK [ceph_migrate : Print the resulting MDS spec] ***************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** changed: [np0005546415.localdomain] => (item=['np0005546415.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546415.localdomain", "mds"], "delta": "0:00:00.731662", "end": "2025-12-05 09:52:32.788672", "item": ["np0005546415.localdomain", "mds"], "msg": "", "rc": 0, "start": "2025-12-05 09:52:32.057010", "stderr": "", "stderr_lines": [], "stdout": "Added label mds to host np0005546415.localdomain", "stdout_lines": ["Added label mds to host np0005546415.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546416.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546416.localdomain", "mds"], "delta": "0:00:00.889584", "end": "2025-12-05 09:52:35.378951", "item": ["np0005546416.localdomain", "mds"], "msg": "", "rc": 0, "start": "2025-12-05 09:52:34.489367", "stderr": "", "stderr_lines": [], "stdout": "Added label mds to host np0005546416.localdomain", "stdout_lines": ["Added label mds to host np0005546416.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546418.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546418.localdomain", "mds"], "delta": "0:00:00.715303", "end": "2025-12-05 09:52:36.660117", "item": ["np0005546418.localdomain", "mds"], "msg": "", "rc": 0, "start": "2025-12-05 09:52:35.944814", "stderr": "", "stderr_lines": [], "stdout": "Added label mds to host np0005546418.localdomain", "stdout_lines": ["Added label mds to host np0005546418.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546419.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546419.localdomain", "mds"], "delta": "0:00:00.766266", "end": "2025-12-05 09:52:37.933609", "item": ["np0005546419.localdomain", "mds"], "msg": "", "rc": 0, "start": "2025-12-05 09:52:37.167343", "stderr": "", "stderr_lines": [], "stdout": "Added label mds to host np0005546419.localdomain", "stdout_lines": ["Added label mds to host np0005546419.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546420.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546420.localdomain", "mds"], "delta": "0:00:00.732840", "end": "2025-12-05 09:52:39.215373", "item": ["np0005546420.localdomain", "mds"], "msg": "", "rc": 0, "start": "2025-12-05 09:52:38.482533", "stderr": "", "stderr_lines": [], "stdout": "Added label mds to host np0005546420.localdomain", "stdout_lines": ["Added label mds to host np0005546420.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546421.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546421.localdomain", "mds"], "delta": "0:00:00.742822", "end": "2025-12-05 09:52:40.504815", "item": ["np0005546421.localdomain", "mds"], "msg": "", "rc": 0, "start": "2025-12-05 09:52:39.761993", "stderr": "", "stderr_lines": [], "stdout": "Added label mds to host np0005546421.localdomain", "stdout_lines": ["Added label mds to host np0005546421.localdomain"]} TASK [ceph_migrate : Update the MDS Daemon spec definition] ******************** ok: [np0005546415.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/etc/ceph:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mds:/home/tripleo-admin/mds:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mds"], "delta": "0:00:00.701115", "end": "2025-12-05 09:52:41.917937", "rc": 0, "start": "2025-12-05 09:52:41.216822", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mds.mds update...", "stdout_lines": ["Scheduled mds.mds update..."]} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Wait for the orchestrator to process the spec] ************ Pausing for 30 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 30, "echo": true, "rc": 0, "start": "2025-12-05 09:52:42.070997", "stderr": "", "stdout": "Paused for 30.03 seconds", "stop": "2025-12-05 09:53:12.103240", "user_input": ""} TASK [ceph_migrate : Reload the updated mdsmap] ******************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "fs", "status", "cephfs", "-f", "json"], "delta": "0:00:00.711148", "end": "2025-12-05 09:53:13.348285", "msg": "", "rc": 0, "start": "2025-12-05 09:53:12.637137", "stderr": "", "stderr_lines": [], "stdout": "\n{\"clients\": [{\"clients\": 0, \"fs\": \"cephfs\"}], \"mds_version\": [{\"daemon\": [\"mds.np0005546418.rcuuff\", \"mds.np0005546415.aphosd\", \"mds.np0005546419.rweotn\", \"mds.np0005546416.lkuhij\", \"mds.np0005546421.tuudjq\", \"mds.np0005546420.eqhasr\"], \"version\": \"ceph version 18.2.1-361.el9cp (439dcd6094d413840eb2ec590fe2194ec616687f) reef (stable)\"}], \"mdsmap\": [{\"caps\": 0, \"dirs\": 12, \"dns\": 10, \"inos\": 13, \"name\": \"mds.np0005546418.rcuuff\", \"rank\": 0, \"rate\": 0, \"state\": \"active\"}, {\"name\": \"mds.np0005546415.aphosd\", \"state\": \"standby\"}, {\"name\": \"mds.np0005546419.rweotn\", \"state\": \"standby\"}, {\"name\": \"mds.np0005546416.lkuhij\", \"state\": \"standby\"}, {\"name\": \"mds.np0005546421.tuudjq\", \"state\": \"standby\"}, {\"name\": \"mds.np0005546420.eqhasr\", \"state\": \"standby\"}], \"pools\": [{\"avail\": 14032745472, \"id\": 7, \"name\": \"manila_metadata\", \"type\": \"metadata\", \"used\": 98304}, {\"avail\": 14032745472, \"id\": 6, \"name\": \"manila_data\", \"type\": \"data\", \"used\": 0}]}", "stdout_lines": ["", "{\"clients\": [{\"clients\": 0, \"fs\": \"cephfs\"}], \"mds_version\": [{\"daemon\": [\"mds.np0005546418.rcuuff\", \"mds.np0005546415.aphosd\", \"mds.np0005546419.rweotn\", \"mds.np0005546416.lkuhij\", \"mds.np0005546421.tuudjq\", \"mds.np0005546420.eqhasr\"], \"version\": \"ceph version 18.2.1-361.el9cp (439dcd6094d413840eb2ec590fe2194ec616687f) reef (stable)\"}], \"mdsmap\": [{\"caps\": 0, \"dirs\": 12, \"dns\": 10, \"inos\": 13, \"name\": \"mds.np0005546418.rcuuff\", \"rank\": 0, \"rate\": 0, \"state\": \"active\"}, {\"name\": \"mds.np0005546415.aphosd\", \"state\": \"standby\"}, {\"name\": \"mds.np0005546419.rweotn\", \"state\": \"standby\"}, {\"name\": \"mds.np0005546416.lkuhij\", \"state\": \"standby\"}, {\"name\": \"mds.np0005546421.tuudjq\", \"state\": \"standby\"}, {\"name\": \"mds.np0005546420.eqhasr\", \"state\": \"standby\"}], \"pools\": [{\"avail\": 14032745472, \"id\": 7, \"name\": \"manila_metadata\", \"type\": \"metadata\", \"used\": 98304}, {\"avail\": 14032745472, \"id\": 6, \"name\": \"manila_data\", \"type\": \"data\", \"used\": 0}]}"]} TASK [ceph_migrate : Get MDS Daemons] ****************************************** ok: [np0005546415.localdomain] => {"ansible_facts": {"mds_daemons": {"clients": [{"clients": 0, "fs": "cephfs"}], "mds_version": [{"daemon": ["mds.np0005546418.rcuuff", "mds.np0005546415.aphosd", "mds.np0005546419.rweotn", "mds.np0005546416.lkuhij", "mds.np0005546421.tuudjq", "mds.np0005546420.eqhasr"], "version": "ceph version 18.2.1-361.el9cp (439dcd6094d413840eb2ec590fe2194ec616687f) reef (stable)"}], "mdsmap": [{"caps": 0, "dirs": 12, "dns": 10, "inos": 13, "name": "mds.np0005546418.rcuuff", "rank": 0, "rate": 0, "state": "active"}, {"name": "mds.np0005546415.aphosd", "state": "standby"}, {"name": "mds.np0005546419.rweotn", "state": "standby"}, {"name": "mds.np0005546416.lkuhij", "state": "standby"}, {"name": "mds.np0005546421.tuudjq", "state": "standby"}, {"name": "mds.np0005546420.eqhasr", "state": "standby"}], "pools": [{"avail": 14032745472, "id": 7, "name": "manila_metadata", "type": "metadata", "used": 98304}, {"avail": 14032745472, "id": 6, "name": "manila_data", "type": "data", "used": 0}]}}, "changed": false} TASK [ceph_migrate : Print Daemons] ******************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Get MDS daemons that are not part of decomm nodes] ******** skipping: [np0005546415.localdomain] => (item={'caps': 0, 'dirs': 12, 'dns': 10, 'inos': 13, 'name': 'mds.np0005546418.rcuuff', 'rank': 0, 'rate': 0, 'state': 'active'}) => {"ansible_loop_var": "item", "changed": false, "false_condition": "item.state == \"standby\"", "item": {"caps": 0, "dirs": 12, "dns": 10, "inos": 13, "name": "mds.np0005546418.rcuuff", "rank": 0, "rate": 0, "state": "active"}, "skip_reason": "Conditional result was False"} ok: [np0005546415.localdomain] => (item={'name': 'mds.np0005546415.aphosd', 'state': 'standby'}) => {"ansible_facts": {"mds_aff_daemon": {"name": "mds.np0005546415.aphosd", "state": "standby"}}, "ansible_loop_var": "item", "changed": false, "item": {"name": "mds.np0005546415.aphosd", "state": "standby"}} ok: [np0005546415.localdomain] => (item={'name': 'mds.np0005546419.rweotn', 'state': 'standby'}) => {"ansible_facts": {"mds_aff_daemon": {"name": "mds.np0005546419.rweotn", "state": "standby"}}, "ansible_loop_var": "item", "changed": false, "item": {"name": "mds.np0005546419.rweotn", "state": "standby"}} ok: [np0005546415.localdomain] => (item={'name': 'mds.np0005546416.lkuhij', 'state': 'standby'}) => {"ansible_facts": {"mds_aff_daemon": {"name": "mds.np0005546416.lkuhij", "state": "standby"}}, "ansible_loop_var": "item", "changed": false, "item": {"name": "mds.np0005546416.lkuhij", "state": "standby"}} ok: [np0005546415.localdomain] => (item={'name': 'mds.np0005546421.tuudjq', 'state': 'standby'}) => {"ansible_facts": {"mds_aff_daemon": {"name": "mds.np0005546421.tuudjq", "state": "standby"}}, "ansible_loop_var": "item", "changed": false, "item": {"name": "mds.np0005546421.tuudjq", "state": "standby"}} ok: [np0005546415.localdomain] => (item={'name': 'mds.np0005546420.eqhasr', 'state': 'standby'}) => {"ansible_facts": {"mds_aff_daemon": {"name": "mds.np0005546420.eqhasr", "state": "standby"}}, "ansible_loop_var": "item", "changed": false, "item": {"name": "mds.np0005546420.eqhasr", "state": "standby"}} TASK [ceph_migrate : Affinity daemon selected] ********************************* ok: [np0005546415.localdomain] => { "msg": { "name": "mds.np0005546420.eqhasr", "state": "standby" } } TASK [ceph_migrate : Set MDS affinity] ***************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": "podman run --rm --net=host --ipc=host --volume /etc/ceph:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring config set mds.np0005546420.eqhasr mds_join_fs cephfs", "delta": "0:00:00.734238", "end": "2025-12-05 09:53:14.921825", "msg": "", "rc": 0, "start": "2025-12-05 09:53:14.187587", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Set/Unset labels - rm] ************************************ skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - rm] ************************************ changed: [np0005546415.localdomain] => (item=['np0005546415.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005546415.localdomain", "mds"], "delta": "0:00:00.726520", "end": "2025-12-05 09:53:16.325116", "item": ["np0005546415.localdomain", "mds"], "msg": "", "rc": 0, "start": "2025-12-05 09:53:15.598596", "stderr": "", "stderr_lines": [], "stdout": "Removed label mds from host np0005546415.localdomain", "stdout_lines": ["Removed label mds from host np0005546415.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546416.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005546416.localdomain", "mds"], "delta": "0:00:00.863628", "end": "2025-12-05 09:53:17.747461", "item": ["np0005546416.localdomain", "mds"], "msg": "", "rc": 0, "start": "2025-12-05 09:53:16.883833", "stderr": "", "stderr_lines": [], "stdout": "Removed label mds from host np0005546416.localdomain", "stdout_lines": ["Removed label mds from host np0005546416.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546418.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005546418.localdomain", "mds"], "delta": "0:00:00.783158", "end": "2025-12-05 09:53:19.147913", "item": ["np0005546418.localdomain", "mds"], "msg": "", "rc": 0, "start": "2025-12-05 09:53:18.364755", "stderr": "", "stderr_lines": [], "stdout": "Removed label mds from host np0005546418.localdomain", "stdout_lines": ["Removed label mds from host np0005546418.localdomain"]} TASK [ceph_migrate : Wait daemons] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005546415.localdomain TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mds] ********************************************* changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mds", "-f", "json"], "delta": "0:00:00.733612", "end": "2025-12-05 09:53:20.624532", "msg": "", "rc": 0, "start": "2025-12-05 09:53:19.890920", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"210b882cdb9d\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.04%\", \"created\": \"2025-12-05T08:10:29.036355Z\", \"daemon_id\": \"mds.np0005546415.aphosd\", \"daemon_name\": \"mds.mds.np0005546415.aphosd\", \"daemon_type\": \"mds\", \"events\": [\"2025-12-05T08:10:29.120143Z daemon:mds.mds.np0005546415.aphosd [INFO] \\\"Deployed mds.mds.np0005546415.aphosd on host 'np0005546415.localdomain'\\\"\"], \"hostname\": \"np0005546415.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:44:05.516491Z\", \"memory_usage\": 25155338, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2025-12-05T08:10:28.953415Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"4d197dcedf66\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.04%\", \"created\": \"2025-12-05T08:10:31.356848Z\", \"daemon_id\": \"mds.np0005546416.lkuhij\", \"daemon_name\": \"mds.mds.np0005546416.lkuhij\", \"daemon_type\": \"mds\", \"events\": [\"2025-12-05T08:10:31.454585Z daemon:mds.mds.np0005546416.lkuhij [INFO] \\\"Deployed mds.mds.np0005546416.lkuhij on host 'np0005546416.localdomain'\\\"\"], \"hostname\": \"np0005546416.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:44:05.715241Z\", \"memory_usage\": 26057113, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2025-12-05T08:10:31.236745Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"9353b317bf0f\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.17%\", \"created\": \"2025-12-05T08:10:26.942623Z\", \"daemon_id\": \"mds.np0005546418.rcuuff\", \"daemon_name\": \"mds.mds.np0005546418.rcuuff\", \"daemon_type\": \"mds\", \"events\": [\"2025-12-05T08:10:27.047211Z daemon:mds.mds.np0005546418.rcuuff [INFO] \\\"Deployed mds.mds.np0005546418.rcuuff on host 'np0005546418.localdomain'\\\"\"], \"hostname\": \"np0005546418.localdomain\", \"is_active\": true, \"last_refresh\": \"2025-12-05T09:44:05.678724Z\", \"memory_usage\": 27126661, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2025-12-05T08:10:26.823535Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"c015c4610c3f\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"6.06%\", \"created\": \"2025-12-05T09:52:48.690281Z\", \"daemon_id\": \"mds.np0005546419.rweotn\", \"daemon_name\": \"mds.mds.np0005546419.rweotn\", \"daemon_type\": \"mds\", \"events\": [\"2025-12-05T09:52:48.775683Z daemon:mds.mds.np0005546419.rweotn [INFO] \\\"Deployed mds.mds.np0005546419.rweotn on host 'np0005546419.localdomain'\\\"\"], \"hostname\": \"np0005546419.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:52:50.700120Z\", \"memory_usage\": 15959326, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2025-12-05T09:52:48.577597Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"d29a603d5e8c\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.67%\", \"created\": \"2025-12-05T09:52:46.269729Z\", \"daemon_id\": \"mds.np0005546420.eqhasr\", \"daemon_name\": \"mds.mds.np0005546420.eqhasr\", \"daemon_type\": \"mds\", \"events\": [\"2025-12-05T09:52:46.345956Z daemon:mds.mds.np0005546420.eqhasr [INFO] \\\"Deployed mds.mds.np0005546420.eqhasr on host 'np0005546420.localdomain'\\\"\"], \"hostname\": \"np0005546420.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:52:50.660996Z\", \"memory_usage\": 15927869, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2025-12-05T09:52:46.185651Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"d7fd9fb17dfa\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.50%\", \"created\": \"2025-12-05T09:52:44.094323Z\", \"daemon_id\": \"mds.np0005546421.tuudjq\", \"daemon_name\": \"mds.mds.np0005546421.tuudjq\", \"daemon_type\": \"mds\", \"events\": [\"2025-12-05T09:52:44.166722Z daemon:mds.mds.np0005546421.tuudjq [INFO] \\\"Deployed mds.mds.np0005546421.tuudjq on host 'np0005546421.localdomain'\\\"\"], \"hostname\": \"np0005546421.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:52:50.959438Z\", \"memory_usage\": 14375976, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2025-12-05T09:52:43.976032Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"210b882cdb9d\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.04%\", \"created\": \"2025-12-05T08:10:29.036355Z\", \"daemon_id\": \"mds.np0005546415.aphosd\", \"daemon_name\": \"mds.mds.np0005546415.aphosd\", \"daemon_type\": \"mds\", \"events\": [\"2025-12-05T08:10:29.120143Z daemon:mds.mds.np0005546415.aphosd [INFO] \\\"Deployed mds.mds.np0005546415.aphosd on host 'np0005546415.localdomain'\\\"\"], \"hostname\": \"np0005546415.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:44:05.516491Z\", \"memory_usage\": 25155338, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2025-12-05T08:10:28.953415Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"4d197dcedf66\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.04%\", \"created\": \"2025-12-05T08:10:31.356848Z\", \"daemon_id\": \"mds.np0005546416.lkuhij\", \"daemon_name\": \"mds.mds.np0005546416.lkuhij\", \"daemon_type\": \"mds\", \"events\": [\"2025-12-05T08:10:31.454585Z daemon:mds.mds.np0005546416.lkuhij [INFO] \\\"Deployed mds.mds.np0005546416.lkuhij on host 'np0005546416.localdomain'\\\"\"], \"hostname\": \"np0005546416.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:44:05.715241Z\", \"memory_usage\": 26057113, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2025-12-05T08:10:31.236745Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"9353b317bf0f\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.17%\", \"created\": \"2025-12-05T08:10:26.942623Z\", \"daemon_id\": \"mds.np0005546418.rcuuff\", \"daemon_name\": \"mds.mds.np0005546418.rcuuff\", \"daemon_type\": \"mds\", \"events\": [\"2025-12-05T08:10:27.047211Z daemon:mds.mds.np0005546418.rcuuff [INFO] \\\"Deployed mds.mds.np0005546418.rcuuff on host 'np0005546418.localdomain'\\\"\"], \"hostname\": \"np0005546418.localdomain\", \"is_active\": true, \"last_refresh\": \"2025-12-05T09:44:05.678724Z\", \"memory_usage\": 27126661, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2025-12-05T08:10:26.823535Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"c015c4610c3f\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"6.06%\", \"created\": \"2025-12-05T09:52:48.690281Z\", \"daemon_id\": \"mds.np0005546419.rweotn\", \"daemon_name\": \"mds.mds.np0005546419.rweotn\", \"daemon_type\": \"mds\", \"events\": [\"2025-12-05T09:52:48.775683Z daemon:mds.mds.np0005546419.rweotn [INFO] \\\"Deployed mds.mds.np0005546419.rweotn on host 'np0005546419.localdomain'\\\"\"], \"hostname\": \"np0005546419.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:52:50.700120Z\", \"memory_usage\": 15959326, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2025-12-05T09:52:48.577597Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"d29a603d5e8c\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.67%\", \"created\": \"2025-12-05T09:52:46.269729Z\", \"daemon_id\": \"mds.np0005546420.eqhasr\", \"daemon_name\": \"mds.mds.np0005546420.eqhasr\", \"daemon_type\": \"mds\", \"events\": [\"2025-12-05T09:52:46.345956Z daemon:mds.mds.np0005546420.eqhasr [INFO] \\\"Deployed mds.mds.np0005546420.eqhasr on host 'np0005546420.localdomain'\\\"\"], \"hostname\": \"np0005546420.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:52:50.660996Z\", \"memory_usage\": 15927869, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2025-12-05T09:52:46.185651Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"d7fd9fb17dfa\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.50%\", \"created\": \"2025-12-05T09:52:44.094323Z\", \"daemon_id\": \"mds.np0005546421.tuudjq\", \"daemon_name\": \"mds.mds.np0005546421.tuudjq\", \"daemon_type\": \"mds\", \"events\": [\"2025-12-05T09:52:44.166722Z daemon:mds.mds.np0005546421.tuudjq [INFO] \\\"Deployed mds.mds.np0005546421.tuudjq on host 'np0005546421.localdomain'\\\"\"], \"hostname\": \"np0005546421.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:52:50.959438Z\", \"memory_usage\": 14375976, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2025-12-05T09:52:43.976032Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : Sleep before moving to the next phase] ******************** Pausing for 30 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 30, "echo": true, "rc": 0, "start": "2025-12-05 09:53:20.833948", "stderr": "", "stdout": "Paused for 30.03 seconds", "stop": "2025-12-05 09:53:50.867815", "user_input": ""} TASK [ceph_migrate : Get ceph_cli] ********************************************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Fail if RGW VIPs are not defined] ************************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "ceph_daemons_layout.rgw | default(true) | bool"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005546415.localdomain] => {"false_condition": "ceph_daemons_layout.rgw | default(true) | bool"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** skipping: [np0005546415.localdomain] => (item=['np0005546419.localdomain', 'rgw']) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "item": ["np0005546419.localdomain", "rgw"], "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => (item=['np0005546420.localdomain', 'rgw']) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "item": ["np0005546420.localdomain", "rgw"], "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => (item=['np0005546421.localdomain', 'rgw']) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "item": ["np0005546421.localdomain", "rgw"], "skip_reason": "Conditional result was False"} skipping: [np0005546415.localdomain] => {"changed": false, "msg": "All items skipped"} TASK [ceph_migrate : RGW - Load Spec from the orchestrator] ******************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Print the loaded data] ************************************ skipping: [np0005546415.localdomain] => {"false_condition": "ceph_daemons_layout.rgw | default(true) | bool"} TASK [ceph_migrate : Apply ceph rgw keystone config] *************************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Update the RGW spec definition] *************************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005546415.localdomain] => {"false_condition": "ceph_daemons_layout.rgw | default(true) | bool"} TASK [ceph_migrate : Create the Ingress Daemon spec definition for RGW] ******** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005546415.localdomain] => {"false_condition": "ceph_daemons_layout.rgw | default(true) | bool"} TASK [ceph_migrate : Wait for cephadm to redeploy] ***************************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : RGW - wait daemons] *************************************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Setup a Ceph client to the first node] ******************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_client.yaml for np0005546415.localdomain TASK [ceph_migrate : TMP_CLIENT - Patch os-net-config config and setup a tmp client IP] *** changed: [np0005546415.localdomain] => {"backup": "/etc/os-net-config/tripleo_config.yaml.473857.2025-12-05@09:53:52~", "changed": true, "msg": "line added and ownership, perms or SE linux context changed"} TASK [ceph_migrate : TMP_CLIENT - Refresh os-net-config] *********************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["os-net-config", "-c", "/etc/os-net-config/tripleo_config.yaml"], "delta": "0:00:07.217654", "end": "2025-12-05 09:53:59.919508", "msg": "", "rc": 0, "start": "2025-12-05 09:53:52.701854", "stderr": "", "stderr_lines": [], "stdout": "2025-12-05 09:53:53.517 ERROR os_net_config.execute stderr : WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated.\nWARN : [ifdown] 'network-scripts' will be removed from distribution in near future.\nWARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well.\n\n2025-12-05 09:53:59.855 ERROR os_net_config.execute stderr : WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated.\nWARN : [ifup] 'network-scripts' will be removed from distribution in near future.\nWARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well.", "stdout_lines": ["2025-12-05 09:53:53.517 ERROR os_net_config.execute stderr : WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated.", "WARN : [ifdown] 'network-scripts' will be removed from distribution in near future.", "WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well.", "", "2025-12-05 09:53:59.855 ERROR os_net_config.execute stderr : WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated.", "WARN : [ifup] 'network-scripts' will be removed from distribution in near future.", "WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well."]} TASK [ceph_migrate : Backup data for client purposes] ************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/backup.yaml for np0005546415.localdomain TASK [ceph_migrate : Ensure backup directory exists] *************************** changed: [np0005546415.localdomain] => {"changed": true, "gid": 1003, "group": "tripleo-admin", "mode": "0755", "owner": "tripleo-admin", "path": "/home/tripleo-admin/ceph_client", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 6, "state": "directory", "uid": 1003} TASK [ceph_migrate : Check file in the src directory] ************************** ok: [np0005546415.localdomain] => {"changed": false, "examined": 4, "files": [{"atime": 1764922196.774374, "ctime": 1764922195.7653434, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 58721359, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1764921138.5403962, "nlink": 1, "path": "/etc/ceph/ceph.conf", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 271, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1764922196.7853744, "ctime": 1764922195.7653434, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 58721358, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0600", "mtime": 1764920994.3119175, "nlink": 1, "path": "/etc/ceph/ceph.client.admin.keyring", "pw_name": "root", "rgrp": false, "roth": false, "rusr": true, "size": 151, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1764922236.4275799, "ctime": 1764922234.4995213, "dev": 64516, "gid": 167, "gr_name": "", "inode": 646014310, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1764922234.1795115, "nlink": 1, "path": "/etc/ceph/ceph.client.openstack.keyring", "pw_name": "", "rgrp": true, "roth": true, "rusr": true, "size": 231, "uid": 167, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1764922237.41761, "ctime": 1764922235.3955483, "dev": 64516, "gid": 167, "gr_name": "", "inode": 671322539, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1764922235.0905392, "nlink": 1, "path": "/etc/ceph/ceph.client.manila.keyring", "pw_name": "", "rgrp": true, "roth": true, "rusr": true, "size": 153, "uid": 167, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}], "matched": 4, "msg": "All paths examined", "skipped_paths": {}} TASK [ceph_migrate : Backup ceph client data] ********************************** changed: [np0005546415.localdomain] => (item={'path': '/etc/ceph/ceph.conf', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 271, 'inode': 58721359, 'dev': 64516, 'nlink': 1, 'atime': 1764922196.774374, 'mtime': 1764921138.5403962, 'ctime': 1764922195.7653434, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "9ddad61351f9bf53ca5a99a509b37f8f58fbf3e4", "dest": "/home/tripleo-admin/ceph_client/ceph.conf", "gid": 0, "group": "root", "item": {"atime": 1764922196.774374, "ctime": 1764922195.7653434, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 58721359, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1764921138.5403962, "nlink": 1, "path": "/etc/ceph/ceph.conf", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 271, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "91158730908c237cc7c07e4b4a341d9a", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 271, "src": "/etc/ceph/ceph.conf", "state": "file", "uid": 0} changed: [np0005546415.localdomain] => (item={'path': '/etc/ceph/ceph.client.admin.keyring', 'mode': '0600', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 151, 'inode': 58721358, 'dev': 64516, 'nlink': 1, 'atime': 1764922196.7853744, 'mtime': 1764920994.3119175, 'ctime': 1764922195.7653434, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': False, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "e727e4b15c8bb6c152697f1eb76bbef93e7df730", "dest": "/home/tripleo-admin/ceph_client/ceph.client.admin.keyring", "gid": 0, "group": "root", "item": {"atime": 1764922196.7853744, "ctime": 1764922195.7653434, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 58721358, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0600", "mtime": 1764920994.3119175, "nlink": 1, "path": "/etc/ceph/ceph.client.admin.keyring", "pw_name": "root", "rgrp": false, "roth": false, "rusr": true, "size": 151, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "508a8780164e984fb776cef183e28f07", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 151, "src": "/etc/ceph/ceph.client.admin.keyring", "state": "file", "uid": 0} changed: [np0005546415.localdomain] => (item={'path': '/etc/ceph/ceph.client.openstack.keyring', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 167, 'gid': 167, 'size': 231, 'inode': 646014310, 'dev': 64516, 'nlink': 1, 'atime': 1764922236.4275799, 'mtime': 1764922234.1795115, 'ctime': 1764922234.4995213, 'gr_name': '', 'pw_name': '', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "56b574bbcbb2378bafed25b3f279b3c007056bbe", "dest": "/home/tripleo-admin/ceph_client/ceph.client.openstack.keyring", "gid": 0, "group": "root", "item": {"atime": 1764922236.4275799, "ctime": 1764922234.4995213, "dev": 64516, "gid": 167, "gr_name": "", "inode": 646014310, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1764922234.1795115, "nlink": 1, "path": "/etc/ceph/ceph.client.openstack.keyring", "pw_name": "", "rgrp": true, "roth": true, "rusr": true, "size": 231, "uid": 167, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "9c1b51b36f497a00860221183d21fc7d", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 231, "src": "/etc/ceph/ceph.client.openstack.keyring", "state": "file", "uid": 0} changed: [np0005546415.localdomain] => (item={'path': '/etc/ceph/ceph.client.manila.keyring', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 167, 'gid': 167, 'size': 153, 'inode': 671322539, 'dev': 64516, 'nlink': 1, 'atime': 1764922237.41761, 'mtime': 1764922235.0905392, 'ctime': 1764922235.3955483, 'gr_name': '', 'pw_name': '', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "81b1e70c98aa594608eafceac10d1e7c5fcc2dc9", "dest": "/home/tripleo-admin/ceph_client/ceph.client.manila.keyring", "gid": 0, "group": "root", "item": {"atime": 1764922237.41761, "ctime": 1764922235.3955483, "dev": 64516, "gid": 167, "gr_name": "", "inode": 671322539, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1764922235.0905392, "nlink": 1, "path": "/etc/ceph/ceph.client.manila.keyring", "pw_name": "", "rgrp": true, "roth": true, "rusr": true, "size": 153, "uid": 167, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "bc4d5dbb5a3571307c32c4b317d8bda9", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 153, "src": "/etc/ceph/ceph.client.manila.keyring", "state": "file", "uid": 0} TASK [ceph_migrate : Render global ceph.conf] ********************************** changed: [np0005546415.localdomain] => {"changed": true, "checksum": "c2bbe2ef98059e811040beb3baabe89437b9f775", "dest": "/home/tripleo-admin/ceph_client/ceph.conf", "gid": 0, "group": "root", "md5sum": "6e59ba5fc5510f5e0b0a4221b09d03b2", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 142, "src": "/home/tripleo-admin/.ansible/tmp/ansible-tmp-1764928443.9409807-60897-171310822649209/source", "state": "file", "uid": 0} TASK [ceph_migrate : MGR - Migrate RBD node] *********************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/mgr.yaml for np0005546415.localdomain TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005546415.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /etc/ceph:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : MGR - Setup Mon/Mgr label to the target node] ************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/labels.yaml for np0005546415.localdomain TASK [ceph_migrate : Set/Unset labels - add] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** changed: [np0005546415.localdomain] => (item=['np0005546419.localdomain', 'mgr']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546419.localdomain", "mgr"], "delta": "0:00:00.835491", "end": "2025-12-05 09:54:06.706810", "item": ["np0005546419.localdomain", "mgr"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:05.871319", "stderr": "", "stderr_lines": [], "stdout": "Added label mgr to host np0005546419.localdomain", "stdout_lines": ["Added label mgr to host np0005546419.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546420.localdomain', 'mgr']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546420.localdomain", "mgr"], "delta": "0:00:00.788247", "end": "2025-12-05 09:54:08.094227", "item": ["np0005546420.localdomain", "mgr"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:07.305980", "stderr": "", "stderr_lines": [], "stdout": "Added label mgr to host np0005546420.localdomain", "stdout_lines": ["Added label mgr to host np0005546420.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546421.localdomain', 'mgr']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546421.localdomain", "mgr"], "delta": "0:00:00.820436", "end": "2025-12-05 09:54:09.457333", "item": ["np0005546421.localdomain", "mgr"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:08.636897", "stderr": "", "stderr_lines": [], "stdout": "Added label mgr to host np0005546421.localdomain", "stdout_lines": ["Added label mgr to host np0005546421.localdomain"]} TASK [ceph_migrate : MGR - Load Spec from the orchestrator] ******************** ok: [np0005546415.localdomain] => {"ansible_facts": {"mgr_spec": {"service_name": "mgr", "service_type": "mgr", "spec": {}}}, "changed": false} TASK [ceph_migrate : Update the MGR Daemon spec definition] ******************** ok: [np0005546415.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/etc/ceph:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mgr:/home/tripleo-admin/mgr:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mgr"], "delta": "0:00:00.779839", "end": "2025-12-05 09:54:10.870518", "rc": 0, "start": "2025-12-05 09:54:10.090679", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mgr update...", "stdout_lines": ["Scheduled mgr update..."]} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MGR - wait daemons] *************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005546415.localdomain TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mgr] ********************************************* changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mgr", "-f", "json"], "delta": "0:00:00.717647", "end": "2025-12-05 09:54:12.367706", "msg": "", "rc": 0, "start": "2025-12-05 09:54:11.650059", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"c7c0c4b4bc9c\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.19%\", \"created\": \"2025-12-05T07:49:19.064841Z\", \"daemon_id\": \"np0005546415.knqtle\", \"daemon_name\": \"mgr.np0005546415.knqtle\", \"daemon_type\": \"mgr\", \"events\": [\"2025-12-05T07:52:21.761550Z daemon:mgr.np0005546415.knqtle [INFO] \\\"Reconfigured mgr.np0005546415.knqtle on host 'np0005546415.localdomain'\\\"\"], \"hostname\": \"np0005546415.localdomain\", \"is_active\": true, \"last_refresh\": \"2025-12-05T09:53:30.679736Z\", \"memory_usage\": 545364377, \"ports\": [9283, 8765], \"service_name\": \"mgr\", \"started\": \"2025-12-05T07:49:18.931641Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"5b54c7badafa\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.19%\", \"created\": \"2025-12-05T07:51:38.226238Z\", \"daemon_id\": \"np0005546416.kmqcnq\", \"daemon_name\": \"mgr.np0005546416.kmqcnq\", \"daemon_type\": \"mgr\", \"events\": [\"2025-12-05T07:51:38.320403Z daemon:mgr.np0005546416.kmqcnq [INFO] \\\"Deployed mgr.np0005546416.kmqcnq on host 'np0005546416.localdomain'\\\"\"], \"hostname\": \"np0005546416.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:53:30.740181Z\", \"memory_usage\": 478465228, \"ports\": [8765], \"service_name\": \"mgr\", \"started\": \"2025-12-05T07:51:38.083654Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"e5ff0e6576f5\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.19%\", \"created\": \"2025-12-05T07:51:31.425018Z\", \"daemon_id\": \"np0005546418.garyvl\", \"daemon_name\": \"mgr.np0005546418.garyvl\", \"daemon_type\": \"mgr\", \"events\": [\"2025-12-05T07:51:36.030575Z daemon:mgr.np0005546418.garyvl [INFO] \\\"Deployed mgr.np0005546418.garyvl on host 'np0005546418.localdomain'\\\"\", \"2025-12-05T07:52:26.136914Z daemon:mgr.np0005546418.garyvl [INFO] \\\"Reconfigured mgr.np0005546418.garyvl on host 'np0005546418.localdomain'\\\"\"], \"hostname\": \"np0005546418.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:53:45.412452Z\", \"memory_usage\": 480038092, \"ports\": [8765], \"service_name\": \"mgr\", \"started\": \"2025-12-05T07:51:31.261842Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"c7c0c4b4bc9c\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.19%\", \"created\": \"2025-12-05T07:49:19.064841Z\", \"daemon_id\": \"np0005546415.knqtle\", \"daemon_name\": \"mgr.np0005546415.knqtle\", \"daemon_type\": \"mgr\", \"events\": [\"2025-12-05T07:52:21.761550Z daemon:mgr.np0005546415.knqtle [INFO] \\\"Reconfigured mgr.np0005546415.knqtle on host 'np0005546415.localdomain'\\\"\"], \"hostname\": \"np0005546415.localdomain\", \"is_active\": true, \"last_refresh\": \"2025-12-05T09:53:30.679736Z\", \"memory_usage\": 545364377, \"ports\": [9283, 8765], \"service_name\": \"mgr\", \"started\": \"2025-12-05T07:49:18.931641Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"5b54c7badafa\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.19%\", \"created\": \"2025-12-05T07:51:38.226238Z\", \"daemon_id\": \"np0005546416.kmqcnq\", \"daemon_name\": \"mgr.np0005546416.kmqcnq\", \"daemon_type\": \"mgr\", \"events\": [\"2025-12-05T07:51:38.320403Z daemon:mgr.np0005546416.kmqcnq [INFO] \\\"Deployed mgr.np0005546416.kmqcnq on host 'np0005546416.localdomain'\\\"\"], \"hostname\": \"np0005546416.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:53:30.740181Z\", \"memory_usage\": 478465228, \"ports\": [8765], \"service_name\": \"mgr\", \"started\": \"2025-12-05T07:51:38.083654Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"e5ff0e6576f5\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.19%\", \"created\": \"2025-12-05T07:51:31.425018Z\", \"daemon_id\": \"np0005546418.garyvl\", \"daemon_name\": \"mgr.np0005546418.garyvl\", \"daemon_type\": \"mgr\", \"events\": [\"2025-12-05T07:51:36.030575Z daemon:mgr.np0005546418.garyvl [INFO] \\\"Deployed mgr.np0005546418.garyvl on host 'np0005546418.localdomain'\\\"\", \"2025-12-05T07:52:26.136914Z daemon:mgr.np0005546418.garyvl [INFO] \\\"Reconfigured mgr.np0005546418.garyvl on host 'np0005546418.localdomain'\\\"\"], \"hostname\": \"np0005546418.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:53:45.412452Z\", \"memory_usage\": 480038092, \"ports\": [8765], \"service_name\": \"mgr\", \"started\": \"2025-12-05T07:51:31.261842Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : MON - Load Spec from the orchestrator] ******************** ok: [np0005546415.localdomain] => {"ansible_facts": {"mon_spec": {"service_name": "mon", "service_type": "mon", "spec": {}}}, "changed": false} TASK [ceph_migrate : Set/Unset labels - add] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** changed: [np0005546415.localdomain] => (item=['np0005546415.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546415.localdomain", "mon"], "delta": "0:00:00.720148", "end": "2025-12-05 09:54:13.875588", "item": ["np0005546415.localdomain", "mon"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:13.155440", "stderr": "", "stderr_lines": [], "stdout": "Added label mon to host np0005546415.localdomain", "stdout_lines": ["Added label mon to host np0005546415.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546415.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546415.localdomain", "_admin"], "delta": "0:00:00.858589", "end": "2025-12-05 09:54:15.338619", "item": ["np0005546415.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:14.480030", "stderr": "", "stderr_lines": [], "stdout": "Added label _admin to host np0005546415.localdomain", "stdout_lines": ["Added label _admin to host np0005546415.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546416.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546416.localdomain", "mon"], "delta": "0:00:00.760929", "end": "2025-12-05 09:54:16.688939", "item": ["np0005546416.localdomain", "mon"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:15.928010", "stderr": "", "stderr_lines": [], "stdout": "Added label mon to host np0005546416.localdomain", "stdout_lines": ["Added label mon to host np0005546416.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546416.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546416.localdomain", "_admin"], "delta": "0:00:00.822144", "end": "2025-12-05 09:54:18.113528", "item": ["np0005546416.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:17.291384", "stderr": "", "stderr_lines": [], "stdout": "Added label _admin to host np0005546416.localdomain", "stdout_lines": ["Added label _admin to host np0005546416.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546418.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546418.localdomain", "mon"], "delta": "0:00:00.781875", "end": "2025-12-05 09:54:19.454949", "item": ["np0005546418.localdomain", "mon"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:18.673074", "stderr": "", "stderr_lines": [], "stdout": "Added label mon to host np0005546418.localdomain", "stdout_lines": ["Added label mon to host np0005546418.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546418.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546418.localdomain", "_admin"], "delta": "0:00:00.718451", "end": "2025-12-05 09:54:20.767166", "item": ["np0005546418.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:20.048715", "stderr": "", "stderr_lines": [], "stdout": "Added label _admin to host np0005546418.localdomain", "stdout_lines": ["Added label _admin to host np0005546418.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546419.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546419.localdomain", "mon"], "delta": "0:00:00.821751", "end": "2025-12-05 09:54:22.203900", "item": ["np0005546419.localdomain", "mon"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:21.382149", "stderr": "", "stderr_lines": [], "stdout": "Added label mon to host np0005546419.localdomain", "stdout_lines": ["Added label mon to host np0005546419.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546419.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546419.localdomain", "_admin"], "delta": "0:00:00.700900", "end": "2025-12-05 09:54:23.476439", "item": ["np0005546419.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:22.775539", "stderr": "", "stderr_lines": [], "stdout": "Added label _admin to host np0005546419.localdomain", "stdout_lines": ["Added label _admin to host np0005546419.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546420.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546420.localdomain", "mon"], "delta": "0:00:00.860399", "end": "2025-12-05 09:54:24.930170", "item": ["np0005546420.localdomain", "mon"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:24.069771", "stderr": "", "stderr_lines": [], "stdout": "Added label mon to host np0005546420.localdomain", "stdout_lines": ["Added label mon to host np0005546420.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546420.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546420.localdomain", "_admin"], "delta": "0:00:00.685407", "end": "2025-12-05 09:54:26.122048", "item": ["np0005546420.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:25.436641", "stderr": "", "stderr_lines": [], "stdout": "Added label _admin to host np0005546420.localdomain", "stdout_lines": ["Added label _admin to host np0005546420.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546421.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546421.localdomain", "mon"], "delta": "0:00:00.828742", "end": "2025-12-05 09:54:27.579200", "item": ["np0005546421.localdomain", "mon"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:26.750458", "stderr": "", "stderr_lines": [], "stdout": "Added label mon to host np0005546421.localdomain", "stdout_lines": ["Added label mon to host np0005546421.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546421.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005546421.localdomain", "_admin"], "delta": "0:00:00.752899", "end": "2025-12-05 09:54:28.950042", "item": ["np0005546421.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2025-12-05 09:54:28.197143", "stderr": "", "stderr_lines": [], "stdout": "Added label _admin to host np0005546421.localdomain", "stdout_lines": ["Added label _admin to host np0005546421.localdomain"]} TASK [ceph_migrate : Normalize the mon spec to use labels] ********************* ok: [np0005546415.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/etc/ceph:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mon:/home/tripleo-admin/mon:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mon"], "delta": "0:00:00.714834", "end": "2025-12-05 09:54:30.343528", "rc": 0, "start": "2025-12-05 09:54:29.628694", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mon update...", "stdout_lines": ["Scheduled mon update..."]} TASK [ceph_migrate : RBD - wait new daemons to be available] ******************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005546415.localdomain => (item=np0005546419.localdomain) included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005546415.localdomain => (item=np0005546420.localdomain) included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005546415.localdomain => (item=np0005546421.localdomain) TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mon] ********************************************* FAILED - RETRYING: [np0005546415.localdomain]: wait for mon (200 retries left). FAILED - RETRYING: [np0005546415.localdomain]: wait for mon (199 retries left). FAILED - RETRYING: [np0005546415.localdomain]: wait for mon (198 retries left). changed: [np0005546415.localdomain] => {"attempts": 4, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005546419", "-f", "json"], "delta": "0:00:00.697118", "end": "2025-12-05 09:54:54.246622", "msg": "", "rc": 0, "start": "2025-12-05 09:54:53.549504", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"0cfef878df0a\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.40%\", \"created\": \"2025-12-05T09:54:43.534702Z\", \"daemon_id\": \"np0005546419\", \"daemon_name\": \"mon.np0005546419\", \"daemon_type\": \"mon\", \"events\": [\"2025-12-05T09:54:47.527489Z daemon:mon.np0005546419 [INFO] \\\"Deployed mon.np0005546419 on host 'np0005546419.localdomain'\\\"\"], \"hostname\": \"np0005546419.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:54:49.742980Z\", \"memory_request\": 2147483648, \"memory_usage\": 44386222, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:54:43.423179Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"0cfef878df0a\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.40%\", \"created\": \"2025-12-05T09:54:43.534702Z\", \"daemon_id\": \"np0005546419\", \"daemon_name\": \"mon.np0005546419\", \"daemon_type\": \"mon\", \"events\": [\"2025-12-05T09:54:47.527489Z daemon:mon.np0005546419 [INFO] \\\"Deployed mon.np0005546419 on host 'np0005546419.localdomain'\\\"\"], \"hostname\": \"np0005546419.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:54:49.742980Z\", \"memory_request\": 2147483648, \"memory_usage\": 44386222, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:54:43.423179Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mon] ********************************************* changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005546420", "-f", "json"], "delta": "0:00:00.746548", "end": "2025-12-05 09:54:55.647605", "msg": "", "rc": 0, "start": "2025-12-05 09:54:54.901057", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"645b8ccfa2de\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"2.95%\", \"created\": \"2025-12-05T09:54:37.922123Z\", \"daemon_id\": \"np0005546420\", \"daemon_name\": \"mon.np0005546420\", \"daemon_type\": \"mon\", \"events\": [\"2025-12-05T09:54:40.617744Z daemon:mon.np0005546420 [INFO] \\\"Deployed mon.np0005546420 on host 'np0005546420.localdomain'\\\"\"], \"hostname\": \"np0005546420.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:54:49.846445Z\", \"memory_request\": 2147483648, \"memory_usage\": 45130711, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:54:37.820134Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"645b8ccfa2de\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"2.95%\", \"created\": \"2025-12-05T09:54:37.922123Z\", \"daemon_id\": \"np0005546420\", \"daemon_name\": \"mon.np0005546420\", \"daemon_type\": \"mon\", \"events\": [\"2025-12-05T09:54:40.617744Z daemon:mon.np0005546420 [INFO] \\\"Deployed mon.np0005546420 on host 'np0005546420.localdomain'\\\"\"], \"hostname\": \"np0005546420.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:54:49.846445Z\", \"memory_request\": 2147483648, \"memory_usage\": 45130711, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:54:37.820134Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mon] ********************************************* changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005546421", "-f", "json"], "delta": "0:00:00.699299", "end": "2025-12-05 09:54:57.065897", "msg": "", "rc": 0, "start": "2025-12-05 09:54:56.366598", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"6c8da69ed83b\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"2.68%\", \"created\": \"2025-12-05T09:54:35.058246Z\", \"daemon_id\": \"np0005546421\", \"daemon_name\": \"mon.np0005546421\", \"daemon_type\": \"mon\", \"events\": [\"2025-12-05T09:54:35.151968Z daemon:mon.np0005546421 [INFO] \\\"Deployed mon.np0005546421 on host 'np0005546421.localdomain'\\\"\"], \"hostname\": \"np0005546421.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:54:50.020140Z\", \"memory_request\": 2147483648, \"memory_usage\": 45686456, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:54:34.948292Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"6c8da69ed83b\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"2.68%\", \"created\": \"2025-12-05T09:54:35.058246Z\", \"daemon_id\": \"np0005546421\", \"daemon_name\": \"mon.np0005546421\", \"daemon_type\": \"mon\", \"events\": [\"2025-12-05T09:54:35.151968Z daemon:mon.np0005546421 [INFO] \\\"Deployed mon.np0005546421 on host 'np0005546421.localdomain'\\\"\"], \"hostname\": \"np0005546421.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:54:50.020140Z\", \"memory_request\": 2147483648, \"memory_usage\": 45686456, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:54:34.948292Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : MON - Migrate RBD node] *********************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/mon.yaml for np0005546415.localdomain => (item=['np0005546415.localdomain', 'np0005546419.localdomain']) included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/mon.yaml for np0005546415.localdomain => (item=['np0005546416.localdomain', 'np0005546420.localdomain']) included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/mon.yaml for np0005546415.localdomain => (item=['np0005546418.localdomain', 'np0005546421.localdomain']) TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005546415.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Migrate mon] ********************************************** ok: [np0005546415.localdomain] => { "msg": "Migrate mon: np0005546415.localdomain to node: np0005546419.localdomain" } TASK [ceph_migrate : MON - Get current mon IP address from node_map override] *** ok: [np0005546415.localdomain] => {"ansible_facts": {"mon_ipaddr": "172.18.0.103"}, "changed": false} TASK [ceph_migrate : MON - Check mons quorum] ********************************** changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "-s", "-f", "json"], "delta": "0:00:00.827147", "end": "2025-12-05 09:54:58.991323", "msg": "", "rc": 0, "start": "2025-12-05 09:54:58.164176", "stderr": "", "stderr_lines": [], "stdout": "\n{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":32,\"quorum\":[0,1,2,3,4,5],\"quorum_names\":[\"np0005546415\",\"np0005546418\",\"np0005546416\",\"np0005546421\",\"np0005546420\",\"np0005546419\"],\"quorum_age\":5,\"monmap\":{\"epoch\":6,\"min_mon_release_name\":\"reef\",\"num_mons\":6},\"osdmap\":{\"epoch\":84,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109571242,\"bytes_used\":565997568,\"bytes_avail\":44505993216,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546420.eqhasr\",\"status\":\"up:active\",\"gid\":26492}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":5,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":82,\"modified\":\"2025-12-05T09:54:37.955559+0000\",\"services\":{\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005546419.zhsnqq\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546420.aoeylc\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546421.sukfea\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":32,\"quorum\":[0,1,2,3,4,5],\"quorum_names\":[\"np0005546415\",\"np0005546418\",\"np0005546416\",\"np0005546421\",\"np0005546420\",\"np0005546419\"],\"quorum_age\":5,\"monmap\":{\"epoch\":6,\"min_mon_release_name\":\"reef\",\"num_mons\":6},\"osdmap\":{\"epoch\":84,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109571242,\"bytes_used\":565997568,\"bytes_avail\":44505993216,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546420.eqhasr\",\"status\":\"up:active\",\"gid\":26492}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":5,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":82,\"modified\":\"2025-12-05T09:54:37.955559+0000\",\"services\":{\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005546419.zhsnqq\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546420.aoeylc\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546421.sukfea\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}"]} TASK [ceph_migrate : Backup data for client purposes] ************************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "cur_mon != client_node", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Get the current active mgr] ************************* changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "stat", "-f", "json"], "delta": "0:00:00.710418", "end": "2025-12-05 09:55:00.264388", "msg": "", "rc": 0, "start": "2025-12-05 09:54:59.553970", "stderr": "", "stderr_lines": [], "stdout": "\n{\"epoch\":14,\"available\":true,\"active_name\":\"np0005546415.knqtle\",\"num_standby\":5}", "stdout_lines": ["", "{\"epoch\":14,\"available\":true,\"active_name\":\"np0005546415.knqtle\",\"num_standby\":5}"]} TASK [ceph_migrate : MON - Load mgr data] ************************************** ok: [np0005546415.localdomain] => {"ansible_facts": {"mgr": {"active_name": "np0005546415.knqtle", "available": true, "epoch": 14, "num_standby": 5}}, "changed": false} TASK [ceph_migrate : Print active mgr] ***************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Fail mgr if active in the current node] ******************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/fail_mgr.yaml for np0005546415.localdomain TASK [ceph_migrate : Refresh ceph_cli] ***************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005546415.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Force fail ceph mgr] ************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "fail"], "delta": "0:00:00.883301", "end": "2025-12-05 09:55:02.088144", "msg": "", "rc": 0, "start": "2025-12-05 09:55:01.204843", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Wait for cephadm to reconcile] **************************** Pausing for 10 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2025-12-05 09:55:02.209032", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2025-12-05 09:55:12.222055", "user_input": ""} TASK [ceph_migrate : Get the ceph orchestrator status with] ******************** ASYNC OK on np0005546415.localdomain: jid=j385759970378.481117 changed: [np0005546415.localdomain] => {"ansible_job_id": "j385759970378.481117", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "status", "--format", "json"], "delta": "0:00:00.709810", "end": "2025-12-05 09:55:13.829834", "failed_when_result": false, "finished": 1, "msg": "", "rc": 0, "results_file": "/root/.ansible_async/j385759970378.481117", "start": "2025-12-05 09:55:13.120024", "started": 1, "stderr": "", "stderr_lines": [], "stdout": "\n{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}", "stdout_lines": ["", "{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}"]} TASK [ceph_migrate : Restart the active mgr] *********************************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Fail if ceph orchestrator is still not responding] ******** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Drain and rm --force the cur_mon host] ************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/drain.yaml for np0005546415.localdomain TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005546415.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : MON - wait daemons] *************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005546415", "-f", "json"], "delta": "0:00:00.694300", "end": "2025-12-05 09:55:16.605807", "msg": "", "rc": 0, "start": "2025-12-05 09:55:15.911507", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"0bd15124987c\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.61%\", \"created\": \"2025-12-05T07:49:10.037567Z\", \"daemon_id\": \"np0005546415\", \"daemon_name\": \"mon.np0005546415\", \"daemon_type\": \"mon\", \"hostname\": \"np0005546415.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:55:04.148243Z\", \"memory_request\": 2147483648, \"memory_usage\": 150785228, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T07:49:17.394820Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"0bd15124987c\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.61%\", \"created\": \"2025-12-05T07:49:10.037567Z\", \"daemon_id\": \"np0005546415\", \"daemon_name\": \"mon.np0005546415\", \"daemon_type\": \"mon\", \"hostname\": \"np0005546415.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:55:04.148243Z\", \"memory_request\": 2147483648, \"memory_usage\": 150785228, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T07:49:17.394820Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : DRAIN - Delete the mon running on the current controller node] *** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "rm", "mon.np0005546415", "--force"], "delta": "0:00:05.888194", "end": "2025-12-05 09:55:23.057534", "msg": "", "rc": 0, "start": "2025-12-05 09:55:17.169340", "stderr": "", "stderr_lines": [], "stdout": "Removed mon.np0005546415 from host 'np0005546415.localdomain'", "stdout_lines": ["Removed mon.np0005546415 from host 'np0005546415.localdomain'"]} TASK [ceph_migrate : DRAIN - remove label from the src node] ******************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/labels.yaml for np0005546415.localdomain TASK [ceph_migrate : Set/Unset labels - rm] ************************************ skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - rm] ************************************ changed: [np0005546415.localdomain] => (item=['np0005546415.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005546415.localdomain", "mon"], "delta": "0:00:02.038750", "end": "2025-12-05 09:55:25.856829", "item": ["np0005546415.localdomain", "mon"], "msg": "", "rc": 0, "start": "2025-12-05 09:55:23.818079", "stderr": "", "stderr_lines": [], "stdout": "Removed label mon from host np0005546415.localdomain", "stdout_lines": ["Removed label mon from host np0005546415.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546415.localdomain', 'mgr']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005546415.localdomain", "mgr"], "delta": "0:00:00.811673", "end": "2025-12-05 09:55:27.205529", "item": ["np0005546415.localdomain", "mgr"], "msg": "", "rc": 0, "start": "2025-12-05 09:55:26.393856", "stderr": "", "stderr_lines": [], "stdout": "Removed label mgr from host np0005546415.localdomain", "stdout_lines": ["Removed label mgr from host np0005546415.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546415.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005546415.localdomain", "_admin"], "delta": "0:00:00.840040", "end": "2025-12-05 09:55:28.571488", "item": ["np0005546415.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2025-12-05 09:55:27.731448", "stderr": "", "stderr_lines": [], "stdout": "Removed label _admin from host np0005546415.localdomain", "stdout_lines": ["Removed label _admin from host np0005546415.localdomain"]} TASK [ceph_migrate : Wait for the orchestrator to remove labels] *************** Pausing for 10 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2025-12-05 09:55:28.680550", "stderr": "", "stdout": "Paused for 10.0 seconds", "stop": "2025-12-05 09:55:38.685219", "user_input": ""} TASK [ceph_migrate : DRAIN - Drain the host] *********************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "drain", "np0005546415.localdomain"], "delta": "0:00:00.793502", "end": "2025-12-05 09:55:39.994721", "msg": "", "rc": 0, "start": "2025-12-05 09:55:39.201219", "stderr": "", "stderr_lines": [], "stdout": "Scheduled to remove the following daemons from host 'np0005546415.localdomain'\ntype id \n-------------------- ---------------\nmgr np0005546415.knqtle\ncrash np0005546415 ", "stdout_lines": ["Scheduled to remove the following daemons from host 'np0005546415.localdomain'", "type id ", "-------------------- ---------------", "mgr np0005546415.knqtle", "crash np0005546415 "]} TASK [ceph_migrate : DRAIN - cleanup the host] ********************************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "force_clean | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - check host in hostmap] ****************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "ls", "--host_pattern", "np0005546415.localdomain", "-f", "json"], "delta": "0:00:00.733298", "end": "2025-12-05 09:55:41.354825", "msg": "", "rc": 0, "start": "2025-12-05 09:55:40.621527", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"addr\": \"192.168.122.103\", \"hostname\": \"np0005546415.localdomain\", \"labels\": [\"_no_schedule\", \"_no_conf_keyring\"], \"status\": \"\"}]", "stdout_lines": ["", "[{\"addr\": \"192.168.122.103\", \"hostname\": \"np0005546415.localdomain\", \"labels\": [\"_no_schedule\", \"_no_conf_keyring\"], \"status\": \"\"}]"]} TASK [ceph_migrate : MON - rm the cur_mon host from the Ceph cluster] ********** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "rm", "np0005546415.localdomain", "--force"], "delta": "0:00:00.792899", "end": "2025-12-05 09:55:43.047141", "msg": "", "rc": 0, "start": "2025-12-05 09:55:42.254242", "stderr": "", "stderr_lines": [], "stdout": "Removed host 'np0005546415.localdomain'", "stdout_lines": ["Removed host 'np0005546415.localdomain'"]} TASK [ceph_migrate : MON - Get current mon IP address] ************************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "mon_ipaddr is not defined", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Migrate the mon ip address from src to target node] *** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/network.yaml for np0005546415.localdomain TASK [ceph_migrate : MON - Print current mon IP address] *********************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Patch net-config config and remove the IP address (src node)] *** changed: [np0005546415.localdomain] => {"backup": "/etc/os-net-config/tripleo_config.yaml.483561.2025-12-05@09:55:43~", "changed": true, "found": 1, "msg": "1 line(s) removed"} TASK [ceph_migrate : MON - Refresh os-net-config (src node)] ******************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "not manual_migration | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - manually rm the ip address (src node)] ************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["ip", "a", "del", "172.18.0.103/24", "dev", "vlan21"], "delta": "0:00:00.006040", "end": "2025-12-05 09:55:44.408490", "msg": "", "rc": 0, "start": "2025-12-05 09:55:44.402450", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : MON - Patch net-config config and add the IP address (target node)] *** changed: [np0005546415.localdomain -> np0005546419.localdomain(192.168.122.106)] => {"backup": "/etc/os-net-config/tripleo_config.yaml.290998.2025-12-05@09:55:45~", "changed": true, "msg": "line added"} TASK [ceph_migrate : MON - Refresh os-net-config (target_node)] **************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "not manual_migration | bool | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - statically assign the ip address to the target node] *** changed: [np0005546415.localdomain -> np0005546419.localdomain(192.168.122.106)] => {"changed": true, "cmd": ["ip", "a", "add", "172.18.0.103/24", "dev", "vlan21"], "delta": "0:00:00.005341", "end": "2025-12-05 09:55:46.447416", "msg": "", "rc": 0, "start": "2025-12-05 09:55:46.442075", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : MON - ping ip address to see if is reachable on the target node] *** changed: [np0005546415.localdomain -> np0005546419.localdomain(192.168.122.106)] => {"changed": true, "cmd": ["ping", "-W1", "-c", "3", "172.18.0.103"], "delta": "0:00:02.072405", "end": "2025-12-05 09:55:49.251715", "msg": "", "rc": 0, "start": "2025-12-05 09:55:47.179310", "stderr": "", "stderr_lines": [], "stdout": "PING 172.18.0.103 (172.18.0.103) 56(84) bytes of data.\n64 bytes from 172.18.0.103: icmp_seq=1 ttl=64 time=0.065 ms\n64 bytes from 172.18.0.103: icmp_seq=2 ttl=64 time=0.074 ms\n64 bytes from 172.18.0.103: icmp_seq=3 ttl=64 time=0.056 ms\n\n--- 172.18.0.103 ping statistics ---\n3 packets transmitted, 3 received, 0% packet loss, time 2064ms\nrtt min/avg/max/mdev = 0.056/0.065/0.074/0.007 ms", "stdout_lines": ["PING 172.18.0.103 (172.18.0.103) 56(84) bytes of data.", "64 bytes from 172.18.0.103: icmp_seq=1 ttl=64 time=0.065 ms", "64 bytes from 172.18.0.103: icmp_seq=2 ttl=64 time=0.074 ms", "64 bytes from 172.18.0.103: icmp_seq=3 ttl=64 time=0.056 ms", "", "--- 172.18.0.103 ping statistics ---", "3 packets transmitted, 3 received, 0% packet loss, time 2064ms", "rtt min/avg/max/mdev = 0.056/0.065/0.074/0.007 ms"]} TASK [ceph_migrate : MON - Fail if the IP address is not active in the target node] *** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ping_target_ip.rc != 0", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Unmanage mons] ******************************************** ok: [np0005546415.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mon:/home/tripleo-admin/mon:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mon"], "delta": "0:00:00.744870", "end": "2025-12-05 09:55:50.641151", "rc": 0, "start": "2025-12-05 09:55:49.896281", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mon update...", "stdout_lines": ["Scheduled mon update..."]} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Get tmp mon] **************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005546419", "-f", "json"], "delta": "0:00:00.686863", "end": "2025-12-05 09:55:51.956313", "msg": "", "rc": 0, "start": "2025-12-05 09:55:51.269450", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"0cfef878df0a\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.07%\", \"created\": \"2025-12-05T09:54:43.534702Z\", \"daemon_id\": \"np0005546419\", \"daemon_name\": \"mon.np0005546419\", \"daemon_type\": \"mon\", \"events\": [\"2025-12-05T09:55:22.896697Z daemon:mon.np0005546419 [INFO] \\\"Reconfigured mon.np0005546419 on host 'np0005546419.localdomain'\\\"\"], \"hostname\": \"np0005546419.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:55:04.156901Z\", \"memory_request\": 2147483648, \"memory_usage\": 46955233, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:54:43.423179Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"0cfef878df0a\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.07%\", \"created\": \"2025-12-05T09:54:43.534702Z\", \"daemon_id\": \"np0005546419\", \"daemon_name\": \"mon.np0005546419\", \"daemon_type\": \"mon\", \"events\": [\"2025-12-05T09:55:22.896697Z daemon:mon.np0005546419 [INFO] \\\"Reconfigured mon.np0005546419 on host 'np0005546419.localdomain'\\\"\"], \"hostname\": \"np0005546419.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:55:04.156901Z\", \"memory_request\": 2147483648, \"memory_usage\": 46955233, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:54:43.423179Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : MON - Delete the running mon] ***************************** changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "rm", "mon.np0005546419", "--force"], "delta": "0:00:02.833006", "end": "2025-12-05 09:55:55.448694", "msg": "", "rc": 0, "start": "2025-12-05 09:55:52.615688", "stderr": "", "stderr_lines": [], "stdout": "Removed mon.np0005546419 from host 'np0005546419.localdomain'", "stdout_lines": ["Removed mon.np0005546419 from host 'np0005546419.localdomain'"]} TASK [ceph_migrate : MON - Wait for the current mon to be deleted] ************* Pausing for 10 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2025-12-05 09:55:55.593128", "stderr": "", "stdout": "Paused for 10.07 seconds", "stop": "2025-12-05 09:56:05.662675", "user_input": ""} TASK [ceph_migrate : MON - Redeploy mon on np0005546419.localdomain] *********** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Redeploy mon on np0005546419.localdomain] *********** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "add", "mon", "np0005546419.localdomain:172.18.0.103"], "delta": "0:00:03.715333", "end": "2025-12-05 09:56:09.946985", "msg": "", "rc": 0, "start": "2025-12-05 09:56:06.231652", "stderr": "", "stderr_lines": [], "stdout": "Deployed mon.np0005546419 on host 'np0005546419.localdomain'", "stdout_lines": ["Deployed mon.np0005546419 on host 'np0005546419.localdomain'"]} TASK [ceph_migrate : MON - Wait for the spec to be updated] ******************** Pausing for 10 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2025-12-05 09:56:10.091375", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2025-12-05 09:56:20.103659", "user_input": ""} TASK [ceph_migrate : MON - Check mons quorum] ********************************** changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "-s", "-f", "json"], "delta": "0:00:00.791258", "end": "2025-12-05 09:56:21.400874", "msg": "", "rc": 0, "start": "2025-12-05 09:56:20.609616", "stderr": "", "stderr_lines": [], "stdout": "\n{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":44,\"quorum\":[0,1,2,3,4],\"quorum_names\":[\"np0005546418\",\"np0005546416\",\"np0005546421\",\"np0005546420\",\"np0005546419\"],\"quorum_age\":4,\"monmap\":{\"epoch\":9,\"min_mon_release_name\":\"reef\",\"num_mons\":5},\"osdmap\":{\"epoch\":85,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109572084,\"bytes_used\":566067200,\"bytes_avail\":44505923584,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546420.eqhasr\",\"status\":\"up:active\",\"gid\":26492}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":5,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":85,\"modified\":\"2025-12-05T09:56:03.963085+0000\",\"services\":{\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005546415.knqtle\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":44,\"quorum\":[0,1,2,3,4],\"quorum_names\":[\"np0005546418\",\"np0005546416\",\"np0005546421\",\"np0005546420\",\"np0005546419\"],\"quorum_age\":4,\"monmap\":{\"epoch\":9,\"min_mon_release_name\":\"reef\",\"num_mons\":5},\"osdmap\":{\"epoch\":85,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109572084,\"bytes_used\":566067200,\"bytes_avail\":44505923584,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546420.eqhasr\",\"status\":\"up:active\",\"gid\":26492}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":5,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":85,\"modified\":\"2025-12-05T09:56:03.963085+0000\",\"services\":{\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005546415.knqtle\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}"]} TASK [ceph_migrate : reconfig osds] ******************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "reconfig", "osd.default_drive_group"], "delta": "0:00:00.874918", "end": "2025-12-05 09:56:22.916606", "msg": "", "rc": 0, "start": "2025-12-05 09:56:22.041688", "stderr": "", "stderr_lines": [], "stdout": "Scheduled to reconfig osd.0 on host 'np0005546419.localdomain'\nScheduled to reconfig osd.3 on host 'np0005546419.localdomain'\nScheduled to reconfig osd.1 on host 'np0005546420.localdomain'\nScheduled to reconfig osd.4 on host 'np0005546420.localdomain'\nScheduled to reconfig osd.2 on host 'np0005546421.localdomain'\nScheduled to reconfig osd.5 on host 'np0005546421.localdomain'", "stdout_lines": ["Scheduled to reconfig osd.0 on host 'np0005546419.localdomain'", "Scheduled to reconfig osd.3 on host 'np0005546419.localdomain'", "Scheduled to reconfig osd.1 on host 'np0005546420.localdomain'", "Scheduled to reconfig osd.4 on host 'np0005546420.localdomain'", "Scheduled to reconfig osd.2 on host 'np0005546421.localdomain'", "Scheduled to reconfig osd.5 on host 'np0005546421.localdomain'"]} TASK [ceph_migrate : force-fail ceph mgr] ************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/fail_mgr.yaml for np0005546415.localdomain TASK [ceph_migrate : Refresh ceph_cli] ***************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005546415.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Force fail ceph mgr] ************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "fail"], "delta": "0:00:00.894132", "end": "2025-12-05 09:56:24.579888", "msg": "", "rc": 0, "start": "2025-12-05 09:56:23.685756", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Wait for cephadm to reconcile] **************************** Pausing for 10 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2025-12-05 09:56:24.696122", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2025-12-05 09:56:34.707691", "user_input": ""} TASK [ceph_migrate : Get the ceph orchestrator status with] ******************** ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j955661938832.485168 started=1 finished=0 ASYNC OK on np0005546415.localdomain: jid=j955661938832.485168 changed: [np0005546415.localdomain] => {"ansible_job_id": "j955661938832.485168", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "status", "--format", "json"], "delta": "0:00:21.642978", "end": "2025-12-05 09:56:57.131611", "failed_when_result": false, "finished": 1, "msg": "", "rc": 0, "results_file": "/root/.ansible_async/j955661938832.485168", "start": "2025-12-05 09:56:35.488633", "started": 1, "stderr": "", "stderr_lines": [], "stdout": "\n{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}", "stdout_lines": ["", "{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}"]} TASK [ceph_migrate : Restart the active mgr] *********************************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Fail if ceph orchestrator is still not responding] ******** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Manage mons] **************************************** ok: [np0005546415.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mon:/home/tripleo-admin/mon:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mon"], "delta": "0:00:00.754218", "end": "2025-12-05 09:57:00.363575", "rc": 0, "start": "2025-12-05 09:56:59.609357", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mon update...", "stdout_lines": ["Scheduled mon update..."]} TASK [ceph_migrate : MON - wait daemons] *************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005546415.localdomain TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mon] ********************************************* changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005546419", "-f", "json"], "delta": "0:00:00.753906", "end": "2025-12-05 09:57:01.808535", "msg": "", "rc": 0, "start": "2025-12-05 09:57:01.054629", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"5de521872e63\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.71%\", \"created\": \"2025-12-05T09:56:09.710256Z\", \"daemon_id\": \"np0005546419\", \"daemon_name\": \"mon.np0005546419\", \"daemon_type\": \"mon\", \"hostname\": \"np0005546419.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:56:59.068506Z\", \"memory_request\": 2147483648, \"memory_usage\": 57126420, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:56:09.609834Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"5de521872e63\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.71%\", \"created\": \"2025-12-05T09:56:09.710256Z\", \"daemon_id\": \"np0005546419\", \"daemon_name\": \"mon.np0005546419\", \"daemon_type\": \"mon\", \"hostname\": \"np0005546419.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:56:59.068506Z\", \"memory_request\": 2147483648, \"memory_usage\": 57126420, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:56:09.609834Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005546415.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Migrate mon] ********************************************** ok: [np0005546415.localdomain] => { "msg": "Migrate mon: np0005546416.localdomain to node: np0005546420.localdomain" } TASK [ceph_migrate : MON - Get current mon IP address from node_map override] *** ok: [np0005546415.localdomain] => {"ansible_facts": {"mon_ipaddr": "172.18.0.104"}, "changed": false} TASK [ceph_migrate : MON - Check mons quorum] ********************************** changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "-s", "-f", "json"], "delta": "0:00:00.775000", "end": "2025-12-05 09:57:03.411939", "msg": "", "rc": 0, "start": "2025-12-05 09:57:02.636939", "stderr": "", "stderr_lines": [], "stdout": "\n{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":44,\"quorum\":[0,1,2,3,4],\"quorum_names\":[\"np0005546418\",\"np0005546416\",\"np0005546421\",\"np0005546420\",\"np0005546419\"],\"quorum_age\":46,\"monmap\":{\"epoch\":9,\"min_mon_release_name\":\"reef\",\"num_mons\":5},\"osdmap\":{\"epoch\":87,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109573208,\"bytes_used\":566231040,\"bytes_avail\":44505759744,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546420.eqhasr\",\"status\":\"up:active\",\"gid\":26492}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":4,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":86,\"modified\":\"2025-12-05T09:56:56.995694+0000\",\"services\":{\"mds\":{\"daemons\":{\"summary\":\"\",\"mds.np0005546419.rweotn\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005546420.eqhasr\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005546421.tuudjq\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005546416.kmqcnq\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546418.garyvl\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546419.zhsnqq\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546420.aoeylc\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546421.sukfea\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005546416\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546418\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546419\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546420\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546421\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"osd\":{\"daemons\":{\"summary\":\"\",\"0\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"1\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"2\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"3\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"4\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"5\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":44,\"quorum\":[0,1,2,3,4],\"quorum_names\":[\"np0005546418\",\"np0005546416\",\"np0005546421\",\"np0005546420\",\"np0005546419\"],\"quorum_age\":46,\"monmap\":{\"epoch\":9,\"min_mon_release_name\":\"reef\",\"num_mons\":5},\"osdmap\":{\"epoch\":87,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109573208,\"bytes_used\":566231040,\"bytes_avail\":44505759744,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546420.eqhasr\",\"status\":\"up:active\",\"gid\":26492}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":4,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":86,\"modified\":\"2025-12-05T09:56:56.995694+0000\",\"services\":{\"mds\":{\"daemons\":{\"summary\":\"\",\"mds.np0005546419.rweotn\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005546420.eqhasr\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005546421.tuudjq\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005546416.kmqcnq\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546418.garyvl\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546419.zhsnqq\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546420.aoeylc\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546421.sukfea\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005546416\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546418\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546419\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546420\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005546421\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"osd\":{\"daemons\":{\"summary\":\"\",\"0\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"1\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"2\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"3\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"4\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"5\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}"]} TASK [ceph_migrate : Backup data for client purposes] ************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/backup.yaml for np0005546415.localdomain TASK [ceph_migrate : Ensure backup directory exists] *************************** changed: [np0005546415.localdomain -> np0005546416.localdomain(192.168.122.104)] => {"changed": true, "gid": 1003, "group": "tripleo-admin", "mode": "0755", "owner": "tripleo-admin", "path": "/home/tripleo-admin/ceph_client", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 6, "state": "directory", "uid": 1003} TASK [ceph_migrate : Check file in the src directory] ************************** ok: [np0005546415.localdomain -> np0005546416.localdomain(192.168.122.104)] => {"changed": false, "examined": 2, "files": [{"atime": 1764928621.2468307, "ctime": 1764928621.677844, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1174406448, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1764928621.4538372, "nlink": 1, "path": "/etc/ceph/ceph.conf", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 367, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1764928622.5168698, "ctime": 1764928622.8268793, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1174406449, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0600", "mtime": 1764928622.6488738, "nlink": 1, "path": "/etc/ceph/ceph.client.admin.keyring", "pw_name": "root", "rgrp": false, "roth": false, "rusr": true, "size": 151, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}], "matched": 2, "msg": "All paths examined", "skipped_paths": {}} TASK [ceph_migrate : Backup ceph client data] ********************************** changed: [np0005546415.localdomain -> np0005546416.localdomain(192.168.122.104)] => (item={'path': '/etc/ceph/ceph.conf', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 367, 'inode': 1174406448, 'dev': 64516, 'nlink': 1, 'atime': 1764928621.2468307, 'mtime': 1764928621.4538372, 'ctime': 1764928621.677844, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d0c92e8b21a49a45de6ddb33dd336ee4f07fabd", "dest": "/home/tripleo-admin/ceph_client/ceph.conf", "gid": 0, "group": "root", "item": {"atime": 1764928621.2468307, "ctime": 1764928621.677844, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1174406448, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1764928621.4538372, "nlink": 1, "path": "/etc/ceph/ceph.conf", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 367, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "a68c2bbd6e40bd58ca78b124d8c5fd99", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 367, "src": "/etc/ceph/ceph.conf", "state": "file", "uid": 0} changed: [np0005546415.localdomain -> np0005546416.localdomain(192.168.122.104)] => (item={'path': '/etc/ceph/ceph.client.admin.keyring', 'mode': '0600', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 151, 'inode': 1174406449, 'dev': 64516, 'nlink': 1, 'atime': 1764928622.5168698, 'mtime': 1764928622.6488738, 'ctime': 1764928622.8268793, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': False, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "e727e4b15c8bb6c152697f1eb76bbef93e7df730", "dest": "/home/tripleo-admin/ceph_client/ceph.client.admin.keyring", "gid": 0, "group": "root", "item": {"atime": 1764928622.5168698, "ctime": 1764928622.8268793, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1174406449, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0600", "mtime": 1764928622.6488738, "nlink": 1, "path": "/etc/ceph/ceph.client.admin.keyring", "pw_name": "root", "rgrp": false, "roth": false, "rusr": true, "size": 151, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "508a8780164e984fb776cef183e28f07", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 151, "src": "/etc/ceph/ceph.client.admin.keyring", "state": "file", "uid": 0} TASK [ceph_migrate : MON - Get the current active mgr] ************************* changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "stat", "-f", "json"], "delta": "0:00:00.709906", "end": "2025-12-05 09:57:08.207858", "msg": "", "rc": 0, "start": "2025-12-05 09:57:07.497952", "stderr": "", "stderr_lines": [], "stdout": "\n{\"epoch\":24,\"available\":true,\"active_name\":\"np0005546416.kmqcnq\",\"num_standby\":4}", "stdout_lines": ["", "{\"epoch\":24,\"available\":true,\"active_name\":\"np0005546416.kmqcnq\",\"num_standby\":4}"]} TASK [ceph_migrate : MON - Load mgr data] ************************************** ok: [np0005546415.localdomain] => {"ansible_facts": {"mgr": {"active_name": "np0005546416.kmqcnq", "available": true, "epoch": 24, "num_standby": 4}}, "changed": false} TASK [ceph_migrate : Print active mgr] ***************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Fail mgr if active in the current node] ******************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/fail_mgr.yaml for np0005546415.localdomain TASK [ceph_migrate : Refresh ceph_cli] ***************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005546415.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Force fail ceph mgr] ************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "fail"], "delta": "0:00:00.820072", "end": "2025-12-05 09:57:09.889812", "msg": "", "rc": 0, "start": "2025-12-05 09:57:09.069740", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Wait for cephadm to reconcile] **************************** Pausing for 10 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2025-12-05 09:57:10.008366", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2025-12-05 09:57:20.020950", "user_input": ""} TASK [ceph_migrate : Get the ceph orchestrator status with] ******************** ASYNC OK on np0005546415.localdomain: jid=j48037245463.487535 changed: [np0005546415.localdomain] => {"ansible_job_id": "j48037245463.487535", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "status", "--format", "json"], "delta": "0:00:00.786884", "end": "2025-12-05 09:57:21.612882", "failed_when_result": false, "finished": 1, "msg": "", "rc": 0, "results_file": "/root/.ansible_async/j48037245463.487535", "start": "2025-12-05 09:57:20.825998", "started": 1, "stderr": "", "stderr_lines": [], "stdout": "\n{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}", "stdout_lines": ["", "{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}"]} TASK [ceph_migrate : Restart the active mgr] *********************************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Fail if ceph orchestrator is still not responding] ******** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Drain and rm --force the cur_mon host] ************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/drain.yaml for np0005546415.localdomain TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005546415.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : MON - wait daemons] *************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005546416", "-f", "json"], "delta": "0:00:00.725651", "end": "2025-12-05 09:57:24.277686", "msg": "", "rc": 0, "start": "2025-12-05 09:57:23.552035", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"be4a2e7f3587\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.11%\", \"created\": \"2025-12-05T07:51:26.667877Z\", \"daemon_id\": \"np0005546416\", \"daemon_name\": \"mon.np0005546416\", \"daemon_type\": \"mon\", \"hostname\": \"np0005546416.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:57:11.781668Z\", \"memory_request\": 2147483648, \"memory_usage\": 135371161, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T07:51:26.513110Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"be4a2e7f3587\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.11%\", \"created\": \"2025-12-05T07:51:26.667877Z\", \"daemon_id\": \"np0005546416\", \"daemon_name\": \"mon.np0005546416\", \"daemon_type\": \"mon\", \"hostname\": \"np0005546416.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:57:11.781668Z\", \"memory_request\": 2147483648, \"memory_usage\": 135371161, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T07:51:26.513110Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : DRAIN - Delete the mon running on the current controller node] *** changed: [np0005546415.localdomain -> np0005546416.localdomain(192.168.122.104)] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "rm", "mon.np0005546416", "--force"], "delta": "0:00:07.804827", "end": "2025-12-05 09:57:32.834060", "msg": "", "rc": 0, "start": "2025-12-05 09:57:25.029233", "stderr": "", "stderr_lines": [], "stdout": "Removed mon.np0005546416 from host 'np0005546416.localdomain'", "stdout_lines": ["Removed mon.np0005546416 from host 'np0005546416.localdomain'"]} TASK [ceph_migrate : DRAIN - remove label from the src node] ******************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/labels.yaml for np0005546415.localdomain TASK [ceph_migrate : Set/Unset labels - rm] ************************************ skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - rm] ************************************ changed: [np0005546415.localdomain] => (item=['np0005546416.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005546416.localdomain", "mon"], "delta": "0:00:01.137232", "end": "2025-12-05 09:57:35.774535", "item": ["np0005546416.localdomain", "mon"], "msg": "", "rc": 0, "start": "2025-12-05 09:57:34.637303", "stderr": "", "stderr_lines": [], "stdout": "Removed label mon from host np0005546416.localdomain", "stdout_lines": ["Removed label mon from host np0005546416.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546416.localdomain', 'mgr']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005546416.localdomain", "mgr"], "delta": "0:00:00.712722", "end": "2025-12-05 09:57:37.026389", "item": ["np0005546416.localdomain", "mgr"], "msg": "", "rc": 0, "start": "2025-12-05 09:57:36.313667", "stderr": "", "stderr_lines": [], "stdout": "Removed label mgr from host np0005546416.localdomain", "stdout_lines": ["Removed label mgr from host np0005546416.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546416.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005546416.localdomain", "_admin"], "delta": "0:00:00.810909", "end": "2025-12-05 09:57:38.422227", "item": ["np0005546416.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2025-12-05 09:57:37.611318", "stderr": "", "stderr_lines": [], "stdout": "Removed label _admin from host np0005546416.localdomain", "stdout_lines": ["Removed label _admin from host np0005546416.localdomain"]} TASK [ceph_migrate : Wait for the orchestrator to remove labels] *************** Pausing for 10 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2025-12-05 09:57:38.543499", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2025-12-05 09:57:48.555895", "user_input": ""} TASK [ceph_migrate : DRAIN - Drain the host] *********************************** changed: [np0005546415.localdomain -> np0005546416.localdomain(192.168.122.104)] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "drain", "np0005546416.localdomain"], "delta": "0:00:00.781803", "end": "2025-12-05 09:57:50.040213", "msg": "", "rc": 0, "start": "2025-12-05 09:57:49.258410", "stderr": "", "stderr_lines": [], "stdout": "Scheduled to remove the following daemons from host 'np0005546416.localdomain'\ntype id \n-------------------- ---------------\ncrash np0005546416 ", "stdout_lines": ["Scheduled to remove the following daemons from host 'np0005546416.localdomain'", "type id ", "-------------------- ---------------", "crash np0005546416 "]} TASK [ceph_migrate : DRAIN - cleanup the host] ********************************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "force_clean | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - check host in hostmap] ****************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "ls", "--host_pattern", "np0005546416.localdomain", "-f", "json"], "delta": "0:00:00.878179", "end": "2025-12-05 09:57:51.544928", "msg": "", "rc": 0, "start": "2025-12-05 09:57:50.666749", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"addr\": \"192.168.122.104\", \"hostname\": \"np0005546416.localdomain\", \"labels\": [\"_no_schedule\", \"_no_conf_keyring\"], \"status\": \"\"}]", "stdout_lines": ["", "[{\"addr\": \"192.168.122.104\", \"hostname\": \"np0005546416.localdomain\", \"labels\": [\"_no_schedule\", \"_no_conf_keyring\"], \"status\": \"\"}]"]} TASK [ceph_migrate : MON - rm the cur_mon host from the Ceph cluster] ********** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "rm", "np0005546416.localdomain", "--force"], "delta": "0:00:00.761022", "end": "2025-12-05 09:57:52.928035", "msg": "", "rc": 0, "start": "2025-12-05 09:57:52.167013", "stderr": "", "stderr_lines": [], "stdout": "Removed host 'np0005546416.localdomain'", "stdout_lines": ["Removed host 'np0005546416.localdomain'"]} TASK [ceph_migrate : MON - Get current mon IP address] ************************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "mon_ipaddr is not defined", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Migrate the mon ip address from src to target node] *** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/network.yaml for np0005546415.localdomain TASK [ceph_migrate : MON - Print current mon IP address] *********************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Patch net-config config and remove the IP address (src node)] *** changed: [np0005546415.localdomain -> np0005546416.localdomain(192.168.122.104)] => {"backup": "/etc/os-net-config/tripleo_config.yaml.470289.2025-12-05@09:57:53~", "changed": true, "found": 1, "msg": "1 line(s) removed"} TASK [ceph_migrate : MON - Refresh os-net-config (src node)] ******************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "not manual_migration | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - manually rm the ip address (src node)] ************** changed: [np0005546415.localdomain -> np0005546416.localdomain(192.168.122.104)] => {"changed": true, "cmd": ["ip", "a", "del", "172.18.0.104/24", "dev", "vlan21"], "delta": "0:00:00.007837", "end": "2025-12-05 09:57:54.637445", "msg": "", "rc": 0, "start": "2025-12-05 09:57:54.629608", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : MON - Patch net-config config and add the IP address (target node)] *** changed: [np0005546415.localdomain -> np0005546420.localdomain(192.168.122.107)] => {"backup": "/etc/os-net-config/tripleo_config.yaml.296239.2025-12-05@09:57:55~", "changed": true, "msg": "line added"} TASK [ceph_migrate : MON - Refresh os-net-config (target_node)] **************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "not manual_migration | bool | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - statically assign the ip address to the target node] *** changed: [np0005546415.localdomain -> np0005546420.localdomain(192.168.122.107)] => {"changed": true, "cmd": ["ip", "a", "add", "172.18.0.104/24", "dev", "vlan21"], "delta": "0:00:00.005498", "end": "2025-12-05 09:57:56.834288", "msg": "", "rc": 0, "start": "2025-12-05 09:57:56.828790", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : MON - ping ip address to see if is reachable on the target node] *** changed: [np0005546415.localdomain -> np0005546420.localdomain(192.168.122.107)] => {"changed": true, "cmd": ["ping", "-W1", "-c", "3", "172.18.0.104"], "delta": "0:00:02.096500", "end": "2025-12-05 09:57:59.673446", "msg": "", "rc": 0, "start": "2025-12-05 09:57:57.576946", "stderr": "", "stderr_lines": [], "stdout": "PING 172.18.0.104 (172.18.0.104) 56(84) bytes of data.\n64 bytes from 172.18.0.104: icmp_seq=1 ttl=64 time=0.695 ms\n64 bytes from 172.18.0.104: icmp_seq=2 ttl=64 time=0.093 ms\n64 bytes from 172.18.0.104: icmp_seq=3 ttl=64 time=0.792 ms\n\n--- 172.18.0.104 ping statistics ---\n3 packets transmitted, 3 received, 0% packet loss, time 2089ms\nrtt min/avg/max/mdev = 0.093/0.526/0.792/0.309 ms", "stdout_lines": ["PING 172.18.0.104 (172.18.0.104) 56(84) bytes of data.", "64 bytes from 172.18.0.104: icmp_seq=1 ttl=64 time=0.695 ms", "64 bytes from 172.18.0.104: icmp_seq=2 ttl=64 time=0.093 ms", "64 bytes from 172.18.0.104: icmp_seq=3 ttl=64 time=0.792 ms", "", "--- 172.18.0.104 ping statistics ---", "3 packets transmitted, 3 received, 0% packet loss, time 2089ms", "rtt min/avg/max/mdev = 0.093/0.526/0.792/0.309 ms"]} TASK [ceph_migrate : MON - Fail if the IP address is not active in the target node] *** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ping_target_ip.rc != 0", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Unmanage mons] ******************************************** ok: [np0005546415.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mon:/home/tripleo-admin/mon:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mon"], "delta": "0:00:00.740139", "end": "2025-12-05 09:58:01.155416", "rc": 0, "start": "2025-12-05 09:58:00.415277", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mon update...", "stdout_lines": ["Scheduled mon update..."]} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Get tmp mon] **************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005546420", "-f", "json"], "delta": "0:00:00.839198", "end": "2025-12-05 09:58:02.621669", "msg": "", "rc": 0, "start": "2025-12-05 09:58:01.782471", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"645b8ccfa2de\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.60%\", \"created\": \"2025-12-05T09:54:37.922123Z\", \"daemon_id\": \"np0005546420\", \"daemon_name\": \"mon.np0005546420\", \"daemon_type\": \"mon\", \"events\": [\"2025-12-05T09:58:00.763092Z daemon:mon.np0005546420 [INFO] \\\"Reconfigured mon.np0005546420 on host 'np0005546420.localdomain'\\\"\"], \"hostname\": \"np0005546420.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:57:12.272689Z\", \"memory_request\": 2147483648, \"memory_usage\": 73085747, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:54:37.820134Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"645b8ccfa2de\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.60%\", \"created\": \"2025-12-05T09:54:37.922123Z\", \"daemon_id\": \"np0005546420\", \"daemon_name\": \"mon.np0005546420\", \"daemon_type\": \"mon\", \"events\": [\"2025-12-05T09:58:00.763092Z daemon:mon.np0005546420 [INFO] \\\"Reconfigured mon.np0005546420 on host 'np0005546420.localdomain'\\\"\"], \"hostname\": \"np0005546420.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:57:12.272689Z\", \"memory_request\": 2147483648, \"memory_usage\": 73085747, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:54:37.820134Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : MON - Delete the running mon] ***************************** changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "rm", "mon.np0005546420", "--force"], "delta": "0:00:02.323366", "end": "2025-12-05 09:58:05.601205", "msg": "", "rc": 0, "start": "2025-12-05 09:58:03.277839", "stderr": "", "stderr_lines": [], "stdout": "Removed mon.np0005546420 from host 'np0005546420.localdomain'", "stdout_lines": ["Removed mon.np0005546420 from host 'np0005546420.localdomain'"]} TASK [ceph_migrate : MON - Wait for the current mon to be deleted] ************* Pausing for 10 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2025-12-05 09:58:05.753836", "stderr": "", "stdout": "Paused for 10.02 seconds", "stop": "2025-12-05 09:58:15.770037", "user_input": ""} TASK [ceph_migrate : MON - Redeploy mon on np0005546420.localdomain] *********** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Redeploy mon on np0005546420.localdomain] *********** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "add", "mon", "np0005546420.localdomain:172.18.0.104"], "delta": "0:00:03.793787", "end": "2025-12-05 09:58:20.170837", "msg": "", "rc": 0, "start": "2025-12-05 09:58:16.377050", "stderr": "", "stderr_lines": [], "stdout": "Deployed mon.np0005546420 on host 'np0005546420.localdomain'", "stdout_lines": ["Deployed mon.np0005546420 on host 'np0005546420.localdomain'"]} TASK [ceph_migrate : MON - Wait for the spec to be updated] ******************** Pausing for 10 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2025-12-05 09:58:20.298403", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2025-12-05 09:58:30.309840", "user_input": ""} TASK [ceph_migrate : MON - Check mons quorum] ********************************** changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "-s", "-f", "json"], "delta": "0:00:04.108157", "end": "2025-12-05 09:58:34.966890", "msg": "", "rc": 0, "start": "2025-12-05 09:58:30.858733", "stderr": "", "stderr_lines": [], "stdout": "\n{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":52,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005546418\",\"np0005546421\",\"np0005546419\"],\"quorum_age\":30,\"monmap\":{\"epoch\":11,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":88,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109574332,\"bytes_used\":566284288,\"bytes_avail\":44505706496,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546420.eqhasr\",\"status\":\"up:active\",\"gid\":26492}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":4,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":91,\"modified\":\"2025-12-05T09:58:17.800022+0000\",\"services\":{}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":52,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005546418\",\"np0005546421\",\"np0005546419\"],\"quorum_age\":30,\"monmap\":{\"epoch\":11,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":88,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109574332,\"bytes_used\":566284288,\"bytes_avail\":44505706496,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546420.eqhasr\",\"status\":\"up:active\",\"gid\":26492}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":4,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":91,\"modified\":\"2025-12-05T09:58:17.800022+0000\",\"services\":{}},\"progress_events\":{}}"]} TASK [ceph_migrate : reconfig osds] ******************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "reconfig", "osd.default_drive_group"], "delta": "0:00:04.128194", "end": "2025-12-05 09:58:39.741085", "msg": "", "rc": 0, "start": "2025-12-05 09:58:35.612891", "stderr": "", "stderr_lines": [], "stdout": "Scheduled to reconfig osd.0 on host 'np0005546419.localdomain'\nScheduled to reconfig osd.3 on host 'np0005546419.localdomain'\nScheduled to reconfig osd.1 on host 'np0005546420.localdomain'\nScheduled to reconfig osd.4 on host 'np0005546420.localdomain'\nScheduled to reconfig osd.2 on host 'np0005546421.localdomain'\nScheduled to reconfig osd.5 on host 'np0005546421.localdomain'", "stdout_lines": ["Scheduled to reconfig osd.0 on host 'np0005546419.localdomain'", "Scheduled to reconfig osd.3 on host 'np0005546419.localdomain'", "Scheduled to reconfig osd.1 on host 'np0005546420.localdomain'", "Scheduled to reconfig osd.4 on host 'np0005546420.localdomain'", "Scheduled to reconfig osd.2 on host 'np0005546421.localdomain'", "Scheduled to reconfig osd.5 on host 'np0005546421.localdomain'"]} TASK [ceph_migrate : force-fail ceph mgr] ************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/fail_mgr.yaml for np0005546415.localdomain TASK [ceph_migrate : Refresh ceph_cli] ***************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005546415.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Force fail ceph mgr] ************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "fail"], "delta": "0:00:00.824208", "end": "2025-12-05 09:58:41.405744", "msg": "", "rc": 0, "start": "2025-12-05 09:58:40.581536", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Wait for cephadm to reconcile] **************************** Pausing for 10 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2025-12-05 09:58:41.523060", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2025-12-05 09:58:51.533501", "user_input": ""} TASK [ceph_migrate : Get the ceph orchestrator status with] ******************** ASYNC OK on np0005546415.localdomain: jid=j624793547142.490443 changed: [np0005546415.localdomain] => {"ansible_job_id": "j624793547142.490443", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "status", "--format", "json"], "delta": "0:00:00.712411", "end": "2025-12-05 09:58:52.994935", "failed_when_result": false, "finished": 1, "msg": "", "rc": 0, "results_file": "/root/.ansible_async/j624793547142.490443", "start": "2025-12-05 09:58:52.282524", "started": 1, "stderr": "", "stderr_lines": [], "stdout": "\n{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}", "stdout_lines": ["", "{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}"]} TASK [ceph_migrate : Restart the active mgr] *********************************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Fail if ceph orchestrator is still not responding] ******** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Manage mons] **************************************** ok: [np0005546415.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mon:/home/tripleo-admin/mon:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mon"], "delta": "0:00:00.747714", "end": "2025-12-05 09:58:55.550978", "rc": 0, "start": "2025-12-05 09:58:54.803264", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mon update...", "stdout_lines": ["Scheduled mon update..."]} TASK [ceph_migrate : MON - wait daemons] *************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005546415.localdomain TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mon] ********************************************* changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005546420", "-f", "json"], "delta": "0:00:00.820939", "end": "2025-12-05 09:58:57.029610", "msg": "", "rc": 0, "start": "2025-12-05 09:58:56.208671", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"d3eb7a8501e2\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.72%\", \"created\": \"2025-12-05T09:58:19.909866Z\", \"daemon_id\": \"np0005546420\", \"daemon_name\": \"mon.np0005546420\", \"daemon_type\": \"mon\", \"hostname\": \"np0005546420.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:58:43.500769Z\", \"memory_request\": 2147483648, \"memory_usage\": 63124275, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:58:19.784296Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"d3eb7a8501e2\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.72%\", \"created\": \"2025-12-05T09:58:19.909866Z\", \"daemon_id\": \"np0005546420\", \"daemon_name\": \"mon.np0005546420\", \"daemon_type\": \"mon\", \"hostname\": \"np0005546420.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:58:43.500769Z\", \"memory_request\": 2147483648, \"memory_usage\": 63124275, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:58:19.784296Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005546415.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Migrate mon] ********************************************** ok: [np0005546415.localdomain] => { "msg": "Migrate mon: np0005546418.localdomain to node: np0005546421.localdomain" } TASK [ceph_migrate : MON - Get current mon IP address from node_map override] *** ok: [np0005546415.localdomain] => {"ansible_facts": {"mon_ipaddr": "172.18.0.105"}, "changed": false} TASK [ceph_migrate : MON - Check mons quorum] ********************************** changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "-s", "-f", "json"], "delta": "0:00:00.765184", "end": "2025-12-05 09:58:58.635318", "msg": "", "rc": 0, "start": "2025-12-05 09:58:57.870134", "stderr": "", "stderr_lines": [], "stdout": "\n{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":52,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005546418\",\"np0005546421\",\"np0005546419\"],\"quorum_age\":54,\"monmap\":{\"epoch\":11,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":89,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109575456,\"bytes_used\":566370304,\"bytes_avail\":44505620480,\"bytes_total\":45071990784,\"read_bytes_sec\":17566,\"write_bytes_sec\":0,\"read_op_per_sec\":7,\"write_op_per_sec\":1},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546420.eqhasr\",\"status\":\"up:active\",\"gid\":26492}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":3,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":91,\"modified\":\"2025-12-05T09:58:17.800022+0000\",\"services\":{}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":52,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005546418\",\"np0005546421\",\"np0005546419\"],\"quorum_age\":54,\"monmap\":{\"epoch\":11,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":89,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109575456,\"bytes_used\":566370304,\"bytes_avail\":44505620480,\"bytes_total\":45071990784,\"read_bytes_sec\":17566,\"write_bytes_sec\":0,\"read_op_per_sec\":7,\"write_op_per_sec\":1},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546420.eqhasr\",\"status\":\"up:active\",\"gid\":26492}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":3,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":91,\"modified\":\"2025-12-05T09:58:17.800022+0000\",\"services\":{}},\"progress_events\":{}}"]} TASK [ceph_migrate : Backup data for client purposes] ************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/backup.yaml for np0005546415.localdomain TASK [ceph_migrate : Ensure backup directory exists] *************************** changed: [np0005546415.localdomain -> np0005546418.localdomain(192.168.122.105)] => {"changed": true, "gid": 1003, "group": "tripleo-admin", "mode": "0755", "owner": "tripleo-admin", "path": "/home/tripleo-admin/ceph_client", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 6, "state": "directory", "uid": 1003} TASK [ceph_migrate : Check file in the src directory] ************************** ok: [np0005546415.localdomain -> np0005546418.localdomain(192.168.122.105)] => {"changed": false, "examined": 2, "files": [{"atime": 1764928725.7210698, "ctime": 1764928726.0990813, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1291846247, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1764928725.859074, "nlink": 1, "path": "/etc/ceph/ceph.conf", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 271, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1764928726.951107, "ctime": 1764928727.348119, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1291942428, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0600", "mtime": 1764928727.1661136, "nlink": 1, "path": "/etc/ceph/ceph.client.admin.keyring", "pw_name": "root", "rgrp": false, "roth": false, "rusr": true, "size": 151, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}], "matched": 2, "msg": "All paths examined", "skipped_paths": {}} TASK [ceph_migrate : Backup ceph client data] ********************************** changed: [np0005546415.localdomain -> np0005546418.localdomain(192.168.122.105)] => (item={'path': '/etc/ceph/ceph.conf', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 271, 'inode': 1291846247, 'dev': 64516, 'nlink': 1, 'atime': 1764928725.7210698, 'mtime': 1764928725.859074, 'ctime': 1764928726.0990813, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "b0331e0d731b678f868d45892f48b6dd99af8d5c", "dest": "/home/tripleo-admin/ceph_client/ceph.conf", "gid": 0, "group": "root", "item": {"atime": 1764928725.7210698, "ctime": 1764928726.0990813, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1291846247, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1764928725.859074, "nlink": 1, "path": "/etc/ceph/ceph.conf", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 271, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "1ab52b565c8db87730387daa6b529986", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 271, "src": "/etc/ceph/ceph.conf", "state": "file", "uid": 0} changed: [np0005546415.localdomain -> np0005546418.localdomain(192.168.122.105)] => (item={'path': '/etc/ceph/ceph.client.admin.keyring', 'mode': '0600', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 151, 'inode': 1291942428, 'dev': 64516, 'nlink': 1, 'atime': 1764928726.951107, 'mtime': 1764928727.1661136, 'ctime': 1764928727.348119, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': False, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "e727e4b15c8bb6c152697f1eb76bbef93e7df730", "dest": "/home/tripleo-admin/ceph_client/ceph.client.admin.keyring", "gid": 0, "group": "root", "item": {"atime": 1764928726.951107, "ctime": 1764928727.348119, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1291942428, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0600", "mtime": 1764928727.1661136, "nlink": 1, "path": "/etc/ceph/ceph.client.admin.keyring", "pw_name": "root", "rgrp": false, "roth": false, "rusr": true, "size": 151, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "508a8780164e984fb776cef183e28f07", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 151, "src": "/etc/ceph/ceph.client.admin.keyring", "state": "file", "uid": 0} TASK [ceph_migrate : MON - Get the current active mgr] ************************* changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "stat", "-f", "json"], "delta": "0:00:03.882206", "end": "2025-12-05 09:59:06.333615", "msg": "", "rc": 0, "start": "2025-12-05 09:59:02.451409", "stderr": "", "stderr_lines": [], "stdout": "\n{\"epoch\":35,\"available\":true,\"active_name\":\"np0005546420.aoeylc\",\"num_standby\":3}", "stdout_lines": ["", "{\"epoch\":35,\"available\":true,\"active_name\":\"np0005546420.aoeylc\",\"num_standby\":3}"]} TASK [ceph_migrate : MON - Load mgr data] ************************************** ok: [np0005546415.localdomain] => {"ansible_facts": {"mgr": {"active_name": "np0005546420.aoeylc", "available": true, "epoch": 35, "num_standby": 3}}, "changed": false} TASK [ceph_migrate : Print active mgr] ***************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Fail mgr if active in the current node] ******************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "mgr.active_name | regex_search(cur_mon | split('.') | first) or mgr.active_name | regex_search(target_node | split('.') | first)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Drain and rm --force the cur_mon host] ************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/drain.yaml for np0005546415.localdomain TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005546415.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : MON - wait daemons] *************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005546418", "-f", "json"], "delta": "0:00:00.816877", "end": "2025-12-05 09:59:08.009633", "msg": "", "rc": 0, "start": "2025-12-05 09:59:07.192756", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"c4de4913ed91\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.11%\", \"created\": \"2025-12-05T07:51:24.058793Z\", \"daemon_id\": \"np0005546418\", \"daemon_name\": \"mon.np0005546418\", \"daemon_type\": \"mon\", \"events\": [\"2025-12-05T09:58:58.316917Z daemon:mon.np0005546418 [INFO] \\\"Reconfigured mon.np0005546418 on host 'np0005546418.localdomain'\\\"\"], \"hostname\": \"np0005546418.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:58:43.214838Z\", \"memory_request\": 2147483648, \"memory_usage\": 150785228, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T07:51:23.381755Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"c4de4913ed91\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.11%\", \"created\": \"2025-12-05T07:51:24.058793Z\", \"daemon_id\": \"np0005546418\", \"daemon_name\": \"mon.np0005546418\", \"daemon_type\": \"mon\", \"events\": [\"2025-12-05T09:58:58.316917Z daemon:mon.np0005546418 [INFO] \\\"Reconfigured mon.np0005546418 on host 'np0005546418.localdomain'\\\"\"], \"hostname\": \"np0005546418.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:58:43.214838Z\", \"memory_request\": 2147483648, \"memory_usage\": 150785228, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T07:51:23.381755Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : DRAIN - Delete the mon running on the current controller node] *** changed: [np0005546415.localdomain -> np0005546418.localdomain(192.168.122.105)] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "rm", "mon.np0005546418", "--force"], "delta": "0:00:02.512754", "end": "2025-12-05 09:59:11.366969", "msg": "", "rc": 0, "start": "2025-12-05 09:59:08.854215", "stderr": "", "stderr_lines": [], "stdout": "Removed mon.np0005546418 from host 'np0005546418.localdomain'", "stdout_lines": ["Removed mon.np0005546418 from host 'np0005546418.localdomain'"]} TASK [ceph_migrate : DRAIN - remove label from the src node] ******************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/labels.yaml for np0005546415.localdomain TASK [ceph_migrate : Set/Unset labels - rm] ************************************ skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - rm] ************************************ changed: [np0005546415.localdomain] => (item=['np0005546418.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005546418.localdomain", "mon"], "delta": "0:00:02.794988", "end": "2025-12-05 09:59:15.019326", "item": ["np0005546418.localdomain", "mon"], "msg": "", "rc": 0, "start": "2025-12-05 09:59:12.224338", "stderr": "", "stderr_lines": [], "stdout": "Removed label mon from host np0005546418.localdomain", "stdout_lines": ["Removed label mon from host np0005546418.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546418.localdomain', 'mgr']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005546418.localdomain", "mgr"], "delta": "0:00:00.792466", "end": "2025-12-05 09:59:16.386989", "item": ["np0005546418.localdomain", "mgr"], "msg": "", "rc": 0, "start": "2025-12-05 09:59:15.594523", "stderr": "", "stderr_lines": [], "stdout": "Removed label mgr from host np0005546418.localdomain", "stdout_lines": ["Removed label mgr from host np0005546418.localdomain"]} changed: [np0005546415.localdomain] => (item=['np0005546418.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005546418.localdomain", "_admin"], "delta": "0:00:01.009013", "end": "2025-12-05 09:59:18.009260", "item": ["np0005546418.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2025-12-05 09:59:17.000247", "stderr": "", "stderr_lines": [], "stdout": "Removed label _admin from host np0005546418.localdomain", "stdout_lines": ["Removed label _admin from host np0005546418.localdomain"]} TASK [ceph_migrate : Wait for the orchestrator to remove labels] *************** Pausing for 10 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2025-12-05 09:59:18.139647", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2025-12-05 09:59:28.153414", "user_input": ""} TASK [ceph_migrate : DRAIN - Drain the host] *********************************** changed: [np0005546415.localdomain -> np0005546418.localdomain(192.168.122.105)] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "drain", "np0005546418.localdomain"], "delta": "0:00:00.788806", "end": "2025-12-05 09:59:29.648441", "msg": "", "rc": 0, "start": "2025-12-05 09:59:28.859635", "stderr": "", "stderr_lines": [], "stdout": "Scheduled to remove the following daemons from host 'np0005546418.localdomain'\ntype id \n-------------------- ---------------\nmgr np0005546418.garyvl\ncrash np0005546418 ", "stdout_lines": ["Scheduled to remove the following daemons from host 'np0005546418.localdomain'", "type id ", "-------------------- ---------------", "mgr np0005546418.garyvl", "crash np0005546418 "]} TASK [ceph_migrate : DRAIN - cleanup the host] ********************************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "force_clean | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - check host in hostmap] ****************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "ls", "--host_pattern", "np0005546418.localdomain", "-f", "json"], "delta": "0:00:00.730775", "end": "2025-12-05 09:59:31.074648", "msg": "", "rc": 0, "start": "2025-12-05 09:59:30.343873", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"addr\": \"192.168.122.105\", \"hostname\": \"np0005546418.localdomain\", \"labels\": [\"_no_schedule\", \"_no_conf_keyring\"], \"status\": \"\"}]", "stdout_lines": ["", "[{\"addr\": \"192.168.122.105\", \"hostname\": \"np0005546418.localdomain\", \"labels\": [\"_no_schedule\", \"_no_conf_keyring\"], \"status\": \"\"}]"]} TASK [ceph_migrate : MON - rm the cur_mon host from the Ceph cluster] ********** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "rm", "np0005546418.localdomain", "--force"], "delta": "0:00:00.733910", "end": "2025-12-05 09:59:32.426780", "msg": "", "rc": 0, "start": "2025-12-05 09:59:31.692870", "stderr": "", "stderr_lines": [], "stdout": "Removed host 'np0005546418.localdomain'", "stdout_lines": ["Removed host 'np0005546418.localdomain'"]} TASK [ceph_migrate : MON - Get current mon IP address] ************************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "mon_ipaddr is not defined", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Migrate the mon ip address from src to target node] *** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/network.yaml for np0005546415.localdomain TASK [ceph_migrate : MON - Print current mon IP address] *********************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Patch net-config config and remove the IP address (src node)] *** changed: [np0005546415.localdomain -> np0005546418.localdomain(192.168.122.105)] => {"backup": "/etc/os-net-config/tripleo_config.yaml.473512.2025-12-05@09:59:33~", "changed": true, "found": 1, "msg": "1 line(s) removed"} TASK [ceph_migrate : MON - Refresh os-net-config (src node)] ******************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "not manual_migration | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - manually rm the ip address (src node)] ************** changed: [np0005546415.localdomain -> np0005546418.localdomain(192.168.122.105)] => {"changed": true, "cmd": ["ip", "a", "del", "172.18.0.105/24", "dev", "vlan21"], "delta": "0:00:00.005056", "end": "2025-12-05 09:59:34.023697", "msg": "", "rc": 0, "start": "2025-12-05 09:59:34.018641", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : MON - Patch net-config config and add the IP address (target node)] *** changed: [np0005546415.localdomain -> np0005546421.localdomain(192.168.122.108)] => {"backup": "/etc/os-net-config/tripleo_config.yaml.299671.2025-12-05@09:59:35~", "changed": true, "msg": "line added"} TASK [ceph_migrate : MON - Refresh os-net-config (target_node)] **************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "not manual_migration | bool | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - statically assign the ip address to the target node] *** changed: [np0005546415.localdomain -> np0005546421.localdomain(192.168.122.108)] => {"changed": true, "cmd": ["ip", "a", "add", "172.18.0.105/24", "dev", "vlan21"], "delta": "0:00:00.003381", "end": "2025-12-05 09:59:36.226915", "msg": "", "rc": 0, "start": "2025-12-05 09:59:36.223534", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : MON - ping ip address to see if is reachable on the target node] *** changed: [np0005546415.localdomain -> np0005546421.localdomain(192.168.122.108)] => {"changed": true, "cmd": ["ping", "-W1", "-c", "3", "172.18.0.105"], "delta": "0:00:02.072255", "end": "2025-12-05 09:59:39.059020", "msg": "", "rc": 0, "start": "2025-12-05 09:59:36.986765", "stderr": "", "stderr_lines": [], "stdout": "PING 172.18.0.105 (172.18.0.105) 56(84) bytes of data.\n64 bytes from 172.18.0.105: icmp_seq=1 ttl=64 time=0.055 ms\n64 bytes from 172.18.0.105: icmp_seq=2 ttl=64 time=0.974 ms\n64 bytes from 172.18.0.105: icmp_seq=3 ttl=64 time=0.066 ms\n\n--- 172.18.0.105 ping statistics ---\n3 packets transmitted, 3 received, 0% packet loss, time 2065ms\nrtt min/avg/max/mdev = 0.055/0.365/0.974/0.430 ms", "stdout_lines": ["PING 172.18.0.105 (172.18.0.105) 56(84) bytes of data.", "64 bytes from 172.18.0.105: icmp_seq=1 ttl=64 time=0.055 ms", "64 bytes from 172.18.0.105: icmp_seq=2 ttl=64 time=0.974 ms", "64 bytes from 172.18.0.105: icmp_seq=3 ttl=64 time=0.066 ms", "", "--- 172.18.0.105 ping statistics ---", "3 packets transmitted, 3 received, 0% packet loss, time 2065ms", "rtt min/avg/max/mdev = 0.055/0.365/0.974/0.430 ms"]} TASK [ceph_migrate : MON - Fail if the IP address is not active in the target node] *** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ping_target_ip.rc != 0", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Unmanage mons] ******************************************** ok: [np0005546415.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mon:/home/tripleo-admin/mon:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mon"], "delta": "0:00:00.770745", "end": "2025-12-05 09:59:40.508611", "rc": 0, "start": "2025-12-05 09:59:39.737866", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mon update...", "stdout_lines": ["Scheduled mon update..."]} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Get tmp mon] **************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005546421", "-f", "json"], "delta": "0:00:00.711311", "end": "2025-12-05 09:59:41.876047", "msg": "", "rc": 0, "start": "2025-12-05 09:59:41.164736", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"6c8da69ed83b\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.20%\", \"created\": \"2025-12-05T09:54:35.058246Z\", \"daemon_id\": \"np0005546421\", \"daemon_name\": \"mon.np0005546421\", \"daemon_type\": \"mon\", \"events\": [\"2025-12-05T09:59:36.159389Z daemon:mon.np0005546421 [INFO] \\\"Reconfigured mon.np0005546421 on host 'np0005546421.localdomain'\\\"\"], \"hostname\": \"np0005546421.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:58:43.867310Z\", \"memory_request\": 2147483648, \"memory_usage\": 73169633, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:54:34.948292Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"6c8da69ed83b\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.20%\", \"created\": \"2025-12-05T09:54:35.058246Z\", \"daemon_id\": \"np0005546421\", \"daemon_name\": \"mon.np0005546421\", \"daemon_type\": \"mon\", \"events\": [\"2025-12-05T09:59:36.159389Z daemon:mon.np0005546421 [INFO] \\\"Reconfigured mon.np0005546421 on host 'np0005546421.localdomain'\\\"\"], \"hostname\": \"np0005546421.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T09:58:43.867310Z\", \"memory_request\": 2147483648, \"memory_usage\": 73169633, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:54:34.948292Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : MON - Delete the running mon] ***************************** changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "rm", "mon.np0005546421", "--force"], "delta": "0:00:02.368639", "end": "2025-12-05 09:59:44.909818", "msg": "", "rc": 0, "start": "2025-12-05 09:59:42.541179", "stderr": "", "stderr_lines": [], "stdout": "Removed mon.np0005546421 from host 'np0005546421.localdomain'", "stdout_lines": ["Removed mon.np0005546421 from host 'np0005546421.localdomain'"]} TASK [ceph_migrate : MON - Wait for the current mon to be deleted] ************* Pausing for 10 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2025-12-05 09:59:45.034408", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2025-12-05 09:59:55.046624", "user_input": ""} TASK [ceph_migrate : MON - Redeploy mon on np0005546421.localdomain] *********** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Redeploy mon on np0005546421.localdomain] *********** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "add", "mon", "np0005546421.localdomain:172.18.0.105"], "delta": "0:00:03.733121", "end": "2025-12-05 09:59:59.371859", "msg": "", "rc": 0, "start": "2025-12-05 09:59:55.638738", "stderr": "", "stderr_lines": [], "stdout": "Deployed mon.np0005546421 on host 'np0005546421.localdomain'", "stdout_lines": ["Deployed mon.np0005546421 on host 'np0005546421.localdomain'"]} TASK [ceph_migrate : MON - Wait for the spec to be updated] ******************** Pausing for 10 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2025-12-05 09:59:59.495749", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2025-12-05 10:00:09.507746", "user_input": ""} TASK [ceph_migrate : MON - Check mons quorum] ********************************** changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "-s", "-f", "json"], "delta": "0:00:00.756877", "end": "2025-12-05 10:00:10.799914", "msg": "", "rc": 0, "start": "2025-12-05 10:00:10.043037", "stderr": "", "stderr_lines": [], "stdout": "\n{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":68,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005546419\",\"np0005546420\",\"np0005546421\"],\"quorum_age\":5,\"monmap\":{\"epoch\":15,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":89,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109575456,\"bytes_used\":566370304,\"bytes_avail\":44505620480,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546420.eqhasr\",\"status\":\"up:active\",\"gid\":26492}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":3,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":95,\"modified\":\"2025-12-05T10:00:09.356065+0000\",\"services\":{\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005546421\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":68,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005546419\",\"np0005546420\",\"np0005546421\"],\"quorum_age\":5,\"monmap\":{\"epoch\":15,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":89,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109575456,\"bytes_used\":566370304,\"bytes_avail\":44505620480,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546420.eqhasr\",\"status\":\"up:active\",\"gid\":26492}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":3,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":95,\"modified\":\"2025-12-05T10:00:09.356065+0000\",\"services\":{\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005546421\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}"]} TASK [ceph_migrate : reconfig osds] ******************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "reconfig", "osd.default_drive_group"], "delta": "0:00:01.017769", "end": "2025-12-05 10:00:12.496147", "msg": "", "rc": 0, "start": "2025-12-05 10:00:11.478378", "stderr": "", "stderr_lines": [], "stdout": "Scheduled to reconfig osd.0 on host 'np0005546419.localdomain'\nScheduled to reconfig osd.3 on host 'np0005546419.localdomain'\nScheduled to reconfig osd.1 on host 'np0005546420.localdomain'\nScheduled to reconfig osd.4 on host 'np0005546420.localdomain'\nScheduled to reconfig osd.2 on host 'np0005546421.localdomain'\nScheduled to reconfig osd.5 on host 'np0005546421.localdomain'", "stdout_lines": ["Scheduled to reconfig osd.0 on host 'np0005546419.localdomain'", "Scheduled to reconfig osd.3 on host 'np0005546419.localdomain'", "Scheduled to reconfig osd.1 on host 'np0005546420.localdomain'", "Scheduled to reconfig osd.4 on host 'np0005546420.localdomain'", "Scheduled to reconfig osd.2 on host 'np0005546421.localdomain'", "Scheduled to reconfig osd.5 on host 'np0005546421.localdomain'"]} TASK [ceph_migrate : force-fail ceph mgr] ************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/fail_mgr.yaml for np0005546415.localdomain TASK [ceph_migrate : Refresh ceph_cli] ***************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005546415.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Force fail ceph mgr] ************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "fail"], "delta": "0:00:00.768412", "end": "2025-12-05 10:00:14.026939", "msg": "", "rc": 0, "start": "2025-12-05 10:00:13.258527", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Wait for cephadm to reconcile] **************************** Pausing for 10 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2025-12-05 10:00:14.137106", "stderr": "", "stdout": "Paused for 10.02 seconds", "stop": "2025-12-05 10:00:24.152480", "user_input": ""} TASK [ceph_migrate : Get the ceph orchestrator status with] ******************** ASYNC POLL on np0005546415.localdomain: jid=j78425188060.493953 started=1 finished=0 ASYNC POLL on np0005546415.localdomain: jid=j78425188060.493953 started=1 finished=0 ASYNC OK on np0005546415.localdomain: jid=j78425188060.493953 changed: [np0005546415.localdomain] => {"ansible_job_id": "j78425188060.493953", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "status", "--format", "json"], "delta": "0:00:03.755536", "end": "2025-12-05 10:00:28.635655", "failed_when_result": false, "finished": 1, "msg": "", "rc": 0, "results_file": "/root/.ansible_async/j78425188060.493953", "start": "2025-12-05 10:00:24.880119", "started": 1, "stderr": "", "stderr_lines": [], "stdout": "\n{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}", "stdout_lines": ["", "{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}"]} TASK [ceph_migrate : Restart the active mgr] *********************************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Fail if ceph orchestrator is still not responding] ******** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Manage mons] **************************************** ok: [np0005546415.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mon:/home/tripleo-admin/mon:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mon"], "delta": "0:00:00.746659", "end": "2025-12-05 10:00:31.046663", "rc": 0, "start": "2025-12-05 10:00:30.300004", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mon update...", "stdout_lines": ["Scheduled mon update..."]} TASK [ceph_migrate : MON - wait daemons] *************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005546415.localdomain TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mon] ********************************************* changed: [np0005546415.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005546421", "-f", "json"], "delta": "0:00:00.652727", "end": "2025-12-05 10:00:32.327502", "msg": "", "rc": 0, "start": "2025-12-05 10:00:31.674775", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"5155d4fefb8a\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"4.40%\", \"created\": \"2025-12-05T09:59:59.117772Z\", \"daemon_id\": \"np0005546421\", \"daemon_name\": \"mon.np0005546421\", \"daemon_type\": \"mon\", \"hostname\": \"np0005546421.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T10:00:16.300664Z\", \"memory_request\": 2147483648, \"memory_usage\": 63092817, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:59:59.003088Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"5155d4fefb8a\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:4d2f9dc5b2b33ee1c77bbfabcbbb9f4d94d343b04c4de2e4f8b3b81a1f0fd2fe\"], \"container_image_id\": \"273c05181f81a0e9697960e2eb83e7f1eabed71b98a5f20975a520dc0ec39e12\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"4.40%\", \"created\": \"2025-12-05T09:59:59.117772Z\", \"daemon_id\": \"np0005546421\", \"daemon_name\": \"mon.np0005546421\", \"daemon_type\": \"mon\", \"hostname\": \"np0005546421.localdomain\", \"is_active\": false, \"last_refresh\": \"2025-12-05T10:00:16.300664Z\", \"memory_request\": 2147483648, \"memory_usage\": 63092817, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2025-12-05T09:59:59.003088Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : Sleep before moving to the next mon] ********************** Pausing for 30 seconds ok: [np0005546415.localdomain] => {"changed": false, "delta": 30, "echo": true, "rc": 0, "start": "2025-12-05 10:00:32.452334", "stderr": "", "stdout": "Paused for 30.03 seconds", "stop": "2025-12-05 10:01:02.484724", "user_input": ""} TASK [ceph_migrate : POST - Dump logs] ***************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_load.yaml for np0005546415.localdomain TASK [ceph_migrate : Check file in the src directory] ************************** ok: [np0005546415.localdomain] => {"changed": false, "examined": 4, "files": [{"atime": 1764928498.4712453, "ctime": 1764928498.28924, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 360867540, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1764928444.5596228, "nlink": 1, "path": "/home/tripleo-admin/ceph_client/ceph.conf", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 142, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1764928498.4742453, "ctime": 1764928498.28924, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 251846153, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1764920994.3119175, "nlink": 1, "path": "/home/tripleo-admin/ceph_client/ceph.client.admin.keyring", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1764922236.4275799, "ctime": 1764928498.28924, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 251846154, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1764922234.1795115, "nlink": 1, "path": "/home/tripleo-admin/ceph_client/ceph.client.openstack.keyring", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 231, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1764922237.41761, "ctime": 1764928498.28924, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 251846155, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1764922235.0905392, "nlink": 1, "path": "/home/tripleo-admin/ceph_client/ceph.client.manila.keyring", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 153, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}], "matched": 4, "msg": "All paths examined", "skipped_paths": {}} TASK [ceph_migrate : Restore files] ******************************************** changed: [np0005546415.localdomain] => (item=ceph.conf) => {"ansible_loop_var": "item", "changed": true, "checksum": "c2bbe2ef98059e811040beb3baabe89437b9f775", "dest": "/etc/ceph/ceph.conf", "gid": 0, "group": "root", "item": "ceph.conf", "md5sum": "6e59ba5fc5510f5e0b0a4221b09d03b2", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_tmp_t:s0", "size": 142, "src": "/home/tripleo-admin/ceph_client/ceph.conf", "state": "file", "uid": 0} changed: [np0005546415.localdomain] => (item=ceph.client.admin.keyring) => {"ansible_loop_var": "item", "changed": true, "checksum": "e727e4b15c8bb6c152697f1eb76bbef93e7df730", "dest": "/etc/ceph/ceph.client.admin.keyring", "gid": 0, "group": "root", "item": "ceph.client.admin.keyring", "md5sum": "508a8780164e984fb776cef183e28f07", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 151, "src": "/home/tripleo-admin/ceph_client/ceph.client.admin.keyring", "state": "file", "uid": 0} TASK [ceph_migrate : Ensure backup directory exists] *************************** changed: [np0005546415.localdomain] => {"changed": true, "gid": 1003, "group": "tripleo-admin", "mode": "0755", "owner": "tripleo-admin", "path": "/home/tripleo-admin/ceph_client/logs", "secontext": "unconfined_u:object_r:container_file_t:s0", "size": 6, "state": "directory", "uid": 1003} TASK [ceph_migrate : Get Ceph Health] ****************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "-s", "-f", "json"], "delta": "0:00:05.811137", "end": "2025-12-05 10:01:11.124434", "msg": "", "rc": 0, "start": "2025-12-05 10:01:05.313297", "stderr": "Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b\nInferring config /etc/ceph/ceph.conf\nUsing ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4", "stderr_lines": ["Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "Inferring config /etc/ceph/ceph.conf", "Using ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4"], "stdout": "\n{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_WARN\",\"checks\":{\"CEPHADM_STRAY_DAEMON\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false},\"CEPHADM_STRAY_HOST\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray host(s) with 1 daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false}},\"mutes\":[]},\"election_epoch\":68,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005546419\",\"np0005546420\",\"np0005546421\"],\"quorum_age\":66,\"monmap\":{\"epoch\":15,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":90,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109576580,\"bytes_used\":574836736,\"bytes_avail\":44497154048,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546420.eqhasr\",\"status\":\"up:active\",\"gid\":26492}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":2,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":95,\"modified\":\"2025-12-05T10:00:09.356065+0000\",\"services\":{\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005546421\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"health\":{\"status\":\"HEALTH_WARN\",\"checks\":{\"CEPHADM_STRAY_DAEMON\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false},\"CEPHADM_STRAY_HOST\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray host(s) with 1 daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false}},\"mutes\":[]},\"election_epoch\":68,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005546419\",\"np0005546420\",\"np0005546421\"],\"quorum_age\":66,\"monmap\":{\"epoch\":15,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":90,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1764921138,\"num_in_osds\":6,\"osd_in_since\":1764921115,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109576580,\"bytes_used\":574836736,\"bytes_avail\":44497154048,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005546420.eqhasr\",\"status\":\"up:active\",\"gid\":26492}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":2,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":95,\"modified\":\"2025-12-05T10:00:09.356065+0000\",\"services\":{\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005546421\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}"]} TASK [ceph_migrate : Load ceph data] ******************************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"ceph": {"election_epoch": 68, "fsid": "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "fsmap": {"by_rank": [{"filesystem_id": 1, "gid": 26492, "name": "mds.np0005546420.eqhasr", "rank": 0, "status": "up:active"}], "epoch": 16, "id": 1, "in": 1, "max": 1, "up": 1, "up:standby": 2}, "health": {"checks": {"CEPHADM_STRAY_DAEMON": {"muted": false, "severity": "HEALTH_WARN", "summary": {"count": 1, "message": "1 stray daemon(s) not managed by cephadm"}}, "CEPHADM_STRAY_HOST": {"muted": false, "severity": "HEALTH_WARN", "summary": {"count": 1, "message": "1 stray host(s) with 1 daemon(s) not managed by cephadm"}}}, "mutes": [], "status": "HEALTH_WARN"}, "mgrmap": {"available": true, "modules": ["cephadm", "iostat", "nfs", "restful"], "num_standbys": 2, "services": {}}, "monmap": {"epoch": 15, "min_mon_release_name": "reef", "num_mons": 3}, "osdmap": {"epoch": 90, "num_in_osds": 6, "num_osds": 6, "num_remapped_pgs": 0, "num_up_osds": 6, "osd_in_since": 1764921115, "osd_up_since": 1764921138}, "pgmap": {"bytes_avail": 44497154048, "bytes_total": 45071990784, "bytes_used": 574836736, "data_bytes": 109576580, "num_objects": 69, "num_pgs": 177, "num_pools": 7, "pgs_by_state": [{"count": 177, "state_name": "active+clean"}]}, "progress_events": {}, "quorum": [0, 1, 2], "quorum_age": 66, "quorum_names": ["np0005546419", "np0005546420", "np0005546421"], "servicemap": {"epoch": 95, "modified": "2025-12-05T10:00:09.356065+0000", "services": {"mon": {"daemons": {"np0005546421": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "summary": ""}}}}}}, "changed": false} TASK [ceph_migrate : Dump ceph -s output to log file] ************************** changed: [np0005546415.localdomain] => {"changed": true, "checksum": "25a573a8031a3f22c2bd2fe4940813892951906b", "dest": "/home/tripleo-admin/ceph_client/logs/ceph_health.log", "gid": 1003, "group": "tripleo-admin", "md5sum": "8dcb6a53f20bc435ecd5eeba99d16ad4", "mode": "0644", "owner": "tripleo-admin", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 1624, "src": "/home/tripleo-admin/.ansible/tmp/ansible-tmp-1764928871.3344018-62428-83276490826944/source", "state": "file", "uid": 1003} TASK [ceph_migrate : Get Ceph Orch ServiceMap] ********************************* changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "orch", "ls", "-f", "json"], "delta": "0:00:05.251319", "end": "2025-12-05 10:01:18.070809", "msg": "", "rc": 0, "start": "2025-12-05 10:01:12.819490", "stderr": "Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b\nInferring config /etc/ceph/ceph.conf\nUsing ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4", "stderr_lines": ["Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "Inferring config /etc/ceph/ceph.conf", "Using ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4"], "stdout": "\n[{\"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"crash\", \"service_type\": \"crash\", \"status\": {\"created\": \"2025-12-05T07:49:46.685849Z\", \"last_refresh\": \"2025-12-05T10:00:16.202065Z\", \"running\": 3, \"size\": 3}}, {\"placement\": {\"label\": \"mds\"}, \"service_id\": \"mds\", \"service_name\": \"mds.mds\", \"service_type\": \"mds\", \"status\": {\"created\": \"2025-12-05T09:52:41.761446Z\", \"last_refresh\": \"2025-12-05T10:00:16.202357Z\", \"running\": 3, \"size\": 3}}, {\"placement\": {\"label\": \"mgr\"}, \"service_name\": \"mgr\", \"service_type\": \"mgr\", \"status\": {\"created\": \"2025-12-05T09:54:10.689134Z\", \"last_refresh\": \"2025-12-05T10:00:16.202439Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2025-12-05T10:00:34.523616Z service:mon [INFO] \\\"service was created\\\"\"], \"placement\": {\"label\": \"mon\"}, \"service_name\": \"mon\", \"service_type\": \"mon\", \"status\": {\"created\": \"2025-12-05T10:00:30.890266Z\", \"last_refresh\": \"2025-12-05T10:00:16.202516Z\", \"running\": 3, \"size\": 3}}, {\"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"node-proxy\", \"service_type\": \"node-proxy\", \"status\": {\"created\": \"2025-12-05T07:50:00.628104Z\", \"running\": 0, \"size\": 0}}, {\"placement\": {\"hosts\": [\"np0005546419.localdomain\", \"np0005546420.localdomain\", \"np0005546421.localdomain\"]}, \"service_id\": \"default_drive_group\", \"service_name\": \"osd.default_drive_group\", \"service_type\": \"osd\", \"spec\": {\"data_devices\": {\"paths\": [\"/dev/ceph_vg0/ceph_lv0\", \"/dev/ceph_vg1/ceph_lv1\"]}, \"filter_logic\": \"AND\", \"objectstore\": \"bluestore\"}, \"status\": {\"created\": \"2025-12-05T07:50:28.517071Z\", \"last_refresh\": \"2025-12-05T10:00:16.202189Z\", \"running\": 6, \"size\": 6}}]", "stdout_lines": ["", "[{\"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"crash\", \"service_type\": \"crash\", \"status\": {\"created\": \"2025-12-05T07:49:46.685849Z\", \"last_refresh\": \"2025-12-05T10:00:16.202065Z\", \"running\": 3, \"size\": 3}}, {\"placement\": {\"label\": \"mds\"}, \"service_id\": \"mds\", \"service_name\": \"mds.mds\", \"service_type\": \"mds\", \"status\": {\"created\": \"2025-12-05T09:52:41.761446Z\", \"last_refresh\": \"2025-12-05T10:00:16.202357Z\", \"running\": 3, \"size\": 3}}, {\"placement\": {\"label\": \"mgr\"}, \"service_name\": \"mgr\", \"service_type\": \"mgr\", \"status\": {\"created\": \"2025-12-05T09:54:10.689134Z\", \"last_refresh\": \"2025-12-05T10:00:16.202439Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2025-12-05T10:00:34.523616Z service:mon [INFO] \\\"service was created\\\"\"], \"placement\": {\"label\": \"mon\"}, \"service_name\": \"mon\", \"service_type\": \"mon\", \"status\": {\"created\": \"2025-12-05T10:00:30.890266Z\", \"last_refresh\": \"2025-12-05T10:00:16.202516Z\", \"running\": 3, \"size\": 3}}, {\"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"node-proxy\", \"service_type\": \"node-proxy\", \"status\": {\"created\": \"2025-12-05T07:50:00.628104Z\", \"running\": 0, \"size\": 0}}, {\"placement\": {\"hosts\": [\"np0005546419.localdomain\", \"np0005546420.localdomain\", \"np0005546421.localdomain\"]}, \"service_id\": \"default_drive_group\", \"service_name\": \"osd.default_drive_group\", \"service_type\": \"osd\", \"spec\": {\"data_devices\": {\"paths\": [\"/dev/ceph_vg0/ceph_lv0\", \"/dev/ceph_vg1/ceph_lv1\"]}, \"filter_logic\": \"AND\", \"objectstore\": \"bluestore\"}, \"status\": {\"created\": \"2025-12-05T07:50:28.517071Z\", \"last_refresh\": \"2025-12-05T10:00:16.202189Z\", \"running\": 6, \"size\": 6}}]"]} TASK [ceph_migrate : Load Service Map] ***************************************** ok: [np0005546415.localdomain] => {"ansible_facts": {"servicemap": [{"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2025-12-05T07:49:46.685849Z", "last_refresh": "2025-12-05T10:00:16.202065Z", "running": 3, "size": 3}}, {"placement": {"label": "mds"}, "service_id": "mds", "service_name": "mds.mds", "service_type": "mds", "status": {"created": "2025-12-05T09:52:41.761446Z", "last_refresh": "2025-12-05T10:00:16.202357Z", "running": 3, "size": 3}}, {"placement": {"label": "mgr"}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2025-12-05T09:54:10.689134Z", "last_refresh": "2025-12-05T10:00:16.202439Z", "running": 3, "size": 3}}, {"events": ["2025-12-05T10:00:34.523616Z service:mon [INFO] \"service was created\""], "placement": {"label": "mon"}, "service_name": "mon", "service_type": "mon", "status": {"created": "2025-12-05T10:00:30.890266Z", "last_refresh": "2025-12-05T10:00:16.202516Z", "running": 3, "size": 3}}, {"placement": {"host_pattern": "*"}, "service_name": "node-proxy", "service_type": "node-proxy", "status": {"created": "2025-12-05T07:50:00.628104Z", "running": 0, "size": 0}}, {"placement": {"hosts": ["np0005546419.localdomain", "np0005546420.localdomain", "np0005546421.localdomain"]}, "service_id": "default_drive_group", "service_name": "osd.default_drive_group", "service_type": "osd", "spec": {"data_devices": {"paths": ["/dev/ceph_vg0/ceph_lv0", "/dev/ceph_vg1/ceph_lv1"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2025-12-05T07:50:28.517071Z", "last_refresh": "2025-12-05T10:00:16.202189Z", "running": 6, "size": 6}}]}, "changed": false} TASK [ceph_migrate : Print Service Map] **************************************** skipping: [np0005546415.localdomain] => (item={'placement': {'host_pattern': '*'}, 'service_name': 'crash', 'service_type': 'crash', 'status': {'created': '2025-12-05T07:49:46.685849Z', 'last_refresh': '2025-12-05T10:00:16.202065Z', 'running': 3, 'size': 3}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2025-12-05T07:49:46.685849Z", "last_refresh": "2025-12-05T10:00:16.202065Z", "running": 3, "size": 3}}} skipping: [np0005546415.localdomain] => (item={'placement': {'label': 'mds'}, 'service_id': 'mds', 'service_name': 'mds.mds', 'service_type': 'mds', 'status': {'created': '2025-12-05T09:52:41.761446Z', 'last_refresh': '2025-12-05T10:00:16.202357Z', 'running': 3, 'size': 3}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"placement": {"label": "mds"}, "service_id": "mds", "service_name": "mds.mds", "service_type": "mds", "status": {"created": "2025-12-05T09:52:41.761446Z", "last_refresh": "2025-12-05T10:00:16.202357Z", "running": 3, "size": 3}}} skipping: [np0005546415.localdomain] => (item={'placement': {'label': 'mgr'}, 'service_name': 'mgr', 'service_type': 'mgr', 'status': {'created': '2025-12-05T09:54:10.689134Z', 'last_refresh': '2025-12-05T10:00:16.202439Z', 'running': 3, 'size': 3}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"placement": {"label": "mgr"}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2025-12-05T09:54:10.689134Z", "last_refresh": "2025-12-05T10:00:16.202439Z", "running": 3, "size": 3}}} skipping: [np0005546415.localdomain] => (item={'events': ['2025-12-05T10:00:34.523616Z service:mon [INFO] "service was created"'], 'placement': {'label': 'mon'}, 'service_name': 'mon', 'service_type': 'mon', 'status': {'created': '2025-12-05T10:00:30.890266Z', 'last_refresh': '2025-12-05T10:00:16.202516Z', 'running': 3, 'size': 3}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"events": ["2025-12-05T10:00:34.523616Z service:mon [INFO] \"service was created\""], "placement": {"label": "mon"}, "service_name": "mon", "service_type": "mon", "status": {"created": "2025-12-05T10:00:30.890266Z", "last_refresh": "2025-12-05T10:00:16.202516Z", "running": 3, "size": 3}}} skipping: [np0005546415.localdomain] => (item={'placement': {'host_pattern': '*'}, 'service_name': 'node-proxy', 'service_type': 'node-proxy', 'status': {'created': '2025-12-05T07:50:00.628104Z', 'running': 0, 'size': 0}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"placement": {"host_pattern": "*"}, "service_name": "node-proxy", "service_type": "node-proxy", "status": {"created": "2025-12-05T07:50:00.628104Z", "running": 0, "size": 0}}} skipping: [np0005546415.localdomain] => (item={'placement': {'hosts': ['np0005546419.localdomain', 'np0005546420.localdomain', 'np0005546421.localdomain']}, 'service_id': 'default_drive_group', 'service_name': 'osd.default_drive_group', 'service_type': 'osd', 'spec': {'data_devices': {'paths': ['/dev/ceph_vg0/ceph_lv0', '/dev/ceph_vg1/ceph_lv1']}, 'filter_logic': 'AND', 'objectstore': 'bluestore'}, 'status': {'created': '2025-12-05T07:50:28.517071Z', 'last_refresh': '2025-12-05T10:00:16.202189Z', 'running': 6, 'size': 6}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"placement": {"hosts": ["np0005546419.localdomain", "np0005546420.localdomain", "np0005546421.localdomain"]}, "service_id": "default_drive_group", "service_name": "osd.default_drive_group", "service_type": "osd", "spec": {"data_devices": {"paths": ["/dev/ceph_vg0/ceph_lv0", "/dev/ceph_vg1/ceph_lv1"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2025-12-05T07:50:28.517071Z", "last_refresh": "2025-12-05T10:00:16.202189Z", "running": 6, "size": 6}}} skipping: [np0005546415.localdomain] => {"msg": "All items skipped"} TASK [ceph_migrate : Dump ceph orch ls output to log file] ********************* changed: [np0005546415.localdomain] => {"changed": true, "checksum": "e8e5c52fda760088146a5e4b5c45b2f3f936c422", "dest": "/home/tripleo-admin/ceph_client/logs/ceph_orch_ls.log", "gid": 1003, "group": "tripleo-admin", "md5sum": "47d173a2a4bde3d6a075c6622b5c9f53", "mode": "0644", "owner": "tripleo-admin", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 1600, "src": "/home/tripleo-admin/.ansible/tmp/ansible-tmp-1764928878.312433-62459-211794995421835/source", "state": "file", "uid": 1003} TASK [ceph_migrate : Get Ceph config] ****************************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "config", "dump", "-f", "json"], "delta": "0:00:05.532491", "end": "2025-12-05 10:01:25.281011", "msg": "", "rc": 0, "start": "2025-12-05 10:01:19.748520", "stderr": "Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b\nInferring config /etc/ceph/ceph.conf\nUsing ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4", "stderr_lines": ["Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "Inferring config /etc/ceph/ceph.conf", "Using ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4"], "stdout": "\n[{\"section\":\"global\",\"name\":\"cluster_network\",\"value\":\"172.20.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"container_image\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\",\"level\":\"basic\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv4\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv6\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"public_network\",\"value\":\"172.18.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mon\",\"name\":\"auth_allow_insecure_global_id_reclaim\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_base\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_haproxy\",\"value\":\"registry.redhat.io/rhceph/rhceph-haproxy-rhel9:latest\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_keepalived\",\"value\":\"registry.redhat.io/rhceph/keepalived-rhel9:latest\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_init\",\"value\":\"True\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/migration_current\",\"value\":\"7\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/use_repo_digest\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/orchestrator/orchestrator\",\"value\":\"cephadm\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005546419\",\"location_type\":\"host\",\"location_value\":\"np0005546419\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005546420\",\"location_type\":\"host\",\"location_value\":\"np0005546420\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005546421\",\"location_type\":\"host\",\"location_value\":\"np0005546421\"},{\"section\":\"osd\",\"name\":\"osd_memory_target_autotune\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mds.mds\",\"name\":\"mds_join_fs\",\"value\":\"mds\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mds.np0005546420.eqhasr\",\"name\":\"mds_join_fs\",\"value\":\"cephfs\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"\"}]", "stdout_lines": ["", "[{\"section\":\"global\",\"name\":\"cluster_network\",\"value\":\"172.20.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"container_image\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\",\"level\":\"basic\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv4\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv6\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"public_network\",\"value\":\"172.18.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mon\",\"name\":\"auth_allow_insecure_global_id_reclaim\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_base\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_haproxy\",\"value\":\"registry.redhat.io/rhceph/rhceph-haproxy-rhel9:latest\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_keepalived\",\"value\":\"registry.redhat.io/rhceph/keepalived-rhel9:latest\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_init\",\"value\":\"True\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/migration_current\",\"value\":\"7\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/use_repo_digest\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/orchestrator/orchestrator\",\"value\":\"cephadm\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005546419\",\"location_type\":\"host\",\"location_value\":\"np0005546419\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005546420\",\"location_type\":\"host\",\"location_value\":\"np0005546420\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005546421\",\"location_type\":\"host\",\"location_value\":\"np0005546421\"},{\"section\":\"osd\",\"name\":\"osd_memory_target_autotune\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mds.mds\",\"name\":\"mds_join_fs\",\"value\":\"mds\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mds.np0005546420.eqhasr\",\"name\":\"mds_join_fs\",\"value\":\"cephfs\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"\"}]"]} TASK [ceph_migrate : Print Ceph config dump] *********************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Dump ceph config dump output to log file] ***************** changed: [np0005546415.localdomain] => {"changed": true, "checksum": "96ef0da3ddfb378dc1899ad11f8762a6084292de", "dest": "/home/tripleo-admin/ceph_client/logs/ceph_config_dump.log", "gid": 1003, "group": "tripleo-admin", "md5sum": "ad09889ec3d8ceac7f440cb407fdf817", "mode": "0644", "owner": "tripleo-admin", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 3044, "src": "/home/tripleo-admin/.ansible/tmp/ansible-tmp-1764928885.4993105-62486-139213746448123/source", "state": "file", "uid": 1003} TASK [ceph_migrate : Get Ceph Orch Host Map] *********************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "orch", "host", "ls", "-f", "json"], "delta": "0:00:05.402509", "end": "2025-12-05 10:01:32.388420", "msg": "", "rc": 0, "start": "2025-12-05 10:01:26.985911", "stderr": "Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b\nInferring config /etc/ceph/ceph.conf\nUsing ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4", "stderr_lines": ["Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "Inferring config /etc/ceph/ceph.conf", "Using ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4"], "stdout": "\n[{\"addr\": \"192.168.122.106\", \"hostname\": \"np0005546419.localdomain\", \"labels\": [\"osd\", \"mds\", \"mgr\", \"mon\", \"_admin\"], \"status\": \"\"}, {\"addr\": \"192.168.122.107\", \"hostname\": \"np0005546420.localdomain\", \"labels\": [\"osd\", \"mds\", \"mgr\", \"mon\", \"_admin\"], \"status\": \"\"}, {\"addr\": \"192.168.122.108\", \"hostname\": \"np0005546421.localdomain\", \"labels\": [\"osd\", \"mds\", \"mgr\", \"mon\", \"_admin\"], \"status\": \"\"}]", "stdout_lines": ["", "[{\"addr\": \"192.168.122.106\", \"hostname\": \"np0005546419.localdomain\", \"labels\": [\"osd\", \"mds\", \"mgr\", \"mon\", \"_admin\"], \"status\": \"\"}, {\"addr\": \"192.168.122.107\", \"hostname\": \"np0005546420.localdomain\", \"labels\": [\"osd\", \"mds\", \"mgr\", \"mon\", \"_admin\"], \"status\": \"\"}, {\"addr\": \"192.168.122.108\", \"hostname\": \"np0005546421.localdomain\", \"labels\": [\"osd\", \"mds\", \"mgr\", \"mon\", \"_admin\"], \"status\": \"\"}]"]} TASK [ceph_migrate : Load nodes] *********************************************** ok: [np0005546415.localdomain] => {"ansible_facts": {"nds": [{"addr": "192.168.122.106", "hostname": "np0005546419.localdomain", "labels": ["osd", "mds", "mgr", "mon", "_admin"], "status": ""}, {"addr": "192.168.122.107", "hostname": "np0005546420.localdomain", "labels": ["osd", "mds", "mgr", "mon", "_admin"], "status": ""}, {"addr": "192.168.122.108", "hostname": "np0005546421.localdomain", "labels": ["osd", "mds", "mgr", "mon", "_admin"], "status": ""}]}, "changed": false} TASK [ceph_migrate : Load hostmap List] **************************************** ok: [np0005546415.localdomain] => {"ansible_facts": {"hostmap": {"np0005546419.localdomain": ["osd", "mds", "mgr", "mon", "_admin"], "np0005546420.localdomain": ["osd", "mds", "mgr", "mon", "_admin"], "np0005546421.localdomain": ["osd", "mds", "mgr", "mon", "_admin"]}}, "changed": false} TASK [ceph_migrate : Print Host Map] ******************************************* skipping: [np0005546415.localdomain] => (item=np0005546419.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005546419.localdomain"} skipping: [np0005546415.localdomain] => (item=np0005546420.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005546420.localdomain"} skipping: [np0005546415.localdomain] => (item=np0005546421.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005546421.localdomain"} skipping: [np0005546415.localdomain] => {"msg": "All items skipped"} TASK [ceph_migrate : Dump ceph orch host ls output to log file] **************** changed: [np0005546415.localdomain] => {"changed": true, "checksum": "eeed06d1bbb233e33992ec8771d2a7dd32377694", "dest": "/home/tripleo-admin/ceph_client/logs/ceph_orch_host_ls.log", "gid": 1003, "group": "tripleo-admin", "md5sum": "7522df0b259380843c805e4a6cbf9a94", "mode": "0644", "owner": "tripleo-admin", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 84, "src": "/home/tripleo-admin/.ansible/tmp/ansible-tmp-1764928892.6883209-62517-267319413997057/source", "state": "file", "uid": 1003} TASK [ceph_migrate : Get Ceph monmap and load data] **************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "mon", "dump", "-f", "json"], "delta": "0:00:05.294600", "end": "2025-12-05 10:01:39.419522", "msg": "", "rc": 0, "start": "2025-12-05 10:01:34.124922", "stderr": "Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b\nInferring config /etc/ceph/ceph.conf\nUsing ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4\ndumped monmap epoch 15", "stderr_lines": ["Inferring fsid 79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "Inferring config /etc/ceph/ceph.conf", "Using ceph image with id '273c05181f81' and tag 'latest' created on 2025-11-26 19:45:11 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:04038939b8141c15690c90ad77253fe2c4e8c5f75ae28b709b459441bbe41de4", "dumped monmap epoch 15"], "stdout": "\n{\"epoch\":15,\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"modified\":\"2025-12-05T09:59:59.724612Z\",\"created\":\"2025-12-05T07:49:07.934655Z\",\"min_mon_release\":18,\"min_mon_release_name\":\"reef\",\"election_strategy\":1,\"disallowed_leaders: \":\"\",\"stretch_mode\":false,\"tiebreaker_mon\":\"\",\"removed_ranks: \":\"\",\"features\":{\"persistent\":[\"kraken\",\"luminous\",\"mimic\",\"osdmap-prune\",\"nautilus\",\"octopus\",\"pacific\",\"elector-pinging\",\"quincy\",\"reef\"],\"optional\":[]},\"mons\":[{\"rank\":0,\"name\":\"np0005546419\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.103:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.103:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.103:6789/0\",\"public_addr\":\"172.18.0.103:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":1,\"name\":\"np0005546420\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.104:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.104:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.104:6789/0\",\"public_addr\":\"172.18.0.104:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":2,\"name\":\"np0005546421\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.105:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.105:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.105:6789/0\",\"public_addr\":\"172.18.0.105:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"}],\"quorum\":[0,1,2]}", "stdout_lines": ["", "{\"epoch\":15,\"fsid\":\"79feddb1-4bfc-557f-83b9-0d57c9f66c1b\",\"modified\":\"2025-12-05T09:59:59.724612Z\",\"created\":\"2025-12-05T07:49:07.934655Z\",\"min_mon_release\":18,\"min_mon_release_name\":\"reef\",\"election_strategy\":1,\"disallowed_leaders: \":\"\",\"stretch_mode\":false,\"tiebreaker_mon\":\"\",\"removed_ranks: \":\"\",\"features\":{\"persistent\":[\"kraken\",\"luminous\",\"mimic\",\"osdmap-prune\",\"nautilus\",\"octopus\",\"pacific\",\"elector-pinging\",\"quincy\",\"reef\"],\"optional\":[]},\"mons\":[{\"rank\":0,\"name\":\"np0005546419\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.103:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.103:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.103:6789/0\",\"public_addr\":\"172.18.0.103:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":1,\"name\":\"np0005546420\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.104:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.104:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.104:6789/0\",\"public_addr\":\"172.18.0.104:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":2,\"name\":\"np0005546421\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.105:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.105:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.105:6789/0\",\"public_addr\":\"172.18.0.105:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"}],\"quorum\":[0,1,2]}"]} TASK [ceph_migrate : Get Monmap] *********************************************** ok: [np0005546415.localdomain] => {"ansible_facts": {"mon_dump": {"created": "2025-12-05T07:49:07.934655Z", "disallowed_leaders: ": "", "election_strategy": 1, "epoch": 15, "features": {"optional": [], "persistent": ["kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef"]}, "fsid": "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "min_mon_release": 18, "min_mon_release_name": "reef", "modified": "2025-12-05T09:59:59.724612Z", "mons": [{"addr": "172.18.0.103:6789/0", "crush_location": "{}", "name": "np0005546419", "priority": 0, "public_addr": "172.18.0.103:6789/0", "public_addrs": {"addrvec": [{"addr": "172.18.0.103:3300", "nonce": 0, "type": "v2"}, {"addr": "172.18.0.103:6789", "nonce": 0, "type": "v1"}]}, "rank": 0, "weight": 0}, {"addr": "172.18.0.104:6789/0", "crush_location": "{}", "name": "np0005546420", "priority": 0, "public_addr": "172.18.0.104:6789/0", "public_addrs": {"addrvec": [{"addr": "172.18.0.104:3300", "nonce": 0, "type": "v2"}, {"addr": "172.18.0.104:6789", "nonce": 0, "type": "v1"}]}, "rank": 1, "weight": 0}, {"addr": "172.18.0.105:6789/0", "crush_location": "{}", "name": "np0005546421", "priority": 0, "public_addr": "172.18.0.105:6789/0", "public_addrs": {"addrvec": [{"addr": "172.18.0.105:3300", "nonce": 0, "type": "v2"}, {"addr": "172.18.0.105:6789", "nonce": 0, "type": "v1"}]}, "rank": 2, "weight": 0}], "quorum": [0, 1, 2], "removed_ranks: ": "", "stretch_mode": false, "tiebreaker_mon": ""}}, "changed": false} TASK [ceph_migrate : Print monmap] ********************************************* skipping: [np0005546415.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Dump ceph mon dump output to log file] ******************** changed: [np0005546415.localdomain] => {"changed": true, "checksum": "c9fe1be58f5464c4e0d285f6e00644933e0ceee7", "dest": "/home/tripleo-admin/ceph_client/logs/ceph_mon_dump.log", "gid": 1003, "group": "tripleo-admin", "md5sum": "3a63483061803f602a01e5d5295a4681", "mode": "0644", "owner": "tripleo-admin", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 1425, "src": "/home/tripleo-admin/.ansible/tmp/ansible-tmp-1764928899.6996472-62546-55428484978765/source", "state": "file", "uid": 1003} TASK [ceph_migrate : Load nodes to decommission] ******************************* ok: [np0005546415.localdomain] => {"ansible_facts": {"decomm_nodes": ["np0005546419.localdomain", "np0005546420.localdomain", "np0005546421.localdomain"]}, "changed": false} TASK [ceph_migrate : Load target nodes] **************************************** ok: [np0005546415.localdomain] => {"ansible_facts": {"target_nodes": ["np0005546419.localdomain", "np0005546420.localdomain", "np0005546421.localdomain"]}, "changed": false} TASK [ceph_migrate : Print target nodes] *************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug|default(false)"} TASK [ceph_migrate : Print decomm_nodes] *************************************** skipping: [np0005546415.localdomain] => {"false_condition": "debug|default(false)"} TASK [ceph_migrate : Configure Swift to use rgw backend] *********************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Flush handlers to ensure mgr restart completes] *********** RUNNING HANDLER [ceph_migrate : restart mgr] *********************************** changed: [np0005546415.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "79feddb1-4bfc-557f-83b9-0d57c9f66c1b", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "fail"], "delta": "0:00:03.793450", "end": "2025-12-05 10:01:45.163503", "msg": "", "rc": 0, "start": "2025-12-05 10:01:41.370053", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Install cephadm on all compute nodes] ********************* skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "groups['ComputeHCI'] is defined", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Force fail ceph mgr on first compute node] **************** skipping: [np0005546415.localdomain] => {"changed": false, "false_condition": "groups['ComputeHCI'] is defined", "skip_reason": "Conditional result was False"} PLAY RECAP ********************************************************************* np0005546415.localdomain : ok=239 changed=111 unreachable=0 failed=0 skipped=143 rescued=0 ignored=0