[WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (edpm_node_hostname). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (edpm_node_ip). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (source_galera_members). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (source_mariadb_ip). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (enable_tlse). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (neutron_qe_test). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (tobiko_qe_test). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (neutron_qe_dir). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (prelaunch_barbican_secret). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (os_cloud_name). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (standalone_ip). Using last defined value only. Using /home/zuul/src/review.rdoproject.org/rdo-jobs/playbooks/data_plane_adoption/ansible.cfg as config file PLAY [Externalize Ceph] ******************************************************** TASK [Gathering Facts] ********************************************************* ok: [np0005604209.localdomain] TASK [ceph_migrate : Check file in the src directory] ************************** [WARNING]: Skipped '/home/tripleo-admin/ceph_client' path due to this access issue: '/home/tripleo-admin/ceph_client' is not a directory ok: [np0005604209.localdomain] => {"changed": false, "examined": 0, "files": [], "matched": 0, "msg": "Not all paths examined, check warnings for details", "skipped_paths": {"/home/tripleo-admin/ceph_client": "'/home/tripleo-admin/ceph_client' is not a directory"}} TASK [ceph_migrate : Restore files] ******************************************** skipping: [np0005604209.localdomain] => (item=ceph.conf) => {"ansible_loop_var": "item", "changed": false, "false_condition": "dir_ceph_files.files | length > 0", "item": "ceph.conf", "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => (item=ceph.client.admin.keyring) => {"ansible_loop_var": "item", "changed": false, "false_condition": "dir_ceph_files.files | length > 0", "item": "ceph.client.admin.keyring", "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => {"changed": false, "msg": "All items skipped"} TASK [ceph_migrate : Ensure backup directory exists] *************************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "dump | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Get Ceph Health] ****************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "-s", "-f", "json"], "delta": "0:00:02.698703", "end": "2026-02-01 09:38:33.707368", "msg": "", "rc": 0, "start": "2026-02-01 09:38:31.008665", "stderr": "Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e\nInferring config /var/lib/ceph/33fac0b9-80c7-560f-918a-c92d3021ca1e/mon.np0005604209/config\nUsing ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4", "stderr_lines": ["Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e", "Inferring config /var/lib/ceph/33fac0b9-80c7-560f-918a-c92d3021ca1e/mon.np0005604209/config", "Using ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4"], "stdout": "\n{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":14,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005604209\",\"np0005604211\",\"np0005604210\"],\"quorum_age\":7098,\"monmap\":{\"epoch\":3,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":78,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109571242,\"bytes_used\":555552768,\"bytes_avail\":44516438016,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":6,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604209.wikopf\",\"status\":\"up:active\",\"gid\":24242}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":2,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":66,\"modified\":\"2026-02-01T09:30:05.612178+0000\",\"services\":{}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":14,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005604209\",\"np0005604211\",\"np0005604210\"],\"quorum_age\":7098,\"monmap\":{\"epoch\":3,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":78,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109571242,\"bytes_used\":555552768,\"bytes_avail\":44516438016,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":6,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604209.wikopf\",\"status\":\"up:active\",\"gid\":24242}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":2,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":66,\"modified\":\"2026-02-01T09:30:05.612178+0000\",\"services\":{}},\"progress_events\":{}}"]} TASK [ceph_migrate : Load ceph data] ******************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph": {"election_epoch": 14, "fsid": "33fac0b9-80c7-560f-918a-c92d3021ca1e", "fsmap": {"by_rank": [{"filesystem_id": 1, "gid": 24242, "name": "mds.np0005604209.wikopf", "rank": 0, "status": "up:active"}], "epoch": 6, "id": 1, "in": 1, "max": 1, "up": 1, "up:standby": 2}, "health": {"checks": {}, "mutes": [], "status": "HEALTH_OK"}, "mgrmap": {"available": true, "modules": ["cephadm", "iostat", "nfs", "restful"], "num_standbys": 2, "services": {}}, "monmap": {"epoch": 3, "min_mon_release_name": "reef", "num_mons": 3}, "osdmap": {"epoch": 78, "num_in_osds": 6, "num_osds": 6, "num_remapped_pgs": 0, "num_up_osds": 6, "osd_in_since": 1769931634, "osd_up_since": 1769931655}, "pgmap": {"bytes_avail": 44516438016, "bytes_total": 45071990784, "bytes_used": 555552768, "data_bytes": 109571242, "num_objects": 69, "num_pgs": 177, "num_pools": 7, "pgs_by_state": [{"count": 177, "state_name": "active+clean"}]}, "progress_events": {}, "quorum": [0, 1, 2], "quorum_age": 7098, "quorum_names": ["np0005604209", "np0005604211", "np0005604210"], "servicemap": {"epoch": 66, "modified": "2026-02-01T09:30:05.612178+0000", "services": {}}}}, "changed": false} TASK [ceph_migrate : Dump ceph -s output to log file] ************************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "dump | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Get Ceph Orch ServiceMap] ********************************* changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "orch", "ls", "-f", "json"], "delta": "0:00:02.755111", "end": "2026-02-01 09:38:37.153836", "msg": "", "rc": 0, "start": "2026-02-01 09:38:34.398725", "stderr": "Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e\nInferring config /var/lib/ceph/33fac0b9-80c7-560f-918a-c92d3021ca1e/mon.np0005604209/config\nUsing ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4", "stderr_lines": ["Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e", "Inferring config /var/lib/ceph/33fac0b9-80c7-560f-918a-c92d3021ca1e/mon.np0005604209/config", "Using ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4"], "stdout": "\n[{\"events\": [\"2026-02-01T07:40:28.908086Z service:crash [INFO] \\\"service was created\\\"\"], \"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"crash\", \"service_type\": \"crash\", \"status\": {\"created\": \"2026-02-01T07:38:30.151117Z\", \"last_refresh\": \"2026-02-01T09:27:55.315276Z\", \"running\": 6, \"size\": 6}}, {\"events\": [\"2026-02-01T07:59:05.061136Z service:mds.mds [INFO] \\\"service was created\\\"\"], \"placement\": {\"hosts\": [\"np0005604209.localdomain\", \"np0005604210.localdomain\", \"np0005604211.localdomain\"]}, \"service_id\": \"mds\", \"service_name\": \"mds.mds\", \"service_type\": \"mds\", \"status\": {\"created\": \"2026-02-01T07:58:58.022574Z\", \"last_refresh\": \"2026-02-01T09:32:26.305418Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2026-02-01T07:40:17.446180Z service:mgr [INFO] \\\"service was created\\\"\", \"2026-02-01T07:39:22.780040Z service:mgr [ERROR] \\\"Failed to apply: Cannot place on np0005604211.localdomain: Unknown hosts\\\"\"], \"placement\": {\"hosts\": [\"np0005604209.localdomain\", \"np0005604210.localdomain\", \"np0005604211.localdomain\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\", \"status\": {\"created\": \"2026-02-01T07:39:12.058631Z\", \"last_refresh\": \"2026-02-01T09:32:26.305135Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2026-02-01T07:40:09.102652Z service:mon [INFO] \\\"service was created\\\"\", \"2026-02-01T07:39:22.778779Z service:mon [ERROR] \\\"Failed to apply: Cannot place on np0005604211.localdomain: Unknown hosts\\\"\"], \"placement\": {\"hosts\": [\"np0005604209.localdomain\", \"np0005604210.localdomain\", \"np0005604211.localdomain\"]}, \"service_name\": \"mon\", \"service_type\": \"mon\", \"status\": {\"created\": \"2026-02-01T07:39:12.049851Z\", \"last_refresh\": \"2026-02-01T09:32:26.304980Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2026-02-01T07:38:44.443026Z service:node-proxy [INFO] \\\"service was created\\\"\"], \"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"node-proxy\", \"service_type\": \"node-proxy\", \"status\": {\"created\": \"2026-02-01T07:38:44.402177Z\", \"running\": 0, \"size\": 0}}, {\"events\": [\"2026-02-01T07:39:12.075413Z service:osd.default_drive_group [INFO] \\\"service was created\\\"\"], \"placement\": {\"hosts\": [\"np0005604212.localdomain\", \"np0005604213.localdomain\", \"np0005604215.localdomain\"]}, \"service_id\": \"default_drive_group\", \"service_name\": \"osd.default_drive_group\", \"service_type\": \"osd\", \"spec\": {\"data_devices\": {\"paths\": [\"/dev/ceph_vg0/ceph_lv0\", \"/dev/ceph_vg1/ceph_lv1\"]}, \"filter_logic\": \"AND\", \"objectstore\": \"bluestore\"}, \"status\": {\"created\": \"2026-02-01T07:39:12.067676Z\", \"last_refresh\": \"2026-02-01T09:27:55.315443Z\", \"running\": 6, \"size\": 6}}]", "stdout_lines": ["", "[{\"events\": [\"2026-02-01T07:40:28.908086Z service:crash [INFO] \\\"service was created\\\"\"], \"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"crash\", \"service_type\": \"crash\", \"status\": {\"created\": \"2026-02-01T07:38:30.151117Z\", \"last_refresh\": \"2026-02-01T09:27:55.315276Z\", \"running\": 6, \"size\": 6}}, {\"events\": [\"2026-02-01T07:59:05.061136Z service:mds.mds [INFO] \\\"service was created\\\"\"], \"placement\": {\"hosts\": [\"np0005604209.localdomain\", \"np0005604210.localdomain\", \"np0005604211.localdomain\"]}, \"service_id\": \"mds\", \"service_name\": \"mds.mds\", \"service_type\": \"mds\", \"status\": {\"created\": \"2026-02-01T07:58:58.022574Z\", \"last_refresh\": \"2026-02-01T09:32:26.305418Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2026-02-01T07:40:17.446180Z service:mgr [INFO] \\\"service was created\\\"\", \"2026-02-01T07:39:22.780040Z service:mgr [ERROR] \\\"Failed to apply: Cannot place on np0005604211.localdomain: Unknown hosts\\\"\"], \"placement\": {\"hosts\": [\"np0005604209.localdomain\", \"np0005604210.localdomain\", \"np0005604211.localdomain\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\", \"status\": {\"created\": \"2026-02-01T07:39:12.058631Z\", \"last_refresh\": \"2026-02-01T09:32:26.305135Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2026-02-01T07:40:09.102652Z service:mon [INFO] \\\"service was created\\\"\", \"2026-02-01T07:39:22.778779Z service:mon [ERROR] \\\"Failed to apply: Cannot place on np0005604211.localdomain: Unknown hosts\\\"\"], \"placement\": {\"hosts\": [\"np0005604209.localdomain\", \"np0005604210.localdomain\", \"np0005604211.localdomain\"]}, \"service_name\": \"mon\", \"service_type\": \"mon\", \"status\": {\"created\": \"2026-02-01T07:39:12.049851Z\", \"last_refresh\": \"2026-02-01T09:32:26.304980Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2026-02-01T07:38:44.443026Z service:node-proxy [INFO] \\\"service was created\\\"\"], \"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"node-proxy\", \"service_type\": \"node-proxy\", \"status\": {\"created\": \"2026-02-01T07:38:44.402177Z\", \"running\": 0, \"size\": 0}}, {\"events\": [\"2026-02-01T07:39:12.075413Z service:osd.default_drive_group [INFO] \\\"service was created\\\"\"], \"placement\": {\"hosts\": [\"np0005604212.localdomain\", \"np0005604213.localdomain\", \"np0005604215.localdomain\"]}, \"service_id\": \"default_drive_group\", \"service_name\": \"osd.default_drive_group\", \"service_type\": \"osd\", \"spec\": {\"data_devices\": {\"paths\": [\"/dev/ceph_vg0/ceph_lv0\", \"/dev/ceph_vg1/ceph_lv1\"]}, \"filter_logic\": \"AND\", \"objectstore\": \"bluestore\"}, \"status\": {\"created\": \"2026-02-01T07:39:12.067676Z\", \"last_refresh\": \"2026-02-01T09:27:55.315443Z\", \"running\": 6, \"size\": 6}}]"]} TASK [ceph_migrate : Load Service Map] ***************************************** ok: [np0005604209.localdomain] => {"ansible_facts": {"servicemap": [{"events": ["2026-02-01T07:40:28.908086Z service:crash [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2026-02-01T07:38:30.151117Z", "last_refresh": "2026-02-01T09:27:55.315276Z", "running": 6, "size": 6}}, {"events": ["2026-02-01T07:59:05.061136Z service:mds.mds [INFO] \"service was created\""], "placement": {"hosts": ["np0005604209.localdomain", "np0005604210.localdomain", "np0005604211.localdomain"]}, "service_id": "mds", "service_name": "mds.mds", "service_type": "mds", "status": {"created": "2026-02-01T07:58:58.022574Z", "last_refresh": "2026-02-01T09:32:26.305418Z", "running": 3, "size": 3}}, {"events": ["2026-02-01T07:40:17.446180Z service:mgr [INFO] \"service was created\"", "2026-02-01T07:39:22.780040Z service:mgr [ERROR] \"Failed to apply: Cannot place on np0005604211.localdomain: Unknown hosts\""], "placement": {"hosts": ["np0005604209.localdomain", "np0005604210.localdomain", "np0005604211.localdomain"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-01T07:39:12.058631Z", "last_refresh": "2026-02-01T09:32:26.305135Z", "running": 3, "size": 3}}, {"events": ["2026-02-01T07:40:09.102652Z service:mon [INFO] \"service was created\"", "2026-02-01T07:39:22.778779Z service:mon [ERROR] \"Failed to apply: Cannot place on np0005604211.localdomain: Unknown hosts\""], "placement": {"hosts": ["np0005604209.localdomain", "np0005604210.localdomain", "np0005604211.localdomain"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-01T07:39:12.049851Z", "last_refresh": "2026-02-01T09:32:26.304980Z", "running": 3, "size": 3}}, {"events": ["2026-02-01T07:38:44.443026Z service:node-proxy [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_name": "node-proxy", "service_type": "node-proxy", "status": {"created": "2026-02-01T07:38:44.402177Z", "running": 0, "size": 0}}, {"events": ["2026-02-01T07:39:12.075413Z service:osd.default_drive_group [INFO] \"service was created\""], "placement": {"hosts": ["np0005604212.localdomain", "np0005604213.localdomain", "np0005604215.localdomain"]}, "service_id": "default_drive_group", "service_name": "osd.default_drive_group", "service_type": "osd", "spec": {"data_devices": {"paths": ["/dev/ceph_vg0/ceph_lv0", "/dev/ceph_vg1/ceph_lv1"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-01T07:39:12.067676Z", "last_refresh": "2026-02-01T09:27:55.315443Z", "running": 6, "size": 6}}]}, "changed": false} TASK [ceph_migrate : Print Service Map] **************************************** skipping: [np0005604209.localdomain] => (item={'events': ['2026-02-01T07:40:28.908086Z service:crash [INFO] "service was created"'], 'placement': {'host_pattern': '*'}, 'service_name': 'crash', 'service_type': 'crash', 'status': {'created': '2026-02-01T07:38:30.151117Z', 'last_refresh': '2026-02-01T09:27:55.315276Z', 'running': 6, 'size': 6}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"events": ["2026-02-01T07:40:28.908086Z service:crash [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2026-02-01T07:38:30.151117Z", "last_refresh": "2026-02-01T09:27:55.315276Z", "running": 6, "size": 6}}} skipping: [np0005604209.localdomain] => (item={'events': ['2026-02-01T07:59:05.061136Z service:mds.mds [INFO] "service was created"'], 'placement': {'hosts': ['np0005604209.localdomain', 'np0005604210.localdomain', 'np0005604211.localdomain']}, 'service_id': 'mds', 'service_name': 'mds.mds', 'service_type': 'mds', 'status': {'created': '2026-02-01T07:58:58.022574Z', 'last_refresh': '2026-02-01T09:32:26.305418Z', 'running': 3, 'size': 3}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"events": ["2026-02-01T07:59:05.061136Z service:mds.mds [INFO] \"service was created\""], "placement": {"hosts": ["np0005604209.localdomain", "np0005604210.localdomain", "np0005604211.localdomain"]}, "service_id": "mds", "service_name": "mds.mds", "service_type": "mds", "status": {"created": "2026-02-01T07:58:58.022574Z", "last_refresh": "2026-02-01T09:32:26.305418Z", "running": 3, "size": 3}}} skipping: [np0005604209.localdomain] => (item={'events': ['2026-02-01T07:40:17.446180Z service:mgr [INFO] "service was created"', '2026-02-01T07:39:22.780040Z service:mgr [ERROR] "Failed to apply: Cannot place on np0005604211.localdomain: Unknown hosts"'], 'placement': {'hosts': ['np0005604209.localdomain', 'np0005604210.localdomain', 'np0005604211.localdomain']}, 'service_name': 'mgr', 'service_type': 'mgr', 'status': {'created': '2026-02-01T07:39:12.058631Z', 'last_refresh': '2026-02-01T09:32:26.305135Z', 'running': 3, 'size': 3}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"events": ["2026-02-01T07:40:17.446180Z service:mgr [INFO] \"service was created\"", "2026-02-01T07:39:22.780040Z service:mgr [ERROR] \"Failed to apply: Cannot place on np0005604211.localdomain: Unknown hosts\""], "placement": {"hosts": ["np0005604209.localdomain", "np0005604210.localdomain", "np0005604211.localdomain"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-01T07:39:12.058631Z", "last_refresh": "2026-02-01T09:32:26.305135Z", "running": 3, "size": 3}}} skipping: [np0005604209.localdomain] => (item={'events': ['2026-02-01T07:40:09.102652Z service:mon [INFO] "service was created"', '2026-02-01T07:39:22.778779Z service:mon [ERROR] "Failed to apply: Cannot place on np0005604211.localdomain: Unknown hosts"'], 'placement': {'hosts': ['np0005604209.localdomain', 'np0005604210.localdomain', 'np0005604211.localdomain']}, 'service_name': 'mon', 'service_type': 'mon', 'status': {'created': '2026-02-01T07:39:12.049851Z', 'last_refresh': '2026-02-01T09:32:26.304980Z', 'running': 3, 'size': 3}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"events": ["2026-02-01T07:40:09.102652Z service:mon [INFO] \"service was created\"", "2026-02-01T07:39:22.778779Z service:mon [ERROR] \"Failed to apply: Cannot place on np0005604211.localdomain: Unknown hosts\""], "placement": {"hosts": ["np0005604209.localdomain", "np0005604210.localdomain", "np0005604211.localdomain"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-01T07:39:12.049851Z", "last_refresh": "2026-02-01T09:32:26.304980Z", "running": 3, "size": 3}}} skipping: [np0005604209.localdomain] => (item={'events': ['2026-02-01T07:38:44.443026Z service:node-proxy [INFO] "service was created"'], 'placement': {'host_pattern': '*'}, 'service_name': 'node-proxy', 'service_type': 'node-proxy', 'status': {'created': '2026-02-01T07:38:44.402177Z', 'running': 0, 'size': 0}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"events": ["2026-02-01T07:38:44.443026Z service:node-proxy [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_name": "node-proxy", "service_type": "node-proxy", "status": {"created": "2026-02-01T07:38:44.402177Z", "running": 0, "size": 0}}} skipping: [np0005604209.localdomain] => (item={'events': ['2026-02-01T07:39:12.075413Z service:osd.default_drive_group [INFO] "service was created"'], 'placement': {'hosts': ['np0005604212.localdomain', 'np0005604213.localdomain', 'np0005604215.localdomain']}, 'service_id': 'default_drive_group', 'service_name': 'osd.default_drive_group', 'service_type': 'osd', 'spec': {'data_devices': {'paths': ['/dev/ceph_vg0/ceph_lv0', '/dev/ceph_vg1/ceph_lv1']}, 'filter_logic': 'AND', 'objectstore': 'bluestore'}, 'status': {'created': '2026-02-01T07:39:12.067676Z', 'last_refresh': '2026-02-01T09:27:55.315443Z', 'running': 6, 'size': 6}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"events": ["2026-02-01T07:39:12.075413Z service:osd.default_drive_group [INFO] \"service was created\""], "placement": {"hosts": ["np0005604212.localdomain", "np0005604213.localdomain", "np0005604215.localdomain"]}, "service_id": "default_drive_group", "service_name": "osd.default_drive_group", "service_type": "osd", "spec": {"data_devices": {"paths": ["/dev/ceph_vg0/ceph_lv0", "/dev/ceph_vg1/ceph_lv1"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-01T07:39:12.067676Z", "last_refresh": "2026-02-01T09:27:55.315443Z", "running": 6, "size": 6}}} skipping: [np0005604209.localdomain] => {"msg": "All items skipped"} TASK [ceph_migrate : Dump ceph orch ls output to log file] ********************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "dump | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Get Ceph config] ****************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "config", "dump", "-f", "json"], "delta": "0:00:02.724035", "end": "2026-02-01 09:38:40.550374", "msg": "", "rc": 0, "start": "2026-02-01 09:38:37.826339", "stderr": "Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e\nInferring config /var/lib/ceph/33fac0b9-80c7-560f-918a-c92d3021ca1e/mon.np0005604209/config\nUsing ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4", "stderr_lines": ["Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e", "Inferring config /var/lib/ceph/33fac0b9-80c7-560f-918a-c92d3021ca1e/mon.np0005604209/config", "Using ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4"], "stdout": "\n[{\"section\":\"global\",\"name\":\"cluster_network\",\"value\":\"172.20.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"container_image\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\",\"level\":\"basic\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv4\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv6\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"public_network\",\"value\":\"172.18.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mon\",\"name\":\"auth_allow_insecure_global_id_reclaim\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_base\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_init\",\"value\":\"True\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/migration_current\",\"value\":\"7\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/use_repo_digest\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/orchestrator/orchestrator\",\"value\":\"cephadm\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005604212\",\"location_type\":\"host\",\"location_value\":\"np0005604212\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005604213\",\"location_type\":\"host\",\"location_value\":\"np0005604213\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709082009\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005604215\",\"location_type\":\"host\",\"location_value\":\"np0005604215\"},{\"section\":\"osd\",\"name\":\"osd_memory_target_autotune\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mds.mds\",\"name\":\"mds_join_fs\",\"value\":\"mds\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"\"}]", "stdout_lines": ["", "[{\"section\":\"global\",\"name\":\"cluster_network\",\"value\":\"172.20.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"container_image\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\",\"level\":\"basic\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv4\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv6\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"public_network\",\"value\":\"172.18.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mon\",\"name\":\"auth_allow_insecure_global_id_reclaim\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_base\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_init\",\"value\":\"True\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/migration_current\",\"value\":\"7\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/use_repo_digest\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/orchestrator/orchestrator\",\"value\":\"cephadm\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005604212\",\"location_type\":\"host\",\"location_value\":\"np0005604212\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005604213\",\"location_type\":\"host\",\"location_value\":\"np0005604213\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709082009\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005604215\",\"location_type\":\"host\",\"location_value\":\"np0005604215\"},{\"section\":\"osd\",\"name\":\"osd_memory_target_autotune\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mds.mds\",\"name\":\"mds_join_fs\",\"value\":\"mds\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"\"}]"]} TASK [ceph_migrate : Print Ceph config dump] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Dump ceph config dump output to log file] ***************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "dump | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Get Ceph Orch Host Map] *********************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "orch", "host", "ls", "-f", "json"], "delta": "0:00:02.770594", "end": "2026-02-01 09:38:44.009699", "msg": "", "rc": 0, "start": "2026-02-01 09:38:41.239105", "stderr": "Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e\nInferring config /var/lib/ceph/33fac0b9-80c7-560f-918a-c92d3021ca1e/mon.np0005604209/config\nUsing ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4", "stderr_lines": ["Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e", "Inferring config /var/lib/ceph/33fac0b9-80c7-560f-918a-c92d3021ca1e/mon.np0005604209/config", "Using ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4"], "stdout": "\n[{\"addr\": \"192.168.122.103\", \"hostname\": \"np0005604209.localdomain\", \"labels\": [\"_admin\", \"mgr\", \"mon\"], \"status\": \"\"}, {\"addr\": \"192.168.122.104\", \"hostname\": \"np0005604210.localdomain\", \"labels\": [\"_admin\", \"mgr\", \"mon\"], \"status\": \"\"}, {\"addr\": \"192.168.122.105\", \"hostname\": \"np0005604211.localdomain\", \"labels\": [\"_admin\", \"mgr\", \"mon\"], \"status\": \"\"}, {\"addr\": \"192.168.122.106\", \"hostname\": \"np0005604212.localdomain\", \"labels\": [\"osd\"], \"status\": \"\"}, {\"addr\": \"192.168.122.107\", \"hostname\": \"np0005604213.localdomain\", \"labels\": [\"osd\"], \"status\": \"\"}, {\"addr\": \"192.168.122.108\", \"hostname\": \"np0005604215.localdomain\", \"labels\": [\"osd\"], \"status\": \"\"}]", "stdout_lines": ["", "[{\"addr\": \"192.168.122.103\", \"hostname\": \"np0005604209.localdomain\", \"labels\": [\"_admin\", \"mgr\", \"mon\"], \"status\": \"\"}, {\"addr\": \"192.168.122.104\", \"hostname\": \"np0005604210.localdomain\", \"labels\": [\"_admin\", \"mgr\", \"mon\"], \"status\": \"\"}, {\"addr\": \"192.168.122.105\", \"hostname\": \"np0005604211.localdomain\", \"labels\": [\"_admin\", \"mgr\", \"mon\"], \"status\": \"\"}, {\"addr\": \"192.168.122.106\", \"hostname\": \"np0005604212.localdomain\", \"labels\": [\"osd\"], \"status\": \"\"}, {\"addr\": \"192.168.122.107\", \"hostname\": \"np0005604213.localdomain\", \"labels\": [\"osd\"], \"status\": \"\"}, {\"addr\": \"192.168.122.108\", \"hostname\": \"np0005604215.localdomain\", \"labels\": [\"osd\"], \"status\": \"\"}]"]} TASK [ceph_migrate : Load nodes] *********************************************** ok: [np0005604209.localdomain] => {"ansible_facts": {"nds": [{"addr": "192.168.122.103", "hostname": "np0005604209.localdomain", "labels": ["_admin", "mgr", "mon"], "status": ""}, {"addr": "192.168.122.104", "hostname": "np0005604210.localdomain", "labels": ["_admin", "mgr", "mon"], "status": ""}, {"addr": "192.168.122.105", "hostname": "np0005604211.localdomain", "labels": ["_admin", "mgr", "mon"], "status": ""}, {"addr": "192.168.122.106", "hostname": "np0005604212.localdomain", "labels": ["osd"], "status": ""}, {"addr": "192.168.122.107", "hostname": "np0005604213.localdomain", "labels": ["osd"], "status": ""}, {"addr": "192.168.122.108", "hostname": "np0005604215.localdomain", "labels": ["osd"], "status": ""}]}, "changed": false} TASK [ceph_migrate : Load hostmap List] **************************************** ok: [np0005604209.localdomain] => {"ansible_facts": {"hostmap": {"np0005604209.localdomain": ["_admin", "mgr", "mon"], "np0005604210.localdomain": ["_admin", "mgr", "mon"], "np0005604211.localdomain": ["_admin", "mgr", "mon"], "np0005604212.localdomain": ["osd"], "np0005604213.localdomain": ["osd"], "np0005604215.localdomain": ["osd"]}}, "changed": false} TASK [ceph_migrate : Print Host Map] ******************************************* skipping: [np0005604209.localdomain] => (item=np0005604209.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005604209.localdomain"} skipping: [np0005604209.localdomain] => (item=np0005604210.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005604210.localdomain"} skipping: [np0005604209.localdomain] => (item=np0005604211.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005604211.localdomain"} skipping: [np0005604209.localdomain] => (item=np0005604212.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005604212.localdomain"} skipping: [np0005604209.localdomain] => (item=np0005604213.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005604213.localdomain"} skipping: [np0005604209.localdomain] => (item=np0005604215.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005604215.localdomain"} skipping: [np0005604209.localdomain] => {"msg": "All items skipped"} TASK [ceph_migrate : Dump ceph orch host ls output to log file] **************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "dump | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Get Ceph monmap and load data] **************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "mon", "dump", "-f", "json"], "delta": "0:00:02.792003", "end": "2026-02-01 09:38:47.653623", "msg": "", "rc": 0, "start": "2026-02-01 09:38:44.861620", "stderr": "Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e\nInferring config /var/lib/ceph/33fac0b9-80c7-560f-918a-c92d3021ca1e/mon.np0005604209/config\nUsing ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\ndumped monmap epoch 3", "stderr_lines": ["Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e", "Inferring config /var/lib/ceph/33fac0b9-80c7-560f-918a-c92d3021ca1e/mon.np0005604209/config", "Using ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4", "dumped monmap epoch 3"], "stdout": "\n{\"epoch\":3,\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"modified\":\"2026-02-01T07:40:10.311367Z\",\"created\":\"2026-02-01T07:37:52.883666Z\",\"min_mon_release\":18,\"min_mon_release_name\":\"reef\",\"election_strategy\":1,\"disallowed_leaders: \":\"\",\"stretch_mode\":false,\"tiebreaker_mon\":\"\",\"removed_ranks: \":\"\",\"features\":{\"persistent\":[\"kraken\",\"luminous\",\"mimic\",\"osdmap-prune\",\"nautilus\",\"octopus\",\"pacific\",\"elector-pinging\",\"quincy\",\"reef\"],\"optional\":[]},\"mons\":[{\"rank\":0,\"name\":\"np0005604209\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.103:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.103:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.103:6789/0\",\"public_addr\":\"172.18.0.103:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":1,\"name\":\"np0005604211\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.105:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.105:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.105:6789/0\",\"public_addr\":\"172.18.0.105:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":2,\"name\":\"np0005604210\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.104:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.104:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.104:6789/0\",\"public_addr\":\"172.18.0.104:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"}],\"quorum\":[0,1,2]}", "stdout_lines": ["", "{\"epoch\":3,\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"modified\":\"2026-02-01T07:40:10.311367Z\",\"created\":\"2026-02-01T07:37:52.883666Z\",\"min_mon_release\":18,\"min_mon_release_name\":\"reef\",\"election_strategy\":1,\"disallowed_leaders: \":\"\",\"stretch_mode\":false,\"tiebreaker_mon\":\"\",\"removed_ranks: \":\"\",\"features\":{\"persistent\":[\"kraken\",\"luminous\",\"mimic\",\"osdmap-prune\",\"nautilus\",\"octopus\",\"pacific\",\"elector-pinging\",\"quincy\",\"reef\"],\"optional\":[]},\"mons\":[{\"rank\":0,\"name\":\"np0005604209\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.103:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.103:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.103:6789/0\",\"public_addr\":\"172.18.0.103:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":1,\"name\":\"np0005604211\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.105:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.105:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.105:6789/0\",\"public_addr\":\"172.18.0.105:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":2,\"name\":\"np0005604210\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.104:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.104:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.104:6789/0\",\"public_addr\":\"172.18.0.104:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"}],\"quorum\":[0,1,2]}"]} TASK [ceph_migrate : Get Monmap] *********************************************** ok: [np0005604209.localdomain] => {"ansible_facts": {"mon_dump": {"created": "2026-02-01T07:37:52.883666Z", "disallowed_leaders: ": "", "election_strategy": 1, "epoch": 3, "features": {"optional": [], "persistent": ["kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef"]}, "fsid": "33fac0b9-80c7-560f-918a-c92d3021ca1e", "min_mon_release": 18, "min_mon_release_name": "reef", "modified": "2026-02-01T07:40:10.311367Z", "mons": [{"addr": "172.18.0.103:6789/0", "crush_location": "{}", "name": "np0005604209", "priority": 0, "public_addr": "172.18.0.103:6789/0", "public_addrs": {"addrvec": [{"addr": "172.18.0.103:3300", "nonce": 0, "type": "v2"}, {"addr": "172.18.0.103:6789", "nonce": 0, "type": "v1"}]}, "rank": 0, "weight": 0}, {"addr": "172.18.0.105:6789/0", "crush_location": "{}", "name": "np0005604211", "priority": 0, "public_addr": "172.18.0.105:6789/0", "public_addrs": {"addrvec": [{"addr": "172.18.0.105:3300", "nonce": 0, "type": "v2"}, {"addr": "172.18.0.105:6789", "nonce": 0, "type": "v1"}]}, "rank": 1, "weight": 0}, {"addr": "172.18.0.104:6789/0", "crush_location": "{}", "name": "np0005604210", "priority": 0, "public_addr": "172.18.0.104:6789/0", "public_addrs": {"addrvec": [{"addr": "172.18.0.104:3300", "nonce": 0, "type": "v2"}, {"addr": "172.18.0.104:6789", "nonce": 0, "type": "v1"}]}, "rank": 2, "weight": 0}], "quorum": [0, 1, 2], "removed_ranks: ": "", "stretch_mode": false, "tiebreaker_mon": ""}}, "changed": false} TASK [ceph_migrate : Print monmap] ********************************************* skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Dump ceph mon dump output to log file] ******************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "dump | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Load nodes to decommission] ******************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"decomm_nodes": ["np0005604209.localdomain", "np0005604210.localdomain", "np0005604211.localdomain"]}, "changed": false} TASK [ceph_migrate : Load target nodes] **************************************** ok: [np0005604209.localdomain] => {"ansible_facts": {"target_nodes": ["np0005604212.localdomain", "np0005604213.localdomain", "np0005604215.localdomain"]}, "changed": false} TASK [ceph_migrate : Print target nodes] *************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug|default(false)"} TASK [ceph_migrate : Print decomm_nodes] *************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug|default(false)"} TASK [ceph_migrate : ansible.builtin.fail if input is not provided] ************ skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph is undefined or ceph | length == 0", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Get cluster health] *************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : ansible.builtin.fail if health is HEALTH_WARN || HEALTH_ERR] *** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph.health.status == 'HEALTH_WARN' or ceph.health.status == 'HEALTH_ERR'", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : PgMap] **************************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : ansible.builtin.fail if PGs are not in active+clean state] *** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "pgstate != 'active+clean'", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : OSDMap] *************************************************** ok: [np0005604209.localdomain] => { "msg": "100.0" } TASK [ceph_migrate : ansible.builtin.fail if there is an unacceptable OSDs number] *** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "pct | float < 100", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MonMap] *************************************************** skipping: [np0005604209.localdomain] => {"false_condition": "check_ceph_release | default(false) | bool"} TASK [ceph_migrate : ansible.builtin.fail if Ceph <= Quincy] ******************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "check_ceph_release | default(false) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Mons in quorum] ******************************************* skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : ansible.builtin.fail if Mons are not in quorum] *********** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph.monmap.num_mons < decomm_nodes | length", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : is Ceph Mgr available] ************************************ skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : ansible.builtin.fail if Mgr is not available] ************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "not ceph.mgrmap.available | bool | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : in progress events] *************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : ansible.builtin.fail if there are in progress events] ***** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph.progress_events | length > 0", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Dump Ceph Status] ***************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /etc/ceph:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : set container image base in ceph configuration] *********** ok: [np0005604209.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "config", "set", "mgr", "mgr/cephadm/container_image_base", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest"], "delta": "0:00:00.703787", "end": "2026-02-01 09:38:50.003657", "msg": "", "rc": 0, "start": "2026-02-01 09:38:49.299870", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : set alertmanager container image in ceph configuration] *** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : set grafana container image in ceph configuration] ******** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : set node-exporter container image in ceph configuration] *** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : set prometheus container image in ceph configuration] ***** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Set haproxy container image in ceph configuration] ******** ok: [np0005604209.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "config", "set", "mgr", "mgr/cephadm/container_image_haproxy", "registry.redhat.io/rhceph/rhceph-haproxy-rhel9:latest"], "delta": "0:00:00.713757", "end": "2026-02-01 09:38:51.472852", "msg": "", "rc": 0, "start": "2026-02-01 09:38:50.759095", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Set keepalived container image in ceph configuration] ***** ok: [np0005604209.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "config", "set", "mgr", "mgr/cephadm/container_image_keepalived", "registry.redhat.io/rhceph/keepalived-rhel9:latest"], "delta": "0:00:00.666070", "end": "2026-02-01 09:38:52.761439", "msg": "", "rc": 0, "start": "2026-02-01 09:38:52.095369", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Update firewall rules on the target nodes] **************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/firewall.yaml for np0005604209.localdomain => (item=np0005604212.localdomain) included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/firewall.yaml for np0005604209.localdomain => (item=np0005604213.localdomain) included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/firewall.yaml for np0005604209.localdomain => (item=np0005604215.localdomain) TASK [ceph_migrate : Ceph Migration - Apply the Ceph cluster rules (iptables)] *** skipping: [np0005604209.localdomain] => (item=/etc/sysconfig/iptables) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "item": "/etc/sysconfig/iptables", "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => (item=/etc/sysconfig/ip6tables) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "item": "/etc/sysconfig/ip6tables", "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => {"changed": false, "msg": "All items skipped"} TASK [ceph_migrate : Ensure firewall is enabled/started - iptables] ************ skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Ceph Migration - Apply the Ceph cluster rules (nftables)] *** changed: [np0005604209.localdomain -> np0005604212.localdomain(192.168.122.106)] => {"changed": true, "msg": "Block inserted and ownership, perms or SE linux context changed"} TASK [ceph_migrate : Ensure firewall is enabled/started - nftables] ************ changed: [np0005604209.localdomain -> np0005604212.localdomain(192.168.122.106)] => {"changed": true, "enabled": true, "name": "nftables", "state": "started", "status": {"AccessSELinuxContext": "system_u:object_r:systemd_unit_file_t:s0", "ActiveEnterTimestamp": "Sun 2026-02-01 07:49:43 UTC", "ActiveEnterTimestampMonotonic": "4277651391", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice basic.target systemd-journald.socket sysinit.target", "AllowIsolate": "no", "AssertResult": "yes", "AssertTimestamp": "Sun 2026-02-01 07:49:43 UTC", "AssertTimestampMonotonic": "4277540442", "Before": "network-pre.target multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "yes", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "36490000", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read cap_perfmon cap_bpf cap_checkpoint_restore", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2026-02-01 07:49:43 UTC", "ConditionTimestampMonotonic": "4277540440", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroupId": "0", "ControlPID": "0", "CoredumpFilter": "0x33", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Netfilter Tables", "DevicePolicy": "auto", "Documentation": "\"man:nft(8)\"", "DynamicUser": "no", "ExecMainCode": "1", "ExecMainExitTimestamp": "Sun 2026-02-01 07:49:43 UTC", "ExecMainExitTimestampMonotonic": "4277651050", "ExecMainPID": "41601", "ExecMainStartTimestamp": "Sun 2026-02-01 07:49:43 UTC", "ExecMainStartTimestampMonotonic": "4277557663", "ExecMainStatus": "0", "ExecReload": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset; include \"/etc/sysconfig/nftables.conf\"; ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset; include \"/etc/sysconfig/nftables.conf\"; ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/sbin/nft ; argv[]=/sbin/nft -f /etc/sysconfig/nftables.conf ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/sbin/nft ; argv[]=/sbin/nft -f /etc/sysconfig/nftables.conf ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExitType": "main", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/usr/lib/systemd/system/nftables.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "yes", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "2", "IOSchedulingPriority": "4", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nftables.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2026-02-01 07:49:43 UTC", "InactiveExitTimestampMonotonic": "4277557860", "InvocationID": "3ad99027a519482491f1293479721b34", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "8388608", "LimitMEMLOCKSoft": "8388608", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "62638", "LimitNPROCSoft": "62638", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "62638", "LimitSIGPENDINGSoft": "62638", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "ManagedOOMMemoryPressure": "auto", "ManagedOOMMemoryPressureLimit": "0", "ManagedOOMPreference": "none", "ManagedOOMSwap": "auto", "MemoryAccounting": "yes", "MemoryAvailable": "infinity", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAPolicy": "n/a", "Names": "nftables.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "OnSuccessJobMode": "fail", "Perpetual": "no", "PrivateDevices": "no", "PrivateIPC": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProcSubset": "all", "ProtectClock": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectProc": "default", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "yes", "RemoveIPC": "no", "Requires": "sysinit.target system.slice", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "RuntimeRandomizedExtraUSec": "0", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2026-02-01 07:49:43 UTC", "StateChangeTimestampMonotonic": "4277651391", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "exited", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "2147483646", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "100220", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartFailureMode": "terminate", "TimeoutStartUSec": "infinity", "TimeoutStopFailureMode": "terminate", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "oneshot", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-pre.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [ceph_migrate : Ceph Migration - Apply the Ceph cluster rules (iptables)] *** skipping: [np0005604209.localdomain] => (item=/etc/sysconfig/iptables) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "item": "/etc/sysconfig/iptables", "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => (item=/etc/sysconfig/ip6tables) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "item": "/etc/sysconfig/ip6tables", "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => {"changed": false, "msg": "All items skipped"} TASK [ceph_migrate : Ensure firewall is enabled/started - iptables] ************ skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Ceph Migration - Apply the Ceph cluster rules (nftables)] *** changed: [np0005604209.localdomain -> np0005604213.localdomain(192.168.122.107)] => {"changed": true, "msg": "Block inserted and ownership, perms or SE linux context changed"} TASK [ceph_migrate : Ensure firewall is enabled/started - nftables] ************ changed: [np0005604209.localdomain -> np0005604213.localdomain(192.168.122.107)] => {"changed": true, "enabled": true, "name": "nftables", "state": "started", "status": {"AccessSELinuxContext": "system_u:object_r:systemd_unit_file_t:s0", "ActiveEnterTimestamp": "Sun 2026-02-01 07:49:43 UTC", "ActiveEnterTimestampMonotonic": "4274776958", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target system.slice systemd-journald.socket sysinit.target", "AllowIsolate": "no", "AssertResult": "yes", "AssertTimestamp": "Sun 2026-02-01 07:49:43 UTC", "AssertTimestampMonotonic": "4274677275", "Before": "multi-user.target network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "yes", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "32613000", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read cap_perfmon cap_bpf cap_checkpoint_restore", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2026-02-01 07:49:43 UTC", "ConditionTimestampMonotonic": "4274677274", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroupId": "0", "ControlPID": "0", "CoredumpFilter": "0x33", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Netfilter Tables", "DevicePolicy": "auto", "Documentation": "\"man:nft(8)\"", "DynamicUser": "no", "ExecMainCode": "1", "ExecMainExitTimestamp": "Sun 2026-02-01 07:49:43 UTC", "ExecMainExitTimestampMonotonic": "4274776542", "ExecMainPID": "42988", "ExecMainStartTimestamp": "Sun 2026-02-01 07:49:43 UTC", "ExecMainStartTimestampMonotonic": "4274687002", "ExecMainStatus": "0", "ExecReload": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset; include \"/etc/sysconfig/nftables.conf\"; ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset; include \"/etc/sysconfig/nftables.conf\"; ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/sbin/nft ; argv[]=/sbin/nft -f /etc/sysconfig/nftables.conf ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/sbin/nft ; argv[]=/sbin/nft -f /etc/sysconfig/nftables.conf ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExitType": "main", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/usr/lib/systemd/system/nftables.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "yes", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "2", "IOSchedulingPriority": "4", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nftables.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2026-02-01 07:49:43 UTC", "InactiveExitTimestampMonotonic": "4274687201", "InvocationID": "7407861c61464774b7440942395718da", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "8388608", "LimitMEMLOCKSoft": "8388608", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "62638", "LimitNPROCSoft": "62638", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "62638", "LimitSIGPENDINGSoft": "62638", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "ManagedOOMMemoryPressure": "auto", "ManagedOOMMemoryPressureLimit": "0", "ManagedOOMPreference": "none", "ManagedOOMSwap": "auto", "MemoryAccounting": "yes", "MemoryAvailable": "infinity", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAPolicy": "n/a", "Names": "nftables.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "OnSuccessJobMode": "fail", "Perpetual": "no", "PrivateDevices": "no", "PrivateIPC": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProcSubset": "all", "ProtectClock": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectProc": "default", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "yes", "RemoveIPC": "no", "Requires": "system.slice sysinit.target", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "RuntimeRandomizedExtraUSec": "0", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2026-02-01 07:49:43 UTC", "StateChangeTimestampMonotonic": "4274776958", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "exited", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "2147483646", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "100220", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartFailureMode": "terminate", "TimeoutStartUSec": "infinity", "TimeoutStopFailureMode": "terminate", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "oneshot", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-pre.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [ceph_migrate : Ceph Migration - Apply the Ceph cluster rules (iptables)] *** skipping: [np0005604209.localdomain] => (item=/etc/sysconfig/iptables) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "item": "/etc/sysconfig/iptables", "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => (item=/etc/sysconfig/ip6tables) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "item": "/etc/sysconfig/ip6tables", "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => {"changed": false, "msg": "All items skipped"} TASK [ceph_migrate : Ensure firewall is enabled/started - iptables] ************ skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_firewall_type == \"iptables\"", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Ceph Migration - Apply the Ceph cluster rules (nftables)] *** changed: [np0005604209.localdomain -> np0005604215.localdomain(192.168.122.108)] => {"changed": true, "msg": "Block inserted and ownership, perms or SE linux context changed"} TASK [ceph_migrate : Ensure firewall is enabled/started - nftables] ************ changed: [np0005604209.localdomain -> np0005604215.localdomain(192.168.122.108)] => {"changed": true, "enabled": true, "name": "nftables", "state": "started", "status": {"AccessSELinuxContext": "system_u:object_r:systemd_unit_file_t:s0", "ActiveEnterTimestamp": "Sun 2026-02-01 07:49:42 UTC", "ActiveEnterTimestampMonotonic": "4266777986", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target basic.target systemd-journald.socket system.slice", "AllowIsolate": "no", "AssertResult": "yes", "AssertTimestamp": "Sun 2026-02-01 07:49:42 UTC", "AssertTimestampMonotonic": "4266700167", "Before": "network-pre.target multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "yes", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "30619000", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read cap_perfmon cap_bpf cap_checkpoint_restore", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2026-02-01 07:49:42 UTC", "ConditionTimestampMonotonic": "4266700165", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroupId": "0", "ControlPID": "0", "CoredumpFilter": "0x33", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Netfilter Tables", "DevicePolicy": "auto", "Documentation": "\"man:nft(8)\"", "DynamicUser": "no", "ExecMainCode": "1", "ExecMainExitTimestamp": "Sun 2026-02-01 07:49:42 UTC", "ExecMainExitTimestampMonotonic": "4266777529", "ExecMainPID": "42389", "ExecMainStartTimestamp": "Sun 2026-02-01 07:49:42 UTC", "ExecMainStartTimestampMonotonic": "4266701515", "ExecMainStatus": "0", "ExecReload": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset; include \"/etc/sysconfig/nftables.conf\"; ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset; include \"/etc/sysconfig/nftables.conf\"; ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/sbin/nft ; argv[]=/sbin/nft -f /etc/sysconfig/nftables.conf ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/sbin/nft ; argv[]=/sbin/nft -f /etc/sysconfig/nftables.conf ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/sbin/nft ; argv[]=/sbin/nft flush ruleset ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExitType": "main", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/usr/lib/systemd/system/nftables.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "yes", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "2", "IOSchedulingPriority": "4", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nftables.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2026-02-01 07:49:42 UTC", "InactiveExitTimestampMonotonic": "4266701708", "InvocationID": "f0fd6f51bf884b07bc16ba067d2ee887", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "8388608", "LimitMEMLOCKSoft": "8388608", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "62638", "LimitNPROCSoft": "62638", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "62638", "LimitSIGPENDINGSoft": "62638", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "ManagedOOMMemoryPressure": "auto", "ManagedOOMMemoryPressureLimit": "0", "ManagedOOMPreference": "none", "ManagedOOMSwap": "auto", "MemoryAccounting": "yes", "MemoryAvailable": "infinity", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAPolicy": "n/a", "Names": "nftables.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "OnSuccessJobMode": "fail", "Perpetual": "no", "PrivateDevices": "no", "PrivateIPC": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProcSubset": "all", "ProtectClock": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectProc": "default", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "yes", "RemoveIPC": "no", "Requires": "system.slice sysinit.target", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "RuntimeRandomizedExtraUSec": "0", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2026-02-01 07:49:42 UTC", "StateChangeTimestampMonotonic": "4266777986", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "exited", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "2147483646", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "100220", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartFailureMode": "terminate", "TimeoutStartUSec": "infinity", "TimeoutStopFailureMode": "terminate", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "oneshot", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-pre.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [ceph_migrate : Get ceph_cli] ********************************************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Set the dashboard port] *********************************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Set the dashboard ssl port] ******************************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Disable mgr dashboard module (restart)] ******************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Enable mgr dashboard module (restart)] ******************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Set the prometheus server port] *************************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Set the prometheus server address] ************************ skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Enable prometheus module] ********************************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "ceph_daemons_layout.monitoring | default(true) | bool"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005604209.localdomain] => {"false_condition": "ceph_daemons_layout.monitoring | default(true) | bool"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** skipping: [np0005604209.localdomain] => (item=['np0005604212.localdomain', 'monitoring']) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "item": ["np0005604212.localdomain", "monitoring"], "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => (item=['np0005604213.localdomain', 'monitoring']) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "item": ["np0005604213.localdomain", "monitoring"], "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => (item=['np0005604215.localdomain', 'monitoring']) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "item": ["np0005604215.localdomain", "monitoring"], "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => {"changed": false, "msg": "All items skipped"} TASK [ceph_migrate : MONITORING - Load Spec from the orchestrator] ************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Print the loaded data] ************************************ skipping: [np0005604209.localdomain] => {"false_condition": "ceph_daemons_layout.monitoring | default(true) | bool"} TASK [ceph_migrate : Update the Monitoring Stack spec definition] ************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005604209.localdomain] => {"false_condition": "ceph_daemons_layout.monitoring | default(true) | bool"} TASK [ceph_migrate : MONITORING - wait daemons] ******************************** skipping: [np0005604209.localdomain] => (item=grafana) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "item": "grafana", "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => (item=prometheus) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "item": "prometheus", "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => (item=alertmanager) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "item": "alertmanager", "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => {"changed": false, "msg": "All items skipped"} TASK [ceph_migrate : Sleep before moving to the next daemon] ******************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.monitoring | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /etc/ceph:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : MDS - Load Spec from the orchestrator] ******************** ok: [np0005604209.localdomain] => {"ansible_facts": {"mds_spec": {"service_name": "mds.mds", "service_type": "mds", "spec": {}}}, "changed": false} TASK [ceph_migrate : Print the resulting MDS spec] ***************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** changed: [np0005604209.localdomain] => (item=['np0005604209.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604209.localdomain", "mds"], "delta": "0:00:00.772159", "end": "2026-02-01 09:39:04.154091", "item": ["np0005604209.localdomain", "mds"], "msg": "", "rc": 0, "start": "2026-02-01 09:39:03.381932", "stderr": "", "stderr_lines": [], "stdout": "Added label mds to host np0005604209.localdomain", "stdout_lines": ["Added label mds to host np0005604209.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604210.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604210.localdomain", "mds"], "delta": "0:00:00.715120", "end": "2026-02-01 09:39:05.447913", "item": ["np0005604210.localdomain", "mds"], "msg": "", "rc": 0, "start": "2026-02-01 09:39:04.732793", "stderr": "", "stderr_lines": [], "stdout": "Added label mds to host np0005604210.localdomain", "stdout_lines": ["Added label mds to host np0005604210.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604211.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604211.localdomain", "mds"], "delta": "0:00:00.737175", "end": "2026-02-01 09:39:06.767414", "item": ["np0005604211.localdomain", "mds"], "msg": "", "rc": 0, "start": "2026-02-01 09:39:06.030239", "stderr": "", "stderr_lines": [], "stdout": "Added label mds to host np0005604211.localdomain", "stdout_lines": ["Added label mds to host np0005604211.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604212.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604212.localdomain", "mds"], "delta": "0:00:00.692863", "end": "2026-02-01 09:39:08.063468", "item": ["np0005604212.localdomain", "mds"], "msg": "", "rc": 0, "start": "2026-02-01 09:39:07.370605", "stderr": "", "stderr_lines": [], "stdout": "Added label mds to host np0005604212.localdomain", "stdout_lines": ["Added label mds to host np0005604212.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604213.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604213.localdomain", "mds"], "delta": "0:00:00.712964", "end": "2026-02-01 09:39:09.359630", "item": ["np0005604213.localdomain", "mds"], "msg": "", "rc": 0, "start": "2026-02-01 09:39:08.646666", "stderr": "", "stderr_lines": [], "stdout": "Added label mds to host np0005604213.localdomain", "stdout_lines": ["Added label mds to host np0005604213.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604215.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604215.localdomain", "mds"], "delta": "0:00:00.694175", "end": "2026-02-01 09:39:10.642984", "item": ["np0005604215.localdomain", "mds"], "msg": "", "rc": 0, "start": "2026-02-01 09:39:09.948809", "stderr": "", "stderr_lines": [], "stdout": "Added label mds to host np0005604215.localdomain", "stdout_lines": ["Added label mds to host np0005604215.localdomain"]} TASK [ceph_migrate : Update the MDS Daemon spec definition] ******************** ok: [np0005604209.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/etc/ceph:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mds:/home/tripleo-admin/mds:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mds"], "delta": "0:00:00.730326", "end": "2026-02-01 09:39:12.207524", "rc": 0, "start": "2026-02-01 09:39:11.477198", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mds.mds update...", "stdout_lines": ["Scheduled mds.mds update..."]} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Wait for the orchestrator to process the spec] ************ Pausing for 30 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 30, "echo": true, "rc": 0, "start": "2026-02-01 09:39:12.384782", "stderr": "", "stdout": "Paused for 30.03 seconds", "stop": "2026-02-01 09:39:42.415961", "user_input": ""} TASK [ceph_migrate : Reload the updated mdsmap] ******************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "fs", "status", "cephfs", "-f", "json"], "delta": "0:00:00.739356", "end": "2026-02-01 09:39:43.725881", "msg": "", "rc": 0, "start": "2026-02-01 09:39:42.986525", "stderr": "", "stderr_lines": [], "stdout": "\n{\"clients\": [{\"clients\": 0, \"fs\": \"cephfs\"}], \"mds_version\": [{\"daemon\": [\"mds.np0005604209.wikopf\", \"mds.np0005604215.rwvxvg\", \"mds.np0005604213.jdbvyh\", \"mds.np0005604211.ggsxcc\", \"mds.np0005604210.yulljq\", \"mds.np0005604212.tkdkxt\"], \"version\": \"ceph version 18.2.1-361.el9cp (439dcd6094d413840eb2ec590fe2194ec616687f) reef (stable)\"}], \"mdsmap\": [{\"caps\": 0, \"dirs\": 12, \"dns\": 10, \"inos\": 13, \"name\": \"mds.np0005604209.wikopf\", \"rank\": 0, \"rate\": 0, \"state\": \"active\"}, {\"name\": \"mds.np0005604215.rwvxvg\", \"state\": \"standby\"}, {\"name\": \"mds.np0005604213.jdbvyh\", \"state\": \"standby\"}, {\"name\": \"mds.np0005604211.ggsxcc\", \"state\": \"standby\"}, {\"name\": \"mds.np0005604210.yulljq\", \"state\": \"standby\"}, {\"name\": \"mds.np0005604212.tkdkxt\", \"state\": \"standby\"}], \"pools\": [{\"avail\": 14041846784, \"id\": 7, \"name\": \"manila_metadata\", \"type\": \"metadata\", \"used\": 98304}, {\"avail\": 14041846784, \"id\": 6, \"name\": \"manila_data\", \"type\": \"data\", \"used\": 0}]}", "stdout_lines": ["", "{\"clients\": [{\"clients\": 0, \"fs\": \"cephfs\"}], \"mds_version\": [{\"daemon\": [\"mds.np0005604209.wikopf\", \"mds.np0005604215.rwvxvg\", \"mds.np0005604213.jdbvyh\", \"mds.np0005604211.ggsxcc\", \"mds.np0005604210.yulljq\", \"mds.np0005604212.tkdkxt\"], \"version\": \"ceph version 18.2.1-361.el9cp (439dcd6094d413840eb2ec590fe2194ec616687f) reef (stable)\"}], \"mdsmap\": [{\"caps\": 0, \"dirs\": 12, \"dns\": 10, \"inos\": 13, \"name\": \"mds.np0005604209.wikopf\", \"rank\": 0, \"rate\": 0, \"state\": \"active\"}, {\"name\": \"mds.np0005604215.rwvxvg\", \"state\": \"standby\"}, {\"name\": \"mds.np0005604213.jdbvyh\", \"state\": \"standby\"}, {\"name\": \"mds.np0005604211.ggsxcc\", \"state\": \"standby\"}, {\"name\": \"mds.np0005604210.yulljq\", \"state\": \"standby\"}, {\"name\": \"mds.np0005604212.tkdkxt\", \"state\": \"standby\"}], \"pools\": [{\"avail\": 14041846784, \"id\": 7, \"name\": \"manila_metadata\", \"type\": \"metadata\", \"used\": 98304}, {\"avail\": 14041846784, \"id\": 6, \"name\": \"manila_data\", \"type\": \"data\", \"used\": 0}]}"]} TASK [ceph_migrate : Get MDS Daemons] ****************************************** ok: [np0005604209.localdomain] => {"ansible_facts": {"mds_daemons": {"clients": [{"clients": 0, "fs": "cephfs"}], "mds_version": [{"daemon": ["mds.np0005604209.wikopf", "mds.np0005604215.rwvxvg", "mds.np0005604213.jdbvyh", "mds.np0005604211.ggsxcc", "mds.np0005604210.yulljq", "mds.np0005604212.tkdkxt"], "version": "ceph version 18.2.1-361.el9cp (439dcd6094d413840eb2ec590fe2194ec616687f) reef (stable)"}], "mdsmap": [{"caps": 0, "dirs": 12, "dns": 10, "inos": 13, "name": "mds.np0005604209.wikopf", "rank": 0, "rate": 0, "state": "active"}, {"name": "mds.np0005604215.rwvxvg", "state": "standby"}, {"name": "mds.np0005604213.jdbvyh", "state": "standby"}, {"name": "mds.np0005604211.ggsxcc", "state": "standby"}, {"name": "mds.np0005604210.yulljq", "state": "standby"}, {"name": "mds.np0005604212.tkdkxt", "state": "standby"}], "pools": [{"avail": 14041846784, "id": 7, "name": "manila_metadata", "type": "metadata", "used": 98304}, {"avail": 14041846784, "id": 6, "name": "manila_data", "type": "data", "used": 0}]}}, "changed": false} TASK [ceph_migrate : Print Daemons] ******************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Get MDS daemons that are not part of decomm nodes] ******** skipping: [np0005604209.localdomain] => (item={'caps': 0, 'dirs': 12, 'dns': 10, 'inos': 13, 'name': 'mds.np0005604209.wikopf', 'rank': 0, 'rate': 0, 'state': 'active'}) => {"ansible_loop_var": "item", "changed": false, "false_condition": "item.state == \"standby\"", "item": {"caps": 0, "dirs": 12, "dns": 10, "inos": 13, "name": "mds.np0005604209.wikopf", "rank": 0, "rate": 0, "state": "active"}, "skip_reason": "Conditional result was False"} ok: [np0005604209.localdomain] => (item={'name': 'mds.np0005604215.rwvxvg', 'state': 'standby'}) => {"ansible_facts": {"mds_aff_daemon": {"name": "mds.np0005604215.rwvxvg", "state": "standby"}}, "ansible_loop_var": "item", "changed": false, "item": {"name": "mds.np0005604215.rwvxvg", "state": "standby"}} ok: [np0005604209.localdomain] => (item={'name': 'mds.np0005604213.jdbvyh', 'state': 'standby'}) => {"ansible_facts": {"mds_aff_daemon": {"name": "mds.np0005604213.jdbvyh", "state": "standby"}}, "ansible_loop_var": "item", "changed": false, "item": {"name": "mds.np0005604213.jdbvyh", "state": "standby"}} ok: [np0005604209.localdomain] => (item={'name': 'mds.np0005604211.ggsxcc', 'state': 'standby'}) => {"ansible_facts": {"mds_aff_daemon": {"name": "mds.np0005604211.ggsxcc", "state": "standby"}}, "ansible_loop_var": "item", "changed": false, "item": {"name": "mds.np0005604211.ggsxcc", "state": "standby"}} ok: [np0005604209.localdomain] => (item={'name': 'mds.np0005604210.yulljq', 'state': 'standby'}) => {"ansible_facts": {"mds_aff_daemon": {"name": "mds.np0005604210.yulljq", "state": "standby"}}, "ansible_loop_var": "item", "changed": false, "item": {"name": "mds.np0005604210.yulljq", "state": "standby"}} ok: [np0005604209.localdomain] => (item={'name': 'mds.np0005604212.tkdkxt', 'state': 'standby'}) => {"ansible_facts": {"mds_aff_daemon": {"name": "mds.np0005604212.tkdkxt", "state": "standby"}}, "ansible_loop_var": "item", "changed": false, "item": {"name": "mds.np0005604212.tkdkxt", "state": "standby"}} TASK [ceph_migrate : Affinity daemon selected] ********************************* ok: [np0005604209.localdomain] => { "msg": { "name": "mds.np0005604212.tkdkxt", "state": "standby" } } TASK [ceph_migrate : Set MDS affinity] ***************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": "podman run --rm --net=host --ipc=host --volume /etc/ceph:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring config set mds.np0005604212.tkdkxt mds_join_fs cephfs", "delta": "0:00:00.727252", "end": "2026-02-01 09:39:45.327311", "msg": "", "rc": 0, "start": "2026-02-01 09:39:44.600059", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Set/Unset labels - rm] ************************************ skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - rm] ************************************ changed: [np0005604209.localdomain] => (item=['np0005604209.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005604209.localdomain", "mds"], "delta": "0:00:00.726509", "end": "2026-02-01 09:39:46.653219", "item": ["np0005604209.localdomain", "mds"], "msg": "", "rc": 0, "start": "2026-02-01 09:39:45.926710", "stderr": "", "stderr_lines": [], "stdout": "Removed label mds from host np0005604209.localdomain", "stdout_lines": ["Removed label mds from host np0005604209.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604210.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005604210.localdomain", "mds"], "delta": "0:00:00.778270", "end": "2026-02-01 09:39:47.973984", "item": ["np0005604210.localdomain", "mds"], "msg": "", "rc": 0, "start": "2026-02-01 09:39:47.195714", "stderr": "", "stderr_lines": [], "stdout": "Removed label mds from host np0005604210.localdomain", "stdout_lines": ["Removed label mds from host np0005604210.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604211.localdomain', 'mds']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005604211.localdomain", "mds"], "delta": "0:00:00.836585", "end": "2026-02-01 09:39:49.385727", "item": ["np0005604211.localdomain", "mds"], "msg": "", "rc": 0, "start": "2026-02-01 09:39:48.549142", "stderr": "", "stderr_lines": [], "stdout": "Removed label mds from host np0005604211.localdomain", "stdout_lines": ["Removed label mds from host np0005604211.localdomain"]} TASK [ceph_migrate : Wait daemons] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005604209.localdomain TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mds] ********************************************* changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mds", "-f", "json"], "delta": "0:00:00.708299", "end": "2026-02-01 09:39:50.828693", "msg": "", "rc": 0, "start": "2026-02-01 09:39:50.120394", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"0a8b38ea1be3\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.16%\", \"created\": \"2026-02-01T07:59:02.658297Z\", \"daemon_id\": \"mds.np0005604209.wikopf\", \"daemon_name\": \"mds.mds.np0005604209.wikopf\", \"daemon_type\": \"mds\", \"events\": [\"2026-02-01T07:59:02.742276Z daemon:mds.mds.np0005604209.wikopf [INFO] \\\"Deployed mds.mds.np0005604209.wikopf on host 'np0005604209.localdomain'\\\"\"], \"hostname\": \"np0005604209.localdomain\", \"is_active\": true, \"last_refresh\": \"2026-02-01T09:32:26.305418Z\", \"memory_usage\": 29590814, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2026-02-01T07:59:02.474035Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"04c207075b71\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.04%\", \"created\": \"2026-02-01T07:59:04.933047Z\", \"daemon_id\": \"mds.np0005604210.yulljq\", \"daemon_name\": \"mds.mds.np0005604210.yulljq\", \"daemon_type\": \"mds\", \"events\": [\"2026-02-01T07:59:05.022367Z daemon:mds.mds.np0005604210.yulljq [INFO] \\\"Deployed mds.mds.np0005604210.yulljq on host 'np0005604210.localdomain'\\\"\"], \"hostname\": \"np0005604210.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:32:26.464618Z\", \"memory_usage\": 26277314, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2026-02-01T07:59:04.833673Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"0304dd040c2d\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.05%\", \"created\": \"2026-02-01T07:59:00.238047Z\", \"daemon_id\": \"mds.np0005604211.ggsxcc\", \"daemon_name\": \"mds.mds.np0005604211.ggsxcc\", \"daemon_type\": \"mds\", \"events\": [\"2026-02-01T07:59:00.355217Z daemon:mds.mds.np0005604211.ggsxcc [INFO] \\\"Deployed mds.mds.np0005604211.ggsxcc on host 'np0005604211.localdomain'\\\"\"], \"hostname\": \"np0005604211.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:32:26.445023Z\", \"memory_usage\": 25899827, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2026-02-01T07:59:00.142337Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"7129047be6fa\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"6.25%\", \"created\": \"2026-02-01T09:39:19.261919Z\", \"daemon_id\": \"mds.np0005604212.tkdkxt\", \"daemon_name\": \"mds.mds.np0005604212.tkdkxt\", \"daemon_type\": \"mds\", \"events\": [\"2026-02-01T09:39:19.361038Z daemon:mds.mds.np0005604212.tkdkxt [INFO] \\\"Deployed mds.mds.np0005604212.tkdkxt on host 'np0005604212.localdomain'\\\"\"], \"hostname\": \"np0005604212.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:39:21.516622Z\", \"memory_usage\": 14365491, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2026-02-01T09:39:19.146160Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"68fe25869aad\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"2.04%\", \"created\": \"2026-02-01T09:39:16.742138Z\", \"daemon_id\": \"mds.np0005604213.jdbvyh\", \"daemon_name\": \"mds.mds.np0005604213.jdbvyh\", \"daemon_type\": \"mds\", \"events\": [\"2026-02-01T09:39:16.806743Z daemon:mds.mds.np0005604213.jdbvyh [INFO] \\\"Deployed mds.mds.np0005604213.jdbvyh on host 'np0005604213.localdomain'\\\"\"], \"hostname\": \"np0005604213.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:39:21.437219Z\", \"memory_usage\": 13495173, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2026-02-01T09:39:16.643002Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"80bcdc70795a\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.37%\", \"created\": \"2026-02-01T09:39:14.454281Z\", \"daemon_id\": \"mds.np0005604215.rwvxvg\", \"daemon_name\": \"mds.mds.np0005604215.rwvxvg\", \"daemon_type\": \"mds\", \"events\": [\"2026-02-01T09:39:14.539522Z daemon:mds.mds.np0005604215.rwvxvg [INFO] \\\"Deployed mds.mds.np0005604215.rwvxvg on host 'np0005604215.localdomain'\\\"\"], \"hostname\": \"np0005604215.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:39:21.330225Z\", \"memory_usage\": 15896412, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2026-02-01T09:39:14.343310Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"0a8b38ea1be3\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.16%\", \"created\": \"2026-02-01T07:59:02.658297Z\", \"daemon_id\": \"mds.np0005604209.wikopf\", \"daemon_name\": \"mds.mds.np0005604209.wikopf\", \"daemon_type\": \"mds\", \"events\": [\"2026-02-01T07:59:02.742276Z daemon:mds.mds.np0005604209.wikopf [INFO] \\\"Deployed mds.mds.np0005604209.wikopf on host 'np0005604209.localdomain'\\\"\"], \"hostname\": \"np0005604209.localdomain\", \"is_active\": true, \"last_refresh\": \"2026-02-01T09:32:26.305418Z\", \"memory_usage\": 29590814, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2026-02-01T07:59:02.474035Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"04c207075b71\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.04%\", \"created\": \"2026-02-01T07:59:04.933047Z\", \"daemon_id\": \"mds.np0005604210.yulljq\", \"daemon_name\": \"mds.mds.np0005604210.yulljq\", \"daemon_type\": \"mds\", \"events\": [\"2026-02-01T07:59:05.022367Z daemon:mds.mds.np0005604210.yulljq [INFO] \\\"Deployed mds.mds.np0005604210.yulljq on host 'np0005604210.localdomain'\\\"\"], \"hostname\": \"np0005604210.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:32:26.464618Z\", \"memory_usage\": 26277314, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2026-02-01T07:59:04.833673Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"0304dd040c2d\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.05%\", \"created\": \"2026-02-01T07:59:00.238047Z\", \"daemon_id\": \"mds.np0005604211.ggsxcc\", \"daemon_name\": \"mds.mds.np0005604211.ggsxcc\", \"daemon_type\": \"mds\", \"events\": [\"2026-02-01T07:59:00.355217Z daemon:mds.mds.np0005604211.ggsxcc [INFO] \\\"Deployed mds.mds.np0005604211.ggsxcc on host 'np0005604211.localdomain'\\\"\"], \"hostname\": \"np0005604211.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:32:26.445023Z\", \"memory_usage\": 25899827, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2026-02-01T07:59:00.142337Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"7129047be6fa\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"6.25%\", \"created\": \"2026-02-01T09:39:19.261919Z\", \"daemon_id\": \"mds.np0005604212.tkdkxt\", \"daemon_name\": \"mds.mds.np0005604212.tkdkxt\", \"daemon_type\": \"mds\", \"events\": [\"2026-02-01T09:39:19.361038Z daemon:mds.mds.np0005604212.tkdkxt [INFO] \\\"Deployed mds.mds.np0005604212.tkdkxt on host 'np0005604212.localdomain'\\\"\"], \"hostname\": \"np0005604212.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:39:21.516622Z\", \"memory_usage\": 14365491, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2026-02-01T09:39:19.146160Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"68fe25869aad\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"2.04%\", \"created\": \"2026-02-01T09:39:16.742138Z\", \"daemon_id\": \"mds.np0005604213.jdbvyh\", \"daemon_name\": \"mds.mds.np0005604213.jdbvyh\", \"daemon_type\": \"mds\", \"events\": [\"2026-02-01T09:39:16.806743Z daemon:mds.mds.np0005604213.jdbvyh [INFO] \\\"Deployed mds.mds.np0005604213.jdbvyh on host 'np0005604213.localdomain'\\\"\"], \"hostname\": \"np0005604213.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:39:21.437219Z\", \"memory_usage\": 13495173, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2026-02-01T09:39:16.643002Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"80bcdc70795a\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.37%\", \"created\": \"2026-02-01T09:39:14.454281Z\", \"daemon_id\": \"mds.np0005604215.rwvxvg\", \"daemon_name\": \"mds.mds.np0005604215.rwvxvg\", \"daemon_type\": \"mds\", \"events\": [\"2026-02-01T09:39:14.539522Z daemon:mds.mds.np0005604215.rwvxvg [INFO] \\\"Deployed mds.mds.np0005604215.rwvxvg on host 'np0005604215.localdomain'\\\"\"], \"hostname\": \"np0005604215.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:39:21.330225Z\", \"memory_usage\": 15896412, \"ports\": [], \"service_name\": \"mds.mds\", \"started\": \"2026-02-01T09:39:14.343310Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : Sleep before moving to the next phase] ******************** Pausing for 30 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 30, "echo": true, "rc": 0, "start": "2026-02-01 09:39:50.988145", "stderr": "", "stdout": "Paused for 30.03 seconds", "stop": "2026-02-01 09:40:21.020051", "user_input": ""} TASK [ceph_migrate : Get ceph_cli] ********************************************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Fail if RGW VIPs are not defined] ************************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "ceph_daemons_layout.rgw | default(true) | bool"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005604209.localdomain] => {"false_condition": "ceph_daemons_layout.rgw | default(true) | bool"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** skipping: [np0005604209.localdomain] => (item=['np0005604212.localdomain', 'rgw']) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "item": ["np0005604212.localdomain", "rgw"], "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => (item=['np0005604213.localdomain', 'rgw']) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "item": ["np0005604213.localdomain", "rgw"], "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => (item=['np0005604215.localdomain', 'rgw']) => {"ansible_loop_var": "item", "changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "item": ["np0005604215.localdomain", "rgw"], "skip_reason": "Conditional result was False"} skipping: [np0005604209.localdomain] => {"changed": false, "msg": "All items skipped"} TASK [ceph_migrate : RGW - Load Spec from the orchestrator] ******************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Print the loaded data] ************************************ skipping: [np0005604209.localdomain] => {"false_condition": "ceph_daemons_layout.rgw | default(true) | bool"} TASK [ceph_migrate : Apply ceph rgw keystone config] *************************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Update the RGW spec definition] *************************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005604209.localdomain] => {"false_condition": "ceph_daemons_layout.rgw | default(true) | bool"} TASK [ceph_migrate : Create the Ingress Daemon spec definition for RGW] ******** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005604209.localdomain] => {"false_condition": "ceph_daemons_layout.rgw | default(true) | bool"} TASK [ceph_migrate : Wait for cephadm to redeploy] ***************************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : RGW - wait daemons] *************************************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Setup a Ceph client to the first node] ******************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_client.yaml for np0005604209.localdomain TASK [ceph_migrate : TMP_CLIENT - Patch os-net-config config and setup a tmp client IP] *** changed: [np0005604209.localdomain] => {"backup": "/etc/os-net-config/tripleo_config.yaml.468574.2026-02-01@09:40:22~", "changed": true, "msg": "line added and ownership, perms or SE linux context changed"} TASK [ceph_migrate : TMP_CLIENT - Refresh os-net-config] *********************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["os-net-config", "-c", "/etc/os-net-config/tripleo_config.yaml"], "delta": "0:00:07.379170", "end": "2026-02-01 09:40:30.357337", "msg": "", "rc": 0, "start": "2026-02-01 09:40:22.978167", "stderr": "", "stderr_lines": [], "stdout": "2026-02-01 09:40:23.919 ERROR os_net_config.execute stderr : WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated.\nWARN : [ifdown] 'network-scripts' will be removed from distribution in near future.\nWARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well.\n\n2026-02-01 09:40:30.292 ERROR os_net_config.execute stderr : WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated.\nWARN : [ifup] 'network-scripts' will be removed from distribution in near future.\nWARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well.", "stdout_lines": ["2026-02-01 09:40:23.919 ERROR os_net_config.execute stderr : WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated.", "WARN : [ifdown] 'network-scripts' will be removed from distribution in near future.", "WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well.", "", "2026-02-01 09:40:30.292 ERROR os_net_config.execute stderr : WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated.", "WARN : [ifup] 'network-scripts' will be removed from distribution in near future.", "WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well."]} TASK [ceph_migrate : Backup data for client purposes] ************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/backup.yaml for np0005604209.localdomain TASK [ceph_migrate : Ensure backup directory exists] *************************** changed: [np0005604209.localdomain] => {"changed": true, "gid": 1003, "group": "tripleo-admin", "mode": "0755", "owner": "tripleo-admin", "path": "/home/tripleo-admin/ceph_client", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 6, "state": "directory", "uid": 1003} TASK [ceph_migrate : Check file in the src directory] ************************** ok: [np0005604209.localdomain] => {"changed": false, "examined": 4, "files": [{"atime": 1769932709.2023358, "ctime": 1769932708.117304, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 125830177, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1769931656.9858353, "nlink": 1, "path": "/etc/ceph/ceph.conf", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 271, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1769932709.2123363, "ctime": 1769932708.117304, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 125830176, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0600", "mtime": 1769931517.8977625, "nlink": 1, "path": "/etc/ceph/ceph.client.admin.keyring", "pw_name": "root", "rgrp": false, "roth": false, "rusr": true, "size": 151, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1769932750.3485157, "ctime": 1769932748.2774568, "dev": 64516, "gid": 167, "gr_name": "", "inode": 100722313, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1769932747.9424472, "nlink": 1, "path": "/etc/ceph/ceph.client.openstack.keyring", "pw_name": "", "rgrp": true, "roth": true, "rusr": true, "size": 231, "uid": 167, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1769932751.4375467, "ctime": 1769932749.2774851, "dev": 64516, "gid": 167, "gr_name": "", "inode": 126011210, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1769932748.9624763, "nlink": 1, "path": "/etc/ceph/ceph.client.manila.keyring", "pw_name": "", "rgrp": true, "roth": true, "rusr": true, "size": 153, "uid": 167, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}], "matched": 4, "msg": "All paths examined", "skipped_paths": {}} TASK [ceph_migrate : Backup ceph client data] ********************************** changed: [np0005604209.localdomain] => (item={'path': '/etc/ceph/ceph.conf', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 271, 'inode': 125830177, 'dev': 64516, 'nlink': 1, 'atime': 1769932709.2023358, 'mtime': 1769931656.9858353, 'ctime': 1769932708.117304, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "6c8f40813464a566eca7252d9e693fc8375e148c", "dest": "/home/tripleo-admin/ceph_client/ceph.conf", "gid": 0, "group": "root", "item": {"atime": 1769932709.2023358, "ctime": 1769932708.117304, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 125830177, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1769931656.9858353, "nlink": 1, "path": "/etc/ceph/ceph.conf", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 271, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "6584fbf90db99b1f19be4b6b4eb81912", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 271, "src": "/etc/ceph/ceph.conf", "state": "file", "uid": 0} changed: [np0005604209.localdomain] => (item={'path': '/etc/ceph/ceph.client.admin.keyring', 'mode': '0600', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 151, 'inode': 125830176, 'dev': 64516, 'nlink': 1, 'atime': 1769932709.2123363, 'mtime': 1769931517.8977625, 'ctime': 1769932708.117304, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': False, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "c1c7d8ee1d85e5ca70078f80d56073323aa5a1b6", "dest": "/home/tripleo-admin/ceph_client/ceph.client.admin.keyring", "gid": 0, "group": "root", "item": {"atime": 1769932709.2123363, "ctime": 1769932708.117304, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 125830176, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0600", "mtime": 1769931517.8977625, "nlink": 1, "path": "/etc/ceph/ceph.client.admin.keyring", "pw_name": "root", "rgrp": false, "roth": false, "rusr": true, "size": 151, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "724c058e8f9bb9e9ef4f4d3fb1c871d4", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 151, "src": "/etc/ceph/ceph.client.admin.keyring", "state": "file", "uid": 0} changed: [np0005604209.localdomain] => (item={'path': '/etc/ceph/ceph.client.openstack.keyring', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 167, 'gid': 167, 'size': 231, 'inode': 100722313, 'dev': 64516, 'nlink': 1, 'atime': 1769932750.3485157, 'mtime': 1769932747.9424472, 'ctime': 1769932748.2774568, 'gr_name': '', 'pw_name': '', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "814f759dcc97f4b50c85badaa6f3819c2533c70a", "dest": "/home/tripleo-admin/ceph_client/ceph.client.openstack.keyring", "gid": 0, "group": "root", "item": {"atime": 1769932750.3485157, "ctime": 1769932748.2774568, "dev": 64516, "gid": 167, "gr_name": "", "inode": 100722313, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1769932747.9424472, "nlink": 1, "path": "/etc/ceph/ceph.client.openstack.keyring", "pw_name": "", "rgrp": true, "roth": true, "rusr": true, "size": 231, "uid": 167, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "cb1f6f6e9f8e525dd9530e4eddcba89a", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 231, "src": "/etc/ceph/ceph.client.openstack.keyring", "state": "file", "uid": 0} changed: [np0005604209.localdomain] => (item={'path': '/etc/ceph/ceph.client.manila.keyring', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 167, 'gid': 167, 'size': 153, 'inode': 126011210, 'dev': 64516, 'nlink': 1, 'atime': 1769932751.4375467, 'mtime': 1769932748.9624763, 'ctime': 1769932749.2774851, 'gr_name': '', 'pw_name': '', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "9a0c41ba35379304dc7e57883346ea3531963e9b", "dest": "/home/tripleo-admin/ceph_client/ceph.client.manila.keyring", "gid": 0, "group": "root", "item": {"atime": 1769932751.4375467, "ctime": 1769932749.2774851, "dev": 64516, "gid": 167, "gr_name": "", "inode": 126011210, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1769932748.9624763, "nlink": 1, "path": "/etc/ceph/ceph.client.manila.keyring", "pw_name": "", "rgrp": true, "roth": true, "rusr": true, "size": 153, "uid": 167, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "4705ffddb21d6f6defbb2c8258ccfef4", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 153, "src": "/etc/ceph/ceph.client.manila.keyring", "state": "file", "uid": 0} TASK [ceph_migrate : Render global ceph.conf] ********************************** changed: [np0005604209.localdomain] => {"changed": true, "checksum": "325a9a30a411d247b85e492170c49524d84ea4a7", "dest": "/home/tripleo-admin/ceph_client/ceph.conf", "gid": 0, "group": "root", "md5sum": "41c2cfec048bfb04a66a702d3f6f9775", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 142, "src": "/home/tripleo-admin/.ansible/tmp/ansible-tmp-1769938834.7378592-60567-49828221577609/source", "state": "file", "uid": 0} TASK [ceph_migrate : MGR - Migrate RBD node] *********************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/mgr.yaml for np0005604209.localdomain TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /etc/ceph:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : MGR - Setup Mon/Mgr label to the target node] ************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/labels.yaml for np0005604209.localdomain TASK [ceph_migrate : Set/Unset labels - add] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** changed: [np0005604209.localdomain] => (item=['np0005604212.localdomain', 'mgr']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604212.localdomain", "mgr"], "delta": "0:00:00.820991", "end": "2026-02-01 09:40:37.635006", "item": ["np0005604212.localdomain", "mgr"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:36.814015", "stderr": "", "stderr_lines": [], "stdout": "Added label mgr to host np0005604212.localdomain", "stdout_lines": ["Added label mgr to host np0005604212.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604213.localdomain', 'mgr']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604213.localdomain", "mgr"], "delta": "0:00:00.745676", "end": "2026-02-01 09:40:38.972442", "item": ["np0005604213.localdomain", "mgr"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:38.226766", "stderr": "", "stderr_lines": [], "stdout": "Added label mgr to host np0005604213.localdomain", "stdout_lines": ["Added label mgr to host np0005604213.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604215.localdomain', 'mgr']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604215.localdomain", "mgr"], "delta": "0:00:00.692611", "end": "2026-02-01 09:40:40.285806", "item": ["np0005604215.localdomain", "mgr"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:39.593195", "stderr": "", "stderr_lines": [], "stdout": "Added label mgr to host np0005604215.localdomain", "stdout_lines": ["Added label mgr to host np0005604215.localdomain"]} TASK [ceph_migrate : MGR - Load Spec from the orchestrator] ******************** ok: [np0005604209.localdomain] => {"ansible_facts": {"mgr_spec": {"service_name": "mgr", "service_type": "mgr", "spec": {}}}, "changed": false} TASK [ceph_migrate : Update the MGR Daemon spec definition] ******************** ok: [np0005604209.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/etc/ceph:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mgr:/home/tripleo-admin/mgr:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mgr"], "delta": "0:00:00.785349", "end": "2026-02-01 09:40:41.816558", "rc": 0, "start": "2026-02-01 09:40:41.031209", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mgr update...", "stdout_lines": ["Scheduled mgr update..."]} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MGR - wait daemons] *************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005604209.localdomain TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mgr] ********************************************* changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mgr", "-f", "json"], "delta": "0:00:00.707747", "end": "2026-02-01 09:40:43.269594", "msg": "", "rc": 0, "start": "2026-02-01 09:40:42.561847", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"41a0c06eefe5\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.34%\", \"created\": \"2026-02-01T07:38:03.586924Z\", \"daemon_id\": \"np0005604209.isqrps\", \"daemon_name\": \"mgr.np0005604209.isqrps\", \"daemon_type\": \"mgr\", \"events\": [\"2026-02-01T07:41:00.167873Z daemon:mgr.np0005604209.isqrps [INFO] \\\"Reconfigured mgr.np0005604209.isqrps on host 'np0005604209.localdomain'\\\"\"], \"hostname\": \"np0005604209.localdomain\", \"is_active\": true, \"last_refresh\": \"2026-02-01T09:40:15.166043Z\", \"memory_usage\": 544840089, \"ports\": [9283, 8765], \"service_name\": \"mgr\", \"started\": \"2026-02-01T07:38:03.443422Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"177cf661244f\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.19%\", \"created\": \"2026-02-01T07:40:17.342011Z\", \"daemon_id\": \"np0005604210.rirrtk\", \"daemon_name\": \"mgr.np0005604210.rirrtk\", \"daemon_type\": \"mgr\", \"events\": [\"2026-02-01T07:40:17.412501Z daemon:mgr.np0005604210.rirrtk [INFO] \\\"Deployed mgr.np0005604210.rirrtk on host 'np0005604210.localdomain'\\\"\"], \"hostname\": \"np0005604210.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:40:15.041225Z\", \"memory_usage\": 479828377, \"ports\": [8765], \"service_name\": \"mgr\", \"started\": \"2026-02-01T07:40:17.213970Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"6a1ccfd5d68c\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.20%\", \"created\": \"2026-02-01T07:40:11.231473Z\", \"daemon_id\": \"np0005604211.cuflqz\", \"daemon_name\": \"mgr.np0005604211.cuflqz\", \"daemon_type\": \"mgr\", \"events\": [\"2026-02-01T07:40:15.411548Z daemon:mgr.np0005604211.cuflqz [INFO] \\\"Deployed mgr.np0005604211.cuflqz on host 'np0005604211.localdomain'\\\"\", \"2026-02-01T07:41:04.284409Z daemon:mgr.np0005604211.cuflqz [INFO] \\\"Reconfigured mgr.np0005604211.cuflqz on host 'np0005604211.localdomain'\\\"\"], \"hostname\": \"np0005604211.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:40:15.216471Z\", \"memory_usage\": 476892364, \"ports\": [8765], \"service_name\": \"mgr\", \"started\": \"2026-02-01T07:40:11.093028Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"41a0c06eefe5\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.34%\", \"created\": \"2026-02-01T07:38:03.586924Z\", \"daemon_id\": \"np0005604209.isqrps\", \"daemon_name\": \"mgr.np0005604209.isqrps\", \"daemon_type\": \"mgr\", \"events\": [\"2026-02-01T07:41:00.167873Z daemon:mgr.np0005604209.isqrps [INFO] \\\"Reconfigured mgr.np0005604209.isqrps on host 'np0005604209.localdomain'\\\"\"], \"hostname\": \"np0005604209.localdomain\", \"is_active\": true, \"last_refresh\": \"2026-02-01T09:40:15.166043Z\", \"memory_usage\": 544840089, \"ports\": [9283, 8765], \"service_name\": \"mgr\", \"started\": \"2026-02-01T07:38:03.443422Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"177cf661244f\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.19%\", \"created\": \"2026-02-01T07:40:17.342011Z\", \"daemon_id\": \"np0005604210.rirrtk\", \"daemon_name\": \"mgr.np0005604210.rirrtk\", \"daemon_type\": \"mgr\", \"events\": [\"2026-02-01T07:40:17.412501Z daemon:mgr.np0005604210.rirrtk [INFO] \\\"Deployed mgr.np0005604210.rirrtk on host 'np0005604210.localdomain'\\\"\"], \"hostname\": \"np0005604210.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:40:15.041225Z\", \"memory_usage\": 479828377, \"ports\": [8765], \"service_name\": \"mgr\", \"started\": \"2026-02-01T07:40:17.213970Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}, {\"container_id\": \"6a1ccfd5d68c\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"0.20%\", \"created\": \"2026-02-01T07:40:11.231473Z\", \"daemon_id\": \"np0005604211.cuflqz\", \"daemon_name\": \"mgr.np0005604211.cuflqz\", \"daemon_type\": \"mgr\", \"events\": [\"2026-02-01T07:40:15.411548Z daemon:mgr.np0005604211.cuflqz [INFO] \\\"Deployed mgr.np0005604211.cuflqz on host 'np0005604211.localdomain'\\\"\", \"2026-02-01T07:41:04.284409Z daemon:mgr.np0005604211.cuflqz [INFO] \\\"Reconfigured mgr.np0005604211.cuflqz on host 'np0005604211.localdomain'\\\"\"], \"hostname\": \"np0005604211.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:40:15.216471Z\", \"memory_usage\": 476892364, \"ports\": [8765], \"service_name\": \"mgr\", \"started\": \"2026-02-01T07:40:11.093028Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : MON - Load Spec from the orchestrator] ******************** ok: [np0005604209.localdomain] => {"ansible_facts": {"mon_spec": {"service_name": "mon", "service_type": "mon", "spec": {}}}, "changed": false} TASK [ceph_migrate : Set/Unset labels - add] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - add] *********************************** changed: [np0005604209.localdomain] => (item=['np0005604209.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604209.localdomain", "mon"], "delta": "0:00:00.802652", "end": "2026-02-01 09:40:44.944010", "item": ["np0005604209.localdomain", "mon"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:44.141358", "stderr": "", "stderr_lines": [], "stdout": "Added label mon to host np0005604209.localdomain", "stdout_lines": ["Added label mon to host np0005604209.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604209.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604209.localdomain", "_admin"], "delta": "0:00:00.711517", "end": "2026-02-01 09:40:46.209715", "item": ["np0005604209.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:45.498198", "stderr": "", "stderr_lines": [], "stdout": "Added label _admin to host np0005604209.localdomain", "stdout_lines": ["Added label _admin to host np0005604209.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604210.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604210.localdomain", "mon"], "delta": "0:00:00.754023", "end": "2026-02-01 09:40:47.531305", "item": ["np0005604210.localdomain", "mon"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:46.777282", "stderr": "", "stderr_lines": [], "stdout": "Added label mon to host np0005604210.localdomain", "stdout_lines": ["Added label mon to host np0005604210.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604210.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604210.localdomain", "_admin"], "delta": "0:00:00.739608", "end": "2026-02-01 09:40:48.809600", "item": ["np0005604210.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:48.069992", "stderr": "", "stderr_lines": [], "stdout": "Added label _admin to host np0005604210.localdomain", "stdout_lines": ["Added label _admin to host np0005604210.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604211.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604211.localdomain", "mon"], "delta": "0:00:00.777394", "end": "2026-02-01 09:40:50.144867", "item": ["np0005604211.localdomain", "mon"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:49.367473", "stderr": "", "stderr_lines": [], "stdout": "Added label mon to host np0005604211.localdomain", "stdout_lines": ["Added label mon to host np0005604211.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604211.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604211.localdomain", "_admin"], "delta": "0:00:00.724835", "end": "2026-02-01 09:40:51.457318", "item": ["np0005604211.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:50.732483", "stderr": "", "stderr_lines": [], "stdout": "Added label _admin to host np0005604211.localdomain", "stdout_lines": ["Added label _admin to host np0005604211.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604212.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604212.localdomain", "mon"], "delta": "0:00:01.027930", "end": "2026-02-01 09:40:53.055664", "item": ["np0005604212.localdomain", "mon"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:52.027734", "stderr": "", "stderr_lines": [], "stdout": "Added label mon to host np0005604212.localdomain", "stdout_lines": ["Added label mon to host np0005604212.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604212.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604212.localdomain", "_admin"], "delta": "0:00:00.774787", "end": "2026-02-01 09:40:54.382094", "item": ["np0005604212.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:53.607307", "stderr": "", "stderr_lines": [], "stdout": "Added label _admin to host np0005604212.localdomain", "stdout_lines": ["Added label _admin to host np0005604212.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604213.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604213.localdomain", "mon"], "delta": "0:00:00.756749", "end": "2026-02-01 09:40:55.727092", "item": ["np0005604213.localdomain", "mon"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:54.970343", "stderr": "", "stderr_lines": [], "stdout": "Added label mon to host np0005604213.localdomain", "stdout_lines": ["Added label mon to host np0005604213.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604213.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604213.localdomain", "_admin"], "delta": "0:00:00.683506", "end": "2026-02-01 09:40:57.014258", "item": ["np0005604213.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:56.330752", "stderr": "", "stderr_lines": [], "stdout": "Added label _admin to host np0005604213.localdomain", "stdout_lines": ["Added label _admin to host np0005604213.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604215.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604215.localdomain", "mon"], "delta": "0:00:00.824980", "end": "2026-02-01 09:40:58.382381", "item": ["np0005604215.localdomain", "mon"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:57.557401", "stderr": "", "stderr_lines": [], "stdout": "Added label mon to host np0005604215.localdomain", "stdout_lines": ["Added label mon to host np0005604215.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604215.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "add", "np0005604215.localdomain", "_admin"], "delta": "0:00:00.710171", "end": "2026-02-01 09:40:59.661929", "item": ["np0005604215.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2026-02-01 09:40:58.951758", "stderr": "", "stderr_lines": [], "stdout": "Added label _admin to host np0005604215.localdomain", "stdout_lines": ["Added label _admin to host np0005604215.localdomain"]} TASK [ceph_migrate : Normalize the mon spec to use labels] ********************* ok: [np0005604209.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/etc/ceph:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mon:/home/tripleo-admin/mon:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mon"], "delta": "0:00:00.695154", "end": "2026-02-01 09:41:01.004734", "rc": 0, "start": "2026-02-01 09:41:00.309580", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mon update...", "stdout_lines": ["Scheduled mon update..."]} TASK [ceph_migrate : RBD - wait new daemons to be available] ******************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005604209.localdomain => (item=np0005604212.localdomain) included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005604209.localdomain => (item=np0005604213.localdomain) included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005604209.localdomain => (item=np0005604215.localdomain) TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mon] ********************************************* FAILED - RETRYING: [np0005604209.localdomain]: wait for mon (200 retries left). FAILED - RETRYING: [np0005604209.localdomain]: wait for mon (199 retries left). FAILED - RETRYING: [np0005604209.localdomain]: wait for mon (198 retries left). changed: [np0005604209.localdomain] => {"attempts": 4, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005604212", "-f", "json"], "delta": "0:00:00.617417", "end": "2026-02-01 09:41:22.797697", "msg": "", "rc": 0, "start": "2026-02-01 09:41:22.180280", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"8e57e0bb9712\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.52%\", \"created\": \"2026-02-01T09:41:12.386303Z\", \"daemon_id\": \"np0005604212\", \"daemon_name\": \"mon.np0005604212\", \"daemon_type\": \"mon\", \"events\": [\"2026-02-01T09:41:16.099857Z daemon:mon.np0005604212 [INFO] \\\"Deployed mon.np0005604212 on host 'np0005604212.localdomain'\\\"\"], \"hostname\": \"np0005604212.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:41:18.466840Z\", \"memory_request\": 2147483648, \"memory_usage\": 39856373, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:41:12.293285Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"8e57e0bb9712\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.52%\", \"created\": \"2026-02-01T09:41:12.386303Z\", \"daemon_id\": \"np0005604212\", \"daemon_name\": \"mon.np0005604212\", \"daemon_type\": \"mon\", \"events\": [\"2026-02-01T09:41:16.099857Z daemon:mon.np0005604212 [INFO] \\\"Deployed mon.np0005604212 on host 'np0005604212.localdomain'\\\"\"], \"hostname\": \"np0005604212.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:41:18.466840Z\", \"memory_request\": 2147483648, \"memory_usage\": 39856373, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:41:12.293285Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mon] ********************************************* changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005604213", "-f", "json"], "delta": "0:00:00.650727", "end": "2026-02-01 09:41:24.109776", "msg": "", "rc": 0, "start": "2026-02-01 09:41:23.459049", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"1b1be3e5221c\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.10%\", \"created\": \"2026-02-01T09:41:06.716411Z\", \"daemon_id\": \"np0005604213\", \"daemon_name\": \"mon.np0005604213\", \"daemon_type\": \"mon\", \"events\": [\"2026-02-01T09:41:09.388111Z daemon:mon.np0005604213 [INFO] \\\"Deployed mon.np0005604213 on host 'np0005604213.localdomain'\\\"\"], \"hostname\": \"np0005604213.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:41:18.569877Z\", \"memory_request\": 2147483648, \"memory_usage\": 47395635, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:41:06.621855Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"1b1be3e5221c\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.10%\", \"created\": \"2026-02-01T09:41:06.716411Z\", \"daemon_id\": \"np0005604213\", \"daemon_name\": \"mon.np0005604213\", \"daemon_type\": \"mon\", \"events\": [\"2026-02-01T09:41:09.388111Z daemon:mon.np0005604213 [INFO] \\\"Deployed mon.np0005604213 on host 'np0005604213.localdomain'\\\"\"], \"hostname\": \"np0005604213.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:41:18.569877Z\", \"memory_request\": 2147483648, \"memory_usage\": 47395635, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:41:06.621855Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mon] ********************************************* changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/etc/ceph:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005604215", "-f", "json"], "delta": "0:00:00.741490", "end": "2026-02-01 09:41:25.581096", "msg": "", "rc": 0, "start": "2026-02-01 09:41:24.839606", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"e5584900e404\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"2.82%\", \"created\": \"2026-02-01T09:41:04.032928Z\", \"daemon_id\": \"np0005604215\", \"daemon_name\": \"mon.np0005604215\", \"daemon_type\": \"mon\", \"events\": [\"2026-02-01T09:41:04.110047Z daemon:mon.np0005604215 [INFO] \\\"Deployed mon.np0005604215 on host 'np0005604215.localdomain'\\\"\"], \"hostname\": \"np0005604215.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:41:18.464626Z\", \"memory_request\": 2147483648, \"memory_usage\": 48224010, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:41:03.903046Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"e5584900e404\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"2.82%\", \"created\": \"2026-02-01T09:41:04.032928Z\", \"daemon_id\": \"np0005604215\", \"daemon_name\": \"mon.np0005604215\", \"daemon_type\": \"mon\", \"events\": [\"2026-02-01T09:41:04.110047Z daemon:mon.np0005604215 [INFO] \\\"Deployed mon.np0005604215 on host 'np0005604215.localdomain'\\\"\"], \"hostname\": \"np0005604215.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:41:18.464626Z\", \"memory_request\": 2147483648, \"memory_usage\": 48224010, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:41:03.903046Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : MON - Migrate RBD node] *********************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/mon.yaml for np0005604209.localdomain => (item=['np0005604209.localdomain', 'np0005604212.localdomain']) included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/mon.yaml for np0005604209.localdomain => (item=['np0005604210.localdomain', 'np0005604213.localdomain']) included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/mon.yaml for np0005604209.localdomain => (item=['np0005604211.localdomain', 'np0005604215.localdomain']) TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Migrate mon] ********************************************** ok: [np0005604209.localdomain] => { "msg": "Migrate mon: np0005604209.localdomain to node: np0005604212.localdomain" } TASK [ceph_migrate : MON - Get current mon IP address from node_map override] *** ok: [np0005604209.localdomain] => {"ansible_facts": {"mon_ipaddr": "172.18.0.103"}, "changed": false} TASK [ceph_migrate : MON - Check mons quorum] ********************************** changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "-s", "-f", "json"], "delta": "0:00:00.816290", "end": "2026-02-01 09:41:27.378517", "msg": "", "rc": 0, "start": "2026-02-01 09:41:26.562227", "stderr": "", "stderr_lines": [], "stdout": "\n{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":28,\"quorum\":[0,1,2,3,4,5],\"quorum_names\":[\"np0005604209\",\"np0005604211\",\"np0005604210\",\"np0005604215\",\"np0005604213\",\"np0005604212\"],\"quorum_age\":5,\"monmap\":{\"epoch\":6,\"min_mon_release_name\":\"reef\",\"num_mons\":6},\"osdmap\":{\"epoch\":81,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109571242,\"bytes_used\":592756736,\"bytes_avail\":44479234048,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604212.tkdkxt\",\"status\":\"up:active\",\"gid\":26329}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":5,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":71,\"modified\":\"2026-02-01T09:41:21.990626+0000\",\"services\":{\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005604212.oynhpm\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604213.caiaeh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215.uhhqtv\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005604213\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"osd\":{\"daemons\":{\"summary\":\"\",\"0\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"1\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"2\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"3\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"4\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"5\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":28,\"quorum\":[0,1,2,3,4,5],\"quorum_names\":[\"np0005604209\",\"np0005604211\",\"np0005604210\",\"np0005604215\",\"np0005604213\",\"np0005604212\"],\"quorum_age\":5,\"monmap\":{\"epoch\":6,\"min_mon_release_name\":\"reef\",\"num_mons\":6},\"osdmap\":{\"epoch\":81,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109571242,\"bytes_used\":592756736,\"bytes_avail\":44479234048,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604212.tkdkxt\",\"status\":\"up:active\",\"gid\":26329}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":5,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":71,\"modified\":\"2026-02-01T09:41:21.990626+0000\",\"services\":{\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005604212.oynhpm\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604213.caiaeh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215.uhhqtv\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005604213\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"osd\":{\"daemons\":{\"summary\":\"\",\"0\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"1\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"2\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"3\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"4\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"5\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}"]} TASK [ceph_migrate : Backup data for client purposes] ************************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "cur_mon != client_node", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Get the current active mgr] ************************* changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "stat", "-f", "json"], "delta": "0:00:00.763728", "end": "2026-02-01 09:41:28.920890", "msg": "", "rc": 0, "start": "2026-02-01 09:41:28.157162", "stderr": "", "stderr_lines": [], "stdout": "\n{\"epoch\":14,\"available\":true,\"active_name\":\"np0005604209.isqrps\",\"num_standby\":5}", "stdout_lines": ["", "{\"epoch\":14,\"available\":true,\"active_name\":\"np0005604209.isqrps\",\"num_standby\":5}"]} TASK [ceph_migrate : MON - Load mgr data] ************************************** ok: [np0005604209.localdomain] => {"ansible_facts": {"mgr": {"active_name": "np0005604209.isqrps", "available": true, "epoch": 14, "num_standby": 5}}, "changed": false} TASK [ceph_migrate : Print active mgr] ***************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Fail mgr if active in the current node] ******************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/fail_mgr.yaml for np0005604209.localdomain TASK [ceph_migrate : Refresh ceph_cli] ***************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Force fail ceph mgr] ************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "fail"], "delta": "0:00:00.820081", "end": "2026-02-01 09:41:30.662727", "msg": "", "rc": 0, "start": "2026-02-01 09:41:29.842646", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Wait for cephadm to reconcile] **************************** Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:41:30.804819", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2026-02-01 09:41:40.818927", "user_input": ""} TASK [ceph_migrate : Get the ceph orchestrator status with] ******************** ASYNC OK on np0005604209.localdomain: jid=j784647305464.475818 changed: [np0005604209.localdomain] => {"ansible_job_id": "j784647305464.475818", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "status", "--format", "json"], "delta": "0:00:00.763109", "end": "2026-02-01 09:41:42.449453", "failed_when_result": false, "finished": 1, "msg": "", "rc": 0, "results_file": "/root/.ansible_async/j784647305464.475818", "start": "2026-02-01 09:41:41.686344", "started": 1, "stderr": "", "stderr_lines": [], "stdout": "\n{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}", "stdout_lines": ["", "{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}"]} TASK [ceph_migrate : Restart the active mgr] *********************************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Fail if ceph orchestrator is still not responding] ******** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Drain and rm --force the cur_mon host] ************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/drain.yaml for np0005604209.localdomain TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : MON - wait daemons] *************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005604209", "-f", "json"], "delta": "0:00:00.659573", "end": "2026-02-01 09:41:45.215623", "msg": "", "rc": 0, "start": "2026-02-01 09:41:44.556050", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"fd166e1cf318\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.74%\", \"created\": \"2026-02-01T07:37:54.983660Z\", \"daemon_id\": \"np0005604209\", \"daemon_name\": \"mon.np0005604209\", \"daemon_type\": \"mon\", \"hostname\": \"np0005604209.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:41:32.871763Z\", \"memory_request\": 2147483648, \"memory_usage\": 149212364, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T07:38:01.823089Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"fd166e1cf318\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.74%\", \"created\": \"2026-02-01T07:37:54.983660Z\", \"daemon_id\": \"np0005604209\", \"daemon_name\": \"mon.np0005604209\", \"daemon_type\": \"mon\", \"hostname\": \"np0005604209.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:41:32.871763Z\", \"memory_request\": 2147483648, \"memory_usage\": 149212364, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T07:38:01.823089Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : DRAIN - Delete the mon running on the current controller node] *** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "rm", "mon.np0005604209", "--force"], "delta": "0:00:02.484952", "end": "2026-02-01 09:41:48.360017", "msg": "", "rc": 0, "start": "2026-02-01 09:41:45.875065", "stderr": "", "stderr_lines": [], "stdout": "Removed mon.np0005604209 from host 'np0005604209.localdomain'", "stdout_lines": ["Removed mon.np0005604209 from host 'np0005604209.localdomain'"]} TASK [ceph_migrate : DRAIN - remove label from the src node] ******************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/labels.yaml for np0005604209.localdomain TASK [ceph_migrate : Set/Unset labels - rm] ************************************ skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - rm] ************************************ changed: [np0005604209.localdomain] => (item=['np0005604209.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005604209.localdomain", "mon"], "delta": "0:00:02.751870", "end": "2026-02-01 09:41:51.973018", "item": ["np0005604209.localdomain", "mon"], "msg": "", "rc": 0, "start": "2026-02-01 09:41:49.221148", "stderr": "", "stderr_lines": [], "stdout": "Removed label mon from host np0005604209.localdomain", "stdout_lines": ["Removed label mon from host np0005604209.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604209.localdomain', 'mgr']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005604209.localdomain", "mgr"], "delta": "0:00:01.322954", "end": "2026-02-01 09:41:53.874491", "item": ["np0005604209.localdomain", "mgr"], "msg": "", "rc": 0, "start": "2026-02-01 09:41:52.551537", "stderr": "", "stderr_lines": [], "stdout": "Removed label mgr from host np0005604209.localdomain", "stdout_lines": ["Removed label mgr from host np0005604209.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604209.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005604209.localdomain", "_admin"], "delta": "0:00:01.124222", "end": "2026-02-01 09:41:55.576827", "item": ["np0005604209.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2026-02-01 09:41:54.452605", "stderr": "", "stderr_lines": [], "stdout": "Removed label _admin from host np0005604209.localdomain", "stdout_lines": ["Removed label _admin from host np0005604209.localdomain"]} TASK [ceph_migrate : Wait for the orchestrator to remove labels] *************** Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:41:55.723961", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2026-02-01 09:42:05.735972", "user_input": ""} TASK [ceph_migrate : DRAIN - Drain the host] *********************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "drain", "np0005604209.localdomain"], "delta": "0:00:00.689592", "end": "2026-02-01 09:42:07.024813", "msg": "", "rc": 0, "start": "2026-02-01 09:42:06.335221", "stderr": "", "stderr_lines": [], "stdout": "Scheduled to remove the following daemons from host 'np0005604209.localdomain'\ntype id \n-------------------- ---------------\nmgr np0005604209.isqrps\ncrash np0005604209 ", "stdout_lines": ["Scheduled to remove the following daemons from host 'np0005604209.localdomain'", "type id ", "-------------------- ---------------", "mgr np0005604209.isqrps", "crash np0005604209 "]} TASK [ceph_migrate : DRAIN - cleanup the host] ********************************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "force_clean | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - check host in hostmap] ****************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "ls", "--host_pattern", "np0005604209.localdomain", "-f", "json"], "delta": "0:00:00.654612", "end": "2026-02-01 09:42:08.285668", "msg": "", "rc": 0, "start": "2026-02-01 09:42:07.631056", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"addr\": \"192.168.122.103\", \"hostname\": \"np0005604209.localdomain\", \"labels\": [\"_no_schedule\", \"_no_conf_keyring\"], \"status\": \"\"}]", "stdout_lines": ["", "[{\"addr\": \"192.168.122.103\", \"hostname\": \"np0005604209.localdomain\", \"labels\": [\"_no_schedule\", \"_no_conf_keyring\"], \"status\": \"\"}]"]} TASK [ceph_migrate : MON - rm the cur_mon host from the Ceph cluster] ********** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "rm", "np0005604209.localdomain", "--force"], "delta": "0:00:00.776540", "end": "2026-02-01 09:42:09.690528", "msg": "", "rc": 0, "start": "2026-02-01 09:42:08.913988", "stderr": "", "stderr_lines": [], "stdout": "Removed host 'np0005604209.localdomain'", "stdout_lines": ["Removed host 'np0005604209.localdomain'"]} TASK [ceph_migrate : MON - Get current mon IP address] ************************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "mon_ipaddr is not defined", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Migrate the mon ip address from src to target node] *** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/network.yaml for np0005604209.localdomain TASK [ceph_migrate : MON - Print current mon IP address] *********************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Patch net-config config and remove the IP address (src node)] *** changed: [np0005604209.localdomain] => {"backup": "/etc/os-net-config/tripleo_config.yaml.478064.2026-02-01@09:42:10~", "changed": true, "found": 1, "msg": "1 line(s) removed"} TASK [ceph_migrate : MON - Refresh os-net-config (src node)] ******************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "not manual_migration | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - manually rm the ip address (src node)] ************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["ip", "a", "del", "172.18.0.103/24", "dev", "vlan21"], "delta": "0:00:00.007757", "end": "2026-02-01 09:42:11.194826", "msg": "", "rc": 0, "start": "2026-02-01 09:42:11.187069", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : MON - Patch net-config config and add the IP address (target node)] *** changed: [np0005604209.localdomain -> np0005604212.localdomain(192.168.122.106)] => {"backup": "/etc/os-net-config/tripleo_config.yaml.285304.2026-02-01@09:42:12~", "changed": true, "msg": "line added"} TASK [ceph_migrate : MON - Refresh os-net-config (target_node)] **************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "not manual_migration | bool | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - statically assign the ip address to the target node] *** changed: [np0005604209.localdomain -> np0005604212.localdomain(192.168.122.106)] => {"changed": true, "cmd": ["ip", "a", "add", "172.18.0.103/24", "dev", "vlan21"], "delta": "0:00:00.004882", "end": "2026-02-01 09:42:13.444480", "msg": "", "rc": 0, "start": "2026-02-01 09:42:13.439598", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : MON - ping ip address to see if is reachable on the target node] *** changed: [np0005604209.localdomain -> np0005604212.localdomain(192.168.122.106)] => {"changed": true, "cmd": ["ping", "-W1", "-c", "3", "172.18.0.103"], "delta": "0:00:02.057677", "end": "2026-02-01 09:42:16.220625", "msg": "", "rc": 0, "start": "2026-02-01 09:42:14.162948", "stderr": "", "stderr_lines": [], "stdout": "PING 172.18.0.103 (172.18.0.103) 56(84) bytes of data.\n64 bytes from 172.18.0.103: icmp_seq=1 ttl=64 time=0.053 ms\n64 bytes from 172.18.0.103: icmp_seq=2 ttl=64 time=0.056 ms\n64 bytes from 172.18.0.103: icmp_seq=3 ttl=64 time=0.080 ms\n\n--- 172.18.0.103 ping statistics ---\n3 packets transmitted, 3 received, 0% packet loss, time 2049ms\nrtt min/avg/max/mdev = 0.053/0.063/0.080/0.012 ms", "stdout_lines": ["PING 172.18.0.103 (172.18.0.103) 56(84) bytes of data.", "64 bytes from 172.18.0.103: icmp_seq=1 ttl=64 time=0.053 ms", "64 bytes from 172.18.0.103: icmp_seq=2 ttl=64 time=0.056 ms", "64 bytes from 172.18.0.103: icmp_seq=3 ttl=64 time=0.080 ms", "", "--- 172.18.0.103 ping statistics ---", "3 packets transmitted, 3 received, 0% packet loss, time 2049ms", "rtt min/avg/max/mdev = 0.053/0.063/0.080/0.012 ms"]} TASK [ceph_migrate : MON - Fail if the IP address is not active in the target node] *** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ping_target_ip.rc != 0", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Unmanage mons] ******************************************** ok: [np0005604209.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mon:/home/tripleo-admin/mon:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mon"], "delta": "0:00:00.777739", "end": "2026-02-01 09:42:17.684410", "rc": 0, "start": "2026-02-01 09:42:16.906671", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mon update...", "stdout_lines": ["Scheduled mon update..."]} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Get tmp mon] **************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005604212", "-f", "json"], "delta": "0:00:00.694902", "end": "2026-02-01 09:42:19.035621", "msg": "", "rc": 0, "start": "2026-02-01 09:42:18.340719", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"8e57e0bb9712\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.28%\", \"created\": \"2026-02-01T09:41:12.386303Z\", \"daemon_id\": \"np0005604212\", \"daemon_name\": \"mon.np0005604212\", \"daemon_type\": \"mon\", \"events\": [\"2026-02-01T09:41:52.466150Z daemon:mon.np0005604212 [INFO] \\\"Reconfigured mon.np0005604212 on host 'np0005604212.localdomain'\\\"\"], \"hostname\": \"np0005604212.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:41:32.773503Z\", \"memory_request\": 2147483648, \"memory_usage\": 41659924, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:41:12.293285Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"8e57e0bb9712\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.28%\", \"created\": \"2026-02-01T09:41:12.386303Z\", \"daemon_id\": \"np0005604212\", \"daemon_name\": \"mon.np0005604212\", \"daemon_type\": \"mon\", \"events\": [\"2026-02-01T09:41:52.466150Z daemon:mon.np0005604212 [INFO] \\\"Reconfigured mon.np0005604212 on host 'np0005604212.localdomain'\\\"\"], \"hostname\": \"np0005604212.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:41:32.773503Z\", \"memory_request\": 2147483648, \"memory_usage\": 41659924, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:41:12.293285Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : MON - Delete the running mon] ***************************** changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "rm", "mon.np0005604212", "--force"], "delta": "0:00:02.383140", "end": "2026-02-01 09:42:21.984616", "msg": "", "rc": 0, "start": "2026-02-01 09:42:19.601476", "stderr": "", "stderr_lines": [], "stdout": "Removed mon.np0005604212 from host 'np0005604212.localdomain'", "stdout_lines": ["Removed mon.np0005604212 from host 'np0005604212.localdomain'"]} TASK [ceph_migrate : MON - Wait for the current mon to be deleted] ************* Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:42:22.105073", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2026-02-01 09:42:32.116170", "user_input": ""} TASK [ceph_migrate : MON - Redeploy mon on np0005604212.localdomain] *********** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Redeploy mon on np0005604212.localdomain] *********** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "add", "mon", "np0005604212.localdomain:172.18.0.103"], "delta": "0:00:03.284953", "end": "2026-02-01 09:42:36.242467", "msg": "", "rc": 0, "start": "2026-02-01 09:42:32.957514", "stderr": "", "stderr_lines": [], "stdout": "Deployed mon.np0005604212 on host 'np0005604212.localdomain'", "stdout_lines": ["Deployed mon.np0005604212 on host 'np0005604212.localdomain'"]} TASK [ceph_migrate : MON - Wait for the spec to be updated] ******************** Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:42:36.365142", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2026-02-01 09:42:46.377544", "user_input": ""} TASK [ceph_migrate : MON - Check mons quorum] ********************************** changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "-s", "-f", "json"], "delta": "0:00:00.795063", "end": "2026-02-01 09:42:47.705939", "msg": "", "rc": 0, "start": "2026-02-01 09:42:46.910876", "stderr": "", "stderr_lines": [], "stdout": "\n{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":44,\"quorum\":[0,1,2,3,4],\"quorum_names\":[\"np0005604211\",\"np0005604210\",\"np0005604215\",\"np0005604213\",\"np0005604212\"],\"quorum_age\":6,\"monmap\":{\"epoch\":9,\"min_mon_release_name\":\"reef\",\"num_mons\":5},\"osdmap\":{\"epoch\":82,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109572084,\"bytes_used\":592801792,\"bytes_avail\":44479188992,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604212.tkdkxt\",\"status\":\"up:active\",\"gid\":26329}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":5,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":75,\"modified\":\"2026-02-01T09:42:38.564462+0000\",\"services\":{}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_OK\",\"checks\":{},\"mutes\":[]},\"election_epoch\":44,\"quorum\":[0,1,2,3,4],\"quorum_names\":[\"np0005604211\",\"np0005604210\",\"np0005604215\",\"np0005604213\",\"np0005604212\"],\"quorum_age\":6,\"monmap\":{\"epoch\":9,\"min_mon_release_name\":\"reef\",\"num_mons\":5},\"osdmap\":{\"epoch\":82,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109572084,\"bytes_used\":592801792,\"bytes_avail\":44479188992,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604212.tkdkxt\",\"status\":\"up:active\",\"gid\":26329}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":5,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":75,\"modified\":\"2026-02-01T09:42:38.564462+0000\",\"services\":{}},\"progress_events\":{}}"]} TASK [ceph_migrate : reconfig osds] ******************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "reconfig", "osd.default_drive_group"], "delta": "0:00:01.104003", "end": "2026-02-01 09:42:49.527089", "msg": "", "rc": 0, "start": "2026-02-01 09:42:48.423086", "stderr": "", "stderr_lines": [], "stdout": "Scheduled to reconfig osd.1 on host 'np0005604212.localdomain'\nScheduled to reconfig osd.4 on host 'np0005604212.localdomain'\nScheduled to reconfig osd.0 on host 'np0005604213.localdomain'\nScheduled to reconfig osd.3 on host 'np0005604213.localdomain'\nScheduled to reconfig osd.2 on host 'np0005604215.localdomain'\nScheduled to reconfig osd.5 on host 'np0005604215.localdomain'", "stdout_lines": ["Scheduled to reconfig osd.1 on host 'np0005604212.localdomain'", "Scheduled to reconfig osd.4 on host 'np0005604212.localdomain'", "Scheduled to reconfig osd.0 on host 'np0005604213.localdomain'", "Scheduled to reconfig osd.3 on host 'np0005604213.localdomain'", "Scheduled to reconfig osd.2 on host 'np0005604215.localdomain'", "Scheduled to reconfig osd.5 on host 'np0005604215.localdomain'"]} TASK [ceph_migrate : force-fail ceph mgr] ************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/fail_mgr.yaml for np0005604209.localdomain TASK [ceph_migrate : Refresh ceph_cli] ***************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Force fail ceph mgr] ************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "fail"], "delta": "0:00:00.789607", "end": "2026-02-01 09:42:51.123670", "msg": "", "rc": 0, "start": "2026-02-01 09:42:50.334063", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Wait for cephadm to reconcile] **************************** Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:42:51.238896", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2026-02-01 09:43:01.250851", "user_input": ""} TASK [ceph_migrate : Get the ceph orchestrator status with] ******************** ASYNC OK on np0005604209.localdomain: jid=j795191678281.479564 changed: [np0005604209.localdomain] => {"ansible_job_id": "j795191678281.479564", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "status", "--format", "json"], "delta": "0:00:00.712148", "end": "2026-02-01 09:43:02.749947", "failed_when_result": false, "finished": 1, "msg": "", "rc": 0, "results_file": "/root/.ansible_async/j795191678281.479564", "start": "2026-02-01 09:43:02.037799", "started": 1, "stderr": "", "stderr_lines": [], "stdout": "\n{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}", "stdout_lines": ["", "{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}"]} TASK [ceph_migrate : Restart the active mgr] *********************************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Fail if ceph orchestrator is still not responding] ******** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Manage mons] **************************************** ok: [np0005604209.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mon:/home/tripleo-admin/mon:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mon"], "delta": "0:00:00.859822", "end": "2026-02-01 09:43:05.525478", "rc": 0, "start": "2026-02-01 09:43:04.665656", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mon update...", "stdout_lines": ["Scheduled mon update..."]} TASK [ceph_migrate : MON - wait daemons] *************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005604209.localdomain TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mon] ********************************************* changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005604212", "-f", "json"], "delta": "0:00:00.764693", "end": "2026-02-01 09:43:07.022832", "msg": "", "rc": 0, "start": "2026-02-01 09:43:06.258139", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"4e9c4a1fd3d5\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.99%\", \"created\": \"2026-02-01T09:42:35.988826Z\", \"daemon_id\": \"np0005604212\", \"daemon_name\": \"mon.np0005604212\", \"daemon_type\": \"mon\", \"hostname\": \"np0005604212.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:42:53.244986Z\", \"memory_request\": 2147483648, \"memory_usage\": 46902804, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:42:35.901120Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"4e9c4a1fd3d5\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.99%\", \"created\": \"2026-02-01T09:42:35.988826Z\", \"daemon_id\": \"np0005604212\", \"daemon_name\": \"mon.np0005604212\", \"daemon_type\": \"mon\", \"hostname\": \"np0005604212.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:42:53.244986Z\", \"memory_request\": 2147483648, \"memory_usage\": 46902804, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:42:35.901120Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Migrate mon] ********************************************** ok: [np0005604209.localdomain] => { "msg": "Migrate mon: np0005604210.localdomain to node: np0005604213.localdomain" } TASK [ceph_migrate : MON - Get current mon IP address from node_map override] *** ok: [np0005604209.localdomain] => {"ansible_facts": {"mon_ipaddr": "172.18.0.104"}, "changed": false} TASK [ceph_migrate : MON - Check mons quorum] ********************************** changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "-s", "-f", "json"], "delta": "0:00:00.772831", "end": "2026-02-01 09:43:08.760573", "msg": "", "rc": 0, "start": "2026-02-01 09:43:07.987742", "stderr": "", "stderr_lines": [], "stdout": "\n{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_WARN\",\"checks\":{\"CEPHADM_STRAY_DAEMON\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false},\"CEPHADM_STRAY_HOST\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray host(s) with 1 daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false}},\"mutes\":[]},\"election_epoch\":44,\"quorum\":[0,1,2,3,4],\"quorum_names\":[\"np0005604211\",\"np0005604210\",\"np0005604215\",\"np0005604213\",\"np0005604212\"],\"quorum_age\":27,\"monmap\":{\"epoch\":9,\"min_mon_release_name\":\"reef\",\"num_mons\":5},\"osdmap\":{\"epoch\":83,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109573208,\"bytes_used\":592871424,\"bytes_avail\":44479119360,\"bytes_total\":45071990784,\"read_bytes_sec\":18842,\"write_bytes_sec\":0,\"read_op_per_sec\":8,\"write_op_per_sec\":1},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604212.tkdkxt\",\"status\":\"up:active\",\"gid\":26329}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":5,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":75,\"modified\":\"2026-02-01T09:42:38.564462+0000\",\"services\":{}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_WARN\",\"checks\":{\"CEPHADM_STRAY_DAEMON\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false},\"CEPHADM_STRAY_HOST\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray host(s) with 1 daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false}},\"mutes\":[]},\"election_epoch\":44,\"quorum\":[0,1,2,3,4],\"quorum_names\":[\"np0005604211\",\"np0005604210\",\"np0005604215\",\"np0005604213\",\"np0005604212\"],\"quorum_age\":27,\"monmap\":{\"epoch\":9,\"min_mon_release_name\":\"reef\",\"num_mons\":5},\"osdmap\":{\"epoch\":83,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109573208,\"bytes_used\":592871424,\"bytes_avail\":44479119360,\"bytes_total\":45071990784,\"read_bytes_sec\":18842,\"write_bytes_sec\":0,\"read_op_per_sec\":8,\"write_op_per_sec\":1},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604212.tkdkxt\",\"status\":\"up:active\",\"gid\":26329}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":5,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":75,\"modified\":\"2026-02-01T09:42:38.564462+0000\",\"services\":{}},\"progress_events\":{}}"]} TASK [ceph_migrate : Backup data for client purposes] ************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/backup.yaml for np0005604209.localdomain TASK [ceph_migrate : Ensure backup directory exists] *************************** changed: [np0005604209.localdomain -> np0005604210.localdomain(192.168.122.104)] => {"changed": true, "gid": 1003, "group": "tripleo-admin", "mode": "0755", "owner": "tripleo-admin", "path": "/home/tripleo-admin/ceph_client", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 6, "state": "directory", "uid": 1003} TASK [ceph_migrate : Check file in the src directory] ************************** ok: [np0005604209.localdomain -> np0005604210.localdomain(192.168.122.104)] => {"changed": false, "examined": 2, "files": [{"atime": 1769938975.6243, "ctime": 1769938976.0643122, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1249903459, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1769938975.840306, "nlink": 1, "path": "/etc/ceph/ceph.conf", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 367, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1769938976.910336, "ctime": 1769938977.336348, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1249903460, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0600", "mtime": 1769938977.1053414, "nlink": 1, "path": "/etc/ceph/ceph.client.admin.keyring", "pw_name": "root", "rgrp": false, "roth": false, "rusr": true, "size": 151, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}], "matched": 2, "msg": "All paths examined", "skipped_paths": {}} TASK [ceph_migrate : Backup ceph client data] ********************************** changed: [np0005604209.localdomain -> np0005604210.localdomain(192.168.122.104)] => (item={'path': '/etc/ceph/ceph.conf', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 367, 'inode': 1249903459, 'dev': 64516, 'nlink': 1, 'atime': 1769938975.6243, 'mtime': 1769938975.840306, 'ctime': 1769938976.0643122, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "7f50af7176bdd9d60f3d54db515ab03dad17e898", "dest": "/home/tripleo-admin/ceph_client/ceph.conf", "gid": 0, "group": "root", "item": {"atime": 1769938975.6243, "ctime": 1769938976.0643122, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1249903459, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1769938975.840306, "nlink": 1, "path": "/etc/ceph/ceph.conf", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 367, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "f3d5b28c2b1d26b0d621c50625c21603", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 367, "src": "/etc/ceph/ceph.conf", "state": "file", "uid": 0} changed: [np0005604209.localdomain -> np0005604210.localdomain(192.168.122.104)] => (item={'path': '/etc/ceph/ceph.client.admin.keyring', 'mode': '0600', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 151, 'inode': 1249903460, 'dev': 64516, 'nlink': 1, 'atime': 1769938976.910336, 'mtime': 1769938977.1053414, 'ctime': 1769938977.336348, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': False, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "c1c7d8ee1d85e5ca70078f80d56073323aa5a1b6", "dest": "/home/tripleo-admin/ceph_client/ceph.client.admin.keyring", "gid": 0, "group": "root", "item": {"atime": 1769938976.910336, "ctime": 1769938977.336348, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1249903460, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0600", "mtime": 1769938977.1053414, "nlink": 1, "path": "/etc/ceph/ceph.client.admin.keyring", "pw_name": "root", "rgrp": false, "roth": false, "rusr": true, "size": 151, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "724c058e8f9bb9e9ef4f4d3fb1c871d4", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 151, "src": "/etc/ceph/ceph.client.admin.keyring", "state": "file", "uid": 0} TASK [ceph_migrate : MON - Get the current active mgr] ************************* changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "stat", "-f", "json"], "delta": "0:00:00.739488", "end": "2026-02-01 09:43:13.558863", "msg": "", "rc": 0, "start": "2026-02-01 09:43:12.819375", "stderr": "", "stderr_lines": [], "stdout": "\n{\"epoch\":23,\"available\":true,\"active_name\":\"np0005604213.caiaeh\",\"num_standby\":5}", "stdout_lines": ["", "{\"epoch\":23,\"available\":true,\"active_name\":\"np0005604213.caiaeh\",\"num_standby\":5}"]} TASK [ceph_migrate : MON - Load mgr data] ************************************** ok: [np0005604209.localdomain] => {"ansible_facts": {"mgr": {"active_name": "np0005604213.caiaeh", "available": true, "epoch": 23, "num_standby": 5}}, "changed": false} TASK [ceph_migrate : Print active mgr] ***************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Fail mgr if active in the current node] ******************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/fail_mgr.yaml for np0005604209.localdomain TASK [ceph_migrate : Refresh ceph_cli] ***************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Force fail ceph mgr] ************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "fail"], "delta": "0:00:00.867658", "end": "2026-02-01 09:43:15.317249", "msg": "", "rc": 0, "start": "2026-02-01 09:43:14.449591", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Wait for cephadm to reconcile] **************************** Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:43:15.453900", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2026-02-01 09:43:25.462149", "user_input": ""} TASK [ceph_migrate : Get the ceph orchestrator status with] ******************** ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC POLL on np0005604209.localdomain: jid=j386753210404.480995 started=1 finished=0 ASYNC FAILED on np0005604209.localdomain: jid=j386753210404.480995 ok: [np0005604209.localdomain] => {"ansible_job_id": "j386753210404.480995", "changed": false, "child_pid": 480999, "failed_when_result": false, "finished": 1, "msg": "Timeout exceeded", "results_file": "/root/.ansible_async/j386753210404.480995", "started": 1, "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Restart the active mgr] *********************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "fail"], "delta": "0:00:00.940305", "end": "2026-02-01 09:44:04.357064", "msg": "", "rc": 0, "start": "2026-02-01 09:44:03.416759", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Fail if ceph orchestrator is still not responding] ******** ASYNC OK on np0005604209.localdomain: jid=j494696924970.483109 changed: [np0005604209.localdomain] => {"ansible_job_id": "j494696924970.483109", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "status", "--format", "json"], "delta": "0:00:00.697673", "end": "2026-02-01 09:44:05.854033", "finished": 1, "msg": "", "rc": 0, "results_file": "/root/.ansible_async/j494696924970.483109", "start": "2026-02-01 09:44:05.156360", "started": 1, "stderr": "", "stderr_lines": [], "stdout": "\n{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}", "stdout_lines": ["", "{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}"]} TASK [ceph_migrate : MON - Drain and rm --force the cur_mon host] ************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/drain.yaml for np0005604209.localdomain TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : MON - wait daemons] *************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005604210", "-f", "json"], "delta": "0:00:00.739843", "end": "2026-02-01 09:44:08.445831", "msg": "", "rc": 0, "start": "2026-02-01 09:44:07.705988", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"b3eb9116b2cd\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.17%\", \"created\": \"2026-02-01T07:40:06.194675Z\", \"daemon_id\": \"np0005604210\", \"daemon_name\": \"mon.np0005604210\", \"daemon_type\": \"mon\", \"hostname\": \"np0005604210.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:44:06.706756Z\", \"memory_request\": 2147483648, \"memory_usage\": 137573171, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T07:40:06.051596Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"b3eb9116b2cd\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.17%\", \"created\": \"2026-02-01T07:40:06.194675Z\", \"daemon_id\": \"np0005604210\", \"daemon_name\": \"mon.np0005604210\", \"daemon_type\": \"mon\", \"hostname\": \"np0005604210.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:44:06.706756Z\", \"memory_request\": 2147483648, \"memory_usage\": 137573171, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T07:40:06.051596Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : DRAIN - Delete the mon running on the current controller node] *** changed: [np0005604209.localdomain -> np0005604210.localdomain(192.168.122.104)] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "rm", "mon.np0005604210", "--force"], "delta": "0:00:02.315084", "end": "2026-02-01 09:44:11.629989", "msg": "", "rc": 0, "start": "2026-02-01 09:44:09.314905", "stderr": "", "stderr_lines": [], "stdout": "Removed mon.np0005604210 from host 'np0005604210.localdomain'", "stdout_lines": ["Removed mon.np0005604210 from host 'np0005604210.localdomain'"]} TASK [ceph_migrate : DRAIN - remove label from the src node] ******************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/labels.yaml for np0005604209.localdomain TASK [ceph_migrate : Set/Unset labels - rm] ************************************ skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - rm] ************************************ changed: [np0005604209.localdomain] => (item=['np0005604210.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005604210.localdomain", "mon"], "delta": "0:00:01.798490", "end": "2026-02-01 09:44:14.229668", "item": ["np0005604210.localdomain", "mon"], "msg": "", "rc": 0, "start": "2026-02-01 09:44:12.431178", "stderr": "", "stderr_lines": [], "stdout": "Removed label mon from host np0005604210.localdomain", "stdout_lines": ["Removed label mon from host np0005604210.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604210.localdomain', 'mgr']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005604210.localdomain", "mgr"], "delta": "0:00:00.773405", "end": "2026-02-01 09:44:15.544858", "item": ["np0005604210.localdomain", "mgr"], "msg": "", "rc": 0, "start": "2026-02-01 09:44:14.771453", "stderr": "", "stderr_lines": [], "stdout": "Removed label mgr from host np0005604210.localdomain", "stdout_lines": ["Removed label mgr from host np0005604210.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604210.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005604210.localdomain", "_admin"], "delta": "0:00:00.723255", "end": "2026-02-01 09:44:16.825126", "item": ["np0005604210.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2026-02-01 09:44:16.101871", "stderr": "", "stderr_lines": [], "stdout": "Removed label _admin from host np0005604210.localdomain", "stdout_lines": ["Removed label _admin from host np0005604210.localdomain"]} TASK [ceph_migrate : Wait for the orchestrator to remove labels] *************** Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:44:16.970098", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2026-02-01 09:44:26.983660", "user_input": ""} TASK [ceph_migrate : DRAIN - Drain the host] *********************************** changed: [np0005604209.localdomain -> np0005604210.localdomain(192.168.122.104)] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "drain", "np0005604210.localdomain"], "delta": "0:00:00.701577", "end": "2026-02-01 09:44:28.367630", "msg": "", "rc": 0, "start": "2026-02-01 09:44:27.666053", "stderr": "", "stderr_lines": [], "stdout": "Scheduled to remove the following daemons from host 'np0005604210.localdomain'\ntype id \n-------------------- ---------------\ncrash np0005604210 \nmgr np0005604210.rirrtk", "stdout_lines": ["Scheduled to remove the following daemons from host 'np0005604210.localdomain'", "type id ", "-------------------- ---------------", "crash np0005604210 ", "mgr np0005604210.rirrtk"]} TASK [ceph_migrate : DRAIN - cleanup the host] ********************************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "force_clean | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - check host in hostmap] ****************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "ls", "--host_pattern", "np0005604210.localdomain", "-f", "json"], "delta": "0:00:00.732741", "end": "2026-02-01 09:44:29.742739", "msg": "", "rc": 0, "start": "2026-02-01 09:44:29.009998", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"addr\": \"192.168.122.104\", \"hostname\": \"np0005604210.localdomain\", \"labels\": [\"_no_schedule\", \"_no_conf_keyring\"], \"status\": \"\"}]", "stdout_lines": ["", "[{\"addr\": \"192.168.122.104\", \"hostname\": \"np0005604210.localdomain\", \"labels\": [\"_no_schedule\", \"_no_conf_keyring\"], \"status\": \"\"}]"]} TASK [ceph_migrate : MON - rm the cur_mon host from the Ceph cluster] ********** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "rm", "np0005604210.localdomain", "--force"], "delta": "0:00:00.755904", "end": "2026-02-01 09:44:31.128980", "msg": "", "rc": 0, "start": "2026-02-01 09:44:30.373076", "stderr": "", "stderr_lines": [], "stdout": "Removed host 'np0005604210.localdomain'", "stdout_lines": ["Removed host 'np0005604210.localdomain'"]} TASK [ceph_migrate : MON - Get current mon IP address] ************************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "mon_ipaddr is not defined", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Migrate the mon ip address from src to target node] *** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/network.yaml for np0005604209.localdomain TASK [ceph_migrate : MON - Print current mon IP address] *********************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Patch net-config config and remove the IP address (src node)] *** changed: [np0005604209.localdomain -> np0005604210.localdomain(192.168.122.104)] => {"backup": "/etc/os-net-config/tripleo_config.yaml.467970.2026-02-01@09:44:32~", "changed": true, "found": 1, "msg": "1 line(s) removed"} TASK [ceph_migrate : MON - Refresh os-net-config (src node)] ******************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "not manual_migration | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - manually rm the ip address (src node)] ************** changed: [np0005604209.localdomain -> np0005604210.localdomain(192.168.122.104)] => {"changed": true, "cmd": ["ip", "a", "del", "172.18.0.104/24", "dev", "vlan21"], "delta": "0:00:00.006874", "end": "2026-02-01 09:44:32.831405", "msg": "", "rc": 0, "start": "2026-02-01 09:44:32.824531", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : MON - Patch net-config config and add the IP address (target node)] *** changed: [np0005604209.localdomain -> np0005604213.localdomain(192.168.122.107)] => {"backup": "/etc/os-net-config/tripleo_config.yaml.291753.2026-02-01@09:44:34~", "changed": true, "msg": "line added"} TASK [ceph_migrate : MON - Refresh os-net-config (target_node)] **************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "not manual_migration | bool | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - statically assign the ip address to the target node] *** changed: [np0005604209.localdomain -> np0005604213.localdomain(192.168.122.107)] => {"changed": true, "cmd": ["ip", "a", "add", "172.18.0.104/24", "dev", "vlan21"], "delta": "0:00:00.006483", "end": "2026-02-01 09:44:35.076545", "msg": "", "rc": 0, "start": "2026-02-01 09:44:35.070062", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : MON - ping ip address to see if is reachable on the target node] *** changed: [np0005604209.localdomain -> np0005604213.localdomain(192.168.122.107)] => {"changed": true, "cmd": ["ping", "-W1", "-c", "3", "172.18.0.104"], "delta": "0:00:02.055981", "end": "2026-02-01 09:44:37.913061", "msg": "", "rc": 0, "start": "2026-02-01 09:44:35.857080", "stderr": "", "stderr_lines": [], "stdout": "PING 172.18.0.104 (172.18.0.104) 56(84) bytes of data.\n64 bytes from 172.18.0.104: icmp_seq=1 ttl=64 time=0.055 ms\n64 bytes from 172.18.0.104: icmp_seq=2 ttl=64 time=0.047 ms\n64 bytes from 172.18.0.104: icmp_seq=3 ttl=64 time=0.083 ms\n\n--- 172.18.0.104 ping statistics ---\n3 packets transmitted, 3 received, 0% packet loss, time 2049ms\nrtt min/avg/max/mdev = 0.047/0.061/0.083/0.015 ms", "stdout_lines": ["PING 172.18.0.104 (172.18.0.104) 56(84) bytes of data.", "64 bytes from 172.18.0.104: icmp_seq=1 ttl=64 time=0.055 ms", "64 bytes from 172.18.0.104: icmp_seq=2 ttl=64 time=0.047 ms", "64 bytes from 172.18.0.104: icmp_seq=3 ttl=64 time=0.083 ms", "", "--- 172.18.0.104 ping statistics ---", "3 packets transmitted, 3 received, 0% packet loss, time 2049ms", "rtt min/avg/max/mdev = 0.047/0.061/0.083/0.015 ms"]} TASK [ceph_migrate : MON - Fail if the IP address is not active in the target node] *** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ping_target_ip.rc != 0", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Unmanage mons] ******************************************** ok: [np0005604209.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mon:/home/tripleo-admin/mon:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mon"], "delta": "0:00:30.464830", "end": "2026-02-01 09:45:09.030705", "rc": 0, "start": "2026-02-01 09:44:38.565875", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mon update...", "stdout_lines": ["Scheduled mon update..."]} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Get tmp mon] **************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005604213", "-f", "json"], "delta": "0:00:00.717551", "end": "2026-02-01 09:45:10.436759", "msg": "", "rc": 0, "start": "2026-02-01 09:45:09.719208", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"1b1be3e5221c\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.72%\", \"created\": \"2026-02-01T09:41:06.716411Z\", \"daemon_id\": \"np0005604213\", \"daemon_name\": \"mon.np0005604213\", \"daemon_type\": \"mon\", \"hostname\": \"np0005604213.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:44:06.646616Z\", \"memory_request\": 2147483648, \"memory_usage\": 61100523, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:41:06.621855Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"1b1be3e5221c\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.72%\", \"created\": \"2026-02-01T09:41:06.716411Z\", \"daemon_id\": \"np0005604213\", \"daemon_name\": \"mon.np0005604213\", \"daemon_type\": \"mon\", \"hostname\": \"np0005604213.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:44:06.646616Z\", \"memory_request\": 2147483648, \"memory_usage\": 61100523, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:41:06.621855Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : MON - Delete the running mon] ***************************** changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "rm", "mon.np0005604213", "--force"], "delta": "0:00:02.244609", "end": "2026-02-01 09:45:13.253216", "msg": "", "rc": 0, "start": "2026-02-01 09:45:11.008607", "stderr": "", "stderr_lines": [], "stdout": "Removed mon.np0005604213 from host 'np0005604213.localdomain'", "stdout_lines": ["Removed mon.np0005604213 from host 'np0005604213.localdomain'"]} TASK [ceph_migrate : MON - Wait for the current mon to be deleted] ************* Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:45:13.382875", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2026-02-01 09:45:23.395560", "user_input": ""} TASK [ceph_migrate : MON - Redeploy mon on np0005604213.localdomain] *********** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Redeploy mon on np0005604213.localdomain] *********** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "add", "mon", "np0005604213.localdomain:172.18.0.104"], "delta": "0:00:03.707540", "end": "2026-02-01 09:45:27.717697", "msg": "", "rc": 0, "start": "2026-02-01 09:45:24.010157", "stderr": "", "stderr_lines": [], "stdout": "Deployed mon.np0005604213 on host 'np0005604213.localdomain'", "stdout_lines": ["Deployed mon.np0005604213 on host 'np0005604213.localdomain'"]} TASK [ceph_migrate : MON - Wait for the spec to be updated] ******************** Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:45:27.857957", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2026-02-01 09:45:37.868906", "user_input": ""} TASK [ceph_migrate : MON - Check mons quorum] ********************************** changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "-s", "-f", "json"], "delta": "0:00:03.797017", "end": "2026-02-01 09:45:42.303302", "msg": "", "rc": 0, "start": "2026-02-01 09:45:38.506285", "stderr": "", "stderr_lines": [], "stdout": "\n{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_WARN\",\"checks\":{\"CEPHADM_STRAY_DAEMON\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false},\"CEPHADM_STRAY_HOST\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray host(s) with 1 daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false}},\"mutes\":[]},\"election_epoch\":52,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005604211\",\"np0005604215\",\"np0005604212\"],\"quorum_age\":25,\"monmap\":{\"epoch\":11,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":86,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109576580,\"bytes_used\":593129472,\"bytes_avail\":44478861312,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604212.tkdkxt\",\"status\":\"up:active\",\"gid\":26329}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":4,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":78,\"modified\":\"2026-02-01T09:45:13.319868+0000\",\"services\":{\"mds\":{\"daemons\":{\"summary\":\"\",\"mds.np0005604212.tkdkxt\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604213.jdbvyh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604215.rwvxvg\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005604209.isqrps\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604211.cuflqz\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604212.oynhpm\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604213.caiaeh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215.uhhqtv\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005604211\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604212\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"osd\":{\"daemons\":{\"summary\":\"\",\"0\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"1\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"2\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"3\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"4\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"5\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_WARN\",\"checks\":{\"CEPHADM_STRAY_DAEMON\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false},\"CEPHADM_STRAY_HOST\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray host(s) with 1 daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false}},\"mutes\":[]},\"election_epoch\":52,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005604211\",\"np0005604215\",\"np0005604212\"],\"quorum_age\":25,\"monmap\":{\"epoch\":11,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":86,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109576580,\"bytes_used\":593129472,\"bytes_avail\":44478861312,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604212.tkdkxt\",\"status\":\"up:active\",\"gid\":26329}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":4,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":78,\"modified\":\"2026-02-01T09:45:13.319868+0000\",\"services\":{\"mds\":{\"daemons\":{\"summary\":\"\",\"mds.np0005604212.tkdkxt\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604213.jdbvyh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604215.rwvxvg\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005604209.isqrps\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604211.cuflqz\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604212.oynhpm\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604213.caiaeh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215.uhhqtv\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005604211\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604212\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"osd\":{\"daemons\":{\"summary\":\"\",\"0\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"1\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"2\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"3\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"4\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"5\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}"]} TASK [ceph_migrate : reconfig osds] ******************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "reconfig", "osd.default_drive_group"], "delta": "0:00:00.960022", "end": "2026-02-01 09:45:43.923677", "msg": "", "rc": 0, "start": "2026-02-01 09:45:42.963655", "stderr": "", "stderr_lines": [], "stdout": "Scheduled to reconfig osd.1 on host 'np0005604212.localdomain'\nScheduled to reconfig osd.4 on host 'np0005604212.localdomain'\nScheduled to reconfig osd.0 on host 'np0005604213.localdomain'\nScheduled to reconfig osd.3 on host 'np0005604213.localdomain'\nScheduled to reconfig osd.2 on host 'np0005604215.localdomain'\nScheduled to reconfig osd.5 on host 'np0005604215.localdomain'", "stdout_lines": ["Scheduled to reconfig osd.1 on host 'np0005604212.localdomain'", "Scheduled to reconfig osd.4 on host 'np0005604212.localdomain'", "Scheduled to reconfig osd.0 on host 'np0005604213.localdomain'", "Scheduled to reconfig osd.3 on host 'np0005604213.localdomain'", "Scheduled to reconfig osd.2 on host 'np0005604215.localdomain'", "Scheduled to reconfig osd.5 on host 'np0005604215.localdomain'"]} TASK [ceph_migrate : force-fail ceph mgr] ************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/fail_mgr.yaml for np0005604209.localdomain TASK [ceph_migrate : Refresh ceph_cli] ***************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Force fail ceph mgr] ************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "fail"], "delta": "0:00:03.898831", "end": "2026-02-01 09:45:48.554877", "msg": "", "rc": 0, "start": "2026-02-01 09:45:44.656046", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Wait for cephadm to reconcile] **************************** Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:45:48.702709", "stderr": "", "stdout": "Paused for 10.0 seconds", "stop": "2026-02-01 09:45:58.706953", "user_input": ""} TASK [ceph_migrate : Get the ceph orchestrator status with] ******************** ASYNC OK on np0005604209.localdomain: jid=j584796259388.486253 changed: [np0005604209.localdomain] => {"ansible_job_id": "j584796259388.486253", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "status", "--format", "json"], "delta": "0:00:00.721593", "end": "2026-02-01 09:46:00.169074", "failed_when_result": false, "finished": 1, "msg": "", "rc": 0, "results_file": "/root/.ansible_async/j584796259388.486253", "start": "2026-02-01 09:45:59.447481", "started": 1, "stderr": "", "stderr_lines": [], "stdout": "\n{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}", "stdout_lines": ["", "{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}"]} TASK [ceph_migrate : Restart the active mgr] *********************************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Fail if ceph orchestrator is still not responding] ******** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Manage mons] **************************************** ok: [np0005604209.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mon:/home/tripleo-admin/mon:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mon"], "delta": "0:00:00.726612", "end": "2026-02-01 09:46:02.562485", "rc": 0, "start": "2026-02-01 09:46:01.835873", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mon update...", "stdout_lines": ["Scheduled mon update..."]} TASK [ceph_migrate : MON - wait daemons] *************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005604209.localdomain TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mon] ********************************************* changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005604213", "-f", "json"], "delta": "0:00:00.687593", "end": "2026-02-01 09:46:03.951636", "msg": "", "rc": 0, "start": "2026-02-01 09:46:03.264043", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"512c3a6bb82e\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.87%\", \"created\": \"2026-02-01T09:45:27.475943Z\", \"daemon_id\": \"np0005604213\", \"daemon_name\": \"mon.np0005604213\", \"daemon_type\": \"mon\", \"hostname\": \"np0005604213.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:45:50.639330Z\", \"memory_request\": 2147483648, \"memory_usage\": 70369935, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:45:27.376541Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"512c3a6bb82e\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.87%\", \"created\": \"2026-02-01T09:45:27.475943Z\", \"daemon_id\": \"np0005604213\", \"daemon_name\": \"mon.np0005604213\", \"daemon_type\": \"mon\", \"hostname\": \"np0005604213.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:45:50.639330Z\", \"memory_request\": 2147483648, \"memory_usage\": 70369935, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:45:27.376541Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Migrate mon] ********************************************** ok: [np0005604209.localdomain] => { "msg": "Migrate mon: np0005604211.localdomain to node: np0005604215.localdomain" } TASK [ceph_migrate : MON - Get current mon IP address from node_map override] *** ok: [np0005604209.localdomain] => {"ansible_facts": {"mon_ipaddr": "172.18.0.105"}, "changed": false} TASK [ceph_migrate : MON - Check mons quorum] ********************************** changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "-s", "-f", "json"], "delta": "0:00:00.689387", "end": "2026-02-01 09:46:05.502409", "msg": "", "rc": 0, "start": "2026-02-01 09:46:04.813022", "stderr": "", "stderr_lines": [], "stdout": "\n{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_WARN\",\"checks\":{\"CEPHADM_STRAY_DAEMON\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false},\"CEPHADM_STRAY_HOST\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray host(s) with 1 daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false}},\"mutes\":[]},\"election_epoch\":56,\"quorum\":[0,1,2,3],\"quorum_names\":[\"np0005604211\",\"np0005604215\",\"np0005604212\",\"np0005604213\"],\"quorum_age\":6,\"monmap\":{\"epoch\":12,\"min_mon_release_name\":\"reef\",\"num_mons\":4},\"osdmap\":{\"epoch\":87,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109577704,\"bytes_used\":611713024,\"bytes_avail\":44460277760,\"bytes_total\":45071990784,\"read_bytes_sec\":17850,\"write_bytes_sec\":0,\"read_op_per_sec\":8,\"write_op_per_sec\":1},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604212.tkdkxt\",\"status\":\"up:active\",\"gid\":26329}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":4,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":79,\"modified\":\"2026-02-01T09:45:49.447343+0000\",\"services\":{\"mds\":{\"daemons\":{\"summary\":\"\",\"mds.np0005604212.tkdkxt\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604213.jdbvyh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604215.rwvxvg\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005604209.isqrps\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604211.cuflqz\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604213.caiaeh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215.uhhqtv\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005604211\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604212\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"osd\":{\"daemons\":{\"summary\":\"\",\"0\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"1\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"2\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"3\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"4\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"5\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_WARN\",\"checks\":{\"CEPHADM_STRAY_DAEMON\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false},\"CEPHADM_STRAY_HOST\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray host(s) with 1 daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false}},\"mutes\":[]},\"election_epoch\":56,\"quorum\":[0,1,2,3],\"quorum_names\":[\"np0005604211\",\"np0005604215\",\"np0005604212\",\"np0005604213\"],\"quorum_age\":6,\"monmap\":{\"epoch\":12,\"min_mon_release_name\":\"reef\",\"num_mons\":4},\"osdmap\":{\"epoch\":87,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109577704,\"bytes_used\":611713024,\"bytes_avail\":44460277760,\"bytes_total\":45071990784,\"read_bytes_sec\":17850,\"write_bytes_sec\":0,\"read_op_per_sec\":8,\"write_op_per_sec\":1},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604212.tkdkxt\",\"status\":\"up:active\",\"gid\":26329}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":4,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":79,\"modified\":\"2026-02-01T09:45:49.447343+0000\",\"services\":{\"mds\":{\"daemons\":{\"summary\":\"\",\"mds.np0005604212.tkdkxt\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604213.jdbvyh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604215.rwvxvg\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005604209.isqrps\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604211.cuflqz\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604213.caiaeh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215.uhhqtv\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005604211\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604212\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"osd\":{\"daemons\":{\"summary\":\"\",\"0\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"1\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"2\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"3\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"4\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"5\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}"]} TASK [ceph_migrate : Backup data for client purposes] ************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/backup.yaml for np0005604209.localdomain TASK [ceph_migrate : Ensure backup directory exists] *************************** changed: [np0005604209.localdomain -> np0005604211.localdomain(192.168.122.105)] => {"changed": true, "gid": 1003, "group": "tripleo-admin", "mode": "0755", "owner": "tripleo-admin", "path": "/home/tripleo-admin/ceph_client", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 6, "state": "directory", "uid": 1003} TASK [ceph_migrate : Check file in the src directory] ************************** ok: [np0005604209.localdomain -> np0005604211.localdomain(192.168.122.105)] => {"changed": false, "examined": 2, "files": [{"atime": 1769939152.4776926, "ctime": 1769939152.9317064, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1291929609, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1769939152.688699, "nlink": 1, "path": "/etc/ceph/ceph.conf", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 271, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1769939153.849734, "ctime": 1769939154.4217515, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1291845977, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0600", "mtime": 1769939154.205745, "nlink": 1, "path": "/etc/ceph/ceph.client.admin.keyring", "pw_name": "root", "rgrp": false, "roth": false, "rusr": true, "size": 151, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}], "matched": 2, "msg": "All paths examined", "skipped_paths": {}} TASK [ceph_migrate : Backup ceph client data] ********************************** changed: [np0005604209.localdomain -> np0005604211.localdomain(192.168.122.105)] => (item={'path': '/etc/ceph/ceph.conf', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 271, 'inode': 1291929609, 'dev': 64516, 'nlink': 1, 'atime': 1769939152.4776926, 'mtime': 1769939152.688699, 'ctime': 1769939152.9317064, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "44eafdce172bfd7e5eaa8e73ae06fef99ba22014", "dest": "/home/tripleo-admin/ceph_client/ceph.conf", "gid": 0, "group": "root", "item": {"atime": 1769939152.4776926, "ctime": 1769939152.9317064, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1291929609, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1769939152.688699, "nlink": 1, "path": "/etc/ceph/ceph.conf", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 271, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "df81409f39e2fce59daae817241ac834", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 271, "src": "/etc/ceph/ceph.conf", "state": "file", "uid": 0} changed: [np0005604209.localdomain -> np0005604211.localdomain(192.168.122.105)] => (item={'path': '/etc/ceph/ceph.client.admin.keyring', 'mode': '0600', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 151, 'inode': 1291845977, 'dev': 64516, 'nlink': 1, 'atime': 1769939153.849734, 'mtime': 1769939154.205745, 'ctime': 1769939154.4217515, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': False, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False}) => {"ansible_loop_var": "item", "changed": true, "checksum": "c1c7d8ee1d85e5ca70078f80d56073323aa5a1b6", "dest": "/home/tripleo-admin/ceph_client/ceph.client.admin.keyring", "gid": 0, "group": "root", "item": {"atime": 1769939153.849734, "ctime": 1769939154.4217515, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1291845977, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0600", "mtime": 1769939154.205745, "nlink": 1, "path": "/etc/ceph/ceph.client.admin.keyring", "pw_name": "root", "rgrp": false, "roth": false, "rusr": true, "size": 151, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, "md5sum": "724c058e8f9bb9e9ef4f4d3fb1c871d4", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 151, "src": "/etc/ceph/ceph.client.admin.keyring", "state": "file", "uid": 0} TASK [ceph_migrate : MON - Get the current active mgr] ************************* changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "stat", "-f", "json"], "delta": "0:00:00.839572", "end": "2026-02-01 09:46:10.426605", "msg": "", "rc": 0, "start": "2026-02-01 09:46:09.587033", "stderr": "", "stderr_lines": [], "stdout": "\n{\"epoch\":40,\"available\":true,\"active_name\":\"np0005604215.uhhqtv\",\"num_standby\":4}", "stdout_lines": ["", "{\"epoch\":40,\"available\":true,\"active_name\":\"np0005604215.uhhqtv\",\"num_standby\":4}"]} TASK [ceph_migrate : MON - Load mgr data] ************************************** ok: [np0005604209.localdomain] => {"ansible_facts": {"mgr": {"active_name": "np0005604215.uhhqtv", "available": true, "epoch": 40, "num_standby": 4}}, "changed": false} TASK [ceph_migrate : Print active mgr] ***************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Fail mgr if active in the current node] ******************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/fail_mgr.yaml for np0005604209.localdomain TASK [ceph_migrate : Refresh ceph_cli] ***************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Force fail ceph mgr] ************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "fail"], "delta": "0:00:00.796641", "end": "2026-02-01 09:46:12.156350", "msg": "", "rc": 0, "start": "2026-02-01 09:46:11.359709", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Wait for cephadm to reconcile] **************************** Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:46:12.291734", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2026-02-01 09:46:22.297565", "user_input": ""} TASK [ceph_migrate : Get the ceph orchestrator status with] ******************** ASYNC OK on np0005604209.localdomain: jid=j590564323528.487540 changed: [np0005604209.localdomain] => {"ansible_job_id": "j590564323528.487540", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "status", "--format", "json"], "delta": "0:00:00.689131", "end": "2026-02-01 09:46:23.711058", "failed_when_result": false, "finished": 1, "msg": "", "rc": 0, "results_file": "/root/.ansible_async/j590564323528.487540", "start": "2026-02-01 09:46:23.021927", "started": 1, "stderr": "", "stderr_lines": [], "stdout": "\n{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}", "stdout_lines": ["", "{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}"]} TASK [ceph_migrate : Restart the active mgr] *********************************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Fail if ceph orchestrator is still not responding] ******** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Drain and rm --force the cur_mon host] ************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/drain.yaml for np0005604209.localdomain TASK [ceph_migrate : Get ceph_cli] ********************************************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : MON - wait daemons] *************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005604211", "-f", "json"], "delta": "0:00:00.682151", "end": "2026-02-01 09:46:26.419887", "msg": "", "rc": 0, "start": "2026-02-01 09:46:25.737736", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"33c567b54b63\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.22%\", \"created\": \"2026-02-01T07:40:03.823175Z\", \"daemon_id\": \"np0005604211\", \"daemon_name\": \"mon.np0005604211\", \"daemon_type\": \"mon\", \"events\": [\"2026-02-01T09:46:20.063100Z daemon:mon.np0005604211 [INFO] \\\"Reconfigured mon.np0005604211 on host 'np0005604211.localdomain'\\\"\"], \"hostname\": \"np0005604211.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:46:14.393089Z\", \"memory_request\": 2147483648, \"memory_usage\": 171756748, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T07:40:03.683982Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"33c567b54b63\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"1.22%\", \"created\": \"2026-02-01T07:40:03.823175Z\", \"daemon_id\": \"np0005604211\", \"daemon_name\": \"mon.np0005604211\", \"daemon_type\": \"mon\", \"events\": [\"2026-02-01T09:46:20.063100Z daemon:mon.np0005604211 [INFO] \\\"Reconfigured mon.np0005604211 on host 'np0005604211.localdomain'\\\"\"], \"hostname\": \"np0005604211.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:46:14.393089Z\", \"memory_request\": 2147483648, \"memory_usage\": 171756748, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T07:40:03.683982Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : DRAIN - Delete the mon running on the current controller node] *** changed: [np0005604209.localdomain -> np0005604211.localdomain(192.168.122.105)] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "rm", "mon.np0005604211", "--force"], "delta": "0:00:02.332116", "end": "2026-02-01 09:46:29.507713", "msg": "", "rc": 0, "start": "2026-02-01 09:46:27.175597", "stderr": "", "stderr_lines": [], "stdout": "Removed mon.np0005604211 from host 'np0005604211.localdomain'", "stdout_lines": ["Removed mon.np0005604211 from host 'np0005604211.localdomain'"]} TASK [ceph_migrate : DRAIN - remove label from the src node] ******************* included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/labels.yaml for np0005604209.localdomain TASK [ceph_migrate : Set/Unset labels - rm] ************************************ skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Print nodes] ********************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Set/Unset labels - rm] ************************************ changed: [np0005604209.localdomain] => (item=['np0005604211.localdomain', 'mon']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005604211.localdomain", "mon"], "delta": "0:00:02.818379", "end": "2026-02-01 09:46:33.202001", "item": ["np0005604211.localdomain", "mon"], "msg": "", "rc": 0, "start": "2026-02-01 09:46:30.383622", "stderr": "", "stderr_lines": [], "stdout": "Removed label mon from host np0005604211.localdomain", "stdout_lines": ["Removed label mon from host np0005604211.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604211.localdomain', 'mgr']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005604211.localdomain", "mgr"], "delta": "0:00:00.686410", "end": "2026-02-01 09:46:34.511150", "item": ["np0005604211.localdomain", "mgr"], "msg": "", "rc": 0, "start": "2026-02-01 09:46:33.824740", "stderr": "", "stderr_lines": [], "stdout": "Removed label mgr from host np0005604211.localdomain", "stdout_lines": ["Removed label mgr from host np0005604211.localdomain"]} changed: [np0005604209.localdomain] => (item=['np0005604211.localdomain', '_admin']) => {"ansible_loop_var": "item", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "label", "rm", "np0005604211.localdomain", "_admin"], "delta": "0:00:00.713926", "end": "2026-02-01 09:46:35.782573", "item": ["np0005604211.localdomain", "_admin"], "msg": "", "rc": 0, "start": "2026-02-01 09:46:35.068647", "stderr": "", "stderr_lines": [], "stdout": "Removed label _admin from host np0005604211.localdomain", "stdout_lines": ["Removed label _admin from host np0005604211.localdomain"]} TASK [ceph_migrate : Wait for the orchestrator to remove labels] *************** Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:46:35.919132", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2026-02-01 09:46:45.930546", "user_input": ""} TASK [ceph_migrate : DRAIN - Drain the host] *********************************** changed: [np0005604209.localdomain -> np0005604211.localdomain(192.168.122.105)] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "drain", "np0005604211.localdomain"], "delta": "0:00:00.791929", "end": "2026-02-01 09:46:47.410953", "msg": "", "rc": 0, "start": "2026-02-01 09:46:46.619024", "stderr": "", "stderr_lines": [], "stdout": "Scheduled to remove the following daemons from host 'np0005604211.localdomain'\ntype id \n-------------------- ---------------\nmgr np0005604211.cuflqz\ncrash np0005604211 ", "stdout_lines": ["Scheduled to remove the following daemons from host 'np0005604211.localdomain'", "type id ", "-------------------- ---------------", "mgr np0005604211.cuflqz", "crash np0005604211 "]} TASK [ceph_migrate : DRAIN - cleanup the host] ********************************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "force_clean | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - check host in hostmap] ****************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "ls", "--host_pattern", "np0005604211.localdomain", "-f", "json"], "delta": "0:00:00.709679", "end": "2026-02-01 09:46:48.807833", "msg": "", "rc": 0, "start": "2026-02-01 09:46:48.098154", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"addr\": \"192.168.122.105\", \"hostname\": \"np0005604211.localdomain\", \"labels\": [\"_no_schedule\", \"_no_conf_keyring\"], \"status\": \"\"}]", "stdout_lines": ["", "[{\"addr\": \"192.168.122.105\", \"hostname\": \"np0005604211.localdomain\", \"labels\": [\"_no_schedule\", \"_no_conf_keyring\"], \"status\": \"\"}]"]} TASK [ceph_migrate : MON - rm the cur_mon host from the Ceph cluster] ********** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "host", "rm", "np0005604211.localdomain", "--force"], "delta": "0:00:00.728565", "end": "2026-02-01 09:46:50.131435", "msg": "", "rc": 0, "start": "2026-02-01 09:46:49.402870", "stderr": "", "stderr_lines": [], "stdout": "Removed host 'np0005604211.localdomain'", "stdout_lines": ["Removed host 'np0005604211.localdomain'"]} TASK [ceph_migrate : MON - Get current mon IP address] ************************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "mon_ipaddr is not defined", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Migrate the mon ip address from src to target node] *** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/network.yaml for np0005604209.localdomain TASK [ceph_migrate : MON - Print current mon IP address] *********************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Patch net-config config and remove the IP address (src node)] *** changed: [np0005604209.localdomain -> np0005604211.localdomain(192.168.122.105)] => {"backup": "/etc/os-net-config/tripleo_config.yaml.472523.2026-02-01@09:46:51~", "changed": true, "found": 1, "msg": "1 line(s) removed"} TASK [ceph_migrate : MON - Refresh os-net-config (src node)] ******************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "not manual_migration | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - manually rm the ip address (src node)] ************** changed: [np0005604209.localdomain -> np0005604211.localdomain(192.168.122.105)] => {"changed": true, "cmd": ["ip", "a", "del", "172.18.0.105/24", "dev", "vlan21"], "delta": "0:00:00.006936", "end": "2026-02-01 09:46:52.036358", "msg": "", "rc": 0, "start": "2026-02-01 09:46:52.029422", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : MON - Patch net-config config and add the IP address (target node)] *** changed: [np0005604209.localdomain -> np0005604215.localdomain(192.168.122.108)] => {"backup": "/etc/os-net-config/tripleo_config.yaml.295498.2026-02-01@09:46:53~", "changed": true, "msg": "line added"} TASK [ceph_migrate : MON - Refresh os-net-config (target_node)] **************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "not manual_migration | bool | default(false)", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - statically assign the ip address to the target node] *** changed: [np0005604209.localdomain -> np0005604215.localdomain(192.168.122.108)] => {"changed": true, "cmd": ["ip", "a", "add", "172.18.0.105/24", "dev", "vlan21"], "delta": "0:00:00.004484", "end": "2026-02-01 09:46:53.980097", "msg": "", "rc": 0, "start": "2026-02-01 09:46:53.975613", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : MON - ping ip address to see if is reachable on the target node] *** changed: [np0005604209.localdomain -> np0005604215.localdomain(192.168.122.108)] => {"changed": true, "cmd": ["ping", "-W1", "-c", "3", "172.18.0.105"], "delta": "0:00:02.041568", "end": "2026-02-01 09:46:56.729085", "msg": "", "rc": 0, "start": "2026-02-01 09:46:54.687517", "stderr": "", "stderr_lines": [], "stdout": "PING 172.18.0.105 (172.18.0.105) 56(84) bytes of data.\n64 bytes from 172.18.0.105: icmp_seq=1 ttl=64 time=0.052 ms\n64 bytes from 172.18.0.105: icmp_seq=2 ttl=64 time=0.540 ms\n64 bytes from 172.18.0.105: icmp_seq=3 ttl=64 time=0.069 ms\n\n--- 172.18.0.105 ping statistics ---\n3 packets transmitted, 3 received, 0% packet loss, time 2035ms\nrtt min/avg/max/mdev = 0.052/0.220/0.540/0.226 ms", "stdout_lines": ["PING 172.18.0.105 (172.18.0.105) 56(84) bytes of data.", "64 bytes from 172.18.0.105: icmp_seq=1 ttl=64 time=0.052 ms", "64 bytes from 172.18.0.105: icmp_seq=2 ttl=64 time=0.540 ms", "64 bytes from 172.18.0.105: icmp_seq=3 ttl=64 time=0.069 ms", "", "--- 172.18.0.105 ping statistics ---", "3 packets transmitted, 3 received, 0% packet loss, time 2035ms", "rtt min/avg/max/mdev = 0.052/0.220/0.540/0.226 ms"]} TASK [ceph_migrate : MON - Fail if the IP address is not active in the target node] *** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ping_target_ip.rc != 0", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Unmanage mons] ******************************************** ok: [np0005604209.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mon:/home/tripleo-admin/mon:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mon"], "delta": "0:00:28.104835", "end": "2026-02-01 09:47:25.542186", "rc": 0, "start": "2026-02-01 09:46:57.437351", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mon update...", "stdout_lines": ["Scheduled mon update..."]} TASK [ceph_migrate : Print the resulting spec] ********************************* skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Get tmp mon] **************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005604215", "-f", "json"], "delta": "0:00:03.735276", "end": "2026-02-01 09:47:29.915918", "msg": "", "rc": 0, "start": "2026-02-01 09:47:26.180642", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"e5584900e404\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.19%\", \"created\": \"2026-02-01T09:41:04.032928Z\", \"daemon_id\": \"np0005604215\", \"daemon_name\": \"mon.np0005604215\", \"daemon_type\": \"mon\", \"hostname\": \"np0005604215.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:47:26.462259Z\", \"memory_request\": 2147483648, \"memory_usage\": 105381888, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:41:03.903046Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"e5584900e404\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.19%\", \"created\": \"2026-02-01T09:41:04.032928Z\", \"daemon_id\": \"np0005604215\", \"daemon_name\": \"mon.np0005604215\", \"daemon_type\": \"mon\", \"hostname\": \"np0005604215.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:47:26.462259Z\", \"memory_request\": 2147483648, \"memory_usage\": 105381888, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:41:03.903046Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : MON - Delete the running mon] ***************************** changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "rm", "mon.np0005604215", "--force"], "delta": "0:00:02.350761", "end": "2026-02-01 09:47:32.924255", "msg": "", "rc": 0, "start": "2026-02-01 09:47:30.573494", "stderr": "", "stderr_lines": [], "stdout": "Removed mon.np0005604215 from host 'np0005604215.localdomain'", "stdout_lines": ["Removed mon.np0005604215 from host 'np0005604215.localdomain'"]} TASK [ceph_migrate : MON - Wait for the current mon to be deleted] ************* Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:47:33.078917", "stderr": "", "stdout": "Paused for 10.02 seconds", "stop": "2026-02-01 09:47:43.102152", "user_input": ""} TASK [ceph_migrate : MON - Redeploy mon on np0005604215.localdomain] *********** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : MON - Redeploy mon on np0005604215.localdomain] *********** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "daemon", "add", "mon", "np0005604215.localdomain:172.18.0.105"], "delta": "0:00:06.488033", "end": "2026-02-01 09:47:50.195024", "msg": "", "rc": 0, "start": "2026-02-01 09:47:43.706991", "stderr": "", "stderr_lines": [], "stdout": "Deployed mon.np0005604215 on host 'np0005604215.localdomain'", "stdout_lines": ["Deployed mon.np0005604215 on host 'np0005604215.localdomain'"]} TASK [ceph_migrate : MON - Wait for the spec to be updated] ******************** Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:47:50.306276", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2026-02-01 09:48:00.311867", "user_input": ""} TASK [ceph_migrate : MON - Check mons quorum] ********************************** changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "-s", "-f", "json"], "delta": "0:00:00.828963", "end": "2026-02-01 09:48:01.678544", "msg": "", "rc": 0, "start": "2026-02-01 09:48:00.849581", "stderr": "", "stderr_lines": [], "stdout": "\n{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_WARN\",\"checks\":{\"CEPHADM_STRAY_DAEMON\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false},\"CEPHADM_STRAY_HOST\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray host(s) with 1 daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false}},\"mutes\":[]},\"election_epoch\":68,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005604212\",\"np0005604213\",\"np0005604215\"],\"quorum_age\":4,\"monmap\":{\"epoch\":15,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":89,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109579952,\"bytes_used\":611917824,\"bytes_avail\":44460072960,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604212.tkdkxt\",\"status\":\"up:active\",\"gid\":26329}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":3,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":82,\"modified\":\"2026-02-01T09:47:33.029729+0000\",\"services\":{\"mds\":{\"daemons\":{\"summary\":\"\",\"mds.np0005604212.tkdkxt\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604213.jdbvyh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604215.rwvxvg\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005604209.isqrps\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604212.oynhpm\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604213.caiaeh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215.uhhqtv\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005604212\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604213\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"osd\":{\"daemons\":{\"summary\":\"\",\"0\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"1\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"2\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"3\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"4\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"5\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_WARN\",\"checks\":{\"CEPHADM_STRAY_DAEMON\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false},\"CEPHADM_STRAY_HOST\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray host(s) with 1 daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false}},\"mutes\":[]},\"election_epoch\":68,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005604212\",\"np0005604213\",\"np0005604215\"],\"quorum_age\":4,\"monmap\":{\"epoch\":15,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":89,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109579952,\"bytes_used\":611917824,\"bytes_avail\":44460072960,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604212.tkdkxt\",\"status\":\"up:active\",\"gid\":26329}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":3,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":82,\"modified\":\"2026-02-01T09:47:33.029729+0000\",\"services\":{\"mds\":{\"daemons\":{\"summary\":\"\",\"mds.np0005604212.tkdkxt\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604213.jdbvyh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604215.rwvxvg\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005604209.isqrps\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604212.oynhpm\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604213.caiaeh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215.uhhqtv\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005604212\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604213\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"osd\":{\"daemons\":{\"summary\":\"\",\"0\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"1\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"2\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"3\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"4\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"5\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}"]} TASK [ceph_migrate : reconfig osds] ******************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "reconfig", "osd.default_drive_group"], "delta": "0:00:00.843096", "end": "2026-02-01 09:48:03.193979", "msg": "", "rc": 0, "start": "2026-02-01 09:48:02.350883", "stderr": "", "stderr_lines": [], "stdout": "Scheduled to reconfig osd.1 on host 'np0005604212.localdomain'\nScheduled to reconfig osd.4 on host 'np0005604212.localdomain'\nScheduled to reconfig osd.0 on host 'np0005604213.localdomain'\nScheduled to reconfig osd.3 on host 'np0005604213.localdomain'\nScheduled to reconfig osd.2 on host 'np0005604215.localdomain'\nScheduled to reconfig osd.5 on host 'np0005604215.localdomain'", "stdout_lines": ["Scheduled to reconfig osd.1 on host 'np0005604212.localdomain'", "Scheduled to reconfig osd.4 on host 'np0005604212.localdomain'", "Scheduled to reconfig osd.0 on host 'np0005604213.localdomain'", "Scheduled to reconfig osd.3 on host 'np0005604213.localdomain'", "Scheduled to reconfig osd.2 on host 'np0005604215.localdomain'", "Scheduled to reconfig osd.5 on host 'np0005604215.localdomain'"]} TASK [ceph_migrate : force-fail ceph mgr] ************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/fail_mgr.yaml for np0005604209.localdomain TASK [ceph_migrate : Refresh ceph_cli] ***************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_cli.yaml for np0005604209.localdomain TASK [ceph_migrate : Set ceph CLI] ********************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph_cli": "podman run --rm --net=host --ipc=host --volume /home/tripleo-admin/ceph_client:/etc/ceph:z --entrypoint ceph registry.redhat.io/rhceph/rhceph-7-rhel9:latest --fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring "}, "changed": false} TASK [ceph_migrate : Force fail ceph mgr] ************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "fail"], "delta": "0:00:00.797424", "end": "2026-02-01 09:48:04.727536", "msg": "", "rc": 0, "start": "2026-02-01 09:48:03.930112", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Wait for cephadm to reconcile] **************************** Pausing for 10 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2026-02-01 09:48:04.858179", "stderr": "", "stdout": "Paused for 10.01 seconds", "stop": "2026-02-01 09:48:14.872163", "user_input": ""} TASK [ceph_migrate : Get the ceph orchestrator status with] ******************** ASYNC OK on np0005604209.localdomain: jid=j729601378689.490867 changed: [np0005604209.localdomain] => {"ansible_job_id": "j729601378689.490867", "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "status", "--format", "json"], "delta": "0:00:00.719370", "end": "2026-02-01 09:48:16.339474", "failed_when_result": false, "finished": 1, "msg": "", "rc": 0, "results_file": "/root/.ansible_async/j729601378689.490867", "start": "2026-02-01 09:48:15.620104", "started": 1, "stderr": "", "stderr_lines": [], "stdout": "\n{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}", "stdout_lines": ["", "{\"available\": true, \"backend\": \"cephadm\", \"paused\": false, \"workers\": 10}"]} TASK [ceph_migrate : Restart the active mgr] *********************************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Fail if ceph orchestrator is still not responding] ******** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "\"Timeout exceeded\" in ceph_orch_status.msg", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : MON - Manage mons] **************************************** ok: [np0005604209.localdomain] => {"changed": false, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "-v", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "-v", "/var/lib/ceph/:/var/lib/ceph/:z", "-v", "/var/log/ceph/:/var/log/ceph/:z", "-v", "/home/tripleo-admin/mon:/home/tripleo-admin/mon:z", "--entrypoint=ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "-n", "client.admin", "-k", "/etc/ceph/ceph.client.admin.keyring", "--cluster", "ceph", "orch", "apply", "--in-file", "/home/tripleo-admin/mon"], "delta": "0:00:00.652594", "end": "2026-02-01 09:48:18.906604", "rc": 0, "start": "2026-02-01 09:48:18.254010", "stderr": "", "stderr_lines": [], "stdout": "Scheduled mon update...", "stdout_lines": ["Scheduled mon update..."]} TASK [ceph_migrate : MON - wait daemons] *************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/wait_daemons.yaml for np0005604209.localdomain TASK [ceph_migrate : print daemon id option] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : wait for mon] ********************************************* changed: [np0005604209.localdomain] => {"attempts": 1, "changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "orch", "ps", "--daemon_type", "mon", "--daemon_id", "np0005604215", "-f", "json"], "delta": "0:00:00.691196", "end": "2026-02-01 09:48:20.235624", "msg": "", "rc": 0, "start": "2026-02-01 09:48:19.544428", "stderr": "", "stderr_lines": [], "stdout": "\n[{\"container_id\": \"06016fd8ed9e\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.28%\", \"created\": \"2026-02-01T09:47:49.957501Z\", \"daemon_id\": \"np0005604215\", \"daemon_name\": \"mon.np0005604215\", \"daemon_type\": \"mon\", \"hostname\": \"np0005604215.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:48:06.855400Z\", \"memory_request\": 2147483648, \"memory_usage\": 57021562, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:47:49.851588Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]", "stdout_lines": ["", "[{\"container_id\": \"06016fd8ed9e\", \"container_image_digests\": [\"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\", \"registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:ccaca0c393ff2ec3f4177fd5627fc55fbe1cb8706fbfc96b7bddb02de80a1ade\"], \"container_image_id\": \"f644374691eb2741563f71a8fe1d32033d5d4f8b67c1e0b640ca6278c781e906\", \"container_image_name\": \"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\", \"cpu_percentage\": \"3.28%\", \"created\": \"2026-02-01T09:47:49.957501Z\", \"daemon_id\": \"np0005604215\", \"daemon_name\": \"mon.np0005604215\", \"daemon_type\": \"mon\", \"hostname\": \"np0005604215.localdomain\", \"is_active\": false, \"last_refresh\": \"2026-02-01T09:48:06.855400Z\", \"memory_request\": 2147483648, \"memory_usage\": 57021562, \"ports\": [], \"service_name\": \"mon\", \"started\": \"2026-02-01T09:47:49.851588Z\", \"status\": 1, \"status_desc\": \"running\", \"version\": \"18.2.1-361.el9cp\"}]"]} TASK [ceph_migrate : Sleep before moving to the next mon] ********************** Pausing for 30 seconds ok: [np0005604209.localdomain] => {"changed": false, "delta": 30, "echo": true, "rc": 0, "start": "2026-02-01 09:48:20.397318", "stderr": "", "stdout": "Paused for 30.03 seconds", "stop": "2026-02-01 09:48:50.429624", "user_input": ""} TASK [ceph_migrate : POST - Dump logs] ***************************************** included: /home/zuul/src/github.com/openstack-k8s-operators/data-plane-adoption/tests/roles/ceph_migrate/tasks/ceph_load.yaml for np0005604209.localdomain TASK [ceph_migrate : Check file in the src directory] ************************** ok: [np0005604209.localdomain] => {"changed": false, "examined": 4, "files": [{"atime": 1769938886.9354308, "ctime": 1769938886.6744227, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 42044798, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1769938835.4148498, "nlink": 1, "path": "/home/tripleo-admin/ceph_client/ceph.conf", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 142, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1769938886.9404309, "ctime": 1769938886.6734228, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1291944713, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1769931517.8977625, "nlink": 1, "path": "/home/tripleo-admin/ceph_client/ceph.client.admin.keyring", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1769932750.3485157, "ctime": 1769938886.6734228, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1291944714, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1769932747.9424472, "nlink": 1, "path": "/home/tripleo-admin/ceph_client/ceph.client.openstack.keyring", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 231, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1769932751.4375467, "ctime": 1769938886.6734228, "dev": 64516, "gid": 0, "gr_name": "root", "inode": 1291944715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0644", "mtime": 1769932748.9624763, "nlink": 1, "path": "/home/tripleo-admin/ceph_client/ceph.client.manila.keyring", "pw_name": "root", "rgrp": true, "roth": true, "rusr": true, "size": 153, "uid": 0, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}], "matched": 4, "msg": "All paths examined", "skipped_paths": {}} TASK [ceph_migrate : Restore files] ******************************************** changed: [np0005604209.localdomain] => (item=ceph.conf) => {"ansible_loop_var": "item", "changed": true, "checksum": "325a9a30a411d247b85e492170c49524d84ea4a7", "dest": "/etc/ceph/ceph.conf", "gid": 0, "group": "root", "item": "ceph.conf", "md5sum": "41c2cfec048bfb04a66a702d3f6f9775", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_tmp_t:s0", "size": 142, "src": "/home/tripleo-admin/ceph_client/ceph.conf", "state": "file", "uid": 0} changed: [np0005604209.localdomain] => (item=ceph.client.admin.keyring) => {"ansible_loop_var": "item", "changed": true, "checksum": "c1c7d8ee1d85e5ca70078f80d56073323aa5a1b6", "dest": "/etc/ceph/ceph.client.admin.keyring", "gid": 0, "group": "root", "item": "ceph.client.admin.keyring", "md5sum": "724c058e8f9bb9e9ef4f4d3fb1c871d4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 151, "src": "/home/tripleo-admin/ceph_client/ceph.client.admin.keyring", "state": "file", "uid": 0} TASK [ceph_migrate : Ensure backup directory exists] *************************** changed: [np0005604209.localdomain] => {"changed": true, "gid": 1003, "group": "tripleo-admin", "mode": "0755", "owner": "tripleo-admin", "path": "/home/tripleo-admin/ceph_client/logs", "secontext": "unconfined_u:object_r:container_file_t:s0", "size": 6, "state": "directory", "uid": 1003} TASK [ceph_migrate : Get Ceph Health] ****************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "-s", "-f", "json"], "delta": "0:00:03.193724", "end": "2026-02-01 09:48:56.828816", "msg": "", "rc": 0, "start": "2026-02-01 09:48:53.635092", "stderr": "Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e\nInferring config /etc/ceph/ceph.conf\nUsing ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4", "stderr_lines": ["Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e", "Inferring config /etc/ceph/ceph.conf", "Using ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4"], "stdout": "\n{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_WARN\",\"checks\":{\"CEPHADM_STRAY_DAEMON\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false},\"CEPHADM_STRAY_HOST\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray host(s) with 1 daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false}},\"mutes\":[]},\"election_epoch\":68,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005604212\",\"np0005604213\",\"np0005604215\"],\"quorum_age\":59,\"monmap\":{\"epoch\":15,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":90,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109581076,\"bytes_used\":612016128,\"bytes_avail\":44459974656,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604212.tkdkxt\",\"status\":\"up:active\",\"gid\":26329}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":3,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":83,\"modified\":\"2026-02-01T09:48:05.608037+0000\",\"services\":{\"mds\":{\"daemons\":{\"summary\":\"\",\"mds.np0005604212.tkdkxt\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604213.jdbvyh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604215.rwvxvg\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005604212.oynhpm\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604213.caiaeh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215.uhhqtv\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005604212\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604213\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"osd\":{\"daemons\":{\"summary\":\"\",\"0\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"1\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"2\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"3\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"4\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"5\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}", "stdout_lines": ["", "{\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"health\":{\"status\":\"HEALTH_WARN\",\"checks\":{\"CEPHADM_STRAY_DAEMON\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false},\"CEPHADM_STRAY_HOST\":{\"severity\":\"HEALTH_WARN\",\"summary\":{\"message\":\"1 stray host(s) with 1 daemon(s) not managed by cephadm\",\"count\":1},\"muted\":false}},\"mutes\":[]},\"election_epoch\":68,\"quorum\":[0,1,2],\"quorum_names\":[\"np0005604212\",\"np0005604213\",\"np0005604215\"],\"quorum_age\":59,\"monmap\":{\"epoch\":15,\"min_mon_release_name\":\"reef\",\"num_mons\":3},\"osdmap\":{\"epoch\":90,\"num_osds\":6,\"num_up_osds\":6,\"osd_up_since\":1769931655,\"num_in_osds\":6,\"osd_in_since\":1769931634,\"num_remapped_pgs\":0},\"pgmap\":{\"pgs_by_state\":[{\"state_name\":\"active+clean\",\"count\":177}],\"num_pgs\":177,\"num_pools\":7,\"num_objects\":69,\"data_bytes\":109581076,\"bytes_used\":612016128,\"bytes_avail\":44459974656,\"bytes_total\":45071990784},\"fsmap\":{\"epoch\":16,\"id\":1,\"up\":1,\"in\":1,\"max\":1,\"by_rank\":[{\"filesystem_id\":1,\"rank\":0,\"name\":\"mds.np0005604212.tkdkxt\",\"status\":\"up:active\",\"gid\":26329}],\"up:standby\":2},\"mgrmap\":{\"available\":true,\"num_standbys\":3,\"modules\":[\"cephadm\",\"iostat\",\"nfs\",\"restful\"],\"services\":{}},\"servicemap\":{\"epoch\":83,\"modified\":\"2026-02-01T09:48:05.608037+0000\",\"services\":{\"mds\":{\"daemons\":{\"summary\":\"\",\"mds.np0005604212.tkdkxt\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604213.jdbvyh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"mds.np0005604215.rwvxvg\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mgr\":{\"daemons\":{\"summary\":\"\",\"np0005604212.oynhpm\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604213.caiaeh\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215.uhhqtv\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"mon\":{\"daemons\":{\"summary\":\"\",\"np0005604212\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604213\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"np0005604215\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}},\"osd\":{\"daemons\":{\"summary\":\"\",\"0\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"1\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"2\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"3\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"4\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}},\"5\":{\"start_epoch\":0,\"start_stamp\":\"0.000000\",\"gid\":0,\"addr\":\"(unrecognized address family 0)/0\",\"metadata\":{},\"task_status\":{}}}}}},\"progress_events\":{}}"]} TASK [ceph_migrate : Load ceph data] ******************************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"ceph": {"election_epoch": 68, "fsid": "33fac0b9-80c7-560f-918a-c92d3021ca1e", "fsmap": {"by_rank": [{"filesystem_id": 1, "gid": 26329, "name": "mds.np0005604212.tkdkxt", "rank": 0, "status": "up:active"}], "epoch": 16, "id": 1, "in": 1, "max": 1, "up": 1, "up:standby": 2}, "health": {"checks": {"CEPHADM_STRAY_DAEMON": {"muted": false, "severity": "HEALTH_WARN", "summary": {"count": 1, "message": "1 stray daemon(s) not managed by cephadm"}}, "CEPHADM_STRAY_HOST": {"muted": false, "severity": "HEALTH_WARN", "summary": {"count": 1, "message": "1 stray host(s) with 1 daemon(s) not managed by cephadm"}}}, "mutes": [], "status": "HEALTH_WARN"}, "mgrmap": {"available": true, "modules": ["cephadm", "iostat", "nfs", "restful"], "num_standbys": 3, "services": {}}, "monmap": {"epoch": 15, "min_mon_release_name": "reef", "num_mons": 3}, "osdmap": {"epoch": 90, "num_in_osds": 6, "num_osds": 6, "num_remapped_pgs": 0, "num_up_osds": 6, "osd_in_since": 1769931634, "osd_up_since": 1769931655}, "pgmap": {"bytes_avail": 44459974656, "bytes_total": 45071990784, "bytes_used": 612016128, "data_bytes": 109581076, "num_objects": 69, "num_pgs": 177, "num_pools": 7, "pgs_by_state": [{"count": 177, "state_name": "active+clean"}]}, "progress_events": {}, "quorum": [0, 1, 2], "quorum_age": 59, "quorum_names": ["np0005604212", "np0005604213", "np0005604215"], "servicemap": {"epoch": 83, "modified": "2026-02-01T09:48:05.608037+0000", "services": {"mds": {"daemons": {"mds.np0005604212.tkdkxt": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "mds.np0005604213.jdbvyh": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "mds.np0005604215.rwvxvg": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "summary": ""}}, "mgr": {"daemons": {"np0005604212.oynhpm": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "np0005604213.caiaeh": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "np0005604215.uhhqtv": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "summary": ""}}, "mon": {"daemons": {"np0005604212": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "np0005604213": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "np0005604215": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "summary": ""}}, "osd": {"daemons": {"0": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "1": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "2": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "3": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "4": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "5": {"addr": "(unrecognized address family 0)/0", "gid": 0, "metadata": {}, "start_epoch": 0, "start_stamp": "0.000000", "task_status": {}}, "summary": ""}}}}}}, "changed": false} TASK [ceph_migrate : Dump ceph -s output to log file] ************************** changed: [np0005604209.localdomain] => {"changed": true, "checksum": "5aaeb05c9bd0ee0f1144383daff14b0810d66afc", "dest": "/home/tripleo-admin/ceph_client/logs/ceph_health.log", "gid": 1003, "group": "tripleo-admin", "md5sum": "bf95fc9c47f38c074cfc5a9d37274b45", "mode": "0644", "owner": "tripleo-admin", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 3865, "src": "/home/tripleo-admin/.ansible/tmp/ansible-tmp-1769939337.0720851-62188-98245002341437/source", "state": "file", "uid": 1003} TASK [ceph_migrate : Get Ceph Orch ServiceMap] ********************************* changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "orch", "ls", "-f", "json"], "delta": "0:00:03.002089", "end": "2026-02-01 09:49:01.459591", "msg": "", "rc": 0, "start": "2026-02-01 09:48:58.457502", "stderr": "Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e\nInferring config /etc/ceph/ceph.conf\nUsing ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4", "stderr_lines": ["Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e", "Inferring config /etc/ceph/ceph.conf", "Using ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4"], "stdout": "\n[{\"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"crash\", \"service_type\": \"crash\", \"status\": {\"created\": \"2026-02-01T07:38:30.151117Z\", \"last_refresh\": \"2026-02-01T09:48:06.704872Z\", \"running\": 3, \"size\": 3}}, {\"placement\": {\"label\": \"mds\"}, \"service_id\": \"mds\", \"service_name\": \"mds.mds\", \"service_type\": \"mds\", \"status\": {\"created\": \"2026-02-01T09:39:12.051359Z\", \"last_refresh\": \"2026-02-01T09:48:06.705353Z\", \"running\": 3, \"size\": 3}}, {\"placement\": {\"label\": \"mgr\"}, \"service_name\": \"mgr\", \"service_type\": \"mgr\", \"status\": {\"created\": \"2026-02-01T09:40:41.656715Z\", \"last_refresh\": \"2026-02-01T09:48:06.705485Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2026-02-01T09:48:22.425450Z service:mon [INFO] \\\"service was created\\\"\"], \"placement\": {\"label\": \"mon\"}, \"service_name\": \"mon\", \"service_type\": \"mon\", \"status\": {\"created\": \"2026-02-01T09:48:18.792485Z\", \"last_refresh\": \"2026-02-01T09:48:06.705609Z\", \"running\": 3, \"size\": 3}}, {\"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"node-proxy\", \"service_type\": \"node-proxy\", \"status\": {\"created\": \"2026-02-01T07:38:44.402177Z\", \"running\": 0, \"size\": 0}}, {\"placement\": {\"hosts\": [\"np0005604212.localdomain\", \"np0005604213.localdomain\", \"np0005604215.localdomain\"]}, \"service_id\": \"default_drive_group\", \"service_name\": \"osd.default_drive_group\", \"service_type\": \"osd\", \"spec\": {\"data_devices\": {\"paths\": [\"/dev/ceph_vg0/ceph_lv0\", \"/dev/ceph_vg1/ceph_lv1\"]}, \"filter_logic\": \"AND\", \"objectstore\": \"bluestore\"}, \"status\": {\"created\": \"2026-02-01T07:39:12.067676Z\", \"last_refresh\": \"2026-02-01T09:48:06.705046Z\", \"running\": 6, \"size\": 6}}]", "stdout_lines": ["", "[{\"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"crash\", \"service_type\": \"crash\", \"status\": {\"created\": \"2026-02-01T07:38:30.151117Z\", \"last_refresh\": \"2026-02-01T09:48:06.704872Z\", \"running\": 3, \"size\": 3}}, {\"placement\": {\"label\": \"mds\"}, \"service_id\": \"mds\", \"service_name\": \"mds.mds\", \"service_type\": \"mds\", \"status\": {\"created\": \"2026-02-01T09:39:12.051359Z\", \"last_refresh\": \"2026-02-01T09:48:06.705353Z\", \"running\": 3, \"size\": 3}}, {\"placement\": {\"label\": \"mgr\"}, \"service_name\": \"mgr\", \"service_type\": \"mgr\", \"status\": {\"created\": \"2026-02-01T09:40:41.656715Z\", \"last_refresh\": \"2026-02-01T09:48:06.705485Z\", \"running\": 3, \"size\": 3}}, {\"events\": [\"2026-02-01T09:48:22.425450Z service:mon [INFO] \\\"service was created\\\"\"], \"placement\": {\"label\": \"mon\"}, \"service_name\": \"mon\", \"service_type\": \"mon\", \"status\": {\"created\": \"2026-02-01T09:48:18.792485Z\", \"last_refresh\": \"2026-02-01T09:48:06.705609Z\", \"running\": 3, \"size\": 3}}, {\"placement\": {\"host_pattern\": \"*\"}, \"service_name\": \"node-proxy\", \"service_type\": \"node-proxy\", \"status\": {\"created\": \"2026-02-01T07:38:44.402177Z\", \"running\": 0, \"size\": 0}}, {\"placement\": {\"hosts\": [\"np0005604212.localdomain\", \"np0005604213.localdomain\", \"np0005604215.localdomain\"]}, \"service_id\": \"default_drive_group\", \"service_name\": \"osd.default_drive_group\", \"service_type\": \"osd\", \"spec\": {\"data_devices\": {\"paths\": [\"/dev/ceph_vg0/ceph_lv0\", \"/dev/ceph_vg1/ceph_lv1\"]}, \"filter_logic\": \"AND\", \"objectstore\": \"bluestore\"}, \"status\": {\"created\": \"2026-02-01T07:39:12.067676Z\", \"last_refresh\": \"2026-02-01T09:48:06.705046Z\", \"running\": 6, \"size\": 6}}]"]} TASK [ceph_migrate : Load Service Map] ***************************************** ok: [np0005604209.localdomain] => {"ansible_facts": {"servicemap": [{"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2026-02-01T07:38:30.151117Z", "last_refresh": "2026-02-01T09:48:06.704872Z", "running": 3, "size": 3}}, {"placement": {"label": "mds"}, "service_id": "mds", "service_name": "mds.mds", "service_type": "mds", "status": {"created": "2026-02-01T09:39:12.051359Z", "last_refresh": "2026-02-01T09:48:06.705353Z", "running": 3, "size": 3}}, {"placement": {"label": "mgr"}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-01T09:40:41.656715Z", "last_refresh": "2026-02-01T09:48:06.705485Z", "running": 3, "size": 3}}, {"events": ["2026-02-01T09:48:22.425450Z service:mon [INFO] \"service was created\""], "placement": {"label": "mon"}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-01T09:48:18.792485Z", "last_refresh": "2026-02-01T09:48:06.705609Z", "running": 3, "size": 3}}, {"placement": {"host_pattern": "*"}, "service_name": "node-proxy", "service_type": "node-proxy", "status": {"created": "2026-02-01T07:38:44.402177Z", "running": 0, "size": 0}}, {"placement": {"hosts": ["np0005604212.localdomain", "np0005604213.localdomain", "np0005604215.localdomain"]}, "service_id": "default_drive_group", "service_name": "osd.default_drive_group", "service_type": "osd", "spec": {"data_devices": {"paths": ["/dev/ceph_vg0/ceph_lv0", "/dev/ceph_vg1/ceph_lv1"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-01T07:39:12.067676Z", "last_refresh": "2026-02-01T09:48:06.705046Z", "running": 6, "size": 6}}]}, "changed": false} TASK [ceph_migrate : Print Service Map] **************************************** skipping: [np0005604209.localdomain] => (item={'placement': {'host_pattern': '*'}, 'service_name': 'crash', 'service_type': 'crash', 'status': {'created': '2026-02-01T07:38:30.151117Z', 'last_refresh': '2026-02-01T09:48:06.704872Z', 'running': 3, 'size': 3}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2026-02-01T07:38:30.151117Z", "last_refresh": "2026-02-01T09:48:06.704872Z", "running": 3, "size": 3}}} skipping: [np0005604209.localdomain] => (item={'placement': {'label': 'mds'}, 'service_id': 'mds', 'service_name': 'mds.mds', 'service_type': 'mds', 'status': {'created': '2026-02-01T09:39:12.051359Z', 'last_refresh': '2026-02-01T09:48:06.705353Z', 'running': 3, 'size': 3}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"placement": {"label": "mds"}, "service_id": "mds", "service_name": "mds.mds", "service_type": "mds", "status": {"created": "2026-02-01T09:39:12.051359Z", "last_refresh": "2026-02-01T09:48:06.705353Z", "running": 3, "size": 3}}} skipping: [np0005604209.localdomain] => (item={'placement': {'label': 'mgr'}, 'service_name': 'mgr', 'service_type': 'mgr', 'status': {'created': '2026-02-01T09:40:41.656715Z', 'last_refresh': '2026-02-01T09:48:06.705485Z', 'running': 3, 'size': 3}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"placement": {"label": "mgr"}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2026-02-01T09:40:41.656715Z", "last_refresh": "2026-02-01T09:48:06.705485Z", "running": 3, "size": 3}}} skipping: [np0005604209.localdomain] => (item={'events': ['2026-02-01T09:48:22.425450Z service:mon [INFO] "service was created"'], 'placement': {'label': 'mon'}, 'service_name': 'mon', 'service_type': 'mon', 'status': {'created': '2026-02-01T09:48:18.792485Z', 'last_refresh': '2026-02-01T09:48:06.705609Z', 'running': 3, 'size': 3}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"events": ["2026-02-01T09:48:22.425450Z service:mon [INFO] \"service was created\""], "placement": {"label": "mon"}, "service_name": "mon", "service_type": "mon", "status": {"created": "2026-02-01T09:48:18.792485Z", "last_refresh": "2026-02-01T09:48:06.705609Z", "running": 3, "size": 3}}} skipping: [np0005604209.localdomain] => (item={'placement': {'host_pattern': '*'}, 'service_name': 'node-proxy', 'service_type': 'node-proxy', 'status': {'created': '2026-02-01T07:38:44.402177Z', 'running': 0, 'size': 0}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"placement": {"host_pattern": "*"}, "service_name": "node-proxy", "service_type": "node-proxy", "status": {"created": "2026-02-01T07:38:44.402177Z", "running": 0, "size": 0}}} skipping: [np0005604209.localdomain] => (item={'placement': {'hosts': ['np0005604212.localdomain', 'np0005604213.localdomain', 'np0005604215.localdomain']}, 'service_id': 'default_drive_group', 'service_name': 'osd.default_drive_group', 'service_type': 'osd', 'spec': {'data_devices': {'paths': ['/dev/ceph_vg0/ceph_lv0', '/dev/ceph_vg1/ceph_lv1']}, 'filter_logic': 'AND', 'objectstore': 'bluestore'}, 'status': {'created': '2026-02-01T07:39:12.067676Z', 'last_refresh': '2026-02-01T09:48:06.705046Z', 'running': 6, 'size': 6}}) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": {"placement": {"hosts": ["np0005604212.localdomain", "np0005604213.localdomain", "np0005604215.localdomain"]}, "service_id": "default_drive_group", "service_name": "osd.default_drive_group", "service_type": "osd", "spec": {"data_devices": {"paths": ["/dev/ceph_vg0/ceph_lv0", "/dev/ceph_vg1/ceph_lv1"]}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2026-02-01T07:39:12.067676Z", "last_refresh": "2026-02-01T09:48:06.705046Z", "running": 6, "size": 6}}} skipping: [np0005604209.localdomain] => {"msg": "All items skipped"} TASK [ceph_migrate : Dump ceph orch ls output to log file] ********************* changed: [np0005604209.localdomain] => {"changed": true, "checksum": "00d7dad21346aad6781e10ad59467483c5197fa1", "dest": "/home/tripleo-admin/ceph_client/logs/ceph_orch_ls.log", "gid": 1003, "group": "tripleo-admin", "md5sum": "9346acfd97e7a3eabc41b315897fca4c", "mode": "0644", "owner": "tripleo-admin", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 1600, "src": "/home/tripleo-admin/.ansible/tmp/ansible-tmp-1769939341.7715156-62217-10617614878296/source", "state": "file", "uid": 1003} TASK [ceph_migrate : Get Ceph config] ****************************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "config", "dump", "-f", "json"], "delta": "0:00:02.980224", "end": "2026-02-01 09:49:06.210613", "msg": "", "rc": 0, "start": "2026-02-01 09:49:03.230389", "stderr": "Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e\nInferring config /etc/ceph/ceph.conf\nUsing ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4", "stderr_lines": ["Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e", "Inferring config /etc/ceph/ceph.conf", "Using ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4"], "stdout": "\n[{\"section\":\"global\",\"name\":\"cluster_network\",\"value\":\"172.20.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"container_image\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\",\"level\":\"basic\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv4\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv6\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"public_network\",\"value\":\"172.18.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mon\",\"name\":\"auth_allow_insecure_global_id_reclaim\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_base\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_haproxy\",\"value\":\"registry.redhat.io/rhceph/rhceph-haproxy-rhel9:latest\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_keepalived\",\"value\":\"registry.redhat.io/rhceph/keepalived-rhel9:latest\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_init\",\"value\":\"True\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/migration_current\",\"value\":\"7\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/use_repo_digest\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/orchestrator/orchestrator\",\"value\":\"cephadm\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005604212\",\"location_type\":\"host\",\"location_value\":\"np0005604212\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"1414117580\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005604213\",\"location_type\":\"host\",\"location_value\":\"np0005604213\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709082009\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005604215\",\"location_type\":\"host\",\"location_value\":\"np0005604215\"},{\"section\":\"osd\",\"name\":\"osd_memory_target_autotune\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mds.mds\",\"name\":\"mds_join_fs\",\"value\":\"mds\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mds.np0005604212.tkdkxt\",\"name\":\"mds_join_fs\",\"value\":\"cephfs\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"\"}]", "stdout_lines": ["", "[{\"section\":\"global\",\"name\":\"cluster_network\",\"value\":\"172.20.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"container_image\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\",\"level\":\"basic\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv4\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"ms_bind_ipv6\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"global\",\"name\":\"public_network\",\"value\":\"172.18.0.0/24\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mon\",\"name\":\"auth_allow_insecure_global_id_reclaim\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_base\",\"value\":\"registry.redhat.io/rhceph/rhceph-7-rhel9:latest\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_haproxy\",\"value\":\"registry.redhat.io/rhceph/rhceph-haproxy-rhel9:latest\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_image_keepalived\",\"value\":\"registry.redhat.io/rhceph/keepalived-rhel9:latest\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/container_init\",\"value\":\"True\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/migration_current\",\"value\":\"7\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/cephadm/use_repo_digest\",\"value\":\"false\",\"level\":\"advanced\",\"can_update_at_runtime\":false,\"mask\":\"\"},{\"section\":\"mgr\",\"name\":\"mgr/orchestrator/orchestrator\",\"value\":\"cephadm\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709084876\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005604212\",\"location_type\":\"host\",\"location_value\":\"np0005604212\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"1414117580\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005604213\",\"location_type\":\"host\",\"location_value\":\"np0005604213\"},{\"section\":\"osd\",\"name\":\"osd_memory_target\",\"value\":\"5709082009\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"host:np0005604215\",\"location_type\":\"host\",\"location_value\":\"np0005604215\"},{\"section\":\"osd\",\"name\":\"osd_memory_target_autotune\",\"value\":\"true\",\"level\":\"advanced\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mds.mds\",\"name\":\"mds_join_fs\",\"value\":\"mds\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"\"},{\"section\":\"mds.np0005604212.tkdkxt\",\"name\":\"mds_join_fs\",\"value\":\"cephfs\",\"level\":\"basic\",\"can_update_at_runtime\":true,\"mask\":\"\"}]"]} TASK [ceph_migrate : Print Ceph config dump] *********************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Dump ceph config dump output to log file] ***************** changed: [np0005604209.localdomain] => {"changed": true, "checksum": "456a16c61c42cf81482a3a3e8e515454e0da5b04", "dest": "/home/tripleo-admin/ceph_client/logs/ceph_config_dump.log", "gid": 1003, "group": "tripleo-admin", "md5sum": "058570633120252cd3ac344341ff06e1", "mode": "0644", "owner": "tripleo-admin", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 3044, "src": "/home/tripleo-admin/.ansible/tmp/ansible-tmp-1769939346.3840573-62244-257833907867554/source", "state": "file", "uid": 1003} TASK [ceph_migrate : Get Ceph Orch Host Map] *********************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "orch", "host", "ls", "-f", "json"], "delta": "0:00:02.944168", "end": "2026-02-01 09:49:10.785506", "msg": "", "rc": 0, "start": "2026-02-01 09:49:07.841338", "stderr": "Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e\nInferring config /etc/ceph/ceph.conf\nUsing ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4", "stderr_lines": ["Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e", "Inferring config /etc/ceph/ceph.conf", "Using ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4"], "stdout": "\n[{\"addr\": \"192.168.122.106\", \"hostname\": \"np0005604212.localdomain\", \"labels\": [\"osd\", \"mds\", \"mgr\", \"mon\", \"_admin\"], \"status\": \"\"}, {\"addr\": \"192.168.122.107\", \"hostname\": \"np0005604213.localdomain\", \"labels\": [\"osd\", \"mds\", \"mgr\", \"mon\", \"_admin\"], \"status\": \"\"}, {\"addr\": \"192.168.122.108\", \"hostname\": \"np0005604215.localdomain\", \"labels\": [\"osd\", \"mds\", \"mgr\", \"mon\", \"_admin\"], \"status\": \"\"}]", "stdout_lines": ["", "[{\"addr\": \"192.168.122.106\", \"hostname\": \"np0005604212.localdomain\", \"labels\": [\"osd\", \"mds\", \"mgr\", \"mon\", \"_admin\"], \"status\": \"\"}, {\"addr\": \"192.168.122.107\", \"hostname\": \"np0005604213.localdomain\", \"labels\": [\"osd\", \"mds\", \"mgr\", \"mon\", \"_admin\"], \"status\": \"\"}, {\"addr\": \"192.168.122.108\", \"hostname\": \"np0005604215.localdomain\", \"labels\": [\"osd\", \"mds\", \"mgr\", \"mon\", \"_admin\"], \"status\": \"\"}]"]} TASK [ceph_migrate : Load nodes] *********************************************** ok: [np0005604209.localdomain] => {"ansible_facts": {"nds": [{"addr": "192.168.122.106", "hostname": "np0005604212.localdomain", "labels": ["osd", "mds", "mgr", "mon", "_admin"], "status": ""}, {"addr": "192.168.122.107", "hostname": "np0005604213.localdomain", "labels": ["osd", "mds", "mgr", "mon", "_admin"], "status": ""}, {"addr": "192.168.122.108", "hostname": "np0005604215.localdomain", "labels": ["osd", "mds", "mgr", "mon", "_admin"], "status": ""}]}, "changed": false} TASK [ceph_migrate : Load hostmap List] **************************************** ok: [np0005604209.localdomain] => {"ansible_facts": {"hostmap": {"np0005604212.localdomain": ["osd", "mds", "mgr", "mon", "_admin"], "np0005604213.localdomain": ["osd", "mds", "mgr", "mon", "_admin"], "np0005604215.localdomain": ["osd", "mds", "mgr", "mon", "_admin"]}}, "changed": false} TASK [ceph_migrate : Print Host Map] ******************************************* skipping: [np0005604209.localdomain] => (item=np0005604212.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005604212.localdomain"} skipping: [np0005604209.localdomain] => (item=np0005604213.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005604213.localdomain"} skipping: [np0005604209.localdomain] => (item=np0005604215.localdomain) => {"ansible_loop_var": "item", "false_condition": "debug | default(false)", "item": "np0005604215.localdomain"} skipping: [np0005604209.localdomain] => {"msg": "All items skipped"} TASK [ceph_migrate : Dump ceph orch host ls output to log file] **************** changed: [np0005604209.localdomain] => {"changed": true, "checksum": "58fd1947cb598167a4e6f877c3e4e15a53db749f", "dest": "/home/tripleo-admin/ceph_client/logs/ceph_orch_host_ls.log", "gid": 1003, "group": "tripleo-admin", "md5sum": "2964413eff26f8bd15f86f697d756345", "mode": "0644", "owner": "tripleo-admin", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 84, "src": "/home/tripleo-admin/.ansible/tmp/ansible-tmp-1769939351.15965-62275-276420595823020/source", "state": "file", "uid": 1003} TASK [ceph_migrate : Get Ceph monmap and load data] **************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["cephadm", "shell", "--", "ceph", "mon", "dump", "-f", "json"], "delta": "0:00:06.107896", "end": "2026-02-01 09:49:18.683180", "msg": "", "rc": 0, "start": "2026-02-01 09:49:12.575284", "stderr": "Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e\nInferring config /etc/ceph/ceph.conf\nUsing ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC\nregistry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4\ndumped monmap epoch 15", "stderr_lines": ["Inferring fsid 33fac0b9-80c7-560f-918a-c92d3021ca1e", "Inferring config /etc/ceph/ceph.conf", "Using ceph image with id 'f644374691eb' and tag 'latest' created on 2025-12-08 17:29:38 +0000 UTC", "registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:9805d289a25b976143f669c4fd0e8f239e0e75c2b4f55c3d517ee140cad1ccf4", "dumped monmap epoch 15"], "stdout": "\n{\"epoch\":15,\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"modified\":\"2026-02-01T09:47:50.388496Z\",\"created\":\"2026-02-01T07:37:52.883666Z\",\"min_mon_release\":18,\"min_mon_release_name\":\"reef\",\"election_strategy\":1,\"disallowed_leaders: \":\"\",\"stretch_mode\":false,\"tiebreaker_mon\":\"\",\"removed_ranks: \":\"\",\"features\":{\"persistent\":[\"kraken\",\"luminous\",\"mimic\",\"osdmap-prune\",\"nautilus\",\"octopus\",\"pacific\",\"elector-pinging\",\"quincy\",\"reef\"],\"optional\":[]},\"mons\":[{\"rank\":0,\"name\":\"np0005604212\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.103:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.103:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.103:6789/0\",\"public_addr\":\"172.18.0.103:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":1,\"name\":\"np0005604213\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.104:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.104:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.104:6789/0\",\"public_addr\":\"172.18.0.104:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":2,\"name\":\"np0005604215\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.105:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.105:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.105:6789/0\",\"public_addr\":\"172.18.0.105:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"}],\"quorum\":[0,1,2]}", "stdout_lines": ["", "{\"epoch\":15,\"fsid\":\"33fac0b9-80c7-560f-918a-c92d3021ca1e\",\"modified\":\"2026-02-01T09:47:50.388496Z\",\"created\":\"2026-02-01T07:37:52.883666Z\",\"min_mon_release\":18,\"min_mon_release_name\":\"reef\",\"election_strategy\":1,\"disallowed_leaders: \":\"\",\"stretch_mode\":false,\"tiebreaker_mon\":\"\",\"removed_ranks: \":\"\",\"features\":{\"persistent\":[\"kraken\",\"luminous\",\"mimic\",\"osdmap-prune\",\"nautilus\",\"octopus\",\"pacific\",\"elector-pinging\",\"quincy\",\"reef\"],\"optional\":[]},\"mons\":[{\"rank\":0,\"name\":\"np0005604212\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.103:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.103:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.103:6789/0\",\"public_addr\":\"172.18.0.103:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":1,\"name\":\"np0005604213\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.104:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.104:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.104:6789/0\",\"public_addr\":\"172.18.0.104:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"},{\"rank\":2,\"name\":\"np0005604215\",\"public_addrs\":{\"addrvec\":[{\"type\":\"v2\",\"addr\":\"172.18.0.105:3300\",\"nonce\":0},{\"type\":\"v1\",\"addr\":\"172.18.0.105:6789\",\"nonce\":0}]},\"addr\":\"172.18.0.105:6789/0\",\"public_addr\":\"172.18.0.105:6789/0\",\"priority\":0,\"weight\":0,\"crush_location\":\"{}\"}],\"quorum\":[0,1,2]}"]} TASK [ceph_migrate : Get Monmap] *********************************************** ok: [np0005604209.localdomain] => {"ansible_facts": {"mon_dump": {"created": "2026-02-01T07:37:52.883666Z", "disallowed_leaders: ": "", "election_strategy": 1, "epoch": 15, "features": {"optional": [], "persistent": ["kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef"]}, "fsid": "33fac0b9-80c7-560f-918a-c92d3021ca1e", "min_mon_release": 18, "min_mon_release_name": "reef", "modified": "2026-02-01T09:47:50.388496Z", "mons": [{"addr": "172.18.0.103:6789/0", "crush_location": "{}", "name": "np0005604212", "priority": 0, "public_addr": "172.18.0.103:6789/0", "public_addrs": {"addrvec": [{"addr": "172.18.0.103:3300", "nonce": 0, "type": "v2"}, {"addr": "172.18.0.103:6789", "nonce": 0, "type": "v1"}]}, "rank": 0, "weight": 0}, {"addr": "172.18.0.104:6789/0", "crush_location": "{}", "name": "np0005604213", "priority": 0, "public_addr": "172.18.0.104:6789/0", "public_addrs": {"addrvec": [{"addr": "172.18.0.104:3300", "nonce": 0, "type": "v2"}, {"addr": "172.18.0.104:6789", "nonce": 0, "type": "v1"}]}, "rank": 1, "weight": 0}, {"addr": "172.18.0.105:6789/0", "crush_location": "{}", "name": "np0005604215", "priority": 0, "public_addr": "172.18.0.105:6789/0", "public_addrs": {"addrvec": [{"addr": "172.18.0.105:3300", "nonce": 0, "type": "v2"}, {"addr": "172.18.0.105:6789", "nonce": 0, "type": "v1"}]}, "rank": 2, "weight": 0}], "quorum": [0, 1, 2], "removed_ranks: ": "", "stretch_mode": false, "tiebreaker_mon": ""}}, "changed": false} TASK [ceph_migrate : Print monmap] ********************************************* skipping: [np0005604209.localdomain] => {"false_condition": "debug | default(false)"} TASK [ceph_migrate : Dump ceph mon dump output to log file] ******************** changed: [np0005604209.localdomain] => {"changed": true, "checksum": "8305997fcd5f2dc79722e44a85e0f55f01557fc3", "dest": "/home/tripleo-admin/ceph_client/logs/ceph_mon_dump.log", "gid": 1003, "group": "tripleo-admin", "md5sum": "05fd73bae7ce86f82a88ca0d611c89cd", "mode": "0644", "owner": "tripleo-admin", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 1425, "src": "/home/tripleo-admin/.ansible/tmp/ansible-tmp-1769939358.9679477-62304-74456473835897/source", "state": "file", "uid": 1003} TASK [ceph_migrate : Load nodes to decommission] ******************************* ok: [np0005604209.localdomain] => {"ansible_facts": {"decomm_nodes": ["np0005604212.localdomain", "np0005604213.localdomain", "np0005604215.localdomain"]}, "changed": false} TASK [ceph_migrate : Load target nodes] **************************************** ok: [np0005604209.localdomain] => {"ansible_facts": {"target_nodes": ["np0005604212.localdomain", "np0005604213.localdomain", "np0005604215.localdomain"]}, "changed": false} TASK [ceph_migrate : Print target nodes] *************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug|default(false)"} TASK [ceph_migrate : Print decomm_nodes] *************************************** skipping: [np0005604209.localdomain] => {"false_condition": "debug|default(false)"} TASK [ceph_migrate : Configure Swift to use rgw backend] *********************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "ceph_daemons_layout.rgw | default(true) | bool", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Flush handlers to ensure mgr restart completes] *********** RUNNING HANDLER [ceph_migrate : restart mgr] *********************************** changed: [np0005604209.localdomain] => {"changed": true, "cmd": ["podman", "run", "--rm", "--net=host", "--ipc=host", "--volume", "/home/tripleo-admin/ceph_client:/etc/ceph:z", "--entrypoint", "ceph", "registry.redhat.io/rhceph/rhceph-7-rhel9:latest", "--fsid", "33fac0b9-80c7-560f-918a-c92d3021ca1e", "-c", "/etc/ceph/ceph.conf", "-k", "/etc/ceph/ceph.client.admin.keyring", "mgr", "fail"], "delta": "0:00:00.767531", "end": "2026-02-01 09:49:21.403090", "msg": "", "rc": 0, "start": "2026-02-01 09:49:20.635559", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [ceph_migrate : Install cephadm on all compute nodes] ********************* skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "groups['ComputeHCI'] is defined", "skip_reason": "Conditional result was False"} TASK [ceph_migrate : Force fail ceph mgr on first compute node] **************** skipping: [np0005604209.localdomain] => {"changed": false, "false_condition": "groups['ComputeHCI'] is defined", "skip_reason": "Conditional result was False"} PLAY RECAP ********************************************************************* np0005604209.localdomain : ok=247 changed=114 unreachable=0 failed=0 skipped=142 rescued=0 ignored=0