[WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (edpm_node_hostname). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (edpm_node_ip). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (source_galera_members). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (source_mariadb_ip). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (enable_tlse). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (neutron_qe_test). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (tobiko_qe_test). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (neutron_qe_dir). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (prelaunch_barbican_secret). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (os_cloud_name). Using last defined value only. [WARNING]: While constructing a mapping from /home/zuul/src/review.rdoproject.org/rdo- jobs/playbooks/data_plane_adoption/vars.yaml, line 6, column 1, found a duplicate dict key (standalone_ip). Using last defined value only. Using /home/zuul/src/review.rdoproject.org/rdo-jobs/playbooks/data_plane_adoption/ansible.cfg as config file PLAY [Swift migration] ********************************************************* TASK [swift_migration : Get list of current Swift storage node IPs] ************ changed: [localhost] => {"ansible_facts": {"discovered_interpreter_python": "/usr/bin/python3"}, "changed": true, "cmd": "\noc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c 'swift-ring-tool get > /dev/null 2>&1 ; swift-ring-builder object.builder search _ | tail -n +2 | awk \"{print \\$4}\" | sort -u'\n", "delta": "0:00:03.968419", "end": "2025-10-01 10:04:37.648146", "msg": "", "rc": 0, "start": "2025-10-01 10:04:33.679727", "stderr": "Starting pod/swift-ring-rebalance-debug-9xxdk, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...", "stderr_lines": ["Starting pod/swift-ring-rebalance-debug-9xxdk, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ..."], "stdout": "172.20.0.103\n172.20.0.104\n172.20.0.105", "stdout_lines": ["172.20.0.103", "172.20.0.104", "172.20.0.105"]} TASK [swift_migration : setup nameserver on standalone node] ******************* changed: [localhost] => {"changed": true, "cmd": "set -euxo pipefail\n\n\nCONTROLLER1_SSH=\"ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103\"\necho \"nameserver $(oc get service dnsmasq-dns -o jsonpath='{.status.loadBalancer.ingress[0].ip}')\" | $CONTROLLER1_SSH tee /etc/resolv.conf\n", "delta": "0:00:00.605865", "end": "2025-10-01 10:04:38.530333", "msg": "", "rc": 0, "start": "2025-10-01 10:04:37.924468", "stderr": "+ CONTROLLER1_SSH='ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103'\n+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 tee /etc/resolv.conf\n++ oc get service dnsmasq-dns -o 'jsonpath={.status.loadBalancer.ingress[0].ip}'\n+ echo 'nameserver 192.168.122.80'", "stderr_lines": ["+ CONTROLLER1_SSH='ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103'", "+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 tee /etc/resolv.conf", "++ oc get service dnsmasq-dns -o 'jsonpath={.status.loadBalancer.ingress[0].ip}'", "+ echo 'nameserver 192.168.122.80'"], "stdout": "nameserver 192.168.122.80", "stdout_lines": ["nameserver 192.168.122.80"]} TASK [swift_migration : run swift-dispersion-populate] ************************* changed: [localhost] => {"changed": true, "cmd": "\noc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c 'swift-ring-tool get && swift-dispersion-populate'\n", "delta": "0:00:29.521922", "end": "2025-10-01 10:05:08.384020", "msg": "", "rc": 0, "start": "2025-10-01 10:04:38.862098", "stderr": "Starting pod/swift-ring-rebalance-debug-28njj, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...", "stderr_lines": ["Starting pod/swift-ring-rebalance-debug-28njj, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ..."], "stdout": "Total bytes read: 81920 (80KiB, 31MiB/s)\nUsing storage policy: Policy-0 \n\r\u001b[KCreating containers: 157 of 1024, 11s left, 0 retries\r\u001b[KCreating containers: 557 of 1024, 6s left, 0 retries\r\u001b[KCreating containers: 996 of 1024, 0s left, 0 retries\r\u001b[KCreated 1024 containers for dispersion reporting, 12s, 0 retries\n\r\u001b[KCreating objects: 172 of 1024, 10s left, 0 retries\r\u001b[KCreating objects: 609 of 1024, 5s left, 0 retries\r\u001b[KCreated 1024 objects for dispersion reporting, 12s, 0 retries", "stdout_lines": ["Total bytes read: 81920 (80KiB, 31MiB/s)", "Using storage policy: Policy-0 ", "", "\u001b[KCreating containers: 157 of 1024, 11s left, 0 retries", "\u001b[KCreating containers: 557 of 1024, 6s left, 0 retries", "\u001b[KCreating containers: 996 of 1024, 0s left, 0 retries", "\u001b[KCreated 1024 containers for dispersion reporting, 12s, 0 retries", "", "\u001b[KCreating objects: 172 of 1024, 10s left, 0 retries", "\u001b[KCreating objects: 609 of 1024, 5s left, 0 retries", "\u001b[KCreated 1024 objects for dispersion reporting, 12s, 0 retries"]} TASK [swift_migration : start swift-storage instances] ************************* changed: [localhost] => {"changed": true, "cmd": "\noc patch openstackcontrolplane openstack --type=merge -p='{\"spec\":{\"swift\":{\"template\":{\"swiftStorage\":{\"replicas\": 3}}}}}'\n", "delta": "0:00:00.261290", "end": "2025-10-01 10:05:08.922662", "msg": "", "rc": 0, "start": "2025-10-01 10:05:08.661372", "stderr": "", "stderr_lines": [], "stdout": "openstackcontrolplane.core.openstack.org/openstack patched", "stdout_lines": ["openstackcontrolplane.core.openstack.org/openstack patched"]} TASK [swift_migration : wait until all pods are ready] ************************* FAILED - RETRYING: [localhost]: wait until all pods are ready (60 retries left). changed: [localhost] => {"attempts": 2, "changed": true, "cmd": "\noc wait pods --for condition=Ready --timeout=60s -l component=swift-storage\n", "delta": "0:00:10.874809", "end": "2025-10-01 10:05:22.461431", "msg": "", "rc": 0, "start": "2025-10-01 10:05:11.586622", "stderr": "", "stderr_lines": [], "stdout": "pod/swift-storage-0 condition met\npod/swift-storage-1 condition met\npod/swift-storage-2 condition met", "stdout_lines": ["pod/swift-storage-0 condition met", "pod/swift-storage-1 condition met", "pod/swift-storage-2 condition met"]} TASK [swift_migration : wait until ring configmap includes new pv devices] ***** changed: [localhost] => {"changed": true, "cmd": "\ntimeout 900s bash -c 'until oc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c \"swift-ring-tool get && swift-ring-builder object.builder search --device pv\" ; do sleep 60; done'\n", "delta": "0:01:04.402627", "end": "2025-10-01 10:06:27.122757", "msg": "", "rc": 0, "start": "2025-10-01 10:05:22.720130", "stderr": "Starting pod/swift-ring-rebalance-debug-gd4vx, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...\nerror: non-zero exit code from debug container\nStarting pod/swift-ring-rebalance-debug-2znrg, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...", "stderr_lines": ["Starting pod/swift-ring-rebalance-debug-gd4vx, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ...", "error: non-zero exit code from debug container", "Starting pod/swift-ring-rebalance-debug-2znrg, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ..."], "stdout": "Total bytes read: 81920 (80KiB, 52MiB/s)\nNo matching devices found\nTotal bytes read: 122880 (120KiB, 47MiB/s)\nDevices: id region zone ip address port replication ip replication port name weight partitions balance meta\n 3 1 1 swift-storage-0.swift-storage.openstack.svc 6200 swift-storage-0.swift-storage.openstack.svc 6200 pv 84.00 342 -26.84 crc\n 4 1 1 swift-storage-1.swift-storage.openstack.svc 6200 swift-storage-1.swift-storage.openstack.svc 6200 pv 84.00 341 -27.06 crc\n 5 1 1 swift-storage-2.swift-storage.openstack.svc 6200 swift-storage-2.swift-storage.openstack.svc 6200 pv 84.00 341 -27.06 crc", "stdout_lines": ["Total bytes read: 81920 (80KiB, 52MiB/s)", "No matching devices found", "Total bytes read: 122880 (120KiB, 47MiB/s)", "Devices: id region zone ip address port replication ip replication port name weight partitions balance meta", " 3 1 1 swift-storage-0.swift-storage.openstack.svc 6200 swift-storage-0.swift-storage.openstack.svc 6200 pv 84.00 342 -26.84 crc", " 4 1 1 swift-storage-1.swift-storage.openstack.svc 6200 swift-storage-1.swift-storage.openstack.svc 6200 pv 84.00 341 -27.06 crc", " 5 1 1 swift-storage-2.swift-storage.openstack.svc 6200 swift-storage-2.swift-storage.openstack.svc 6200 pv 84.00 341 -27.06 crc"]} TASK [swift_migration : set standalone node weight to 0 in swift rings] ******** changed: [localhost] => {"changed": true, "cmd": "\noc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c '\nswift-ring-tool get\nwhile read -r node; do\n swift-ring-tool drain ${node}\ndone <<< \"172.20.0.103\n172.20.0.104\n172.20.0.105\"\nswift-ring-tool forced_rebalance\nswift-ring-tool push'\n", "delta": "0:00:11.626384", "end": "2025-10-01 10:06:38.998797", "msg": "", "rc": 0, "start": "2025-10-01 10:06:27.372413", "stderr": "Starting pod/swift-ring-rebalance-debug-sn8dr, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...", "stderr_lines": ["Starting pod/swift-ring-rebalance-debug-sn8dr, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ..."], "stdout": "Total bytes read: 122880 (120KiB, 78MiB/s)\nd0r1z1-172.20.0.103:6002R172.20.0.103:6002/d1_\"\" weight set to 0.0\nd0r1z1-172.20.0.103:6001R172.20.0.103:6001/d1_\"\" weight set to 0.0\nd0r1z1-172.20.0.103:6000R172.20.0.103:6000/d1_\"\" weight set to 0.0\nd1r1z1-172.20.0.104:6002R172.20.0.104:6002/d1_\"\" weight set to 0.0\nd1r1z1-172.20.0.104:6001R172.20.0.104:6001/d1_\"\" weight set to 0.0\nd1r1z1-172.20.0.104:6000R172.20.0.104:6000/d1_\"\" weight set to 0.0\nd2r1z1-172.20.0.105:6002R172.20.0.105:6002/d1_\"\" weight set to 0.0\nd2r1z1-172.20.0.105:6001R172.20.0.105:6001/d1_\"\" weight set to 0.0\nd2r1z1-172.20.0.105:6000R172.20.0.105:6000/d1_\"\" weight set to 0.0\nReassigned 1024 (100.00%) partitions. Balance is now 999.99. Dispersion is now 33.33\n-------------------------------------------------------------------------------\nNOTE: Dispersion of 33.333333 indicates some parts are not\n optimally dispersed.\n\n You may want to adjust some device weights, increase\n the overload or review the dispersion report.\n-------------------------------------------------------------------------------\nReassigned 1024 (100.00%) partitions. Balance is now 999.99. Dispersion is now 33.33\n-------------------------------------------------------------------------------\nNOTE: Dispersion of 33.333333 indicates some parts are not\n optimally dispersed.\n\n You may want to adjust some device weights, increase\n the overload or review the dispersion report.\n-------------------------------------------------------------------------------\nReassigned 1024 (100.00%) partitions. Balance is now 999.99. Dispersion is now 33.33\n-------------------------------------------------------------------------------\nNOTE: Dispersion of 33.333333 indicates some parts are not\n optimally dispersed.\n\n You may want to adjust some device weights, increase\n the overload or review the dispersion report.\n-------------------------------------------------------------------------------\nTotal bytes written: 153600 (150KiB, 15MiB/s)", "stdout_lines": ["Total bytes read: 122880 (120KiB, 78MiB/s)", "d0r1z1-172.20.0.103:6002R172.20.0.103:6002/d1_\"\" weight set to 0.0", "d0r1z1-172.20.0.103:6001R172.20.0.103:6001/d1_\"\" weight set to 0.0", "d0r1z1-172.20.0.103:6000R172.20.0.103:6000/d1_\"\" weight set to 0.0", "d1r1z1-172.20.0.104:6002R172.20.0.104:6002/d1_\"\" weight set to 0.0", "d1r1z1-172.20.0.104:6001R172.20.0.104:6001/d1_\"\" weight set to 0.0", "d1r1z1-172.20.0.104:6000R172.20.0.104:6000/d1_\"\" weight set to 0.0", "d2r1z1-172.20.0.105:6002R172.20.0.105:6002/d1_\"\" weight set to 0.0", "d2r1z1-172.20.0.105:6001R172.20.0.105:6001/d1_\"\" weight set to 0.0", "d2r1z1-172.20.0.105:6000R172.20.0.105:6000/d1_\"\" weight set to 0.0", "Reassigned 1024 (100.00%) partitions. Balance is now 999.99. Dispersion is now 33.33", "-------------------------------------------------------------------------------", "NOTE: Dispersion of 33.333333 indicates some parts are not", " optimally dispersed.", "", " You may want to adjust some device weights, increase", " the overload or review the dispersion report.", "-------------------------------------------------------------------------------", "Reassigned 1024 (100.00%) partitions. Balance is now 999.99. Dispersion is now 33.33", "-------------------------------------------------------------------------------", "NOTE: Dispersion of 33.333333 indicates some parts are not", " optimally dispersed.", "", " You may want to adjust some device weights, increase", " the overload or review the dispersion report.", "-------------------------------------------------------------------------------", "Reassigned 1024 (100.00%) partitions. Balance is now 999.99. Dispersion is now 33.33", "-------------------------------------------------------------------------------", "NOTE: Dispersion of 33.333333 indicates some parts are not", " optimally dispersed.", "", " You may want to adjust some device weights, increase", " the overload or review the dispersion report.", "-------------------------------------------------------------------------------", "Total bytes written: 153600 (150KiB, 15MiB/s)"]} TASK [swift_migration : push rings to standalone and restart swift services] *** changed: [localhost] => {"changed": true, "cmd": "set -euxo pipefail\n\n\nCONTROLLER1_SSH=\"ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103\"\noc extract --confirm cm/swift-ring-files\n$CONTROLLER1_SSH \"tar -C /var/lib/config-data/puppet-generated/swift/etc/swift/ -xzf -\" < swiftrings.tar.gz\n$CONTROLLER1_SSH \"systemctl restart tripleo_swift_*\"\n", "delta": "0:00:03.070519", "end": "2025-10-01 10:06:42.308619", "msg": "", "rc": 0, "start": "2025-10-01 10:06:39.238100", "stderr": "+ CONTROLLER1_SSH='ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103'\n+ oc extract --confirm cm/swift-ring-files\n+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 'tar -C /var/lib/config-data/puppet-generated/swift/etc/swift/ -xzf -'\n+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 'systemctl restart tripleo_swift_*'", "stderr_lines": ["+ CONTROLLER1_SSH='ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103'", "+ oc extract --confirm cm/swift-ring-files", "+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 'tar -C /var/lib/config-data/puppet-generated/swift/etc/swift/ -xzf -'", "+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 'systemctl restart tripleo_swift_*'"], "stdout": "account.ring.gz\ncontainer.ring.gz\nobject.ring.gz\nswiftrings.tar.gz", "stdout_lines": ["account.ring.gz", "container.ring.gz", "object.ring.gz", "swiftrings.tar.gz"]} TASK [swift_migration : wait until all replicas are 100% available after first rebalance] *** changed: [localhost] => {"changed": true, "cmd": "\ntimeout 900s bash -c 'until oc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c \"swift-ring-tool get && swift-dispersion-report\" | grep -q \"100.00% of object copies found\" ; do sleep 60; done'\n", "delta": "0:08:43.787858", "end": "2025-10-01 10:15:26.322289", "msg": "", "rc": 0, "start": "2025-10-01 10:06:42.534431", "stderr": "Starting pod/swift-ring-rebalance-debug-sdkcr, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...\nStarting pod/swift-ring-rebalance-debug-zf64d, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...\nStarting pod/swift-ring-rebalance-debug-rjdr8, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...\nStarting pod/swift-ring-rebalance-debug-tjjn2, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...\nStarting pod/swift-ring-rebalance-debug-9n7fg, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...\nStarting pod/swift-ring-rebalance-debug-xrqx7, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...\nStarting pod/swift-ring-rebalance-debug-sk5cn, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...\nStarting pod/swift-ring-rebalance-debug-lkpbl, command was: /usr/local/bin/swift-ring-tool all", "stderr_lines": ["Starting pod/swift-ring-rebalance-debug-sdkcr, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ...", "Starting pod/swift-ring-rebalance-debug-zf64d, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ...", "Starting pod/swift-ring-rebalance-debug-rjdr8, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ...", "Starting pod/swift-ring-rebalance-debug-tjjn2, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ...", "Starting pod/swift-ring-rebalance-debug-9n7fg, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ...", "Starting pod/swift-ring-rebalance-debug-xrqx7, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ...", "Starting pod/swift-ring-rebalance-debug-sk5cn, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ...", "Starting pod/swift-ring-rebalance-debug-lkpbl, command was: /usr/local/bin/swift-ring-tool all"], "stdout": "", "stdout_lines": []} TASK [swift_migration : rebalance rings second time] *************************** changed: [localhost] => {"changed": true, "cmd": "\noc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c '\nswift-ring-tool get\nswift-ring-tool forced_rebalance\nswift-ring-tool push'\n", "delta": "0:00:10.404546", "end": "2025-10-01 10:15:37.008085", "msg": "", "rc": 0, "start": "2025-10-01 10:15:26.603539", "stderr": "Starting pod/swift-ring-rebalance-debug-4p46l, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...", "stderr_lines": ["Starting pod/swift-ring-rebalance-debug-4p46l, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ..."], "stdout": "Total bytes read: 153600 (150KiB, 57MiB/s)\nReassigned 1024 (100.00%) partitions. Balance is now 0.00. Dispersion is now 0.00\nReassigned 1024 (100.00%) partitions. Balance is now 0.00. Dispersion is now 0.00\nReassigned 1024 (100.00%) partitions. Balance is now 0.00. Dispersion is now 0.00\nTotal bytes written: 184320 (180KiB, 26MiB/s)", "stdout_lines": ["Total bytes read: 153600 (150KiB, 57MiB/s)", "Reassigned 1024 (100.00%) partitions. Balance is now 0.00. Dispersion is now 0.00", "Reassigned 1024 (100.00%) partitions. Balance is now 0.00. Dispersion is now 0.00", "Reassigned 1024 (100.00%) partitions. Balance is now 0.00. Dispersion is now 0.00", "Total bytes written: 184320 (180KiB, 26MiB/s)"]} TASK [swift_migration : push rings to standalone and restart swift services] *** changed: [localhost] => {"changed": true, "cmd": "set -euxo pipefail\n\n\nCONTROLLER1_SSH=\"ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103\"\noc extract --confirm cm/swift-ring-files\n$CONTROLLER1_SSH \"tar -C /var/lib/config-data/puppet-generated/swift/etc/swift/ -xzf -\" < swiftrings.tar.gz\n$CONTROLLER1_SSH \"systemctl restart tripleo_swift_*\"\n", "delta": "0:00:03.211864", "end": "2025-10-01 10:15:40.477504", "msg": "", "rc": 0, "start": "2025-10-01 10:15:37.265640", "stderr": "+ CONTROLLER1_SSH='ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103'\n+ oc extract --confirm cm/swift-ring-files\n+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 'tar -C /var/lib/config-data/puppet-generated/swift/etc/swift/ -xzf -'\n+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 'systemctl restart tripleo_swift_*'", "stderr_lines": ["+ CONTROLLER1_SSH='ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103'", "+ oc extract --confirm cm/swift-ring-files", "+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 'tar -C /var/lib/config-data/puppet-generated/swift/etc/swift/ -xzf -'", "+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 'systemctl restart tripleo_swift_*'"], "stdout": "object.ring.gz\nswiftrings.tar.gz\naccount.ring.gz\ncontainer.ring.gz", "stdout_lines": ["object.ring.gz", "swiftrings.tar.gz", "account.ring.gz", "container.ring.gz"]} TASK [swift_migration : wait until all replicas are 100% available after second rebalance] *** changed: [localhost] => {"changed": true, "cmd": "\ntimeout 900s bash -c 'until oc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c \"swift-ring-tool get && swift-dispersion-report\" | grep -q \"100.00% of object copies found\" ; do sleep 60; done'\n", "delta": "0:02:45.602684", "end": "2025-10-01 10:18:26.416433", "msg": "", "rc": 0, "start": "2025-10-01 10:15:40.813749", "stderr": "Starting pod/swift-ring-rebalance-debug-cvsn8, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...\nStarting pod/swift-ring-rebalance-debug-xxn92, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...\nStarting pod/swift-ring-rebalance-debug-p7vsb, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...", "stderr_lines": ["Starting pod/swift-ring-rebalance-debug-cvsn8, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ...", "Starting pod/swift-ring-rebalance-debug-xxn92, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ...", "Starting pod/swift-ring-rebalance-debug-p7vsb, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ..."], "stdout": "", "stdout_lines": []} TASK [swift_migration : rebalance rings third time] **************************** changed: [localhost] => {"changed": true, "cmd": "\noc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c '\nswift-ring-tool get\nswift-ring-tool forced_rebalance\nswift-ring-tool push'\n", "delta": "0:00:09.441072", "end": "2025-10-01 10:18:36.124944", "msg": "", "rc": 0, "start": "2025-10-01 10:18:26.683872", "stderr": "Starting pod/swift-ring-rebalance-debug-kcdr2, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...", "stderr_lines": ["Starting pod/swift-ring-rebalance-debug-kcdr2, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ..."], "stdout": "Total bytes read: 184320 (180KiB, 29MiB/s)\nNo partitions could be reassigned.\nThere is no need to do so at this time\nNo partitions could be reassigned.\nThere is no need to do so at this time\nNo partitions could be reassigned.\nThere is no need to do so at this time\nTotal bytes written: 184320 (180KiB, 15MiB/s)", "stdout_lines": ["Total bytes read: 184320 (180KiB, 29MiB/s)", "No partitions could be reassigned.", "There is no need to do so at this time", "No partitions could be reassigned.", "There is no need to do so at this time", "No partitions could be reassigned.", "There is no need to do so at this time", "Total bytes written: 184320 (180KiB, 15MiB/s)"]} TASK [swift_migration : push rings to standalone and restart swift services] *** changed: [localhost] => {"changed": true, "cmd": "set -euxo pipefail\n\n\nCONTROLLER1_SSH=\"ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103\"\noc extract --confirm cm/swift-ring-files\n$CONTROLLER1_SSH \"tar -C /var/lib/config-data/puppet-generated/swift/etc/swift/ -xzf -\" < swiftrings.tar.gz\n$CONTROLLER1_SSH \"systemctl restart tripleo_swift_*\"\n", "delta": "0:00:03.082242", "end": "2025-10-01 10:18:39.483912", "msg": "", "rc": 0, "start": "2025-10-01 10:18:36.401670", "stderr": "+ CONTROLLER1_SSH='ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103'\n+ oc extract --confirm cm/swift-ring-files\n+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 'tar -C /var/lib/config-data/puppet-generated/swift/etc/swift/ -xzf -'\n+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 'systemctl restart tripleo_swift_*'", "stderr_lines": ["+ CONTROLLER1_SSH='ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103'", "+ oc extract --confirm cm/swift-ring-files", "+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 'tar -C /var/lib/config-data/puppet-generated/swift/etc/swift/ -xzf -'", "+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 'systemctl restart tripleo_swift_*'"], "stdout": "object.ring.gz\nswiftrings.tar.gz\naccount.ring.gz\ncontainer.ring.gz", "stdout_lines": ["object.ring.gz", "swiftrings.tar.gz", "account.ring.gz", "container.ring.gz"]} TASK [swift_migration : wait until all replicas are 100% available after third rebalance] *** changed: [localhost] => {"changed": true, "cmd": "\ntimeout 900s bash -c 'until oc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c \"swift-ring-tool get && swift-dispersion-report\" | grep -q \"100.00% of object copies found\" ; do sleep 60; done'\n", "delta": "0:00:17.034597", "end": "2025-10-01 10:18:56.835283", "msg": "", "rc": 0, "start": "2025-10-01 10:18:39.800686", "stderr": "Starting pod/swift-ring-rebalance-debug-6pmtw, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...", "stderr_lines": ["Starting pod/swift-ring-rebalance-debug-6pmtw, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ..."], "stdout": "", "stdout_lines": []} TASK [swift_migration : wait until /srv/node on standalone is drained] ********* changed: [localhost] => {"changed": true, "cmd": "set -euxo pipefail\n\nCONTROLLER1_SSH=\"ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103\"\n$CONTROLLER1_SSH \"timeout 900s bash -c 'while \\$(find /srv/node/ -type f -name \\\"*.db\\\" -o -name \\\"*.data\\\" | grep -q \\\".\\\"); do sleep 5; done'\"\n", "delta": "0:03:06.233833", "end": "2025-10-01 10:22:03.338538", "msg": "", "rc": 0, "start": "2025-10-01 10:18:57.104705", "stderr": "+ CONTROLLER1_SSH='ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103'\n+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 'timeout 900s bash -c '\\''while $(find /srv/node/ -type f -name \"*.db\" -o -name \"*.data\" | grep -q \".\"); do sleep 5; done'\\'''\nfind: ‘/srv/node/d1/objects/331’: No such file or directory", "stderr_lines": ["+ CONTROLLER1_SSH='ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103'", "+ ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103 'timeout 900s bash -c '\\''while $(find /srv/node/ -type f -name \"*.db\" -o -name \"*.data\" | grep -q \".\"); do sleep 5; done'\\'''", "find: ‘/srv/node/d1/objects/331’: No such file or directory"], "stdout": "", "stdout_lines": []} TASK [swift_migration : remove standalone node from rings] ********************* changed: [localhost] => {"changed": true, "cmd": "set -euxo pipefail\n\n\nCONTROLLER1_SSH=\"ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103\"\noc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c '\nswift-ring-tool get\nwhile read -r node; do\n swift-ring-tool drain ${node}\ndone <<< \"172.20.0.103\n172.20.0.104\n172.20.0.105\"\nswift-ring-tool rebalance\nswift-ring-tool push'\n", "delta": "0:00:11.996625", "end": "2025-10-01 10:22:15.626924", "msg": "", "rc": 0, "start": "2025-10-01 10:22:03.630299", "stderr": "+ CONTROLLER1_SSH='ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103'\n+ oc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c '\nswift-ring-tool get\nwhile read -r node; do\n swift-ring-tool drain ${node}\ndone <<< \"172.20.0.103\n172.20.0.104\n172.20.0.105\"\nswift-ring-tool rebalance\nswift-ring-tool push'\nStarting pod/swift-ring-rebalance-debug-g5758, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...", "stderr_lines": ["+ CONTROLLER1_SSH='ssh -o StrictHostKeyChecking=accept-new -i /home/zuul/.ssh/id_rsa root@192.168.122.103'", "+ oc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c '", "swift-ring-tool get", "while read -r node; do", " swift-ring-tool drain ${node}", "done <<< \"172.20.0.103", "172.20.0.104", "172.20.0.105\"", "swift-ring-tool rebalance", "swift-ring-tool push'", "Starting pod/swift-ring-rebalance-debug-g5758, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ..."], "stdout": "Total bytes read: 184320 (180KiB, 50MiB/s)\nd0r1z1-172.20.0.103:6002R172.20.0.103:6002/d1_\"\" weight set to 0.0\nd0r1z1-172.20.0.103:6001R172.20.0.103:6001/d1_\"\" weight set to 0.0\nd0r1z1-172.20.0.103:6000R172.20.0.103:6000/d1_\"\" weight set to 0.0\nd1r1z1-172.20.0.104:6002R172.20.0.104:6002/d1_\"\" weight set to 0.0\nd1r1z1-172.20.0.104:6001R172.20.0.104:6001/d1_\"\" weight set to 0.0\nd1r1z1-172.20.0.104:6000R172.20.0.104:6000/d1_\"\" weight set to 0.0\nd2r1z1-172.20.0.105:6002R172.20.0.105:6002/d1_\"\" weight set to 0.0\nd2r1z1-172.20.0.105:6001R172.20.0.105:6001/d1_\"\" weight set to 0.0\nd2r1z1-172.20.0.105:6000R172.20.0.105:6000/d1_\"\" weight set to 0.0\nNo partitions could be reassigned.\nThere is no need to do so at this time\nNo partitions could be reassigned.\nThere is no need to do so at this time\nNo partitions could be reassigned.\nThere is no need to do so at this time\nTotal bytes written: 184320 (180KiB, 26MiB/s)", "stdout_lines": ["Total bytes read: 184320 (180KiB, 50MiB/s)", "d0r1z1-172.20.0.103:6002R172.20.0.103:6002/d1_\"\" weight set to 0.0", "d0r1z1-172.20.0.103:6001R172.20.0.103:6001/d1_\"\" weight set to 0.0", "d0r1z1-172.20.0.103:6000R172.20.0.103:6000/d1_\"\" weight set to 0.0", "d1r1z1-172.20.0.104:6002R172.20.0.104:6002/d1_\"\" weight set to 0.0", "d1r1z1-172.20.0.104:6001R172.20.0.104:6001/d1_\"\" weight set to 0.0", "d1r1z1-172.20.0.104:6000R172.20.0.104:6000/d1_\"\" weight set to 0.0", "d2r1z1-172.20.0.105:6002R172.20.0.105:6002/d1_\"\" weight set to 0.0", "d2r1z1-172.20.0.105:6001R172.20.0.105:6001/d1_\"\" weight set to 0.0", "d2r1z1-172.20.0.105:6000R172.20.0.105:6000/d1_\"\" weight set to 0.0", "No partitions could be reassigned.", "There is no need to do so at this time", "No partitions could be reassigned.", "There is no need to do so at this time", "No partitions could be reassigned.", "There is no need to do so at this time", "Total bytes written: 184320 (180KiB, 26MiB/s)"]} PLAY RECAP ********************************************************************* localhost : ok=17 changed=17 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0