2025-10-11 20:18:40.044962 | Job console starting... 2025-10-11 20:18:40.061553 | Updating repositories 2025-10-11 20:18:40.091642 | Preparing job workspace 2025-10-11 20:18:45.576001 | Running Ansible setup... 2025-10-11 20:18:49.724841 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-10-11 20:18:50.337223 | 2025-10-11 20:18:50.337355 | PLAY [localhost] 2025-10-11 20:18:50.346918 | 2025-10-11 20:18:50.347052 | TASK [Gathering Facts] 2025-10-11 20:18:51.332936 | localhost | ok 2025-10-11 20:18:51.362173 | 2025-10-11 20:18:51.362405 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2025-10-11 20:18:51.828687 | localhost -> localhost | changed 2025-10-11 20:18:51.839872 | 2025-10-11 20:18:51.840079 | TASK [log-inventory : Copy ansible inventory to logs dir] 2025-10-11 20:18:52.803107 | localhost -> localhost | changed 2025-10-11 20:18:52.816206 | 2025-10-11 20:18:52.816351 | TASK [Setup log path fact] 2025-10-11 20:18:52.838128 | localhost | ok 2025-10-11 20:18:52.855219 | 2025-10-11 20:18:52.855321 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-10-11 20:18:52.885854 | localhost | ok 2025-10-11 20:18:52.897517 | 2025-10-11 20:18:52.897606 | TASK [emit-job-header : Print job information] 2025-10-11 20:18:52.928227 | # Job Information 2025-10-11 20:18:52.928376 | Ansible Version: 2.15.12 2025-10-11 20:18:52.928412 | Job: vexxhost-hotstack-secret-rotate 2025-10-11 20:18:52.928439 | Pipeline: github-experimental-trigger 2025-10-11 20:18:52.928471 | Executor: ze01.softwarefactory-project.io 2025-10-11 20:18:52.928506 | Triggered by: https://github.com/openstack-k8s-operators/hotstack/pull/256 2025-10-11 20:18:52.928537 | Log URL (when completed): https://logserver.rdoproject.org/c8e/rdoproject.org/c8eea6111faf4495bb5a4d8fda95714a/ 2025-10-11 20:18:52.928562 | Event ID: ca2f3f90-a6de-11f0-850b-9890ad4db396 2025-10-11 20:18:52.933659 | 2025-10-11 20:18:52.933753 | LOOP [emit-job-header : Print node information] 2025-10-11 20:18:53.026913 | localhost | ok: 2025-10-11 20:18:53.027244 | localhost | # Node Information 2025-10-11 20:18:53.027307 | localhost | Inventory Hostname: hotstack 2025-10-11 20:18:53.027355 | localhost | Hostname: np0005481320 2025-10-11 20:18:53.027397 | localhost | Username: zuul 2025-10-11 20:18:53.027440 | localhost | Distro: CentOS 9 2025-10-11 20:18:53.027478 | localhost | Provider: vexxhost-nodepool-tripleo 2025-10-11 20:18:53.027514 | localhost | Region: RegionOne 2025-10-11 20:18:53.027550 | localhost | Label: cloud-centos-9-stream-tripleo-vexxhost 2025-10-11 20:18:53.027585 | localhost | Product Name: OpenStack Nova 2025-10-11 20:18:53.027620 | localhost | Interface IP: 38.102.83.110 2025-10-11 20:18:53.062007 | 2025-10-11 20:18:53.062136 | PLAY [all] 2025-10-11 20:18:53.070905 | 2025-10-11 20:18:53.070983 | TASK [Gather network facts] 2025-10-11 20:18:53.607947 | hotstack | ok 2025-10-11 20:18:53.643960 | 2025-10-11 20:18:53.644153 | TASK [include_role : start-zuul-console] 2025-10-11 20:18:53.667785 | hotstack | ok 2025-10-11 20:18:53.683472 | 2025-10-11 20:18:53.683553 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-10-11 20:18:54.127548 | hotstack | ok 2025-10-11 20:18:54.146786 | 2025-10-11 20:18:54.146946 | TASK [include_role : add-build-sshkey] 2025-10-11 20:18:54.183748 | hotstack | ok 2025-10-11 20:18:54.210867 | 2025-10-11 20:18:54.210995 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2025-10-11 20:18:54.480891 | hotstack -> localhost | ok 2025-10-11 20:18:54.492829 | 2025-10-11 20:18:54.492960 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2025-10-11 20:18:54.533167 | hotstack | ok 2025-10-11 20:18:54.559248 | hotstack | included: /var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2025-10-11 20:18:54.567572 | 2025-10-11 20:18:54.567662 | TASK [add-build-sshkey : Create Temp SSH key] 2025-10-11 20:18:55.480648 | hotstack -> localhost | Generating public/private rsa key pair. 2025-10-11 20:18:55.481098 | hotstack -> localhost | Your identification has been saved in /var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/work/c8eea6111faf4495bb5a4d8fda95714a_id_rsa. 2025-10-11 20:18:55.481175 | hotstack -> localhost | Your public key has been saved in /var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/work/c8eea6111faf4495bb5a4d8fda95714a_id_rsa.pub. 2025-10-11 20:18:55.481223 | hotstack -> localhost | The key fingerprint is: 2025-10-11 20:18:55.481265 | hotstack -> localhost | SHA256:QOEHBTl58GwB47sQhnjXspkL2P9QcQW/cx1m4/XCy4c zuul-build-sshkey 2025-10-11 20:18:55.481309 | hotstack -> localhost | The key's randomart image is: 2025-10-11 20:18:55.481349 | hotstack -> localhost | +---[RSA 3072]----+ 2025-10-11 20:18:55.481387 | hotstack -> localhost | | OO+.. | 2025-10-11 20:18:55.481428 | hotstack -> localhost | | . . =+=.+ | 2025-10-11 20:18:55.481467 | hotstack -> localhost | |. o = *o* . = .| 2025-10-11 20:18:55.481506 | hotstack -> localhost | | + o * B . * +.| 2025-10-11 20:18:55.481546 | hotstack -> localhost | |. o = o S o . = .| 2025-10-11 20:18:55.481584 | hotstack -> localhost | | o + . o . + | 2025-10-11 20:18:55.481621 | hotstack -> localhost | | + . E .| 2025-10-11 20:18:55.481663 | hotstack -> localhost | | o . | 2025-10-11 20:18:55.481700 | hotstack -> localhost | | . | 2025-10-11 20:18:55.481738 | hotstack -> localhost | +----[SHA256]-----+ 2025-10-11 20:18:55.481836 | hotstack -> localhost | ok: Runtime: 0:00:00.435742 2025-10-11 20:18:55.493799 | 2025-10-11 20:18:55.493934 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2025-10-11 20:18:55.530728 | hotstack | ok 2025-10-11 20:18:55.551153 | hotstack | included: /var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2025-10-11 20:18:55.565287 | 2025-10-11 20:18:55.565373 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2025-10-11 20:18:55.590208 | hotstack | skipping: Conditional result was False 2025-10-11 20:18:55.598037 | 2025-10-11 20:18:55.598118 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2025-10-11 20:18:56.065222 | hotstack | changed 2025-10-11 20:18:56.072689 | 2025-10-11 20:18:56.072806 | TASK [add-build-sshkey : Make sure user has a .ssh] 2025-10-11 20:18:56.357471 | hotstack | ok 2025-10-11 20:18:56.364158 | 2025-10-11 20:18:56.364235 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2025-10-11 20:18:57.375824 | hotstack | changed 2025-10-11 20:18:57.387936 | 2025-10-11 20:18:57.388096 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2025-10-11 20:18:58.351897 | hotstack | changed 2025-10-11 20:18:58.363131 | 2025-10-11 20:18:58.363266 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2025-10-11 20:18:58.389685 | hotstack | skipping: Conditional result was False 2025-10-11 20:18:58.401551 | 2025-10-11 20:18:58.401683 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2025-10-11 20:18:58.825579 | hotstack -> localhost | changed 2025-10-11 20:18:58.846302 | 2025-10-11 20:18:58.846427 | TASK [add-build-sshkey : Add back temp key] 2025-10-11 20:18:59.208904 | hotstack -> localhost | Identity added: /var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/work/c8eea6111faf4495bb5a4d8fda95714a_id_rsa (zuul-build-sshkey) 2025-10-11 20:18:59.209280 | hotstack -> localhost | ok: Runtime: 0:00:00.014663 2025-10-11 20:18:59.221593 | 2025-10-11 20:18:59.221729 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2025-10-11 20:18:59.661586 | hotstack | ok 2025-10-11 20:18:59.667575 | 2025-10-11 20:18:59.667659 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2025-10-11 20:18:59.703868 | hotstack | skipping: Conditional result was False 2025-10-11 20:18:59.716614 | 2025-10-11 20:18:59.716749 | TASK [include_role : validate-host] 2025-10-11 20:18:59.747965 | hotstack | ok 2025-10-11 20:18:59.773854 | 2025-10-11 20:18:59.773940 | TASK [validate-host : Define zuul_info_dir fact] 2025-10-11 20:18:59.815562 | hotstack | ok 2025-10-11 20:18:59.822168 | 2025-10-11 20:18:59.822254 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2025-10-11 20:19:00.090708 | hotstack -> localhost | ok 2025-10-11 20:19:00.100812 | 2025-10-11 20:19:00.100910 | TASK [validate-host : Collect information about the host] 2025-10-11 20:19:00.932950 | hotstack | ok 2025-10-11 20:19:00.951543 | 2025-10-11 20:19:00.951691 | TASK [validate-host : Sanitize hostname] 2025-10-11 20:19:01.024724 | hotstack | ok 2025-10-11 20:19:01.031298 | 2025-10-11 20:19:01.031380 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2025-10-11 20:19:01.524820 | hotstack -> localhost | changed 2025-10-11 20:19:01.531994 | 2025-10-11 20:19:01.532098 | TASK [validate-host : Collect information about zuul worker] 2025-10-11 20:19:01.981199 | hotstack | ok 2025-10-11 20:19:01.987811 | 2025-10-11 20:19:01.987896 | TASK [validate-host : Write out all zuul information for each host] 2025-10-11 20:19:02.491878 | hotstack -> localhost | changed 2025-10-11 20:19:02.505079 | 2025-10-11 20:19:02.505221 | TASK [include_role : prepare-workspace-openshift] 2025-10-11 20:19:02.522041 | hotstack | skipping: Conditional result was False 2025-10-11 20:19:02.529508 | 2025-10-11 20:19:02.529606 | TASK [include_role : remove-zuul-sshkey] 2025-10-11 20:19:02.544001 | hotstack | skipping: Conditional result was False 2025-10-11 20:19:02.551875 | 2025-10-11 20:19:02.551968 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2025-10-11 20:19:02.847476 | hotstack | ok: "logs" 2025-10-11 20:19:02.847876 | hotstack | ok: All items complete 2025-10-11 20:19:02.847933 | 2025-10-11 20:19:03.112167 | hotstack | ok: "artifacts" 2025-10-11 20:19:03.367259 | hotstack | ok: "docs" 2025-10-11 20:19:03.380578 | 2025-10-11 20:19:03.380727 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2025-10-11 20:19:03.726794 | hotstack | changed: "logs" 2025-10-11 20:19:03.991006 | hotstack | changed: "artifacts" 2025-10-11 20:19:04.240436 | hotstack | changed: "docs" 2025-10-11 20:19:04.289461 | 2025-10-11 20:19:04.289663 | PLAY RECAP 2025-10-11 20:19:04.289765 | hotstack | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-10-11 20:19:04.289824 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-10-11 20:19:04.289865 | 2025-10-11 20:19:04.421370 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-10-11 20:19:04.423958 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/hotstack/pre_stage1.yaml@master] 2025-10-11 20:19:05.002060 | 2025-10-11 20:19:05.002172 | PLAY [Create necessary files to deploy hotstack scenario] 2025-10-11 20:19:05.022991 | 2025-10-11 20:19:05.023104 | TASK [prepare-workspace : Start zuul_console daemon.] 2025-10-11 20:19:05.467798 | hotstack | ok 2025-10-11 20:19:05.480471 | 2025-10-11 20:19:05.480676 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2025-10-11 20:19:08.012647 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:08.027719 | 2025-10-11 20:19:08.027883 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2025-10-11 20:19:08.510303 | hotstack | changed: 2025-10-11 20:19:08.510645 | hotstack | { 2025-10-11 20:19:08.510706 | hotstack | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCINPOs6XsfMVQMqjmiduT3Bxhogy7MbAFOWlR+9LlKkTW1kV6glsCXY5svtggd2zRtc40UWalHaj9jC+yEkZdI35h2PkK+Sww52u4nczqgNpIFNt7Dm2xtYKbTolAV9jSeNkRlGMCq9EBzQlwiV0HkHx1CdNR/zzXbyNZLmOybFkXqR150H01kUhdv0v6AMWTDZjMEWO/PaWCOgzZhH9ztXjy+rwa7pdaI4+0Pb9Kib+d8/IrgNsLB/sCazqD+9/COI6AHqzTDS1aU9/gMQrUN1ronzMEQhzzOuoI8WeLqU++j+0dT2UWVPlQqoln+RYu7dUn/DSZDrsYenudT5+P" 2025-10-11 20:19:08.510753 | hotstack | } 2025-10-11 20:19:08.537823 | 2025-10-11 20:19:08.538063 | TASK [Assert cloud name and cloud secret] 2025-10-11 20:19:08.607935 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:08.618973 | 2025-10-11 20:19:08.619221 | TASK [Ensure openstack release repo is installed] 2025-10-11 20:19:12.868770 | hotstack | changed 2025-10-11 20:19:12.879963 | 2025-10-11 20:19:12.880195 | TASK [Install openstack client packages] 2025-10-11 20:19:29.894796 | hotstack | changed 2025-10-11 20:19:29.906938 | 2025-10-11 20:19:29.907120 | TASK [Ensure HotStack work dir] 2025-10-11 20:19:30.352985 | hotstack | changed 2025-10-11 20:19:30.365898 | 2025-10-11 20:19:30.366111 | LOOP [Ensure etc directories] 2025-10-11 20:19:30.652923 | hotstack | changed: "/etc/openstack" 2025-10-11 20:19:30.653163 | hotstack | changed: All items complete 2025-10-11 20:19:30.653217 | 2025-10-11 20:19:30.896856 | hotstack | changed: "/etc/hotstack" 2025-10-11 20:19:30.917741 | 2025-10-11 20:19:30.917939 | TASK [Ensure .ssh dir exists] 2025-10-11 20:19:31.212792 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:31.225575 | 2025-10-11 20:19:31.225736 | TASK [Ensure ssh keypair exists] 2025-10-11 20:19:41.794648 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:41.802457 | 2025-10-11 20:19:41.802564 | TASK [Generate CA cert file] 2025-10-11 20:19:41.838111 | hotstack | skipping: Conditional result was False 2025-10-11 20:19:41.845753 | 2025-10-11 20:19:41.845845 | TASK [Update CA certs] 2025-10-11 20:19:42.378549 | hotstack | skipping: Conditional result was False 2025-10-11 20:19:42.391896 | 2025-10-11 20:19:42.392094 | TASK [Set _auth_type fact] 2025-10-11 20:19:42.439766 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:42.450759 | 2025-10-11 20:19:42.450938 | TASK [Write clouds.yaml - user/password] 2025-10-11 20:19:43.681668 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:43.692675 | 2025-10-11 20:19:43.692804 | TASK [Create application credential for sushy-emulator] 2025-10-11 20:19:46.744927 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:46.783161 | 2025-10-11 20:19:46.783564 | TASK [Read application credential from file] 2025-10-11 20:19:47.169441 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:47.175822 | 2025-10-11 20:19:47.175898 | TASK [Delete temporary application credential file] 2025-10-11 20:19:47.459729 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:47.469933 | 2025-10-11 20:19:47.470090 | TASK [Assert application credential id and secret] 2025-10-11 20:19:47.557560 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:47.568289 | 2025-10-11 20:19:47.568423 | TASK [Write new clouds.yaml with application credentials] 2025-10-11 20:19:48.544741 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:48.554729 | 2025-10-11 20:19:48.554852 | TASK [Write hotstack cloud-secret.yaml] 2025-10-11 20:19:49.388828 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:49.404870 | 2025-10-11 20:19:49.405080 | TASK [Write clouds.yaml with application credentials] 2025-10-11 20:19:49.446728 | 2025-10-11 20:19:49.446990 | TASK [Write hotstack cloud-secret.yaml] 2025-10-11 20:19:49.542766 | 2025-10-11 20:19:49.542888 | PLAY RECAP 2025-10-11 20:19:49.542927 | hotstack | ok: 18 changed: 11 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 0 2025-10-11 20:19:49.542948 | 2025-10-11 20:19:49.627358 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/hotstack/pre_stage1.yaml@master] 2025-10-11 20:19:49.634622 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/hotstack/pre_stage2.yaml@master] 2025-10-11 20:19:50.207604 | 2025-10-11 20:19:50.207715 | PLAY [Create hotstack scenario] 2025-10-11 20:19:50.228282 | 2025-10-11 20:19:50.228361 | TASK [Assert scenario is defined] 2025-10-11 20:19:50.277589 | hotstack | ok: All assertions passed 2025-10-11 20:19:50.282738 | 2025-10-11 20:19:50.282807 | TASK [Fetch bootstrap vars from remote to zuul executor] 2025-10-11 20:19:50.826789 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:50.838921 | 2025-10-11 20:19:50.839095 | TASK [Load bootstrap vars with template resolution] 2025-10-11 20:19:50.877086 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:50.888338 | 2025-10-11 20:19:50.888563 | TASK [Fetch automation vars from remote to zuul executor] 2025-10-11 20:19:51.325627 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:51.337478 | 2025-10-11 20:19:51.337705 | TASK [Load automation vars with template resolution] 2025-10-11 20:19:51.429096 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:51.440333 | 2025-10-11 20:19:51.440472 | TASK [Slurp zuul-build-sshkey from file] 2025-10-11 20:19:51.835832 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:51.847322 | 2025-10-11 20:19:51.847451 | TASK [Set up infrastructure (Heat stack)] 2025-10-11 20:19:51.874901 | hotstack | Output suppressed because no_log was given 2025-10-11 20:19:51.925208 | 2025-10-11 20:19:51.925345 | TASK [dataplane_ssh_keys : Ensure Dataplane ssh keypair exists] 2025-10-11 20:19:52.586303 | hotstack | changed 2025-10-11 20:19:52.597734 | 2025-10-11 20:19:52.597863 | TASK [dataplane_ssh_keys : Ensure Nova migration ssh keypair exists] 2025-10-11 20:19:53.045353 | hotstack | changed 2025-10-11 20:19:53.057880 | 2025-10-11 20:19:53.058073 | TASK [dataplane_ssh_keys : Set SSH public key facts] 2025-10-11 20:19:53.104979 | hotstack | ok 2025-10-11 20:19:53.120518 | 2025-10-11 20:19:53.120718 | TASK [dataplane_ssh_keys : Store SSH public key facts in file] 2025-10-11 20:19:54.190872 | hotstack | changed 2025-10-11 20:19:54.214115 | 2025-10-11 20:19:54.214282 | TASK [heat_stack : Assert config is defined] 2025-10-11 20:19:54.323128 | hotstack | ok: All assertions passed 2025-10-11 20:19:54.334251 | 2025-10-11 20:19:54.334379 | TASK [heat_stack : Get latest snapset and update stack parameters] 2025-10-11 20:19:54.370993 | hotstack | skipping: Conditional result was False 2025-10-11 20:19:54.384879 | 2025-10-11 20:19:54.385078 | TASK [heat_stack : Debug latest snapset information] 2025-10-11 20:19:54.431699 | hotstack | skipping: Conditional result was False 2025-10-11 20:19:54.445623 | 2025-10-11 20:19:54.445763 | TASK [heat_stack : Create stack] 2025-10-11 20:21:15.723222 | hotstack | changed 2025-10-11 20:21:15.741117 | 2025-10-11 20:21:15.741260 | TASK [heat_stack : Wait for stack to complete] 2025-10-11 20:21:17.365506 | hotstack | ok 2025-10-11 20:21:17.377746 | 2025-10-11 20:21:17.377871 | TASK [heat_stack : Debug - stack_info] 2025-10-11 20:21:17.404863 | hotstack | skipping: Conditional result was False 2025-10-11 20:21:17.417681 | 2025-10-11 20:21:17.417813 | TASK [heat_stack : Stop if stack not complete] 2025-10-11 20:21:17.444369 | hotstack | skipping: Conditional result was False 2025-10-11 20:21:17.457662 | 2025-10-11 20:21:17.457805 | TASK [heat_stack : Get stack outputs] 2025-10-11 20:21:19.605969 | hotstack | changed 2025-10-11 20:21:19.623841 | 2025-10-11 20:21:19.624053 | TASK [heat_stack : Set stack outputs facts] 2025-10-11 20:21:19.663812 | hotstack | ok 2025-10-11 20:21:19.679509 | 2025-10-11 20:21:19.679693 | TASK [heat_stack : Store stack outputs in file] 2025-10-11 20:21:20.621217 | hotstack | changed 2025-10-11 20:21:20.642853 | 2025-10-11 20:21:20.643020 | TASK [Fetch stack outputs from remote to zuul executor] 2025-10-11 20:21:21.036214 | hotstack | Output suppressed because no_log was given 2025-10-11 20:21:21.046266 | 2025-10-11 20:21:21.046418 | TASK [Load stack output vars with template resolution] 2025-10-11 20:21:21.093516 | hotstack | Output suppressed because no_log was given 2025-10-11 20:21:21.103517 | 2025-10-11 20:21:21.103648 | TASK [Fetch cloud secrets from remote to zuul executor] 2025-10-11 20:21:21.520483 | hotstack | Output suppressed because no_log was given 2025-10-11 20:21:21.530826 | 2025-10-11 20:21:21.530963 | TASK [Load hotstack cloud secret vars with template resolution] 2025-10-11 20:21:21.577916 | hotstack | Output suppressed because no_log was given 2025-10-11 20:21:21.589647 | 2025-10-11 20:21:21.589787 | TASK [Add Hotstack controller-0 to ansible inventory] 2025-10-11 20:21:21.634170 | hotstack | Output suppressed because no_log was given 2025-10-11 20:21:21.641195 | 2025-10-11 20:21:21.641299 | TASK [Wait for Hotstack controller-0 to be ready] 2025-10-11 20:22:59.608861 | hotstack -> 38.102.83.82 | Output suppressed because no_log was given 2025-10-11 20:22:59.614752 | 2025-10-11 20:22:59.614834 | TASK [Start Zuul console on Hotstack controller-0] 2025-10-11 20:22:59.652230 | hotstack | Output suppressed because no_log was given 2025-10-11 20:22:59.690403 | 2025-10-11 20:22:59.690512 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-10-11 20:23:00.518535 | hotstack -> 38.102.83.82 | ok 2025-10-11 20:23:00.538478 | 2025-10-11 20:23:00.538597 | TASK [Prepare the controller node] 2025-10-11 20:23:00.567859 | hotstack | Output suppressed because no_log was given 2025-10-11 20:23:00.638634 | 2025-10-11 20:23:00.638743 | TASK [controller : Assert config is defined] 2025-10-11 20:23:00.719113 | hotstack | ok: All assertions passed 2025-10-11 20:23:00.723967 | 2025-10-11 20:23:00.724051 | TASK [controller : Add controller-0 to the Ansible inventory] 2025-10-11 20:23:00.752977 | hotstack | ok 2025-10-11 20:23:00.757927 | 2025-10-11 20:23:00.757987 | TASK [controller : Read Dataplane SSH private key content] 2025-10-11 20:23:01.231249 | hotstack | ok 2025-10-11 20:23:01.236198 | 2025-10-11 20:23:01.236259 | TASK [controller : Read Nova migration SSH private key content] 2025-10-11 20:23:01.497791 | hotstack | ok 2025-10-11 20:23:01.502903 | 2025-10-11 20:23:01.502974 | TASK [controller : Wait for controller-0 to be ready] 2025-10-11 20:23:02.366351 | hotstack -> 38.102.83.82 | ok 2025-10-11 20:23:02.373966 | 2025-10-11 20:23:02.374085 | LOOP [controller : Ensure directories exists] 2025-10-11 20:23:03.313938 | hotstack -> 38.102.83.82 | changed: "/home/zuul/data" 2025-10-11 20:23:08.733487 | hotstack -> 38.102.83.82 | changed: "/home/zuul/bin" 2025-10-11 20:23:08.751259 | 2025-10-11 20:23:08.751467 | LOOP [controller : Add common functions to the bin_dir] 2025-10-11 20:23:11.394413 | hotstack -> 38.102.83.82 | changed: "bin/hotstack-common-funcs.sh" 2025-10-11 20:23:11.394748 | hotstack -> 38.102.83.82 | changed: All items complete 2025-10-11 20:23:11.394797 | 2025-10-11 20:23:11.405457 | 2025-10-11 20:23:11.405558 | LOOP [controller : Add bin utilities to the bin_dir] 2025-10-11 20:23:13.019161 | hotstack -> 38.102.83.82 | changed: "bin/hotstack-approve-install-plan" 2025-10-11 20:23:14.195407 | hotstack -> 38.102.83.82 | changed: "bin/hotstack-leader-election-tune" 2025-10-11 20:23:15.596369 | hotstack -> 38.102.83.82 | changed: "bin/hotstack-nova-discover-hosts" 2025-10-11 20:23:17.331077 | hotstack -> 38.102.83.82 | changed: "bin/hotstack-snapset" 2025-10-11 20:23:18.060559 | hotstack -> 38.102.83.82 | changed: "bin/hotstack-openstack-version-patch" 2025-10-11 20:23:20.438489 | hotstack -> 38.102.83.82 | changed: "bin/hotstack-wait-for-bmh" 2025-10-11 20:23:20.456373 | 2025-10-11 20:23:20.456571 | TASK [controller : Write ansible inventory to file on controller-0] 2025-10-11 20:23:20.533443 | hotstack | skipping: Conditional result was False 2025-10-11 20:23:20.546667 | 2025-10-11 20:23:20.546815 | TASK [controller : Copy Dataplane ssh private key to controller] 2025-10-11 20:23:21.473877 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:23:21.486604 | 2025-10-11 20:23:21.486747 | TASK [controller : Copy Dataplane ssh public key to controller] 2025-10-11 20:23:22.330641 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:23:22.337301 | 2025-10-11 20:23:22.337417 | TASK [controller : Copy Nova migrate ssh private key to controller] 2025-10-11 20:23:23.253177 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:23:23.269306 | 2025-10-11 20:23:23.269458 | TASK [controller : Copy Nova migrate ssh public key to controller] 2025-10-11 20:23:24.184395 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:23:24.198209 | 2025-10-11 20:23:24.198403 | TASK [controller : Copy dataplane authorized keys to controller] 2025-10-11 20:23:25.028046 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:23:25.034128 | 2025-10-11 20:23:25.034190 | TASK [controller : Ensure cloud config directory exists] 2025-10-11 20:23:25.632636 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:23:25.646363 | 2025-10-11 20:23:25.646502 | TASK [controller : Template the clouds.yaml] 2025-10-11 20:23:26.897189 | hotstack -> 38.102.83.82 | Output suppressed because no_log was given 2025-10-11 20:23:26.909524 | 2025-10-11 20:23:26.909665 | TASK [controller : Write Ironic nodes YAML] 2025-10-11 20:23:26.946587 | hotstack | skipping: Conditional result was False 2025-10-11 20:23:26.968540 | 2025-10-11 20:23:26.968685 | TASK [Install Openshift] 2025-10-11 20:23:26.997419 | hotstack | Output suppressed because no_log was given 2025-10-11 20:23:27.059115 | 2025-10-11 20:23:27.059213 | TASK [ocp_agent_installer : Assert config is defined] 2025-10-11 20:23:27.154423 | hotstack -> 38.102.83.82 | ok: All assertions passed 2025-10-11 20:23:27.163052 | 2025-10-11 20:23:27.163143 | TASK [ocp_agent_installer : Install using agent installer] 2025-10-11 20:23:27.283805 | hotstack | ok 2025-10-11 20:23:27.301254 | hotstack | included: /var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/_install.yml 2025-10-11 20:23:27.308542 | 2025-10-11 20:23:27.308620 | TASK [ocp_agent_installer : Assert config is defined] 2025-10-11 20:23:27.383875 | hotstack -> 38.102.83.82 | ok: All assertions passed 2025-10-11 20:23:27.392269 | 2025-10-11 20:23:27.392358 | LOOP [ocp_agent_installer : Ensure directory exists] 2025-10-11 20:23:27.879401 | hotstack -> 38.102.83.82 | ok: "/home/zuul/bin" 2025-10-11 20:23:27.879863 | hotstack -> 38.102.83.82 | changed: All items complete 2025-10-11 20:23:27.879923 | 2025-10-11 20:23:28.325729 | hotstack -> 38.102.83.82 | changed: "/home/zuul/.kube" 2025-10-11 20:23:28.669305 | hotstack -> 38.102.83.82 | changed: "/home/zuul/ocp-cluster" 2025-10-11 20:23:29.003513 | hotstack -> 38.102.83.82 | changed: "/home/zuul/ocp-cluster/openshift" 2025-10-11 20:23:29.482086 | hotstack -> 38.102.83.82 | changed: "/home/zuul/agent-installer" 2025-10-11 20:23:29.937861 | hotstack -> 38.102.83.82 | changed: "/home/zuul/cluster-custom-config/" 2025-10-11 20:23:30.250268 | hotstack -> 38.102.83.82 | changed: "/home/zuul/cluster-custom-config//butane" 2025-10-11 20:23:30.676066 | hotstack -> 38.102.83.82 | changed: "/home/zuul/cluster-custom-config//machine-configs" 2025-10-11 20:23:31.068643 | hotstack -> 38.102.83.82 | changed: "/home/zuul/cluster-custom-config//config-assets" 2025-10-11 20:23:31.105160 | 2025-10-11 20:23:31.105358 | TASK [ocp_agent_installer : Install package requirements for agent installer] 2025-10-11 20:24:20.078701 | hotstack -> 38.102.83.82 | ok: Nothing to do 2025-10-11 20:24:20.099705 | 2025-10-11 20:24:20.099882 | TASK [ocp_agent_installer : Run tasks/install_client.yml] 2025-10-11 20:24:20.138206 | hotstack | ok 2025-10-11 20:24:20.153519 | hotstack | included: /var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/install_client.yml 2025-10-11 20:24:20.169133 | 2025-10-11 20:24:20.169232 | TASK [ocp_agent_installer : Download the client] 2025-10-11 20:24:22.076262 | hotstack -> 38.102.83.82 | changed: OK (73347743 bytes) 2025-10-11 20:24:22.090684 | 2025-10-11 20:24:22.090842 | TASK [ocp_agent_installer : Extract client to /home/zuul/bin] 2025-10-11 20:24:28.886664 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:24:28.900405 | 2025-10-11 20:24:28.900538 | TASK [ocp_agent_installer : Configure bash completion] 2025-10-11 20:24:56.636920 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:24:56.649489 | 2025-10-11 20:24:56.649650 | TASK [ocp_agent_installer : Run tasks/install_installer.yml] 2025-10-11 20:24:56.677658 | hotstack | ok 2025-10-11 20:24:56.691803 | hotstack | included: /var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/install_installer.yml 2025-10-11 20:24:56.716887 | 2025-10-11 20:24:56.717045 | TASK [ocp_agent_installer : Download the installer] 2025-10-11 20:28:54.510853 | hotstack -> 38.102.83.82 | changed: OK (437684516 bytes) 2025-10-11 20:28:54.526199 | 2025-10-11 20:28:54.526356 | TASK [ocp_agent_installer : Extract installer to /home/zuul/bin] 2025-10-11 20:36:52.502280 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:36:52.510326 | 2025-10-11 20:36:52.510427 | TASK [ocp_agent_installer : Write OCP install-config.yaml] 2025-10-11 20:37:28.954654 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:37:28.967919 | 2025-10-11 20:37:28.968108 | TASK [ocp_agent_installer : Replace pull secret in install-config.yaml] 2025-10-11 20:37:29.525945 | hotstack -> 38.102.83.82 | Output suppressed because no_log was given 2025-10-11 20:37:29.538308 | 2025-10-11 20:37:29.538455 | TASK [ocp_agent_installer : Write OCP agent-config.yaml] 2025-10-11 20:37:30.819287 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:37:30.833498 | 2025-10-11 20:37:30.833663 | TASK [ocp_agent_installer : Include tasks to generate machine configs] 2025-10-11 20:37:30.871475 | hotstack | ok 2025-10-11 20:37:30.891116 | hotstack | included: /var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/machine_configs.yml 2025-10-11 20:37:30.914313 | 2025-10-11 20:37:30.914427 | LOOP [ocp_agent_installer : Template butane config for net.ifnames] 2025-10-11 20:37:32.442977 | hotstack -> 38.102.83.82 | changed: "master" 2025-10-11 20:37:32.463730 | 2025-10-11 20:37:32.463886 | LOOP [ocp_agent_installer : Generate MachineConfig for iscsi] 2025-10-11 20:37:33.188190 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:37:33.189067 | hotstack -> 38.102.83.82 | changed: All items complete 2025-10-11 20:37:33.189162 | 2025-10-11 20:37:33.207041 | 2025-10-11 20:37:33.207212 | LOOP [ocp_agent_installer : Template butane config for iscsi] 2025-10-11 20:37:34.765461 | hotstack -> 38.102.83.82 | changed: "master" 2025-10-11 20:37:34.784280 | 2025-10-11 20:37:34.784504 | LOOP [ocp_agent_installer : Generate MachineConfig for iscsi] 2025-10-11 20:37:35.511585 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:37:35.512052 | hotstack -> 38.102.83.82 | changed: All items complete 2025-10-11 20:37:35.512136 | 2025-10-11 20:37:35.528163 | 2025-10-11 20:37:35.528306 | LOOP [ocp_agent_installer : Template butane config for multipath] 2025-10-11 20:37:36.634915 | hotstack -> 38.102.83.82 | changed: "master" 2025-10-11 20:37:36.658320 | 2025-10-11 20:37:36.658489 | LOOP [ocp_agent_installer : Generate MachineConfig for multipath] 2025-10-11 20:37:37.226746 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:37:37.227073 | hotstack -> 38.102.83.82 | changed: All items complete 2025-10-11 20:37:37.227124 | 2025-10-11 20:37:37.251126 | 2025-10-11 20:37:37.251296 | LOOP [ocp_agent_installer : Template butane config for LVM cinder-volumes] 2025-10-11 20:37:38.542774 | hotstack -> 38.102.83.82 | changed: "master" 2025-10-11 20:37:38.560612 | 2025-10-11 20:37:38.560791 | LOOP [ocp_agent_installer : Generate MachineConfig for multipath] 2025-10-11 20:37:39.172837 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:37:39.173279 | hotstack -> 38.102.83.82 | changed: All items complete 2025-10-11 20:37:39.173340 | 2025-10-11 20:37:39.193355 | 2025-10-11 20:37:39.193504 | TASK [ocp_agent_installer : Include tasks to generate config assets] 2025-10-11 20:37:39.232315 | hotstack | ok 2025-10-11 20:37:39.250795 | hotstack | included: /var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/config_assets.yml 2025-10-11 20:37:39.279732 | 2025-10-11 20:37:39.279841 | TASK [ocp_agent_installer : Template ovn-k8s customization] 2025-10-11 20:37:40.686087 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:37:40.701728 | 2025-10-11 20:37:40.701893 | TASK [ocp_agent_installer : Copy Etcd customization] 2025-10-11 20:37:41.751975 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:37:41.766042 | 2025-10-11 20:37:41.766228 | TASK [ocp_agent_installer : Template ImageContentSourcePolicy customization] 2025-10-11 20:37:41.847467 | hotstack | skipping: Conditional result was False 2025-10-11 20:37:41.860617 | 2025-10-11 20:37:41.860790 | TASK [ocp_agent_installer : Initialize _ocp_additional_trusted_ca_map fact] 2025-10-11 20:37:41.921687 | hotstack | skipping: Conditional result was False 2025-10-11 20:37:41.945442 | 2025-10-11 20:37:41.945706 | LOOP [ocp_agent_installer : Append to _ocp_additional_trusted_ca_map fact] 2025-10-11 20:37:42.005945 | hotstack | skipping: Conditional result was False 2025-10-11 20:37:42.020881 | 2025-10-11 20:37:42.021107 | TASK [ocp_agent_installer : Template additional CA config map] 2025-10-11 20:37:42.092273 | hotstack | skipping: Conditional result was False 2025-10-11 20:37:42.101143 | 2025-10-11 20:37:42.101247 | TASK [ocp_agent_installer : Copy additional CA config image] 2025-10-11 20:37:42.169307 | hotstack | skipping: Conditional result was False 2025-10-11 20:37:42.177793 | 2025-10-11 20:37:42.177940 | TASK [ocp_agent_installer : Copy machine_configs to manifests dir] 2025-10-11 20:37:42.880672 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:37:42.889253 | 2025-10-11 20:37:42.889368 | TASK [ocp_agent_installer : Copy config assets to manifests dir] 2025-10-11 20:37:43.552133 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:37:43.563404 | 2025-10-11 20:37:43.563505 | TASK [ocp_agent_installer : Run tasks/pxe_assets.yml] 2025-10-11 20:37:43.600339 | hotstack | ok 2025-10-11 20:37:43.615878 | hotstack | included: /var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/pxe_assets.yml 2025-10-11 20:37:43.639626 | 2025-10-11 20:37:43.639698 | TASK [ocp_agent_installer : Create the boot-artifacts directory] 2025-10-11 20:37:44.227822 | hotstack -> 38.102.83.82 | changed 2025-10-11 20:37:44.240208 | 2025-10-11 20:37:44.240340 | TASK [ocp_agent_installer : Create PXE assets] 2025-10-11 20:37:46.560635 | controller-0 | level=warning msg=Compute[0].Hyperthreading: Disabled is ignored 2025-10-11 20:37:46.560830 | controller-0 | level=warning msg=ControlPlane.Hyperthreading: Disabled is ignored 2025-10-11 20:37:46.560845 | controller-0 | level=info msg=Configuration has 3 master replicas and 0 worker replicas 2025-10-11 20:37:47.673393 | controller-0 | level=info msg=The rendezvous host IP (node0 IP) is 192.168.34.10 2025-10-11 20:37:48.472579 | controller-0 | level=info msg=Extracting base ISO from release payload 2025-10-11 20:48:36.148757 | controller-0 | level=info msg=Base ISO obtained from release and cached at [/home/zuul/.cache/agent/image_cache/coreos-x86_64.iso] 2025-10-11 21:02:51.011945 | controller-0 | level=info msg=Consuming Install Config from target directory 2025-10-11 21:02:51.012403 | controller-0 | level=info msg=Consuming Agent Config from target directory 2025-10-11 21:02:51.632960 | controller-0 | level=info msg=Consuming Extra Manifests from target directory 2025-10-11 21:02:51.633013 | controller-0 | level=info msg=Created iPXE script agent.x86_64.ipxe in boot-artifacts directory 2025-10-11 21:02:51.633071 | controller-0 | level=info msg=PXE boot artifacts created in: boot-artifacts 2025-10-11 21:02:51.633109 | controller-0 | level=info msg=Kernel parameters for PXE boot: rw ignition.firstboot ignition.platform.id=metal 2025-10-11 21:02:52.774454 | hotstack -> 38.102.83.82 | changed 2025-10-11 21:02:52.786894 | 2025-10-11 21:02:52.787105 | TASK [ocp_agent_installer : Set serial console in ipxe] 2025-10-11 21:02:53.643798 | hotstack -> 38.102.83.82 | changed: line replaced 2025-10-11 21:02:53.650555 | 2025-10-11 21:02:53.650620 | TASK [ocp_agent_installer : Disable net.ifnames] 2025-10-11 21:02:54.280732 | hotstack -> 38.102.83.82 | changed: line replaced 2025-10-11 21:02:54.295888 | 2025-10-11 21:02:54.296089 | LOOP [ocp_agent_installer : Copy boot-artifacts to the web server - (ocp_agent_installer_boot_artifacts_dir)] 2025-10-11 21:02:55.444484 | hotstack -> 38.102.83.82 | changed: "agent.x86_64-vmlinuz" 2025-10-11 21:02:55.444770 | 2025-10-11 21:02:57.171638 | hotstack -> 38.102.83.82 | changed: "agent.x86_64-initrd.img" 2025-10-11 21:15:42.821598 | hotstack -> 38.102.83.82 | changed: "agent.x86_64-rootfs.img" 2025-10-11 21:15:43.308374 | hotstack -> 38.102.83.82 | changed: "agent.x86_64.ipxe" 2025-10-11 21:15:43.329567 | 2025-10-11 21:15:43.329713 | TASK [ocp_agent_installer : Run tasks/iso_assets.yml] 2025-10-11 21:15:43.367362 | hotstack | skipping: Conditional result was False 2025-10-11 21:15:43.376518 | 2025-10-11 21:15:43.376632 | TASK [ocp_agent_installer : Copy auth/kubeconfig to ~/.kube/config] 2025-10-11 21:15:44.138854 | hotstack -> 38.102.83.82 | changed 2025-10-11 21:15:44.213969 | 2025-10-11 21:15:44.214188 | TASK [ocp_agent_installer : Wait for bootstrap-complete] 2025-10-11 21:15:55.017445 | controller-0 | level=info msg=Waiting for cluster install to initialize. Sleeping for 30 seconds 2025-10-11 21:16:38.705468 | controller-0 | level=info msg=Waiting for cluster install to initialize. Sleeping for 30 seconds 2025-10-11 21:17:20.722288 | controller-0 | level=info msg=Waiting for cluster install to initialize. Sleeping for 30 seconds 2025-10-11 21:18:02.744676 | controller-0 | level=info msg=Cannot access Rendezvous Host. There may be a network configuration problem, check console for additional info 2025-10-11 21:18:44.794264 | controller-0 | level=info msg=Cluster is not ready for install. Check validations 2025-10-11 21:18:44.794727 | controller-0 | level=warning msg=Cluster validation: The cluster has hosts that are not ready to install. 2025-10-11 21:18:44.794841 | controller-0 | level=warning msg=Cluster validation: The cluster must have exactly 3 dedicated control plane nodes. Add or remove hosts, or change their roles configurations to meet the requirement. 2025-10-11 21:18:44.800237 | controller-0 | level=info msg=Host 5e6742b7-3c33-4390-9c8a-792c97291be6: set as bootstrap 2025-10-11 21:18:56.839196 | controller-0 | level=warning msg=Host master-0 validation: Host couldn't synchronize with any NTP server 2025-10-11 21:18:56.839403 | controller-0 | level=warning msg=Host master-0 validation: Error while evaluating DNS resolution on this host 2025-10-11 21:18:56.839477 | controller-0 | level=warning msg=Host master-0 validation: Error while evaluating DNS resolution on this host 2025-10-11 21:18:56.839537 | controller-0 | level=warning msg=Host master-0 validation: Error while evaluating DNS resolution on this host 2025-10-11 21:18:56.840422 | controller-0 | level=warning msg=Host master-1 validation: Host couldn't synchronize with any NTP server 2025-10-11 21:18:56.840608 | controller-0 | level=warning msg=Host master-1 validation: Error while evaluating DNS resolution on this host 2025-10-11 21:18:56.840684 | controller-0 | level=warning msg=Host master-1 validation: Error while evaluating DNS resolution on this host 2025-10-11 21:18:56.840748 | controller-0 | level=warning msg=Host master-1 validation: Error while evaluating DNS resolution on this host 2025-10-11 21:18:56.846310 | controller-0 | level=warning msg=Host master-1: updated status from discovering to insufficient (Host cannot be installed due to following failing validation(s): Host couldn't synchronize with any NTP server) 2025-10-11 21:19:44.997656 | controller-0 | level=info msg=Cluster validation: The cluster has the exact amount of dedicated control plane nodes. 2025-10-11 21:19:44.998149 | controller-0 | level=warning msg=Host master-1 validation: No connectivity to the majority of hosts in the cluster 2025-10-11 21:19:44.998981 | controller-0 | level=warning msg=Host master-2 validation: No connectivity to the majority of hosts in the cluster 2025-10-11 21:19:44.999105 | controller-0 | level=warning msg=Host master-2 validation: Host couldn't synchronize with any NTP server 2025-10-11 21:19:44.999313 | controller-0 | level=warning msg=Host master-2 validation: Error while evaluating DNS resolution on this host 2025-10-11 21:19:44.999394 | controller-0 | level=warning msg=Host master-2 validation: Error while evaluating DNS resolution on this host 2025-10-11 21:19:44.999485 | controller-0 | level=warning msg=Host master-2 validation: Error while evaluating DNS resolution on this host 2025-10-11 21:19:45.000293 | controller-0 | level=warning msg=Host master-0 validation: No connectivity to the majority of hosts in the cluster 2025-10-11 21:19:45.000393 | controller-0 | level=info msg=Host master-0 validation: Host NTP is synced 2025-10-11 21:19:45.000485 | controller-0 | level=info msg=Host master-0 validation: Domain name resolution for the api.ocp.openstack.lab domain was successful or not required 2025-10-11 21:19:45.000593 | controller-0 | level=info msg=Host master-0 validation: Domain name resolution for the api-int.ocp.openstack.lab domain was successful or not required 2025-10-11 21:19:45.000680 | controller-0 | level=info msg=Host master-0 validation: Domain name resolution for the *.apps.ocp.openstack.lab domain was successful or not required 2025-10-11 21:19:45.005050 | controller-0 | level=info msg=Host master-0: validation 'ntp-synced' is now fixed 2025-10-11 21:19:57.042225 | controller-0 | level=info msg=Host master-1 validation: Host NTP is synced 2025-10-11 21:19:57.042395 | controller-0 | level=info msg=Host master-1 validation: Domain name resolution for the api.ocp.openstack.lab domain was successful or not required 2025-10-11 21:19:57.042503 | controller-0 | level=info msg=Host master-1 validation: Domain name resolution for the api-int.ocp.openstack.lab domain was successful or not required 2025-10-11 21:19:57.042637 | controller-0 | level=info msg=Host master-1 validation: Domain name resolution for the *.apps.ocp.openstack.lab domain was successful or not required 2025-10-11 21:19:57.046711 | controller-0 | level=info msg=Host master-1: validation 'ntp-synced' is now fixed 2025-10-11 21:20:09.080176 | controller-0 | level=info msg=Host master-2 validation: Host has connectivity to the majority of hosts in the cluster 2025-10-11 21:20:09.084338 | controller-0 | level=info msg=Host master-2: validation 'belongs-to-majority-group' is now fixed 2025-10-11 21:20:45.208542 | controller-0 | level=info msg=Host master-2 validation: Host NTP is synced 2025-10-11 21:20:45.208784 | controller-0 | level=info msg=Host master-2 validation: Domain name resolution for the api.ocp.openstack.lab domain was successful or not required 2025-10-11 21:20:45.208884 | controller-0 | level=info msg=Host master-2 validation: Domain name resolution for the api-int.ocp.openstack.lab domain was successful or not required 2025-10-11 21:20:45.208982 | controller-0 | level=info msg=Host master-2 validation: Domain name resolution for the *.apps.ocp.openstack.lab domain was successful or not required 2025-10-11 21:20:45.213340 | controller-0 | level=info msg=Host master-2: validation 'ntp-synced' is now fixed 2025-10-11 21:20:57.245317 | controller-0 | level=info msg=Host master-0 validation: Host has connectivity to the majority of hosts in the cluster 2025-10-11 21:20:57.245779 | controller-0 | level=info msg=Host master-1 validation: Host has connectivity to the majority of hosts in the cluster 2025-10-11 21:20:57.250421 | controller-0 | level=info msg=Host master-1: updated status from insufficient to known (Host is ready to be installed) 2025-10-11 21:21:09.282010 | controller-0 | level=info msg=Preparing cluster for installation 2025-10-11 21:21:09.282421 | controller-0 | level=info msg=Cluster validation: All hosts in the cluster are ready to install. 2025-10-11 21:21:21.337930 | controller-0 | level=info msg=Host master-1: updated status from known to preparing-for-installation (Host finished successfully to prepare for installation) 2025-10-11 21:21:57.440776 | controller-0 | level=info msg=Host master-1: New image status quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ab80599fe72dc2d07f4417f4cc981f1e7f199a8e7c26f17e7ff6ac00689a51ba. result: success. time: 1.61 seconds; size: 447.07 Megabytes; download rate: 290.84 MBps 2025-10-11 21:40:15.766543 | controller-0 | level=warning msg=Cluster validation: The cluster has hosts that are not ready to install. 2025-10-11 21:40:15.772524 | controller-0 | level=info msg=Host master-1: updated status from preparing-for-installation to preparing-failed (The host has encountered a preparation timeout, the following conditions failed: the installation disk speed check did not complete within the timeout.) 2025-10-11 21:40:39.852874 | controller-0 | level=info msg=Cluster is ready for install 2025-10-11 21:40:39.853051 | controller-0 | level=info msg=failed to prepare cluster installation, retrying 2025-10-11 21:41:03.940399 | controller-0 | level=info msg=Host master-1: updated status from preparing-failed to known (Host is ready to be installed) 2025-10-11 21:41:15.977225 | controller-0 | level=info msg=Cluster validation: All hosts in the cluster are ready to install. 2025-10-11 21:41:15.990970 | controller-0 | level=info msg=Host master-1: updated status from known to preparing-for-installation (Host finished successfully to prepare for installation) 2025-10-11 21:41:28.031395 | controller-0 | level=info msg=Host master-2: updated status from preparing-for-installation to preparing-successful (Host finished successfully to prepare for installation) 2025-10-11 22:00:07.821548 | controller-0 | level=info msg=Host master-0: updated status from preparing-for-installation to preparing-failed (The host has encountered a preparation timeout, the following conditions failed: the installation disk speed check did not complete within the timeout.) 2025-10-11 22:00:19.864397 | controller-0 | level=info msg=Cluster is ready for install 2025-10-11 22:00:31.906128 | controller-0 | level=info msg=Host master-2: updated status from known to preparing-for-installation (Host finished successfully to prepare for installation) 2025-10-11 22:00:43.945964 | controller-0 | level=info msg=Host master-2: updated status from preparing-for-installation to preparing-successful (Host finished successfully to prepare for installation) 2025-10-11 22:10:09.880160 | controller-0 | level=warning msg=Host's disk /dev/disk/by-path/pci-0000:00:06.0 is slower than the supported speed, and may cause degraded cluster performance (fdatasync duration: 120 ms) 2025-10-11 22:10:21.923000 | controller-0 | level=warning msg=Host's disk /dev/disk/by-path/pci-0000:00:06.0 is slower than the supported speed, and may cause degraded cluster performance (fdatasync duration: 114 ms) 2025-10-11 22:11:10.076909 | controller-0 | level=info msg=Cluster installation in progress 2025-10-11 22:11:10.084125 | controller-0 | level=info msg=Host master-0: updated status from preparing-for-installation to preparing-successful (Host finished successfully to prepare for installation) 2025-10-11 22:11:22.125192 | controller-0 | level=info msg=Host master-0: updated status from preparing-successful to installing (Installation is in progress) 2025-10-11 22:11:46.202484 | controller-0 | level=info msg=Host: master-2, reached installation stage Writing image to disk: 30% 2025-10-11 22:11:58.246622 | controller-0 | level=info msg=Host: master-1, reached installation stage Writing image to disk: 39% 2025-10-11 22:12:10.298987 | controller-0 | level=info msg=Host: master-1, reached installation stage Writing image to disk: 79% 2025-10-11 22:12:22.345465 | controller-0 | level=info msg=Host: master-0, reached installation stage Writing image to disk: 100% 2025-10-11 22:13:01.669904 | controller-0 | level=info msg=Bootstrap Kube API Initialized 2025-10-11 22:13:34.218527 | controller-0 | level=info msg=Host: master-2, reached installation stage Rebooting 2025-10-11 22:15:45.008839 | controller-0 | level=info msg=Use the following commands to gather logs from the cluster 2025-10-11 22:15:45.008993 | controller-0 | level=info msg=openshift-install gather bootstrap --help 2025-10-11 22:15:45.009097 | controller-0 | level=error msg=Bootstrap failed to complete: : bootstrap process timed out: context deadline exceeded 2025-10-11 22:15:45.238732 | hotstack -> 38.102.83.82 | ERROR 2025-10-11 22:15:45.239119 | hotstack -> 38.102.83.82 | { 2025-10-11 22:15:45.239201 | hotstack -> 38.102.83.82 | "delta": "1:00:00.217255", 2025-10-11 22:15:45.239263 | hotstack -> 38.102.83.82 | "end": "2025-10-11 22:15:45.021496", 2025-10-11 22:15:45.239314 | hotstack -> 38.102.83.82 | "msg": "non-zero return code", 2025-10-11 22:15:45.239351 | hotstack -> 38.102.83.82 | "rc": 5, 2025-10-11 22:15:45.239387 | hotstack -> 38.102.83.82 | "start": "2025-10-11 21:15:44.804241" 2025-10-11 22:15:45.239422 | hotstack -> 38.102.83.82 | } failure 2025-10-11 22:15:45.244113 | 2025-10-11 22:15:45.244224 | PLAY RECAP 2025-10-11 22:15:45.244306 | hotstack | ok: 74 changed: 48 unreachable: 0 failed: 1 skipped: 12 rescued: 0 ignored: 0 2025-10-11 22:15:45.244348 | 2025-10-11 22:15:45.401177 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/hotstack/pre_stage2.yaml@master] 2025-10-11 22:15:45.407104 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/hotstack/post.yaml@master] 2025-10-11 22:15:45.990747 | 2025-10-11 22:15:45.990852 | PLAY [Collect hotstack logs and clean up environment] 2025-10-11 22:15:46.011767 | 2025-10-11 22:15:46.011842 | TASK [Fetch stack outputs from remote to zuul executor] 2025-10-11 22:15:46.645994 | hotstack | Output suppressed because no_log was given 2025-10-11 22:15:46.657200 | 2025-10-11 22:15:46.657352 | TASK [Load stack output vars with template resolution] 2025-10-11 22:15:46.708320 | hotstack | Output suppressed because no_log was given 2025-10-11 22:15:46.719953 | 2025-10-11 22:15:46.720192 | TASK [Add Hotstack controller-0 to ansible inventory] 2025-10-11 22:15:46.794972 | hotstack | Output suppressed because no_log was given 2025-10-11 22:15:46.807811 | 2025-10-11 22:15:46.807918 | TASK [Wait for Hotstack controller-0 to be ready] 2025-10-11 22:15:54.484264 | hotstack -> 38.102.83.82 | Output suppressed because no_log was given 2025-10-11 22:15:54.496685 | 2025-10-11 22:15:54.496862 | TASK [Collect hotstack logs] 2025-10-11 22:15:54.523777 | hotstack | Output suppressed because no_log was given 2025-10-11 22:15:54.573105 | 2025-10-11 22:15:54.573264 | TASK [hotlogs : Initialize failure tracking] 2025-10-11 22:15:54.603425 | hotstack | ok 2025-10-11 22:15:54.608805 | 2025-10-11 22:15:54.608889 | TASK [hotlogs : Ensure logs directory] 2025-10-11 22:15:54.979412 | hotstack | changed 2025-10-11 22:15:54.992473 | 2025-10-11 22:15:54.992805 | LOOP [hotlogs : Create hotlogs sub dirs] 2025-10-11 22:15:55.271470 | hotstack | changed: 2025-10-11 22:15:55.271875 | hotstack | { 2025-10-11 22:15:55.271935 | hotstack | "dest_dir": "ocp_cluster", 2025-10-11 22:15:55.271978 | hotstack | "src": "/home/zuul/ocp-cluster/.openshift_install.log" 2025-10-11 22:15:55.272046 | hotstack | } 2025-10-11 22:15:55.508769 | hotstack | ok: 2025-10-11 22:15:55.508889 | hotstack | { 2025-10-11 22:15:55.508912 | hotstack | "dest_dir": "ocp_cluster", 2025-10-11 22:15:55.508931 | hotstack | "src": "/home/zuul/cluster-custom-config/" 2025-10-11 22:15:55.508951 | hotstack | } 2025-10-11 22:15:55.712832 | hotstack | changed: 2025-10-11 22:15:55.712947 | hotstack | { 2025-10-11 22:15:55.712970 | hotstack | "dest_dir": "data", 2025-10-11 22:15:55.713062 | hotstack | "src": "/home/zuul/data/" 2025-10-11 22:15:55.713094 | hotstack | } 2025-10-11 22:15:55.965784 | hotstack | changed: 2025-10-11 22:15:55.965938 | hotstack | { 2025-10-11 22:15:55.965990 | hotstack | "dest_dir": "manifests", 2025-10-11 22:15:55.966074 | hotstack | "src": "/home/zuul/manifests/" 2025-10-11 22:15:55.966118 | hotstack | } 2025-10-11 22:15:56.166125 | hotstack | ok: 2025-10-11 22:15:56.166286 | hotstack | { 2025-10-11 22:15:56.166336 | hotstack | "dest_dir": ".", 2025-10-11 22:15:56.166377 | hotstack | "src": "/home/zuul/must-gather.tar.gz" 2025-10-11 22:15:56.166435 | hotstack | } 2025-10-11 22:15:56.182801 | 2025-10-11 22:15:56.182966 | TASK [hotlogs : Run must-gather operations] 2025-10-11 22:15:58.409456 | hotstack -> 38.102.83.82 | ERROR 2025-10-11 22:15:58.409673 | hotstack -> 38.102.83.82 | { 2025-10-11 22:15:58.409704 | hotstack -> 38.102.83.82 | "msg": "Must-gather failed: error: unable to resolve image stream 'openshift/must-gather': the server could not find the requested resource (get imagestreams.image.openshift.io must-gather)\n (Command: oc adm must-gather --image-stream=openshift/must-gather --image=quay.io/openstack-k8s-operators/openstack-must-gather --dest-dir=/home/zuul/must-gather --timeout=10m --host-network=false -- ADDITIONAL_NAMESPACES=sushy-emulator OPENSTACK_DATABASES=ALL SOS_EDPM=all SOS_DECOMPRESS=0 gather)", 2025-10-11 22:15:58.409727 | hotstack -> 38.102.83.82 | "rc": 1 2025-10-11 22:15:58.409745 | hotstack -> 38.102.83.82 | } 2025-10-11 22:15:58.415831 | 2025-10-11 22:15:58.415896 | TASK [hotlogs : Display must-gather failure] 2025-10-11 22:15:58.475843 | hotstack | ok: 2025-10-11 22:15:58.476029 | hotstack | Must-gather operations failed: Must-gather failed: error: unable to resolve image stream 'openshift/must-gather': the server could not find the requested resource (get imagestreams.image.openshift.io must-gather) 2025-10-11 22:15:58.476067 | hotstack | (Command: oc adm must-gather --image-stream=openshift/must-gather --image=quay.io/openstack-k8s-operators/openstack-must-gather --dest-dir=/home/zuul/must-gather --timeout=10m --host-network=false -- ADDITIONAL_NAMESPACES=sushy-emulator OPENSTACK_DATABASES=ALL SOS_EDPM=all SOS_DECOMPRESS=0 gather) 2025-10-11 22:15:58.481087 | 2025-10-11 22:15:58.481148 | TASK [hotlogs : Track must-gather failure] 2025-10-11 22:15:58.541893 | hotstack | ok 2025-10-11 22:15:58.547951 | 2025-10-11 22:15:58.548038 | LOOP [hotlogs : Collect hotstack data] 2025-10-11 22:15:59.484316 | hotstack -> 38.102.83.110 | changed: >f+++++++++ .openshift_install.log 2025-10-11 22:15:59.484732 | hotstack -> 38.102.83.110 | changed: All items complete 2025-10-11 22:15:59.484790 | 2025-10-11 22:16:00.095664 | hotstack -> 38.102.83.110 | changed: 2025-10-11 22:16:00.095822 | hotstack -> 38.102.83.110 | .d..t...... ./ 2025-10-11 22:16:00.095848 | hotstack -> 38.102.83.110 | cd+++++++++ butane/ 2025-10-11 22:16:00.095867 | hotstack -> 38.102.83.110 | >f+++++++++ butane/90-master-disable-netifnames.bu 2025-10-11 22:16:00.095884 | hotstack -> 38.102.83.110 | >f+++++++++ butane/90-master-enable-iscsi.bu 2025-10-11 22:16:00.095900 | hotstack -> 38.102.83.110 | >f+++++++++ butane/91-master-enable-multipath.bu 2025-10-11 22:16:00.095916 | hotstack -> 38.102.83.110 | >f+++++++++ butane/92-master-lv-cinder-volumes.bu 2025-10-11 22:16:00.095932 | hotstack -> 38.102.83.110 | cd+++++++++ config-assets/ 2025-10-11 22:16:00.095948 | hotstack -> 38.102.83.110 | >f+++++++++ config-assets/95-etcd_config.yaml 2025-10-11 22:16:00.095964 | hotstack -> 38.102.83.110 | >f+++++++++ config-assets/ovn_k8s_config.yaml 2025-10-11 22:16:00.095980 | hotstack -> 38.102.83.110 | cd+++++++++ machine-configs/ 2025-10-11 22:16:00.095995 | hotstack -> 38.102.83.110 | >f+++++++++ machine-configs/90-master-disable-netifnames.yaml 2025-10-11 22:16:00.096070 | hotstack -> 38.102.83.110 | >f+++++++++ machine-configs/90-master-enable-iscsi.yaml 2025-10-11 22:16:00.096095 | hotstack -> 38.102.83.110 | >f+++++++++ machine-configs/91-master-enable-multipath.yaml 2025-10-11 22:16:00.096112 | hotstack -> 38.102.83.110 | >f+++++++++ machine-configs/92-master-lv-cinder-volumes.yaml 2025-10-11 22:16:00.677210 | hotstack -> 38.102.83.110 | changed: .d..t...... ./ 2025-10-11 22:16:01.341383 | hotstack -> 38.102.83.110 | ERROR: Item: {'src': '/home/zuul/manifests/', 'dest_dir': 'manifests'} 2025-10-11 22:16:01.341753 | hotstack -> 38.102.83.110 | { 2025-10-11 22:16:01.341800 | hotstack -> 38.102.83.110 | "ansible_loop_var": "item", 2025-10-11 22:16:01.341828 | hotstack -> 38.102.83.110 | "item": { 2025-10-11 22:16:01.341853 | hotstack -> 38.102.83.110 | "dest_dir": "manifests", 2025-10-11 22:16:01.341888 | hotstack -> 38.102.83.110 | "src": "/home/zuul/manifests/" 2025-10-11 22:16:01.341913 | hotstack -> 38.102.83.110 | }, 2025-10-11 22:16:01.341937 | hotstack -> 38.102.83.110 | "msg": "Warning: Permanently added '38.102.83.82' (ED25519) to the list of known hosts.\r\nrsync: [sender] change_dir \"/home/zuul/manifests\" failed: No such file or directory (2)\nrsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1839) [Receiver=3.2.5]\nrsync: [Receiver] write error: Broken pipe (32)\n", 2025-10-11 22:16:01.341965 | hotstack -> 38.102.83.110 | "rc": 23 2025-10-11 22:16:01.341989 | hotstack -> 38.102.83.110 | } 2025-10-11 22:16:02.030485 | hotstack -> 38.102.83.110 | ERROR: Item: {'src': '/home/zuul/must-gather.tar.gz', 'dest_dir': '.'} 2025-10-11 22:16:02.030725 | hotstack -> 38.102.83.110 | { 2025-10-11 22:16:02.030782 | hotstack -> 38.102.83.110 | "ansible_loop_var": "item", 2025-10-11 22:16:02.030823 | hotstack -> 38.102.83.110 | "item": { 2025-10-11 22:16:02.030890 | hotstack -> 38.102.83.110 | "dest_dir": ".", 2025-10-11 22:16:02.030929 | hotstack -> 38.102.83.110 | "src": "/home/zuul/must-gather.tar.gz" 2025-10-11 22:16:02.030964 | hotstack -> 38.102.83.110 | }, 2025-10-11 22:16:02.030999 | hotstack -> 38.102.83.110 | "msg": "Warning: Permanently added '38.102.83.82' (ED25519) to the list of known hosts.\r\nrsync: [sender] link_stat \"/home/zuul/must-gather.tar.gz\" failed: No such file or directory (2)\nrsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1839) [Receiver=3.2.5]\nrsync: [Receiver] write error: Broken pipe (32)\n", 2025-10-11 22:16:02.031081 | hotstack -> 38.102.83.110 | "rc": 23 2025-10-11 22:16:02.031119 | hotstack -> 38.102.83.110 | } 2025-10-11 22:16:02.046975 | hotstack | ERROR: Ignoring Errors 2025-10-11 22:16:02.062132 | 2025-10-11 22:16:02.062302 | LOOP [hotlogs : Check hotstack data collection failures] 2025-10-11 22:16:02.134543 | hotstack | skipping: Conditional result was False 2025-10-11 22:16:02.141333 | hotstack | skipping: Conditional result was False 2025-10-11 22:16:02.149678 | hotstack | skipping: Conditional result was False 2025-10-11 22:16:02.172535 | hotstack | ERROR 2025-10-11 22:16:02.172770 | hotstack | { 2025-10-11 22:16:02.172826 | hotstack | "msg": "Unexpected templating type error occurred on ({{ hotlogs_failures + ['Failed to collect: ' + item.item] }}): can only concatenate str (not \"dict\") to str. can only concatenate str (not \"dict\") to str" 2025-10-11 22:16:02.172873 | hotstack | } 2025-10-11 22:16:02.183658 | 2025-10-11 22:16:02.183805 | TASK [Print message that log collection failed] 2025-10-11 22:16:02.222989 | hotstack | ok: WARNING: Log collection failed and may be incomplete. Continue with cleanup ... 2025-10-11 22:16:02.235066 | 2025-10-11 22:16:02.235224 | TASK [Set _auth_type fact] 2025-10-11 22:16:02.282601 | hotstack | Output suppressed because no_log was given 2025-10-11 22:16:02.294333 | 2025-10-11 22:16:02.294491 | TASK [Write clouds.yaml] 2025-10-11 22:16:03.372823 | hotstack | Output suppressed because no_log was given 2025-10-11 22:16:03.384689 | 2025-10-11 22:16:03.384815 | TASK [Delete application credentials] 2025-10-11 22:16:05.442166 | hotstack | changed 2025-10-11 22:16:05.453600 | 2025-10-11 22:16:05.453730 | TASK [Print message that application credential failed to delete] 2025-10-11 22:16:05.479970 | hotstack | skipping: Conditional result was False 2025-10-11 22:16:05.491405 | 2025-10-11 22:16:05.491534 | TASK [Print message that application credential deleted successfully] 2025-10-11 22:16:05.538152 | hotstack | ok: Application credential deleted successfully. 2025-10-11 22:16:05.548408 | 2025-10-11 22:16:05.548533 | TASK [Write clouds.yaml with application credentials] 2025-10-11 22:16:05.585753 | 2025-10-11 22:16:05.586046 | TASK [Delete the heat stack] 2025-10-11 18:16:28.537353 | hotstack | 2025-10-11 22:16:08Z [hs-c8eea6111faf4495bb5a4d8fda95714a]: DELETE_IN_PROGRESS Stack DELETE started 2025-10-11 18:16:28.537505 | hotstack | 2025-10-11 22:16:09Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537524 | hotstack | 2025-10-11 22:16:10Z [hs-c8eea6111faf4495bb5a4d8fda95714a.controller-floating-ip]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537537 | hotstack | 2025-10-11 22:16:11Z [hs-c8eea6111faf4495bb5a4d8fda95714a.controller-floating-ip]: DELETE_COMPLETE state changed 2025-10-11 18:16:28.537551 | hotstack | 2025-10-11 22:16:11Z [hs-c8eea6111faf4495bb5a4d8fda95714a.machine-net-router-interface]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537564 | hotstack | 2025-10-11 22:16:11Z [hs-c8eea6111faf4495bb5a4d8fda95714a.ctlplane-net-router-interface]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537577 | hotstack | 2025-10-11 22:16:12Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537687 | hotstack | 2025-10-11 22:16:12Z [hs-c8eea6111faf4495bb5a4d8fda95714a.machine-net-router-interface]: DELETE_COMPLETE state changed 2025-10-11 18:16:28.537709 | hotstack | 2025-10-11 22:16:13Z [hs-c8eea6111faf4495bb5a4d8fda95714a.ctlplane-net-router-interface]: DELETE_COMPLETE state changed 2025-10-11 18:16:28.537722 | hotstack | 2025-10-11 22:16:13Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker2]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537735 | hotstack | 2025-10-11 22:16:14Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker1]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537747 | hotstack | 2025-10-11 22:16:15Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537760 | hotstack | 2025-10-11 22:16:16Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537773 | hotstack | 2025-10-11 22:16:17Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker2]: DELETE_COMPLETE state changed 2025-10-11 18:16:28.537786 | hotstack | 2025-10-11 22:16:17Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker2-trunk0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537799 | hotstack | 2025-10-11 22:16:17Z [hs-c8eea6111faf4495bb5a4d8fda95714a.controller]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537812 | hotstack | 2025-10-11 22:16:18Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker2-trunk0]: DELETE_COMPLETE state changed 2025-10-11 18:16:28.537825 | hotstack | 2025-10-11 22:16:18Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker2-internal-api-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537838 | hotstack | 2025-10-11 22:16:18Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker2-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537851 | hotstack | 2025-10-11 22:16:18Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker2-tenant-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537864 | hotstack | 2025-10-11 22:16:18Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537877 | hotstack | 2025-10-11 22:16:19Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker2-tenant-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:28.537890 | hotstack | 2025-10-11 22:16:19Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker2-ctlplane-trunk-parent-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:28.537902 | hotstack | 2025-10-11 22:16:19Z [hs-c8eea6111faf4495bb5a4d8fda95714a.ironic-net-router-interface]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537915 | hotstack | 2025-10-11 22:16:19Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker2-internal-api-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:28.537928 | hotstack | 2025-10-11 22:16:20Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537941 | hotstack | 2025-10-11 22:16:20Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1]: DELETE_COMPLETE state changed 2025-10-11 18:16:28.537953 | hotstack | 2025-10-11 22:16:20Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1_init]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537966 | hotstack | 2025-10-11 22:16:20Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1-trunk0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.537979 | hotstack | 2025-10-11 22:16:20Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1_init]: DELETE_COMPLETE state changed 2025-10-11 18:16:28.538004 | hotstack | 2025-10-11 22:16:20Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1_hostname]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.538017 | hotstack | 2025-10-11 22:16:20Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1_hostname]: DELETE_COMPLETE state changed 2025-10-11 18:16:28.538033 | hotstack | 2025-10-11 22:16:20Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker1]: DELETE_COMPLETE state changed 2025-10-11 18:16:28.538046 | hotstack | 2025-10-11 22:16:21Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker1-trunk0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.538091 | hotstack | 2025-10-11 22:16:21Z [hs-c8eea6111faf4495bb5a4d8fda95714a.ironic-net-router-interface]: DELETE_COMPLETE state changed 2025-10-11 18:16:28.538108 | hotstack | 2025-10-11 22:16:22Z [hs-c8eea6111faf4495bb5a4d8fda95714a.router]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:28.538148 | hotstack | 2025-10-11 22:16:22Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1-trunk0]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814334 | hotstack | 2025-10-11 22:16:22Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1-storage-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814421 | hotstack | 2025-10-11 22:16:22Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1-tenant-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814437 | hotstack | 2025-10-11 22:16:22Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814452 | hotstack | 2025-10-11 22:16:22Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1-internal-api-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814474 | hotstack | 2025-10-11 22:16:22Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker1-trunk0]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814487 | hotstack | 2025-10-11 22:16:22Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker1-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814500 | hotstack | 2025-10-11 22:16:22Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker1-tenant-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814513 | hotstack | 2025-10-11 22:16:22Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker1-internal-api-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814526 | hotstack | 2025-10-11 22:16:23Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1-internal-api-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814539 | hotstack | 2025-10-11 22:16:23Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1-storage-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814554 | hotstack | 2025-10-11 22:16:23Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1-tenant-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814566 | hotstack | 2025-10-11 22:16:23Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute1-ctlplane-trunk-parent-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814641 | hotstack | 2025-10-11 22:16:23Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker1-internal-api-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814661 | hotstack | 2025-10-11 22:16:24Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker1-ctlplane-trunk-parent-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814674 | hotstack | 2025-10-11 22:16:24Z [hs-c8eea6111faf4495bb5a4d8fda95714a.router]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814699 | hotstack | 2025-10-11 22:16:24Z [hs-c8eea6111faf4495bb5a4d8fda95714a.controller]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814713 | hotstack | 2025-10-11 22:16:25Z [hs-c8eea6111faf4495bb5a4d8fda95714a.controller-init]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814726 | hotstack | 2025-10-11 22:16:25Z [hs-c8eea6111faf4495bb5a4d8fda95714a.controller-init]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814738 | hotstack | 2025-10-11 22:16:25Z [hs-c8eea6111faf4495bb5a4d8fda95714a.controller-write-files]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814751 | hotstack | 2025-10-11 22:16:25Z [hs-c8eea6111faf4495bb5a4d8fda95714a.controller-runcmd]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814764 | hotstack | 2025-10-11 22:16:25Z [hs-c8eea6111faf4495bb5a4d8fda95714a.controller_users]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814790 | hotstack | 2025-10-11 22:16:25Z [hs-c8eea6111faf4495bb5a4d8fda95714a.controller-write-files]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814804 | hotstack | 2025-10-11 22:16:25Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker1-tenant-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814816 | hotstack | 2025-10-11 22:16:25Z [hs-c8eea6111faf4495bb5a4d8fda95714a.controller-runcmd]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814829 | hotstack | 2025-10-11 22:16:25Z [hs-c8eea6111faf4495bb5a4d8fda95714a.controller_users]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814842 | hotstack | 2025-10-11 22:16:27Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814854 | hotstack | 2025-10-11 22:16:28Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker0]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814874 | hotstack | 2025-10-11 22:16:28Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0_init]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814887 | hotstack | 2025-10-11 22:16:28Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0_init]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814899 | hotstack | 2025-10-11 22:16:28Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker_init]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814912 | hotstack | 2025-10-11 22:16:28Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0_hostname]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814925 | hotstack | 2025-10-11 22:16:28Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0_hostname]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814937 | hotstack | 2025-10-11 22:16:28Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0-trunk0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814950 | hotstack | 2025-10-11 22:16:28Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker_init]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.814963 | hotstack | 2025-10-11 22:16:28Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker0-trunk0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814976 | hotstack | 2025-10-11 22:16:28Z [hs-c8eea6111faf4495bb5a4d8fda95714a.dataplane_users]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.814988 | hotstack | 2025-10-11 22:16:28Z [hs-c8eea6111faf4495bb5a4d8fda95714a.dataplane_users]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.815001 | hotstack | 2025-10-11 22:16:29Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker0-trunk0]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.815014 | hotstack | 2025-10-11 22:16:30Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker0-tenant-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.815028 | hotstack | 2025-10-11 22:16:30Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker0-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.815040 | hotstack | 2025-10-11 22:16:30Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0-trunk0]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.815053 | hotstack | 2025-10-11 22:16:30Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0-storage-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.815066 | hotstack | 2025-10-11 22:16:30Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker0-internal-api-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.815079 | hotstack | 2025-10-11 22:16:30Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0-internal-api-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.815092 | hotstack | 2025-10-11 22:16:30Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.815105 | hotstack | 2025-10-11 22:16:30Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0-tenant-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:38.815117 | hotstack | 2025-10-11 22:16:30Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker0-ctlplane-trunk-parent-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.815133 | hotstack | 2025-10-11 22:16:31Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker0-internal-api-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:38.815155 | hotstack | 2025-10-11 22:16:31Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0-storage-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930197 | hotstack | 2025-10-11 22:16:31Z [hs-c8eea6111faf4495bb5a4d8fda95714a.networker0-tenant-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930268 | hotstack | 2025-10-11 22:16:32Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0-internal-api-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930278 | hotstack | 2025-10-11 22:16:32Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0-tenant-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930285 | hotstack | 2025-10-11 22:16:32Z [hs-c8eea6111faf4495bb5a4d8fda95714a.compute0-ctlplane-trunk-parent-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930293 | hotstack | 2025-10-11 22:16:33Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930301 | hotstack | 2025-10-11 22:16:33Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-ironic-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930308 | hotstack | 2025-10-11 22:16:33Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-machine-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930316 | hotstack | 2025-10-11 22:16:33Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-cinder-vol1]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930323 | hotstack | 2025-10-11 22:16:33Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-cinder-vol0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930330 | hotstack | 2025-10-11 22:16:33Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-cinder-vol2]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930337 | hotstack | 2025-10-11 22:16:33Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-trunk0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930345 | hotstack | 2025-10-11 22:16:33Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-lvms-vol0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930360 | hotstack | 2025-10-11 22:16:34Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-ironic-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930367 | hotstack | 2025-10-11 22:16:34Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-machine-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930375 | hotstack | 2025-10-11 22:16:34Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930382 | hotstack | 2025-10-11 22:16:34Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-trunk0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930389 | hotstack | 2025-10-11 22:16:34Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-cinder-vol1]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930396 | hotstack | 2025-10-11 22:16:34Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-machine-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930403 | hotstack | 2025-10-11 22:16:34Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-cinder-vol2]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930414 | hotstack | 2025-10-11 22:16:34Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-cinder-vol0]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930421 | hotstack | 2025-10-11 22:16:34Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-ironic-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930445 | hotstack | 2025-10-11 22:16:34Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-cinder-vol2]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930453 | hotstack | 2025-10-11 22:16:34Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-lvms-vol0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930461 | hotstack | 2025-10-11 22:16:35Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-cinder-vol1]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930468 | hotstack | 2025-10-11 22:16:35Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-lvms-vol0]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930476 | hotstack | 2025-10-11 22:16:35Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-cinder-vol0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930483 | hotstack | 2025-10-11 22:16:35Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-trunk0]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930490 | hotstack | 2025-10-11 22:16:35Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-internal-api-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930497 | hotstack | 2025-10-11 22:16:35Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-tenant-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930505 | hotstack | 2025-10-11 22:16:35Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-octavia-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930522 | hotstack | 2025-10-11 22:16:35Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-storage-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930530 | hotstack | 2025-10-11 22:16:35Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930540 | hotstack | 2025-10-11 22:16:36Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-ironic-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930547 | hotstack | 2025-10-11 22:16:36Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-machine-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930554 | hotstack | 2025-10-11 22:16:36Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-storage-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930561 | hotstack | 2025-10-11 22:16:36Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-trunk0]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930569 | hotstack | 2025-10-11 22:16:36Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-tenant-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930576 | hotstack | 2025-10-11 22:16:36Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-storage-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930583 | hotstack | 2025-10-11 22:16:36Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-tenant-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930628 | hotstack | 2025-10-11 22:16:36Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-octavia-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930637 | hotstack | 2025-10-11 22:16:36Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-internal-api-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930645 | hotstack | 2025-10-11 22:16:36Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930653 | hotstack | 2025-10-11 22:16:36Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-octavia-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930661 | hotstack | 2025-10-11 22:16:36Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-ctlplane-trunk-parent-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930668 | hotstack | 2025-10-11 22:16:36Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master2-internal-api-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930676 | hotstack | 2025-10-11 22:16:37Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930684 | hotstack | 2025-10-11 22:16:37Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-cinder-vol0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:43.930691 | hotstack | 2025-10-11 22:16:37Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-storage-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:43.930706 | hotstack | 2025-10-11 22:16:37Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-trunk0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257178 | hotstack | 2025-10-11 22:16:37Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-ironic-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257281 | hotstack | 2025-10-11 22:16:37Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-machine-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257304 | hotstack | 2025-10-11 22:16:37Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-cinder-vol1]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257324 | hotstack | 2025-10-11 22:16:37Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-ctlplane-trunk-parent-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.257342 | hotstack | 2025-10-11 22:16:37Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-cinder-vol2]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257361 | hotstack | 2025-10-11 22:16:37Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-lvms-vol0]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257380 | hotstack | 2025-10-11 22:16:37Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-tenant-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.257398 | hotstack | 2025-10-11 22:16:37Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-internal-api-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.257415 | hotstack | 2025-10-11 22:16:37Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-octavia-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.257453 | hotstack | 2025-10-11 22:16:38Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-machine-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.257472 | hotstack | 2025-10-11 22:16:38Z [hs-c8eea6111faf4495bb5a4d8fda95714a.extra-dhcp-opts-value]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257491 | hotstack | 2025-10-11 22:16:38Z [hs-c8eea6111faf4495bb5a4d8fda95714a.extra-dhcp-opts-value]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.257509 | hotstack | 2025-10-11 22:16:38Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-ironic-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.257526 | hotstack | 2025-10-11 22:16:38Z [hs-c8eea6111faf4495bb5a4d8fda95714a.controller-machine-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257546 | hotstack | 2025-10-11 22:16:38Z [hs-c8eea6111faf4495bb5a4d8fda95714a.ironic-subnet]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257563 | hotstack | 2025-10-11 22:16:38Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-trunk0]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.257581 | hotstack | 2025-10-11 22:16:39Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-storage-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257698 | hotstack | 2025-10-11 22:16:39Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-internal-api-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257720 | hotstack | 2025-10-11 22:16:39Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-tenant-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257778 | hotstack | 2025-10-11 22:16:39Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257800 | hotstack | 2025-10-11 22:16:39Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-octavia-port]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257832 | hotstack | 2025-10-11 22:16:39Z [hs-c8eea6111faf4495bb5a4d8fda95714a.ironic-subnet]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.257852 | hotstack | 2025-10-11 22:16:39Z [hs-c8eea6111faf4495bb5a4d8fda95714a.ironic-net]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257870 | hotstack | 2025-10-11 22:16:39Z [hs-c8eea6111faf4495bb5a4d8fda95714a.controller-machine-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.257889 | hotstack | 2025-10-11 22:16:39Z [hs-c8eea6111faf4495bb5a4d8fda95714a.machine-subnet]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257908 | hotstack | 2025-10-11 22:16:39Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-storage-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.257925 | hotstack | 2025-10-11 22:16:39Z [hs-c8eea6111faf4495bb5a4d8fda95714a.storage-subnet]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257942 | hotstack | 2025-10-11 22:16:39Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-tenant-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.257960 | hotstack | 2025-10-11 22:16:39Z [hs-c8eea6111faf4495bb5a4d8fda95714a.tenant-subnet]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.257979 | hotstack | 2025-10-11 22:16:39Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-ctlplane-trunk-parent-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.257997 | hotstack | 2025-10-11 22:16:40Z [hs-c8eea6111faf4495bb5a4d8fda95714a.ctlplane-subnet]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.258015 | hotstack | 2025-10-11 22:16:40Z [hs-c8eea6111faf4495bb5a4d8fda95714a.storage-subnet]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258034 | hotstack | 2025-10-11 22:16:40Z [hs-c8eea6111faf4495bb5a4d8fda95714a.tenant-subnet]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258051 | hotstack | 2025-10-11 22:16:40Z [hs-c8eea6111faf4495bb5a4d8fda95714a.machine-subnet]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258069 | hotstack | 2025-10-11 22:16:40Z [hs-c8eea6111faf4495bb5a4d8fda95714a.storage-net]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.258086 | hotstack | 2025-10-11 22:16:40Z [hs-c8eea6111faf4495bb5a4d8fda95714a.tenant-net]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.258105 | hotstack | 2025-10-11 22:16:40Z [hs-c8eea6111faf4495bb5a4d8fda95714a.machine-net]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.258124 | hotstack | 2025-10-11 22:16:40Z [hs-c8eea6111faf4495bb5a4d8fda95714a.ctlplane-subnet]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258144 | hotstack | 2025-10-11 22:16:40Z [hs-c8eea6111faf4495bb5a4d8fda95714a.ironic-net]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258179 | hotstack | 2025-10-11 22:16:40Z [hs-c8eea6111faf4495bb5a4d8fda95714a.ctlplane-net]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.258199 | hotstack | 2025-10-11 22:16:40Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-internal-api-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258217 | hotstack | 2025-10-11 22:16:40Z [hs-c8eea6111faf4495bb5a4d8fda95714a.internal-api-subnet]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.258235 | hotstack | 2025-10-11 22:16:40Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-octavia-port]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258253 | hotstack | 2025-10-11 22:16:41Z [hs-c8eea6111faf4495bb5a4d8fda95714a.octavia-subnet]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.258271 | hotstack | 2025-10-11 22:16:41Z [hs-c8eea6111faf4495bb5a4d8fda95714a.internal-api-subnet]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258291 | hotstack | 2025-10-11 22:16:41Z [hs-c8eea6111faf4495bb5a4d8fda95714a.internal-api-net]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.258318 | hotstack | 2025-10-11 22:16:41Z [hs-c8eea6111faf4495bb5a4d8fda95714a.octavia-subnet]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258336 | hotstack | 2025-10-11 22:16:41Z [hs-c8eea6111faf4495bb5a4d8fda95714a.octavia-net]: DELETE_IN_PROGRESS state changed 2025-10-11 18:16:59.258355 | hotstack | 2025-10-11 22:16:41Z [hs-c8eea6111faf4495bb5a4d8fda95714a.storage-net]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258374 | hotstack | 2025-10-11 22:16:41Z [hs-c8eea6111faf4495bb5a4d8fda95714a.tenant-net]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258392 | hotstack | 2025-10-11 22:16:41Z [hs-c8eea6111faf4495bb5a4d8fda95714a.ctlplane-net]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258410 | hotstack | 2025-10-11 22:16:42Z [hs-c8eea6111faf4495bb5a4d8fda95714a.machine-net]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258427 | hotstack | 2025-10-11 22:16:42Z [hs-c8eea6111faf4495bb5a4d8fda95714a.internal-api-net]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258445 | hotstack | 2025-10-11 22:16:42Z [hs-c8eea6111faf4495bb5a4d8fda95714a.octavia-net]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258463 | hotstack | 2025-10-11 22:16:45Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-cinder-vol2]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258481 | hotstack | 2025-10-11 22:16:45Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-lvms-vol0]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258500 | hotstack | 2025-10-11 22:16:45Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-cinder-vol1]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258518 | hotstack | 2025-10-11 22:16:45Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master1-cinder-vol0]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.258547 | hotstack | 2025-10-11 22:16:55Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-cinder-vol0]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.336487 | hotstack | 2025-10-11 22:16:55Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-cinder-vol1]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.336561 | hotstack | 2025-10-11 22:16:55Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-lvms-vol0]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.336571 | hotstack | 2025-10-11 22:16:55Z [hs-c8eea6111faf4495bb5a4d8fda95714a.master0-cinder-vol2]: DELETE_COMPLETE state changed 2025-10-11 18:16:59.336580 | hotstack | 2025-10-11 22:16:55Z [hs-c8eea6111faf4495bb5a4d8fda95714a]: DELETE_COMPLETE Stack DELETE completed successfully 2025-10-11 22:16:59.744162 | hotstack | changed 2025-10-11 22:16:59.759467 | 2025-10-11 22:16:59.759664 | TASK [Print message that stack failed to delete] 2025-10-11 22:16:59.786931 | hotstack | skipping: Conditional result was False 2025-10-11 22:16:59.799654 | 2025-10-11 22:16:59.799786 | TASK [Print message that stack deleted successfully] 2025-10-11 22:16:59.847469 | hotstack | ok: Stack deleted successfully. 2025-10-11 22:16:59.858267 | 2025-10-11 22:16:59.858410 | TASK [Delete clouds.yaml] 2025-10-11 22:17:00.170804 | hotstack | Output suppressed because no_log was given 2025-10-11 22:17:00.240397 | 2025-10-11 22:17:00.240524 | PLAY RECAP 2025-10-11 22:17:00.240577 | hotstack | ok: 18 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 2 ignored: 1 2025-10-11 22:17:00.240603 | 2025-10-11 22:17:00.340757 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/hotstack/post.yaml@master] 2025-10-11 22:17:00.344367 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-10-11 22:17:00.944230 | 2025-10-11 22:17:00.944360 | PLAY [all] 2025-10-11 22:17:00.962892 | 2025-10-11 22:17:00.962980 | TASK [include_role : fetch-output] 2025-10-11 22:17:01.011679 | hotstack | ok 2025-10-11 22:17:01.028774 | 2025-10-11 22:17:01.028856 | TASK [fetch-output : Set log path for multiple nodes] 2025-10-11 22:17:01.083337 | hotstack | skipping: Conditional result was False 2025-10-11 22:17:01.090916 | 2025-10-11 22:17:01.091008 | TASK [fetch-output : Set log path for single node] 2025-10-11 22:17:01.135775 | hotstack | ok 2025-10-11 22:17:01.146828 | 2025-10-11 22:17:01.146963 | LOOP [fetch-output : Ensure local output dirs] 2025-10-11 22:17:01.602865 | hotstack -> localhost | ok: "/var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/work/logs" 2025-10-11 22:17:01.864426 | hotstack -> localhost | changed: "/var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/work/artifacts" 2025-10-11 22:17:02.106344 | hotstack -> localhost | changed: "/var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/work/docs" 2025-10-11 22:17:02.128288 | 2025-10-11 22:17:02.128464 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-10-11 22:17:02.878686 | hotstack | changed: 2025-10-11 22:17:02.879211 | hotstack | .d..t...... ./ 2025-10-11 22:17:02.879299 | hotstack | cd+++++++++ hotlogs/ 2025-10-11 22:17:02.879351 | hotstack | cd+++++++++ hotlogs/data/ 2025-10-11 22:17:02.879397 | hotstack | cd+++++++++ hotlogs/manifests/ 2025-10-11 22:17:02.879442 | hotstack | cd+++++++++ hotlogs/ocp_cluster/ 2025-10-11 22:17:02.879484 | hotstack | >f+++++++++ hotlogs/ocp_cluster/openshift_install.log 2025-10-11 22:17:02.879538 | hotstack | cd+++++++++ hotlogs/ocp_cluster/butane/ 2025-10-11 22:17:02.879580 | hotstack | >f+++++++++ hotlogs/ocp_cluster/butane/90-master-disable-netifnames.bu 2025-10-11 22:17:02.879622 | hotstack | >f+++++++++ hotlogs/ocp_cluster/butane/90-master-enable-iscsi.bu 2025-10-11 22:17:02.879662 | hotstack | >f+++++++++ hotlogs/ocp_cluster/butane/91-master-enable-multipath.bu 2025-10-11 22:17:02.879701 | hotstack | >f+++++++++ hotlogs/ocp_cluster/butane/92-master-lv-cinder-volumes.bu 2025-10-11 22:17:02.879739 | hotstack | cd+++++++++ hotlogs/ocp_cluster/config-assets/ 2025-10-11 22:17:02.879780 | hotstack | >f+++++++++ hotlogs/ocp_cluster/config-assets/95-etcd_config.yaml 2025-10-11 22:17:02.879817 | hotstack | >f+++++++++ hotlogs/ocp_cluster/config-assets/ovn_k8s_config.yaml 2025-10-11 22:17:02.879854 | hotstack | cd+++++++++ hotlogs/ocp_cluster/machine-configs/ 2025-10-11 22:17:02.879900 | hotstack | >f+++++++++ hotlogs/ocp_cluster/machine-configs/90-master-disable-netifnames.yaml 2025-10-11 22:17:02.879943 | hotstack | >f+++++++++ hotlogs/ocp_cluster/machine-configs/90-master-enable-iscsi.yaml 2025-10-11 22:17:02.879982 | hotstack | >f+++++++++ hotlogs/ocp_cluster/machine-configs/91-master-enable-multipath.yaml 2025-10-11 22:17:02.880052 | hotstack | >f+++++++++ hotlogs/ocp_cluster/machine-configs/92-master-lv-cinder-volumes.yaml 2025-10-11 22:17:02.880135 | hotstack | changed: All items complete 2025-10-11 22:17:02.880183 | 2025-10-11 22:17:03.458100 | hotstack | changed: .d..t...... ./ 2025-10-11 22:17:04.029237 | hotstack | changed: .d..t...... ./ 2025-10-11 22:17:04.054921 | 2025-10-11 22:17:04.055152 | TASK [include_role : fetch-output-openshift] 2025-10-11 22:17:04.082780 | hotstack | skipping: Conditional result was False 2025-10-11 22:17:04.096438 | 2025-10-11 22:17:04.096609 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2025-10-11 22:17:04.545899 | hotstack -> localhost | ok: Item: artifacts Runtime: 0:00:00.011851 2025-10-11 22:17:04.829895 | hotstack -> localhost | ok: Item: docs Runtime: 0:00:00.012532 2025-10-11 22:17:04.860088 | 2025-10-11 22:17:04.860202 | PLAY [all] 2025-10-11 22:17:04.874430 | 2025-10-11 22:17:04.874495 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2025-10-11 22:17:05.523577 | hotstack | changed 2025-10-11 22:17:05.569139 | 2025-10-11 22:17:05.569215 | PLAY RECAP 2025-10-11 22:17:05.569269 | hotstack | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2025-10-11 22:17:05.569301 | 2025-10-11 22:17:05.675516 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-10-11 22:17:05.680958 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2025-10-11 22:17:06.331627 | 2025-10-11 22:17:06.331749 | PLAY [localhost] 2025-10-11 22:17:06.349880 | 2025-10-11 22:17:06.349964 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2025-10-11 22:17:06.759627 | localhost | changed 2025-10-11 22:17:06.769289 | 2025-10-11 22:17:06.769463 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2025-10-11 22:17:06.815450 | localhost | ok 2025-10-11 22:17:06.832731 | 2025-10-11 22:17:06.832870 | TASK [add-fileserver : Create SSH private key tempfile] 2025-10-11 22:17:07.245432 | localhost | changed 2025-10-11 22:17:07.256721 | 2025-10-11 22:17:07.256852 | TASK [add-fileserver : Create SSH private key from secret] 2025-10-11 22:17:08.046975 | localhost | changed 2025-10-11 22:17:08.057489 | 2025-10-11 22:17:08.057624 | TASK [add-fileserver : Add fileserver ssh key] 2025-10-11 22:17:08.512905 | localhost | Identity added: /var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/work/tmp/ansible.dtoz31qg (/var/lib/zuul/builds/c8eea6111faf4495bb5a4d8fda95714a/work/tmp/ansible.dtoz31qg) 2025-10-11 22:17:08.513282 | localhost | ok: Runtime: 0:00:00.009083 2025-10-11 22:17:08.522583 | 2025-10-11 22:17:08.522727 | TASK [add-fileserver : Remove SSH private key from disk] 2025-10-11 22:17:08.818107 | localhost | ok: Runtime: 0:00:00.004919 2025-10-11 22:17:08.822823 | 2025-10-11 22:17:08.822887 | TASK [add-fileserver : Add fileserver to inventory] 2025-10-11 22:17:08.903271 | localhost | changed 2025-10-11 22:17:08.909060 | 2025-10-11 22:17:08.909149 | TASK [add-fileserver : Add fileserver server to known hosts] 2025-10-11 22:17:09.283384 | localhost | changed 2025-10-11 22:17:09.303153 | 2025-10-11 22:17:09.303223 | PLAY [localhost] 2025-10-11 22:17:09.315376 | 2025-10-11 22:17:09.315435 | TASK [Generate bulk log download script] 2025-10-11 22:17:09.354775 | localhost | ok 2025-10-11 22:17:09.366575 | 2025-10-11 22:17:09.366638 | TASK [local-log-download : Check API endpoint is defined] 2025-10-11 22:17:09.394519 | localhost | ok: All assertions passed 2025-10-11 22:17:09.399251 | 2025-10-11 22:17:09.399316 | TASK [local-log-download : Create download script] 2025-10-11 22:17:09.851055 | localhost -> localhost | changed 2025-10-11 22:17:09.869932 | 2025-10-11 22:17:09.870097 | TASK [Register quick-download link] 2025-10-11 22:17:09.905307 | localhost | ok 2025-10-11 22:17:09.937591 | 2025-10-11 22:17:09.937707 | PLAY [logserver.rdoproject.org] 2025-10-11 22:17:09.950789 | 2025-10-11 22:17:09.950878 | TASK [Set zuul-log-path fact] 2025-10-11 22:17:09.969556 | logserver.rdoproject.org | ok 2025-10-11 22:17:09.981342 | 2025-10-11 22:17:09.981441 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-10-11 22:17:10.022078 | logserver.rdoproject.org | ok 2025-10-11 22:17:10.033875 | 2025-10-11 22:17:10.034051 | TASK [upload-logs : Create log directories] 2025-10-11 22:17:11.064850 | logserver.rdoproject.org | changed 2025-10-11 22:17:11.071375 | 2025-10-11 22:17:11.071522 | TASK [upload-logs : Ensure logs are readable before uploading] 2025-10-11 22:17:11.403954 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.008554 2025-10-11 22:17:11.413312 | 2025-10-11 22:17:11.413459 | TASK [upload-logs : Upload logs to log server] 2025-10-11 22:17:12.132497 | logserver.rdoproject.org | Output suppressed because no_log was given 2025-10-11 22:17:12.138711 | 2025-10-11 22:17:12.138843 | LOOP [upload-logs : Compress console log and json output] 2025-10-11 22:17:12.182679 | logserver.rdoproject.org | skipping: Conditional result was False 2025-10-11 22:17:12.191596 | logserver.rdoproject.org | skipping: Conditional result was False 2025-10-11 22:17:12.203077 | 2025-10-11 22:17:12.203240 | LOOP [upload-logs : Upload compressed console log and json output] 2025-10-11 22:17:12.242886 | logserver.rdoproject.org | skipping: Conditional result was False 2025-10-11 22:17:12.243386 | 2025-10-11 22:17:12.245795 | logserver.rdoproject.org | skipping: Conditional result was False 2025-10-11 22:17:12.258458 | 2025-10-11 22:17:12.258624 | LOOP [upload-logs : Upload console log and json output]