2026-03-18 08:26:08.954515 | Job console starting...
2026-03-18 08:26:08.966671 | Updating repositories
2026-03-18 08:26:08.996294 | Preparing job workspace
2026-03-18 08:26:14.367002 | Running Ansible setup...
2026-03-18 08:26:18.163314 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-03-18 08:26:18.755909 | 
2026-03-18 08:26:18.756020 | PLAY [localhost]
2026-03-18 08:26:18.764837 | 
2026-03-18 08:26:18.764926 | TASK [Gathering Facts]
2026-03-18 08:26:19.782592 | localhost | ok
2026-03-18 08:26:19.815111 | 
2026-03-18 08:26:19.815309 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-18 08:26:20.281963 | localhost -> localhost | changed
2026-03-18 08:26:20.296044 | 
2026-03-18 08:26:20.296235 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-18 08:26:21.198591 | localhost -> localhost | changed
2026-03-18 08:26:21.217363 | 
2026-03-18 08:26:21.217555 | TASK [Setup log path fact]
2026-03-18 08:26:21.242308 | localhost | ok
2026-03-18 08:26:21.268302 | 
2026-03-18 08:26:21.268640 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-18 08:26:21.297461 | localhost | ok
2026-03-18 08:26:21.304689 | 
2026-03-18 08:26:21.304750 | TASK [emit-job-header : Print job information]
2026-03-18 08:26:21.336494 | # Job Information
2026-03-18 08:26:21.336786 | Ansible Version: 2.15.12
2026-03-18 08:26:21.336843 | Job: vexxhost-hotstack-3-nodes
2026-03-18 08:26:21.336887 | Pipeline: github-experimental-trigger
2026-03-18 08:26:21.336926 | Executor: ze04.softwarefactory-project.io
2026-03-18 08:26:21.336963 | Triggered by: https://github.com/openstack-k8s-operators/hotstack/pull/235
2026-03-18 08:26:21.337004 | Log URL (when completed): https://logserver.rdoproject.org/a60/rdoproject.org/a6011b973c2345d192387c6898cffebe/
2026-03-18 08:26:21.337044 | Event ID: ff4a9e90-22a3-11f1-9f94-30b1dc4c6575
2026-03-18 08:26:21.344590 | 
2026-03-18 08:26:21.344772 | LOOP [emit-job-header : Print node information]
2026-03-18 08:26:21.436193 | localhost | ok:
2026-03-18 08:26:21.436574 | localhost | # Node Information
2026-03-18 08:26:21.436633 | localhost | Inventory Hostname: hotstack
2026-03-18 08:26:21.436730 | localhost | Hostname: np0005650432
2026-03-18 08:26:21.436785 | localhost | Username: zuul
2026-03-18 08:26:21.436830 | localhost | Distro: CentOS 9
2026-03-18 08:26:21.436870 | localhost | Provider: vexxhost-nodepool-tripleo
2026-03-18 08:26:21.436908 | localhost | Region: RegionOne
2026-03-18 08:26:21.436945 | localhost | Label: cloud-centos-9-stream-tripleo-vexxhost
2026-03-18 08:26:21.436982 | localhost | Product Name: OpenStack Nova
2026-03-18 08:26:21.437019 | localhost | Interface IP: 38.102.83.70
2026-03-18 08:26:21.483507 | 
2026-03-18 08:26:21.483652 | PLAY [all]
2026-03-18 08:26:21.499073 | 
2026-03-18 08:26:21.499211 | TASK [Gather network facts]
2026-03-18 08:26:21.977367 | hotstack | ok
2026-03-18 08:26:22.011272 | 
2026-03-18 08:26:22.011421 | TASK [include_role : start-zuul-console]
2026-03-18 08:26:22.034310 | hotstack | ok
2026-03-18 08:26:22.050608 | 
2026-03-18 08:26:22.050773 | TASK [start-zuul-console : Start zuul_console daemon.]
2026-03-18 08:26:22.439803 | hotstack | ok
2026-03-18 08:26:22.453330 | 
2026-03-18 08:26:22.453410 | TASK [include_role : add-build-sshkey]
2026-03-18 08:26:22.484121 | hotstack | ok
2026-03-18 08:26:22.503262 | 
2026-03-18 08:26:22.503396 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-18 08:26:22.772115 | hotstack -> localhost | ok
2026-03-18 08:26:22.778000 | 
2026-03-18 08:26:22.778068 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-18 08:26:22.807797 | hotstack | ok
2026-03-18 08:26:22.821299 | hotstack | included: /var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-18 08:26:22.826928 | 
2026-03-18 08:26:22.826992 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-18 08:26:23.965488 | hotstack -> localhost | Generating public/private rsa key pair.
2026-03-18 08:26:23.965769 | hotstack -> localhost | Your identification has been saved in /var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/work/a6011b973c2345d192387c6898cffebe_id_rsa.
2026-03-18 08:26:23.965813 | hotstack -> localhost | Your public key has been saved in /var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/work/a6011b973c2345d192387c6898cffebe_id_rsa.pub.
2026-03-18 08:26:23.965844 | hotstack -> localhost | The key fingerprint is:
2026-03-18 08:26:23.965871 | hotstack -> localhost | SHA256:FFoWRF735nfnWjYbXQa2ko3nQ6MP2Xo98s+9IR8cAY0 zuul-build-sshkey
2026-03-18 08:26:23.965896 | hotstack -> localhost | The key's randomart image is:
2026-03-18 08:26:23.965922 | hotstack -> localhost | +---[RSA 3072]----+
2026-03-18 08:26:23.965945 | hotstack -> localhost | |       oB.. ..o  |
2026-03-18 08:26:23.966000 | hotstack -> localhost | |       = o . E.. |
2026-03-18 08:26:23.966030 | hotstack -> localhost | |      . o     =. |
2026-03-18 08:26:23.966055 | hotstack -> localhost | |       .     B o.|
2026-03-18 08:26:23.966081 | hotstack -> localhost | |        S   + B.*|
2026-03-18 08:26:23.966104 | hotstack -> localhost | |             O.=*|
2026-03-18 08:26:23.966128 | hotstack -> localhost | |            +.+B=|
2026-03-18 08:26:23.966156 | hotstack -> localhost | |             =+BO|
2026-03-18 08:26:23.966181 | hotstack -> localhost | |            ..==B|
2026-03-18 08:26:23.966207 | hotstack -> localhost | +----[SHA256]-----+
2026-03-18 08:26:23.966271 | hotstack -> localhost | ok: Runtime: 0:00:00.661861
2026-03-18 08:26:23.987267 | 
2026-03-18 08:26:23.987351 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-18 08:26:24.026785 | hotstack | ok
2026-03-18 08:26:24.038028 | hotstack | included: /var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-18 08:26:24.046341 | 
2026-03-18 08:26:24.046419 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-18 08:26:24.070417 | hotstack | skipping: Conditional result was False
2026-03-18 08:26:24.076312 | 
2026-03-18 08:26:24.076401 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-18 08:26:24.545579 | hotstack | changed
2026-03-18 08:26:24.556891 | 
2026-03-18 08:26:24.557030 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-18 08:26:24.860042 | hotstack | ok
2026-03-18 08:26:24.868140 | 
2026-03-18 08:26:24.868277 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-18 08:26:25.754572 | hotstack | changed
2026-03-18 08:26:25.765937 | 
2026-03-18 08:26:25.766084 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-18 08:26:26.590727 | hotstack | changed
2026-03-18 08:26:26.601672 | 
2026-03-18 08:26:26.601873 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-18 08:26:26.629366 | hotstack | skipping: Conditional result was False
2026-03-18 08:26:26.641810 | 
2026-03-18 08:26:26.641947 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-18 08:26:27.068080 | hotstack -> localhost | changed
2026-03-18 08:26:27.089917 | 
2026-03-18 08:26:27.090109 | TASK [add-build-sshkey : Add back temp key]
2026-03-18 08:26:27.404406 | hotstack -> localhost | Identity added: /var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/work/a6011b973c2345d192387c6898cffebe_id_rsa (zuul-build-sshkey)
2026-03-18 08:26:27.404846 | hotstack -> localhost | ok: Runtime: 0:00:00.013489
2026-03-18 08:26:27.417716 | 
2026-03-18 08:26:27.417856 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-18 08:26:27.805605 | hotstack | ok
2026-03-18 08:26:27.817348 | 
2026-03-18 08:26:27.817513 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-18 08:26:27.860784 | hotstack | skipping: Conditional result was False
2026-03-18 08:26:27.939945 | 
2026-03-18 08:26:27.940145 | TASK [include_role : validate-host]
2026-03-18 08:26:27.972582 | hotstack | ok
2026-03-18 08:26:27.992242 | 
2026-03-18 08:26:27.992313 | TASK [validate-host : Define zuul_info_dir fact]
2026-03-18 08:26:28.034619 | hotstack | ok
2026-03-18 08:26:28.040978 | 
2026-03-18 08:26:28.041062 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2026-03-18 08:26:28.333598 | hotstack -> localhost | ok
2026-03-18 08:26:28.347197 | 
2026-03-18 08:26:28.347349 | TASK [validate-host : Collect information about the host]
2026-03-18 08:26:29.073955 | hotstack | ok
2026-03-18 08:26:29.085980 | 
2026-03-18 08:26:29.086071 | TASK [validate-host : Sanitize hostname]
2026-03-18 08:26:29.158606 | hotstack | ok
2026-03-18 08:26:29.167567 | 
2026-03-18 08:26:29.167745 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2026-03-18 08:26:29.715820 | hotstack -> localhost | changed
2026-03-18 08:26:29.722449 | 
2026-03-18 08:26:29.722560 | TASK [validate-host : Collect information about zuul worker]
2026-03-18 08:26:30.126525 | hotstack | ok
2026-03-18 08:26:30.138114 | 
2026-03-18 08:26:30.138262 | TASK [validate-host : Write out all zuul information for each host]
2026-03-18 08:26:30.624749 | hotstack -> localhost | changed
2026-03-18 08:26:30.645661 | 
2026-03-18 08:26:30.645864 | TASK [include_role : prepare-workspace-openshift]
2026-03-18 08:26:30.672719 | hotstack | skipping: Conditional result was False
2026-03-18 08:26:30.684079 | 
2026-03-18 08:26:30.684226 | TASK [include_role : remove-zuul-sshkey]
2026-03-18 08:26:30.710469 | hotstack | skipping: Conditional result was False
2026-03-18 08:26:30.722219 | 
2026-03-18 08:26:30.722357 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-18 08:26:31.007201 | hotstack | ok: "logs"
2026-03-18 08:26:31.007638 | hotstack | ok: All items complete
2026-03-18 08:26:31.007737 | 
2026-03-18 08:26:31.240619 | hotstack | ok: "artifacts"
2026-03-18 08:26:31.491431 | hotstack | ok: "docs"
2026-03-18 08:26:31.512120 | 
2026-03-18 08:26:31.512335 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-18 08:26:31.802207 | hotstack | changed: "logs"
2026-03-18 08:26:32.037124 | hotstack | changed: "artifacts"
2026-03-18 08:26:32.303238 | hotstack | changed: "docs"
2026-03-18 08:26:32.342049 | 
2026-03-18 08:26:32.342180 | PLAY RECAP
2026-03-18 08:26:32.342236 | hotstack | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-03-18 08:26:32.342271 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-18 08:26:32.342295 | 
2026-03-18 08:26:32.457955 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-03-18 08:26:32.462752 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/hotstack/pre_stage1.yaml@master]
2026-03-18 08:26:33.066509 | 
2026-03-18 08:26:33.066664 | PLAY [Create necessary files to deploy hotstack scenario]
2026-03-18 08:26:33.087072 | 
2026-03-18 08:26:33.087173 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-18 08:26:33.506546 | hotstack | ok
2026-03-18 08:26:33.515301 | 
2026-03-18 08:26:33.515414 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-18 08:26:35.751333 | hotstack | Output suppressed because no_log was given
2026-03-18 08:26:35.771515 | 
2026-03-18 08:26:35.771651 | LOOP [add-authorized-keys : Enable access via build key on all nodes]
2026-03-18 08:26:36.230539 | hotstack | changed:
2026-03-18 08:26:36.230766 | hotstack | {
2026-03-18 08:26:36.230806 | hotstack |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCINPOs6XsfMVQMqjmiduT3Bxhogy7MbAFOWlR+9LlKkTW1kV6glsCXY5svtggd2zRtc40UWalHaj9jC+yEkZdI35h2PkK+Sww52u4nczqgNpIFNt7Dm2xtYKbTolAV9jSeNkRlGMCq9EBzQlwiV0HkHx1CdNR/zzXbyNZLmOybFkXqR150H01kUhdv0v6AMWTDZjMEWO/PaWCOgzZhH9ztXjy+rwa7pdaI4+0Pb9Kib+d8/IrgNsLB/sCazqD+9/COI6AHqzTDS1aU9/gMQrUN1ronzMEQhzzOuoI8WeLqU++j+0dT2UWVPlQqoln+RYu7dUn/DSZDrsYenudT5+P"
2026-03-18 08:26:36.230838 | hotstack | }
2026-03-18 08:26:36.259440 | 
2026-03-18 08:26:36.259587 | TASK [Assert cloud name and cloud secret]
2026-03-18 08:26:36.327542 | hotstack | Output suppressed because no_log was given
2026-03-18 08:26:36.338355 | 
2026-03-18 08:26:36.338486 | TASK [Ensure openstack release repo is installed]
2026-03-18 08:26:40.392271 | hotstack | changed
2026-03-18 08:26:40.403665 | 
2026-03-18 08:26:40.403887 | TASK [Install openstack client packages]
2026-03-18 08:26:57.848430 | hotstack | changed
2026-03-18 08:26:57.853839 | 
2026-03-18 08:26:57.853911 | TASK [Ensure HotStack work dir]
2026-03-18 08:26:58.198082 | hotstack | changed
2026-03-18 08:26:58.203109 | 
2026-03-18 08:26:58.203172 | LOOP [Ensure etc directories]
2026-03-18 08:26:58.475032 | hotstack | changed: "/etc/openstack"
2026-03-18 08:26:58.475906 | hotstack | changed: All items complete
2026-03-18 08:26:58.476001 | 
2026-03-18 08:26:58.707624 | hotstack | changed: "/etc/hotstack"
2026-03-18 08:26:58.724460 | 
2026-03-18 08:26:58.724594 | TASK [Ensure .ssh dir exists]
2026-03-18 08:26:58.968007 | hotstack | Output suppressed because no_log was given
2026-03-18 08:26:58.980124 | 
2026-03-18 08:26:58.980252 | TASK [Ensure ssh keypair exists]
2026-03-18 08:27:09.543517 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:09.549614 | 
2026-03-18 08:27:09.549704 | TASK [Generate CA cert file]
2026-03-18 08:27:09.584064 | hotstack | skipping: Conditional result was False
2026-03-18 08:27:09.597282 | 
2026-03-18 08:27:09.597465 | TASK [Update CA certs]
2026-03-18 08:27:10.149263 | hotstack | skipping: Conditional result was False
2026-03-18 08:27:10.161272 | 
2026-03-18 08:27:10.161412 | TASK [Set _auth_type fact]
2026-03-18 08:27:10.219319 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:10.230036 | 
2026-03-18 08:27:10.230172 | TASK [Write clouds.yaml - user/password]
2026-03-18 08:27:11.273520 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:11.279333 | 
2026-03-18 08:27:11.279485 | TASK [Create application credential for sushy-emulator]
2026-03-18 08:27:13.814776 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:13.826821 | 
2026-03-18 08:27:13.826950 | TASK [Read application credential from file]
2026-03-18 08:27:14.182004 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:14.196433 | 
2026-03-18 08:27:14.196661 | TASK [Delete temporary application credential file]
2026-03-18 08:27:14.446370 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:14.451182 | 
2026-03-18 08:27:14.451244 | TASK [Assert application credential id and secret]
2026-03-18 08:27:14.530411 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:14.541133 | 
2026-03-18 08:27:14.541264 | TASK [Write new clouds.yaml with application credentials]
2026-03-18 08:27:15.324055 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:15.337602 | 
2026-03-18 08:27:15.337890 | TASK [Write hotstack cloud-secret.yaml]
2026-03-18 08:27:16.073081 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:16.084712 | 
2026-03-18 08:27:16.084852 | TASK [Write clouds.yaml with application credentials]
2026-03-18 08:27:16.124500 | 
2026-03-18 08:27:16.124860 | TASK [Write hotstack cloud-secret.yaml]
2026-03-18 08:27:16.261300 | 
2026-03-18 08:27:16.261466 | PLAY RECAP
2026-03-18 08:27:16.261523 | hotstack | ok: 18 changed: 11 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 0
2026-03-18 08:27:16.261553 | 
2026-03-18 08:27:16.373804 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/hotstack/pre_stage1.yaml@master]
2026-03-18 08:27:16.375970 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/hotstack/pre_stage2.yaml@master]
2026-03-18 08:27:16.960184 | 
2026-03-18 08:27:16.960351 | PLAY [Create hotstack scenario]
2026-03-18 08:27:16.982590 | 
2026-03-18 08:27:16.982720 | TASK [Assert scenario is defined]
2026-03-18 08:27:17.065206 | hotstack | ok: All assertions passed
2026-03-18 08:27:17.074031 | 
2026-03-18 08:27:17.074151 | TASK [Fetch bootstrap vars from remote to zuul executor]
2026-03-18 08:27:17.544121 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:17.556637 | 
2026-03-18 08:27:17.556843 | TASK [Load bootstrap vars with template resolution]
2026-03-18 08:27:17.606616 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:17.617579 | 
2026-03-18 08:27:17.617783 | TASK [Fetch automation vars from remote to zuul executor]
2026-03-18 08:27:18.007108 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:18.017786 | 
2026-03-18 08:27:18.017924 | TASK [Load automation vars with template resolution]
2026-03-18 08:27:18.106446 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:18.116975 | 
2026-03-18 08:27:18.117106 | TASK [Slurp zuul-build-sshkey from file]
2026-03-18 08:27:18.504764 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:18.516239 | 
2026-03-18 08:27:18.516382 | TASK [Set up infrastructure (Heat stack)]
2026-03-18 08:27:18.547595 | hotstack | Output suppressed because no_log was given
2026-03-18 08:27:18.604172 | 
2026-03-18 08:27:18.604338 | TASK [dataplane_ssh_keys : Ensure Dataplane ssh keypair exists]
2026-03-18 08:27:19.232718 | hotstack | changed
2026-03-18 08:27:19.245167 | 
2026-03-18 08:27:19.245314 | TASK [dataplane_ssh_keys : Ensure Nova migration ssh keypair exists]
2026-03-18 08:27:19.643054 | hotstack | changed
2026-03-18 08:27:19.658012 | 
2026-03-18 08:27:19.658175 | TASK [dataplane_ssh_keys : Set SSH public key facts]
2026-03-18 08:27:19.704529 | hotstack | ok
2026-03-18 08:27:19.713621 | 
2026-03-18 08:27:19.713786 | TASK [dataplane_ssh_keys : Store SSH public key facts in file]
2026-03-18 08:27:20.640877 | hotstack | changed
2026-03-18 08:27:20.663892 | 
2026-03-18 08:27:20.664057 | TASK [heat_stack : Assert config is defined]
2026-03-18 08:27:20.772555 | hotstack | ok: All assertions passed
2026-03-18 08:27:20.783394 | 
2026-03-18 08:27:20.783520 | TASK [heat_stack : Get latest snapset and update stack parameters]
2026-03-18 08:27:20.820525 | hotstack | skipping: Conditional result was False
2026-03-18 08:27:20.832839 | 
2026-03-18 08:27:20.833000 | TASK [heat_stack : Debug latest snapset information]
2026-03-18 08:27:20.869314 | hotstack | skipping: Conditional result was False
2026-03-18 08:27:20.882524 | 
2026-03-18 08:27:20.882711 | LOOP [heat_stack : Create tar archives and compress]
2026-03-18 08:27:20.915409 | 
2026-03-18 08:27:20.915715 | TASK [heat_stack : Create stack]
2026-03-18 08:29:39.288848 | hotstack | changed
2026-03-18 08:29:39.297078 | 
2026-03-18 08:29:39.297169 | TASK [heat_stack : Wait for stack to complete]
2026-03-18 08:29:40.980475 | hotstack | ok
2026-03-18 08:29:40.993092 | 
2026-03-18 08:29:40.993223 | TASK [heat_stack : Stop if stack not complete]
2026-03-18 08:29:41.020729 | hotstack | skipping: Conditional result was False
2026-03-18 08:29:41.033746 | 
2026-03-18 08:29:41.033932 | TASK [heat_stack : Get stack outputs]
2026-03-18 08:29:42.787318 | hotstack | changed
2026-03-18 08:29:42.801528 | 
2026-03-18 08:29:42.801737 | TASK [heat_stack : Set stack outputs facts]
2026-03-18 08:29:42.851085 | hotstack | ok
2026-03-18 08:29:42.866488 | 
2026-03-18 08:29:42.866897 | TASK [heat_stack : Store stack outputs in file]
2026-03-18 08:29:43.637822 | hotstack | changed
2026-03-18 08:29:43.651343 | 
2026-03-18 08:29:43.651478 | TASK [Fetch stack outputs from remote to zuul executor]
2026-03-18 08:29:44.007917 | hotstack | Output suppressed because no_log was given
2026-03-18 08:29:44.015664 | 
2026-03-18 08:29:44.015767 | TASK [Load stack output vars with template resolution]
2026-03-18 08:29:44.061851 | hotstack | Output suppressed because no_log was given
2026-03-18 08:29:44.072139 | 
2026-03-18 08:29:44.072265 | TASK [Fetch cloud secrets from remote to zuul executor]
2026-03-18 08:29:44.446763 | hotstack | Output suppressed because no_log was given
2026-03-18 08:29:44.457169 | 
2026-03-18 08:29:44.457336 | TASK [Load hotstack cloud secret vars with template resolution]
2026-03-18 08:29:44.494961 | hotstack | Output suppressed because no_log was given
2026-03-18 08:29:44.507175 | 
2026-03-18 08:29:44.507295 | TASK [Add Hotstack controller-0 to ansible inventory]
2026-03-18 08:29:44.545130 | hotstack | Output suppressed because no_log was given
2026-03-18 08:29:44.556564 | 
2026-03-18 08:29:44.556722 | TASK [Wait for Hotstack controller-0 to be ready]
2026-03-18 08:29:50.704528 | hotstack -> 38.102.83.179 | Output suppressed because no_log was given
2026-03-18 08:29:50.716085 | 
2026-03-18 08:29:50.716218 | TASK [Start Zuul console on Hotstack controller-0]
2026-03-18 08:29:50.743489 | hotstack | Output suppressed because no_log was given
2026-03-18 08:29:50.787897 | 
2026-03-18 08:29:50.788003 | TASK [start-zuul-console : Start zuul_console daemon.]
2026-03-18 08:29:51.253547 | hotstack -> 38.102.83.179 | ok
2026-03-18 08:29:51.279977 | 
2026-03-18 08:29:51.280225 | TASK [Prepare the controller node]
2026-03-18 08:29:51.339411 | hotstack | Output suppressed because no_log was given
2026-03-18 08:29:51.380636 | 
2026-03-18 08:29:51.380745 | TASK [controller : Assert config is defined]
2026-03-18 08:29:51.478586 | hotstack | ok: All assertions passed
2026-03-18 08:29:51.490068 | 
2026-03-18 08:29:51.490204 | TASK [controller : Add controller-0 to the Ansible inventory]
2026-03-18 08:29:51.537376 | hotstack | ok
2026-03-18 08:29:51.548298 | 
2026-03-18 08:29:51.548450 | TASK [controller : Read Dataplane SSH private key content]
2026-03-18 08:29:51.819262 | hotstack | ok
2026-03-18 08:29:51.830181 | 
2026-03-18 08:29:51.830317 | TASK [controller : Read Nova migration SSH private key content]
2026-03-18 08:29:52.093274 | hotstack | ok
2026-03-18 08:29:52.104717 | 
2026-03-18 08:29:52.104855 | TASK [controller : Wait for controller-0 to be ready]
2026-03-18 08:29:52.776271 | hotstack -> 38.102.83.179 | ok
2026-03-18 08:29:52.789158 | 
2026-03-18 08:29:52.789301 | LOOP [controller : Ensure directories exists]
2026-03-18 08:29:53.406724 | hotstack -> 38.102.83.179 | changed: "/home/zuul/data"
2026-03-18 08:29:53.407333 | 
2026-03-18 08:29:53.878855 | hotstack -> 38.102.83.179 | changed: "/home/zuul/bin"
2026-03-18 08:29:53.895726 | 
2026-03-18 08:29:53.895921 | TASK [controller : Setup NFS server]
2026-03-18 08:29:53.985388 | hotstack | ok
2026-03-18 08:29:54.002252 | hotstack | included: /var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/controller/tasks/setup_nfs.yml
2026-03-18 08:29:54.020178 | 
2026-03-18 08:29:54.020322 | LOOP [controller : Create NFS export directories]
2026-03-18 08:29:54.612251 | hotstack -> 38.102.83.179 | changed:
2026-03-18 08:29:54.612655 | hotstack -> 38.102.83.179 | {
2026-03-18 08:29:54.612757 | hotstack -> 38.102.83.179 |   "mode": "0777",
2026-03-18 08:29:54.612817 | hotstack -> 38.102.83.179 |   "path": "/export/nova-console-recordings"
2026-03-18 08:29:54.612881 | hotstack -> 38.102.83.179 | }
2026-03-18 08:29:54.629368 | 
2026-03-18 08:29:54.629557 | TASK [controller : Configure NFS exports]
2026-03-18 08:29:55.780080 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:29:55.793808 | 
2026-03-18 08:29:55.793950 | TASK [controller : Enable and start NFS server]
2026-03-18 08:29:57.284100 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:29:57.299518 | 
2026-03-18 08:29:57.299669 | TASK [controller : Reload NFS exports]
2026-03-18 08:29:57.858990 | hotstack -> 38.102.83.179 | ok
2026-03-18 08:29:57.865776 | 
2026-03-18 08:29:57.865890 | LOOP [controller : Add common functions to the bin_dir]
2026-03-18 08:29:58.858444 | hotstack -> 38.102.83.179 | changed: "bin/hotstack-common-funcs.sh"
2026-03-18 08:29:58.858773 | hotstack -> 38.102.83.179 | changed: All items complete
2026-03-18 08:29:58.858807 | 
2026-03-18 08:29:58.877138 | 
2026-03-18 08:29:58.877329 | LOOP [controller : Add bin utilities to the bin_dir]
2026-03-18 08:29:59.908877 | hotstack -> 38.102.83.179 | changed: "bin/hotstack-approve-install-plan"
2026-03-18 08:30:00.937358 | hotstack -> 38.102.83.179 | changed: "bin/hotstack-collect-tempest-logs"
2026-03-18 08:30:01.790257 | hotstack -> 38.102.83.179 | changed: "bin/hotstack-leader-election-tune"
2026-03-18 08:30:02.433906 | hotstack -> 38.102.83.179 | changed: "bin/hotstack-nova-discover-hosts"
2026-03-18 08:30:03.083969 | hotstack -> 38.102.83.179 | changed: "bin/hotstack-snapset"
2026-03-18 08:30:03.726316 | hotstack -> 38.102.83.179 | changed: "bin/hotstack-openstack-version-patch"
2026-03-18 08:30:04.336923 | hotstack -> 38.102.83.179 | changed: "bin/hotstack-wait-for-bmh"
2026-03-18 08:30:04.358141 | 
2026-03-18 08:30:04.358307 | TASK [controller : Write ansible inventory to file on controller-0]
2026-03-18 08:30:04.435784 | hotstack | skipping: Conditional result was False
2026-03-18 08:30:04.449310 | 
2026-03-18 08:30:04.449464 | TASK [controller : Copy Dataplane ssh private key to controller]
2026-03-18 08:30:05.140927 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:30:05.154010 | 
2026-03-18 08:30:05.154149 | TASK [controller : Copy Dataplane ssh public key to controller]
2026-03-18 08:30:05.835865 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:30:05.849056 | 
2026-03-18 08:30:05.849256 | TASK [controller : Copy Nova migrate ssh private key to controller]
2026-03-18 08:30:06.571971 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:30:06.585492 | 
2026-03-18 08:30:06.585632 | TASK [controller : Copy Nova migrate ssh public key to controller]
2026-03-18 08:30:07.331560 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:30:07.345434 | 
2026-03-18 08:30:07.345593 | TASK [controller : Copy dataplane authorized keys to controller]
2026-03-18 08:30:08.039844 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:30:08.053376 | 
2026-03-18 08:30:08.053553 | TASK [controller : Ensure cloud config directory exists]
2026-03-18 08:30:08.389737 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:30:08.400492 | 
2026-03-18 08:30:08.400647 | TASK [controller : Template the clouds.yaml]
2026-03-18 08:30:09.183085 | hotstack -> 38.102.83.179 | Output suppressed because no_log was given
2026-03-18 08:30:09.195658 | 
2026-03-18 08:30:09.195906 | TASK [controller : Write CA certificate to file]
2026-03-18 08:30:09.929361 | hotstack -> 38.102.83.179 | Output suppressed because no_log was given
2026-03-18 08:30:09.941332 | 
2026-03-18 08:30:09.941493 | TASK [controller : Write Ironic nodes YAML]
2026-03-18 08:30:09.989329 | hotstack | skipping: Conditional result was False
2026-03-18 08:30:10.002326 | 
2026-03-18 08:30:10.002479 | TASK [controller : Install OpenStack client]
2026-03-18 08:30:10.059743 | hotstack | skipping: Conditional result was False
2026-03-18 08:30:10.096918 | 
2026-03-18 08:30:10.097172 | TASK [Install Openshift]
2026-03-18 08:30:10.135078 | hotstack | Output suppressed because no_log was given
2026-03-18 08:30:10.230457 | 
2026-03-18 08:30:10.230573 | TASK [ocp_agent_installer : Skip OCP agent installer for MicroShift]
2026-03-18 08:30:10.264890 | hotstack | skipping: Conditional result was False
2026-03-18 08:30:10.272831 | 
2026-03-18 08:30:10.272944 | TASK [ocp_agent_installer : Assert config is defined]
2026-03-18 08:30:10.369338 | hotstack -> 38.102.83.179 | ok: All assertions passed
2026-03-18 08:30:10.382103 | 
2026-03-18 08:30:10.382253 | TASK [ocp_agent_installer : Install using agent installer]
2026-03-18 08:30:10.442249 | hotstack | ok
2026-03-18 08:30:10.471835 | hotstack | included: /var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/_install.yml
2026-03-18 08:30:10.482543 | 
2026-03-18 08:30:10.482628 | TASK [ocp_agent_installer : Assert config is defined]
2026-03-18 08:30:10.569779 | hotstack -> 38.102.83.179 | ok: All assertions passed
2026-03-18 08:30:10.581967 | 
2026-03-18 08:30:10.582093 | LOOP [ocp_agent_installer : Ensure directory exists]
2026-03-18 08:30:10.918978 | hotstack -> 38.102.83.179 | ok: "/home/zuul/bin"
2026-03-18 08:30:10.919336 | hotstack -> 38.102.83.179 | changed: All items complete
2026-03-18 08:30:10.919381 | 
2026-03-18 08:30:11.190890 | hotstack -> 38.102.83.179 | changed: "/home/zuul/.kube"
2026-03-18 08:30:11.451311 | hotstack -> 38.102.83.179 | changed: "/home/zuul/ocp-cluster"
2026-03-18 08:30:11.769351 | hotstack -> 38.102.83.179 | changed: "/home/zuul/ocp-cluster/openshift"
2026-03-18 08:30:12.060258 | hotstack -> 38.102.83.179 | changed: "/home/zuul/agent-installer"
2026-03-18 08:30:12.330367 | hotstack -> 38.102.83.179 | changed: "/home/zuul/cluster-custom-config/"
2026-03-18 08:30:12.616088 | hotstack -> 38.102.83.179 | changed: "/home/zuul/cluster-custom-config//butane"
2026-03-18 08:30:12.934741 | hotstack -> 38.102.83.179 | changed: "/home/zuul/cluster-custom-config//machine-configs"
2026-03-18 08:30:13.222020 | hotstack -> 38.102.83.179 | changed: "/home/zuul/cluster-custom-config//config-assets"
2026-03-18 08:30:13.244815 | 
2026-03-18 08:30:13.245015 | TASK [ocp_agent_installer : Install package requirements for agent installer]
2026-03-18 08:31:20.757300 | hotstack -> 38.102.83.179 | ok: Nothing to do
2026-03-18 08:31:20.770615 | 
2026-03-18 08:31:20.770795 | TASK [ocp_agent_installer : Run tasks/install_client.yml]
2026-03-18 08:31:20.818925 | hotstack | ok
2026-03-18 08:31:20.834663 | hotstack | included: /var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/install_client.yml
2026-03-18 08:31:20.856077 | 
2026-03-18 08:31:20.856165 | TASK [ocp_agent_installer : Download the client]
2026-03-18 08:31:22.695638 | hotstack -> 38.102.83.179 | changed: OK (73371188 bytes)
2026-03-18 08:31:22.713996 | 
2026-03-18 08:31:22.714154 | TASK [ocp_agent_installer : Extract client to /home/zuul/bin]
2026-03-18 08:31:27.041461 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:31:27.050295 | 
2026-03-18 08:31:27.050450 | TASK [ocp_agent_installer : Configure bash completion]
2026-03-18 08:31:27.578637 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:31:27.591497 | 
2026-03-18 08:31:27.591626 | TASK [ocp_agent_installer : Run tasks/install_installer.yml]
2026-03-18 08:31:27.640991 | hotstack | ok
2026-03-18 08:31:27.655490 | hotstack | included: /var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/install_installer.yml
2026-03-18 08:31:27.678794 | 
2026-03-18 08:31:27.678878 | TASK [ocp_agent_installer : Download the installer]
2026-03-18 08:31:34.975510 | hotstack -> 38.102.83.179 | changed: OK (437745083 bytes)
2026-03-18 08:31:34.992727 | 
2026-03-18 08:31:34.992894 | TASK [ocp_agent_installer : Extract installer to /home/zuul/bin]
2026-03-18 08:31:49.642922 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:31:49.656839 | 
2026-03-18 08:31:49.657026 | TASK [ocp_agent_installer : Write OCP install-config.yaml]
2026-03-18 08:31:50.401356 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:31:50.452941 | 
2026-03-18 08:31:50.453087 | TASK [ocp_agent_installer : Replace pull secret in install-config.yaml]
2026-03-18 08:31:50.896049 | hotstack -> 38.102.83.179 | Output suppressed because no_log was given
2026-03-18 08:31:50.908264 | 
2026-03-18 08:31:50.908400 | TASK [ocp_agent_installer : Write OCP agent-config.yaml]
2026-03-18 08:31:51.597542 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:31:51.611511 | 
2026-03-18 08:31:51.611644 | TASK [ocp_agent_installer : Include tasks to generate machine configs]
2026-03-18 08:31:51.659834 | hotstack | ok
2026-03-18 08:31:51.681783 | hotstack | included: /var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/machine_configs.yml
2026-03-18 08:31:51.704910 | 
2026-03-18 08:31:51.704993 | LOOP [ocp_agent_installer : Template butane config for net.ifnames]
2026-03-18 08:31:52.431755 | hotstack -> 38.102.83.179 | changed: "master"
2026-03-18 08:31:52.455801 | 
2026-03-18 08:31:52.455976 | LOOP [ocp_agent_installer : Generate MachineConfig for iscsi]
2026-03-18 08:31:52.870577 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:31:52.871297 | hotstack -> 38.102.83.179 | changed: All items complete
2026-03-18 08:31:52.871400 | 
2026-03-18 08:31:52.894796 | 
2026-03-18 08:31:52.894956 | LOOP [ocp_agent_installer : Template butane config for iscsi]
2026-03-18 08:31:53.633314 | hotstack -> 38.102.83.179 | changed: "master"
2026-03-18 08:31:53.648976 | 
2026-03-18 08:31:53.649140 | LOOP [ocp_agent_installer : Generate MachineConfig for iscsi]
2026-03-18 08:31:54.037077 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:31:54.037510 | hotstack -> 38.102.83.179 | changed: All items complete
2026-03-18 08:31:54.037572 | 
2026-03-18 08:31:54.054797 | 
2026-03-18 08:31:54.055015 | LOOP [ocp_agent_installer : Template butane config for multipath]
2026-03-18 08:31:54.733667 | hotstack -> 38.102.83.179 | changed: "master"
2026-03-18 08:31:54.756993 | 
2026-03-18 08:31:54.757192 | LOOP [ocp_agent_installer : Generate MachineConfig for multipath]
2026-03-18 08:31:55.181954 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:31:55.182378 | hotstack -> 38.102.83.179 | changed: All items complete
2026-03-18 08:31:55.182439 | 
2026-03-18 08:31:55.198018 | 
2026-03-18 08:31:55.198173 | LOOP [ocp_agent_installer : Template butane config for LVM cinder-volumes]
2026-03-18 08:31:55.948450 | hotstack -> 38.102.83.179 | changed: "master"
2026-03-18 08:31:55.964037 | 
2026-03-18 08:31:55.964206 | LOOP [ocp_agent_installer : Generate MachineConfig for multipath]
2026-03-18 08:31:56.328270 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:31:56.328829 | hotstack -> 38.102.83.179 | changed: All items complete
2026-03-18 08:31:56.328927 | 
2026-03-18 08:31:56.344141 | 
2026-03-18 08:31:56.344346 | TASK [ocp_agent_installer : Include tasks to generate config assets]
2026-03-18 08:31:56.383360 | hotstack | ok
2026-03-18 08:31:56.405114 | hotstack | included: /var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/config_assets.yml
2026-03-18 08:31:56.432966 | 
2026-03-18 08:31:56.433057 | TASK [ocp_agent_installer : Template ovn-k8s customization]
2026-03-18 08:31:57.111063 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:31:57.124459 | 
2026-03-18 08:31:57.124620 | TASK [ocp_agent_installer : Copy Etcd customization]
2026-03-18 08:31:57.826135 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:31:57.838402 | 
2026-03-18 08:31:57.838563 | TASK [ocp_agent_installer : Template ImageContentSourcePolicy customization]
2026-03-18 08:31:57.905592 | hotstack | skipping: Conditional result was False
2026-03-18 08:31:57.918950 | 
2026-03-18 08:31:57.919152 | TASK [ocp_agent_installer : Initialize _ocp_additional_trusted_ca_map fact]
2026-03-18 08:31:57.977741 | hotstack | skipping: Conditional result was False
2026-03-18 08:31:57.990484 | 
2026-03-18 08:31:57.990723 | LOOP [ocp_agent_installer : Append to _ocp_additional_trusted_ca_map fact]
2026-03-18 08:31:58.045959 | hotstack | skipping: Conditional result was False
2026-03-18 08:31:58.054800 | 
2026-03-18 08:31:58.054927 | TASK [ocp_agent_installer : Template additional CA config map]
2026-03-18 08:31:58.100153 | hotstack | skipping: Conditional result was False
2026-03-18 08:31:58.106225 | 
2026-03-18 08:31:58.106290 | TASK [ocp_agent_installer : Template Image config (additionalTrustedCA and/or insecureRegistries)]
2026-03-18 08:31:58.151230 | hotstack | skipping: Conditional result was False
2026-03-18 08:31:58.157339 | 
2026-03-18 08:31:58.157402 | TASK [ocp_agent_installer : Copy machine_configs to manifests dir]
2026-03-18 08:31:58.591187 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:31:58.608254 | 
2026-03-18 08:31:58.608644 | TASK [ocp_agent_installer : Copy config assets to manifests dir]
2026-03-18 08:31:58.997315 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:31:59.016834 | 
2026-03-18 08:31:59.017054 | TASK [ocp_agent_installer : Run tasks/pxe_assets.yml]
2026-03-18 08:31:59.069169 | hotstack | ok
2026-03-18 08:31:59.092422 | hotstack | included: /var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/pxe_assets.yml
2026-03-18 08:31:59.129462 | 
2026-03-18 08:31:59.129625 | TASK [ocp_agent_installer : Create the boot-artifacts directory]
2026-03-18 08:31:59.500959 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:31:59.517198 | 
2026-03-18 08:31:59.517350 | TASK [ocp_agent_installer : Create PXE assets]
2026-03-18 04:32:02.419001 | controller-0 | level=warning msg=Compute[0].Hyperthreading: Disabled is ignored
2026-03-18 04:32:03.289521 | controller-0 | level=warning msg=ControlPlane.Hyperthreading: Disabled is ignored
2026-03-18 04:32:03.289570 | controller-0 | level=info msg=Configuration has 1 master replicas and 0 worker replicas
2026-03-18 04:32:03.289588 | controller-0 | level=info msg=The rendezvous host IP (node0 IP) is 192.168.32.10
2026-03-18 04:32:03.915749 | controller-0 | level=info msg=Extracting base ISO from release payload
2026-03-18 04:32:41.510459 | controller-0 | level=info msg=Base ISO obtained from release and cached at [/home/zuul/.cache/agent/image_cache/coreos-x86_64.iso]
2026-03-18 04:33:33.841364 | controller-0 | level=error msg=failed to write asset (Agent Installer PXE Files) to disk: cannot generate PXE assets due to configuration errors
2026-03-18 04:33:33.843375 | controller-0 | level=fatal msg=failed to fetch Agent Installer PXE Files: failed to fetch dependency of "Agent Installer PXE Files": failed to generate asset "Agent Installer Artifacts": command '[oc adm release info --image-for=agent-installer-utils --filter-by-os=linux/amd64 --insecure=true quay.io/openshift-release-dev/ocp-release@sha256:59727c4b3fef19e5149675cf3350735bbfe2c6588a57654b2e4552dd719f58b1 --registry-config=/tmp/registry-config1279943544]' exited with non-zero exit code 1:
2026-03-18 04:33:33.843396 | controller-0 | level=fatal msg=error: unable to parse image quay.io/openshift-release-dev/ocp-release@sha256:59727c4b3fef19e5149675cf3350735bbfe2c6588a57654b2e4552dd719f58b1: cannot retrieve image configuration for manifest sha256:59727c4b3fef19e5149675cf3350735bbfe2c6588a57654b2e4552dd719f58b1: Get "https://cdn01.quay.io/quayio-production-s3/sha256/5d/5d5367f9038e45cbb28eb9dc2ad9f722dd59c63ea4c4665ca57ea29a86f7000a?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260318%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260318T083323Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=aaf9712318e56ded4197c4045246779bfd62a90373ff09b9f5f1d575847f1b94&region=us-east-1&namespace=openshift-release-dev&username=openshift-release-dev+ocm_access_1b89217552bc42d1be3fb06a1aed001a&repo_name=ocp-release&akamai_signature=exp=1773823703~hmac=8c215b575e63aeee44692cb76beccbc96447fa2e99a1d95e3f4cab66cca53c13": net/http: TLS handshake timeout
2026-03-18 04:33:33.843403 | controller-0 | level=fatal
2026-03-18 08:33:34.145366 | hotstack -> 38.102.83.179 | ERROR
2026-03-18 08:33:34.145773 | hotstack -> 38.102.83.179 | {
2026-03-18 08:33:34.145847 | hotstack -> 38.102.83.179 |   "delta": "0:01:33.946685",
2026-03-18 08:33:34.145900 | hotstack -> 38.102.83.179 |   "end": "2026-03-18 04:33:33.843647",
2026-03-18 08:33:34.145943 | hotstack -> 38.102.83.179 |   "msg": "non-zero return code",
2026-03-18 08:33:34.145980 | hotstack -> 38.102.83.179 |   "rc": 1,
2026-03-18 08:33:34.146015 | hotstack -> 38.102.83.179 |   "start": "2026-03-18 04:31:59.896962"
2026-03-18 08:33:34.146048 | hotstack -> 38.102.83.179 | }
failure
2026-03-18 08:33:34.149874 | 
2026-03-18 08:33:34.149974 | PLAY RECAP
2026-03-18 08:33:34.150060 | hotstack | ok: 75 changed: 47 unreachable: 0 failed: 1 skipped: 13 rescued: 0 ignored: 0
2026-03-18 08:33:34.150104 | 
2026-03-18 08:33:34.299851 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/hotstack/pre_stage2.yaml@master]
2026-03-18 08:33:34.302300 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/hotstack/post.yaml@master]
2026-03-18 08:33:34.882356 | 
2026-03-18 08:33:34.882476 | PLAY [Collect hotstack logs]
2026-03-18 08:33:34.903795 | 
2026-03-18 08:33:34.903891 | TASK [Fetch stack outputs from remote to zuul executor]
2026-03-18 08:33:35.519118 | hotstack | Output suppressed because no_log was given
2026-03-18 08:33:35.530437 | 
2026-03-18 08:33:35.530610 | TASK [Load stack output vars with template resolution]
2026-03-18 08:33:35.579717 | hotstack | Output suppressed because no_log was given
2026-03-18 08:33:35.590996 | 
2026-03-18 08:33:35.591164 | TASK [Add Hotstack controller-0 to ansible inventory]
2026-03-18 08:33:35.638026 | hotstack | Output suppressed because no_log was given
2026-03-18 08:33:35.648781 | 
2026-03-18 08:33:35.648935 | TASK [Wait for Hotstack controller-0 to be ready]
2026-03-18 08:33:41.435546 | hotstack -> 38.102.83.179 | Output suppressed because no_log was given
2026-03-18 08:33:41.447527 | 
2026-03-18 08:33:41.447660 | TASK [Collect hotstack logs]
2026-03-18 08:33:41.476301 | hotstack | Output suppressed because no_log was given
2026-03-18 08:33:41.529227 | 
2026-03-18 08:33:41.529352 | TASK [hotlogs : Initialize failure tracking]
2026-03-18 08:33:41.561564 | hotstack | ok
2026-03-18 08:33:41.568387 | 
2026-03-18 08:33:41.568476 | TASK [hotlogs : Ensure logs directory]
2026-03-18 08:33:41.991853 | hotstack | changed
2026-03-18 08:33:42.003553 | 
2026-03-18 08:33:42.003844 | LOOP [hotlogs : Create hotlogs sub dirs]
2026-03-18 08:33:42.244213 | hotstack | changed:
2026-03-18 08:33:42.244545 | hotstack | {
2026-03-18 08:33:42.244586 | hotstack |   "dest_dir": "ocp_cluster",
2026-03-18 08:33:42.244612 | hotstack |   "src": "/home/zuul/ocp-cluster/.openshift_install.log"
2026-03-18 08:33:42.244637 | hotstack | }
2026-03-18 08:33:42.473495 | hotstack | ok:
2026-03-18 08:33:42.473586 | hotstack | {
2026-03-18 08:33:42.473609 | hotstack |   "dest_dir": "ocp_cluster",
2026-03-18 08:33:42.473629 | hotstack |   "src": "/home/zuul/cluster-custom-config/"
2026-03-18 08:33:42.473649 | hotstack | }
2026-03-18 08:33:42.678152 | hotstack | changed:
2026-03-18 08:33:42.678293 | hotstack | {
2026-03-18 08:33:42.678345 | hotstack |   "dest_dir": "data",
2026-03-18 08:33:42.678386 | hotstack |   "src": "/home/zuul/data/"
2026-03-18 08:33:42.678425 | hotstack | }
2026-03-18 08:33:42.900805 | hotstack | changed:
2026-03-18 08:33:42.900947 | hotstack | {
2026-03-18 08:33:42.900998 | hotstack |   "dest_dir": "manifests",
2026-03-18 08:33:42.901042 | hotstack |   "src": "/home/zuul/manifests/"
2026-03-18 08:33:42.901081 | hotstack | }
2026-03-18 08:33:43.114613 | hotstack | ok:
2026-03-18 08:33:43.114779 | hotstack | {
2026-03-18 08:33:43.114830 | hotstack |   "dest_dir": ".",
2026-03-18 08:33:43.114871 | hotstack |   "src": "/home/zuul/must-gather.tar.gz"
2026-03-18 08:33:43.114908 | hotstack | }
2026-03-18 08:33:43.348997 | hotstack | ok:
2026-03-18 08:33:43.349113 | hotstack | {
2026-03-18 08:33:43.349145 | hotstack |   "dest_dir": ".",
2026-03-18 08:33:43.349170 | hotstack |   "src": "/home/zuul/logs/tempest/"
2026-03-18 08:33:43.349194 | hotstack | }
2026-03-18 08:33:43.563953 | hotstack | changed:
2026-03-18 08:33:43.564169 | hotstack | {
2026-03-18 08:33:43.564234 | hotstack |   "dest_dir": "nova-console-recordings",
2026-03-18 08:33:43.564277 | hotstack |   "src": "/home/zuul/nova-console-recordings/"
2026-03-18 08:33:43.564316 | hotstack | }
2026-03-18 08:33:43.581731 | 
2026-03-18 08:33:43.581819 | TASK [hotlogs : Run must-gather operations]
2026-03-18 08:33:44.289915 | hotstack -> 38.102.83.179 | ERROR
2026-03-18 08:33:44.290375 | hotstack -> 38.102.83.179 | {
2026-03-18 08:33:44.290443 | hotstack -> 38.102.83.179 |   "msg": "Must-gather failed: error: Missing or incomplete configuration info.  Please point to an existing, complete config file:\n\n\n  1. Via the command-line flag --kubeconfig\n  2. Via the KUBECONFIG environment variable\n  3. In your home directory as ~/.kube/config\n\nTo view or setup config directly use the 'config' command.\n (Command: oc adm must-gather --image-stream=openshift/must-gather --image=quay.io/openstack-k8s-operators/openstack-must-gather --dest-dir=/home/zuul/must-gather --timeout=10m --host-network=false -- ADDITIONAL_NAMESPACES=sushy-emulator OPENSTACK_DATABASES=ALL SOS_EDPM=all SOS_DECOMPRESS=0 gather)",
2026-03-18 08:33:44.290517 | hotstack -> 38.102.83.179 |   "rc": 1
2026-03-18 08:33:44.290564 | hotstack -> 38.102.83.179 | }
2026-03-18 08:33:44.303674 | 
2026-03-18 08:33:44.303852 | TASK [hotlogs : Display must-gather failure]
2026-03-18 08:33:44.415593 | hotstack | ok:
2026-03-18 08:33:44.415896 | hotstack | Must-gather operations failed: Must-gather failed: error: Missing or incomplete configuration info.  Please point to an existing, complete config file:
2026-03-18 08:33:44.415957 | hotstack |
2026-03-18 08:33:44.416003 | hotstack |
2026-03-18 08:33:44.416045 | hotstack |   1. Via the command-line flag --kubeconfig
2026-03-18 08:33:44.416085 | hotstack |   2. Via the KUBECONFIG environment variable
2026-03-18 08:33:44.416125 | hotstack |   3. In your home directory as ~/.kube/config
2026-03-18 08:33:44.416165 | hotstack |
2026-03-18 08:33:44.416204 | hotstack | To view or setup config directly use the 'config' command.
2026-03-18 08:33:44.416252 | hotstack |  (Command: oc adm must-gather --image-stream=openshift/must-gather --image=quay.io/openstack-k8s-operators/openstack-must-gather --dest-dir=/home/zuul/must-gather --timeout=10m --host-network=false -- ADDITIONAL_NAMESPACES=sushy-emulator OPENSTACK_DATABASES=ALL SOS_EDPM=all SOS_DECOMPRESS=0 gather)
2026-03-18 08:33:44.456814 | 
2026-03-18 08:33:44.456959 | TASK [hotlogs : Track must-gather failure]
2026-03-18 08:33:44.502101 | hotstack | ok
2026-03-18 08:33:44.513633 | 
2026-03-18 08:33:44.513797 | LOOP [hotlogs : Collect tempest logs from test-operator PVCs]
2026-03-18 08:33:45.062584 | hotstack -> 38.102.83.179 | ok: non-zero return code
2026-03-18 08:33:45.063028 | hotstack -> 38.102.83.179 | changed: All items complete
2026-03-18 08:33:45.063089 | 
2026-03-18 08:33:45.081214 | 
2026-03-18 08:33:45.081405 | LOOP [hotlogs : Display tempest log collection results]
2026-03-18 08:33:45.147508 | hotstack | ok: Namespace openstack: ['==========================================', 'Tempest Log Collection', '==========================================', 'Namespace: openstack', 'Logs directory: /home/zuul/logs/tempest', '==========================================', '', 'Searching for tempest log PVCs...', 'error: Missing or incomplete configuration info.  Please point to an existing, complete config file:', '', '', '  1. Via the command-line flag --kubeconfig', '  2. Via the KUBECONFIG environment variable', '  3. In your home directory as ~/.kube/config', '', "To view or setup config directly use the 'config' command."]
2026-03-18 08:33:45.159887 | 
2026-03-18 08:33:45.160059 | LOOP [hotlogs : Track tempest log collection failures]
2026-03-18 08:33:45.203415 | hotstack | ok:
2026-03-18 08:33:45.203870 | hotstack | {
2026-03-18 08:33:45.203941 | hotstack |   "ansible_loop_var": "item",
2026-03-18 08:33:45.203993 | hotstack |   "changed": false,
2026-03-18 08:33:45.204041 | hotstack |   "cmd": [
2026-03-18 08:33:45.204087 | hotstack |     "hotstack-collect-tempest-logs",
2026-03-18 08:33:45.204130 | hotstack |     "--namespace",
2026-03-18 08:33:45.204174 | hotstack |     "openstack"
2026-03-18 08:33:45.204216 | hotstack |   ],
2026-03-18 08:33:45.204258 | hotstack |   "delta": "0:00:00.098709",
2026-03-18 08:33:45.204300 | hotstack |   "end": "2026-03-18 04:33:45.042818",
2026-03-18 08:33:45.204364 | hotstack |   "failed": false,
2026-03-18 08:33:45.204403 | hotstack |   "failed_when_result": false,
2026-03-18 08:33:45.204444 | hotstack |   "invocation": {
2026-03-18 08:33:45.204485 | hotstack |     "module_args": {
2026-03-18 08:33:45.204527 | hotstack |       "_raw_params": "hotstack-collect-tempest-logs --namespace openstack",
2026-03-18 08:33:45.204570 | hotstack |       "_uses_shell": false,
2026-03-18 08:33:45.204655 | hotstack |       "argv": null,
2026-03-18 08:33:45.204734 | hotstack |       "chdir": null,
2026-03-18 08:33:45.204781 | hotstack |       "creates": null,
2026-03-18 08:33:45.204824 | hotstack |       "executable": null,
2026-03-18 08:33:45.204866 | hotstack |       "removes": null,
2026-03-18 08:33:45.204907 | hotstack |       "stdin": null,
2026-03-18 08:33:45.205133 | hotstack |       "stdin_add_newline": true,
2026-03-18 08:33:45.205185 | hotstack |       "strip_empty_ends": true,
2026-03-18 08:33:45.205222 | hotstack |       "warn": false,
2026-03-18 08:33:45.205258 | hotstack |       "zuul_ansible_split_streams": false,
2026-03-18 08:33:45.205291 | hotstack |       "zuul_log_id": "in-loop-ignore"
2026-03-18 08:33:45.205324 | hotstack |     }
2026-03-18 08:33:45.205358 | hotstack |   },
2026-03-18 08:33:45.205392 | hotstack |   "item": "openstack",
2026-03-18 08:33:45.205425 | hotstack |   "msg": "non-zero return code",
2026-03-18 08:33:45.205458 | hotstack |   "rc": 1,
2026-03-18 08:33:45.205497 | hotstack |   "start": "2026-03-18 04:33:44.944109",
2026-03-18 08:33:45.205532 | hotstack |   "stderr": "",
2026-03-18 08:33:45.205567 | hotstack |   "stderr_lines": [],
2026-03-18 08:33:45.205609 | hotstack |   "stdout": "==========================================\nTempest Log Collection\n==========================================\nNamespace: openstack\nLogs directory: /home/zuul/logs/tempest\n==========================================\n\nSearching for tempest log PVCs...\nerror: Missing or incomplete configuration info.  Please point to an existing, complete config file:\n\n\n  1. Via the command-line flag --kubeconfig\n  2. Via the KUBECONFIG environment variable\n  3. In your home directory as ~/.kube/config\n\nTo view or setup config directly use the 'config' command.",
2026-03-18 08:33:45.205647 | hotstack |   "stdout_lines": [
2026-03-18 08:33:45.205738 | hotstack |     "==========================================",
2026-03-18 08:33:45.205789 | hotstack |     "Tempest Log Collection",
2026-03-18 08:33:45.205826 | hotstack |     "==========================================",
2026-03-18 08:33:45.205860 | hotstack |     "Namespace: openstack",
2026-03-18 08:33:45.205893 | hotstack |     "Logs directory: /home/zuul/logs/tempest",
2026-03-18 08:33:45.205926 | hotstack |     "==========================================",
2026-03-18 08:33:45.205959 | hotstack |     "",
2026-03-18 08:33:45.205992 | hotstack |     "Searching for tempest log PVCs...",
2026-03-18 08:33:45.206025 | hotstack |     "error: Missing or incomplete configuration info.  Please point to an existing, complete config file:",
2026-03-18 08:33:45.206059 | hotstack |     "",
2026-03-18 08:33:45.206093 | hotstack |     "",
2026-03-18 08:33:45.206126 | hotstack |     "  1. Via the command-line flag --kubeconfig",
2026-03-18 08:33:45.206160 | hotstack |     "  2. Via the KUBECONFIG environment variable",
2026-03-18 08:33:45.206194 | hotstack |     "  3. In your home directory as ~/.kube/config",
2026-03-18 08:33:45.206227 | hotstack |     "",
2026-03-18 08:33:45.206260 | hotstack |     "To view or setup config directly use the 'config' command."
2026-03-18 08:33:45.206294 | hotstack |   ],
2026-03-18 08:33:45.206327 | hotstack |   "zuul_log_id": "in-loop-ignore"
2026-03-18 08:33:45.206359 | hotstack | }
2026-03-18 08:33:45.206417 | hotstack | ok: All items complete
2026-03-18 08:33:45.206456 | 
2026-03-18 08:33:45.227754 | 
2026-03-18 08:33:45.227953 | TASK [hotlogs : Create nova console recordings directory in base_dir on controller]
2026-03-18 08:33:45.550963 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:33:45.564444 | 
2026-03-18 08:33:45.564582 | TASK [hotlogs : Copy nova console recordings from NFS export]
2026-03-18 04:33:45.914195 | controller-0 | sending incremental file list
2026-03-18 04:33:45.916049 | controller-0 | ./
2026-03-18 04:33:45.957025 | controller-0 |
2026-03-18 04:33:45.957077 | controller-0 | sent 66 bytes  received 19 bytes  170.00 bytes/sec
2026-03-18 04:33:45.957084 | controller-0 | total size is 0  speedup is 0.00
2026-03-18 08:33:46.099258 | hotstack -> 38.102.83.179 | changed
2026-03-18 08:33:46.113375 | 
2026-03-18 08:33:46.113542 | LOOP [hotlogs : Collect hotstack data]
2026-03-18 08:33:46.921038 | hotstack -> 38.102.83.70 | changed: >f+++++++++ .openshift_install.log
2026-03-18 08:33:47.428478 | hotstack -> 38.102.83.70 | changed:
2026-03-18 08:33:47.428713 | hotstack -> 38.102.83.70 | .d..t...... ./
2026-03-18 08:33:47.428780 | hotstack -> 38.102.83.70 | cd+++++++++ butane/
2026-03-18 08:33:47.428826 | hotstack -> 38.102.83.70 | >f+++++++++ butane/90-master-disable-netifnames.bu
2026-03-18 08:33:47.428868 | hotstack -> 38.102.83.70 | >f+++++++++ butane/90-master-enable-iscsi.bu
2026-03-18 08:33:47.428909 | hotstack -> 38.102.83.70 | >f+++++++++ butane/91-master-enable-multipath.bu
2026-03-18 08:33:47.428948 | hotstack -> 38.102.83.70 | >f+++++++++ butane/92-master-lv-cinder-volumes.bu
2026-03-18 08:33:47.428986 | hotstack -> 38.102.83.70 | cd+++++++++ config-assets/
2026-03-18 08:33:47.429025 | hotstack -> 38.102.83.70 | >f+++++++++ config-assets/95-etcd_config.yaml
2026-03-18 08:33:47.429063 | hotstack -> 38.102.83.70 | >f+++++++++ config-assets/ovn_k8s_config.yaml
2026-03-18 08:33:47.429102 | hotstack -> 38.102.83.70 | cd+++++++++ machine-configs/
2026-03-18 08:33:47.429140 | hotstack -> 38.102.83.70 | >f+++++++++ machine-configs/90-master-disable-netifnames.yaml
2026-03-18 08:33:47.429179 | hotstack -> 38.102.83.70 | >f+++++++++ machine-configs/90-master-enable-iscsi.yaml
2026-03-18 08:33:47.429217 | hotstack -> 38.102.83.70 | >f+++++++++ machine-configs/91-master-enable-multipath.yaml
2026-03-18 08:33:47.429255 | hotstack -> 38.102.83.70 | >f+++++++++ machine-configs/92-master-lv-cinder-volumes.yaml
2026-03-18 08:33:47.930220 | hotstack -> 38.102.83.70 | changed: .d..t...... ./
2026-03-18 08:33:48.550478 | hotstack -> 38.102.83.70 | ERROR: Item: {'src': '/home/zuul/manifests/', 'dest_dir': 'manifests'}
2026-03-18 08:33:48.550792 | hotstack -> 38.102.83.70 | {
2026-03-18 08:33:48.550864 | hotstack -> 38.102.83.70 |   "ansible_loop_var": "item",
2026-03-18 08:33:48.550908 | hotstack -> 38.102.83.70 |   "item": {
2026-03-18 08:33:48.550947 | hotstack -> 38.102.83.70 |     "dest_dir": "manifests",
2026-03-18 08:33:48.550985 | hotstack -> 38.102.83.70 |     "src": "/home/zuul/manifests/"
2026-03-18 08:33:48.551021 | hotstack -> 38.102.83.70 |   },
2026-03-18 08:33:48.551057 | hotstack -> 38.102.83.70 |   "msg": "Warning: Permanently added '38.102.83.179' (ED25519) to the list of known hosts.\r\nrsync: [sender] change_dir \"/home/zuul/manifests\" failed: No such file or directory (2)\nrsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1841) [Receiver=3.2.5]\nrsync: [Receiver] write error: Broken pipe (32)\n",
2026-03-18 08:33:48.551099 | hotstack -> 38.102.83.70 |   "rc": 23
2026-03-18 08:33:48.551135 | hotstack -> 38.102.83.70 | }
2026-03-18 08:33:49.161069 | hotstack -> 38.102.83.70 | ERROR: Item: {'src': '/home/zuul/must-gather.tar.gz', 'dest_dir': '.'}
2026-03-18 08:33:49.161305 | hotstack -> 38.102.83.70 | {
2026-03-18 08:33:49.161363 | hotstack -> 38.102.83.70 |   "ansible_loop_var": "item",
2026-03-18 08:33:49.161405 | hotstack -> 38.102.83.70 |   "item": {
2026-03-18 08:33:49.161441 | hotstack -> 38.102.83.70 |     "dest_dir": ".",
2026-03-18 08:33:49.161476 | hotstack -> 38.102.83.70 |     "src": "/home/zuul/must-gather.tar.gz"
2026-03-18 08:33:49.161510 | hotstack -> 38.102.83.70 |   },
2026-03-18 08:33:49.161545 | hotstack -> 38.102.83.70 |   "msg": "Warning: Permanently added '38.102.83.179' (ED25519) to the list of known hosts.\r\nrsync: [sender] link_stat \"/home/zuul/must-gather.tar.gz\" failed: No such file or directory (2)\nrsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1841) [Receiver=3.2.5]\nrsync: [Receiver] write error: Broken pipe (32)\n",
2026-03-18 08:33:49.161587 | hotstack -> 38.102.83.70 |   "rc": 23
2026-03-18 08:33:49.161621 | hotstack -> 38.102.83.70 | }
2026-03-18 08:33:49.676949 | hotstack -> 38.102.83.70 | changed: .d..t...... ./
2026-03-18 08:33:50.243179 | hotstack -> 38.102.83.70 | changed: .d..t...... ./
2026-03-18 08:33:50.260776 | hotstack | ERROR: Ignoring Errors
2026-03-18 08:33:50.276560 | 
2026-03-18 08:33:50.276760 | LOOP [hotlogs : Check hotstack data collection failures]
2026-03-18 08:33:50.354326 | hotstack | skipping: Conditional result was False
2026-03-18 08:33:50.359795 | hotstack | skipping: Conditional result was False
2026-03-18 08:33:50.366882 | hotstack | skipping: Conditional result was False
2026-03-18 08:33:50.390564 | hotstack | ERROR
2026-03-18 08:33:50.390874 | hotstack | {
2026-03-18 08:33:50.390950 | hotstack |   "msg": "Unexpected templating type error occurred on ({{ hotlogs_failures + ['Failed to collect: ' + item.item] }}): can only concatenate str (not \"dict\") to str. can only concatenate str (not \"dict\") to str"
2026-03-18 08:33:50.391001 | hotstack | }
2026-03-18 08:33:50.402500 | 
2026-03-18 08:33:50.402642 | TASK [Print message that log collection failed]
2026-03-18 08:33:50.432517 | hotstack | ok: WARNING: Log collection failed and may be incomplete. Continue with cleanup ...
2026-03-18 08:33:50.477382 | 
2026-03-18 08:33:50.477499 | PLAY RECAP
2026-03-18 08:33:50.477568 | hotstack | ok: 16 changed: 6 unreachable: 0 failed: 0 skipped: 0 rescued: 2 ignored: 1
2026-03-18 08:33:50.477602 | 
2026-03-18 08:33:50.582592 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/hotstack/post.yaml@master]
2026-03-18 08:33:50.584848 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/hotstack/post-clean.yaml@master]
2026-03-18 08:33:51.179686 | 
2026-03-18 08:33:51.179804 | PLAY [Clean up hotstack environment]
2026-03-18 08:33:51.203148 | 
2026-03-18 08:33:51.203270 | TASK [Set _auth_type fact]
2026-03-18 08:33:51.254821 | hotstack | Output suppressed because no_log was given
2026-03-18 08:33:51.261916 | 
2026-03-18 08:33:51.262013 | TASK [Write clouds.yaml]
2026-03-18 08:33:52.614636 | hotstack | Output suppressed because no_log was given
2026-03-18 08:33:52.626337 | 
2026-03-18 08:33:52.626480 | TASK [Delete application credentials]
2026-03-18 08:33:54.679983 | hotstack | changed
2026-03-18 08:33:54.692496 | 
2026-03-18 08:33:54.692625 | TASK [Print message that application credential failed to delete]
2026-03-18 08:33:54.719876 | hotstack | skipping: Conditional result was False
2026-03-18 08:33:54.733186 | 
2026-03-18 08:33:54.733328 | TASK [Print message that application credential deleted successfully]
2026-03-18 08:33:54.782121 | hotstack | ok: Application credential deleted successfully.
2026-03-18 08:33:54.792778 | 
2026-03-18 08:33:54.792912 | TASK [Write clouds.yaml with application credentials]
2026-03-18 08:33:54.823803 | 
2026-03-18 08:33:54.824103 | TASK [Delete the heat stack]
2026-03-18 04:34:17.078076 | hotstack | 2026-03-18 08:33:57Z [hs-a6011b973c2345d192387c6898cffebe]: DELETE_IN_PROGRESS  Stack DELETE started
2026-03-18 04:34:17.078324 | hotstack | 2026-03-18 08:33:57Z [hs-a6011b973c2345d192387c6898cffebe.master0]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078340 | hotstack | 2026-03-18 08:33:58Z [hs-a6011b973c2345d192387c6898cffebe.ctlplane-net-router-interface]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078346 | hotstack | 2026-03-18 08:33:59Z [hs-a6011b973c2345d192387c6898cffebe.compute0]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078351 | hotstack | 2026-03-18 08:34:00Z [hs-a6011b973c2345d192387c6898cffebe.controller-floating-ip]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078356 | hotstack | 2026-03-18 08:34:01Z [hs-a6011b973c2345d192387c6898cffebe.controller-floating-ip]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078360 | hotstack | 2026-03-18 08:34:01Z [hs-a6011b973c2345d192387c6898cffebe.controller]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078365 | hotstack | 2026-03-18 08:34:01Z [hs-a6011b973c2345d192387c6898cffebe.machine-net-router-interface]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078370 | hotstack | 2026-03-18 08:34:02Z [hs-a6011b973c2345d192387c6898cffebe.ctlplane-net-router-interface]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078375 | hotstack | 2026-03-18 08:34:07Z [hs-a6011b973c2345d192387c6898cffebe.compute0]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078379 | hotstack | 2026-03-18 08:34:07Z [hs-a6011b973c2345d192387c6898cffebe.compute0-trunk0]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078384 | hotstack | 2026-03-18 08:34:07Z [hs-a6011b973c2345d192387c6898cffebe.compute0_init]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078388 | hotstack | 2026-03-18 08:34:07Z [hs-a6011b973c2345d192387c6898cffebe.compute0_init]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078393 | hotstack | 2026-03-18 08:34:07Z [hs-a6011b973c2345d192387c6898cffebe.compute0_hostname]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078397 | hotstack | 2026-03-18 08:34:07Z [hs-a6011b973c2345d192387c6898cffebe.dataplane_users]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078402 | hotstack | 2026-03-18 08:34:07Z [hs-a6011b973c2345d192387c6898cffebe.compute0_hostname]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078406 | hotstack | 2026-03-18 08:34:07Z [hs-a6011b973c2345d192387c6898cffebe.dataplane_users]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078410 | hotstack | 2026-03-18 08:34:07Z [hs-a6011b973c2345d192387c6898cffebe.controller]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078415 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.controller-init]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078419 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.controller-init]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078424 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.compute0-trunk0]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078428 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.controller-runcmd]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078432 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.compute0-tenant-port]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078437 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.controller-runcmd]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078441 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.compute0-storage-port]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078446 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.controller_users]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078450 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.compute0-internal-api-port]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078455 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.machine-net-router-interface]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078460 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.controller-write-files]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078464 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.compute0-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078479 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.controller_users]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078484 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.controller-write-files]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078492 | hotstack | 2026-03-18 08:34:08Z [hs-a6011b973c2345d192387c6898cffebe.router]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:17.078497 | hotstack | 2026-03-18 08:34:09Z [hs-a6011b973c2345d192387c6898cffebe.compute0-tenant-port]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078501 | hotstack | 2026-03-18 08:34:09Z [hs-a6011b973c2345d192387c6898cffebe.compute0-internal-api-port]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078505 | hotstack | 2026-03-18 08:34:09Z [hs-a6011b973c2345d192387c6898cffebe.compute0-storage-port]: DELETE_COMPLETE  state changed
2026-03-18 04:34:17.078519 | hotstack | 2026-03-18 08:34:09Z [hs-a6011b973c2345d192387c6898cffebe.compute0-ctlplane-trunk-parent-port]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.116979 | hotstack | 2026-03-18 08:34:09Z [hs-a6011b973c2345d192387c6898cffebe.router]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117068 | hotstack | 2026-03-18 08:34:12Z [hs-a6011b973c2345d192387c6898cffebe.master0]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117097 | hotstack | 2026-03-18 08:34:12Z [hs-a6011b973c2345d192387c6898cffebe.master0-trunk0]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117111 | hotstack | 2026-03-18 08:34:12Z [hs-a6011b973c2345d192387c6898cffebe.master0-machine-port]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117124 | hotstack | 2026-03-18 08:34:12Z [hs-a6011b973c2345d192387c6898cffebe.master0-cinder-vol0]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117136 | hotstack | 2026-03-18 08:34:12Z [hs-a6011b973c2345d192387c6898cffebe.master0-lvms-vol0]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117148 | hotstack | 2026-03-18 08:34:12Z [hs-a6011b973c2345d192387c6898cffebe.master0-cinder-vol1]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117198 | hotstack | 2026-03-18 08:34:12Z [hs-a6011b973c2345d192387c6898cffebe.master0-cinder-vol2]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117214 | hotstack | 2026-03-18 08:34:12Z [hs-a6011b973c2345d192387c6898cffebe.master0-machine-port]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117226 | hotstack | 2026-03-18 08:34:13Z [hs-a6011b973c2345d192387c6898cffebe.extra-dhcp-opts-value]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117237 | hotstack | 2026-03-18 08:34:13Z [hs-a6011b973c2345d192387c6898cffebe.extra-dhcp-opts-value]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117247 | hotstack | 2026-03-18 08:34:13Z [hs-a6011b973c2345d192387c6898cffebe.controller-machine-port]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117263 | hotstack | 2026-03-18 08:34:13Z [hs-a6011b973c2345d192387c6898cffebe.master0-cinder-vol1]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117274 | hotstack | 2026-03-18 08:34:13Z [hs-a6011b973c2345d192387c6898cffebe.controller-machine-port]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117284 | hotstack | 2026-03-18 08:34:13Z [hs-a6011b973c2345d192387c6898cffebe.machine-subnet]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117297 | hotstack | 2026-03-18 08:34:13Z [hs-a6011b973c2345d192387c6898cffebe.master0-lvms-vol0]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117307 | hotstack | 2026-03-18 08:34:13Z [hs-a6011b973c2345d192387c6898cffebe.master0-cinder-vol0]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117317 | hotstack | 2026-03-18 08:34:14Z [hs-a6011b973c2345d192387c6898cffebe.master0-cinder-vol2]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117327 | hotstack | 2026-03-18 08:34:14Z [hs-a6011b973c2345d192387c6898cffebe.machine-subnet]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117337 | hotstack | 2026-03-18 08:34:14Z [hs-a6011b973c2345d192387c6898cffebe.machine-net]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117347 | hotstack | 2026-03-18 08:34:15Z [hs-a6011b973c2345d192387c6898cffebe.master0-trunk0]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117357 | hotstack | 2026-03-18 08:34:15Z [hs-a6011b973c2345d192387c6898cffebe.master0-internal-api-port]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117379 | hotstack | 2026-03-18 08:34:15Z [hs-a6011b973c2345d192387c6898cffebe.master0-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117390 | hotstack | 2026-03-18 08:34:15Z [hs-a6011b973c2345d192387c6898cffebe.master0-tenant-port]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117400 | hotstack | 2026-03-18 08:34:15Z [hs-a6011b973c2345d192387c6898cffebe.master0-storage-port]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117409 | hotstack | 2026-03-18 08:34:15Z [hs-a6011b973c2345d192387c6898cffebe.master0-octavia-port]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117419 | hotstack | 2026-03-18 08:34:15Z [hs-a6011b973c2345d192387c6898cffebe.machine-net]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117434 | hotstack | 2026-03-18 08:34:15Z [hs-a6011b973c2345d192387c6898cffebe.master0-internal-api-port]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117445 | hotstack | 2026-03-18 08:34:15Z [hs-a6011b973c2345d192387c6898cffebe.master0-octavia-port]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117455 | hotstack | 2026-03-18 08:34:15Z [hs-a6011b973c2345d192387c6898cffebe.internal-api-subnet]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117465 | hotstack | 2026-03-18 08:34:15Z [hs-a6011b973c2345d192387c6898cffebe.octavia-subnet]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117479 | hotstack | 2026-03-18 08:34:16Z [hs-a6011b973c2345d192387c6898cffebe.master0-ctlplane-trunk-parent-port]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117493 | hotstack | 2026-03-18 08:34:16Z [hs-a6011b973c2345d192387c6898cffebe.ctlplane-subnet]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.117508 | hotstack | 2026-03-18 08:34:16Z [hs-a6011b973c2345d192387c6898cffebe.master0-tenant-port]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117522 | hotstack | 2026-03-18 08:34:16Z [hs-a6011b973c2345d192387c6898cffebe.internal-api-subnet]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117536 | hotstack | 2026-03-18 08:34:16Z [hs-a6011b973c2345d192387c6898cffebe.octavia-subnet]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117548 | hotstack | 2026-03-18 08:34:16Z [hs-a6011b973c2345d192387c6898cffebe.master0-storage-port]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117558 | hotstack | 2026-03-18 08:34:16Z [hs-a6011b973c2345d192387c6898cffebe.ctlplane-subnet]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.117576 | hotstack | 2026-03-18 08:34:16Z [hs-a6011b973c2345d192387c6898cffebe.octavia-net]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.206433 | hotstack | 2026-03-18 08:34:16Z [hs-a6011b973c2345d192387c6898cffebe.tenant-subnet]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.206552 | hotstack | 2026-03-18 08:34:16Z [hs-a6011b973c2345d192387c6898cffebe.internal-api-net]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.206566 | hotstack | 2026-03-18 08:34:16Z [hs-a6011b973c2345d192387c6898cffebe.storage-subnet]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.206577 | hotstack | 2026-03-18 08:34:16Z [hs-a6011b973c2345d192387c6898cffebe.ctlplane-net]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.206586 | hotstack | 2026-03-18 08:34:16Z [hs-a6011b973c2345d192387c6898cffebe.tenant-subnet]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.206596 | hotstack | 2026-03-18 08:34:17Z [hs-a6011b973c2345d192387c6898cffebe.tenant-net]: DELETE_IN_PROGRESS  state changed
2026-03-18 04:34:22.206606 | hotstack | 2026-03-18 08:34:17Z [hs-a6011b973c2345d192387c6898cffebe.storage-subnet]: DELETE_COMPLETE  state changed
2026-03-18 04:34:22.206616 | hotstack | 2026-03-18 08:34:17Z [hs-a6011b973c2345d192387c6898cffebe.storage-net]: DELETE_IN_PROGRESS  state changed
2026-03-18 08:34:22.404062 | hotstack | changed
2026-03-18 08:34:22.411892 | 
2026-03-18 08:34:22.411978 | TASK [Print message that stack failed to delete]
2026-03-18 08:34:22.427738 | hotstack | skipping: Conditional result was False
2026-03-18 08:34:22.436619 | 
2026-03-18 08:34:22.436748 | TASK [Print message that stack deleted successfully]
2026-03-18 08:34:22.467735 | hotstack | ok: Stack deleted successfully.
2026-03-18 08:34:22.475059 | 
2026-03-18 08:34:22.475142 | TASK [Delete clouds.yaml]
2026-03-18 08:34:22.893658 | hotstack | Output suppressed because no_log was given
2026-03-18 08:34:22.936041 | 
2026-03-18 08:34:22.936184 | PLAY RECAP
2026-03-18 08:34:22.936264 | hotstack | ok: 7 changed: 4 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-18 08:34:22.936307 | 
2026-03-18 08:34:23.038710 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/hotstack/post-clean.yaml@master]
2026-03-18 08:34:23.043003 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-03-18 08:34:23.638870 | 
2026-03-18 08:34:23.638981 | PLAY [all]
2026-03-18 08:34:23.658651 | 
2026-03-18 08:34:23.658775 | TASK [include_role : fetch-output]
2026-03-18 08:34:23.698449 | hotstack | ok
2026-03-18 08:34:23.716373 | 
2026-03-18 08:34:23.716478 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-18 08:34:23.791913 | hotstack | skipping: Conditional result was False
2026-03-18 08:34:23.797937 | 
2026-03-18 08:34:23.798005 | TASK [fetch-output : Set log path for single node]
2026-03-18 08:34:23.837421 | hotstack | ok
2026-03-18 08:34:23.842646 | 
2026-03-18 08:34:23.842726 | LOOP [fetch-output : Ensure local output dirs]
2026-03-18 08:34:24.267431 | hotstack -> localhost | ok: "/var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/work/logs"
2026-03-18 08:34:24.520155 | hotstack -> localhost | changed: "/var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/work/artifacts"
2026-03-18 08:34:24.761732 | hotstack -> localhost | changed: "/var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/work/docs"
2026-03-18 08:34:24.789067 | 
2026-03-18 08:34:24.789361 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-18 08:34:25.490065 | hotstack | changed:
2026-03-18 08:34:25.490408 | hotstack | .d..t...... ./
2026-03-18 08:34:25.490491 | hotstack | cd+++++++++ hotlogs/
2026-03-18 08:34:25.490548 | hotstack | cd+++++++++ hotlogs/data/
2026-03-18 08:34:25.490601 | hotstack | cd+++++++++ hotlogs/manifests/
2026-03-18 08:34:25.490652 | hotstack | cd+++++++++ hotlogs/nova-console-recordings/
2026-03-18 08:34:25.490878 | hotstack | cd+++++++++ hotlogs/ocp_cluster/
2026-03-18 08:34:25.490938 | hotstack | >f+++++++++ hotlogs/ocp_cluster/openshift_install.log
2026-03-18 08:34:25.490978 | hotstack | cd+++++++++ hotlogs/ocp_cluster/butane/
2026-03-18 08:34:25.491019 | hotstack | >f+++++++++ hotlogs/ocp_cluster/butane/90-master-disable-netifnames.bu
2026-03-18 08:34:25.491057 | hotstack | >f+++++++++ hotlogs/ocp_cluster/butane/90-master-enable-iscsi.bu
2026-03-18 08:34:25.491095 | hotstack | >f+++++++++ hotlogs/ocp_cluster/butane/91-master-enable-multipath.bu
2026-03-18 08:34:25.491133 | hotstack | >f+++++++++ hotlogs/ocp_cluster/butane/92-master-lv-cinder-volumes.bu
2026-03-18 08:34:25.491170 | hotstack | cd+++++++++ hotlogs/ocp_cluster/config-assets/
2026-03-18 08:34:25.491207 | hotstack | >f+++++++++ hotlogs/ocp_cluster/config-assets/95-etcd_config.yaml
2026-03-18 08:34:25.491244 | hotstack | >f+++++++++ hotlogs/ocp_cluster/config-assets/ovn_k8s_config.yaml
2026-03-18 08:34:25.491286 | hotstack | cd+++++++++ hotlogs/ocp_cluster/machine-configs/
2026-03-18 08:34:25.491325 | hotstack | >f+++++++++ hotlogs/ocp_cluster/machine-configs/90-master-disable-netifnames.yaml
2026-03-18 08:34:25.491362 | hotstack | >f+++++++++ hotlogs/ocp_cluster/machine-configs/90-master-enable-iscsi.yaml
2026-03-18 08:34:25.491398 | hotstack | >f+++++++++ hotlogs/ocp_cluster/machine-configs/91-master-enable-multipath.yaml
2026-03-18 08:34:25.491435 | hotstack | >f+++++++++ hotlogs/ocp_cluster/machine-configs/92-master-lv-cinder-volumes.yaml
2026-03-18 08:34:25.491508 | hotstack | changed: All items complete
2026-03-18 08:34:25.491554 | 
2026-03-18 08:34:25.978996 | hotstack | changed: .d..t...... ./
2026-03-18 08:34:26.533021 | hotstack | changed: .d..t...... ./
2026-03-18 08:34:26.570964 | 
2026-03-18 08:34:26.571246 | TASK [include_role : fetch-output-openshift]
2026-03-18 08:34:26.600350 | hotstack | skipping: Conditional result was False
2026-03-18 08:34:26.614217 | 
2026-03-18 08:34:26.614372 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-18 08:34:27.112449 | hotstack -> localhost | ok: Item: artifacts Runtime: 0:00:00.015402
2026-03-18 08:34:27.404324 | hotstack -> localhost | ok: Item: docs Runtime: 0:00:00.013351
2026-03-18 08:34:27.463356 | 
2026-03-18 08:34:27.463491 | PLAY [all]
2026-03-18 08:34:27.482973 | 
2026-03-18 08:34:27.483066 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-18 08:34:28.152218 | hotstack | changed
2026-03-18 08:34:28.199852 | 
2026-03-18 08:34:28.199940 | PLAY RECAP
2026-03-18 08:34:28.200000 | hotstack | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2026-03-18 08:34:28.200036 | 
2026-03-18 08:34:28.304007 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-03-18 08:34:28.306196 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master]
2026-03-18 08:34:28.900431 | 
2026-03-18 08:34:28.900557 | PLAY [localhost]
2026-03-18 08:34:28.917870 | 
2026-03-18 08:34:28.917985 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-18 08:34:29.343921 | localhost | changed
2026-03-18 08:34:29.348372 | 
2026-03-18 08:34:29.348456 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-18 08:34:29.389010 | localhost | ok
2026-03-18 08:34:29.403647 | 
2026-03-18 08:34:29.403844 | TASK [add-fileserver : Create SSH private key tempfile]
2026-03-18 08:34:29.845957 | localhost | changed
2026-03-18 08:34:29.858061 | 
2026-03-18 08:34:29.858535 | TASK [add-fileserver : Create SSH private key from secret]
2026-03-18 08:34:30.666367 | localhost | changed
2026-03-18 08:34:30.671491 | 
2026-03-18 08:34:30.671560 | TASK [add-fileserver : Add fileserver ssh key]
2026-03-18 08:34:31.124265 | localhost | Identity added: /var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/work/tmp/ansible.t5o0us10 (/var/lib/zuul/builds/a6011b973c2345d192387c6898cffebe/work/tmp/ansible.t5o0us10)
2026-03-18 08:34:31.125035 | localhost | ok: Runtime: 0:00:00.012729
2026-03-18 08:34:31.139074 | 
2026-03-18 08:34:31.139310 | TASK [add-fileserver : Remove SSH private key from disk]
2026-03-18 08:34:31.435989 | localhost | ok: Runtime: 0:00:00.008443
2026-03-18 08:34:31.446215 | 
2026-03-18 08:34:31.446359 | TASK [add-fileserver : Add fileserver to inventory]
2026-03-18 08:34:31.503510 | localhost | changed
2026-03-18 08:34:31.513017 | 
2026-03-18 08:34:31.513161 | TASK [add-fileserver : Add fileserver server to known hosts]
2026-03-18 08:34:31.915411 | localhost | changed
2026-03-18 08:34:31.943039 | 
2026-03-18 08:34:31.943145 | PLAY [localhost]
2026-03-18 08:34:31.954808 | 
2026-03-18 08:34:31.954901 | TASK [Generate bulk log download script]
2026-03-18 08:34:31.973220 | localhost | ok
2026-03-18 08:34:32.007903 | 
2026-03-18 08:34:32.008165 | TASK [local-log-download : Check API endpoint is defined]
2026-03-18 08:34:32.036166 | localhost | ok: All assertions passed
2026-03-18 08:34:32.040646 | 
2026-03-18 08:34:32.040726 | TASK [local-log-download : Create download script]
2026-03-18 08:34:32.409627 | localhost -> localhost | changed
2026-03-18 08:34:32.418705 | 
2026-03-18 08:34:32.418789 | TASK [Register quick-download link]
2026-03-18 08:34:32.448707 | localhost | ok
2026-03-18 08:34:32.464544 | 
2026-03-18 08:34:32.464650 | PLAY [logserver.rdoproject.org]
2026-03-18 08:34:32.475828 | 
2026-03-18 08:34:32.475914 | TASK [Set zuul-log-path fact]
2026-03-18 08:34:32.493466 | logserver.rdoproject.org | ok
2026-03-18 08:34:32.502706 | 
2026-03-18 08:34:32.502814 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-18 08:34:32.529698 | logserver.rdoproject.org | ok
2026-03-18 08:34:32.534787 | 
2026-03-18 08:34:32.534855 | TASK [upload-logs : Create log directories]
2026-03-18 08:34:33.411872 | logserver.rdoproject.org | changed
2026-03-18 08:34:33.418754 | 
2026-03-18 08:34:33.418894 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-18 08:34:33.752982 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.011448
2026-03-18 08:34:33.763353 | 
2026-03-18 08:34:33.763493 | TASK [upload-logs : Upload logs to log server]
2026-03-18 08:34:34.500379 | logserver.rdoproject.org | Output suppressed because no_log was given
2026-03-18 08:34:34.507297 | 
2026-03-18 08:34:34.507603 | LOOP [upload-logs : Compress console log and json output]
2026-03-18 08:34:34.584073 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-18 08:34:34.597207 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-18 08:34:34.607098 | 
2026-03-18 08:34:34.607361 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-18 08:34:34.660770 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-18 08:34:34.661247 | 
2026-03-18 08:34:34.664217 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-18 08:34:34.675708 | 
2026-03-18 08:34:34.676007 | LOOP [upload-logs : Upload console log and json output]