2026-03-08 21:56:18.017135 | Job console starting...
2026-03-08 21:56:18.029320 | Updating repositories
2026-03-08 21:56:18.053940 | Preparing job workspace
2026-03-08 21:56:21.362420 | Running Ansible setup...
2026-03-08 21:56:25.089461 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-03-08 21:56:25.673433 | 
2026-03-08 21:56:25.673540 | PLAY [localhost]
2026-03-08 21:56:25.682287 | 
2026-03-08 21:56:25.682357 | TASK [Gathering Facts]
2026-03-08 21:56:26.729615 | localhost | ok
2026-03-08 21:56:26.758298 | 
2026-03-08 21:56:26.758453 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-08 21:56:27.190248 | localhost -> localhost | changed
2026-03-08 21:56:27.197275 | 
2026-03-08 21:56:27.197379 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-08 21:56:28.094112 | localhost -> localhost | changed
2026-03-08 21:56:28.111931 | 
2026-03-08 21:56:28.112128 | TASK [Setup log path fact]
2026-03-08 21:56:28.143239 | localhost | ok
2026-03-08 21:56:28.165542 | 
2026-03-08 21:56:28.165634 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-08 21:56:28.205463 | localhost | ok
2026-03-08 21:56:28.215610 | 
2026-03-08 21:56:28.215699 | TASK [emit-job-header : Print job information]
2026-03-08 21:56:28.265950 | # Job Information
2026-03-08 21:56:28.266127 | Ansible Version: 2.15.12
2026-03-08 21:56:28.266163 | Job: vexxhost-hotstack-blank-image
2026-03-08 21:56:28.266190 | Pipeline: github-check
2026-03-08 21:56:28.266215 | Executor: ze01.softwarefactory-project.io
2026-03-08 21:56:28.266240 | Triggered by: https://github.com/openstack-k8s-operators/hotstack/pull/403
2026-03-08 21:56:28.266265 | Log URL (when completed): https://logserver.rdoproject.org/5e7/rdoproject.org/5e7065ac385646a5b8836f51fba3149f/
2026-03-08 21:56:28.266289 | Event ID: 85a2a270-1b39-11f1-8004-2ce54983d8f0
2026-03-08 21:56:28.271056 | 
2026-03-08 21:56:28.271139 | LOOP [emit-job-header : Print node information]
2026-03-08 21:56:28.385341 | localhost | ok:
2026-03-08 21:56:28.385810 | localhost | # Node Information
2026-03-08 21:56:28.385871 | localhost | Inventory Hostname: hotstack
2026-03-08 21:56:28.385920 | localhost | Hostname: np0005641836
2026-03-08 21:56:28.385963 | localhost | Username: zuul
2026-03-08 21:56:28.386006 | localhost | Distro: CentOS 9
2026-03-08 21:56:28.386090 | localhost | Provider: vexxhost-nodepool-tripleo
2026-03-08 21:56:28.386135 | localhost | Region: RegionOne
2026-03-08 21:56:28.386173 | localhost | Label: cloud-centos-9-stream-tripleo-vexxhost
2026-03-08 21:56:28.386210 | localhost | Product Name: OpenStack Nova
2026-03-08 21:56:28.386265 | localhost | Interface IP: 38.102.83.158
2026-03-08 21:56:28.413200 | 
2026-03-08 21:56:28.413323 | PLAY [all]
2026-03-08 21:56:28.421882 | 
2026-03-08 21:56:28.421961 | TASK [Gather network facts]
2026-03-08 21:56:28.889435 | hotstack | ok
2026-03-08 21:56:28.922308 | 
2026-03-08 21:56:28.922467 | TASK [include_role : start-zuul-console]
2026-03-08 21:56:28.949516 | hotstack | ok
2026-03-08 21:56:28.965476 | 
2026-03-08 21:56:28.965579 | TASK [start-zuul-console : Start zuul_console daemon.]
2026-03-08 21:56:29.399571 | hotstack | ok
2026-03-08 21:56:29.421984 | 
2026-03-08 21:56:29.422221 | TASK [include_role : add-build-sshkey]
2026-03-08 21:56:29.455782 | hotstack | ok
2026-03-08 21:56:29.475813 | 
2026-03-08 21:56:29.475977 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-08 21:56:29.747285 | hotstack -> localhost | ok
2026-03-08 21:56:29.752925 | 
2026-03-08 21:56:29.753016 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-08 21:56:29.773695 | hotstack | ok
2026-03-08 21:56:29.787300 | hotstack | included: /var/lib/zuul/builds/5e7065ac385646a5b8836f51fba3149f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-08 21:56:29.793357 | 
2026-03-08 21:56:29.793416 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-08 21:56:30.691474 | hotstack -> localhost | Generating public/private rsa key pair.
2026-03-08 21:56:30.691637 | hotstack -> localhost | Your identification has been saved in /var/lib/zuul/builds/5e7065ac385646a5b8836f51fba3149f/work/5e7065ac385646a5b8836f51fba3149f_id_rsa.
2026-03-08 21:56:30.691667 | hotstack -> localhost | Your public key has been saved in /var/lib/zuul/builds/5e7065ac385646a5b8836f51fba3149f/work/5e7065ac385646a5b8836f51fba3149f_id_rsa.pub.
2026-03-08 21:56:30.691688 | hotstack -> localhost | The key fingerprint is:
2026-03-08 21:56:30.691707 | hotstack -> localhost | SHA256:xFv17eUOgRiUXYhjJO1Jf+rexnYDP3HLI1ZamaQz4nA zuul-build-sshkey
2026-03-08 21:56:30.691726 | hotstack -> localhost | The key's randomart image is:
2026-03-08 21:56:30.691745 | hotstack -> localhost | +---[RSA 3072]----+
2026-03-08 21:56:30.691763 | hotstack -> localhost | |        .+++.o.  |
2026-03-08 21:56:30.691781 | hotstack -> localhost | |       . .B+oo . |
2026-03-08 21:56:30.691799 | hotstack -> localhost | |        o+o+. o o|
2026-03-08 21:56:30.691816 | hotstack -> localhost | |       . oo . .=.|
2026-03-08 21:56:30.691834 | hotstack -> localhost | |        S    o+ =|
2026-03-08 21:56:30.691851 | hotstack -> localhost | |         . E.= O.|
2026-03-08 21:56:30.691868 | hotstack -> localhost | |          +...X =|
2026-03-08 21:56:30.691885 | hotstack -> localhost | |           ..=+B.|
2026-03-08 21:56:30.691902 | hotstack -> localhost | |           .ooo.+|
2026-03-08 21:56:30.691918 | hotstack -> localhost | +----[SHA256]-----+
2026-03-08 21:56:30.691960 | hotstack -> localhost | ok: Runtime: 0:00:00.491686
2026-03-08 21:56:30.697641 | 
2026-03-08 21:56:30.697705 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-08 21:56:30.716403 | hotstack | ok
2026-03-08 21:56:30.725767 | hotstack | included: /var/lib/zuul/builds/5e7065ac385646a5b8836f51fba3149f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-08 21:56:30.733827 | 
2026-03-08 21:56:30.733889 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-08 21:56:30.748155 | hotstack | skipping: Conditional result was False
2026-03-08 21:56:30.755280 | 
2026-03-08 21:56:30.755362 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-08 21:56:31.220543 | hotstack | changed
2026-03-08 21:56:31.232107 | 
2026-03-08 21:56:31.232273 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-08 21:56:31.534367 | hotstack | ok
2026-03-08 21:56:31.545088 | 
2026-03-08 21:56:31.545224 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-08 21:56:32.358665 | hotstack | changed
2026-03-08 21:56:32.369433 | 
2026-03-08 21:56:32.369566 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-08 21:56:33.122251 | hotstack | changed
2026-03-08 21:56:33.133055 | 
2026-03-08 21:56:33.133188 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-08 21:56:33.149749 | hotstack | skipping: Conditional result was False
2026-03-08 21:56:33.161195 | 
2026-03-08 21:56:33.161327 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-08 21:56:33.555306 | hotstack -> localhost | changed
2026-03-08 21:56:33.576362 | 
2026-03-08 21:56:33.576498 | TASK [add-build-sshkey : Add back temp key]
2026-03-08 21:56:33.901418 | hotstack -> localhost | Identity added: /var/lib/zuul/builds/5e7065ac385646a5b8836f51fba3149f/work/5e7065ac385646a5b8836f51fba3149f_id_rsa (zuul-build-sshkey)
2026-03-08 21:56:33.901887 | hotstack -> localhost | ok: Runtime: 0:00:00.014760
2026-03-08 21:56:33.913235 | 
2026-03-08 21:56:33.913365 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-08 21:56:34.288798 | hotstack | ok
2026-03-08 21:56:34.298663 | 
2026-03-08 21:56:34.298819 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-08 21:56:34.336354 | hotstack | skipping: Conditional result was False
2026-03-08 21:56:34.356121 | 
2026-03-08 21:56:34.356253 | TASK [include_role : validate-host]
2026-03-08 21:56:34.391818 | hotstack | ok
2026-03-08 21:56:34.425368 | 
2026-03-08 21:56:34.425456 | TASK [validate-host : Define zuul_info_dir fact]
2026-03-08 21:56:34.469279 | hotstack | ok
2026-03-08 21:56:34.478950 | 
2026-03-08 21:56:34.479107 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2026-03-08 21:56:34.760173 | hotstack -> localhost | ok
2026-03-08 21:56:34.771487 | 
2026-03-08 21:56:34.771612 | TASK [validate-host : Collect information about the host]
2026-03-08 21:56:35.543959 | hotstack | ok
2026-03-08 21:56:35.563058 | 
2026-03-08 21:56:35.563189 | TASK [validate-host : Sanitize hostname]
2026-03-08 21:56:35.620312 | hotstack | ok
2026-03-08 21:56:35.630991 | 
2026-03-08 21:56:35.631165 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2026-03-08 21:56:36.106463 | hotstack -> localhost | changed
2026-03-08 21:56:36.117649 | 
2026-03-08 21:56:36.117779 | TASK [validate-host : Collect information about zuul worker]
2026-03-08 21:56:36.533189 | hotstack | ok
2026-03-08 21:56:36.543723 | 
2026-03-08 21:56:36.543863 | TASK [validate-host : Write out all zuul information for each host]
2026-03-08 21:56:37.045870 | hotstack -> localhost | changed
2026-03-08 21:56:37.068275 | 
2026-03-08 21:56:37.068454 | TASK [include_role : prepare-workspace-openshift]
2026-03-08 21:56:37.098868 | hotstack | skipping: Conditional result was False
2026-03-08 21:56:37.113548 | 
2026-03-08 21:56:37.113701 | TASK [include_role : remove-zuul-sshkey]
2026-03-08 21:56:37.141843 | hotstack | skipping: Conditional result was False
2026-03-08 21:56:37.155847 | 
2026-03-08 21:56:37.155996 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-08 21:56:37.425410 | hotstack | ok: "logs"
2026-03-08 21:56:37.425918 | hotstack | ok: All items complete
2026-03-08 21:56:37.425994 | 
2026-03-08 21:56:37.612561 | hotstack | ok: "artifacts"
2026-03-08 21:56:37.854575 | hotstack | ok: "docs"
2026-03-08 21:56:37.877371 | 
2026-03-08 21:56:37.877616 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-08 21:56:38.174356 | hotstack | changed: "logs"
2026-03-08 21:56:38.389687 | hotstack | changed: "artifacts"
2026-03-08 21:56:38.620747 | hotstack | changed: "docs"
2026-03-08 21:56:38.674099 | 
2026-03-08 21:56:38.674280 | PLAY RECAP
2026-03-08 21:56:38.674345 | hotstack | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-03-08 21:56:38.674381 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-08 21:56:38.674406 | 
2026-03-08 21:56:38.843865 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-03-08 21:56:38.845220 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/hotstack/pre_stage1.yaml@master]
2026-03-08 21:56:39.462717 | 
2026-03-08 21:56:39.462841 | PLAY [Create necessary files to deploy hotstack scenario]
2026-03-08 21:56:39.485102 | 
2026-03-08 21:56:39.485235 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-08 21:56:39.885838 | hotstack | ok
2026-03-08 21:56:39.898664 | 
2026-03-08 21:56:39.898821 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-08 21:56:41.988052 | hotstack | Output suppressed because no_log was given
2026-03-08 21:56:42.010320 | 
2026-03-08 21:56:42.010464 | LOOP [add-authorized-keys : Enable access via build key on all nodes]
2026-03-08 21:56:42.515964 | hotstack | changed:
2026-03-08 21:56:42.516269 | hotstack | {
2026-03-08 21:56:42.516336 | hotstack |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCINPOs6XsfMVQMqjmiduT3Bxhogy7MbAFOWlR+9LlKkTW1kV6glsCXY5svtggd2zRtc40UWalHaj9jC+yEkZdI35h2PkK+Sww52u4nczqgNpIFNt7Dm2xtYKbTolAV9jSeNkRlGMCq9EBzQlwiV0HkHx1CdNR/zzXbyNZLmOybFkXqR150H01kUhdv0v6AMWTDZjMEWO/PaWCOgzZhH9ztXjy+rwa7pdaI4+0Pb9Kib+d8/IrgNsLB/sCazqD+9/COI6AHqzTDS1aU9/gMQrUN1ronzMEQhzzOuoI8WeLqU++j+0dT2UWVPlQqoln+RYu7dUn/DSZDrsYenudT5+P"
2026-03-08 21:56:42.516388 | hotstack | }
2026-03-08 21:56:42.541088 | 
2026-03-08 21:56:42.541265 | TASK [Assert cloud name and cloud secret]
2026-03-08 21:56:42.611442 | hotstack | Output suppressed because no_log was given
2026-03-08 21:56:42.622246 | 
2026-03-08 21:56:42.622372 | TASK [Ensure openstack release repo is installed]
2026-03-08 21:56:46.119772 | hotstack | changed
2026-03-08 21:56:46.131339 | 
2026-03-08 21:56:46.131466 | TASK [Install openstack client packages]
2026-03-08 21:56:59.946609 | hotstack | changed
2026-03-08 21:56:59.953858 | 
2026-03-08 21:56:59.953934 | TASK [Ensure HotStack work dir]
2026-03-08 21:57:00.291092 | hotstack | changed
2026-03-08 21:57:00.298861 | 
2026-03-08 21:57:00.299038 | LOOP [Ensure etc directories]
2026-03-08 21:57:00.549128 | hotstack | changed: "/etc/openstack"
2026-03-08 21:57:00.549645 | hotstack | changed: All items complete
2026-03-08 21:57:00.549708 | 
2026-03-08 21:57:00.753495 | hotstack | changed: "/etc/hotstack"
2026-03-08 21:57:00.771865 | 
2026-03-08 21:57:00.771999 | TASK [Ensure .ssh dir exists]
2026-03-08 21:57:01.002124 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:01.014138 | 
2026-03-08 21:57:01.014266 | TASK [Ensure ssh keypair exists]
2026-03-08 21:57:11.721048 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:11.728496 | 
2026-03-08 21:57:11.728582 | TASK [Generate CA cert file]
2026-03-08 21:57:11.763227 | hotstack | skipping: Conditional result was False
2026-03-08 21:57:11.771417 | 
2026-03-08 21:57:11.771503 | TASK [Update CA certs]
2026-03-08 21:57:12.307925 | hotstack | skipping: Conditional result was False
2026-03-08 21:57:12.315757 | 
2026-03-08 21:57:12.315840 | TASK [Set _auth_type fact]
2026-03-08 21:57:12.368461 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:12.374656 | 
2026-03-08 21:57:12.374737 | TASK [Write clouds.yaml - user/password]
2026-03-08 21:57:13.427947 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:13.439558 | 
2026-03-08 21:57:13.439807 | TASK [Create application credential for sushy-emulator]
2026-03-08 21:57:15.498168 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:15.510924 | 
2026-03-08 21:57:15.511175 | TASK [Read application credential from file]
2026-03-08 21:57:15.891633 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:15.896668 | 
2026-03-08 21:57:15.896739 | TASK [Delete temporary application credential file]
2026-03-08 21:57:16.125919 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:16.135134 | 
2026-03-08 21:57:16.135287 | TASK [Assert application credential id and secret]
2026-03-08 21:57:16.239334 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:16.254404 | 
2026-03-08 21:57:16.254606 | TASK [Write new clouds.yaml with application credentials]
2026-03-08 21:57:17.016055 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:17.026822 | 
2026-03-08 21:57:17.026977 | TASK [Write hotstack cloud-secret.yaml]
2026-03-08 21:57:17.717545 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:17.729242 | 
2026-03-08 21:57:17.729377 | TASK [Write clouds.yaml with application credentials]
2026-03-08 21:57:17.768732 | 
2026-03-08 21:57:17.769000 | TASK [Write hotstack cloud-secret.yaml]
2026-03-08 21:57:17.834905 | 
2026-03-08 21:57:17.835159 | PLAY RECAP
2026-03-08 21:57:17.835226 | hotstack | ok: 18 changed: 11 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 0
2026-03-08 21:57:17.835253 | 
2026-03-08 21:57:17.939713 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/hotstack/pre_stage1.yaml@master]
2026-03-08 21:57:17.940478 | RUN START: [trusted : review.rdoproject.org/config/playbooks/hotstack/hotstack-blank-image-run.yaml@master]
2026-03-08 21:57:18.506131 | 
2026-03-08 21:57:18.506241 | PLAY [Update hotstack sushy-tools-blank-image]
2026-03-08 21:57:18.526655 | 
2026-03-08 21:57:18.526766 | TASK [Install packages (dependencies)]
2026-03-08 21:57:21.133215 | hotstack | changed
2026-03-08 21:57:21.144770 | 
2026-03-08 21:57:21.144943 | TASK [Set hotstack images dir fact]
2026-03-08 21:57:21.223138 | hotstack | ok
2026-03-08 21:57:21.235432 | 
2026-03-08 21:57:21.235577 | TASK [Build the sushy-tools-blank-image image]
2026-03-08 17:57:21.667185 | hotstack | qemu-img create -f raw blank-image.qcow2 1M
2026-03-08 17:57:21.673757 | hotstack | Formatting 'blank-image.qcow2', fmt=raw size=1048576
2026-03-08 21:57:21.780908 | hotstack | changed
2026-03-08 21:57:21.792690 | 
2026-03-08 21:57:21.792869 | TASK [Set image name fact]
2026-03-08 21:57:21.840864 | hotstack | ok
2026-03-08 21:57:21.852064 | 
2026-03-08 21:57:21.852204 | TASK [Get current sushy-tools-blank image id's]
2026-03-08 21:57:24.197332 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:24.208422 | 
2026-03-08 21:57:24.208563 | TASK [Upload image to glance]
2026-03-08 21:57:27.441516 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:27.452560 | 
2026-03-08 21:57:27.452698 | LOOP [Add archived suffix to old images]
2026-03-08 21:57:29.822345 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:29.836667 | 
2026-03-08 21:57:29.836838 | TASK [Rename new image]
2026-03-08 21:57:32.104327 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:32.115067 | 
2026-03-08 21:57:32.115196 | LOOP [Delete archived images if possible]
2026-03-08 21:57:34.466091 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:34.472547 | 
2026-03-08 21:57:34.472625 | TASK [DEBUG - Archived images delete]
2026-03-08 21:57:34.514481 | hotstack | ERROR
2026-03-08 21:57:34.514741 | hotstack | {
2026-03-08 21:57:34.514784 | hotstack |   "msg": "Not all archived images where deleted.\n\nArchived images: {'changed': False, 'images': [{'checksum': 'b6d81b360a5672d80c27430f39153e2c', 'container_format': 'bare', 'created_at': '2026-02-27T21:12:23Z', 'disk_format': 'raw', 'is_hidden': False, 'is_protected': False, 'hash_algo': 'sha256', 'hash_value': '30e14955ebf1352266dc2ff8067e68104607e750abb9d3b36582b8af909fcb58', 'min_disk': 0, 'min_ram': 0, 'name': 'sushy-tools-blank-image', 'owner': '4b633c451ac74233be3721a3635275e5', 'owner_id': '4b633c451ac74233be3721a3635275e5', 'properties': {'hw_firmware_type': 'uefi', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/sushy-tools-blank-image-e997268a', 'owner_specified.openstack.sha256': ''}, 'size': 1048576, 'store': None, 'status': 'active', 'updated_at': '2026-02-27T21:12:28Z', 'virtual_size': 1048576, 'visibility': 'private', 'file': '/v2/images/13dd9cab-35ea-4bce-9a49-7dce65f6285a/file', 'locations': [{'url': 'rbd://d449eca9-e75a-46a7-a01e-4f844da6f49b/images/13dd9cab-35ea-4bce-9a49-7dce65f6285a/snap', 'metadata': {}}], 'direct_url': 'rbd://d449eca9-e75a-46a7-a01e-4f844da6f49b/images/13dd9cab-35ea-4bce-9a49-7dce65f6285a/snap', 'url': None, 'metadata': None, 'architecture': None, 'hypervisor_type': None, 'instance_type_rxtx_factor': None, 'instance_uuid': None, 'needs_config_drive': None, 'kernel_id': None, 'os_distro': None, 'os_version': None, 'needs_secure_boot': None, 'os_shutdown_timeout': 5, 'ramdisk_id': None, 'vm_mode': None, 'hw_cpu_sockets': None, 'hw_cpu_cores': None, 'hw_cpu_threads': None, 'hw_disk_bus': None, 'hw_cpu_policy': None, 'hw_cpu_thread_policy': None, 'hw_rng_model': None, 'hw_machine_type': 'q35', 'hw_scsi_model': None, 'hw_serial_port_count': None, 'hw_video_model': None, 'hw_video_ram': None, 'hw_watchdog_action': None, 'os_command_line': None, 'hw_vif_model': None, 'is_hw_vif_multiqueue_enabled': None, 'is_hw_boot_menu_enabled': None, 'vmware_adaptertype': None, 'vmware_ostype': None, 'has_auto_disk_config': None, 'os_type': None, 'os_admin_user': None, 'hw_qemu_guest_agent': None, 'os_require_quiesce': None, 'schema': '/v2/schemas/image', 'id': '13dd9cab-35ea-4bce-9a49-7dce65f6285a', 'tags': ['hotstack', 'hotstack-blank-image']}], 'failed': False}\n\nDelete results:\n\n{'results': [{'extra_data': {'data': None, 'details': '500 Internal Server Error: The server has either erred or is incapable of performing the requested operation.', 'response': '<html>\\n <head>\\n  <title>500 Internal Server Error</title>\\n </head>\\n <body>\\n  <h1>500 Internal Server Error</h1>\\n  The server has either erred or is incapable of performing the requested operation.<br /><br />\\n\\n\\n\\n </body>\\n</html>'}, 'failed': True, 'msg': 'HttpException: 500: Server Error for url: https://image.rdo.mtl2.vexxhost.net/v2/images/13dd9cab-35ea-4bce-9a49-7dce65f6285a, 500 Internal Server Error: The server has either erred or is incapable of performing the requested operation.', 'invocation': {'module_args': {'id': '13dd9cab-35ea-4bce-9a49-7dce65f6285a', 'name': 'sushy-tools-blank-image', 'state': 'absent', 'wait': True, 'timeout': 180, 'interface': 'public', 'sdk_log_level': 'INFO', 'container_format': 'bare', 'disk_format': 'qcow2', 'is_public': False, 'properties': {}, 'tags': [], 'auth_type': None, 'auth': None, 'region_name': None, 'validate_certs': None, 'ca_cert': None, 'client_cert': None, 'client_key': None, 'api_timeout': None, 'sdk_log_path': None, 'checksum': None, 'filename': None, 'is_protected': None, 'kernel': None, 'min_disk': None, 'min_ram': None, 'owner': None, 'owner_domain': None, 'ramdisk': None, 'visibility': None, 'volume': None}}, 'changed': False, 'item': {'checksum': 'b6d81b360a5672d80c27430f39153e2c', 'container_format': 'bare', 'created_at': '2026-02-27T21:12:23Z', 'disk_format': 'raw', 'is_hidden': False, 'is_protected': False, 'hash_algo': 'sha256', 'hash_value': '30e14955ebf1352266dc2ff8067e68104607e750abb9d3b36582b8af909fcb58', 'min_disk': 0, 'min_ram': 0, 'name': 'sushy-tools-blank-image', 'owner': '4b633c451ac74233be3721a3635275e5', 'owner_id': '4b633c451ac74233be3721a3635275e5', 'properties': {'hw_firmware_type': 'uefi', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/sushy-tools-blank-image-e997268a', 'owner_specified.openstack.sha256': ''}, 'size': 1048576, 'store': None, 'status': 'active', 'updated_at': '2026-02-27T21:12:28Z', 'virtual_size': 1048576, 'visibility': 'private', 'file': '/v2/images/13dd9cab-35ea-4bce-9a49-7dce65f6285a/file', 'locations': [{'url': 'rbd://d449eca9-e75a-46a7-a01e-4f844da6f49b/images/13dd9cab-35ea-4bce-9a49-7dce65f6285a/snap', 'metadata': {}}], 'direct_url': 'rbd://d449eca9-e75a-46a7-a01e-4f844da6f49b/images/13dd9cab-35ea-4bce-9a49-7dce65f6285a/snap', 'url': None, 'metadata': None, 'architecture': None, 'hypervisor_type': None, 'instance_type_rxtx_factor': None, 'instance_uuid': None, 'needs_config_drive': None, 'kernel_id': None, 'os_distro': None, 'os_version': None, 'needs_secure_boot': None, 'os_shutdown_timeout': 5, 'ramdisk_id': None, 'vm_mode': None, 'hw_cpu_sockets': None, 'hw_cpu_cores': None, 'hw_cpu_threads': None, 'hw_disk_bus': None, 'hw_cpu_policy': None, 'hw_cpu_thread_policy': None, 'hw_rng_model': None, 'hw_machine_type': 'q35', 'hw_scsi_model': None, 'hw_serial_port_count': None, 'hw_video_model': None, 'hw_video_ram': None, 'hw_watchdog_action': None, 'os_command_line': None, 'hw_vif_model': None, 'is_hw_vif_multiqueue_enabled': None, 'is_hw_boot_menu_enabled': None, 'vmware_adaptertype': None, 'vmware_ostype': None, 'has_auto_disk_config': None, 'os_type': None, 'os_admin_user': None, 'hw_qemu_guest_agent': None, 'os_require_quiesce': None, 'schema': '/v2/schemas/image', 'id': '13dd9cab-35ea-4bce-9a49-7dce65f6285a', 'tags': ['hotstack', 'hotstack-blank-image']}, 'ansible_loop_var': 'item'}], 'skipped': False, 'failed': True, 'msg': 'One or more items failed', 'changed': False}\n"
2026-03-08 21:57:34.514833 | hotstack | }
2026-03-08 21:57:34.516195 | 
2026-03-08 21:57:34.516257 | PLAY RECAP
2026-03-08 21:57:34.516309 | hotstack | ok: 8 changed: 5 unreachable: 0 failed: 1 skipped: 0 rescued: 1 ignored: 0
2026-03-08 21:57:34.516337 | 
2026-03-08 21:57:34.622422 | RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/hotstack/hotstack-blank-image-run.yaml@master]
2026-03-08 21:57:34.623181 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/hotstack/hotstack-image-post.yaml@master]
2026-03-08 21:57:35.188182 | 
2026-03-08 21:57:35.188283 | PLAY [Cleanup hotstack image build environment]
2026-03-08 21:57:35.209225 | 
2026-03-08 21:57:35.209338 | TASK [Set _auth_type fact]
2026-03-08 21:57:35.258068 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:35.263578 | 
2026-03-08 21:57:35.263647 | TASK [Write clouds.yaml]
2026-03-08 21:57:36.309171 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:36.320473 | 
2026-03-08 21:57:36.320621 | TASK [Delete application credentials]
2026-03-08 21:57:39.372813 | hotstack | changed
2026-03-08 21:57:39.384429 | 
2026-03-08 21:57:39.384562 | TASK [Delete clouds.yaml]
2026-03-08 21:57:39.829248 | hotstack | Output suppressed because no_log was given
2026-03-08 21:57:39.868572 | 
2026-03-08 21:57:39.868680 | PLAY RECAP
2026-03-08 21:57:39.868769 | hotstack | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-08 21:57:39.868814 | 
2026-03-08 21:57:40.011346 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/hotstack/hotstack-image-post.yaml@master]
2026-03-08 21:57:40.012743 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-03-08 21:57:40.597535 | 
2026-03-08 21:57:40.597642 | PLAY [all]
2026-03-08 21:57:40.616812 | 
2026-03-08 21:57:40.616927 | TASK [include_role : fetch-output]
2026-03-08 21:57:40.656187 | hotstack | ok
2026-03-08 21:57:40.672721 | 
2026-03-08 21:57:40.672833 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-08 21:57:40.717673 | hotstack | skipping: Conditional result was False
2026-03-08 21:57:40.725390 | 
2026-03-08 21:57:40.725500 | TASK [fetch-output : Set log path for single node]
2026-03-08 21:57:40.783731 | hotstack | ok
2026-03-08 21:57:40.794670 | 
2026-03-08 21:57:40.794812 | LOOP [fetch-output : Ensure local output dirs]
2026-03-08 21:57:41.239409 | hotstack -> localhost | ok: "/var/lib/zuul/builds/5e7065ac385646a5b8836f51fba3149f/work/logs"
2026-03-08 21:57:41.533591 | hotstack -> localhost | changed: "/var/lib/zuul/builds/5e7065ac385646a5b8836f51fba3149f/work/artifacts"
2026-03-08 21:57:41.759704 | hotstack -> localhost | changed: "/var/lib/zuul/builds/5e7065ac385646a5b8836f51fba3149f/work/docs"
2026-03-08 21:57:41.775366 | 
2026-03-08 21:57:41.775498 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-08 21:57:42.436480 | hotstack | ok
2026-03-08 21:57:42.436674 | hotstack | changed: All items complete
2026-03-08 21:57:42.436703 | 
2026-03-08 21:57:42.897839 | hotstack | changed: .d..t...... ./
2026-03-08 21:57:43.413829 | hotstack | changed: .d..t...... ./
2026-03-08 21:57:43.436368 | 
2026-03-08 21:57:43.436510 | TASK [include_role : fetch-output-openshift]
2026-03-08 21:57:43.461834 | hotstack | skipping: Conditional result was False
2026-03-08 21:57:43.470152 | 
2026-03-08 21:57:43.470240 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-08 21:57:43.862298 | hotstack -> localhost | ok: Item: artifacts Runtime: 0:00:00.007002
2026-03-08 21:57:44.067236 | hotstack -> localhost | ok: Item: docs Runtime: 0:00:00.006975
2026-03-08 21:57:44.099192 | 
2026-03-08 21:57:44.099298 | PLAY [all]
2026-03-08 21:57:44.113434 | 
2026-03-08 21:57:44.113528 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-08 21:57:44.577590 | hotstack | changed
2026-03-08 21:57:44.625632 | 
2026-03-08 21:57:44.625752 | PLAY RECAP
2026-03-08 21:57:44.625812 | hotstack | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2026-03-08 21:57:44.625841 | 
2026-03-08 21:57:44.725841 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-03-08 21:57:44.726537 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master]
2026-03-08 21:57:45.326974 | 
2026-03-08 21:57:45.327105 | PLAY [localhost]
2026-03-08 21:57:45.344821 | 
2026-03-08 21:57:45.344911 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-08 21:57:45.734158 | localhost | changed
2026-03-08 21:57:45.743993 | 
2026-03-08 21:57:45.744205 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-08 21:57:45.770652 | localhost | ok
2026-03-08 21:57:45.788625 | 
2026-03-08 21:57:45.788782 | TASK [add-fileserver : Create SSH private key tempfile]
2026-03-08 21:57:46.119797 | localhost | changed
2026-03-08 21:57:46.130724 | 
2026-03-08 21:57:46.130907 | TASK [add-fileserver : Create SSH private key from secret]
2026-03-08 21:57:46.749933 | localhost | changed
2026-03-08 21:57:46.775946 | 
2026-03-08 21:57:46.776057 | TASK [add-fileserver : Add fileserver ssh key]
2026-03-08 21:57:47.188591 | localhost | Identity added: /var/lib/zuul/builds/5e7065ac385646a5b8836f51fba3149f/work/tmp/ansible.9_sf_mux (/var/lib/zuul/builds/5e7065ac385646a5b8836f51fba3149f/work/tmp/ansible.9_sf_mux)
2026-03-08 21:57:47.188900 | localhost | ok: Runtime: 0:00:00.013425
2026-03-08 21:57:47.198599 | 
2026-03-08 21:57:47.198741 | TASK [add-fileserver : Remove SSH private key from disk]
2026-03-08 21:57:47.510812 | localhost | ok: Runtime: 0:00:00.008813
2026-03-08 21:57:47.521157 | 
2026-03-08 21:57:47.521294 | TASK [add-fileserver : Add fileserver to inventory]
2026-03-08 21:57:47.598898 | localhost | changed
2026-03-08 21:57:47.609517 | 
2026-03-08 21:57:47.609651 | TASK [add-fileserver : Add fileserver server to known hosts]
2026-03-08 21:57:48.043839 | localhost | changed
2026-03-08 21:57:48.083528 | 
2026-03-08 21:57:48.083663 | PLAY [localhost]
2026-03-08 21:57:48.099513 | 
2026-03-08 21:57:48.099615 | TASK [Generate bulk log download script]
2026-03-08 21:57:48.121442 | localhost | ok
2026-03-08 21:57:48.137306 | 
2026-03-08 21:57:48.137398 | TASK [local-log-download : Check API endpoint is defined]
2026-03-08 21:57:48.192103 | localhost | ok: All assertions passed
2026-03-08 21:57:48.202337 | 
2026-03-08 21:57:48.202472 | TASK [local-log-download : Create download script]
2026-03-08 21:57:48.667809 | localhost -> localhost | changed
2026-03-08 21:57:48.687756 | 
2026-03-08 21:57:48.687896 | TASK [Register quick-download link]
2026-03-08 21:57:48.723299 | localhost | ok
2026-03-08 21:57:48.783661 | 
2026-03-08 21:57:48.783776 | PLAY [logserver.rdoproject.org]
2026-03-08 21:57:48.796578 | 
2026-03-08 21:57:48.796657 | TASK [Set zuul-log-path fact]
2026-03-08 21:57:48.814995 | logserver.rdoproject.org | ok
2026-03-08 21:57:48.826834 | 
2026-03-08 21:57:48.826924 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-08 21:57:48.864986 | logserver.rdoproject.org | ok
2026-03-08 21:57:48.872050 | 
2026-03-08 21:57:48.872131 | TASK [upload-logs : Create log directories]
2026-03-08 21:57:49.762534 | logserver.rdoproject.org | changed
2026-03-08 21:57:49.769554 | 
2026-03-08 21:57:49.769721 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-08 21:57:50.086990 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.008752
2026-03-08 21:57:50.095435 | 
2026-03-08 21:57:50.095591 | TASK [upload-logs : Upload logs to log server]
2026-03-08 21:57:50.860438 | logserver.rdoproject.org | Output suppressed because no_log was given
2026-03-08 21:57:50.866782 | 
2026-03-08 21:57:50.866919 | LOOP [upload-logs : Compress console log and json output]
2026-03-08 21:57:50.938624 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-08 21:57:50.950059 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-08 21:57:50.962132 | 
2026-03-08 21:57:50.962321 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-08 21:57:51.011353 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-08 21:57:51.011857 | 
2026-03-08 21:57:51.014572 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-08 21:57:51.030665 | 
2026-03-08 21:57:51.030868 | LOOP [upload-logs : Upload console log and json output]