2025-10-11 16:26:20.979665 | Job console starting...
2025-10-11 16:26:20.990594 | Updating repositories
2025-10-11 16:26:21.013894 | Preparing job workspace
2025-10-11 16:26:26.786761 | Running Ansible setup...
2025-10-11 16:26:30.886828 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2025-10-11 16:26:31.439066 | 
2025-10-11 16:26:31.439173 | PLAY [localhost]
2025-10-11 16:26:31.447599 | 
2025-10-11 16:26:31.447668 | TASK [Gathering Facts]
2025-10-11 16:26:32.436118 | localhost | ok
2025-10-11 16:26:32.468396 | 
2025-10-11 16:26:32.468602 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2025-10-11 16:26:32.916335 | localhost -> localhost | changed
2025-10-11 16:26:32.927433 | 
2025-10-11 16:26:32.927574 | TASK [log-inventory : Copy ansible inventory to logs dir]
2025-10-11 16:26:33.759670 | localhost -> localhost | changed
2025-10-11 16:26:33.777099 | 
2025-10-11 16:26:33.777245 | TASK [Setup log path fact]
2025-10-11 16:26:33.801210 | localhost | ok
2025-10-11 16:26:33.824491 | 
2025-10-11 16:26:33.824616 | TASK [set-zuul-log-path-fact : Set log path for a build]
2025-10-11 16:26:33.848188 | localhost | ok
2025-10-11 16:26:33.864031 | 
2025-10-11 16:26:33.864161 | TASK [emit-job-header : Print job information]
2025-10-11 16:26:33.916836 | # Job Information
2025-10-11 16:26:33.917074 | Ansible Version: 2.15.12
2025-10-11 16:26:33.917129 | Job: vexxhost-hotstack-secret-rotate
2025-10-11 16:26:33.917171 | Pipeline: github-experimental-trigger
2025-10-11 16:26:33.917209 | Executor: ze03.softwarefactory-project.io
2025-10-11 16:26:33.917247 | Triggered by: https://github.com/openstack-k8s-operators/hotstack/pull/256
2025-10-11 16:26:33.917286 | Log URL (when completed): https://logserver.rdoproject.org/940/rdoproject.org/940225484a7545aa87e051a62bdab4af/
2025-10-11 16:26:33.917324 | Event ID: d84ce340-a6be-11f0-972c-84e2db0af46a
2025-10-11 16:26:33.925398 | 
2025-10-11 16:26:33.925528 | LOOP [emit-job-header : Print node information]
2025-10-11 16:26:34.040876 | localhost | ok:
2025-10-11 16:26:34.041045 | localhost | # Node Information
2025-10-11 16:26:34.041072 | localhost | Inventory Hostname: hotstack
2025-10-11 16:26:34.041095 | localhost | Hostname: np0005481217
2025-10-11 16:26:34.041114 | localhost | Username: zuul
2025-10-11 16:26:34.041134 | localhost | Distro: CentOS 9
2025-10-11 16:26:34.041152 | localhost | Provider: vexxhost-nodepool-tripleo
2025-10-11 16:26:34.041169 | localhost | Region: RegionOne
2025-10-11 16:26:34.041185 | localhost | Label: cloud-centos-9-stream-tripleo-vexxhost
2025-10-11 16:26:34.041201 | localhost | Product Name: OpenStack Nova
2025-10-11 16:26:34.041218 | localhost | Interface IP: 38.102.83.102
2025-10-11 16:26:34.072844 | 
2025-10-11 16:26:34.072967 | PLAY [all]
2025-10-11 16:26:34.081521 | 
2025-10-11 16:26:34.081604 | TASK [Gather network facts]
2025-10-11 16:26:34.649462 | hotstack | ok
2025-10-11 16:26:34.680444 | 
2025-10-11 16:26:34.680567 | TASK [include_role : start-zuul-console]
2025-10-11 16:26:34.703581 | hotstack | ok
2025-10-11 16:26:34.718530 | 
2025-10-11 16:26:34.718611 | TASK [start-zuul-console : Start zuul_console daemon.]
2025-10-11 16:26:35.203808 | hotstack | ok
2025-10-11 16:26:35.212260 | 
2025-10-11 16:26:35.212322 | TASK [include_role : add-build-sshkey]
2025-10-11 16:26:35.241080 | hotstack | ok
2025-10-11 16:26:35.253860 | 
2025-10-11 16:26:35.253971 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2025-10-11 16:26:35.491897 | hotstack -> localhost | ok
2025-10-11 16:26:35.503425 | 
2025-10-11 16:26:35.503575 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2025-10-11 16:26:35.541044 | hotstack | ok
2025-10-11 16:26:35.567540 | hotstack | included: /var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2025-10-11 16:26:35.575923 | 
2025-10-11 16:26:35.576065 | TASK [add-build-sshkey : Create Temp SSH key]
2025-10-11 16:26:36.553254 | hotstack -> localhost | Generating public/private rsa key pair.
2025-10-11 16:26:36.553470 | hotstack -> localhost | Your identification has been saved in /var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/work/940225484a7545aa87e051a62bdab4af_id_rsa.
2025-10-11 16:26:36.553501 | hotstack -> localhost | Your public key has been saved in /var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/work/940225484a7545aa87e051a62bdab4af_id_rsa.pub.
2025-10-11 16:26:36.553523 | hotstack -> localhost | The key fingerprint is:
2025-10-11 16:26:36.553542 | hotstack -> localhost | SHA256:5jB4JEN87EFv7GnfCGQKW+K7dGNTUsgXhClyrlMC1hc zuul-build-sshkey
2025-10-11 16:26:36.553563 | hotstack -> localhost | The key's randomart image is:
2025-10-11 16:26:36.553581 | hotstack -> localhost | +---[RSA 3072]----+
2025-10-11 16:26:36.553599 | hotstack -> localhost | |  ...Eo+o        |
2025-10-11 16:26:36.553618 | hotstack -> localhost | |...o+o*+ .       |
2025-10-11 16:26:36.553637 | hotstack -> localhost | |.. +*+=.O        |
2025-10-11 16:26:36.553654 | hotstack -> localhost | |  ..oX.O .       |
2025-10-11 16:26:36.553672 | hotstack -> localhost | |   ++ * S        |
2025-10-11 16:26:36.553689 | hotstack -> localhost | |  o  o O o o     |
2025-10-11 16:26:36.553706 | hotstack -> localhost | |   .o = . o .    |
2025-10-11 16:26:36.553741 | hotstack -> localhost | |   . + o         |
2025-10-11 16:26:36.553766 | hotstack -> localhost | |    .            |
2025-10-11 16:26:36.553784 | hotstack -> localhost | +----[SHA256]-----+
2025-10-11 16:26:36.553829 | hotstack -> localhost | ok: Runtime: 0:00:00.542873
2025-10-11 16:26:36.559375 | 
2025-10-11 16:26:36.559444 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2025-10-11 16:26:36.588934 | hotstack | ok
2025-10-11 16:26:36.598756 | hotstack | included: /var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2025-10-11 16:26:36.607458 | 
2025-10-11 16:26:36.607527 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2025-10-11 16:26:36.632165 | hotstack | skipping: Conditional result was False
2025-10-11 16:26:36.638152 | 
2025-10-11 16:26:36.638215 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2025-10-11 16:26:37.119879 | hotstack | changed
2025-10-11 16:26:37.130378 | 
2025-10-11 16:26:37.130512 | TASK [add-build-sshkey : Make sure user has a .ssh]
2025-10-11 16:26:37.433162 | hotstack | ok
2025-10-11 16:26:37.443549 | 
2025-10-11 16:26:37.443680 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2025-10-11 16:26:38.421854 | hotstack | changed
2025-10-11 16:26:38.427257 | 
2025-10-11 16:26:38.427317 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2025-10-11 16:26:39.447525 | hotstack | changed
2025-10-11 16:26:39.458697 | 
2025-10-11 16:26:39.458900 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2025-10-11 16:26:39.496048 | hotstack | skipping: Conditional result was False
2025-10-11 16:26:39.508627 | 
2025-10-11 16:26:39.508799 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2025-10-11 16:26:39.913034 | hotstack -> localhost | changed
2025-10-11 16:26:39.936487 | 
2025-10-11 16:26:39.936637 | TASK [add-build-sshkey : Add back temp key]
2025-10-11 16:26:40.289603 | hotstack -> localhost | Identity added: /var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/work/940225484a7545aa87e051a62bdab4af_id_rsa (zuul-build-sshkey)
2025-10-11 16:26:40.290053 | hotstack -> localhost | ok: Runtime: 0:00:00.013799
2025-10-11 16:26:40.302450 | 
2025-10-11 16:26:40.302599 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2025-10-11 16:26:40.711924 | hotstack | ok
2025-10-11 16:26:40.722987 | 
2025-10-11 16:26:40.723115 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2025-10-11 16:26:40.749055 | hotstack | skipping: Conditional result was False
2025-10-11 16:26:40.769990 | 
2025-10-11 16:26:40.770151 | TASK [include_role : validate-host]
2025-10-11 16:26:40.809532 | hotstack | ok
2025-10-11 16:26:40.842017 | 
2025-10-11 16:26:40.842104 | TASK [validate-host : Define zuul_info_dir fact]
2025-10-11 16:26:40.883025 | hotstack | ok
2025-10-11 16:26:40.889293 | 
2025-10-11 16:26:40.889373 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2025-10-11 16:26:41.177081 | hotstack -> localhost | ok
2025-10-11 16:26:41.185790 | 
2025-10-11 16:26:41.185889 | TASK [validate-host : Collect information about the host]
2025-10-11 16:26:42.047450 | hotstack | ok
2025-10-11 16:26:42.065710 | 
2025-10-11 16:26:42.065869 | TASK [validate-host : Sanitize hostname]
2025-10-11 16:26:42.142146 | hotstack | ok
2025-10-11 16:26:42.152465 | 
2025-10-11 16:26:42.152597 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2025-10-11 16:26:42.677956 | hotstack -> localhost | changed
2025-10-11 16:26:42.689024 | 
2025-10-11 16:26:42.689159 | TASK [validate-host : Collect information about zuul worker]
2025-10-11 16:26:43.183991 | hotstack | ok
2025-10-11 16:26:43.194064 | 
2025-10-11 16:26:43.194194 | TASK [validate-host : Write out all zuul information for each host]
2025-10-11 16:26:43.699915 | hotstack -> localhost | changed
2025-10-11 16:26:43.720391 | 
2025-10-11 16:26:43.720521 | TASK [include_role : prepare-workspace-openshift]
2025-10-11 16:26:43.746870 | hotstack | skipping: Conditional result was False
2025-10-11 16:26:43.757552 | 
2025-10-11 16:26:43.757680 | TASK [include_role : remove-zuul-sshkey]
2025-10-11 16:26:43.785053 | hotstack | skipping: Conditional result was False
2025-10-11 16:26:43.796019 | 
2025-10-11 16:26:43.796154 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2025-10-11 16:26:44.071768 | hotstack | ok: "logs"
2025-10-11 16:26:44.072178 | hotstack | ok: All items complete
2025-10-11 16:26:44.072237 | 
2025-10-11 16:26:44.296012 | hotstack | ok: "artifacts"
2025-10-11 16:26:44.523070 | hotstack | ok: "docs"
2025-10-11 16:26:44.537393 | 
2025-10-11 16:26:44.537529 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2025-10-11 16:26:44.828598 | hotstack | changed: "logs"
2025-10-11 16:26:45.050060 | hotstack | changed: "artifacts"
2025-10-11 16:26:45.316277 | hotstack | changed: "docs"
2025-10-11 16:26:45.348097 | 
2025-10-11 16:26:45.348197 | PLAY RECAP
2025-10-11 16:26:45.348241 | hotstack | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2025-10-11 16:26:45.348266 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2025-10-11 16:26:45.348284 | 
2025-10-11 16:26:45.444240 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2025-10-11 16:26:45.446881 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/hotstack/pre_stage1.yaml@master]
2025-10-11 16:26:46.016622 | 
2025-10-11 16:26:46.016793 | PLAY [Create necessary files to deploy hotstack scenario]
2025-10-11 16:26:46.037283 | 
2025-10-11 16:26:46.037382 | TASK [prepare-workspace : Start zuul_console daemon.]
2025-10-11 16:26:46.485328 | hotstack | ok
2025-10-11 16:26:46.493969 | 
2025-10-11 16:26:46.494074 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2025-10-11 16:26:49.319644 | hotstack | Output suppressed because no_log was given
2025-10-11 16:26:49.341293 | 
2025-10-11 16:26:49.341432 | LOOP [add-authorized-keys : Enable access via build key on all nodes]
2025-10-11 16:26:49.839466 | hotstack | changed:
2025-10-11 16:26:49.839681 | hotstack | {
2025-10-11 16:26:49.839709 | hotstack |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCINPOs6XsfMVQMqjmiduT3Bxhogy7MbAFOWlR+9LlKkTW1kV6glsCXY5svtggd2zRtc40UWalHaj9jC+yEkZdI35h2PkK+Sww52u4nczqgNpIFNt7Dm2xtYKbTolAV9jSeNkRlGMCq9EBzQlwiV0HkHx1CdNR/zzXbyNZLmOybFkXqR150H01kUhdv0v6AMWTDZjMEWO/PaWCOgzZhH9ztXjy+rwa7pdaI4+0Pb9Kib+d8/IrgNsLB/sCazqD+9/COI6AHqzTDS1aU9/gMQrUN1ronzMEQhzzOuoI8WeLqU++j+0dT2UWVPlQqoln+RYu7dUn/DSZDrsYenudT5+P"
2025-10-11 16:26:49.839747 | hotstack | }
2025-10-11 16:26:49.864172 | 
2025-10-11 16:26:49.864356 | TASK [Assert cloud name and cloud secret]
2025-10-11 16:26:49.943124 | hotstack | Output suppressed because no_log was given
2025-10-11 16:26:49.954398 | 
2025-10-11 16:26:49.954524 | TASK [Ensure openstack release repo is installed]
2025-10-11 16:26:54.587397 | hotstack | changed
2025-10-11 16:26:54.598627 | 
2025-10-11 16:26:54.598828 | TASK [Install openstack client packages]
2025-10-11 16:27:10.939096 | hotstack | changed
2025-10-11 16:27:10.951819 | 
2025-10-11 16:27:10.951999 | TASK [Ensure HotStack work dir]
2025-10-11 16:27:11.371082 | hotstack | changed
2025-10-11 16:27:11.382785 | 
2025-10-11 16:27:11.382930 | LOOP [Ensure etc directories]
2025-10-11 16:27:11.694085 | hotstack | changed: "/etc/openstack"
2025-10-11 16:27:11.694481 | hotstack | changed: All items complete
2025-10-11 16:27:11.694542 | 
2025-10-11 16:27:11.974272 | hotstack | changed: "/etc/hotstack"
2025-10-11 16:27:11.989869 | 
2025-10-11 16:27:11.990057 | TASK [Ensure .ssh dir exists]
2025-10-11 16:27:12.233283 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:12.244447 | 
2025-10-11 16:27:12.244602 | TASK [Ensure ssh keypair exists]
2025-10-11 16:27:22.807455 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:22.819104 | 
2025-10-11 16:27:22.819237 | TASK [Generate CA cert file]
2025-10-11 16:27:22.866442 | hotstack | skipping: Conditional result was False
2025-10-11 16:27:22.879478 | 
2025-10-11 16:27:22.879632 | TASK [Update CA certs]
2025-10-11 16:27:23.431293 | hotstack | skipping: Conditional result was False
2025-10-11 16:27:23.444036 | 
2025-10-11 16:27:23.444167 | TASK [Set _auth_type fact]
2025-10-11 16:27:23.501368 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:23.511594 | 
2025-10-11 16:27:23.511717 | TASK [Write clouds.yaml - user/password]
2025-10-11 16:27:24.807579 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:24.818215 | 
2025-10-11 16:27:24.818340 | TASK [Create application credential for sushy-emulator]
2025-10-11 16:27:27.369033 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:27.380034 | 
2025-10-11 16:27:27.380206 | TASK [Read application credential from file]
2025-10-11 16:27:27.806142 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:27.817579 | 
2025-10-11 16:27:27.817711 | TASK [Delete temporary application credential file]
2025-10-11 16:27:28.102436 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:28.113650 | 
2025-10-11 16:27:28.113828 | TASK [Assert application credential id and secret]
2025-10-11 16:27:28.213906 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:28.224657 | 
2025-10-11 16:27:28.224854 | TASK [Write new clouds.yaml with application credentials]
2025-10-11 16:27:29.263687 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:29.273833 | 
2025-10-11 16:27:29.273960 | TASK [Write hotstack cloud-secret.yaml]
2025-10-11 16:27:30.150319 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:30.160612 | 
2025-10-11 16:27:30.160767 | TASK [Write clouds.yaml with application credentials]
2025-10-11 16:27:30.202805 | 
2025-10-11 16:27:30.203134 | TASK [Write hotstack cloud-secret.yaml]
2025-10-11 16:27:30.311182 | 
2025-10-11 16:27:30.311341 | PLAY RECAP
2025-10-11 16:27:30.311387 | hotstack | ok: 18 changed: 11 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 0
2025-10-11 16:27:30.311407 | 
2025-10-11 16:27:30.430457 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/hotstack/pre_stage1.yaml@master]
2025-10-11 16:27:30.436792 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/hotstack/pre_stage2.yaml@master]
2025-10-11 16:27:31.080531 | 
2025-10-11 16:27:31.080695 | PLAY [Create hotstack scenario]
2025-10-11 16:27:31.103150 | 
2025-10-11 16:27:31.103360 | TASK [Assert scenario is defined]
2025-10-11 16:27:31.179243 | hotstack | ok: All assertions passed
2025-10-11 16:27:31.187647 | 
2025-10-11 16:27:31.187805 | TASK [Fetch bootstrap vars from remote to zuul executor]
2025-10-11 16:27:31.684146 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:31.695929 | 
2025-10-11 16:27:31.696085 | TASK [Load bootstrap vars with template resolution]
2025-10-11 16:27:31.745610 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:31.757103 | 
2025-10-11 16:27:31.757255 | TASK [Fetch automation vars from remote to zuul executor]
2025-10-11 16:27:32.195095 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:32.205390 | 
2025-10-11 16:27:32.205520 | TASK [Load automation vars with template resolution]
2025-10-11 16:27:32.275316 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:32.285705 | 
2025-10-11 16:27:32.285889 | TASK [Slurp zuul-build-sshkey from file]
2025-10-11 16:27:32.723288 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:32.735492 | 
2025-10-11 16:27:32.735628 | TASK [Set up infrastructure (Heat stack)]
2025-10-11 16:27:32.765699 | hotstack | Output suppressed because no_log was given
2025-10-11 16:27:32.815037 | 
2025-10-11 16:27:32.815165 | TASK [dataplane_ssh_keys : Ensure Dataplane ssh keypair exists]
2025-10-11 16:27:33.537589 | hotstack | changed
2025-10-11 16:27:33.549202 | 
2025-10-11 16:27:33.549334 | TASK [dataplane_ssh_keys : Ensure Nova migration ssh keypair exists]
2025-10-11 16:27:33.987382 | hotstack | changed
2025-10-11 16:27:34.000452 | 
2025-10-11 16:27:34.000605 | TASK [dataplane_ssh_keys : Set SSH public key facts]
2025-10-11 16:27:34.050171 | hotstack | ok
2025-10-11 16:27:34.062400 | 
2025-10-11 16:27:34.062672 | TASK [dataplane_ssh_keys : Store SSH public key facts in file]
2025-10-11 16:27:35.188206 | hotstack | changed
2025-10-11 16:27:35.210891 | 
2025-10-11 16:27:35.211110 | TASK [heat_stack : Assert config is defined]
2025-10-11 16:27:35.330013 | hotstack | ok: All assertions passed
2025-10-11 16:27:35.339139 | 
2025-10-11 16:27:35.339341 | TASK [heat_stack : Get latest snapset and update stack parameters]
2025-10-11 16:27:35.398017 | hotstack | skipping: Conditional result was False
2025-10-11 16:27:35.411914 | 
2025-10-11 16:27:35.412073 | TASK [heat_stack : Debug latest snapset information]
2025-10-11 16:27:35.460962 | hotstack | skipping: Conditional result was False
2025-10-11 16:27:35.475255 | 
2025-10-11 16:27:35.475406 | TASK [heat_stack : Create stack]
2025-10-11 16:29:05.326434 | hotstack | changed
2025-10-11 16:29:05.344567 | 
2025-10-11 16:29:05.344698 | TASK [heat_stack : Wait for stack to complete]
2025-10-11 16:29:06.953830 | hotstack | ok
2025-10-11 16:29:06.965622 | 
2025-10-11 16:29:06.965803 | TASK [heat_stack : Debug - stack_info]
2025-10-11 16:29:06.993239 | hotstack | skipping: Conditional result was False
2025-10-11 16:29:07.005662 | 
2025-10-11 16:29:07.005826 | TASK [heat_stack : Stop if stack not complete]
2025-10-11 16:29:07.033158 | hotstack | skipping: Conditional result was False
2025-10-11 16:29:07.045300 | 
2025-10-11 16:29:07.045440 | TASK [heat_stack : Get stack outputs]
2025-10-11 16:29:09.034288 | hotstack | changed
2025-10-11 16:29:09.051298 | 
2025-10-11 16:29:09.051425 | TASK [heat_stack : Set stack outputs facts]
2025-10-11 16:29:09.101033 | hotstack | ok
2025-10-11 16:29:09.116975 | 
2025-10-11 16:29:09.117106 | TASK [heat_stack : Store stack outputs in file]
2025-10-11 16:29:10.044548 | hotstack | changed
2025-10-11 16:29:10.065779 | 
2025-10-11 16:29:10.065904 | TASK [Fetch stack outputs from remote to zuul executor]
2025-10-11 16:29:10.449243 | hotstack | Output suppressed because no_log was given
2025-10-11 16:29:10.459219 | 
2025-10-11 16:29:10.459339 | TASK [Load stack output vars with template resolution]
2025-10-11 16:29:10.510925 | hotstack | Output suppressed because no_log was given
2025-10-11 16:29:10.521071 | 
2025-10-11 16:29:10.521199 | TASK [Fetch cloud secrets from remote to zuul executor]
2025-10-11 16:29:10.914686 | hotstack | Output suppressed because no_log was given
2025-10-11 16:29:10.924954 | 
2025-10-11 16:29:10.925075 | TASK [Load hotstack cloud secret vars with template resolution]
2025-10-11 16:29:10.972691 | hotstack | Output suppressed because no_log was given
2025-10-11 16:29:10.984093 | 
2025-10-11 16:29:10.984218 | TASK [Add Hotstack controller-0 to ansible inventory]
2025-10-11 16:29:11.033765 | hotstack | Output suppressed because no_log was given
2025-10-11 16:29:11.044887 | 
2025-10-11 16:29:11.045008 | TASK [Wait for Hotstack controller-0 to be ready]
2025-10-11 16:29:17.258880 | hotstack -> 38.102.83.47 | Output suppressed because no_log was given
2025-10-11 16:29:17.270413 | 
2025-10-11 16:29:17.270539 | TASK [Start Zuul console on Hotstack controller-0]
2025-10-11 16:29:17.296849 | hotstack | Output suppressed because no_log was given
2025-10-11 16:29:17.360326 | 
2025-10-11 16:29:17.360428 | TASK [start-zuul-console : Start zuul_console daemon.]
2025-10-11 16:29:17.862867 | hotstack -> 38.102.83.47 | ok
2025-10-11 16:29:17.884280 | 
2025-10-11 16:29:17.884417 | TASK [Prepare the controller node]
2025-10-11 16:29:17.910041 | hotstack | Output suppressed because no_log was given
2025-10-11 16:29:17.967686 | 
2025-10-11 16:29:17.967778 | TASK [controller : Assert config is defined]
2025-10-11 16:29:18.052500 | hotstack | ok: All assertions passed
2025-10-11 16:29:18.064859 | 
2025-10-11 16:29:18.064988 | TASK [controller : Add controller-0 to the Ansible inventory]
2025-10-11 16:29:18.111087 | hotstack | ok
2025-10-11 16:29:18.121942 | 
2025-10-11 16:29:18.122089 | TASK [controller : Read Dataplane SSH private key content]
2025-10-11 16:29:18.404293 | hotstack | ok
2025-10-11 16:29:18.415176 | 
2025-10-11 16:29:18.415311 | TASK [controller : Read Nova migration SSH private key content]
2025-10-11 16:29:18.695991 | hotstack | ok
2025-10-11 16:29:18.707151 | 
2025-10-11 16:29:18.707285 | TASK [controller : Wait for controller-0 to be ready]
2025-10-11 16:29:19.430175 | hotstack -> 38.102.83.47 | ok
2025-10-11 16:29:19.442191 | 
2025-10-11 16:29:19.442343 | LOOP [controller : Ensure directories exists]
2025-10-11 16:29:20.104125 | hotstack -> 38.102.83.47 | changed: "/home/zuul/data"
2025-10-11 16:29:20.425626 | hotstack -> 38.102.83.47 | changed: "/home/zuul/bin"
2025-10-11 16:29:20.440774 | 
2025-10-11 16:29:20.440913 | LOOP [controller : Add common functions to the bin_dir]
2025-10-11 16:29:21.241252 | hotstack -> 38.102.83.47 | changed: "bin/hotstack-common-funcs.sh"
2025-10-11 16:29:21.241678 | hotstack -> 38.102.83.47 | changed: All items complete
2025-10-11 16:29:21.241776 | 
2025-10-11 16:29:21.255574 | 
2025-10-11 16:29:21.255815 | LOOP [controller : Add bin utilities to the bin_dir]
2025-10-11 16:29:22.054344 | hotstack -> 38.102.83.47 | changed: "bin/hotstack-approve-install-plan"
2025-10-11 16:29:22.738794 | hotstack -> 38.102.83.47 | changed: "bin/hotstack-leader-election-tune"
2025-10-11 16:29:23.429166 | hotstack -> 38.102.83.47 | changed: "bin/hotstack-nova-discover-hosts"
2025-10-11 16:29:24.112786 | hotstack -> 38.102.83.47 | changed: "bin/hotstack-snapset"
2025-10-11 16:29:24.738857 | hotstack -> 38.102.83.47 | changed: "bin/hotstack-openstack-version-patch"
2025-10-11 16:29:25.408532 | hotstack -> 38.102.83.47 | changed: "bin/hotstack-wait-for-bmh"
2025-10-11 16:29:25.431328 | 
2025-10-11 16:29:25.431524 | TASK [controller : Write ansible inventory to file on controller-0]
2025-10-11 16:29:25.489170 | hotstack | skipping: Conditional result was False
2025-10-11 16:29:25.502208 | 
2025-10-11 16:29:25.502390 | TASK [controller : Copy Dataplane ssh private key to controller]
2025-10-11 16:29:26.282074 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:29:26.296227 | 
2025-10-11 16:29:26.296365 | TASK [controller : Copy Dataplane ssh public key to controller]
2025-10-11 16:29:27.080978 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:29:27.095198 | 
2025-10-11 16:29:27.095365 | TASK [controller : Copy Nova migrate ssh private key to controller]
2025-10-11 16:29:27.818874 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:29:27.832974 | 
2025-10-11 16:29:27.833123 | TASK [controller : Copy Nova migrate ssh public key to controller]
2025-10-11 16:29:28.592271 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:29:28.599146 | 
2025-10-11 16:29:28.599208 | TASK [controller : Copy dataplane authorized keys to controller]
2025-10-11 16:29:29.352403 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:29:29.358897 | 
2025-10-11 16:29:29.358960 | TASK [controller : Ensure cloud config directory exists]
2025-10-11 16:29:29.719411 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:29:29.733582 | 
2025-10-11 16:29:29.733718 | TASK [controller : Template the clouds.yaml]
2025-10-11 16:29:30.678053 | hotstack -> 38.102.83.47 | Output suppressed because no_log was given
2025-10-11 16:29:30.691974 | 
2025-10-11 16:29:30.692129 | TASK [controller : Write Ironic nodes YAML]
2025-10-11 16:29:30.739879 | hotstack | skipping: Conditional result was False
2025-10-11 16:29:30.762263 | 
2025-10-11 16:29:30.762416 | TASK [Install Openshift]
2025-10-11 16:29:30.789631 | hotstack | Output suppressed because no_log was given
2025-10-11 16:29:30.847928 | 
2025-10-11 16:29:30.848045 | TASK [ocp_agent_installer : Assert config is defined]
2025-10-11 16:29:30.933411 | hotstack -> 38.102.83.47 | ok: All assertions passed
2025-10-11 16:29:30.939133 | 
2025-10-11 16:29:30.939194 | TASK [ocp_agent_installer : Install using agent installer]
2025-10-11 16:29:30.988544 | hotstack | ok
2025-10-11 16:29:31.000888 | hotstack | included: /var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/_install.yml
2025-10-11 16:29:31.007103 | 
2025-10-11 16:29:31.007168 | TASK [ocp_agent_installer : Assert config is defined]
2025-10-11 16:29:31.071700 | hotstack -> 38.102.83.47 | ok: All assertions passed
2025-10-11 16:29:31.078629 | 
2025-10-11 16:29:31.078689 | LOOP [ocp_agent_installer : Ensure directory exists]
2025-10-11 16:29:31.485606 | hotstack -> 38.102.83.47 | ok: "/home/zuul/bin"
2025-10-11 16:29:31.486143 | hotstack -> 38.102.83.47 | changed: All items complete
2025-10-11 16:29:31.486203 | 
2025-10-11 16:29:31.786906 | hotstack -> 38.102.83.47 | changed: "/home/zuul/.kube"
2025-10-11 16:29:32.089055 | hotstack -> 38.102.83.47 | changed: "/home/zuul/ocp-cluster"
2025-10-11 16:29:32.379447 | hotstack -> 38.102.83.47 | changed: "/home/zuul/ocp-cluster/openshift"
2025-10-11 16:29:32.668150 | hotstack -> 38.102.83.47 | changed: "/home/zuul/agent-installer"
2025-10-11 16:29:32.970393 | hotstack -> 38.102.83.47 | changed: "/home/zuul/cluster-custom-config/"
2025-10-11 16:29:33.309754 | hotstack -> 38.102.83.47 | changed: "/home/zuul/cluster-custom-config//butane"
2025-10-11 16:29:33.631536 | hotstack -> 38.102.83.47 | changed: "/home/zuul/cluster-custom-config//machine-configs"
2025-10-11 16:29:33.943227 | hotstack -> 38.102.83.47 | changed: "/home/zuul/cluster-custom-config//config-assets"
2025-10-11 16:29:34.004337 | 
2025-10-11 16:29:34.004468 | TASK [ocp_agent_installer : Install package requirements for agent installer]
2025-10-11 16:29:51.959832 | hotstack -> 38.102.83.47 | ok: Nothing to do
2025-10-11 16:29:51.973419 | 
2025-10-11 16:29:51.973562 | TASK [ocp_agent_installer : Run tasks/install_client.yml]
2025-10-11 16:29:52.011459 | hotstack | ok
2025-10-11 16:29:52.026946 | hotstack | included: /var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/install_client.yml
2025-10-11 16:29:52.047598 | 
2025-10-11 16:29:52.047683 | TASK [ocp_agent_installer : Download the client]
2025-10-11 16:29:53.994791 | hotstack -> 38.102.83.47 | changed: OK (73347743 bytes)
2025-10-11 16:29:54.009045 | 
2025-10-11 16:29:54.009178 | TASK [ocp_agent_installer : Extract client to /home/zuul/bin]
2025-10-11 16:29:58.627436 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:29:58.636326 | 
2025-10-11 16:29:58.636422 | TASK [ocp_agent_installer : Configure bash completion]
2025-10-11 16:29:59.665545 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:29:59.681754 | 
2025-10-11 16:29:59.681942 | TASK [ocp_agent_installer : Run tasks/install_installer.yml]
2025-10-11 16:29:59.719888 | hotstack | ok
2025-10-11 16:29:59.736850 | hotstack | included: /var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/install_installer.yml
2025-10-11 16:29:59.759281 | 
2025-10-11 16:29:59.759420 | TASK [ocp_agent_installer : Download the installer]
2025-10-11 16:30:07.291269 | hotstack -> 38.102.83.47 | changed: OK (437684516 bytes)
2025-10-11 16:30:07.305155 | 
2025-10-11 16:30:07.305293 | TASK [ocp_agent_installer : Extract installer to /home/zuul/bin]
2025-10-11 16:30:22.531887 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:30:22.545044 | 
2025-10-11 16:30:22.545223 | TASK [ocp_agent_installer : Write OCP install-config.yaml]
2025-10-11 16:30:23.400964 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:30:23.415915 | 
2025-10-11 16:30:23.416119 | TASK [ocp_agent_installer : Replace pull secret in install-config.yaml]
2025-10-11 16:30:23.965082 | hotstack -> 38.102.83.47 | Output suppressed because no_log was given
2025-10-11 16:30:23.977683 | 
2025-10-11 16:30:23.977914 | TASK [ocp_agent_installer : Write OCP agent-config.yaml]
2025-10-11 16:30:24.832526 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:30:24.846862 | 
2025-10-11 16:30:24.847044 | TASK [ocp_agent_installer : Include tasks to generate machine configs]
2025-10-11 16:30:24.884559 | hotstack | ok
2025-10-11 16:30:24.906763 | hotstack | included: /var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/machine_configs.yml
2025-10-11 16:30:24.929678 | 
2025-10-11 16:30:24.929857 | LOOP [ocp_agent_installer : Template butane config for net.ifnames]
2025-10-11 16:30:25.783169 | hotstack -> 38.102.83.47 | changed: "master"
2025-10-11 16:30:25.805027 | 
2025-10-11 16:30:25.805170 | LOOP [ocp_agent_installer : Generate MachineConfig for iscsi]
2025-10-11 16:30:26.292149 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:30:26.292645 | hotstack -> 38.102.83.47 | changed: All items complete
2025-10-11 16:30:26.292760 | 
2025-10-11 16:30:26.308510 | 
2025-10-11 16:30:26.308649 | LOOP [ocp_agent_installer : Template butane config for iscsi]
2025-10-11 16:30:27.164434 | hotstack -> 38.102.83.47 | changed: "master"
2025-10-11 16:30:27.182511 | 
2025-10-11 16:30:27.182662 | LOOP [ocp_agent_installer : Generate MachineConfig for iscsi]
2025-10-11 16:30:27.620399 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:30:27.620884 | hotstack -> 38.102.83.47 | changed: All items complete
2025-10-11 16:30:27.620946 | 
2025-10-11 16:30:27.640016 | 
2025-10-11 16:30:27.640155 | LOOP [ocp_agent_installer : Template butane config for multipath]
2025-10-11 16:30:28.593252 | hotstack -> 38.102.83.47 | changed: "master"
2025-10-11 16:30:28.651712 | 
2025-10-11 16:30:28.651888 | LOOP [ocp_agent_installer : Generate MachineConfig for multipath]
2025-10-11 16:30:29.063534 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:30:29.064215 | hotstack -> 38.102.83.47 | changed: All items complete
2025-10-11 16:30:29.064286 | 
2025-10-11 16:30:29.087335 | 
2025-10-11 16:30:29.087512 | LOOP [ocp_agent_installer : Template butane config for LVM cinder-volumes]
2025-10-11 16:30:29.994162 | hotstack -> 38.102.83.47 | changed: "master"
2025-10-11 16:30:30.013985 | 
2025-10-11 16:30:30.014173 | LOOP [ocp_agent_installer : Generate MachineConfig for multipath]
2025-10-11 16:30:30.454612 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:30:30.455065 | hotstack -> 38.102.83.47 | changed: All items complete
2025-10-11 16:30:30.455126 | 
2025-10-11 16:30:30.473579 | 
2025-10-11 16:30:30.473826 | TASK [ocp_agent_installer : Include tasks to generate config assets]
2025-10-11 16:30:30.513476 | hotstack | ok
2025-10-11 16:30:30.531534 | hotstack | included: /var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/config_assets.yml
2025-10-11 16:30:30.560199 | 
2025-10-11 16:30:30.560336 | TASK [ocp_agent_installer : Template ovn-k8s customization]
2025-10-11 16:30:31.400553 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:30:31.413597 | 
2025-10-11 16:30:31.413798 | TASK [ocp_agent_installer : Copy Etcd customization]
2025-10-11 16:30:32.183623 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:30:32.196454 | 
2025-10-11 16:30:32.196590 | TASK [ocp_agent_installer : Template ImageContentSourcePolicy customization]
2025-10-11 16:30:32.264593 | hotstack | skipping: Conditional result was False
2025-10-11 16:30:32.276920 | 
2025-10-11 16:30:32.277060 | TASK [ocp_agent_installer : Initialize _ocp_additional_trusted_ca_map fact]
2025-10-11 16:30:32.346248 | hotstack | skipping: Conditional result was False
2025-10-11 16:30:32.354047 | 
2025-10-11 16:30:32.354131 | LOOP [ocp_agent_installer : Append to _ocp_additional_trusted_ca_map fact]
2025-10-11 16:30:32.409878 | hotstack | skipping: Conditional result was False
2025-10-11 16:30:32.425212 | 
2025-10-11 16:30:32.425420 | TASK [ocp_agent_installer : Template additional CA config map]
2025-10-11 16:30:32.473961 | hotstack | skipping: Conditional result was False
2025-10-11 16:30:32.487036 | 
2025-10-11 16:30:32.487233 | TASK [ocp_agent_installer : Copy additional CA config image]
2025-10-11 16:30:32.536099 | hotstack | skipping: Conditional result was False
2025-10-11 16:30:32.551663 | 
2025-10-11 16:30:32.551829 | TASK [ocp_agent_installer : Copy machine_configs to manifests dir]
2025-10-11 16:30:33.028863 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:30:33.042081 | 
2025-10-11 16:30:33.042218 | TASK [ocp_agent_installer : Copy config assets to manifests dir]
2025-10-11 16:30:33.561219 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:30:33.574517 | 
2025-10-11 16:30:33.574656 | TASK [ocp_agent_installer : Run tasks/pxe_assets.yml]
2025-10-11 16:30:33.622193 | hotstack | ok
2025-10-11 16:30:33.640397 | hotstack | included: /var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/trusted/project_3/github.com/openstack-k8s-operators/hotstack/roles/ocp_agent_installer/tasks/pxe_assets.yml
2025-10-11 16:30:33.675485 | 
2025-10-11 16:30:33.675575 | TASK [ocp_agent_installer : Create the boot-artifacts directory]
2025-10-11 16:30:34.068572 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:30:34.082216 | 
2025-10-11 16:30:34.082356 | TASK [ocp_agent_installer : Create PXE assets]
2025-10-11 16:30:36.162762 | controller-0 | level=warning msg=Compute[0].Hyperthreading: Disabled is ignored
2025-10-11 16:30:36.839880 | controller-0 | level=warning msg=ControlPlane.Hyperthreading: Disabled is ignored
2025-10-11 16:30:36.839922 | controller-0 | level=info msg=Configuration has 3 master replicas and 0 worker replicas
2025-10-11 16:30:36.839937 | controller-0 | level=info msg=The rendezvous host IP (node0 IP) is 192.168.34.10
2025-10-11 16:30:37.535665 | controller-0 | level=info msg=Extracting base ISO from release payload
2025-10-11 16:31:02.501865 | controller-0 | level=info msg=Base ISO obtained from release and cached at [/home/zuul/.cache/agent/image_cache/coreos-x86_64.iso]
2025-10-11 16:32:04.967467 | controller-0 | level=info msg=Consuming Extra Manifests from target directory
2025-10-11 16:32:04.967891 | controller-0 | level=info msg=Consuming Agent Config from target directory
2025-10-11 16:32:05.591424 | controller-0 | level=info msg=Consuming Install Config from target directory
2025-10-11 16:32:05.591509 | controller-0 | level=info msg=Created iPXE script agent.x86_64.ipxe in boot-artifacts directory
2025-10-11 16:32:05.591562 | controller-0 | level=info msg=PXE boot artifacts created in: boot-artifacts
2025-10-11 16:32:05.591602 | controller-0 | level=info msg=Kernel parameters for PXE boot: rw ignition.firstboot ignition.platform.id=metal
2025-10-11 16:32:06.210910 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:32:06.223802 | 
2025-10-11 16:32:06.223931 | TASK [ocp_agent_installer : Set serial console in ipxe]
2025-10-11 16:32:06.886710 | hotstack -> 38.102.83.47 | changed: line replaced
2025-10-11 16:32:06.900919 | 
2025-10-11 16:32:06.901075 | TASK [ocp_agent_installer : Disable net.ifnames]
2025-10-11 16:32:07.489253 | hotstack -> 38.102.83.47 | changed: line replaced
2025-10-11 16:32:07.501842 | 
2025-10-11 16:32:07.502013 | LOOP [ocp_agent_installer : Copy boot-artifacts to the web server - (ocp_agent_installer_boot_artifacts_dir)]
2025-10-11 16:32:08.523017 | hotstack -> 38.102.83.47 | changed: "agent.x86_64-vmlinuz"
2025-10-11 16:32:08.523452 | 
2025-10-11 16:32:10.010377 | hotstack -> 38.102.83.47 | changed: "agent.x86_64-initrd.img"
2025-10-11 16:32:38.006986 | hotstack -> 38.102.83.47 | changed: "agent.x86_64-rootfs.img"
2025-10-11 16:32:38.500036 | hotstack -> 38.102.83.47 | changed: "agent.x86_64.ipxe"
2025-10-11 16:32:38.524847 | 
2025-10-11 16:32:38.525087 | TASK [ocp_agent_installer : Run tasks/iso_assets.yml]
2025-10-11 16:32:38.564627 | hotstack | skipping: Conditional result was False
2025-10-11 16:32:38.578044 | 
2025-10-11 16:32:38.578181 | TASK [ocp_agent_installer : Copy auth/kubeconfig to ~/.kube/config]
2025-10-11 16:32:39.142293 | hotstack -> 38.102.83.47 | changed
2025-10-11 16:32:39.156399 | 
2025-10-11 16:32:39.156539 | TASK [ocp_agent_installer : Wait for bootstrap-complete]
2025-10-11 16:33:19.751245 | controller-0 | level=info msg=Waiting for cluster install to initialize. Sleeping for 30 seconds
2025-10-11 16:34:01.775180 | controller-0 | level=info msg=Waiting for cluster install to initialize. Sleeping for 30 seconds
2025-10-11 16:34:43.798303 | controller-0 | level=info msg=Cannot access Rendezvous Host. There may be a network configuration problem, check console for additional info
2025-10-11 16:35:25.823805 | controller-0 | level=info msg=Cannot access Rendezvous Host. There may be a network configuration problem, check console for additional info
2025-10-11 16:36:07.878511 | controller-0 | level=info msg=Cluster is not ready for install. Check validations
2025-10-11 16:36:07.879047 | controller-0 | level=warning msg=Cluster validation: The cluster has hosts that are not ready to install.
2025-10-11 16:36:07.880240 | controller-0 | level=warning msg=Host master-2 validation: No connectivity to the majority of hosts in the cluster
2025-10-11 16:36:07.880422 | controller-0 | level=warning msg=Host master-2 validation: Host couldn't synchronize with any NTP server
2025-10-11 16:36:07.880718 | controller-0 | level=warning msg=Host master-2 validation: Error while evaluating DNS resolution on this host
2025-10-11 16:36:07.880814 | controller-0 | level=warning msg=Host master-2 validation: Error while evaluating DNS resolution on this host
2025-10-11 16:36:07.880905 | controller-0 | level=warning msg=Host master-2 validation: Error while evaluating DNS resolution on this host
2025-10-11 16:36:07.882403 | controller-0 | level=warning msg=Host master-0 validation: No connectivity to the majority of hosts in the cluster
2025-10-11 16:36:07.882590 | controller-0 | level=warning msg=Host master-0 validation: Host couldn't synchronize with any NTP server
2025-10-11 16:36:07.882807 | controller-0 | level=warning msg=Host master-0 validation: Error while evaluating DNS resolution on this host
2025-10-11 16:36:07.882898 | controller-0 | level=warning msg=Host master-0 validation: Error while evaluating DNS resolution on this host
2025-10-11 16:36:07.882982 | controller-0 | level=warning msg=Host master-0 validation: Error while evaluating DNS resolution on this host
2025-10-11 16:36:07.884044 | controller-0 | level=warning msg=Host master-1 validation: No connectivity to the majority of hosts in the cluster
2025-10-11 16:36:07.884192 | controller-0 | level=warning msg=Host master-1 validation: Host couldn't synchronize with any NTP server
2025-10-11 16:36:07.884458 | controller-0 | level=warning msg=Host master-1 validation: Error while evaluating DNS resolution on this host
2025-10-11 16:36:07.884668 | controller-0 | level=warning msg=Host master-1 validation: Error while evaluating DNS resolution on this host
2025-10-11 16:36:07.884751 | controller-0 | level=warning msg=Host master-1 validation: Error while evaluating DNS resolution on this host
2025-10-11 16:36:07.891219 | controller-0 | level=warning msg=Host master-0: updated status from discovering to insufficient (Host cannot be installed due to following failing validation(s): Host couldn't synchronize with any NTP server ; No connectivity to the majority of hosts in the cluster)
2025-10-11 16:37:08.101054 | controller-0 | level=info msg=Host master-0 validation: Host NTP is synced
2025-10-11 16:37:08.101272 | controller-0 | level=info msg=Host master-0 validation: Domain name resolution for the api.ocp.openstack.lab domain was successful or not required
2025-10-11 16:37:08.101359 | controller-0 | level=info msg=Host master-0 validation: Domain name resolution for the api-int.ocp.openstack.lab domain was successful or not required
2025-10-11 16:37:08.101481 | controller-0 | level=info msg=Host master-0 validation: Domain name resolution for the *.apps.ocp.openstack.lab domain was successful or not required
2025-10-11 16:37:08.101910 | controller-0 | level=info msg=Host master-1 validation: Host NTP is synced
2025-10-11 16:37:08.102020 | controller-0 | level=info msg=Host master-1 validation: Domain name resolution for the api.ocp.openstack.lab domain was successful or not required
2025-10-11 16:37:08.102118 | controller-0 | level=info msg=Host master-1 validation: Domain name resolution for the api-int.ocp.openstack.lab domain was successful or not required
2025-10-11 16:37:08.102216 | controller-0 | level=info msg=Host master-1 validation: Domain name resolution for the *.apps.ocp.openstack.lab domain was successful or not required
2025-10-11 16:37:08.102634 | controller-0 | level=info msg=Host master-2 validation: Host NTP is synced
2025-10-11 16:37:08.102777 | controller-0 | level=info msg=Host master-2 validation: Domain name resolution for the api.ocp.openstack.lab domain was successful or not required
2025-10-11 16:37:08.102845 | controller-0 | level=info msg=Host master-2 validation: Domain name resolution for the api-int.ocp.openstack.lab domain was successful or not required
2025-10-11 16:37:08.102910 | controller-0 | level=info msg=Host master-2 validation: Domain name resolution for the *.apps.ocp.openstack.lab domain was successful or not required
2025-10-11 16:37:08.107471 | controller-0 | level=info msg=Host master-2: validation 'ntp-synced' is now fixed
2025-10-11 16:37:20.146243 | controller-0 | level=info msg=Host master-0 validation: Host has connectivity to the majority of hosts in the cluster
2025-10-11 16:37:20.146786 | controller-0 | level=info msg=Host master-2 validation: Host has connectivity to the majority of hosts in the cluster
2025-10-11 16:37:20.147125 | controller-0 | level=info msg=Host master-1 validation: Host has connectivity to the majority of hosts in the cluster
2025-10-11 16:37:20.155002 | controller-0 | level=info msg=Host master-2: updated status from insufficient to known (Host is ready to be installed)
2025-10-11 16:37:32.191494 | controller-0 | level=info msg=Preparing cluster for installation
2025-10-11 16:37:32.191930 | controller-0 | level=info msg=Cluster validation: All hosts in the cluster are ready to install.
2025-10-11 16:37:44.246285 | controller-0 | level=info msg=Host master-1: updated status from known to preparing-for-installation (Host finished successfully to prepare for installation)
2025-10-11 16:38:20.372311 | controller-0 | level=info msg=Host master-2: New image status quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ab80599fe72dc2d07f4417f4cc981f1e7f199a8e7c26f17e7ff6ac00689a51ba. result: success. time: 1.55 seconds; size: 447.07 Megabytes; download rate: 302.79 MBps
2025-10-11 16:45:22.007865 | controller-0 | level=warning msg=Host's disk /dev/disk/by-path/pci-0000:00:06.0 is slower than the supported speed, and may cause degraded cluster performance (fdatasync duration: 229 ms)
2025-10-11 16:46:10.175214 | controller-0 | level=info msg=Host master-1: updated status from preparing-for-installation to preparing-successful (Host finished successfully to prepare for installation)
2025-10-11 16:46:22.214119 | controller-0 | level=info msg=Cluster installation in progress
2025-10-11 16:46:22.221391 | controller-0 | level=info msg=Host master-1: updated status from preparing-successful to installing (Installation is in progress)
2025-10-11 16:47:10.402085 | controller-0 | level=info msg=Host: master-2, reached installation stage Writing image to disk: 27%
2025-10-11 16:47:22.448992 | controller-0 | level=info msg=Host: master-0, reached installation stage Writing image to disk: 54%
2025-10-11 16:47:34.497565 | controller-0 | level=info msg=Host: master-1, reached installation stage Writing image to disk: 100%
2025-10-11 16:47:46.550644 | controller-0 | level=info msg=Host: master-0, reached installation stage Writing image to disk: 100%
2025-10-11 16:48:19.676662 | controller-0 | level=info msg=Bootstrap Kube API Initialized
2025-10-11 17:20:08.645383 | controller-0 | level=warning msg=Host master-0: updated status from installing-in-progress to error (Host failed to install because its installation stage Writing image to disk did not sufficiently progress in the last 30m0s.)
2025-10-11 17:20:12.691416 | controller-0 | level=info msg=Cluster has hosts in error
2025-10-11 17:20:12.691579 | controller-0 | level=info msg=cluster has stopped installing... working to recover installation
2025-10-11 17:32:39.743597 | controller-0 | level=info msg=Use the following commands to gather logs from the cluster
2025-10-11 17:32:39.743726 | controller-0 | level=info msg=openshift-install gather bootstrap --help
2025-10-11 17:32:39.743801 | controller-0 | level=error msg=Bootstrap failed to complete: : bootstrap process timed out: context deadline exceeded
2025-10-11 17:32:40.045201 | hotstack -> 38.102.83.47 | ERROR
2025-10-11 17:32:40.045401 | hotstack -> 38.102.83.47 | {
2025-10-11 17:32:40.045460 | hotstack -> 38.102.83.47 |   "delta": "1:00:00.182700",
2025-10-11 17:32:40.045502 | hotstack -> 38.102.83.47 |   "end": "2025-10-11 17:32:39.752093",
2025-10-11 17:32:40.045538 | hotstack -> 38.102.83.47 |   "msg": "non-zero return code",
2025-10-11 17:32:40.045572 | hotstack -> 38.102.83.47 |   "rc": 5,
2025-10-11 17:32:40.045605 | hotstack -> 38.102.83.47 |   "start": "2025-10-11 16:32:39.569393"
2025-10-11 17:32:40.045639 | hotstack -> 38.102.83.47 | }
failure
2025-10-11 17:32:40.049450 | 
2025-10-11 17:32:40.049554 | PLAY RECAP
2025-10-11 17:32:40.049636 | hotstack | ok: 74 changed: 48 unreachable: 0 failed: 1 skipped: 12 rescued: 0 ignored: 0
2025-10-11 17:32:40.049680 | 
2025-10-11 17:32:40.184149 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/hotstack/pre_stage2.yaml@master]
2025-10-11 17:32:40.188232 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/hotstack/post.yaml@master]
2025-10-11 17:32:40.762944 | 
2025-10-11 17:32:40.763045 | PLAY [Collect hotstack logs and clean up environment]
2025-10-11 17:32:40.783835 | 
2025-10-11 17:32:40.783909 | TASK [Fetch stack outputs from remote to zuul executor]
2025-10-11 17:32:41.410960 | hotstack | Output suppressed because no_log was given
2025-10-11 17:32:41.416039 | 
2025-10-11 17:32:41.416110 | TASK [Load stack output vars with template resolution]
2025-10-11 17:32:41.456032 | hotstack | Output suppressed because no_log was given
2025-10-11 17:32:41.460900 | 
2025-10-11 17:32:41.460962 | TASK [Add Hotstack controller-0 to ansible inventory]
2025-10-11 17:32:41.499686 | hotstack | Output suppressed because no_log was given
2025-10-11 17:32:41.505092 | 
2025-10-11 17:32:41.505157 | TASK [Wait for Hotstack controller-0 to be ready]
2025-10-11 17:32:47.407980 | hotstack -> 38.102.83.47 | Output suppressed because no_log was given
2025-10-11 17:32:47.419402 | 
2025-10-11 17:32:47.419574 | TASK [Collect hotstack logs]
2025-10-11 17:32:47.446277 | hotstack | Output suppressed because no_log was given
2025-10-11 17:32:47.493085 | 
2025-10-11 17:32:47.493229 | TASK [hotlogs : Initialize failure tracking]
2025-10-11 17:32:47.525367 | hotstack | ok
2025-10-11 17:32:47.532636 | 
2025-10-11 17:32:47.532757 | TASK [hotlogs : Ensure logs directory]
2025-10-11 17:32:47.966324 | hotstack | changed
2025-10-11 17:32:47.978058 | 
2025-10-11 17:32:47.978193 | LOOP [hotlogs : Create hotlogs sub dirs]
2025-10-11 17:32:48.297803 | hotstack | changed:
2025-10-11 17:32:48.298277 | hotstack | {
2025-10-11 17:32:48.298358 | hotstack |   "dest_dir": "ocp_cluster",
2025-10-11 17:32:48.298415 | hotstack |   "src": "/home/zuul/ocp-cluster/.openshift_install.log"
2025-10-11 17:32:48.298469 | hotstack | }
2025-10-11 17:32:48.553498 | hotstack | ok:
2025-10-11 17:32:48.554027 | hotstack | {
2025-10-11 17:32:48.554122 | hotstack |   "dest_dir": "ocp_cluster",
2025-10-11 17:32:48.554174 | hotstack |   "src": "/home/zuul/cluster-custom-config/"
2025-10-11 17:32:48.554222 | hotstack | }
2025-10-11 17:32:48.765935 | hotstack | changed:
2025-10-11 17:32:48.766082 | hotstack | {
2025-10-11 17:32:48.766134 | hotstack |   "dest_dir": "data",
2025-10-11 17:32:48.766174 | hotstack |   "src": "/home/zuul/data/"
2025-10-11 17:32:48.766211 | hotstack | }
2025-10-11 17:32:49.020048 | hotstack | changed:
2025-10-11 17:32:49.020212 | hotstack | {
2025-10-11 17:32:49.020268 | hotstack |   "dest_dir": "manifests",
2025-10-11 17:32:49.020310 | hotstack |   "src": "/home/zuul/manifests/"
2025-10-11 17:32:49.020347 | hotstack | }
2025-10-11 17:32:49.272319 | hotstack | ok:
2025-10-11 17:32:49.272513 | hotstack | {
2025-10-11 17:32:49.272566 | hotstack |   "dest_dir": ".",
2025-10-11 17:32:49.272607 | hotstack |   "src": "/home/zuul/must-gather.tar.gz"
2025-10-11 17:32:49.272646 | hotstack | }
2025-10-11 17:32:49.289363 | 
2025-10-11 17:32:49.289575 | TASK [hotlogs : Run must-gather operations]
2025-10-11 17:32:50.206520 | hotstack -> 38.102.83.47 | ERROR
2025-10-11 17:32:50.206995 | hotstack -> 38.102.83.47 | {
2025-10-11 17:32:50.207061 | hotstack -> 38.102.83.47 |   "msg": "Must-gather failed: error: unable to resolve image stream 'openshift/must-gather': the server could not find the requested resource (get imagestreams.image.openshift.io must-gather)\n (Command: oc adm must-gather --image-stream=openshift/must-gather --image=quay.io/openstack-k8s-operators/openstack-must-gather --dest-dir=/home/zuul/must-gather --timeout=10m --host-network=false -- ADDITIONAL_NAMESPACES=sushy-emulator OPENSTACK_DATABASES=ALL SOS_EDPM=all SOS_DECOMPRESS=0 gather)",
2025-10-11 17:32:50.207109 | hotstack -> 38.102.83.47 |   "rc": 1
2025-10-11 17:32:50.207146 | hotstack -> 38.102.83.47 | }
2025-10-11 17:32:50.219993 | 
2025-10-11 17:32:50.220163 | TASK [hotlogs : Display must-gather failure]
2025-10-11 17:32:50.320163 | hotstack | ok:
2025-10-11 17:32:50.320443 | hotstack | Must-gather operations failed: Must-gather failed: error: unable to resolve image stream 'openshift/must-gather': the server could not find the requested resource (get imagestreams.image.openshift.io must-gather)
2025-10-11 17:32:50.320500 | hotstack |  (Command: oc adm must-gather --image-stream=openshift/must-gather --image=quay.io/openstack-k8s-operators/openstack-must-gather --dest-dir=/home/zuul/must-gather --timeout=10m --host-network=false -- ADDITIONAL_NAMESPACES=sushy-emulator OPENSTACK_DATABASES=ALL SOS_EDPM=all SOS_DECOMPRESS=0 gather)
2025-10-11 17:32:50.367772 | 
2025-10-11 17:32:50.367917 | TASK [hotlogs : Track must-gather failure]
2025-10-11 17:32:50.444050 | hotstack | ok
2025-10-11 17:32:50.456718 | 
2025-10-11 17:32:50.456943 | LOOP [hotlogs : Collect hotstack data]
2025-10-11 17:32:51.333529 | hotstack -> 38.102.83.102 | changed: >f+++++++++ .openshift_install.log
2025-10-11 17:32:51.333835 | hotstack -> 38.102.83.102 | changed: All items complete
2025-10-11 17:32:51.333877 | 
2025-10-11 17:32:51.811324 | hotstack -> 38.102.83.102 | changed:
2025-10-11 17:32:51.811432 | hotstack -> 38.102.83.102 | .d..t...... ./
2025-10-11 17:32:51.811457 | hotstack -> 38.102.83.102 | cd+++++++++ butane/
2025-10-11 17:32:51.811476 | hotstack -> 38.102.83.102 | >f+++++++++ butane/90-master-disable-netifnames.bu
2025-10-11 17:32:51.811494 | hotstack -> 38.102.83.102 | >f+++++++++ butane/90-master-enable-iscsi.bu
2025-10-11 17:32:51.811512 | hotstack -> 38.102.83.102 | >f+++++++++ butane/91-master-enable-multipath.bu
2025-10-11 17:32:51.811541 | hotstack -> 38.102.83.102 | >f+++++++++ butane/92-master-lv-cinder-volumes.bu
2025-10-11 17:32:51.811559 | hotstack -> 38.102.83.102 | cd+++++++++ config-assets/
2025-10-11 17:32:51.811590 | hotstack -> 38.102.83.102 | >f+++++++++ config-assets/95-etcd_config.yaml
2025-10-11 17:32:51.811608 | hotstack -> 38.102.83.102 | >f+++++++++ config-assets/ovn_k8s_config.yaml
2025-10-11 17:32:51.811625 | hotstack -> 38.102.83.102 | cd+++++++++ machine-configs/
2025-10-11 17:32:51.811644 | hotstack -> 38.102.83.102 | >f+++++++++ machine-configs/90-master-disable-netifnames.yaml
2025-10-11 17:32:51.811661 | hotstack -> 38.102.83.102 | >f+++++++++ machine-configs/90-master-enable-iscsi.yaml
2025-10-11 17:32:51.811678 | hotstack -> 38.102.83.102 | >f+++++++++ machine-configs/91-master-enable-multipath.yaml
2025-10-11 17:32:51.811694 | hotstack -> 38.102.83.102 | >f+++++++++ machine-configs/92-master-lv-cinder-volumes.yaml
2025-10-11 17:32:52.411340 | hotstack -> 38.102.83.102 | changed: .d..t...... ./
2025-10-11 17:32:53.030712 | hotstack -> 38.102.83.102 | ERROR: Item: {'src': '/home/zuul/manifests/', 'dest_dir': 'manifests'}
2025-10-11 17:32:53.031015 | hotstack -> 38.102.83.102 | {
2025-10-11 17:32:53.031092 | hotstack -> 38.102.83.102 |   "ansible_loop_var": "item",
2025-10-11 17:32:53.031146 | hotstack -> 38.102.83.102 |   "item": {
2025-10-11 17:32:53.031192 | hotstack -> 38.102.83.102 |     "dest_dir": "manifests",
2025-10-11 17:32:53.031237 | hotstack -> 38.102.83.102 |     "src": "/home/zuul/manifests/"
2025-10-11 17:32:53.031282 | hotstack -> 38.102.83.102 |   },
2025-10-11 17:32:53.031327 | hotstack -> 38.102.83.102 |   "msg": "Warning: Permanently added '38.102.83.47' (ED25519) to the list of known hosts.\r\nrsync: [sender] change_dir \"/home/zuul/manifests\" failed: No such file or directory (2)\nrsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1839) [Receiver=3.2.5]\nrsync: [Receiver] write error: Broken pipe (32)\n",
2025-10-11 17:32:53.031377 | hotstack -> 38.102.83.102 |   "rc": 23
2025-10-11 17:32:53.031421 | hotstack -> 38.102.83.102 | }
2025-10-11 17:32:53.657161 | hotstack -> 38.102.83.102 | ERROR: Item: {'src': '/home/zuul/must-gather.tar.gz', 'dest_dir': '.'}
2025-10-11 17:32:53.657380 | hotstack -> 38.102.83.102 | {
2025-10-11 17:32:53.657439 | hotstack -> 38.102.83.102 |   "ansible_loop_var": "item",
2025-10-11 17:32:53.657480 | hotstack -> 38.102.83.102 |   "item": {
2025-10-11 17:32:53.657517 | hotstack -> 38.102.83.102 |     "dest_dir": ".",
2025-10-11 17:32:53.657552 | hotstack -> 38.102.83.102 |     "src": "/home/zuul/must-gather.tar.gz"
2025-10-11 17:32:53.657588 | hotstack -> 38.102.83.102 |   },
2025-10-11 17:32:53.657623 | hotstack -> 38.102.83.102 |   "msg": "Warning: Permanently added '38.102.83.47' (ED25519) to the list of known hosts.\r\nrsync: [sender] link_stat \"/home/zuul/must-gather.tar.gz\" failed: No such file or directory (2)\nrsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1839) [Receiver=3.2.5]\nrsync: [Receiver] write error: Broken pipe (32)\n",
2025-10-11 17:32:53.657667 | hotstack -> 38.102.83.102 |   "rc": 23
2025-10-11 17:32:53.657702 | hotstack -> 38.102.83.102 | }
2025-10-11 17:32:53.677006 | hotstack | ERROR: Ignoring Errors
2025-10-11 17:32:53.691508 | 
2025-10-11 17:32:53.691678 | LOOP [hotlogs : Check hotstack data collection failures]
2025-10-11 17:32:53.764093 | hotstack | skipping: Conditional result was False
2025-10-11 17:32:53.769685 | hotstack | skipping: Conditional result was False
2025-10-11 17:32:53.775843 | hotstack | skipping: Conditional result was False
2025-10-11 17:32:53.792966 | hotstack | ERROR
2025-10-11 17:32:53.793219 | hotstack | {
2025-10-11 17:32:53.793280 | hotstack |   "msg": "Unexpected templating type error occurred on ({{ hotlogs_failures + ['Failed to collect: ' + item.item] }}): can only concatenate str (not \"dict\") to str. can only concatenate str (not \"dict\") to str"
2025-10-11 17:32:53.793324 | hotstack | }
2025-10-11 17:32:53.803874 | 
2025-10-11 17:32:53.804028 | TASK [Print message that log collection failed]
2025-10-11 17:32:53.834066 | hotstack | ok: WARNING: Log collection failed and may be incomplete. Continue with cleanup ...
2025-10-11 17:32:53.844649 | 
2025-10-11 17:32:53.844834 | TASK [Set _auth_type fact]
2025-10-11 17:32:53.891769 | hotstack | Output suppressed because no_log was given
2025-10-11 17:32:53.903121 | 
2025-10-11 17:32:53.903258 | TASK [Write clouds.yaml]
2025-10-11 17:32:54.992140 | hotstack | Output suppressed because no_log was given
2025-10-11 17:32:55.005117 | 
2025-10-11 17:32:55.005264 | TASK [Delete application credentials]
2025-10-11 17:32:57.062394 | hotstack | changed
2025-10-11 17:32:57.073822 | 
2025-10-11 17:32:57.073988 | TASK [Print message that application credential failed to delete]
2025-10-11 17:32:57.100879 | hotstack | skipping: Conditional result was False
2025-10-11 17:32:57.113434 | 
2025-10-11 17:32:57.113576 | TASK [Print message that application credential deleted successfully]
2025-10-11 17:32:57.161822 | hotstack | ok: Application credential deleted successfully.
2025-10-11 17:32:57.172217 | 
2025-10-11 17:32:57.172538 | TASK [Write clouds.yaml with application credentials]
2025-10-11 17:32:57.211078 | 
2025-10-11 17:32:57.211312 | TASK [Delete the heat stack]
2025-10-11 13:33:24.749958 | hotstack | 2025-10-11 17:32:59Z [hs-940225484a7545aa87e051a62bdab4af]: DELETE_IN_PROGRESS  Stack DELETE started
2025-10-11 13:33:24.750045 | hotstack | 2025-10-11 17:33:00Z [hs-940225484a7545aa87e051a62bdab4af.networker0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750053 | hotstack | 2025-10-11 17:33:01Z [hs-940225484a7545aa87e051a62bdab4af.compute0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750059 | hotstack | 2025-10-11 17:33:02Z [hs-940225484a7545aa87e051a62bdab4af.compute1]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750065 | hotstack | 2025-10-11 17:33:03Z [hs-940225484a7545aa87e051a62bdab4af.controller]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750072 | hotstack | 2025-10-11 17:33:04Z [hs-940225484a7545aa87e051a62bdab4af.master1]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750078 | hotstack | 2025-10-11 17:33:05Z [hs-940225484a7545aa87e051a62bdab4af.ctlplane-net-router-interface]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750084 | hotstack | 2025-10-11 17:33:06Z [hs-940225484a7545aa87e051a62bdab4af.ironic-net-router-interface]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750090 | hotstack | 2025-10-11 17:33:07Z [hs-940225484a7545aa87e051a62bdab4af.ctlplane-net-router-interface]: DELETE_COMPLETE  state changed
2025-10-11 13:33:24.750096 | hotstack | 2025-10-11 17:33:07Z [hs-940225484a7545aa87e051a62bdab4af.master2]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750102 | hotstack | 2025-10-11 17:33:08Z [hs-940225484a7545aa87e051a62bdab4af.networker0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:24.750108 | hotstack | 2025-10-11 17:33:08Z [hs-940225484a7545aa87e051a62bdab4af.networker0-trunk0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750114 | hotstack | 2025-10-11 17:33:08Z [hs-940225484a7545aa87e051a62bdab4af.controller-floating-ip]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750120 | hotstack | 2025-10-11 17:33:08Z [hs-940225484a7545aa87e051a62bdab4af.ironic-net-router-interface]: DELETE_COMPLETE  state changed
2025-10-11 13:33:24.750126 | hotstack | 2025-10-11 17:33:09Z [hs-940225484a7545aa87e051a62bdab4af.networker0-trunk0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:24.750132 | hotstack | 2025-10-11 17:33:09Z [hs-940225484a7545aa87e051a62bdab4af.networker0-internal-api-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750138 | hotstack | 2025-10-11 17:33:09Z [hs-940225484a7545aa87e051a62bdab4af.networker0-tenant-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750144 | hotstack | 2025-10-11 17:33:09Z [hs-940225484a7545aa87e051a62bdab4af.networker0-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750151 | hotstack | 2025-10-11 17:33:09Z [hs-940225484a7545aa87e051a62bdab4af.controller-floating-ip]: DELETE_COMPLETE  state changed
2025-10-11 13:33:24.750157 | hotstack | 2025-10-11 17:33:09Z [hs-940225484a7545aa87e051a62bdab4af.networker1]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750163 | hotstack | 2025-10-11 17:33:09Z [hs-940225484a7545aa87e051a62bdab4af.machine-net-router-interface]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750169 | hotstack | 2025-10-11 17:33:09Z [hs-940225484a7545aa87e051a62bdab4af.networker0-internal-api-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:24.750174 | hotstack | 2025-10-11 17:33:09Z [hs-940225484a7545aa87e051a62bdab4af.networker0-ctlplane-trunk-parent-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:24.750181 | hotstack | 2025-10-11 17:33:10Z [hs-940225484a7545aa87e051a62bdab4af.networker2]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750187 | hotstack | 2025-10-11 17:33:10Z [hs-940225484a7545aa87e051a62bdab4af.networker0-tenant-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:24.750193 | hotstack | 2025-10-11 17:33:10Z [hs-940225484a7545aa87e051a62bdab4af.controller]: DELETE_COMPLETE  state changed
2025-10-11 13:33:24.750199 | hotstack | 2025-10-11 17:33:11Z [hs-940225484a7545aa87e051a62bdab4af.controller-init]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750205 | hotstack | 2025-10-11 17:33:11Z [hs-940225484a7545aa87e051a62bdab4af.controller-init]: DELETE_COMPLETE  state changed
2025-10-11 13:33:24.750211 | hotstack | 2025-10-11 17:33:11Z [hs-940225484a7545aa87e051a62bdab4af.controller-write-files]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750223 | hotstack | 2025-10-11 17:33:11Z [hs-940225484a7545aa87e051a62bdab4af.controller-runcmd]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750229 | hotstack | 2025-10-11 17:33:11Z [hs-940225484a7545aa87e051a62bdab4af.controller_users]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750235 | hotstack | 2025-10-11 17:33:11Z [hs-940225484a7545aa87e051a62bdab4af.controller-runcmd]: DELETE_COMPLETE  state changed
2025-10-11 13:33:24.750242 | hotstack | 2025-10-11 17:33:11Z [hs-940225484a7545aa87e051a62bdab4af.controller-write-files]: DELETE_COMPLETE  state changed
2025-10-11 13:33:24.750248 | hotstack | 2025-10-11 17:33:11Z [hs-940225484a7545aa87e051a62bdab4af.controller_users]: DELETE_COMPLETE  state changed
2025-10-11 13:33:24.750254 | hotstack | 2025-10-11 17:33:11Z [hs-940225484a7545aa87e051a62bdab4af.master0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:24.750260 | hotstack | 2025-10-11 17:33:12Z [hs-940225484a7545aa87e051a62bdab4af.machine-net-router-interface]: DELETE_COMPLETE  state changed
2025-10-11 13:33:24.750272 | hotstack | 2025-10-11 17:33:12Z [hs-940225484a7545aa87e051a62bdab4af.router]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285159 | hotstack | 2025-10-11 17:33:13Z [hs-940225484a7545aa87e051a62bdab4af.router]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285277 | hotstack | 2025-10-11 17:33:13Z [hs-940225484a7545aa87e051a62bdab4af.compute1]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285296 | hotstack | 2025-10-11 17:33:14Z [hs-940225484a7545aa87e051a62bdab4af.compute1-trunk0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285320 | hotstack | 2025-10-11 17:33:14Z [hs-940225484a7545aa87e051a62bdab4af.compute1_init]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285334 | hotstack | 2025-10-11 17:33:14Z [hs-940225484a7545aa87e051a62bdab4af.compute1_init]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285350 | hotstack | 2025-10-11 17:33:14Z [hs-940225484a7545aa87e051a62bdab4af.compute1_hostname]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285368 | hotstack | 2025-10-11 17:33:14Z [hs-940225484a7545aa87e051a62bdab4af.compute1_hostname]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285385 | hotstack | 2025-10-11 17:33:15Z [hs-940225484a7545aa87e051a62bdab4af.compute1-trunk0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285403 | hotstack | 2025-10-11 17:33:15Z [hs-940225484a7545aa87e051a62bdab4af.compute1-internal-api-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285418 | hotstack | 2025-10-11 17:33:15Z [hs-940225484a7545aa87e051a62bdab4af.compute1-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285432 | hotstack | 2025-10-11 17:33:15Z [hs-940225484a7545aa87e051a62bdab4af.compute1-storage-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285447 | hotstack | 2025-10-11 17:33:15Z [hs-940225484a7545aa87e051a62bdab4af.compute1-tenant-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285464 | hotstack | 2025-10-11 17:33:17Z [hs-940225484a7545aa87e051a62bdab4af.compute1-internal-api-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285479 | hotstack | 2025-10-11 17:33:17Z [hs-940225484a7545aa87e051a62bdab4af.compute1-storage-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285497 | hotstack | 2025-10-11 17:33:17Z [hs-940225484a7545aa87e051a62bdab4af.compute1-ctlplane-trunk-parent-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285511 | hotstack | 2025-10-11 17:33:19Z [hs-940225484a7545aa87e051a62bdab4af.compute1-tenant-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285547 | hotstack | 2025-10-11 17:33:21Z [hs-940225484a7545aa87e051a62bdab4af.compute0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285600 | hotstack | 2025-10-11 17:33:21Z [hs-940225484a7545aa87e051a62bdab4af.compute0-trunk0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285616 | hotstack | 2025-10-11 17:33:21Z [hs-940225484a7545aa87e051a62bdab4af.compute0_init]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285629 | hotstack | 2025-10-11 17:33:21Z [hs-940225484a7545aa87e051a62bdab4af.compute0_init]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285647 | hotstack | 2025-10-11 17:33:21Z [hs-940225484a7545aa87e051a62bdab4af.compute0_hostname]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285664 | hotstack | 2025-10-11 17:33:21Z [hs-940225484a7545aa87e051a62bdab4af.compute0_hostname]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285701 | hotstack | 2025-10-11 17:33:22Z [hs-940225484a7545aa87e051a62bdab4af.networker1]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285720 | hotstack | 2025-10-11 17:33:22Z [hs-940225484a7545aa87e051a62bdab4af.networker2]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285733 | hotstack | 2025-10-11 17:33:22Z [hs-940225484a7545aa87e051a62bdab4af.networker1-trunk0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285747 | hotstack | 2025-10-11 17:33:22Z [hs-940225484a7545aa87e051a62bdab4af.networker2-trunk0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285817 | hotstack | 2025-10-11 17:33:22Z [hs-940225484a7545aa87e051a62bdab4af.compute0-trunk0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285853 | hotstack | 2025-10-11 17:33:22Z [hs-940225484a7545aa87e051a62bdab4af.networker_init]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285867 | hotstack | 2025-10-11 17:33:22Z [hs-940225484a7545aa87e051a62bdab4af.networker_init]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285881 | hotstack | 2025-10-11 17:33:22Z [hs-940225484a7545aa87e051a62bdab4af.compute0-storage-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285894 | hotstack | 2025-10-11 17:33:23Z [hs-940225484a7545aa87e051a62bdab4af.compute0-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285907 | hotstack | 2025-10-11 17:33:23Z [hs-940225484a7545aa87e051a62bdab4af.compute0-internal-api-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285920 | hotstack | 2025-10-11 17:33:23Z [hs-940225484a7545aa87e051a62bdab4af.compute0-tenant-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285934 | hotstack | 2025-10-11 17:33:23Z [hs-940225484a7545aa87e051a62bdab4af.dataplane_users]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285947 | hotstack | 2025-10-11 17:33:23Z [hs-940225484a7545aa87e051a62bdab4af.dataplane_users]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285960 | hotstack | 2025-10-11 17:33:23Z [hs-940225484a7545aa87e051a62bdab4af.networker1-trunk0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.285973 | hotstack | 2025-10-11 17:33:23Z [hs-940225484a7545aa87e051a62bdab4af.networker1-internal-api-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.285987 | hotstack | 2025-10-11 17:33:23Z [hs-940225484a7545aa87e051a62bdab4af.networker1-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.286000 | hotstack | 2025-10-11 17:33:23Z [hs-940225484a7545aa87e051a62bdab4af.networker1-tenant-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.286014 | hotstack | 2025-10-11 17:33:23Z [hs-940225484a7545aa87e051a62bdab4af.networker2-trunk0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.286028 | hotstack | 2025-10-11 17:33:23Z [hs-940225484a7545aa87e051a62bdab4af.networker2-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.286043 | hotstack | 2025-10-11 17:33:23Z [hs-940225484a7545aa87e051a62bdab4af.networker2-tenant-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.286061 | hotstack | 2025-10-11 17:33:23Z [hs-940225484a7545aa87e051a62bdab4af.networker2-internal-api-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:45.286151 | hotstack | 2025-10-11 17:33:24Z [hs-940225484a7545aa87e051a62bdab4af.compute0-tenant-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.286170 | hotstack | 2025-10-11 17:33:24Z [hs-940225484a7545aa87e051a62bdab4af.compute0-storage-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.286188 | hotstack | 2025-10-11 17:33:24Z [hs-940225484a7545aa87e051a62bdab4af.compute0-ctlplane-trunk-parent-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.286201 | hotstack | 2025-10-11 17:33:24Z [hs-940225484a7545aa87e051a62bdab4af.compute0-internal-api-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.286228 | hotstack | 2025-10-11 17:33:24Z [hs-940225484a7545aa87e051a62bdab4af.networker1-ctlplane-trunk-parent-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.286241 | hotstack | 2025-10-11 17:33:24Z [hs-940225484a7545aa87e051a62bdab4af.networker1-internal-api-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.286254 | hotstack | 2025-10-11 17:33:25Z [hs-940225484a7545aa87e051a62bdab4af.networker2-ctlplane-trunk-parent-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.286278 | hotstack | 2025-10-11 17:33:25Z [hs-940225484a7545aa87e051a62bdab4af.networker2-tenant-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:45.286304 | hotstack | 2025-10-11 17:33:25Z [hs-940225484a7545aa87e051a62bdab4af.networker2-internal-api-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.393358 | hotstack | 2025-10-11 17:33:25Z [hs-940225484a7545aa87e051a62bdab4af.networker1-tenant-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.393456 | hotstack | 2025-10-11 17:33:32Z [hs-940225484a7545aa87e051a62bdab4af.master1]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.393477 | hotstack | 2025-10-11 17:33:32Z [hs-940225484a7545aa87e051a62bdab4af.master1-cinder-vol2]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393496 | hotstack | 2025-10-11 17:33:32Z [hs-940225484a7545aa87e051a62bdab4af.master1-cinder-vol0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393514 | hotstack | 2025-10-11 17:33:32Z [hs-940225484a7545aa87e051a62bdab4af.master1-lvms-vol0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393532 | hotstack | 2025-10-11 17:33:32Z [hs-940225484a7545aa87e051a62bdab4af.master1-cinder-vol1]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393550 | hotstack | 2025-10-11 17:33:32Z [hs-940225484a7545aa87e051a62bdab4af.master1-trunk0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393567 | hotstack | 2025-10-11 17:33:33Z [hs-940225484a7545aa87e051a62bdab4af.master1-machine-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393584 | hotstack | 2025-10-11 17:33:33Z [hs-940225484a7545aa87e051a62bdab4af.master1-ironic-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393601 | hotstack | 2025-10-11 17:33:34Z [hs-940225484a7545aa87e051a62bdab4af.master1-machine-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.393618 | hotstack | 2025-10-11 17:33:34Z [hs-940225484a7545aa87e051a62bdab4af.master1-ironic-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.393636 | hotstack | 2025-10-11 17:33:35Z [hs-940225484a7545aa87e051a62bdab4af.master1-trunk0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.393653 | hotstack | 2025-10-11 17:33:36Z [hs-940225484a7545aa87e051a62bdab4af.master1-octavia-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393670 | hotstack | 2025-10-11 17:33:36Z [hs-940225484a7545aa87e051a62bdab4af.master1-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393687 | hotstack | 2025-10-11 17:33:36Z [hs-940225484a7545aa87e051a62bdab4af.master1-storage-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393704 | hotstack | 2025-10-11 17:33:36Z [hs-940225484a7545aa87e051a62bdab4af.master1-internal-api-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393721 | hotstack | 2025-10-11 17:33:36Z [hs-940225484a7545aa87e051a62bdab4af.master1-tenant-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393739 | hotstack | 2025-10-11 17:33:36Z [hs-940225484a7545aa87e051a62bdab4af.master1-octavia-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.393756 | hotstack | 2025-10-11 17:33:37Z [hs-940225484a7545aa87e051a62bdab4af.master1-ctlplane-trunk-parent-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.393838 | hotstack | 2025-10-11 17:33:37Z [hs-940225484a7545aa87e051a62bdab4af.master1-tenant-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.393857 | hotstack | 2025-10-11 17:33:37Z [hs-940225484a7545aa87e051a62bdab4af.master1-internal-api-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.393873 | hotstack | 2025-10-11 17:33:37Z [hs-940225484a7545aa87e051a62bdab4af.master1-storage-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.393891 | hotstack | 2025-10-11 17:33:40Z [hs-940225484a7545aa87e051a62bdab4af.master2]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.393908 | hotstack | 2025-10-11 17:33:40Z [hs-940225484a7545aa87e051a62bdab4af.master2-machine-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393942 | hotstack | 2025-10-11 17:33:40Z [hs-940225484a7545aa87e051a62bdab4af.master2-lvms-vol0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393962 | hotstack | 2025-10-11 17:33:40Z [hs-940225484a7545aa87e051a62bdab4af.master2-cinder-vol0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.393979 | hotstack | 2025-10-11 17:33:40Z [hs-940225484a7545aa87e051a62bdab4af.master2-ironic-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394012 | hotstack | 2025-10-11 17:33:40Z [hs-940225484a7545aa87e051a62bdab4af.master2-trunk0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394030 | hotstack | 2025-10-11 17:33:40Z [hs-940225484a7545aa87e051a62bdab4af.master2-cinder-vol2]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394065 | hotstack | 2025-10-11 17:33:40Z [hs-940225484a7545aa87e051a62bdab4af.master2-cinder-vol1]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394084 | hotstack | 2025-10-11 17:33:41Z [hs-940225484a7545aa87e051a62bdab4af.master0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394101 | hotstack | 2025-10-11 17:33:41Z [hs-940225484a7545aa87e051a62bdab4af.master0-trunk0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394119 | hotstack | 2025-10-11 17:33:41Z [hs-940225484a7545aa87e051a62bdab4af.master0-lvms-vol0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394136 | hotstack | 2025-10-11 17:33:41Z [hs-940225484a7545aa87e051a62bdab4af.master0-ironic-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394154 | hotstack | 2025-10-11 17:33:41Z [hs-940225484a7545aa87e051a62bdab4af.master0-machine-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394171 | hotstack | 2025-10-11 17:33:41Z [hs-940225484a7545aa87e051a62bdab4af.master2-ironic-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394188 | hotstack | 2025-10-11 17:33:41Z [hs-940225484a7545aa87e051a62bdab4af.master0-cinder-vol0]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394206 | hotstack | 2025-10-11 17:33:41Z [hs-940225484a7545aa87e051a62bdab4af.master2-machine-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394224 | hotstack | 2025-10-11 17:33:41Z [hs-940225484a7545aa87e051a62bdab4af.master0-cinder-vol1]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394243 | hotstack | 2025-10-11 17:33:41Z [hs-940225484a7545aa87e051a62bdab4af.master0-cinder-vol2]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394269 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.master2-trunk0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394288 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.master2-internal-api-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394306 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.master2-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394325 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.master2-octavia-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394343 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.master2-storage-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394365 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.master0-machine-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394384 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.master2-tenant-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394402 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.extra-dhcp-opts-value]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394419 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.extra-dhcp-opts-value]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394437 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.controller-machine-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394454 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.master0-ironic-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394471 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.ironic-subnet]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394489 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.master0-trunk0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394507 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.master0-octavia-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394525 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.master0-tenant-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394543 | hotstack | 2025-10-11 17:33:42Z [hs-940225484a7545aa87e051a62bdab4af.master0-internal-api-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394574 | hotstack | 2025-10-11 17:33:43Z [hs-940225484a7545aa87e051a62bdab4af.master0-ctlplane-trunk-parent-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394594 | hotstack | 2025-10-11 17:33:43Z [hs-940225484a7545aa87e051a62bdab4af.master0-storage-port]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394613 | hotstack | 2025-10-11 17:33:43Z [hs-940225484a7545aa87e051a62bdab4af.master2-tenant-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394631 | hotstack | 2025-10-11 17:33:43Z [hs-940225484a7545aa87e051a62bdab4af.master2-internal-api-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394648 | hotstack | 2025-10-11 17:33:43Z [hs-940225484a7545aa87e051a62bdab4af.ironic-subnet]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394666 | hotstack | 2025-10-11 17:33:43Z [hs-940225484a7545aa87e051a62bdab4af.ironic-net]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394693 | hotstack | 2025-10-11 17:33:43Z [hs-940225484a7545aa87e051a62bdab4af.controller-machine-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394711 | hotstack | 2025-10-11 17:33:43Z [hs-940225484a7545aa87e051a62bdab4af.machine-subnet]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394728 | hotstack | 2025-10-11 17:33:43Z [hs-940225484a7545aa87e051a62bdab4af.master1-lvms-vol0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394805 | hotstack | 2025-10-11 17:33:43Z [hs-940225484a7545aa87e051a62bdab4af.master0-octavia-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394838 | hotstack | 2025-10-11 17:33:43Z [hs-940225484a7545aa87e051a62bdab4af.master2-storage-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394857 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.master2-ctlplane-trunk-parent-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394875 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.master0-storage-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394893 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.master2-octavia-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394911 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.storage-subnet]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394928 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.octavia-subnet]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394945 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.master0-ctlplane-trunk-parent-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394962 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.ctlplane-subnet]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.394980 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.master0-tenant-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.394998 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.master1-cinder-vol0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395016 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.tenant-subnet]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.395033 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.machine-subnet]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395049 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.machine-net]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.395067 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.master1-cinder-vol1]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395084 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.storage-subnet]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395102 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.octavia-subnet]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395120 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.storage-net]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.395138 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.master1-cinder-vol2]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395155 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.ctlplane-subnet]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395183 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.octavia-net]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.395201 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.tenant-subnet]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395219 | hotstack | 2025-10-11 17:33:44Z [hs-940225484a7545aa87e051a62bdab4af.master0-internal-api-port]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395237 | hotstack | 2025-10-11 17:33:45Z [hs-940225484a7545aa87e051a62bdab4af.internal-api-subnet]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.395254 | hotstack | 2025-10-11 17:33:45Z [hs-940225484a7545aa87e051a62bdab4af.ironic-net]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395271 | hotstack | 2025-10-11 17:33:45Z [hs-940225484a7545aa87e051a62bdab4af.ctlplane-net]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.395288 | hotstack | 2025-10-11 17:33:45Z [hs-940225484a7545aa87e051a62bdab4af.tenant-net]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.395313 | hotstack | 2025-10-11 17:33:45Z [hs-940225484a7545aa87e051a62bdab4af.machine-net]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395330 | hotstack | 2025-10-11 17:33:45Z [hs-940225484a7545aa87e051a62bdab4af.internal-api-subnet]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395348 | hotstack | 2025-10-11 17:33:45Z [hs-940225484a7545aa87e051a62bdab4af.octavia-net]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395366 | hotstack | 2025-10-11 17:33:46Z [hs-940225484a7545aa87e051a62bdab4af.internal-api-net]: DELETE_IN_PROGRESS  state changed
2025-10-11 13:33:50.395384 | hotstack | 2025-10-11 17:33:46Z [hs-940225484a7545aa87e051a62bdab4af.master2-cinder-vol0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395402 | hotstack | 2025-10-11 17:33:46Z [hs-940225484a7545aa87e051a62bdab4af.master2-cinder-vol1]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395420 | hotstack | 2025-10-11 17:33:46Z [hs-940225484a7545aa87e051a62bdab4af.storage-net]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395438 | hotstack | 2025-10-11 17:33:46Z [hs-940225484a7545aa87e051a62bdab4af.tenant-net]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395456 | hotstack | 2025-10-11 17:33:46Z [hs-940225484a7545aa87e051a62bdab4af.master2-lvms-vol0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395474 | hotstack | 2025-10-11 17:33:46Z [hs-940225484a7545aa87e051a62bdab4af.ctlplane-net]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.395504 | hotstack | 2025-10-11 17:33:47Z [hs-940225484a7545aa87e051a62bdab4af.master2-cinder-vol2]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.462261 | hotstack | 2025-10-11 17:33:47Z [hs-940225484a7545aa87e051a62bdab4af.internal-api-net]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.462439 | hotstack | 2025-10-11 17:33:48Z [hs-940225484a7545aa87e051a62bdab4af.master0-lvms-vol0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.462459 | hotstack | 2025-10-11 17:33:48Z [hs-940225484a7545aa87e051a62bdab4af.master0-cinder-vol1]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.462474 | hotstack | 2025-10-11 17:33:48Z [hs-940225484a7545aa87e051a62bdab4af.master0-cinder-vol0]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.462489 | hotstack | 2025-10-11 17:33:49Z [hs-940225484a7545aa87e051a62bdab4af.master0-cinder-vol2]: DELETE_COMPLETE  state changed
2025-10-11 13:33:50.462504 | hotstack | 2025-10-11 17:33:49Z [hs-940225484a7545aa87e051a62bdab4af]: DELETE_COMPLETE  Stack DELETE completed successfully
2025-10-11 17:33:50.837504 | hotstack | changed
2025-10-11 17:33:50.846867 | 
2025-10-11 17:33:50.846981 | TASK [Print message that stack failed to delete]
2025-10-11 17:33:50.872011 | hotstack | skipping: Conditional result was False
2025-10-11 17:33:50.879361 | 
2025-10-11 17:33:50.879477 | TASK [Print message that stack deleted successfully]
2025-10-11 17:33:50.920467 | hotstack | ok: Stack deleted successfully.
2025-10-11 17:33:50.926116 | 
2025-10-11 17:33:50.926192 | TASK [Delete clouds.yaml]
2025-10-11 17:33:51.236074 | hotstack | Output suppressed because no_log was given
2025-10-11 17:33:51.276495 | 
2025-10-11 17:33:51.276621 | PLAY RECAP
2025-10-11 17:33:51.276681 | hotstack | ok: 18 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 2 ignored: 1
2025-10-11 17:33:51.276711 | 
2025-10-11 17:33:51.372237 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/hotstack/post.yaml@master]
2025-10-11 17:33:51.377779 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2025-10-11 17:33:51.951237 | 
2025-10-11 17:33:51.951349 | PLAY [all]
2025-10-11 17:33:51.969680 | 
2025-10-11 17:33:51.969783 | TASK [include_role : fetch-output]
2025-10-11 17:33:52.008532 | hotstack | ok
2025-10-11 17:33:52.024870 | 
2025-10-11 17:33:52.024950 | TASK [fetch-output : Set log path for multiple nodes]
2025-10-11 17:33:52.089764 | hotstack | skipping: Conditional result was False
2025-10-11 17:33:52.101626 | 
2025-10-11 17:33:52.101791 | TASK [fetch-output : Set log path for single node]
2025-10-11 17:33:52.149102 | hotstack | ok
2025-10-11 17:33:52.160905 | 
2025-10-11 17:33:52.161060 | LOOP [fetch-output : Ensure local output dirs]
2025-10-11 17:33:52.583892 | hotstack -> localhost | ok: "/var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/work/logs"
2025-10-11 17:33:52.805133 | hotstack -> localhost | changed: "/var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/work/artifacts"
2025-10-11 17:33:53.048745 | hotstack -> localhost | changed: "/var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/work/docs"
2025-10-11 17:33:53.064998 | 
2025-10-11 17:33:53.065077 | LOOP [fetch-output : Collect logs, artifacts and docs]
2025-10-11 17:33:53.736698 | hotstack | changed:
2025-10-11 17:33:53.737060 | hotstack | .d..t...... ./
2025-10-11 17:33:53.737130 | hotstack | cd+++++++++ hotlogs/
2025-10-11 17:33:53.737176 | hotstack | cd+++++++++ hotlogs/data/
2025-10-11 17:33:53.737219 | hotstack | cd+++++++++ hotlogs/manifests/
2025-10-11 17:33:53.737289 | hotstack | cd+++++++++ hotlogs/ocp_cluster/
2025-10-11 17:33:53.737331 | hotstack | >f+++++++++ hotlogs/ocp_cluster/openshift_install.log
2025-10-11 17:33:53.737371 | hotstack | cd+++++++++ hotlogs/ocp_cluster/butane/
2025-10-11 17:33:53.737411 | hotstack | >f+++++++++ hotlogs/ocp_cluster/butane/90-master-disable-netifnames.bu
2025-10-11 17:33:53.737451 | hotstack | >f+++++++++ hotlogs/ocp_cluster/butane/90-master-enable-iscsi.bu
2025-10-11 17:33:53.737489 | hotstack | >f+++++++++ hotlogs/ocp_cluster/butane/91-master-enable-multipath.bu
2025-10-11 17:33:53.737527 | hotstack | >f+++++++++ hotlogs/ocp_cluster/butane/92-master-lv-cinder-volumes.bu
2025-10-11 17:33:53.737565 | hotstack | cd+++++++++ hotlogs/ocp_cluster/config-assets/
2025-10-11 17:33:53.737603 | hotstack | >f+++++++++ hotlogs/ocp_cluster/config-assets/95-etcd_config.yaml
2025-10-11 17:33:53.737641 | hotstack | >f+++++++++ hotlogs/ocp_cluster/config-assets/ovn_k8s_config.yaml
2025-10-11 17:33:53.737679 | hotstack | cd+++++++++ hotlogs/ocp_cluster/machine-configs/
2025-10-11 17:33:53.737722 | hotstack | >f+++++++++ hotlogs/ocp_cluster/machine-configs/90-master-disable-netifnames.yaml
2025-10-11 17:33:53.737801 | hotstack | >f+++++++++ hotlogs/ocp_cluster/machine-configs/90-master-enable-iscsi.yaml
2025-10-11 17:33:53.737842 | hotstack | >f+++++++++ hotlogs/ocp_cluster/machine-configs/91-master-enable-multipath.yaml
2025-10-11 17:33:53.737880 | hotstack | >f+++++++++ hotlogs/ocp_cluster/machine-configs/92-master-lv-cinder-volumes.yaml
2025-10-11 17:33:53.737951 | hotstack | changed: All items complete
2025-10-11 17:33:53.737999 | 
2025-10-11 17:33:54.290868 | hotstack | changed: .d..t...... ./
2025-10-11 17:33:54.844561 | hotstack | changed: .d..t...... ./
2025-10-11 17:33:54.868566 | 
2025-10-11 17:33:54.868706 | TASK [include_role : fetch-output-openshift]
2025-10-11 17:33:54.895031 | hotstack | skipping: Conditional result was False
2025-10-11 17:33:54.907688 | 
2025-10-11 17:33:54.907884 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2025-10-11 17:33:55.381118 | hotstack -> localhost | ok: Item: artifacts Runtime: 0:00:00.012095
2025-10-11 17:33:55.670247 | hotstack -> localhost | ok: Item: docs Runtime: 0:00:00.013245
2025-10-11 17:33:55.710549 | 
2025-10-11 17:33:55.710632 | PLAY [all]
2025-10-11 17:33:55.728840 | 
2025-10-11 17:33:55.728905 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2025-10-11 17:33:56.399487 | hotstack | changed
2025-10-11 17:33:56.446018 | 
2025-10-11 17:33:56.446112 | PLAY RECAP
2025-10-11 17:33:56.446165 | hotstack | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2025-10-11 17:33:56.446197 | 
2025-10-11 17:33:56.548636 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2025-10-11 17:33:56.551311 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master]
2025-10-11 17:33:57.137412 | 
2025-10-11 17:33:57.137523 | PLAY [localhost]
2025-10-11 17:33:57.155501 | 
2025-10-11 17:33:57.155587 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2025-10-11 17:33:57.576084 | localhost | changed
2025-10-11 17:33:57.586329 | 
2025-10-11 17:33:57.586484 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2025-10-11 17:33:57.623631 | localhost | ok
2025-10-11 17:33:57.641651 | 
2025-10-11 17:33:57.641846 | TASK [add-fileserver : Create SSH private key tempfile]
2025-10-11 17:33:58.055445 | localhost | changed
2025-10-11 17:33:58.066802 | 
2025-10-11 17:33:58.066936 | TASK [add-fileserver : Create SSH private key from secret]
2025-10-11 17:33:58.746436 | localhost | changed
2025-10-11 17:33:58.758108 | 
2025-10-11 17:33:58.758240 | TASK [add-fileserver : Add fileserver ssh key]
2025-10-11 17:33:59.221050 | localhost | Identity added: /var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/work/tmp/ansible.3dmlcfmr (/var/lib/zuul/builds/940225484a7545aa87e051a62bdab4af/work/tmp/ansible.3dmlcfmr)
2025-10-11 17:33:59.221374 | localhost | ok: Runtime: 0:00:00.011989
2025-10-11 17:33:59.230880 | 
2025-10-11 17:33:59.231020 | TASK [add-fileserver : Remove SSH private key from disk]
2025-10-11 17:33:59.521093 | localhost | ok: Runtime: 0:00:00.007810
2025-10-11 17:33:59.531229 | 
2025-10-11 17:33:59.531358 | TASK [add-fileserver : Add fileserver to inventory]
2025-10-11 17:33:59.619273 | localhost | changed
2025-10-11 17:33:59.628356 | 
2025-10-11 17:33:59.628485 | TASK [add-fileserver : Add fileserver server to known hosts]
2025-10-11 17:34:00.051005 | localhost | changed
2025-10-11 17:34:00.091001 | 
2025-10-11 17:34:00.091074 | PLAY [localhost]
2025-10-11 17:34:00.107125 | 
2025-10-11 17:34:00.107201 | TASK [Generate bulk log download script]
2025-10-11 17:34:00.151451 | localhost | ok
2025-10-11 17:34:00.164742 | 
2025-10-11 17:34:00.164804 | TASK [local-log-download : Check API endpoint is defined]
2025-10-11 17:34:00.192575 | localhost | ok: All assertions passed
2025-10-11 17:34:00.198651 | 
2025-10-11 17:34:00.198751 | TASK [local-log-download : Create download script]
2025-10-11 17:34:00.651806 | localhost -> localhost | changed
2025-10-11 17:34:00.670539 | 
2025-10-11 17:34:00.670663 | TASK [Register quick-download link]
2025-10-11 17:34:00.705866 | localhost | ok
2025-10-11 17:34:00.737942 | 
2025-10-11 17:34:00.738015 | PLAY [logserver.rdoproject.org]
2025-10-11 17:34:00.751228 | 
2025-10-11 17:34:00.751304 | TASK [Set zuul-log-path fact]
2025-10-11 17:34:00.769822 | logserver.rdoproject.org | ok
2025-10-11 17:34:00.781153 | 
2025-10-11 17:34:00.781237 | TASK [set-zuul-log-path-fact : Set log path for a build]
2025-10-11 17:34:00.821382 | logserver.rdoproject.org | ok
2025-10-11 17:34:00.832706 | 
2025-10-11 17:34:00.832893 | TASK [upload-logs : Create log directories]
2025-10-11 17:34:01.897705 | logserver.rdoproject.org | changed
2025-10-11 17:34:01.904712 | 
2025-10-11 17:34:01.904878 | TASK [upload-logs : Ensure logs are readable before uploading]
2025-10-11 17:34:02.239409 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.008618
2025-10-11 17:34:02.248976 | 
2025-10-11 17:34:02.249118 | TASK [upload-logs : Upload logs to log server]
2025-10-11 17:34:03.028376 | logserver.rdoproject.org | Output suppressed because no_log was given
2025-10-11 17:34:03.035089 | 
2025-10-11 17:34:03.035310 | LOOP [upload-logs : Compress console log and json output]
2025-10-11 17:34:03.103226 | logserver.rdoproject.org | skipping: Conditional result was False
2025-10-11 17:34:03.114575 | logserver.rdoproject.org | skipping: Conditional result was False
2025-10-11 17:34:03.132387 | 
2025-10-11 17:34:03.132578 | LOOP [upload-logs : Upload compressed console log and json output]
2025-10-11 17:34:03.182523 | logserver.rdoproject.org | skipping: Conditional result was False
2025-10-11 17:34:03.182990 | 
2025-10-11 17:34:03.187032 | logserver.rdoproject.org | skipping: Conditional result was False
2025-10-11 17:34:03.197828 | 
2025-10-11 17:34:03.198021 | LOOP [upload-logs : Upload console log and json output]