2026-02-26 19:12:39.747147 | Job console starting...
2026-02-26 19:12:39.969013 | Updating repositories
2026-02-26 19:12:40.691165 | Preparing job workspace
2026-02-26 19:12:49.408866 | Running Ansible setup...
2026-02-26 19:12:53.520118 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-02-26 19:12:54.371666 | 
2026-02-26 19:12:54.371846 | PLAY [localhost]
2026-02-26 19:12:54.396026 | 
2026-02-26 19:12:54.396110 | TASK [Gathering Facts]
2026-02-26 19:12:55.419205 | localhost | ok
2026-02-26 19:12:55.443235 | 
2026-02-26 19:12:55.443348 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-02-26 19:12:56.183002 | localhost -> localhost | changed
2026-02-26 19:12:56.188620 | 
2026-02-26 19:12:56.188720 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-02-26 19:12:57.195653 | localhost -> localhost | changed
2026-02-26 19:12:57.204110 | 
2026-02-26 19:12:57.204201 | TASK [Setup log path fact]
2026-02-26 19:12:57.224186 | localhost | ok
2026-02-26 19:12:57.235855 | 
2026-02-26 19:12:57.235939 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-02-26 19:12:57.262899 | localhost | ok
2026-02-26 19:12:57.272048 | 
2026-02-26 19:12:57.272120 | TASK [emit-job-header : Print job information]
2026-02-26 19:12:57.302713 | # Job Information
2026-02-26 19:12:57.302951 | Ansible Version: 2.15.12
2026-02-26 19:12:57.302983 | Job: cifmw-molecule-reproducer
2026-02-26 19:12:57.303007 | Pipeline: github-check
2026-02-26 19:12:57.303027 | Executor: ibm-bm4-ze.softwarefactory-project.io
2026-02-26 19:12:57.303047 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3720
2026-02-26 19:12:57.303066 | Log URL (when completed): https://logserver.rdoproject.org/887/rdoproject.org/887aa6d2228f4b4e801f111ad7ae8901/
2026-02-26 19:12:57.303086 | Event ID: f6e04f50-1346-11f1-80a6-f09915dbf8a7
2026-02-26 19:12:57.313986 | 
2026-02-26 19:12:57.314059 | LOOP [emit-job-header : Print node information]
2026-02-26 19:12:57.466590 | localhost | ok:
2026-02-26 19:12:57.466819 | localhost | # Node Information
2026-02-26 19:12:57.466856 | localhost | Inventory Hostname: controller
2026-02-26 19:12:57.466882 | localhost | Hostname: np0005631942
2026-02-26 19:12:57.466903 | localhost | Username: zuul
2026-02-26 19:12:57.466925 | localhost | Distro: CentOS 9
2026-02-26 19:12:57.466946 | localhost | Provider: ibm-bm4-nodepool
2026-02-26 19:12:57.466964 | localhost | Region: regionOne
2026-02-26 19:12:57.466984 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm
2026-02-26 19:12:57.467003 | localhost | Product Name: OpenStack Compute
2026-02-26 19:12:57.467020 | localhost | Interface IP: 192.168.26.120
2026-02-26 19:12:57.490017 | 
2026-02-26 19:12:57.490104 | PLAY [all]
2026-02-26 19:12:57.496648 | 
2026-02-26 19:12:57.496719 | TASK [Gather network facts]
2026-02-26 19:12:57.949777 | controller | ok
2026-02-26 19:12:57.989642 | 
2026-02-26 19:12:57.989751 | TASK [include_role : start-zuul-console]
2026-02-26 19:12:58.028111 | controller | ok
2026-02-26 19:12:58.039587 | 
2026-02-26 19:12:58.039667 | TASK [start-zuul-console : Start zuul_console daemon.]
2026-02-26 19:12:58.591487 | controller | ok
2026-02-26 19:12:58.603317 | 
2026-02-26 19:12:58.603382 | TASK [include_role : add-build-sshkey]
2026-02-26 19:12:58.620810 | controller | ok
2026-02-26 19:12:58.637580 | 
2026-02-26 19:12:58.637658 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-02-26 19:12:59.017440 | controller -> localhost | ok
2026-02-26 19:12:59.024270 | 
2026-02-26 19:12:59.024399 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-02-26 19:12:59.128782 | controller | ok
2026-02-26 19:12:59.152073 | controller | included: /var/lib/zuul/builds/887aa6d2228f4b4e801f111ad7ae8901/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-02-26 19:12:59.161857 | 
2026-02-26 19:12:59.161931 | TASK [add-build-sshkey : Create Temp SSH key]
2026-02-26 19:13:00.646838 | controller -> localhost | Generating public/private rsa key pair.
2026-02-26 19:13:00.647044 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/887aa6d2228f4b4e801f111ad7ae8901/work/887aa6d2228f4b4e801f111ad7ae8901_id_rsa.
2026-02-26 19:13:00.647079 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/887aa6d2228f4b4e801f111ad7ae8901/work/887aa6d2228f4b4e801f111ad7ae8901_id_rsa.pub.
2026-02-26 19:13:00.647104 | controller -> localhost | The key fingerprint is:
2026-02-26 19:13:00.647126 | controller -> localhost | SHA256:vCBpnBBN/0hileqYwRykJHSZujM2Z+2bHlZN2crNItk zuul-build-sshkey
2026-02-26 19:13:00.647147 | controller -> localhost | The key's randomart image is:
2026-02-26 19:13:00.647167 | controller -> localhost | +---[RSA 3072]----+
2026-02-26 19:13:00.647187 | controller -> localhost | |o+o++ ..         |
2026-02-26 19:13:00.647206 | controller -> localhost | |o.o+.o.   o      |
2026-02-26 19:13:00.647225 | controller -> localhost | |.oo.o.o  o .     |
2026-02-26 19:13:00.647243 | controller -> localhost | | .++.= +* +      |
2026-02-26 19:13:00.647261 | controller -> localhost | |  .=B o+SE o     |
2026-02-26 19:13:00.647280 | controller -> localhost | | *o+.o.....      |
2026-02-26 19:13:00.647326 | controller -> localhost | |. * .o  .        |
2026-02-26 19:13:00.647351 | controller -> localhost | |    ..o          |
2026-02-26 19:13:00.647371 | controller -> localhost | |    .+.          |
2026-02-26 19:13:00.647390 | controller -> localhost | +----[SHA256]-----+
2026-02-26 19:13:00.647437 | controller -> localhost | ok: Runtime: 0:00:00.397749
2026-02-26 19:13:00.652996 | 
2026-02-26 19:13:00.653060 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-02-26 19:13:00.692661 | controller | ok
2026-02-26 19:13:00.704382 | controller | included: /var/lib/zuul/builds/887aa6d2228f4b4e801f111ad7ae8901/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-02-26 19:13:00.714238 | 
2026-02-26 19:13:00.714330 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-02-26 19:13:00.749111 | controller | skipping: Conditional result was False
2026-02-26 19:13:00.754989 | 
2026-02-26 19:13:00.755059 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-02-26 19:13:01.312155 | controller | changed
2026-02-26 19:13:01.317448 | 
2026-02-26 19:13:01.317515 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-02-26 19:13:01.624944 | controller | ok
2026-02-26 19:13:01.630930 | 
2026-02-26 19:13:01.631018 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-02-26 19:13:02.856203 | controller | changed
2026-02-26 19:13:02.861251 | 
2026-02-26 19:13:02.861332 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-02-26 19:13:03.968869 | controller | changed
2026-02-26 19:13:03.973979 | 
2026-02-26 19:13:03.974046 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-02-26 19:13:03.997865 | controller | skipping: Conditional result was False
2026-02-26 19:13:04.003766 | 
2026-02-26 19:13:04.003834 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-02-26 19:13:04.334717 | controller -> localhost | changed
2026-02-26 19:13:04.344967 | 
2026-02-26 19:13:04.345059 | TASK [add-build-sshkey : Add back temp key]
2026-02-26 19:13:04.676504 | controller -> localhost | Identity added: /var/lib/zuul/builds/887aa6d2228f4b4e801f111ad7ae8901/work/887aa6d2228f4b4e801f111ad7ae8901_id_rsa (zuul-build-sshkey)
2026-02-26 19:13:04.676709 | controller -> localhost | ok: Runtime: 0:00:00.016954
2026-02-26 19:13:04.682250 | 
2026-02-26 19:13:04.682343 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-02-26 19:13:05.105683 | controller | ok
2026-02-26 19:13:05.110260 | 
2026-02-26 19:13:05.110357 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-02-26 19:13:05.144410 | controller | skipping: Conditional result was False
2026-02-26 19:13:05.156006 | 
2026-02-26 19:13:05.156083 | TASK [include_role : validate-host]
2026-02-26 19:13:05.201023 | controller | ok
2026-02-26 19:13:05.219076 | 
2026-02-26 19:13:05.219143 | TASK [validate-host : Define zuul_info_dir fact]
2026-02-26 19:13:05.247389 | controller | ok
2026-02-26 19:13:05.252120 | 
2026-02-26 19:13:05.252188 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2026-02-26 19:13:05.538603 | controller -> localhost | ok
2026-02-26 19:13:05.545512 | 
2026-02-26 19:13:05.545582 | TASK [validate-host : Collect information about the host]
2026-02-26 19:13:06.244485 | controller | ok
2026-02-26 19:13:06.259210 | 
2026-02-26 19:13:06.259333 | TASK [validate-host : Sanitize hostname]
2026-02-26 19:13:06.339845 | controller | ok
2026-02-26 19:13:06.344738 | 
2026-02-26 19:13:06.344808 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2026-02-26 19:13:06.838334 | controller -> localhost | changed
2026-02-26 19:13:06.845183 | 
2026-02-26 19:13:06.845276 | TASK [validate-host : Collect information about zuul worker]
2026-02-26 19:13:07.266973 | controller | ok
2026-02-26 19:13:07.271913 | 
2026-02-26 19:13:07.271999 | TASK [validate-host : Write out all zuul information for each host]
2026-02-26 19:13:07.644017 | controller -> localhost | changed
2026-02-26 19:13:07.653243 | 
2026-02-26 19:13:07.653354 | TASK [include_role : prepare-workspace-openshift]
2026-02-26 19:13:07.679869 | controller | skipping: Conditional result was False
2026-02-26 19:13:07.686357 | 
2026-02-26 19:13:07.686430 | TASK [include_role : remove-zuul-sshkey]
2026-02-26 19:13:07.699895 | controller | skipping: Conditional result was False
2026-02-26 19:13:07.705105 | 
2026-02-26 19:13:07.705177 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-02-26 19:13:07.956363 | controller | ok: "logs"
2026-02-26 19:13:07.956622 | controller | ok: All items complete
2026-02-26 19:13:07.956670 | 
2026-02-26 19:13:08.177312 | controller | ok: "artifacts"
2026-02-26 19:13:08.410943 | controller | ok: "docs"
2026-02-26 19:13:08.420183 | 
2026-02-26 19:13:08.420286 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-02-26 19:13:08.705028 | controller | changed: "logs"
2026-02-26 19:13:08.953183 | controller | changed: "artifacts"
2026-02-26 19:13:09.195362 | controller | changed: "docs"
2026-02-26 19:13:09.228893 | 
2026-02-26 19:13:09.229024 | PLAY RECAP
2026-02-26 19:13:09.229081 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-02-26 19:13:09.229113 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-02-26 19:13:09.229134 | 
2026-02-26 19:13:09.307416 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-02-26 19:13:09.308098 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2026-02-26 19:13:09.881795 | 
2026-02-26 19:13:09.881902 | PLAY [all]
2026-02-26 19:13:09.901158 | 
2026-02-26 19:13:09.901234 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2026-02-26 19:13:09.960404 | controller | ok
2026-02-26 19:13:09.965264 | 
2026-02-26 19:13:09.965363 | TASK [mirror-info-fork : Create /etc/ci]
2026-02-26 19:13:10.359392 | controller | changed
2026-02-26 19:13:10.364909 | 
2026-02-26 19:13:10.364994 | TASK [mirror-info-fork : Install ci_mirror script]
2026-02-26 19:13:11.640764 | controller | changed
2026-02-26 19:13:11.650905 | 
2026-02-26 19:13:11.650991 | LOOP [add-authorized-keys : Enable access via build key on all nodes]
2026-02-26 19:13:12.102951 | controller | changed:
2026-02-26 19:13:12.103170 | controller | {
2026-02-26 19:13:12.103207 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com"
2026-02-26 19:13:12.103241 | controller | }
2026-02-26 19:13:12.395403 | controller | changed:
2026-02-26 19:13:12.395509 | controller | {
2026-02-26 19:13:12.395542 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com"
2026-02-26 19:13:12.395565 | controller | }
2026-02-26 19:13:12.683833 | controller | changed:
2026-02-26 19:13:12.683942 | controller | {
2026-02-26 19:13:12.683973 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com"
2026-02-26 19:13:12.683996 | controller | }
2026-02-26 19:13:12.979651 | controller | changed:
2026-02-26 19:13:12.979774 | controller | {
2026-02-26 19:13:12.979805 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com"
2026-02-26 19:13:12.979827 | controller | }
2026-02-26 19:13:13.284624 | controller | changed:
2026-02-26 19:13:13.284991 | controller | {
2026-02-26 19:13:13.285030 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com"
2026-02-26 19:13:13.285054 | controller | }
2026-02-26 19:13:13.580212 | controller | changed:
2026-02-26 19:13:13.581539 | controller | {
2026-02-26 19:13:13.581602 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com"
2026-02-26 19:13:13.581642 | controller | }
2026-02-26 19:13:13.880945 | controller | changed:
2026-02-26 19:13:13.881045 | controller | {
2026-02-26 19:13:13.881074 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen"
2026-02-26 19:13:13.881098 | controller | }
2026-02-26 19:13:14.183256 | controller | changed:
2026-02-26 19:13:14.183403 | controller | {
2026-02-26 19:13:14.183435 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora"
2026-02-26 19:13:14.183459 | controller | }
2026-02-26 19:13:14.484623 | controller | changed:
2026-02-26 19:13:14.484724 | controller | {
2026-02-26 19:13:14.484752 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner"
2026-02-26 19:13:14.484775 | controller | }
2026-02-26 19:13:14.805502 | controller | changed:
2026-02-26 19:13:14.805589 | controller | {
2026-02-26 19:13:14.805615 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com"
2026-02-26 19:13:14.805649 | controller | }
2026-02-26 19:13:15.100149 | controller | changed:
2026-02-26 19:13:15.100230 | controller | {
2026-02-26 19:13:15.100258 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com"
2026-02-26 19:13:15.100281 | controller | }
2026-02-26 19:13:15.398736 | controller | changed:
2026-02-26 19:13:15.398823 | controller | {
2026-02-26 19:13:15.398850 | controller |   "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com"
2026-02-26 19:13:15.398872 | controller | }
2026-02-26 19:13:15.688263 | controller | changed:
2026-02-26 19:13:15.688381 | controller | {
2026-02-26 19:13:15.688408 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com"
2026-02-26 19:13:15.688429 | controller | }
2026-02-26 19:13:15.986344 | controller | changed:
2026-02-26 19:13:15.986452 | controller | {
2026-02-26 19:13:15.986481 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel"
2026-02-26 19:13:15.986501 | controller | }
2026-02-26 19:13:16.273601 | controller | changed:
2026-02-26 19:13:16.273706 | controller | {
2026-02-26 19:13:16.273735 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux"
2026-02-26 19:13:16.273758 | controller | }
2026-02-26 19:13:16.564749 | controller | changed:
2026-02-26 19:13:16.565128 | controller | {
2026-02-26 19:13:16.565171 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr"
2026-02-26 19:13:16.565195 | controller | }
2026-02-26 19:13:16.861994 | controller | changed:
2026-02-26 19:13:16.862184 | controller | {
2026-02-26 19:13:16.862222 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com"
2026-02-26 19:13:16.862247 | controller | }
2026-02-26 19:13:17.149727 | controller | changed:
2026-02-26 19:13:17.149931 | controller | {
2026-02-26 19:13:17.149967 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb"
2026-02-26 19:13:17.150008 | controller | }
2026-02-26 19:13:17.444581 | controller | changed:
2026-02-26 19:13:17.444699 | controller | {
2026-02-26 19:13:17.444726 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9"
2026-02-26 19:13:17.444746 | controller | }
2026-02-26 19:13:17.764891 | controller | changed:
2026-02-26 19:13:17.764983 | controller | {
2026-02-26 19:13:17.765013 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora"
2026-02-26 19:13:17.765035 | controller | }
2026-02-26 19:13:18.056282 | controller | changed:
2026-02-26 19:13:18.056487 | controller | {
2026-02-26 19:13:18.056517 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac"
2026-02-26 19:13:18.056539 | controller | }
2026-02-26 19:13:18.356728 | controller | changed:
2026-02-26 19:13:18.357125 | controller | {
2026-02-26 19:13:18.357168 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop"
2026-02-26 19:13:18.357194 | controller | }
2026-02-26 19:13:18.681131 | controller | changed:
2026-02-26 19:13:18.681401 | controller | {
2026-02-26 19:13:18.681436 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com"
2026-02-26 19:13:18.681461 | controller | }
2026-02-26 19:13:18.992801 | controller | changed:
2026-02-26 19:13:18.992914 | controller | {
2026-02-26 19:13:18.992944 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com"
2026-02-26 19:13:18.992965 | controller | }
2026-02-26 19:13:19.292483 | controller | changed:
2026-02-26 19:13:19.292569 | controller | {
2026-02-26 19:13:19.292596 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com"
2026-02-26 19:13:19.292618 | controller | }
2026-02-26 19:13:19.591502 | controller | changed:
2026-02-26 19:13:19.591604 | controller | {
2026-02-26 19:13:19.591645 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono"
2026-02-26 19:13:19.591669 | controller | }
2026-02-26 19:13:19.615714 | 
2026-02-26 19:13:19.615789 | TASK [Set timezone to UTC]
2026-02-26 19:13:20.143888 | controller | changed: executed `/bin/timedatectl set-timezone UTC`
2026-02-26 19:13:20.149663 | 
2026-02-26 19:13:20.149757 | TASK [Create nodepool directory]
2026-02-26 19:13:20.455936 | controller | changed
2026-02-26 19:13:20.461536 | 
2026-02-26 19:13:20.461616 | TASK [Create nodepool sub_nodes file]
2026-02-26 19:13:21.524676 | controller | changed
2026-02-26 19:13:21.529787 | 
2026-02-26 19:13:21.529877 | TASK [Create nodepool sub_nodes_private file]
2026-02-26 19:13:22.654663 | controller | changed
2026-02-26 19:13:22.671286 | 
2026-02-26 19:13:22.671427 | LOOP [Populate nodepool sub_nodes file]
2026-02-26 19:13:22.701109 | 
2026-02-26 19:13:22.701234 | LOOP [Populate nodepool sub_nodes_private file]
2026-02-26 19:13:22.729887 | 
2026-02-26 19:13:22.730012 | TASK [Create nodepool primary file]
2026-02-26 19:13:22.753119 | controller | skipping: Conditional result was False
2026-02-26 19:13:22.758584 | 
2026-02-26 19:13:22.758671 | TASK [Create nodepool node_private for this node]
2026-02-26 19:13:23.864684 | controller | changed
2026-02-26 19:13:23.870187 | 
2026-02-26 19:13:23.870261 | LOOP [Copy ssh keys to nodepool directory]
2026-02-26 19:13:24.296503 | controller | ok: Item: id_rsa Runtime: 0:00:00.006279
2026-02-26 19:13:24.296699 | 
2026-02-26 19:13:24.554709 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.006455
2026-02-26 19:13:24.562069 | 
2026-02-26 19:13:24.562178 | TASK [Add sudoers role for zuul-sudo-grep.sh]
2026-02-26 19:13:25.676967 | controller | changed
2026-02-26 19:13:25.685260 | 
2026-02-26 19:13:25.685381 | TASK [Validate sudoers config after edits]
2026-02-26 19:13:26.005858 | controller | /etc/sudoers: parsed OK
2026-02-26 19:13:26.005925 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK
2026-02-26 19:13:26.005934 | controller | /etc/sudoers.d/zuul: parsed OK
2026-02-26 19:13:26.005940 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK
2026-02-26 19:13:26.237709 | controller | ok: Runtime: 0:00:00.006079
2026-02-26 19:13:26.243445 | 
2026-02-26 19:13:26.243507 | TASK [Show the environment passed in to job shell scripts]
2026-02-26 19:13:26.534501 | controller | SHELL=/bin/bash
2026-02-26 19:13:26.534539 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework
2026-02-26 19:13:26.534549 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework
2026-02-26 19:13:26.534556 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/20/3720/0ed017cff811a7067f813f17eeea4a13a9696c8e
2026-02-26 19:13:26.534561 | controller | PWD=/home/zuul
2026-02-26 19:13:26.534567 | controller | ZUUL_PIPELINE=github-check
2026-02-26 19:13:26.534572 | controller | LOGNAME=zuul
2026-02-26 19:13:26.534577 | controller | XDG_SESSION_TYPE=tty
2026-02-26 19:13:26.534582 | controller | _=/usr/bin/env
2026-02-26 19:13:26.534587 | controller | MOTD_SHOWN=pam
2026-02-26 19:13:26.534623 | controller | HOME=/home/zuul
2026-02-26 19:13:26.534631 | controller | LANG=en_US.UTF-8
2026-02-26 19:13:26.534637 | controller | SSH_CONNECTION=192.168.26.12 51214 192.168.26.120 22
2026-02-26 19:13:26.534642 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET
2026-02-26 19:13:26.534650 | controller | ZUUL_CHANGE_IDS=3720,0ed017cff811a7067f813f17eeea4a13a9696c8e
2026-02-26 19:13:26.534655 | controller | WORKSPACE=/home/zuul/workspace
2026-02-26 19:13:26.534660 | controller | XDG_SESSION_CLASS=user
2026-02-26 19:13:26.534665 | controller | SELINUX_ROLE_REQUESTED=
2026-02-26 19:13:26.534670 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s
2026-02-26 19:13:26.534676 | controller | USER=zuul
2026-02-26 19:13:26.534681 | controller | ZUUL_VOTING=True
2026-02-26 19:13:26.534686 | controller | BUILD_TIMEOUT=5400000
2026-02-26 19:13:26.534691 | controller | SELINUX_USE_CURRENT_RANGE=
2026-02-26 19:13:26.534696 | controller | SHLVL=1
2026-02-26 19:13:26.534701 | controller | ZUUL_PATCHSET=0ed017cff811a7067f813f17eeea4a13a9696c8e
2026-02-26 19:13:26.534706 | controller | XDG_SESSION_ID=1
2026-02-26 19:13:26.534711 | controller | ZUUL_BRANCH=main
2026-02-26 19:13:26.534716 | controller | XDG_RUNTIME_DIR=/run/user/1000
2026-02-26 19:13:26.534721 | controller | SSH_CLIENT=192.168.26.12 51214 22
2026-02-26 19:13:26.534740 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/
2026-02-26 19:13:26.534749 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima:
2026-02-26 19:13:26.534754 | controller | which_declare=declare -f
2026-02-26 19:13:26.534760 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
2026-02-26 19:13:26.534765 | controller | SELINUX_LEVEL_REQUESTED=
2026-02-26 19:13:26.534770 | controller | ZUUL_CHANGE=3720
2026-02-26 19:13:26.534775 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus
2026-02-26 19:13:26.534780 | controller | ZUUL_UUID=887aa6d2228f4b4e801f111ad7ae8901
2026-02-26 19:13:26.534785 | controller | BASH_FUNC_which%%=() {  ( alias;
2026-02-26 19:13:26.534792 | controller |  eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
2026-02-26 19:13:26.534797 | controller | }
2026-02-26 19:13:26.785959 | controller | ok: Runtime: 0:00:00.005419
2026-02-26 19:13:26.791508 | 
2026-02-26 19:13:26.791597 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars]
2026-02-26 19:13:26.827382 | controller | skipping: Conditional result was False
2026-02-26 19:13:26.832808 | 
2026-02-26 19:13:26.832893 | TASK [Symlink /home/zuul-worker/workspace]
2026-02-26 19:13:27.402130 | controller | skipping: Conditional result was False
2026-02-26 19:13:27.407799 | 
2026-02-26 19:13:27.407881 | TASK [Ensure legacy workspace directory]
2026-02-26 19:13:27.657989 | controller | changed
2026-02-26 19:13:27.697282 | 
2026-02-26 19:13:27.697378 | PLAY RECAP
2026-02-26 19:13:27.697424 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-02-26 19:13:27.697450 | 
2026-02-26 19:13:27.791912 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2026-02-26 19:13:27.792691 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2026-02-26 19:13:28.350080 | 
2026-02-26 19:13:28.350175 | PLAY [Run ci/playbooks/dump_zuul_data.yml]
2026-02-26 19:13:28.371668 | 
2026-02-26 19:13:28.371766 | TASK [Create zuul-output directory]
2026-02-26 19:13:28.777384 | controller | changed
2026-02-26 19:13:28.785563 | 
2026-02-26 19:13:28.785670 | TASK [Slurp Zuul inventory test]
2026-02-26 19:13:29.286553 | controller -> localhost | ok
2026-02-26 19:13:29.292625 | 
2026-02-26 19:13:29.292724 | TASK [Save zuul inventory]
2026-02-26 19:13:30.653971 | controller | changed
2026-02-26 19:13:30.672639 | 
2026-02-26 19:13:30.672732 | TASK [Save zuul vars without the change_message]
2026-02-26 19:13:31.781615 | controller | changed
2026-02-26 19:13:31.809442 | 
2026-02-26 19:13:31.809539 | PLAY RECAP
2026-02-26 19:13:31.809586 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-02-26 19:13:31.809610 | 
2026-02-26 19:13:31.878181 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2026-02-26 19:13:31.878932 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2026-02-26 19:13:32.643895 | 
2026-02-26 19:13:32.644254 | PLAY [Run ci/playbooks/molecule-prepare.yml]
2026-02-26 19:13:32.665751 | 
2026-02-26 19:13:32.665827 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh]
2026-02-26 19:13:32.697180 | controller | ok
2026-02-26 19:13:32.719158 | 
2026-02-26 19:13:32.719252 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2026-02-26 19:13:32.752751 | controller | skipping: Conditional result was False
2026-02-26 19:13:32.758828 | 
2026-02-26 19:13:32.758900 | TASK [mirror-info-fork : Create /etc/ci]
2026-02-26 19:13:33.182585 | controller | ok
2026-02-26 19:13:33.188251 | 
2026-02-26 19:13:33.188368 | TASK [mirror-info-fork : Install ci_mirror script]
2026-02-26 19:13:34.162338 | controller | ok
2026-02-26 19:13:34.173135 | 
2026-02-26 19:13:34.173214 | TASK [Prepare workspace]
2026-02-26 19:13:34.190987 | controller | ok
2026-02-26 19:13:34.207998 | 
2026-02-26 19:13:34.208070 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-02-26 19:13:34.591554 | controller | ok
2026-02-26 19:13:34.597388 | 
2026-02-26 19:13:34.597462 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-02-26 19:13:37.112783 | controller | Output suppressed because no_log was given
2026-02-26 19:13:37.123157 | 
2026-02-26 19:13:37.123221 | LOOP [Create zuul-output directory]
2026-02-26 19:13:37.383843 | controller | changed: "/home/zuul/ci-framework-data/logs"
2026-02-26 19:13:37.607684 | controller | ok: "/home/zuul/zuul-output/logs"
2026-02-26 19:13:37.622195 | 
2026-02-26 19:13:37.622265 | TASK [Install required packages]
2026-02-26 19:13:56.807817 | controller | ok: Nothing to do
2026-02-26 19:13:56.812794 | 
2026-02-26 19:13:56.812864 | TASK [Install venv]
2026-02-26 19:14:55.908942 | controller | changed
2026-02-26 19:14:55.936801 | 
2026-02-26 19:14:55.937052 | PLAY RECAP
2026-02-26 19:14:55.937111 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-02-26 19:14:55.937139 | 
2026-02-26 19:14:56.056908 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2026-02-26 19:14:56.058497 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2026-02-26 19:14:56.609772 | 
2026-02-26 19:14:56.609873 | PLAY [Run ci/playbooks/molecule-test.yml]
2026-02-26 19:14:56.630514 | 
2026-02-26 19:14:56.630591 | TASK [Gather required facts]
2026-02-26 19:14:57.177981 | controller | ok
2026-02-26 19:14:57.183798 | 
2026-02-26 19:14:57.183897 | TASK [Load environment var if instructed to]
2026-02-26 19:14:57.219379 | controller | skipping: Conditional result was False
2026-02-26 19:14:57.225510 | 
2026-02-26 19:14:57.225591 | TASK [Ensure group_vars dir exists]
2026-02-26 19:14:57.610702 | controller | ok
2026-02-26 19:14:57.616940 | 
2026-02-26 19:14:57.617005 | TASK [Print related variables]
2026-02-26 19:14:57.645360 | controller | ok:
2026-02-26 19:14:57.645466 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml
2026-02-26 19:14:57.645498 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer
2026-02-26 19:14:57.650340 | 
2026-02-26 19:14:57.650405 | TASK [Run molecule]
2026-02-26 19:14:58.647408 | controller | INFO     Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml
2026-02-26 19:14:58.922799 | controller | INFO     Performing prerun with role_name_check=0...
2026-02-26 19:15:16.135241 | controller | WARNING  Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.135662 | controller | WARNING  Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.136116 | controller | WARNING  Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.136536 | controller | WARNING  Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.137015 | controller | WARNING  Another version of 'cifmw.general' 1.0.0+0ed017cf was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+0ed017cf (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.137444 | controller | WARNING  Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.137885 | controller | WARNING  Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.138302 | controller | WARNING  Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.138743 | controller | WARNING  Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.139132 | controller | WARNING  Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.139552 | controller | WARNING  Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.140012 | controller | WARNING  Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.140427 | controller | WARNING  Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.140874 | controller | WARNING  Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.141289 | controller | WARNING  Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 19:15:16.150404 | controller | INFO     Running crc_layout > prepare
2026-02-26 19:15:16.809845 | controller |
2026-02-26 19:15:16.809887 | controller | PLAY [Prepare] *****************************************************************
2026-02-26 19:15:16.809963 | controller |
2026-02-26 19:15:16.810046 | controller | TASK [Gathering Facts] *********************************************************
2026-02-26 19:15:16.810137 | controller | Thursday 26 February 2026  19:15:16 +0000 (0:00:00.018)       0:00:00.018 *****
2026-02-26 19:15:17.640854 | controller | ok: [instance]
2026-02-26 19:15:17.640911 | controller |
2026-02-26 19:15:17.641026 | controller | TASK [Create custom basedir] ***************************************************
2026-02-26 19:15:17.641120 | controller | Thursday 26 February 2026  19:15:17 +0000 (0:00:00.831)       0:00:00.850 *****
2026-02-26 19:15:17.949329 | controller | changed: [instance]
2026-02-26 19:15:17.949382 | controller |
2026-02-26 19:15:17.949487 | controller | TASK [test_deps : Gather facts if they don't exist] ****************************
2026-02-26 19:15:17.949589 | controller | Thursday 26 February 2026  19:15:17 +0000 (0:00:00.308)       0:00:01.158 *****
2026-02-26 19:15:17.967025 | controller | skipping: [instance]
2026-02-26 19:15:17.967131 | controller |
2026-02-26 19:15:17.967252 | controller | TASK [test_deps : Gather variables for each operating system] ******************
2026-02-26 19:15:17.967365 | controller | Thursday 26 February 2026  19:15:17 +0000 (0:00:00.017)       0:00:01.176 *****
2026-02-26 19:15:18.008278 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)
2026-02-26 19:15:18.008381 | controller |
2026-02-26 19:15:18.008498 | controller | TASK [test_deps : Detect mirrors file] *****************************************
2026-02-26 19:15:18.008629 | controller | Thursday 26 February 2026  19:15:18 +0000 (0:00:00.041)       0:00:01.217 *****
2026-02-26 19:15:18.286879 | controller | ok: [instance]
2026-02-26 19:15:18.286933 | controller |
2026-02-26 19:15:18.287085 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] ***********
2026-02-26 19:15:18.287155 | controller | Thursday 26 February 2026  19:15:18 +0000 (0:00:00.278)       0:00:01.496 *****
2026-02-26 19:15:18.494700 | controller | ok: [instance]
2026-02-26 19:15:18.494821 | controller |
2026-02-26 19:15:18.494924 | controller | TASK [test_deps : Disable ubi 9 repos] *****************************************
2026-02-26 19:15:18.495028 | controller | Thursday 26 February 2026  19:15:18 +0000 (0:00:00.207)       0:00:01.704 *****
2026-02-26 19:15:19.166176 | controller | ok: [instance] => (item=ubi-9-appstream)
2026-02-26 19:15:19.166265 | controller | ok: [instance] => (item=ubi-9-baseos)
2026-02-26 19:15:19.166373 | controller | ok: [instance] => (item=ubi-9-codeready-builder)
2026-02-26 19:15:19.166472 | controller |
2026-02-26 19:15:19.166586 | controller | TASK [Deploy repo-setup] *******************************************************
2026-02-26 19:15:19.166674 | controller | Thursday 26 February 2026  19:15:19 +0000 (0:00:00.671)       0:00:02.375 *****
2026-02-26 19:15:19.224760 | controller |
2026-02-26 19:15:19.224854 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2026-02-26 19:15:19.225009 | controller | Thursday 26 February 2026  19:15:19 +0000 (0:00:00.058)       0:00:02.434 *****
2026-02-26 19:15:19.743831 | controller | changed: [instance] => (item=tmp)
2026-02-26 19:15:19.743872 | controller | changed: [instance] => (item=artifacts/repositories)
2026-02-26 19:15:19.744014 | controller | changed: [instance] => (item=venv/repo_setup)
2026-02-26 19:15:19.744057 | controller |
2026-02-26 19:15:19.744161 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2026-02-26 19:15:19.744248 | controller | Thursday 26 February 2026  19:15:19 +0000 (0:00:00.518)       0:00:02.953 *****
2026-02-26 19:15:20.581944 | controller | ok: [instance]
2026-02-26 19:15:20.581991 | controller |
2026-02-26 19:15:20.582246 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2026-02-26 19:15:21.697845 | controller | Thursday 26 February 2026  19:15:20 +0000 (0:00:00.838)       0:00:03.791 *****
2026-02-26 19:15:21.697896 | controller | changed: [instance]
2026-02-26 19:15:21.697924 | controller |
2026-02-26 19:15:21.697940 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2026-02-26 19:15:21.698060 | controller | Thursday 26 February 2026  19:15:21 +0000 (0:00:01.115)       0:00:04.907 *****
2026-02-26 19:15:29.310815 | controller | changed: [instance]
2026-02-26 19:15:29.310970 | controller |
2026-02-26 19:15:29.311000 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2026-02-26 19:15:29.311013 | controller | Thursday 26 February 2026  19:15:29 +0000 (0:00:07.612)       0:00:12.520 *****
2026-02-26 19:15:30.015271 | controller | changed: [instance]
2026-02-26 19:15:30.037024 | controller |
2026-02-26 19:15:30.037061 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2026-02-26 19:15:30.037072 | controller | Thursday 26 February 2026  19:15:30 +0000 (0:00:00.704)       0:00:13.224 *****
2026-02-26 19:15:30.037084 | controller | skipping: [instance]
2026-02-26 19:15:30.037112 | controller |
2026-02-26 19:15:30.037122 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2026-02-26 19:15:30.037216 | controller | Thursday 26 February 2026  19:15:30 +0000 (0:00:00.021)       0:00:13.246 *****
2026-02-26 19:15:30.832563 | controller | changed: [instance]
2026-02-26 19:15:30.868836 | controller |
2026-02-26 19:15:30.868874 | controller | TASK [repo_setup : Get component repo] *****************************************
2026-02-26 19:15:30.868884 | controller | Thursday 26 February 2026  19:15:30 +0000 (0:00:00.795)       0:00:14.041 *****
2026-02-26 19:15:30.868897 | controller | skipping: [instance]
2026-02-26 19:15:30.868936 | controller |
2026-02-26 19:15:30.868946 | controller | TASK [repo_setup : Rename component repo] **************************************
2026-02-26 19:15:30.869040 | controller | Thursday 26 February 2026  19:15:30 +0000 (0:00:00.036)       0:00:14.078 *****
2026-02-26 19:15:30.904880 | controller | skipping: [instance]
2026-02-26 19:15:30.904966 | controller |
2026-02-26 19:15:30.904983 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2026-02-26 19:15:30.904999 | controller | Thursday 26 February 2026  19:15:30 +0000 (0:00:00.035)       0:00:14.113 *****
2026-02-26 19:15:30.939882 | controller | skipping: [instance]
2026-02-26 19:15:31.464882 | controller |
2026-02-26 19:15:31.464916 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2026-02-26 19:15:31.464926 | controller | Thursday 26 February 2026  19:15:30 +0000 (0:00:00.035)       0:00:14.149 *****
2026-02-26 19:15:31.464938 | controller | changed: [instance]
2026-02-26 19:15:31.900404 | controller |
2026-02-26 19:15:31.900434 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2026-02-26 19:15:31.900441 | controller | Thursday 26 February 2026  19:15:31 +0000 (0:00:00.524)       0:00:14.674 *****
2026-02-26 19:15:31.900451 | controller | changed: [instance]
2026-02-26 19:15:31.928843 | controller |
2026-02-26 19:15:31.928884 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2026-02-26 19:15:31.928894 | controller | Thursday 26 February 2026  19:15:31 +0000 (0:00:00.435)       0:00:15.109 *****
2026-02-26 19:15:31.928908 | controller | skipping: [instance]
2026-02-26 19:15:31.957408 | controller |
2026-02-26 19:15:31.957430 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2026-02-26 19:15:31.957438 | controller | Thursday 26 February 2026  19:15:31 +0000 (0:00:00.028)       0:00:15.138 *****
2026-02-26 19:15:31.957451 | controller | skipping: [instance]
2026-02-26 19:15:31.984801 | controller |
2026-02-26 19:15:31.984830 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2026-02-26 19:15:31.984838 | controller | Thursday 26 February 2026  19:15:31 +0000 (0:00:00.028)       0:00:15.166 *****
2026-02-26 19:15:31.984848 | controller | skipping: [instance]
2026-02-26 19:15:31.985032 | controller |
2026-02-26 19:15:31.985056 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2026-02-26 19:15:32.022717 | controller | Thursday 26 February 2026  19:15:31 +0000 (0:00:00.027)       0:00:15.194 *****
2026-02-26 19:15:32.022762 | controller | ok: [instance]
2026-02-26 19:15:32.049671 | controller |
2026-02-26 19:15:32.049688 | controller | TASK [repo_setup : Create download directory] **********************************
2026-02-26 19:15:32.049695 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.037)       0:00:15.232 *****
2026-02-26 19:15:32.049710 | controller | skipping: [instance]
2026-02-26 19:15:32.076261 | controller |
2026-02-26 19:15:32.076282 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2026-02-26 19:15:32.076291 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.026)       0:00:15.259 *****
2026-02-26 19:15:32.076301 | controller | skipping: [instance]
2026-02-26 19:15:32.102853 | controller |
2026-02-26 19:15:32.102872 | controller | TASK [Download the RPM] ********************************************************
2026-02-26 19:15:32.102879 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.026)       0:00:15.285 *****
2026-02-26 19:15:32.102887 | controller | skipping: [instance]
2026-02-26 19:15:32.103024 | controller |
2026-02-26 19:15:32.103158 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2026-02-26 19:15:32.103304 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.027)       0:00:15.312 *****
2026-02-26 19:15:32.129872 | controller | skipping: [instance]
2026-02-26 19:15:32.130046 | controller |
2026-02-26 19:15:32.130211 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2026-02-26 19:15:32.130369 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.026)       0:00:15.339 *****
2026-02-26 19:15:32.156273 | controller | skipping: [instance]
2026-02-26 19:15:32.156448 | controller |
2026-02-26 19:15:32.156629 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2026-02-26 19:15:32.156788 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.026)       0:00:15.366 *****
2026-02-26 19:15:32.184781 | controller | skipping: [instance]
2026-02-26 19:15:32.185224 | controller |
2026-02-26 19:15:32.185394 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2026-02-26 19:15:32.185505 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.028)       0:00:15.394 *****
2026-02-26 19:15:32.210500 | controller | skipping: [instance]
2026-02-26 19:15:32.210669 | controller |
2026-02-26 19:15:32.210798 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2026-02-26 19:15:32.210919 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.025)       0:00:15.420 *****
2026-02-26 19:15:32.390305 | controller | ok: [instance]
2026-02-26 19:15:32.617836 | controller |
2026-02-26 19:15:32.617871 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2026-02-26 19:15:32.617881 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.179)       0:00:15.599 *****
2026-02-26 19:15:32.617893 | controller | changed: [instance]
2026-02-26 19:15:32.618115 | controller |
2026-02-26 19:15:32.618150 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2026-02-26 19:15:32.842428 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.227)       0:00:15.827 *****
2026-02-26 19:15:32.842467 | controller | changed: [instance]
2026-02-26 19:15:32.863693 | controller |
2026-02-26 19:15:32.863714 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2026-02-26 19:15:32.863723 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.224)       0:00:16.051 *****
2026-02-26 19:15:32.863757 | controller | skipping: [instance]
2026-02-26 19:15:32.886612 | controller |
2026-02-26 19:15:32.886641 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2026-02-26 19:15:32.886653 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.021)       0:00:16.073 *****
2026-02-26 19:15:32.886677 | controller | skipping: [instance]
2026-02-26 19:15:32.909663 | controller |
2026-02-26 19:15:32.909685 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2026-02-26 19:15:32.909694 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.022)       0:00:16.095 *****
2026-02-26 19:15:32.909704 | controller | skipping: [instance]
2026-02-26 19:15:32.931873 | controller |
2026-02-26 19:15:32.931919 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2026-02-26 19:15:32.931930 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.023)       0:00:16.119 *****
2026-02-26 19:15:32.931945 | controller | skipping: [instance]
2026-02-26 19:15:32.932023 | controller |
2026-02-26 19:15:32.932054 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2026-02-26 19:15:32.932085 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.021)       0:00:16.141 *****
2026-02-26 19:15:32.953845 | controller | skipping: [instance]
2026-02-26 19:15:32.974971 | controller |
2026-02-26 19:15:32.974992 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] ***
2026-02-26 19:15:32.975001 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.021)       0:00:16.162 *****
2026-02-26 19:15:32.975017 | controller | skipping: [instance]
2026-02-26 19:15:32.975171 | controller |
2026-02-26 19:15:32.975361 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2026-02-26 19:15:32.975541 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.021)       0:00:16.184 *****
2026-02-26 19:15:32.991381 | controller | skipping: [instance]
2026-02-26 19:15:32.991594 | controller |
2026-02-26 19:15:32.991812 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2026-02-26 19:15:32.992003 | controller | Thursday 26 February 2026  19:15:32 +0000 (0:00:00.016)       0:00:16.201 *****
2026-02-26 19:15:33.019924 | controller | skipping: [instance]
2026-02-26 19:15:33.019962 | controller |
2026-02-26 19:15:33.020128 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2026-02-26 19:15:33.020209 | controller | Thursday 26 February 2026  19:15:33 +0000 (0:00:00.028)       0:00:16.229 *****
2026-02-26 19:15:33.036768 | controller | skipping: [instance]
2026-02-26 19:15:33.036993 | controller |
2026-02-26 19:15:33.037217 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2026-02-26 19:15:33.037415 | controller | Thursday 26 February 2026  19:15:33 +0000 (0:00:00.016)       0:00:16.246 *****
2026-02-26 19:15:33.060174 | controller | skipping: [instance]
2026-02-26 19:15:33.060266 | controller |
2026-02-26 19:15:33.060392 | controller | TASK [test_deps : Look for redhat-release rpm] *********************************
2026-02-26 19:15:33.060498 | controller | Thursday 26 February 2026  19:15:33 +0000 (0:00:00.023)       0:00:16.269 *****
2026-02-26 19:15:33.089713 | controller | skipping: [instance]
2026-02-26 19:15:33.089826 | controller |
2026-02-26 19:15:33.089981 | controller | TASK [test_deps : Remove redhat-release] ***************************************
2026-02-26 19:15:33.090052 | controller | Thursday 26 February 2026  19:15:33 +0000 (0:00:00.029)       0:00:16.299 *****
2026-02-26 19:15:33.118968 | controller | skipping: [instance]
2026-02-26 19:15:33.119076 | controller |
2026-02-26 19:15:33.119242 | controller | TASK [test_deps : Install centos-stream-release] *******************************
2026-02-26 19:15:33.119343 | controller | Thursday 26 February 2026  19:15:33 +0000 (0:00:00.029)       0:00:16.328 *****
2026-02-26 19:15:33.148501 | controller | skipping: [instance]
2026-02-26 19:15:33.148697 | controller |
2026-02-26 19:15:33.148806 | controller | TASK [test_deps : Install additional packages] *********************************
2026-02-26 19:15:33.148928 | controller | Thursday 26 February 2026  19:15:33 +0000 (0:00:00.029)       0:00:16.358 *****
2026-02-26 19:15:33.177927 | controller | skipping: [instance]
2026-02-26 19:15:33.178148 | controller |
2026-02-26 19:15:33.178356 | controller | TASK [test_deps : Install selinux python libs] *********************************
2026-02-26 19:15:33.178588 | controller | Thursday 26 February 2026  19:15:33 +0000 (0:00:00.029)       0:00:16.387 *****
2026-02-26 19:16:16.577191 | controller | ok: [instance]
2026-02-26 19:16:17.788171 | controller |
2026-02-26 19:16:17.788204 | controller | TASK [test_deps : Install python yaml libs] ************************************
2026-02-26 19:16:17.788212 | controller | Thursday 26 February 2026  19:16:16 +0000 (0:00:43.398)       0:00:59.785 *****
2026-02-26 19:16:17.788223 | controller | ok: [instance]
2026-02-26 19:16:17.820375 | controller |
2026-02-26 19:16:17.820392 | controller | TASK [test_deps : Install extra packages] **************************************
2026-02-26 19:16:17.820399 | controller | Thursday 26 February 2026  19:16:17 +0000 (0:00:01.211)       0:01:00.997 *****
2026-02-26 19:16:17.820407 | controller | skipping: [instance]
2026-02-26 19:16:17.862372 | controller |
2026-02-26 19:16:17.862392 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2026-02-26 19:16:17.862399 | controller | Thursday 26 February 2026  19:16:17 +0000 (0:00:00.032)       0:01:01.029 *****
2026-02-26 19:16:17.862409 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml)
2026-02-26 19:16:17.881829 | controller |
2026-02-26 19:16:17.881848 | controller | TASK [ci_setup : List packages to install] *************************************
2026-02-26 19:16:17.881862 | controller | Thursday 26 February 2026  19:16:17 +0000 (0:00:00.041)       0:01:01.071 *****
2026-02-26 19:16:17.881871 | controller | ok: [instance] =>
2026-02-26 19:16:17.882013 | controller |   cifmw_ci_setup_packages:
2026-02-26 19:16:17.882029 | controller |   - bash-completion
2026-02-26 19:16:17.882036 | controller |   - ca-certificates
2026-02-26 19:16:17.882041 | controller |   - git-core
2026-02-26 19:16:17.882047 | controller |   - make
2026-02-26 19:16:17.882053 | controller |   - tar
2026-02-26 19:16:17.882058 | controller |   - tmux
2026-02-26 19:16:17.882063 | controller |   - python3-pip
2026-02-26 19:16:17.882069 | controller |
2026-02-26 19:16:17.882077 | controller | TASK [ci_setup : Install needed packages] **************************************
2026-02-26 19:16:26.175268 | controller | Thursday 26 February 2026  19:16:17 +0000 (0:00:00.018)       0:01:01.090 *****
2026-02-26 19:16:26.175307 | controller | changed: [instance]
2026-02-26 19:16:26.175328 | controller |
2026-02-26 19:16:26.175463 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2026-02-26 19:16:26.175496 | controller | Thursday 26 February 2026  19:16:26 +0000 (0:00:08.294)       0:01:09.384 *****
2026-02-26 19:16:26.742818 | controller | ok: [instance]
2026-02-26 19:16:26.742867 | controller |
2026-02-26 19:16:26.743074 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2026-02-26 19:16:26.743113 | controller | Thursday 26 February 2026  19:16:26 +0000 (0:00:00.567)       0:01:09.952 *****
2026-02-26 19:16:26.949254 | controller | changed: [instance]
2026-02-26 19:16:26.949300 | controller |
2026-02-26 19:16:26.949310 | controller | TASK [ci_setup : Install openshift client] *************************************
2026-02-26 19:16:26.949391 | controller | Thursday 26 February 2026  19:16:26 +0000 (0:00:00.206)       0:01:10.158 *****
2026-02-26 19:16:32.965859 | controller | changed: [instance]
2026-02-26 19:16:33.000500 | controller |
2026-02-26 19:16:33.000534 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2026-02-26 19:16:33.000544 | controller | Thursday 26 February 2026  19:16:32 +0000 (0:00:06.016)       0:01:16.175 *****
2026-02-26 19:16:33.000556 | controller | ok: [instance]
2026-02-26 19:16:33.267632 | controller |
2026-02-26 19:16:33.267676 | controller | TASK [ci_setup : Create completion file] ***************************************
2026-02-26 19:16:33.267685 | controller | Thursday 26 February 2026  19:16:32 +0000 (0:00:00.034)       0:01:16.210 *****
2026-02-26 19:16:33.267696 | controller | changed: [instance]
2026-02-26 19:16:33.535856 | controller |
2026-02-26 19:16:33.535886 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2026-02-26 19:16:33.535894 | controller | Thursday 26 February 2026  19:16:33 +0000 (0:00:00.266)       0:01:16.476 *****
2026-02-26 19:16:33.535904 | controller | changed: [instance]
2026-02-26 19:16:33.535927 | controller |
2026-02-26 19:16:33.536134 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2026-02-26 19:16:33.551933 | controller | Thursday 26 February 2026  19:16:33 +0000 (0:00:00.268)       0:01:16.745 *****
2026-02-26 19:16:33.551989 | controller | skipping: [instance]
2026-02-26 19:16:33.552035 | controller |
2026-02-26 19:16:33.552050 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2026-02-26 19:16:33.552152 | controller | Thursday 26 February 2026  19:16:33 +0000 (0:00:00.016)       0:01:16.761 *****
2026-02-26 19:16:33.568704 | controller | skipping: [instance]
2026-02-26 19:16:33.585704 | controller |
2026-02-26 19:16:33.585724 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2026-02-26 19:16:33.585754 | controller | Thursday 26 February 2026  19:16:33 +0000 (0:00:00.016)       0:01:16.778 *****
2026-02-26 19:16:33.585766 | controller | skipping: [instance]
2026-02-26 19:16:33.602597 | controller |
2026-02-26 19:16:33.602615 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2026-02-26 19:16:33.602623 | controller | Thursday 26 February 2026  19:16:33 +0000 (0:00:00.016)       0:01:16.795 *****
2026-02-26 19:16:33.602633 | controller | skipping: [instance]
2026-02-26 19:16:33.619273 | controller |
2026-02-26 19:16:33.619288 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2026-02-26 19:16:33.619301 | controller | Thursday 26 February 2026  19:16:33 +0000 (0:00:00.017)       0:01:16.812 *****
2026-02-26 19:16:33.619309 | controller | skipping: [instance]
2026-02-26 19:16:33.640817 | controller |
2026-02-26 19:16:33.640836 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2026-02-26 19:16:33.640844 | controller | Thursday 26 February 2026  19:16:33 +0000 (0:00:00.016)       0:01:16.828 *****
2026-02-26 19:16:33.640852 | controller | skipping: [instance]
2026-02-26 19:16:33.641060 | controller |
2026-02-26 19:16:33.641080 | controller | TASK [ci_setup : Manage directories] *******************************************
2026-02-26 19:16:34.596689 | controller | Thursday 26 February 2026  19:16:33 +0000 (0:00:00.021)       0:01:16.850 *****
2026-02-26 19:16:34.596724 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr)
2026-02-26 19:16:34.925928 | controller | changed: [instance] => (item=/opt/basedir/logs)
2026-02-26 19:16:34.925955 | controller | ok: [instance] => (item=/opt/basedir/tmp)
2026-02-26 19:16:34.925962 | controller | changed: [instance] => (item=/opt/basedir/volumes)
2026-02-26 19:16:34.925968 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters)
2026-02-26 19:16:34.925974 | controller |
2026-02-26 19:16:34.925979 | controller | TASK [Create secret file] ******************************************************
2026-02-26 19:16:34.925985 | controller | Thursday 26 February 2026  19:16:34 +0000 (0:00:00.955)       0:01:17.805 *****
2026-02-26 19:16:34.926006 | controller | changed: [instance]
2026-02-26 19:16:34.926025 | controller |
2026-02-26 19:16:34.927826 | controller | PLAY RECAP *********************************************************************
2026-02-26 19:16:34.927880 | controller | instance                   : ok=31   changed=17   unreachable=0    failed=0    skipped=36   rescued=0    ignored=0
2026-02-26 19:16:34.927890 | controller |
2026-02-26 19:16:34.927898 | controller | Thursday 26 February 2026  19:16:34 +0000 (0:00:00.329)       0:01:18.135 *****
2026-02-26 19:16:34.927905 | controller | ===============================================================================
2026-02-26 19:16:34.927912 | controller | test_deps : Install selinux python libs -------------------------------- 43.40s
2026-02-26 19:16:34.927919 | controller | ci_setup : Install needed packages -------------------------------------- 8.29s
2026-02-26 19:16:34.927925 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.61s
2026-02-26 19:16:34.927931 | controller | ci_setup : Install openshift client ------------------------------------- 6.02s
2026-02-26 19:16:34.927938 | controller | test_deps : Install python yaml libs ------------------------------------ 1.21s
2026-02-26 19:16:34.927944 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.12s
2026-02-26 19:16:34.927950 | controller | ci_setup : Manage directories ------------------------------------------- 0.96s
2026-02-26 19:16:34.927957 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.84s
2026-02-26 19:16:34.927963 | controller | Gathering Facts --------------------------------------------------------- 0.83s
2026-02-26 19:16:34.927969 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.80s
2026-02-26 19:16:34.927976 | controller | repo_setup : Install repo-setup package --------------------------------- 0.70s
2026-02-26 19:16:34.927982 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.67s
2026-02-26 19:16:34.927989 | controller | ci_setup : Gather version of openshift client --------------------------- 0.57s
2026-02-26 19:16:34.927995 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.52s
2026-02-26 19:16:34.928001 | controller | repo_setup : Ensure directories are present ----------------------------- 0.52s
2026-02-26 19:16:34.928010 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.44s
2026-02-26 19:16:34.928034 | controller | Create secret file ------------------------------------------------------ 0.33s
2026-02-26 19:16:34.928251 | controller | Create custom basedir --------------------------------------------------- 0.31s
2026-02-26 19:16:34.928269 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.28s
2026-02-26 19:16:34.980327 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.27s
2026-02-26 19:16:34.980359 | controller | INFO     Running crc_layout > converge
2026-02-26 19:16:35.567049 | controller |
2026-02-26 19:16:35.567238 | controller | PLAY [Converge] ****************************************************************
2026-02-26 19:16:35.567367 | controller |
2026-02-26 19:16:35.567499 | controller | TASK [Gathering Facts] *********************************************************
2026-02-26 19:16:35.567628 | controller | Thursday 26 February 2026  19:16:35 +0000 (0:00:00.026)       0:00:00.026 *****
2026-02-26 19:16:36.388138 | controller | ok: [instance]
2026-02-26 19:16:36.409873 | controller |
2026-02-26 19:16:36.409913 | controller | TASK [Load networking definition from scenario file] ***************************
2026-02-26 19:16:36.409923 | controller | Thursday 26 February 2026  19:16:36 +0000 (0:00:00.821)       0:00:00.847 *****
2026-02-26 19:16:36.409935 | controller | ok: [instance]
2026-02-26 19:16:36.409968 | controller |
2026-02-26 19:16:36.410138 | controller | TASK [discover_latest_image : Get latest image] ********************************
2026-02-26 19:16:38.026797 | controller | Thursday 26 February 2026  19:16:36 +0000 (0:00:00.022)       0:00:00.869 *****
2026-02-26 19:16:38.026834 | controller | changed: [instance]
2026-02-26 19:16:38.053857 | controller |
2026-02-26 19:16:38.053894 | controller | TASK [discover_latest_image : Export facts accordingly] ************************
2026-02-26 19:16:38.053911 | controller | Thursday 26 February 2026  19:16:38 +0000 (0:00:01.616)       0:00:02.486 *****
2026-02-26 19:16:38.053925 | controller | ok: [instance]
2026-02-26 19:16:38.074815 | controller |
2026-02-26 19:16:38.074846 | controller | TASK [reproducer : Load CI job environment] ************************************
2026-02-26 19:16:38.074854 | controller | Thursday 26 February 2026  19:16:38 +0000 (0:00:00.027)       0:00:02.513 *****
2026-02-26 19:16:38.074865 | controller | skipping: [instance]
2026-02-26 19:16:38.074889 | controller |
2026-02-26 19:16:38.074897 | controller | TASK [Build final libvirt layout] **********************************************
2026-02-26 19:16:38.074924 | controller | Thursday 26 February 2026  19:16:38 +0000 (0:00:00.021)       0:00:02.534 *****
2026-02-26 19:16:38.124148 | controller |
2026-02-26 19:16:38.205800 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] ***********
2026-02-26 19:16:38.205824 | controller | Thursday 26 February 2026  19:16:38 +0000 (0:00:00.049)       0:00:02.583 *****
2026-02-26 19:16:38.205835 | controller | ok: [instance]
2026-02-26 19:16:38.206012 | controller |
2026-02-26 19:16:38.206034 | controller | TASK [libvirt_manager : Patch the layout if needed] ****************************
2026-02-26 19:16:38.273879 | controller | Thursday 26 February 2026  19:16:38 +0000 (0:00:00.081)       0:00:02.665 *****
2026-02-26 19:16:38.273916 | controller | skipping: [instance]
2026-02-26 19:16:38.274098 | controller |
2026-02-26 19:16:38.274120 | controller | TASK [reproducer : Assert no conflicting parameters were passed] ***************
2026-02-26 19:16:38.300850 | controller | Thursday 26 February 2026  19:16:38 +0000 (0:00:00.067)       0:00:02.733 *****
2026-02-26 19:16:38.300879 | controller | ok: [instance]
2026-02-26 19:16:38.324193 | controller |
2026-02-26 19:16:38.324216 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] ***
2026-02-26 19:16:38.324224 | controller | Thursday 26 February 2026  19:16:38 +0000 (0:00:00.027)       0:00:02.760 *****
2026-02-26 19:16:38.324234 | controller | ok: [instance] => changed=false
2026-02-26 19:16:38.324321 | controller |   msg: All assertions passed
2026-02-26 19:16:38.324425 | controller |
2026-02-26 19:16:38.324536 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************
2026-02-26 19:16:38.324642 | controller | Thursday 26 February 2026  19:16:38 +0000 (0:00:00.023)       0:00:02.784 *****
2026-02-26 19:16:38.366355 | controller | ok: [instance]
2026-02-26 19:16:38.366452 | controller |
2026-02-26 19:16:38.366597 | controller | TASK [reproducer : Ensure directories are present] *****************************
2026-02-26 19:16:38.366681 | controller | Thursday 26 February 2026  19:16:38 +0000 (0:00:00.041)       0:00:02.826 *****
2026-02-26 19:16:38.827836 | controller | ok: [instance] => (item=artifacts)
2026-02-26 19:16:38.827888 | controller | ok: [instance] => (item=logs)
2026-02-26 19:16:38.827899 | controller |
2026-02-26 19:16:38.828101 | controller | TASK [Bootstrap libvirt if needed] *********************************************
2026-02-26 19:16:38.902838 | controller | Thursday 26 February 2026  19:16:38 +0000 (0:00:00.461)       0:00:03.287 *****
2026-02-26 19:16:38.902875 | controller |
2026-02-26 19:16:39.084608 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************
2026-02-26 19:16:39.084640 | controller | Thursday 26 February 2026  19:16:38 +0000 (0:00:00.075)       0:00:03.362 *****
2026-02-26 19:16:39.084652 | controller | ok: [instance]
2026-02-26 19:16:39.363637 | controller |
2026-02-26 19:16:39.363667 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] *************
2026-02-26 19:16:39.363702 | controller | Thursday 26 February 2026  19:16:39 +0000 (0:00:00.181)       0:00:03.543 *****
2026-02-26 19:16:39.363713 | controller | changed: [instance]
2026-02-26 19:16:39.641233 | controller |
2026-02-26 19:16:39.641265 | controller | TASK [libvirt_manager : Check if KVM is enabled] *******************************
2026-02-26 19:16:39.641273 | controller | Thursday 26 February 2026  19:16:39 +0000 (0:00:00.278)       0:00:03.822 *****
2026-02-26 19:16:39.641282 | controller | ok: [instance]
2026-02-26 19:16:39.670467 | controller |
2026-02-26 19:16:39.670492 | controller | TASK [libvirt_manager : Fail if KVM not enabled] *******************************
2026-02-26 19:16:39.670500 | controller | Thursday 26 February 2026  19:16:39 +0000 (0:00:00.277)       0:00:04.100 *****
2026-02-26 19:16:39.670510 | controller | skipping: [instance]
2026-02-26 19:16:39.688412 | controller |
2026-02-26 19:16:39.688433 | controller | TASK [libvirt_manager : Check if VMX virtualization] ***************************
2026-02-26 19:16:39.688442 | controller | Thursday 26 February 2026  19:16:39 +0000 (0:00:00.029)       0:00:04.130 *****
2026-02-26 19:16:39.688453 | controller | skipping: [instance]
2026-02-26 19:16:39.709705 | controller |
2026-02-26 19:16:39.709722 | controller | TASK [libvirt_manager : Check if SVM virtualization] ***************************
2026-02-26 19:16:39.709746 | controller | Thursday 26 February 2026  19:16:39 +0000 (0:00:00.017)       0:00:04.147 *****
2026-02-26 19:16:39.709758 | controller | ok: [instance]
2026-02-26 19:16:39.737444 | controller |
2026-02-26 19:16:39.737466 | controller | TASK [libvirt_manager : Enable VMX virtualization] *****************************
2026-02-26 19:16:39.737481 | controller | Thursday 26 February 2026  19:16:39 +0000 (0:00:00.021)       0:00:04.169 *****
2026-02-26 19:16:39.737493 | controller | skipping: [instance]
2026-02-26 19:16:50.124774 | controller |
2026-02-26 19:16:50.124807 | controller | TASK [libvirt_manager : Install packages required for using KVM] ***************
2026-02-26 19:16:50.124816 | controller | Thursday 26 February 2026  19:16:39 +0000 (0:00:00.027)       0:00:04.196 *****
2026-02-26 19:16:50.124826 | controller | changed: [instance]
2026-02-26 19:16:50.334190 | controller |
2026-02-26 19:16:50.334223 | controller | TASK [libvirt_manager : Create rules.d polkit folder] **************************
2026-02-26 19:16:50.334231 | controller | Thursday 26 February 2026  19:16:50 +0000 (0:00:10.387)       0:00:14.583 *****
2026-02-26 19:16:50.334242 | controller | changed: [instance]
2026-02-26 19:16:50.822450 | controller |
2026-02-26 19:16:50.822482 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] *********************
2026-02-26 19:16:50.822490 | controller | Thursday 26 February 2026  19:16:50 +0000 (0:00:00.209)       0:00:14.793 *****
2026-02-26 19:16:50.822501 | controller | changed: [instance]
2026-02-26 19:16:51.403810 | controller |
2026-02-26 19:16:51.403841 | controller | TASK [libvirt_manager : Restart service polkit service] ************************
2026-02-26 19:16:51.403849 | controller | Thursday 26 February 2026  19:16:50 +0000 (0:00:00.488)       0:00:15.281 *****
2026-02-26 19:16:51.403859 | controller | changed: [instance]
2026-02-26 19:16:51.598851 | controller |
2026-02-26 19:16:51.598887 | controller | TASK [libvirt_manager : Remove directory for service override] *****************
2026-02-26 19:16:51.598895 | controller | Thursday 26 February 2026  19:16:51 +0000 (0:00:00.581)       0:00:15.863 *****
2026-02-26 19:16:51.598906 | controller | ok: [instance]
2026-02-26 19:16:52.251541 | controller |
2026-02-26 19:16:52.251570 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] ***
2026-02-26 19:16:52.251578 | controller | Thursday 26 February 2026  19:16:51 +0000 (0:00:00.194)       0:00:16.058 *****
2026-02-26 19:16:52.251588 | controller | ok: [instance]
2026-02-26 19:16:52.992236 | controller |
2026-02-26 19:16:52.992269 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************
2026-02-26 19:16:52.992287 | controller | Thursday 26 February 2026  19:16:52 +0000 (0:00:00.652)       0:00:16.710 *****
2026-02-26 19:16:52.992298 | controller | changed: [instance]
2026-02-26 19:16:53.076885 | controller |
2026-02-26 19:16:53.076928 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] ****
2026-02-26 19:16:53.076938 | controller | Thursday 26 February 2026  19:16:52 +0000 (0:00:00.740)       0:00:17.451 *****
2026-02-26 19:16:53.076951 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu)
2026-02-26 19:16:53.076981 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface)
2026-02-26 19:16:53.076989 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network)
2026-02-26 19:16:53.076998 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev)
2026-02-26 19:16:53.077023 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter)
2026-02-26 19:16:53.077578 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret)
2026-02-26 19:16:53.398832 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage)
2026-02-26 19:16:53.398866 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy)
2026-02-26 19:16:53.398875 | controller |
2026-02-26 19:16:53.398884 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] *********
2026-02-26 19:16:53.398891 | controller | Thursday 26 February 2026  19:16:53 +0000 (0:00:00.084)       0:00:17.536 *****
2026-02-26 19:16:53.398902 | controller | ok: [instance]
2026-02-26 19:16:53.719368 | controller |
2026-02-26 19:16:53.719398 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] **********
2026-02-26 19:16:53.719406 | controller | Thursday 26 February 2026  19:16:53 +0000 (0:00:00.322)       0:00:17.858 *****
2026-02-26 19:16:53.719416 | controller | ok: [instance]
2026-02-26 19:16:54.040251 | controller |
2026-02-26 19:16:54.040281 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] **************
2026-02-26 19:16:54.040289 | controller | Thursday 26 February 2026  19:16:53 +0000 (0:00:00.320)       0:00:18.178 *****
2026-02-26 19:16:54.040300 | controller | ok: [instance]
2026-02-26 19:16:54.357816 | controller |
2026-02-26 19:16:54.357846 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] ****
2026-02-26 19:16:54.357854 | controller | Thursday 26 February 2026  19:16:54 +0000 (0:00:00.320)       0:00:18.499 *****
2026-02-26 19:16:54.357864 | controller | ok: [instance]
2026-02-26 19:16:54.357885 | controller |
2026-02-26 19:16:54.357893 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] *****
2026-02-26 19:16:54.358033 | controller | Thursday 26 February 2026  19:16:54 +0000 (0:00:00.317)       0:00:18.817 *****
2026-02-26 19:16:54.672878 | controller | ok: [instance]
2026-02-26 19:16:54.673131 | controller |
2026-02-26 19:16:54.673164 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] *********
2026-02-26 19:16:54.989672 | controller | Thursday 26 February 2026  19:16:54 +0000 (0:00:00.314)       0:00:19.132 *****
2026-02-26 19:16:54.989721 | controller | ok: [instance]
2026-02-26 19:16:55.306844 | controller |
2026-02-26 19:16:55.306878 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ******
2026-02-26 19:16:55.306887 | controller | Thursday 26 February 2026  19:16:54 +0000 (0:00:00.316)       0:00:19.448 *****
2026-02-26 19:16:55.306907 | controller | ok: [instance]
2026-02-26 19:16:55.307117 | controller |
2026-02-26 19:16:55.307152 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] *******
2026-02-26 19:16:55.626827 | controller | Thursday 26 February 2026  19:16:55 +0000 (0:00:00.317)       0:00:19.766 *****
2026-02-26 19:16:55.626880 | controller | ok: [instance]
2026-02-26 19:16:55.949133 | controller |
2026-02-26 19:16:55.949164 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] ***********
2026-02-26 19:16:55.949172 | controller | Thursday 26 February 2026  19:16:55 +0000 (0:00:00.319)       0:00:20.086 *****
2026-02-26 19:16:55.949182 | controller | ok: [instance]
2026-02-26 19:16:56.265830 | controller |
2026-02-26 19:16:56.265863 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ******
2026-02-26 19:16:56.265872 | controller | Thursday 26 February 2026  19:16:55 +0000 (0:00:00.322)       0:00:20.408 *****
2026-02-26 19:16:56.265884 | controller | ok: [instance]
2026-02-26 19:16:56.265912 | controller |
2026-02-26 19:16:56.266064 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] *******
2026-02-26 19:16:56.583355 | controller | Thursday 26 February 2026  19:16:56 +0000 (0:00:00.317)       0:00:20.725 *****
2026-02-26 19:16:56.583391 | controller | ok: [instance]
2026-02-26 19:16:56.901364 | controller |
2026-02-26 19:16:56.901393 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] ***********
2026-02-26 19:16:56.901402 | controller | Thursday 26 February 2026  19:16:56 +0000 (0:00:00.317)       0:00:21.042 *****
2026-02-26 19:16:56.901411 | controller | ok: [instance]
2026-02-26 19:16:57.219814 | controller |
2026-02-26 19:16:57.219856 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] *****
2026-02-26 19:16:57.219866 | controller | Thursday 26 February 2026  19:16:56 +0000 (0:00:00.317)       0:00:21.360 *****
2026-02-26 19:16:57.219878 | controller | ok: [instance]
2026-02-26 19:16:57.219944 | controller |
2026-02-26 19:16:57.219953 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ******
2026-02-26 19:16:57.219960 | controller | Thursday 26 February 2026  19:16:57 +0000 (0:00:00.318)       0:00:21.679 *****
2026-02-26 19:16:57.538850 | controller | ok: [instance]
2026-02-26 19:16:57.538904 | controller |
2026-02-26 19:16:57.539211 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] **********
2026-02-26 19:16:57.860454 | controller | Thursday 26 February 2026  19:16:57 +0000 (0:00:00.319)       0:00:21.998 *****
2026-02-26 19:16:57.860488 | controller | ok: [instance]
2026-02-26 19:16:58.183866 | controller |
2026-02-26 19:16:58.183898 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] *******
2026-02-26 19:16:58.183907 | controller | Thursday 26 February 2026  19:16:57 +0000 (0:00:00.321)       0:00:22.319 *****
2026-02-26 19:16:58.183918 | controller | ok: [instance]
2026-02-26 19:16:58.499340 | controller |
2026-02-26 19:16:58.499374 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ********
2026-02-26 19:16:58.499383 | controller | Thursday 26 February 2026  19:16:58 +0000 (0:00:00.323)       0:00:22.643 *****
2026-02-26 19:16:58.499393 | controller | ok: [instance]
2026-02-26 19:16:58.820756 | controller |
2026-02-26 19:16:58.820783 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************
2026-02-26 19:16:58.820793 | controller | Thursday 26 February 2026  19:16:58 +0000 (0:00:00.315)       0:00:22.958 *****
2026-02-26 19:16:58.820805 | controller | ok: [instance]
2026-02-26 19:16:59.134820 | controller |
2026-02-26 19:16:59.134856 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ******
2026-02-26 19:16:59.134864 | controller | Thursday 26 February 2026  19:16:58 +0000 (0:00:00.321)       0:00:23.280 *****
2026-02-26 19:16:59.134875 | controller | ok: [instance]
2026-02-26 19:16:59.134908 | controller |
2026-02-26 19:16:59.135078 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] *******
2026-02-26 19:16:59.453720 | controller | Thursday 26 February 2026  19:16:59 +0000 (0:00:00.314)       0:00:23.594 *****
2026-02-26 19:16:59.453765 | controller | ok: [instance]
2026-02-26 19:16:59.767333 | controller |
2026-02-26 19:16:59.767364 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] ***********
2026-02-26 19:16:59.767372 | controller | Thursday 26 February 2026  19:16:59 +0000 (0:00:00.318)       0:00:23.913 *****
2026-02-26 19:16:59.767382 | controller | ok: [instance]
2026-02-26 19:17:00.087188 | controller |
2026-02-26 19:17:00.087212 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ********
2026-02-26 19:17:00.087220 | controller | Thursday 26 February 2026  19:16:59 +0000 (0:00:00.313)       0:00:24.226 *****
2026-02-26 19:17:00.087236 | controller | ok: [instance]
2026-02-26 19:17:00.409826 | controller |
2026-02-26 19:17:00.409858 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] *********
2026-02-26 19:17:00.409874 | controller | Thursday 26 February 2026  19:17:00 +0000 (0:00:00.319)       0:00:24.546 *****
2026-02-26 19:17:00.409886 | controller | ok: [instance]
2026-02-26 19:17:00.729112 | controller |
2026-02-26 19:17:00.729143 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] *************
2026-02-26 19:17:00.729151 | controller | Thursday 26 February 2026  19:17:00 +0000 (0:00:00.322)       0:00:24.869 *****
2026-02-26 19:17:00.729161 | controller | ok: [instance]
2026-02-26 19:17:00.748468 | controller |
2026-02-26 19:17:00.748486 | controller | TASK [libvirt_manager : Manage service for older releases] *********************
2026-02-26 19:17:00.748493 | controller | Thursday 26 February 2026  19:17:00 +0000 (0:00:00.319)       0:00:25.188 *****
2026-02-26 19:17:00.748502 | controller | skipping: [instance]
2026-02-26 19:17:01.029421 | controller |
2026-02-26 19:17:01.029441 | controller | TASK [libvirt_manager : Get libvirt group users] *******************************
2026-02-26 19:17:01.029448 | controller | Thursday 26 February 2026  19:17:00 +0000 (0:00:00.019)       0:00:25.208 *****
2026-02-26 19:17:01.029457 | controller | ok: [instance]
2026-02-26 19:17:01.406257 | controller |
2026-02-26 19:17:01.406276 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] ***************
2026-02-26 19:17:01.406284 | controller | Thursday 26 February 2026  19:17:01 +0000 (0:00:00.280)       0:00:25.488 *****
2026-02-26 19:17:01.406293 | controller | ok: [instance]
2026-02-26 19:17:01.713802 | controller |
2026-02-26 19:17:01.713839 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] ***
2026-02-26 19:17:01.713846 | controller | Thursday 26 February 2026  19:17:01 +0000 (0:00:00.377)       0:00:25.865 *****
2026-02-26 19:17:01.713856 | controller | changed: [instance]
2026-02-26 19:17:02.003626 | controller |
2026-02-26 19:17:02.003658 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] *********
2026-02-26 19:17:02.003666 | controller | Thursday 26 February 2026  19:17:01 +0000 (0:00:00.307)       0:00:26.172 *****
2026-02-26 19:17:02.003676 | controller | [WARNING]: Reset is not implemented for this connection
2026-02-26 19:17:02.013881 | controller | changed: [instance]
2026-02-26 19:17:02.101897 | controller |
2026-02-26 19:17:02.101945 | controller | TASK [libvirt_manager : Ensure we reload user env] *****************************
2026-02-26 19:17:02.101953 | controller | Thursday 26 February 2026  19:17:01 +0000 (0:00:00.283)       0:00:26.456 *****
2026-02-26 19:17:02.101959 | controller |
2026-02-26 19:17:02.101965 | controller | TASK [reproducer : Deploy networks in libvirt] *********************************
2026-02-26 19:17:02.101970 | controller | Thursday 26 February 2026  19:17:02 +0000 (0:00:00.016)       0:00:26.473 *****
2026-02-26 19:17:02.101981 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance
2026-02-26 19:17:02.102006 | controller |
2026-02-26 19:17:02.102015 | controller | TASK [reproducer : Ensure networks are consistent] *****************************
2026-02-26 19:17:02.142883 | controller | Thursday 26 February 2026  19:17:02 +0000 (0:00:00.088)       0:00:26.561 *****
2026-02-26 19:17:02.142929 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance
2026-02-26 19:17:02.142986 | controller |
2026-02-26 19:17:02.143105 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-02-26 19:17:02.143217 | controller | Thursday 26 February 2026  19:17:02 +0000 (0:00:00.041)       0:00:26.602 *****
2026-02-26 19:17:02.192398 | controller | ok: [instance] => (item=compute)
2026-02-26 19:17:02.192508 | controller | ok: [instance] => (item=controller)
2026-02-26 19:17:02.192618 | controller | ok: [instance] => (item=crc)
2026-02-26 19:17:02.192741 | controller |
2026-02-26 19:17:02.192877 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-02-26 19:17:02.192988 | controller | Thursday 26 February 2026  19:17:02 +0000 (0:00:00.049)       0:00:26.652 *****
2026-02-26 19:17:02.234761 | controller | ok: [instance]
2026-02-26 19:17:02.234915 | controller |
2026-02-26 19:17:02.235067 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2026-02-26 19:17:02.235199 | controller | Thursday 26 February 2026  19:17:02 +0000 (0:00:00.042)       0:00:26.694 *****
2026-02-26 19:17:02.276923 | controller | ok: [instance] => changed=false
2026-02-26 19:17:02.277041 | controller |   msg: All assertions passed
2026-02-26 19:17:02.277153 | controller |
2026-02-26 19:17:02.277269 | controller | TASK [Ensure we get latest OCP config] *****************************************
2026-02-26 19:17:02.277381 | controller | Thursday 26 February 2026  19:17:02 +0000 (0:00:00.042)       0:00:26.736 *****
2026-02-26 19:17:02.318762 | controller |
2026-02-26 19:17:02.318907 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] *****
2026-02-26 19:17:02.319039 | controller | Thursday 26 February 2026  19:17:02 +0000 (0:00:00.041)       0:00:26.778 *****
2026-02-26 19:17:02.399535 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.49', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'})
2026-02-26 19:17:02.399656 | controller | ok: [instance] => (item={})
2026-02-26 19:17:02.399802 | controller |
2026-02-26 19:17:02.399920 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] ****************
2026-02-26 19:17:02.400029 | controller | Thursday 26 February 2026  19:17:02 +0000 (0:00:00.080)       0:00:26.859 *****
2026-02-26 19:17:02.417536 | controller | skipping: [instance]
2026-02-26 19:17:02.417647 | controller |
2026-02-26 19:17:02.417815 | controller | TASK [devscripts : Ensure output directory exists] *****************************
2026-02-26 19:17:02.417960 | controller | Thursday 26 February 2026  19:17:02 +0000 (0:00:00.018)       0:00:26.877 *****
2026-02-26 19:17:02.631302 | controller | ok: [instance]
2026-02-26 19:17:02.972668 | controller |
2026-02-26 19:17:02.972722 | controller | TASK [devscripts : Output built config for easier debugging] *******************
2026-02-26 19:17:02.972762 | controller | Thursday 26 February 2026  19:17:02 +0000 (0:00:00.213)       0:00:27.090 *****
2026-02-26 19:17:02.972776 | controller | changed: [instance]
2026-02-26 19:17:03.704811 | controller |
2026-02-26 19:17:03.704839 | controller | TASK [ci_network : Remove the local dns configuration] *************************
2026-02-26 19:17:03.704847 | controller | Thursday 26 February 2026  19:17:02 +0000 (0:00:00.341)       0:00:27.431 *****
2026-02-26 19:17:03.704857 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf)
2026-02-26 19:17:03.705169 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf)
2026-02-26 19:17:03.705202 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf)
2026-02-26 19:17:03.705211 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf)
2026-02-26 19:17:03.705223 | controller |
2026-02-26 19:17:03.730476 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] **************
2026-02-26 19:17:03.730494 | controller | Thursday 26 February 2026  19:17:03 +0000 (0:00:00.732)       0:00:28.163 *****
2026-02-26 19:17:03.730505 | controller | skipping: [instance]
2026-02-26 19:17:04.093857 | controller |
2026-02-26 19:17:04.093889 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] *********
2026-02-26 19:17:04.093899 | controller | Thursday 26 February 2026  19:17:03 +0000 (0:00:00.025)       0:00:28.189 *****
2026-02-26 19:17:04.093911 | controller | changed: [instance]
2026-02-26 19:17:04.515794 | controller |
2026-02-26 19:17:04.515825 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ******************
2026-02-26 19:17:04.515833 | controller | Thursday 26 February 2026  19:17:04 +0000 (0:00:00.353)       0:00:28.543 *****
2026-02-26 19:17:04.515839 | controller |
2026-02-26 19:17:04.515844 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-02-26 19:17:04.515849 | controller | Thursday 26 February 2026  19:17:04 +0000 (0:00:00.008)       0:00:28.552 *****
2026-02-26 19:17:04.515866 | controller | changed: [instance]
2026-02-26 19:17:04.515894 | controller |
2026-02-26 19:17:04.515902 | controller | TASK [Ensure no default networks exists] ***************************************
2026-02-26 19:17:04.590798 | controller | Thursday 26 February 2026  19:17:04 +0000 (0:00:00.422)       0:00:28.975 *****
2026-02-26 19:17:04.590834 | controller |
2026-02-26 19:17:04.590902 | controller | TASK [libvirt_manager : Deactivate crc] ****************************************
2026-02-26 19:17:04.591010 | controller | Thursday 26 February 2026  19:17:04 +0000 (0:00:00.075)       0:00:29.050 *****
2026-02-26 19:17:05.733862 | controller | ok: [instance]
2026-02-26 19:17:05.733915 | controller |
2026-02-26 19:17:05.733925 | controller | TASK [libvirt_manager : Removing crc] ******************************************
2026-02-26 19:17:05.733935 | controller | Thursday 26 February 2026  19:17:05 +0000 (0:00:01.142)       0:00:30.193 *****
2026-02-26 19:17:05.971329 | controller | ok: [instance]
2026-02-26 19:17:06.474381 | controller |
2026-02-26 19:17:06.474416 | controller | TASK [libvirt_manager : Deactivate default] ************************************
2026-02-26 19:17:06.474426 | controller | Thursday 26 February 2026  19:17:05 +0000 (0:00:00.237)       0:00:30.430 *****
2026-02-26 19:17:06.474438 | controller | ok: [instance]
2026-02-26 19:17:06.698263 | controller |
2026-02-26 19:17:06.698293 | controller | TASK [libvirt_manager : Removing default] **************************************
2026-02-26 19:17:06.698300 | controller | Thursday 26 February 2026  19:17:06 +0000 (0:00:00.502)       0:00:30.933 *****
2026-02-26 19:17:06.698310 | controller | ok: [instance]
2026-02-26 19:17:07.920401 | controller |
2026-02-26 19:17:07.920432 | controller | TASK [reproducer : Ensure firewalld is installed] ******************************
2026-02-26 19:17:07.920439 | controller | Thursday 26 February 2026  19:17:06 +0000 (0:00:00.224)       0:00:31.157 *****
2026-02-26 19:17:07.920449 | controller | ok: [instance]
2026-02-26 19:17:08.252360 | controller |
2026-02-26 19:17:08.252385 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************
2026-02-26 19:17:08.252393 | controller | Thursday 26 February 2026  19:17:07 +0000 (0:00:01.222)       0:00:32.379 *****
2026-02-26 19:17:08.252408 | controller | ok: [instance]
2026-02-26 19:17:08.534404 | controller |
2026-02-26 19:17:08.534434 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] ***********************
2026-02-26 19:17:08.534442 | controller | Thursday 26 February 2026  19:17:08 +0000 (0:00:00.332)       0:00:32.711 *****
2026-02-26 19:17:08.534452 | controller | changed: [instance]
2026-02-26 19:17:08.813858 | controller |
2026-02-26 19:17:08.813899 | controller | TASK [reproducer : Ensure IP forwarding is enabled] ****************************
2026-02-26 19:17:08.813909 | controller | Thursday 26 February 2026  19:17:08 +0000 (0:00:00.281)       0:00:32.993 *****
2026-02-26 19:17:08.813921 | controller | changed: [instance]
2026-02-26 19:17:09.365798 | controller |
2026-02-26 19:17:09.365826 | controller | TASK [reproducer : Ensure the required parameters are loaded] ******************
2026-02-26 19:17:09.365834 | controller | Thursday 26 February 2026  19:17:08 +0000 (0:00:00.279)       0:00:33.273 *****
2026-02-26 19:17:09.365845 | controller | changed: [instance] => (item=arptables)
2026-02-26 19:17:09.366181 | controller | changed: [instance] => (item=iptables)
2026-02-26 19:17:09.366214 | controller | changed: [instance] => (item=ip6tables)
2026-02-26 19:17:09.676749 | controller |
2026-02-26 19:17:09.676776 | controller | TASK [reproducer : Ensure firewall service is enabled and started] *************
2026-02-26 19:17:09.676784 | controller | Thursday 26 February 2026  19:17:09 +0000 (0:00:00.552)       0:00:33.825 *****
2026-02-26 19:17:09.676794 | controller | ok: [instance]
2026-02-26 19:17:09.767585 | controller |
2026-02-26 19:17:09.767617 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] *************
2026-02-26 19:17:09.767631 | controller | Thursday 26 February 2026  19:17:09 +0000 (0:00:00.310)       0:00:34.136 *****
2026-02-26 19:17:09.767646 | controller | ok: [instance]
2026-02-26 19:17:09.809207 | controller |
2026-02-26 19:17:09.809239 | controller | TASK [Ensure the required network configurations are applied] ******************
2026-02-26 19:17:09.809252 | controller | Thursday 26 February 2026  19:17:09 +0000 (0:00:00.090)       0:00:34.226 *****
2026-02-26 19:17:09.809267 | controller |
2026-02-26 19:17:09.829855 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] ***
2026-02-26 19:17:09.829919 | controller | Thursday 26 February 2026  19:17:09 +0000 (0:00:00.041)       0:00:34.268 *****
2026-02-26 19:17:09.829936 | controller | skipping: [instance]
2026-02-26 19:17:09.829983 | controller |
2026-02-26 19:17:09.829994 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ******
2026-02-26 19:17:09.850647 | controller | Thursday 26 February 2026  19:17:09 +0000 (0:00:00.020)       0:00:34.289 *****
2026-02-26 19:17:09.850675 | controller | skipping: [instance]
2026-02-26 19:17:09.871770 | controller |
2026-02-26 19:17:09.871792 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-02-26 19:17:09.871801 | controller | Thursday 26 February 2026  19:17:09 +0000 (0:00:00.020)       0:00:34.309 *****
2026-02-26 19:17:09.871811 | controller | skipping: [instance]
2026-02-26 19:17:09.896881 | controller |
2026-02-26 19:17:09.896906 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ******
2026-02-26 19:17:09.896915 | controller | Thursday 26 February 2026  19:17:09 +0000 (0:00:00.021)       0:00:34.331 *****
2026-02-26 19:17:09.896925 | controller | skipping: [instance]
2026-02-26 19:17:09.897063 | controller |
2026-02-26 19:17:09.897198 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] **********************
2026-02-26 19:17:09.897327 | controller | Thursday 26 February 2026  19:17:09 +0000 (0:00:00.025)       0:00:34.356 *****
2026-02-26 19:17:09.933088 | controller | ok: [instance]
2026-02-26 19:17:09.933262 | controller |
2026-02-26 19:17:09.933427 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] ***
2026-02-26 19:17:09.933582 | controller | Thursday 26 February 2026  19:17:09 +0000 (0:00:00.036)       0:00:34.392 *****
2026-02-26 19:17:09.967596 | controller | skipping: [instance]
2026-02-26 19:17:09.967819 | controller |
2026-02-26 19:17:09.968000 | controller | TASK [ci_nmstate : Get k8s nodes] **********************************************
2026-02-26 19:17:09.968139 | controller | Thursday 26 February 2026  19:17:09 +0000 (0:00:00.034)       0:00:34.427 *****
2026-02-26 19:17:09.988671 | controller | skipping: [instance]
2026-02-26 19:17:09.988919 | controller |
2026-02-26 19:17:09.989090 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ********
2026-02-26 19:17:09.989232 | controller | Thursday 26 February 2026  19:17:09 +0000 (0:00:00.020)       0:00:34.448 *****
2026-02-26 19:17:10.042389 | controller | ok: [instance]
2026-02-26 19:17:10.042576 | controller |
2026-02-26 19:17:10.042790 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] *************************
2026-02-26 19:17:10.042957 | controller | Thursday 26 February 2026  19:17:10 +0000 (0:00:00.053)       0:00:34.502 *****
2026-02-26 19:17:10.062940 | controller | skipping: [instance]
2026-02-26 19:17:10.063114 | controller |
2026-02-26 19:17:10.063276 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] *********************
2026-02-26 19:17:10.063407 | controller | Thursday 26 February 2026  19:17:10 +0000 (0:00:00.020)       0:00:34.522 *****
2026-02-26 19:17:10.108253 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost)
2026-02-26 19:17:10.108413 | controller |
2026-02-26 19:17:10.108577 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2026-02-26 19:17:10.108772 | controller | Thursday 26 February 2026  19:17:10 +0000 (0:00:00.045)       0:00:34.568 *****
2026-02-26 19:17:10.428589 | controller | ok: [instance -> localhost]
2026-02-26 19:17:15.549616 | controller |
2026-02-26 19:17:15.549651 | controller | TASK [ci_nmstate : Install required packages on localhost] *********************
2026-02-26 19:17:15.549659 | controller | Thursday 26 February 2026  19:17:10 +0000 (0:00:00.319)       0:00:34.887 *****
2026-02-26 19:17:15.549669 | controller | changed: [instance -> localhost]
2026-02-26 19:17:15.753900 | controller |
2026-02-26 19:17:15.753987 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2026-02-26 19:17:15.753998 | controller | Thursday 26 February 2026  19:17:15 +0000 (0:00:05.120)       0:00:40.008 *****
2026-02-26 19:17:15.754017 | controller | changed: [instance]
2026-02-26 19:17:16.126938 | controller |
2026-02-26 19:17:16.126992 | controller | TASK [ci_nmstate : Save nmstate state for localhost] ***************************
2026-02-26 19:17:16.127002 | controller | Thursday 26 February 2026  19:17:15 +0000 (0:00:00.204)       0:00:40.213 *****
2026-02-26 19:17:16.127033 | controller | changed: [instance]
2026-02-26 19:17:17.764628 | controller |
2026-02-26 19:17:17.764660 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] *********************
2026-02-26 19:17:17.764668 | controller | Thursday 26 February 2026  19:17:16 +0000 (0:00:00.372)       0:00:40.586 *****
2026-02-26 19:17:17.764678 | controller | changed: [instance -> localhost]
2026-02-26 19:17:18.127313 | controller |
2026-02-26 19:17:18.127344 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ******************
2026-02-26 19:17:18.127352 | controller | Thursday 26 February 2026  19:17:17 +0000 (0:00:01.637)       0:00:42.223 *****
2026-02-26 19:17:18.127362 | controller | changed: [instance]
2026-02-26 19:17:18.159630 | controller |
2026-02-26 19:17:18.159647 | controller | TASK [reproducer : Select right domain] ****************************************
2026-02-26 19:17:18.159654 | controller | Thursday 26 February 2026  19:17:18 +0000 (0:00:00.362)       0:00:42.586 *****
2026-02-26 19:17:18.159662 | controller | ok: [instance]
2026-02-26 19:17:18.298780 | controller |
2026-02-26 19:17:18.298810 | controller | TASK [Create the virtual networks] *********************************************
2026-02-26 19:17:18.298819 | controller | Thursday 26 February 2026  19:17:18 +0000 (0:00:00.032)       0:00:42.619 *****
2026-02-26 19:17:18.298829 | controller |
2026-02-26 19:17:18.319105 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ********************
2026-02-26 19:17:18.319123 | controller | Thursday 26 February 2026  19:17:18 +0000 (0:00:00.139)       0:00:42.758 *****
2026-02-26 19:17:18.319134 | controller | ok: [instance]
2026-02-26 19:17:18.538349 | controller |
2026-02-26 19:17:18.538383 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] *******
2026-02-26 19:17:18.538390 | controller | Thursday 26 February 2026  19:17:18 +0000 (0:00:00.020)       0:00:42.778 *****
2026-02-26 19:17:18.538400 | controller | ok: [instance]
2026-02-26 19:17:18.568370 | controller |
2026-02-26 19:17:18.568389 | controller | TASK [libvirt_manager : Load file if exists] ***********************************
2026-02-26 19:17:18.568396 | controller | Thursday 26 February 2026  19:17:18 +0000 (0:00:00.219)       0:00:42.997 *****
2026-02-26 19:17:18.568404 | controller | skipping: [instance]
2026-02-26 19:17:18.598198 | controller |
2026-02-26 19:17:18.598219 | controller | TASK [libvirt_manager : Update fact with existing content] *********************
2026-02-26 19:17:18.598228 | controller | Thursday 26 February 2026  19:17:18 +0000 (0:00:00.030)       0:00:43.027 *****
2026-02-26 19:17:18.598239 | controller | skipping: [instance]
2026-02-26 19:17:18.656162 | controller |
2026-02-26 19:17:18.656185 | controller | TASK [libvirt_manager : Generate VM list] **************************************
2026-02-26 19:17:18.656194 | controller | Thursday 26 February 2026  19:17:18 +0000 (0:00:00.029)       0:00:43.057 *****
2026-02-26 19:17:18.656205 | controller | ok: [instance]
2026-02-26 19:17:18.656372 | controller |
2026-02-26 19:17:18.656532 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] *********************
2026-02-26 19:17:18.656659 | controller | Thursday 26 February 2026  19:17:18 +0000 (0:00:00.058)       0:00:43.115 *****
2026-02-26 19:17:18.783854 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'})
2026-02-26 19:17:18.784052 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'})
2026-02-26 19:17:18.784217 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'})
2026-02-26 19:17:18.784364 | controller |
2026-02-26 19:17:18.784517 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] **********************
2026-02-26 19:17:18.784671 | controller | Thursday 26 February 2026  19:17:18 +0000 (0:00:00.127)       0:00:43.243 *****
2026-02-26 19:17:18.820134 | controller | skipping: [instance]
2026-02-26 19:17:18.820310 | controller |
2026-02-26 19:17:18.820474 | controller | TASK [libvirt_manager : Dump MAC mapping] **************************************
2026-02-26 19:17:18.820632 | controller | Thursday 26 February 2026  19:17:18 +0000 (0:00:00.036)       0:00:43.279 *****
2026-02-26 19:17:19.185873 | controller | changed: [instance]
2026-02-26 19:17:19.278888 | controller |
2026-02-26 19:17:19.278964 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] ***********************
2026-02-26 19:17:19.278974 | controller | Thursday 26 February 2026  19:17:19 +0000 (0:00:00.365)       0:00:43.645 *****
2026-02-26 19:17:19.279035 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes)
2026-02-26 19:17:19.332508 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers)
2026-02-26 19:17:19.332538 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps)
2026-02-26 19:17:19.332548 | controller |
2026-02-26 19:17:19.332556 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-02-26 19:17:19.332563 | controller | Thursday 26 February 2026  19:17:19 +0000 (0:00:00.091)       0:00:43.736 *****
2026-02-26 19:17:19.332574 | controller | changed: [instance]
2026-02-26 19:17:19.661873 | controller |
2026-02-26 19:17:19.661913 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-02-26 19:17:19.661923 | controller | Thursday 26 February 2026  19:17:19 +0000 (0:00:00.054)       0:00:43.791 *****
2026-02-26 19:17:19.661935 | controller | changed: [instance]
2026-02-26 19:17:19.661965 | controller |
2026-02-26 19:17:19.662116 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-02-26 19:17:19.662148 | controller | Thursday 26 February 2026  19:17:19 +0000 (0:00:00.329)       0:00:44.121 *****
2026-02-26 19:17:19.899263 | controller | changed: [instance]
2026-02-26 19:17:19.955571 | controller |
2026-02-26 19:17:19.955593 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-02-26 19:17:19.955603 | controller | Thursday 26 February 2026  19:17:19 +0000 (0:00:00.237)       0:00:44.358 *****
2026-02-26 19:17:19.955613 | controller | changed: [instance]
2026-02-26 19:17:20.173846 | controller |
2026-02-26 19:17:20.173899 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-02-26 19:17:20.173909 | controller | Thursday 26 February 2026  19:17:19 +0000 (0:00:00.056)       0:00:44.414 *****
2026-02-26 19:17:20.173923 | controller | changed: [instance]
2026-02-26 19:17:20.404543 | controller |
2026-02-26 19:17:20.404563 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-02-26 19:17:20.404571 | controller | Thursday 26 February 2026  19:17:20 +0000 (0:00:00.218)       0:00:44.633 *****
2026-02-26 19:17:20.404580 | controller | changed: [instance]
2026-02-26 19:17:20.458482 | controller |
2026-02-26 19:17:20.458505 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-02-26 19:17:20.458512 | controller | Thursday 26 February 2026  19:17:20 +0000 (0:00:00.230)       0:00:44.864 *****
2026-02-26 19:17:20.458522 | controller | changed: [instance]
2026-02-26 19:17:20.667259 | controller |
2026-02-26 19:17:20.667293 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-02-26 19:17:20.667303 | controller | Thursday 26 February 2026  19:17:20 +0000 (0:00:00.053)       0:00:44.917 *****
2026-02-26 19:17:20.667315 | controller | changed: [instance]
2026-02-26 19:17:20.886608 | controller |
2026-02-26 19:17:20.886636 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-02-26 19:17:20.886643 | controller | Thursday 26 February 2026  19:17:20 +0000 (0:00:00.208)       0:00:45.126 *****
2026-02-26 19:17:20.886653 | controller | changed: [instance]
2026-02-26 19:17:21.086711 | controller |
2026-02-26 19:17:21.086757 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ********************
2026-02-26 19:17:21.086766 | controller | Thursday 26 February 2026  19:17:20 +0000 (0:00:00.219)       0:00:45.345 *****
2026-02-26 19:17:21.086776 | controller | ok: [instance]
2026-02-26 19:17:21.603828 | controller |
2026-02-26 19:17:21.603866 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ******************
2026-02-26 19:17:21.603876 | controller | Thursday 26 February 2026  19:17:21 +0000 (0:00:00.199)       0:00:45.545 *****
2026-02-26 19:17:21.603888 | controller | changed: [instance]
2026-02-26 19:17:21.604244 | controller |
2026-02-26 19:17:21.790305 | controller | TASK [libvirt_manager : Remove ini file after conversion] **********************
2026-02-26 19:17:21.790337 | controller | Thursday 26 February 2026  19:17:21 +0000 (0:00:00.517)       0:00:46.063 *****
2026-02-26 19:17:21.790355 | controller | changed: [instance]
2026-02-26 19:17:21.814467 | controller |
2026-02-26 19:17:21.814489 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-02-26 19:17:21.814498 | controller | Thursday 26 February 2026  19:17:21 +0000 (0:00:00.186)       0:00:46.249 *****
2026-02-26 19:17:21.814509 | controller | skipping: [instance]
2026-02-26 19:17:21.838535 | controller |
2026-02-26 19:17:21.838555 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-02-26 19:17:21.838571 | controller | Thursday 26 February 2026  19:17:21 +0000 (0:00:00.024)       0:00:46.273 *****
2026-02-26 19:17:21.838581 | controller | skipping: [instance]
2026-02-26 19:17:21.863282 | controller |
2026-02-26 19:17:21.863305 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-02-26 19:17:21.863314 | controller | Thursday 26 February 2026  19:17:21 +0000 (0:00:00.024)       0:00:46.298 *****
2026-02-26 19:17:21.863324 | controller | skipping: [instance]
2026-02-26 19:17:21.886853 | controller |
2026-02-26 19:17:21.886891 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-02-26 19:17:21.886902 | controller | Thursday 26 February 2026  19:17:21 +0000 (0:00:00.024)       0:00:46.322 *****
2026-02-26 19:17:21.886915 | controller | skipping: [instance]
2026-02-26 19:17:21.904815 | controller |
2026-02-26 19:17:21.904832 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-02-26 19:17:21.904840 | controller | Thursday 26 February 2026  19:17:21 +0000 (0:00:00.023)       0:00:46.346 *****
2026-02-26 19:17:21.904851 | controller | ok: [instance]
2026-02-26 19:17:21.986877 | controller |
2026-02-26 19:17:21.986915 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-02-26 19:17:21.986924 | controller | Thursday 26 February 2026  19:17:21 +0000 (0:00:00.018)       0:00:46.364 *****
2026-02-26 19:17:21.986941 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2026-02-26 19:17:21.986979 | controller |
2026-02-26 19:17:21.986989 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-02-26 19:17:21.987069 | controller | Thursday 26 February 2026  19:17:21 +0000 (0:00:00.082)       0:00:46.446 *****
2026-02-26 19:17:22.004605 | controller | skipping: [instance]
2026-02-26 19:17:22.004744 | controller |
2026-02-26 19:17:22.004884 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-02-26 19:17:22.005006 | controller | Thursday 26 February 2026  19:17:22 +0000 (0:00:00.018)       0:00:46.464 *****
2026-02-26 19:17:22.212354 | controller | changed: [instance]
2026-02-26 19:17:22.612865 | controller |
2026-02-26 19:17:22.612905 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-02-26 19:17:22.612915 | controller | Thursday 26 February 2026  19:17:22 +0000 (0:00:00.207)       0:00:46.671 *****
2026-02-26 19:17:22.612929 | controller | changed: [instance]
2026-02-26 19:17:22.672781 | controller |
2026-02-26 19:17:22.672821 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-02-26 19:17:22.672831 | controller | Thursday 26 February 2026  19:17:22 +0000 (0:00:00.400)       0:00:47.071 *****
2026-02-26 19:17:22.672844 | controller | ok: [instance]
2026-02-26 19:17:22.705214 | controller |
2026-02-26 19:17:22.705240 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-02-26 19:17:22.705247 | controller | Thursday 26 February 2026  19:17:22 +0000 (0:00:00.060)       0:00:47.132 *****
2026-02-26 19:17:22.705257 | controller | ok: [instance]
2026-02-26 19:17:23.082853 | controller |
2026-02-26 19:17:23.082894 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-02-26 19:17:23.082904 | controller | Thursday 26 February 2026  19:17:22 +0000 (0:00:00.032)       0:00:47.164 *****
2026-02-26 19:17:23.082919 | controller | changed: [instance]
2026-02-26 19:17:23.189969 | controller |
2026-02-26 19:17:23.190026 | controller | TASK [libvirt_manager : Manage networks if needed] *****************************
2026-02-26 19:17:23.190037 | controller | Thursday 26 February 2026  19:17:23 +0000 (0:00:00.377)       0:00:47.542 *****
2026-02-26 19:17:23.190049 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance
2026-02-26 19:17:23.240774 | controller |
2026-02-26 19:17:23.240804 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] ***
2026-02-26 19:17:23.240811 | controller | Thursday 26 February 2026  19:17:23 +0000 (0:00:00.107)       0:00:47.649 *****
2026-02-26 19:17:23.240821 | controller | ok: [instance] => (item=public)
2026-02-26 19:17:23.681617 | controller | ok: [instance] => (item=osp_trunk)
2026-02-26 19:17:23.681648 | controller |
2026-02-26 19:17:23.681656 | controller | TASK [libvirt_manager : Ensure networks are defined] ***************************
2026-02-26 19:17:23.681662 | controller | Thursday 26 February 2026  19:17:23 +0000 (0:00:00.050)       0:00:47.700 *****
2026-02-26 19:17:23.681672 | controller | changed: [instance] => (item=cifmw-public)
2026-02-26 19:17:24.284482 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-02-26 19:17:24.284513 | controller |
2026-02-26 19:17:24.284521 | controller | TASK [libvirt_manager : Ensure networks are created/started] *******************
2026-02-26 19:17:24.284527 | controller | Thursday 26 February 2026  19:17:23 +0000 (0:00:00.440)       0:00:48.140 *****
2026-02-26 19:17:24.284537 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 19:17:24.719499 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 19:17:24.719530 | controller |
2026-02-26 19:17:24.719538 | controller | TASK [libvirt_manager : Ensure networks are active] ****************************
2026-02-26 19:17:24.719545 | controller | Thursday 26 February 2026  19:17:24 +0000 (0:00:00.602)       0:00:48.743 *****
2026-02-26 19:17:24.719554 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 19:17:25.151865 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 19:17:25.151901 | controller |
2026-02-26 19:17:25.151911 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ******************
2026-02-26 19:17:25.151918 | controller | Thursday 26 February 2026  19:17:24 +0000 (0:00:00.435)       0:00:49.178 *****
2026-02-26 19:17:25.151930 | controller | changed: [instance] => (item=cifmw-public)
2026-02-26 19:17:25.151958 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-02-26 19:17:25.151967 | controller |
2026-02-26 19:17:25.152100 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] **********
2026-02-26 19:17:25.152132 | controller | Thursday 26 February 2026  19:17:25 +0000 (0:00:00.432)       0:00:49.611 *****
2026-02-26 19:17:25.211376 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance
2026-02-26 19:17:25.390599 | controller |
2026-02-26 19:17:25.390624 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] ***********************
2026-02-26 19:17:25.390634 | controller | Thursday 26 February 2026  19:17:25 +0000 (0:00:00.059)       0:00:49.670 *****
2026-02-26 19:17:25.390644 | controller | ok: [instance]
2026-02-26 19:17:25.765857 | controller |
2026-02-26 19:17:25.765891 | controller | TASK [libvirt_manager : Fetch bridges ports link info] *************************
2026-02-26 19:17:25.765901 | controller | Thursday 26 February 2026  19:17:25 +0000 (0:00:00.179)       0:00:49.849 *****
2026-02-26 19:17:25.765913 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 19:17:25.765940 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 19:17:25.765950 | controller |
2026-02-26 19:17:25.766141 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************
2026-02-26 19:17:25.834894 | controller | Thursday 26 February 2026  19:17:25 +0000 (0:00:00.375)       0:00:50.225 *****
2026-02-26 19:17:25.834937 | controller |
2026-02-26 19:17:25.870829 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2026-02-26 19:17:25.870848 | controller | Thursday 26 February 2026  19:17:25 +0000 (0:00:00.069)       0:00:50.294 *****
2026-02-26 19:17:25.870858 | controller | skipping: [instance]
2026-02-26 19:17:25.871028 | controller |
2026-02-26 19:17:25.871051 | controller | TASK [ci_nmstate : Install required packages on instance] **********************
2026-02-26 19:17:27.142561 | controller | Thursday 26 February 2026  19:17:25 +0000 (0:00:00.036)       0:00:50.330 *****
2026-02-26 19:17:27.142601 | controller | ok: [instance]
2026-02-26 19:17:27.333841 | controller |
2026-02-26 19:17:27.333866 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2026-02-26 19:17:27.333876 | controller | Thursday 26 February 2026  19:17:27 +0000 (0:00:01.270)       0:00:51.601 *****
2026-02-26 19:17:27.333887 | controller | ok: [instance]
2026-02-26 19:17:27.333914 | controller |
2026-02-26 19:17:27.333924 | controller | TASK [ci_nmstate : Save nmstate state for instance] ****************************
2026-02-26 19:17:27.334025 | controller | Thursday 26 February 2026  19:17:27 +0000 (0:00:00.191)       0:00:51.793 *****
2026-02-26 19:17:27.699282 | controller | changed: [instance]
2026-02-26 19:17:29.353498 | controller |
2026-02-26 19:17:29.353529 | controller | TASK [ci_nmstate : Apply the desidered state on instance] **********************
2026-02-26 19:17:29.353537 | controller | Thursday 26 February 2026  19:17:27 +0000 (0:00:00.365)       0:00:52.158 *****
2026-02-26 19:17:29.353548 | controller | changed: [instance]
2026-02-26 19:17:29.353788 | controller |
2026-02-26 19:17:29.710226 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] *******************
2026-02-26 19:17:29.710254 | controller | Thursday 26 February 2026  19:17:29 +0000 (0:00:01.654)       0:00:53.813 *****
2026-02-26 19:17:29.710266 | controller | changed: [instance]
2026-02-26 19:17:29.741790 | controller |
2026-02-26 19:17:29.741834 | controller | TASK [Create extra network configuration] **************************************
2026-02-26 19:17:29.741843 | controller | Thursday 26 February 2026  19:17:29 +0000 (0:00:00.356)       0:00:54.169 *****
2026-02-26 19:17:29.741859 | controller | skipping: [instance]
2026-02-26 19:17:29.770397 | controller |
2026-02-26 19:17:29.770426 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] **************
2026-02-26 19:17:29.770435 | controller | Thursday 26 February 2026  19:17:29 +0000 (0:00:00.031)       0:00:54.201 *****
2026-02-26 19:17:29.770447 | controller | skipping: [instance]
2026-02-26 19:17:30.214250 | controller |
2026-02-26 19:17:30.214276 | controller | TASK [libvirt_manager : Refresh networking facts on host] **********************
2026-02-26 19:17:30.214286 | controller | Thursday 26 February 2026  19:17:29 +0000 (0:00:00.028)       0:00:54.229 *****
2026-02-26 19:17:30.214297 | controller | ok: [instance]
2026-02-26 19:17:30.362278 | controller |
2026-02-26 19:17:30.362298 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] **********
2026-02-26 19:17:30.362305 | controller | Thursday 26 February 2026  19:17:30 +0000 (0:00:00.443)       0:00:54.673 *****
2026-02-26 19:17:30.362315 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 19:17:31.592607 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 19:17:31.592639 | controller |
2026-02-26 19:17:31.592647 | controller | TASK [dnsmasq : Install needed packages] ***************************************
2026-02-26 19:17:31.592659 | controller | Thursday 26 February 2026  19:17:30 +0000 (0:00:00.147)       0:00:54.821 *****
2026-02-26 19:17:31.592670 | controller | ok: [instance]
2026-02-26 19:17:35.357820 | controller |
2026-02-26 19:17:35.357858 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ******
2026-02-26 19:17:35.357866 | controller | Thursday 26 February 2026  19:17:31 +0000 (0:00:01.230)       0:00:56.051 *****
2026-02-26 19:17:35.357877 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'})
2026-02-26 19:17:35.357901 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'})
2026-02-26 19:17:35.357908 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'})
2026-02-26 19:17:35.357913 | controller |
2026-02-26 19:17:35.357919 | controller | TASK [dnsmasq : Manage configuration directory] ********************************
2026-02-26 19:17:35.357926 | controller | Thursday 26 February 2026  19:17:35 +0000 (0:00:03.765)       0:00:59.816 *****
2026-02-26 19:17:35.578277 | controller | changed: [instance]
2026-02-26 19:17:35.946823 | controller |
2026-02-26 19:17:35.946853 | controller | TASK [dnsmasq : Manage systemd unit file] **************************************
2026-02-26 19:17:35.946861 | controller | Thursday 26 February 2026  19:17:35 +0000 (0:00:00.220)       0:01:00.037 *****
2026-02-26 19:17:35.946871 | controller | changed: [instance]
2026-02-26 19:17:35.946894 | controller |
2026-02-26 19:17:35.946902 | controller | TASK [dnsmasq : Manage base configuration file] ********************************
2026-02-26 19:17:35.947004 | controller | Thursday 26 February 2026  19:17:35 +0000 (0:00:00.368)       0:01:00.406 *****
2026-02-26 19:17:36.331859 | controller | changed: [instance]
2026-02-26 19:17:36.363501 | controller |
2026-02-26 19:17:36.363534 | controller | TASK [dnsmasq : Render listener configuration] *********************************
2026-02-26 19:17:36.363542 | controller | Thursday 26 February 2026  19:17:36 +0000 (0:00:00.384)       0:01:00.791 *****
2026-02-26 19:17:36.363552 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance
2026-02-26 19:17:36.749593 | controller |
2026-02-26 19:17:36.749623 | controller | TASK [dnsmasq : Create listener configuration file] ****************************
2026-02-26 19:17:36.749631 | controller | Thursday 26 February 2026  19:17:36 +0000 (0:00:00.031)       0:01:00.822 *****
2026-02-26 19:17:36.749642 | controller | changed: [instance]
2026-02-26 19:17:36.768518 | controller |
2026-02-26 19:17:36.768541 | controller | TASK [dnsmasq : Remove listener configuration file] ****************************
2026-02-26 19:17:36.768549 | controller | Thursday 26 February 2026  19:17:36 +0000 (0:00:00.386)       0:01:01.209 *****
2026-02-26 19:17:36.768560 | controller | skipping: [instance]
2026-02-26 19:17:36.801566 | controller |
2026-02-26 19:17:36.801586 | controller | TASK [dnsmasq : Render dns configuration] **************************************
2026-02-26 19:17:36.801594 | controller | Thursday 26 February 2026  19:17:36 +0000 (0:00:00.019)       0:01:01.228 *****
2026-02-26 19:17:36.801605 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance
2026-02-26 19:17:37.174269 | controller |
2026-02-26 19:17:37.174306 | controller | TASK [dnsmasq : Create dns configuration file] *********************************
2026-02-26 19:17:37.174317 | controller | Thursday 26 February 2026  19:17:36 +0000 (0:00:00.033)       0:01:01.261 *****
2026-02-26 19:17:37.174328 | controller | changed: [instance]
2026-02-26 19:17:37.192851 | controller |
2026-02-26 19:17:37.192884 | controller | TASK [dnsmasq : Remove dns configuration file] *********************************
2026-02-26 19:17:37.192895 | controller | Thursday 26 February 2026  19:17:37 +0000 (0:00:00.372)       0:01:01.633 *****
2026-02-26 19:17:37.192912 | controller | skipping: [instance]
2026-02-26 19:17:37.192942 | controller |
2026-02-26 19:17:37.192953 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] ***
2026-02-26 19:17:37.193084 | controller | Thursday 26 February 2026  19:17:37 +0000 (0:00:00.019)       0:01:01.652 *****
2026-02-26 19:17:37.404566 | controller | ok: [instance] => (item=127.0.0.2)
2026-02-26 19:17:38.099272 | controller |
2026-02-26 19:17:38.099301 | controller | TASK [dnsmasq : Enable and start service] **************************************
2026-02-26 19:17:38.099309 | controller | Thursday 26 February 2026  19:17:37 +0000 (0:00:00.211)       0:01:01.863 *****
2026-02-26 19:17:38.099319 | controller | changed: [instance]
2026-02-26 19:17:38.119512 | controller |
2026-02-26 19:17:38.119532 | controller | TASK [dnsmasq : Stop service] **************************************************
2026-02-26 19:17:38.119540 | controller | Thursday 26 February 2026  19:17:38 +0000 (0:00:00.694)       0:01:02.558 *****
2026-02-26 19:17:38.119549 | controller | skipping: [instance]
2026-02-26 19:17:38.139513 | controller |
2026-02-26 19:17:38.139532 | controller | TASK [dnsmasq : Remove unit file] **********************************************
2026-02-26 19:17:38.139540 | controller | Thursday 26 February 2026  19:17:38 +0000 (0:00:00.020)       0:01:02.579 *****
2026-02-26 19:17:38.139549 | controller | skipping: [instance]
2026-02-26 19:17:38.172878 | controller |
2026-02-26 19:17:38.172915 | controller | TASK [dnsmasq : Remove main configuration files] *******************************
2026-02-26 19:17:38.172925 | controller | Thursday 26 February 2026  19:17:38 +0000 (0:00:00.020)       0:01:02.599 *****
2026-02-26 19:17:38.172945 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2026-02-26 19:17:38.172977 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d)
2026-02-26 19:17:38.172985 | controller | skipping: [instance]
2026-02-26 19:17:38.172992 | controller |
2026-02-26 19:17:38.173001 | controller | TASK [Create dnsmasq networks] *************************************************
2026-02-26 19:17:38.173027 | controller | Thursday 26 February 2026  19:17:38 +0000 (0:00:00.033)       0:01:02.632 *****
2026-02-26 19:17:38.291237 | controller |
2026-02-26 19:17:38.322834 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2026-02-26 19:17:38.322857 | controller | Thursday 26 February 2026  19:17:38 +0000 (0:00:00.118)       0:01:02.750 *****
2026-02-26 19:17:38.322869 | controller | ok: [instance] => changed=false
2026-02-26 19:17:38.322899 | controller |   msg: All assertions passed
2026-02-26 19:17:38.322909 | controller |
2026-02-26 19:17:38.323055 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2026-02-26 19:17:38.361302 | controller | Thursday 26 February 2026  19:17:38 +0000 (0:00:00.031)       0:01:02.782 *****
2026-02-26 19:17:38.361327 | controller | ok: [instance] => changed=false
2026-02-26 19:17:38.798307 | controller |   msg: All assertions passed
2026-02-26 19:17:38.798337 | controller |
2026-02-26 19:17:38.798345 | controller | TASK [dnsmasq : Create network] ************************************************
2026-02-26 19:17:38.798351 | controller | Thursday 26 February 2026  19:17:38 +0000 (0:00:00.038)       0:01:02.820 *****
2026-02-26 19:17:38.798361 | controller | changed: [instance]
2026-02-26 19:17:38.816608 | controller |
2026-02-26 19:17:38.816630 | controller | TASK [dnsmasq : Remove network] ************************************************
2026-02-26 19:17:38.816637 | controller | Thursday 26 February 2026  19:17:38 +0000 (0:00:00.436)       0:01:03.257 *****
2026-02-26 19:17:38.816647 | controller | skipping: [instance]
2026-02-26 19:17:38.841626 | controller |
2026-02-26 19:17:38.841651 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2026-02-26 19:17:38.841660 | controller | Thursday 26 February 2026  19:17:38 +0000 (0:00:00.018)       0:01:03.276 *****
2026-02-26 19:17:38.841671 | controller | skipping: [instance]
2026-02-26 19:17:38.871845 | controller |
2026-02-26 19:17:38.871868 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2026-02-26 19:17:38.871876 | controller | Thursday 26 February 2026  19:17:38 +0000 (0:00:00.024)       0:01:03.301 *****
2026-02-26 19:17:38.871885 | controller | ok: [instance] => changed=false
2026-02-26 19:17:38.909846 | controller |   msg: All assertions passed
2026-02-26 19:17:38.909882 | controller |
2026-02-26 19:17:38.909892 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2026-02-26 19:17:38.909905 | controller | Thursday 26 February 2026  19:17:38 +0000 (0:00:00.030)       0:01:03.331 *****
2026-02-26 19:17:38.909918 | controller | ok: [instance] => changed=false
2026-02-26 19:17:38.909947 | controller |   msg: All assertions passed
2026-02-26 19:17:38.909955 | controller |
2026-02-26 19:17:38.909964 | controller | TASK [dnsmasq : Create network] ************************************************
2026-02-26 19:17:38.910052 | controller | Thursday 26 February 2026  19:17:38 +0000 (0:00:00.038)       0:01:03.369 *****
2026-02-26 19:17:39.354493 | controller | changed: [instance]
2026-02-26 19:17:39.374521 | controller |
2026-02-26 19:17:39.374547 | controller | TASK [dnsmasq : Remove network] ************************************************
2026-02-26 19:17:39.374556 | controller | Thursday 26 February 2026  19:17:39 +0000 (0:00:00.444)       0:01:03.813 *****
2026-02-26 19:17:39.374565 | controller | skipping: [instance]
2026-02-26 19:17:39.400488 | controller |
2026-02-26 19:17:39.400511 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2026-02-26 19:17:39.400519 | controller | Thursday 26 February 2026  19:17:39 +0000 (0:00:00.020)       0:01:03.834 *****
2026-02-26 19:17:39.400528 | controller | skipping: [instance]
2026-02-26 19:17:39.434326 | controller |
2026-02-26 19:17:39.434348 | controller | TASK [Deploy radvd for IPv6 router advertisements] *****************************
2026-02-26 19:17:39.434356 | controller | Thursday 26 February 2026  19:17:39 +0000 (0:00:00.025)       0:01:03.860 *****
2026-02-26 19:17:39.434364 | controller | skipping: [instance]
2026-02-26 19:17:39.934530 | controller |
2026-02-26 19:17:39.934562 | controller | TASK [libvirt_manager : Ensure network is in correct zone] *********************
2026-02-26 19:17:39.934570 | controller | Thursday 26 February 2026  19:17:39 +0000 (0:00:00.033)       0:01:03.893 *****
2026-02-26 19:17:39.934582 | controller | changed: [instance] => (item=cifmw-public)
2026-02-26 19:17:39.934686 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-02-26 19:17:39.934823 | controller |
2026-02-26 19:17:39.934841 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-02-26 19:17:39.934932 | controller | Thursday 26 February 2026  19:17:39 +0000 (0:00:00.499)       0:01:04.393 *****
2026-02-26 19:17:39.969994 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public)
2026-02-26 19:17:40.296799 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk)
2026-02-26 19:17:40.296834 | controller |
2026-02-26 19:17:40.296843 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-02-26 19:17:40.296849 | controller | Thursday 26 February 2026  19:17:39 +0000 (0:00:00.035)       0:01:04.429 *****
2026-02-26 19:17:40.296859 | controller | ok: [instance]
2026-02-26 19:17:40.296878 | controller |
2026-02-26 19:17:40.297096 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2026-02-26 19:17:40.333403 | controller | Thursday 26 February 2026  19:17:40 +0000 (0:00:00.327)       0:01:04.756 *****
2026-02-26 19:17:40.333435 | controller | ok: [instance]
2026-02-26 19:17:40.539144 | controller |
2026-02-26 19:17:40.539177 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-02-26 19:17:40.539185 | controller | Thursday 26 February 2026  19:17:40 +0000 (0:00:00.036)       0:01:04.792 *****
2026-02-26 19:17:40.539195 | controller | ok: [instance]
2026-02-26 19:17:40.573748 | controller |
2026-02-26 19:17:40.573782 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2026-02-26 19:17:40.573792 | controller | Thursday 26 February 2026  19:17:40 +0000 (0:00:00.205)       0:01:04.998 *****
2026-02-26 19:17:40.573805 | controller | ok: [instance]
2026-02-26 19:17:40.908837 | controller |
2026-02-26 19:17:40.908868 | controller | TASK [libvirt_manager : Output _network_data] **********************************
2026-02-26 19:17:40.908876 | controller | Thursday 26 February 2026  19:17:40 +0000 (0:00:00.034)       0:01:05.033 *****
2026-02-26 19:17:40.908886 | controller | changed: [instance]
2026-02-26 19:17:40.908912 | controller |
2026-02-26 19:17:40.908922 | controller | TASK [libvirt_manager : Output pub_net] ****************************************
2026-02-26 19:17:40.908932 | controller | Thursday 26 February 2026  19:17:40 +0000 (0:00:00.335)       0:01:05.368 *****
2026-02-26 19:17:41.238489 | controller | changed: [instance]
2026-02-26 19:17:41.572379 | controller |
2026-02-26 19:17:41.572414 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ******************
2026-02-26 19:17:41.572422 | controller | Thursday 26 February 2026  19:17:41 +0000 (0:00:00.329)       0:01:05.697 *****
2026-02-26 19:17:41.572432 | controller | changed: [instance]
2026-02-26 19:17:41.670286 | controller |
2026-02-26 19:17:41.670314 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ********************
2026-02-26 19:17:41.670322 | controller | Thursday 26 February 2026  19:17:41 +0000 (0:00:00.333)       0:01:06.031 *****
2026-02-26 19:17:41.670332 | controller | ok: [instance]
2026-02-26 19:17:42.009716 | controller |
2026-02-26 19:17:42.009760 | controller | TASK [libvirt_manager : Save networking_mapper patch] **************************
2026-02-26 19:17:42.009769 | controller | Thursday 26 February 2026  19:17:41 +0000 (0:00:00.098)       0:01:06.129 *****
2026-02-26 19:17:42.009780 | controller | changed: [instance]
2026-02-26 19:17:42.034851 | controller |
2026-02-26 19:17:42.034878 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-02-26 19:17:42.034888 | controller | Thursday 26 February 2026  19:17:42 +0000 (0:00:00.339)       0:01:06.469 *****
2026-02-26 19:17:42.034900 | controller | skipping: [instance]
2026-02-26 19:17:42.059604 | controller |
2026-02-26 19:17:42.059624 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-02-26 19:17:42.059633 | controller | Thursday 26 February 2026  19:17:42 +0000 (0:00:00.025)       0:01:06.494 *****
2026-02-26 19:17:42.059644 | controller | skipping: [instance]
2026-02-26 19:17:42.083717 | controller |
2026-02-26 19:17:42.083751 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-02-26 19:17:42.083760 | controller | Thursday 26 February 2026  19:17:42 +0000 (0:00:00.024)       0:01:06.519 *****
2026-02-26 19:17:42.083771 | controller | skipping: [instance]
2026-02-26 19:17:42.107872 | controller |
2026-02-26 19:17:42.107895 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-02-26 19:17:42.107904 | controller | Thursday 26 February 2026  19:17:42 +0000 (0:00:00.024)       0:01:06.543 *****
2026-02-26 19:17:42.107914 | controller | skipping: [instance]
2026-02-26 19:17:42.107998 | controller |
2026-02-26 19:17:42.108013 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-02-26 19:17:42.108022 | controller | Thursday 26 February 2026  19:17:42 +0000 (0:00:00.024)       0:01:06.567 *****
2026-02-26 19:17:42.127786 | controller | ok: [instance]
2026-02-26 19:17:42.250620 | controller |
2026-02-26 19:17:42.250642 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-02-26 19:17:42.250652 | controller | Thursday 26 February 2026  19:17:42 +0000 (0:00:00.019)       0:01:06.587 *****
2026-02-26 19:17:42.250666 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2026-02-26 19:17:42.269288 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}})
2026-02-26 19:17:42.269309 | controller |
2026-02-26 19:17:42.269317 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-02-26 19:17:42.269323 | controller | Thursday 26 February 2026  19:17:42 +0000 (0:00:00.122)       0:01:06.709 *****
2026-02-26 19:17:42.269331 | controller | skipping: [instance]
2026-02-26 19:17:42.472471 | controller |
2026-02-26 19:17:42.472497 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-02-26 19:17:42.472505 | controller | Thursday 26 February 2026  19:17:42 +0000 (0:00:00.018)       0:01:06.728 *****
2026-02-26 19:17:42.472521 | controller | ok: [instance]
2026-02-26 19:17:42.861842 | controller |
2026-02-26 19:17:42.861876 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-02-26 19:17:42.861885 | controller | Thursday 26 February 2026  19:17:42 +0000 (0:00:00.203)       0:01:06.931 *****
2026-02-26 19:17:42.861896 | controller | changed: [instance]
2026-02-26 19:17:42.926625 | controller |
2026-02-26 19:17:42.926645 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-02-26 19:17:42.926652 | controller | Thursday 26 February 2026  19:17:42 +0000 (0:00:00.389)       0:01:07.321 *****
2026-02-26 19:17:42.926661 | controller | ok: [instance]
2026-02-26 19:17:42.959622 | controller |
2026-02-26 19:17:42.959640 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-02-26 19:17:42.959647 | controller | Thursday 26 February 2026  19:17:42 +0000 (0:00:00.064)       0:01:07.386 *****
2026-02-26 19:17:42.959656 | controller | ok: [instance]
2026-02-26 19:17:43.365801 | controller |
2026-02-26 19:17:43.365833 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-02-26 19:17:43.365841 | controller | Thursday 26 February 2026  19:17:42 +0000 (0:00:00.033)       0:01:07.419 *****
2026-02-26 19:17:43.365853 | controller | changed: [instance]
2026-02-26 19:17:43.365878 | controller |
2026-02-26 19:17:43.365884 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] ***
2026-02-26 19:17:43.365892 | controller | Thursday 26 February 2026  19:17:43 +0000 (0:00:00.405)       0:01:07.825 *****
2026-02-26 19:17:43.394529 | controller | ok: [instance]
2026-02-26 19:17:43.413595 | controller |
2026-02-26 19:17:43.413613 | controller | TASK [libvirt_manager : Unset patch] *******************************************
2026-02-26 19:17:43.413621 | controller | Thursday 26 February 2026  19:17:43 +0000 (0:00:00.028)       0:01:07.853 *****
2026-02-26 19:17:43.413630 | controller | ok: [instance]
2026-02-26 19:17:43.433864 | controller |
2026-02-26 19:17:43.433899 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] ****************
2026-02-26 19:17:43.433909 | controller | Thursday 26 February 2026  19:17:43 +0000 (0:00:00.019)       0:01:07.873 *****
2026-02-26 19:17:43.433922 | controller | ok: [instance]
2026-02-26 19:17:43.510836 | controller |
2026-02-26 19:17:43.510864 | controller | TASK [libvirt_manager : Reserve IPs on networks] *******************************
2026-02-26 19:17:43.510879 | controller | Thursday 26 February 2026  19:17:43 +0000 (0:00:00.020)       0:01:07.893 *****
2026-02-26 19:17:43.510891 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane)
2026-02-26 19:17:43.510922 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi)
2026-02-26 19:17:43.510930 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage)
2026-02-26 19:17:43.510937 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant)
2026-02-26 19:17:43.510943 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external)
2026-02-26 19:17:43.510952 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt)
2026-02-26 19:17:43.511253 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public)
2026-02-26 19:17:43.648859 | controller |
2026-02-26 19:17:43.648890 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-02-26 19:17:43.648900 | controller | Thursday 26 February 2026  19:17:43 +0000 (0:00:00.076)       0:01:07.970 *****
2026-02-26 19:17:43.648912 | controller | ok: [instance] => (item=compute-0 - ctlplane)
2026-02-26 19:17:43.731925 | controller | ok: [instance] => (item=controller-0 - ctlplane)
2026-02-26 19:17:43.731955 | controller | ok: [instance] => (item=crc-0 - ctlplane)
2026-02-26 19:17:43.731965 | controller |
2026-02-26 19:17:43.731973 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-02-26 19:17:43.731980 | controller | Thursday 26 February 2026  19:17:43 +0000 (0:00:00.137)       0:01:08.108 *****
2026-02-26 19:17:43.731992 | controller | skipping: [instance] => (item=compute-0 - internalapi)
2026-02-26 19:17:43.732057 | controller | skipping: [instance] => (item=controller-0 - internalapi)
2026-02-26 19:17:43.732179 | controller | skipping: [instance] => (item=crc-0 - internalapi)
2026-02-26 19:17:43.732289 | controller | skipping: [instance]
2026-02-26 19:17:43.732387 | controller |
2026-02-26 19:17:43.732491 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-02-26 19:17:43.732596 | controller | Thursday 26 February 2026  19:17:43 +0000 (0:00:00.083)       0:01:08.191 *****
2026-02-26 19:17:43.814125 | controller | skipping: [instance] => (item=compute-0 - storage)
2026-02-26 19:17:43.814250 | controller | skipping: [instance] => (item=controller-0 - storage)
2026-02-26 19:17:43.814361 | controller | skipping: [instance] => (item=crc-0 - storage)
2026-02-26 19:17:43.814469 | controller | skipping: [instance]
2026-02-26 19:17:43.814556 | controller |
2026-02-26 19:17:43.814676 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-02-26 19:17:43.814814 | controller | Thursday 26 February 2026  19:17:43 +0000 (0:00:00.082)       0:01:08.273 *****
2026-02-26 19:17:43.896400 | controller | skipping: [instance] => (item=compute-0 - tenant)
2026-02-26 19:17:43.896508 | controller | skipping: [instance] => (item=controller-0 - tenant)
2026-02-26 19:17:43.896641 | controller | skipping: [instance] => (item=crc-0 - tenant)
2026-02-26 19:17:43.896816 | controller | skipping: [instance]
2026-02-26 19:17:43.896948 | controller |
2026-02-26 19:17:43.897065 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-02-26 19:17:43.897190 | controller | Thursday 26 February 2026  19:17:43 +0000 (0:00:00.082)       0:01:08.356 *****
2026-02-26 19:17:43.980513 | controller | skipping: [instance] => (item=compute-0 - external)
2026-02-26 19:17:43.980641 | controller | skipping: [instance] => (item=controller-0 - external)
2026-02-26 19:17:43.980856 | controller | skipping: [instance] => (item=crc-0 - external)
2026-02-26 19:17:43.980967 | controller | skipping: [instance]
2026-02-26 19:17:43.981087 | controller |
2026-02-26 19:17:43.981217 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-02-26 19:17:43.981340 | controller | Thursday 26 February 2026  19:17:43 +0000 (0:00:00.084)       0:01:08.440 *****
2026-02-26 19:17:44.062911 | controller | skipping: [instance] => (item=compute-0 - storagemgmt)
2026-02-26 19:17:44.063039 | controller | skipping: [instance] => (item=controller-0 - storagemgmt)
2026-02-26 19:17:44.063204 | controller | skipping: [instance] => (item=crc-0 - storagemgmt)
2026-02-26 19:17:44.063306 | controller | skipping: [instance]
2026-02-26 19:17:44.063424 | controller |
2026-02-26 19:17:44.063552 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-02-26 19:17:44.063667 | controller | Thursday 26 February 2026  19:17:44 +0000 (0:00:00.082)       0:01:08.522 *****
2026-02-26 19:17:44.203437 | controller | ok: [instance] => (item=compute-0 - public)
2026-02-26 19:17:44.203595 | controller | ok: [instance] => (item=controller-0 - public)
2026-02-26 19:17:44.203721 | controller | ok: [instance] => (item=crc-0 - public)
2026-02-26 19:17:44.203912 | controller |
2026-02-26 19:17:44.204020 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ******************************
2026-02-26 19:17:44.204123 | controller | Thursday 26 February 2026  19:17:44 +0000 (0:00:00.140)       0:01:08.663 *****
2026-02-26 19:17:44.317190 | controller |
2026-02-26 19:17:44.317270 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************
2026-02-26 19:17:44.317428 | controller | Thursday 26 February 2026  19:17:44 +0000 (0:00:00.113)       0:01:08.776 *****
2026-02-26 19:17:44.356738 | controller | ok: [instance]
2026-02-26 19:17:44.356967 | controller |
2026-02-26 19:17:44.357164 | controller | TASK [dnsmasq : Assert we have needed host data] *******************************
2026-02-26 19:17:44.357290 | controller | Thursday 26 February 2026  19:17:44 +0000 (0:00:00.039)       0:01:08.816 *****
2026-02-26 19:17:44.459218 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:8a:f4:7d', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2026-02-26 19:17:44.459349 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:af:c1:1f', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2026-02-26 19:17:44.459480 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:1f:c6:51', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2026-02-26 19:17:44.459589 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:15:50:37', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2026-02-26 19:17:44.459682 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:89:08:69', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2026-02-26 19:17:44.459824 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:75:42:70', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2026-02-26 19:17:44.459934 | controller |
2026-02-26 19:17:44.460036 | controller | TASK [dnsmasq : Ensure networks exists] ****************************************
2026-02-26 19:17:44.460143 | controller | Thursday 26 February 2026  19:17:44 +0000 (0:00:00.102)       0:01:08.918 *****
2026-02-26 19:17:44.512238 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk)
2026-02-26 19:17:44.512417 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public)
2026-02-26 19:17:44.512623 | controller |
2026-02-26 19:17:44.512682 | controller | TASK [dnsmasq : Check network file status] *************************************
2026-02-26 19:17:44.512836 | controller | Thursday 26 February 2026  19:17:44 +0000 (0:00:00.052)       0:01:08.971 *****
2026-02-26 19:17:44.689466 | controller | ok: [instance]
2026-02-26 19:17:44.713429 | controller |
2026-02-26 19:17:44.713462 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2026-02-26 19:17:44.713472 | controller | Thursday 26 February 2026  19:17:44 +0000 (0:00:00.177)       0:01:09.148 *****
2026-02-26 19:17:44.713484 | controller | ok: [instance]
2026-02-26 19:17:44.893311 | controller |
2026-02-26 19:17:44.893338 | controller | TASK [dnsmasq : Check network file status] *************************************
2026-02-26 19:17:44.893346 | controller | Thursday 26 February 2026  19:17:44 +0000 (0:00:00.024)       0:01:09.172 *****
2026-02-26 19:17:44.893357 | controller | ok: [instance]
2026-02-26 19:17:44.916773 | controller |
2026-02-26 19:17:44.916793 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2026-02-26 19:17:44.916801 | controller | Thursday 26 February 2026  19:17:44 +0000 (0:00:00.179)       0:01:09.352 *****
2026-02-26 19:17:44.916810 | controller | ok: [instance]
2026-02-26 19:17:44.916888 | controller |
2026-02-26 19:17:44.916897 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] ****************************
2026-02-26 19:17:44.916905 | controller | Thursday 26 February 2026  19:17:44 +0000 (0:00:00.023)       0:01:09.376 *****
2026-02-26 19:17:44.936840 | controller | ok: [instance]
2026-02-26 19:17:44.936899 | controller |
2026-02-26 19:17:44.936914 | controller | TASK [dnsmasq : Compute entry] *************************************************
2026-02-26 19:17:44.937011 | controller | Thursday 26 February 2026  19:17:44 +0000 (0:00:00.020)       0:01:09.396 *****
2026-02-26 19:17:45.116851 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:8a:f4:7d', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2026-02-26 19:17:45.117265 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:af:c1:1f', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2026-02-26 19:17:45.117280 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:1f:c6:51', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2026-02-26 19:17:45.117288 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:15:50:37', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2026-02-26 19:17:45.117297 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:89:08:69', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2026-02-26 19:17:45.155133 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:75:42:70', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2026-02-26 19:17:45.155156 | controller |
2026-02-26 19:17:45.155165 | controller | TASK [dnsmasq : Create add/remove sets] ****************************************
2026-02-26 19:17:45.155173 | controller | Thursday 26 February 2026  19:17:45 +0000 (0:00:00.179)       0:01:09.576 *****
2026-02-26 19:17:45.155183 | controller | ok: [instance]
2026-02-26 19:17:47.209862 | controller |
2026-02-26 19:17:47.209895 | controller | TASK [dnsmasq : Add DHCP entries] **********************************************
2026-02-26 19:17:47.209904 | controller | Thursday 26 February 2026  19:17:45 +0000 (0:00:00.038)       0:01:09.614 *****
2026-02-26 19:17:47.209917 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:8a:f4:7d', 'entry': 'set:compute,52:54:00:8a:f4:7d,192.168.140.100,compute-0', 'state': 'present'})
2026-02-26 19:17:47.232412 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:af:c1:1f', 'entry': 'set:controller,52:54:01:af:c1:1f,192.168.140.9,controller-0', 'state': 'present'})
2026-02-26 19:17:47.232455 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:1f:c6:51', 'entry': 'set:ocp,52:54:02:1f:c6:51,192.168.140.10,crc-0', 'state': 'present'})
2026-02-26 19:17:47.232469 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:15:50:37', 'entry': 'set:compute,52:54:00:15:50:37,192.168.101.100,compute-0', 'state': 'present'})
2026-02-26 19:17:47.232478 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:89:08:69', 'entry': 'set:controller,52:54:01:89:08:69,192.168.101.9,controller-0', 'state': 'present'})
2026-02-26 19:17:47.232487 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:75:42:70', 'entry': 'set:ocp,52:54:02:75:42:70,192.168.101.10,crc-0', 'state': 'present'})
2026-02-26 19:17:47.232497 | controller |
2026-02-26 19:17:47.232506 | controller | TASK [dnsmasq : Remove DHCP entries] *******************************************
2026-02-26 19:17:47.232523 | controller | Thursday 26 February 2026  19:17:47 +0000 (0:00:02.054)       0:01:11.668 *****
2026-02-26 19:17:47.232539 | controller | skipping: [instance]
2026-02-26 19:17:47.451450 | controller |
2026-02-26 19:17:47.451470 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] ***********
2026-02-26 19:17:47.451478 | controller | Thursday 26 February 2026  19:17:47 +0000 (0:00:00.022)       0:01:11.691 *****
2026-02-26 19:17:47.451487 | controller | ok: [instance] => (item=compute-0)
2026-02-26 19:17:47.595462 | controller | ok: [instance] => (item=controller-0)
2026-02-26 19:17:47.595480 | controller | ok: [instance] => (item=crc-0)
2026-02-26 19:17:47.595487 | controller |
2026-02-26 19:17:47.595493 | controller | TASK [Inject VMs in the .utility zone] *****************************************
2026-02-26 19:17:47.595499 | controller | Thursday 26 February 2026  19:17:47 +0000 (0:00:00.219)       0:01:11.910 *****
2026-02-26 19:17:47.595507 | controller |
2026-02-26 19:17:47.637879 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-02-26 19:17:47.637914 | controller | Thursday 26 February 2026  19:17:47 +0000 (0:00:00.143)       0:01:12.054 *****
2026-02-26 19:17:47.637936 | controller | ok: [instance]
2026-02-26 19:17:47.637970 | controller |
2026-02-26 19:17:47.638145 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-02-26 19:17:47.845904 | controller | Thursday 26 February 2026  19:17:47 +0000 (0:00:00.042)       0:01:12.097 *****
2026-02-26 19:17:47.845932 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-02-26 19:17:47.846111 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-02-26 19:17:47.846277 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-02-26 19:17:47.846437 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-02-26 19:17:47.846600 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-02-26 19:17:47.846815 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-02-26 19:17:47.846954 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-02-26 19:17:47.847095 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 19:17:47.847222 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 19:17:47.847347 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-02-26 19:17:47.847470 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-02-26 19:17:47.847595 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-02-26 19:17:47.847750 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-02-26 19:17:47.847901 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-02-26 19:17:47.848031 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-02-26 19:17:47.848204 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-02-26 19:17:47.848323 | controller |
2026-02-26 19:17:47.848455 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-02-26 19:17:47.848597 | controller | Thursday 26 February 2026  19:17:47 +0000 (0:00:00.208)       0:01:12.305 *****
2026-02-26 19:17:50.947840 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-02-26 19:17:50.947915 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-02-26 19:17:50.949414 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-02-26 19:17:51.298903 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-02-26 19:17:51.298942 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-02-26 19:17:51.298954 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-02-26 19:17:51.298965 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-02-26 19:17:51.298974 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 19:17:51.298983 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 19:17:51.298993 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-02-26 19:17:51.299003 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-02-26 19:17:51.299012 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-02-26 19:17:51.299021 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-02-26 19:17:51.299029 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-02-26 19:17:51.299038 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-02-26 19:17:51.299047 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-02-26 19:17:51.299056 | controller |
2026-02-26 19:17:51.299065 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-02-26 19:17:51.299075 | controller | Thursday 26 February 2026  19:17:50 +0000 (0:00:03.101)       0:01:15.407 *****
2026-02-26 19:17:51.299090 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-02-26 19:17:51.299131 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-02-26 19:17:51.299170 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-02-26 19:17:51.299184 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-02-26 19:17:51.299845 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-02-26 19:17:51.299902 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-02-26 19:17:51.299913 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-02-26 19:17:51.299921 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 19:17:51.299928 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 19:17:51.299934 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-02-26 19:17:51.299944 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-02-26 19:17:51.300610 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-02-26 19:17:51.319183 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-02-26 19:17:51.319207 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-02-26 19:17:51.319217 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-02-26 19:17:51.319227 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-02-26 19:17:51.319240 | controller |
2026-02-26 19:17:51.319248 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] ****************
2026-02-26 19:17:51.319256 | controller | Thursday 26 February 2026  19:17:51 +0000 (0:00:00.350)       0:01:15.758 *****
2026-02-26 19:17:51.319267 | controller | ok: [instance]
2026-02-26 19:17:51.363811 | controller |
2026-02-26 19:17:51.363829 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] **************
2026-02-26 19:17:51.363835 | controller | Thursday 26 February 2026  19:17:51 +0000 (0:00:00.020)       0:01:15.778 *****
2026-02-26 19:17:51.363844 | controller | skipping: [instance] => (item=compute)
2026-02-26 19:17:51.363869 | controller | skipping: [instance] => (item=controller)
2026-02-26 19:17:51.364564 | controller | skipping: [instance] => (item=crc)
2026-02-26 19:17:51.395964 | controller | skipping: [instance]
2026-02-26 19:17:51.395989 | controller |
2026-02-26 19:17:51.395999 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] *******
2026-02-26 19:17:51.396006 | controller | Thursday 26 February 2026  19:17:51 +0000 (0:00:00.044)       0:01:15.823 *****
2026-02-26 19:17:51.396017 | controller | skipping: [instance]
2026-02-26 19:17:51.396183 | controller |
2026-02-26 19:17:51.396347 | controller | TASK [libvirt_manager : Ensure some domains are local] *************************
2026-02-26 19:17:51.396515 | controller | Thursday 26 February 2026  19:17:51 +0000 (0:00:00.032)       0:01:15.855 *****
2026-02-26 19:17:51.778859 | controller | changed: [instance]
2026-02-26 19:17:51.778908 | controller |
2026-02-26 19:17:51.778916 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************
2026-02-26 19:17:51.778925 | controller | Thursday 26 February 2026  19:17:51 +0000 (0:00:00.371)       0:01:16.227 *****
2026-02-26 19:17:51.778947 | controller |
2026-02-26 19:17:51.779182 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2026-02-26 19:17:52.415157 | controller | Thursday 26 February 2026  19:17:51 +0000 (0:00:00.010)       0:01:16.238 *****
2026-02-26 19:17:52.415189 | controller | changed: [instance]
2026-02-26 19:17:52.774380 | controller |
2026-02-26 19:17:52.774409 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-02-26 19:17:52.774418 | controller | Thursday 26 February 2026  19:17:52 +0000 (0:00:00.636)       0:01:16.874 *****
2026-02-26 19:17:52.774428 | controller | changed: [instance]
2026-02-26 19:17:53.118443 | controller |
2026-02-26 19:17:53.118472 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] *************************************
2026-02-26 19:17:53.118480 | controller | Thursday 26 February 2026  19:17:52 +0000 (0:00:00.359)       0:01:17.233 *****
2026-02-26 19:17:53.118490 | controller | changed: [instance]
2026-02-26 19:17:53.474415 | controller |
2026-02-26 19:17:53.474449 | controller | TASK [reproducer : Delegate our domains to our own instance] *******************
2026-02-26 19:17:53.474460 | controller | Thursday 26 February 2026  19:17:53 +0000 (0:00:00.344)       0:01:17.577 *****
2026-02-26 19:17:53.474470 | controller | changed: [instance]
2026-02-26 19:17:53.843825 | controller |
2026-02-26 19:17:53.843865 | controller | TASK [reproducer : Ensure "utility" domain is local] ***************************
2026-02-26 19:17:53.843875 | controller | Thursday 26 February 2026  19:17:53 +0000 (0:00:00.355)       0:01:17.933 *****
2026-02-26 19:17:53.843887 | controller | changed: [instance]
2026-02-26 19:17:53.843910 | controller |
2026-02-26 19:17:53.844088 | controller | TASK [Build utility records dataset] *******************************************
2026-02-26 19:17:53.877144 | controller | Thursday 26 February 2026  19:17:53 +0000 (0:00:00.369)       0:01:18.303 *****
2026-02-26 19:17:53.877172 | controller |
2026-02-26 19:17:53.968858 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-02-26 19:17:53.968886 | controller | Thursday 26 February 2026  19:17:53 +0000 (0:00:00.033)       0:01:18.336 *****
2026-02-26 19:17:53.968899 | controller | ok: [instance]
2026-02-26 19:17:53.968930 | controller |
2026-02-26 19:17:53.968941 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-02-26 19:17:53.969052 | controller | Thursday 26 February 2026  19:17:53 +0000 (0:00:00.091)       0:01:18.428 *****
2026-02-26 19:17:54.068888 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-02-26 19:17:54.069212 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 19:17:54.069238 | controller |
2026-02-26 19:17:54.530648 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-02-26 19:17:54.530682 | controller | Thursday 26 February 2026  19:17:54 +0000 (0:00:00.100)       0:01:18.528 *****
2026-02-26 19:17:54.530694 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-02-26 19:17:54.824874 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 19:17:54.824908 | controller |
2026-02-26 19:17:54.824918 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-02-26 19:17:54.824925 | controller | Thursday 26 February 2026  19:17:54 +0000 (0:00:00.461)       0:01:18.989 *****
2026-02-26 19:17:54.824937 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-02-26 19:17:54.824967 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 19:17:54.824982 | controller |
2026-02-26 19:17:54.824990 | controller | TASK [reproducer : Flush handlers] *********************************************
2026-02-26 19:17:54.824996 | controller | Thursday 26 February 2026  19:17:54 +0000 (0:00:00.283)       0:01:19.273 *****
2026-02-26 19:17:54.825005 | controller |
2026-02-26 19:17:54.825031 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-02-26 19:17:54.825167 | controller | Thursday 26 February 2026  19:17:54 +0000 (0:00:00.010)       0:01:19.283 *****
2026-02-26 19:17:55.309371 | controller | changed: [instance]
2026-02-26 19:17:55.309419 | controller |
2026-02-26 19:17:55.309601 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-02-26 19:17:55.662847 | controller | Thursday 26 February 2026  19:17:55 +0000 (0:00:00.484)       0:01:19.768 *****
2026-02-26 19:17:55.662885 | controller | changed: [instance]
2026-02-26 19:17:55.694879 | controller |
2026-02-26 19:17:55.694904 | controller | TASK [reproducer : Bootstrap nat64 if needed] **********************************
2026-02-26 19:17:55.694914 | controller | Thursday 26 February 2026  19:17:55 +0000 (0:00:00.353)       0:01:20.122 *****
2026-02-26 19:17:55.694925 | controller | skipping: [instance]
2026-02-26 19:17:55.772256 | controller |
2026-02-26 19:17:55.772292 | controller | TASK [reproducer : Deploy CRC if needed] ***************************************
2026-02-26 19:17:55.772302 | controller | Thursday 26 February 2026  19:17:55 +0000 (0:00:00.032)       0:01:20.154 *****
2026-02-26 19:17:55.772314 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance
2026-02-26 19:17:55.957829 | controller |
2026-02-26 19:17:55.957857 | controller | TASK [reproducer : Check for CRC availability in known path] *******************
2026-02-26 19:17:55.957864 | controller | Thursday 26 February 2026  19:17:55 +0000 (0:00:00.077)       0:01:20.231 *****
2026-02-26 19:17:55.957875 | controller | ok: [instance]
2026-02-26 19:17:55.957892 | controller |
2026-02-26 19:17:55.957900 | controller | TASK [Deploy CRC if needed] ****************************************************
2026-02-26 19:17:55.957926 | controller | Thursday 26 February 2026  19:17:55 +0000 (0:00:00.185)       0:01:20.417 *****
2026-02-26 19:17:55.977377 | controller | skipping: [instance]
2026-02-26 19:17:56.293258 | controller |
2026-02-26 19:17:56.293288 | controller | TASK [rhol_crc : Stop CRC VM] **************************************************
2026-02-26 19:17:56.293296 | controller | Thursday 26 February 2026  19:17:55 +0000 (0:00:00.019)       0:01:20.436 *****
2026-02-26 19:17:56.293306 | controller | ok: [instance]
2026-02-26 19:17:56.529876 | controller |
2026-02-26 19:17:56.529909 | controller | TASK [rhol_crc : Undefine CRC VM] **********************************************
2026-02-26 19:17:56.529917 | controller | Thursday 26 February 2026  19:17:56 +0000 (0:00:00.315)       0:01:20.752 *****
2026-02-26 19:17:56.529928 | controller | ok: [instance]
2026-02-26 19:17:56.529964 | controller |
2026-02-26 19:17:56.529972 | controller | TASK [rhol_crc : Destroy CRC network] ******************************************
2026-02-26 19:17:56.530161 | controller | Thursday 26 February 2026  19:17:56 +0000 (0:00:00.236)       0:01:20.988 *****
2026-02-26 19:17:56.755391 | controller | ok: [instance]
2026-02-26 19:17:56.977865 | controller |
2026-02-26 19:17:56.977929 | controller | TASK [rhol_crc : Undefine CRC network] *****************************************
2026-02-26 19:17:56.977938 | controller | Thursday 26 February 2026  19:17:56 +0000 (0:00:00.225)       0:01:21.214 *****
2026-02-26 19:17:56.977952 | controller | ok: [instance]
2026-02-26 19:17:57.209335 | controller |
2026-02-26 19:17:57.209374 | controller | TASK [rhol_crc : Destroy default network] **************************************
2026-02-26 19:17:57.209384 | controller | Thursday 26 February 2026  19:17:56 +0000 (0:00:00.222)       0:01:21.436 *****
2026-02-26 19:17:57.209398 | controller | ok: [instance]
2026-02-26 19:17:57.209567 | controller |
2026-02-26 19:17:57.209723 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-02-26 19:17:57.209898 | controller | Thursday 26 February 2026  19:17:57 +0000 (0:00:00.232)       0:01:21.668 *****
2026-02-26 19:17:57.248939 | controller |
2026-02-26 19:17:57.249086 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2026-02-26 19:17:57.249226 | controller | Thursday 26 February 2026  19:17:57 +0000 (0:00:00.040)       0:01:21.708 *****
2026-02-26 19:17:57.444873 | controller | ok: [instance]
2026-02-26 19:17:57.444917 | controller |
2026-02-26 19:17:57.444925 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2026-02-26 19:17:57.444934 | controller | Thursday 26 February 2026  19:17:57 +0000 (0:00:00.195)       0:01:21.904 *****
2026-02-26 19:17:57.466742 | controller | ok: [instance]
2026-02-26 19:17:57.466842 | controller |
2026-02-26 19:17:57.466953 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2026-02-26 19:17:57.467065 | controller | Thursday 26 February 2026  19:17:57 +0000 (0:00:00.022)       0:01:21.926 *****
2026-02-26 19:17:57.491026 | controller | skipping: [instance]
2026-02-26 19:17:57.491134 | controller |
2026-02-26 19:17:57.491260 | controller | TASK [reproducer : Slurp ssh key for CRC access] *******************************
2026-02-26 19:17:57.491374 | controller | Thursday 26 February 2026  19:17:57 +0000 (0:00:00.024)       0:01:21.950 *****
2026-02-26 19:17:57.779927 | controller | ok: [instance]
2026-02-26 19:17:57.779973 | controller |
2026-02-26 19:17:57.779981 | controller | TASK [reproducer : Get kubeconfig file from crc directory] *********************
2026-02-26 19:17:57.779990 | controller | Thursday 26 February 2026  19:17:57 +0000 (0:00:00.288)       0:01:22.239 *****
2026-02-26 19:17:58.001282 | controller | ok: [instance]
2026-02-26 19:17:58.175498 | controller |
2026-02-26 19:17:58.175538 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] *************
2026-02-26 19:17:58.175548 | controller | Thursday 26 February 2026  19:17:57 +0000 (0:00:00.221)       0:01:22.460 *****
2026-02-26 19:17:58.175562 | controller | ok: [instance]
2026-02-26 19:17:58.232669 | controller |
2026-02-26 19:17:58.232699 | controller | TASK [Ensure we expose openshift_login related facts] **************************
2026-02-26 19:17:58.232720 | controller | Thursday 26 February 2026  19:17:58 +0000 (0:00:00.174)       0:01:22.634 *****
2026-02-26 19:17:58.232745 | controller |
2026-02-26 19:17:58.277434 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-02-26 19:17:58.277457 | controller | Thursday 26 February 2026  19:17:58 +0000 (0:00:00.057)       0:01:22.692 *****
2026-02-26 19:17:58.277470 | controller | ok: [instance] => changed=false
2026-02-26 19:17:58.459662 | controller |   msg: All assertions passed
2026-02-26 19:17:58.459751 | controller |
2026-02-26 19:17:58.459766 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-02-26 19:17:58.459774 | controller | Thursday 26 February 2026  19:17:58 +0000 (0:00:00.044)       0:01:22.736 *****
2026-02-26 19:17:58.459790 | controller | ok: [instance]
2026-02-26 19:17:58.651941 | controller |
2026-02-26 19:17:58.652007 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-02-26 19:17:58.652017 | controller | Thursday 26 February 2026  19:17:58 +0000 (0:00:00.182)       0:01:22.919 *****
2026-02-26 19:17:58.652034 | controller | ok: [instance]
2026-02-26 19:17:58.676860 | controller |
2026-02-26 19:17:58.676883 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-02-26 19:17:58.676891 | controller | Thursday 26 February 2026  19:17:58 +0000 (0:00:00.192)       0:01:23.111 *****
2026-02-26 19:17:58.676900 | controller | ok: [instance] => changed=false
2026-02-26 19:17:58.864300 | controller |   msg: All assertions passed
2026-02-26 19:17:58.864339 | controller |
2026-02-26 19:17:58.864347 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-02-26 19:17:58.864354 | controller | Thursday 26 February 2026  19:17:58 +0000 (0:00:00.024)       0:01:23.136 *****
2026-02-26 19:17:58.864364 | controller | ok: [instance]
2026-02-26 19:17:58.864383 | controller |
2026-02-26 19:17:58.864583 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-02-26 19:17:59.042291 | controller | Thursday 26 February 2026  19:17:58 +0000 (0:00:00.187)       0:01:23.323 *****
2026-02-26 19:17:59.042331 | controller | ok: [instance]
2026-02-26 19:17:59.091363 | controller |
2026-02-26 19:17:59.091392 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-02-26 19:17:59.091400 | controller | Thursday 26 February 2026  19:17:59 +0000 (0:00:00.177)       0:01:23.501 *****
2026-02-26 19:17:59.091410 | controller | ok: [instance]
2026-02-26 19:17:59.477825 | controller |
2026-02-26 19:17:59.477858 | controller | TASK [reproducer : Remove CRC managed zone delegation] *************************
2026-02-26 19:17:59.477868 | controller | Thursday 26 February 2026  19:17:59 +0000 (0:00:00.049)       0:01:23.550 *****
2026-02-26 19:17:59.477880 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf)
2026-02-26 19:17:59.477910 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf)
2026-02-26 19:17:59.477935 | controller |
2026-02-26 19:17:59.478155 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************
2026-02-26 19:17:59.497179 | controller | Thursday 26 February 2026  19:17:59 +0000 (0:00:00.386)       0:01:23.937 *****
2026-02-26 19:17:59.497206 | controller | skipping: [instance]
2026-02-26 19:17:59.521523 | controller |
2026-02-26 19:17:59.521550 | controller | TASK [Load the architecture local kustomize patches] ***************************
2026-02-26 19:17:59.521559 | controller | Thursday 26 February 2026  19:17:59 +0000 (0:00:00.019)       0:01:23.956 *****
2026-02-26 19:17:59.521570 | controller | skipping: [instance]
2026-02-26 19:17:59.652876 | controller |
2026-02-26 19:17:59.652902 | controller | TASK [reproducer : Consume libvirt_manager] ************************************
2026-02-26 19:17:59.652911 | controller | Thursday 26 February 2026  19:17:59 +0000 (0:00:00.024)       0:01:23.981 *****
2026-02-26 19:17:59.652922 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance
2026-02-26 19:17:59.678828 | controller |
2026-02-26 19:17:59.678867 | controller | TASK [libvirt_manager : Import layout generator if needed] *********************
2026-02-26 19:17:59.678878 | controller | Thursday 26 February 2026  19:17:59 +0000 (0:00:00.131)       0:01:24.112 *****
2026-02-26 19:17:59.678891 | controller | skipping: [instance]
2026-02-26 19:17:59.678919 | controller |
2026-02-26 19:17:59.678929 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] *****************
2026-02-26 19:17:59.679024 | controller | Thursday 26 February 2026  19:17:59 +0000 (0:00:00.026)       0:01:24.138 *****
2026-02-26 19:18:01.101055 | controller | changed: [instance]
2026-02-26 19:18:01.615694 | controller |
2026-02-26 19:18:01.615756 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] ****************
2026-02-26 19:18:01.615766 | controller | Thursday 26 February 2026  19:18:01 +0000 (0:00:01.421)       0:01:25.560 *****
2026-02-26 19:18:01.615776 | controller | changed: [instance]
2026-02-26 19:18:02.043915 | controller |
2026-02-26 19:18:02.043945 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] **************************
2026-02-26 19:18:02.043953 | controller | Thursday 26 February 2026  19:18:01 +0000 (0:00:00.503)       0:01:26.063 *****
2026-02-26 19:18:02.043959 | controller |
2026-02-26 19:18:02.043964 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-02-26 19:18:02.043970 | controller | Thursday 26 February 2026  19:18:01 +0000 (0:00:00.011)       0:01:26.074 *****
2026-02-26 19:18:02.043980 | controller | changed: [instance]
2026-02-26 19:18:02.044012 | controller |
2026-02-26 19:18:02.044031 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2026-02-26 19:18:02.044174 | controller | Thursday 26 February 2026  19:18:02 +0000 (0:00:00.428)       0:01:26.503 *****
2026-02-26 19:18:02.691573 | controller | changed: [instance]
2026-02-26 19:18:02.724053 | controller |
2026-02-26 19:18:02.724073 | controller | TASK [Deploy virtualbmc] *******************************************************
2026-02-26 19:18:02.724081 | controller | Thursday 26 February 2026  19:18:02 +0000 (0:00:00.647)       0:01:27.150 *****
2026-02-26 19:18:02.724090 | controller | skipping: [instance]
2026-02-26 19:18:02.757080 | controller |
2026-02-26 19:18:02.757102 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] ***********
2026-02-26 19:18:02.757110 | controller | Thursday 26 February 2026  19:18:02 +0000 (0:00:00.032)       0:01:27.183 *****
2026-02-26 19:18:02.757119 | controller | skipping: [instance]
2026-02-26 19:18:03.298621 | controller |
2026-02-26 19:18:03.298651 | controller | TASK [libvirt_manager : Create needed workload directory] **********************
2026-02-26 19:18:03.298659 | controller | Thursday 26 February 2026  19:18:02 +0000 (0:00:00.033)       0:01:27.216 *****
2026-02-26 19:18:03.298669 | controller | changed: [instance] => (item=workload)
2026-02-26 19:18:03.705859 | controller | changed: [instance] => (item=reproducer-inventory)
2026-02-26 19:18:03.705902 | controller | ok: [instance] => (item=volumes)
2026-02-26 19:18:03.705917 | controller |
2026-02-26 19:18:03.705924 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] **********************
2026-02-26 19:18:03.705931 | controller | Thursday 26 February 2026  19:18:03 +0000 (0:00:00.541)       0:01:27.757 *****
2026-02-26 19:18:03.705944 | controller | changed: [instance] => (item=workload)
2026-02-26 19:18:03.730172 | controller | changed: [instance] => (item=volumes)
2026-02-26 19:18:03.730203 | controller |
2026-02-26 19:18:03.730211 | controller | TASK [libvirt_manager : Generate networking data] ******************************
2026-02-26 19:18:03.730218 | controller | Thursday 26 February 2026  19:18:03 +0000 (0:00:00.407)       0:01:28.165 *****
2026-02-26 19:18:03.730228 | controller | skipping: [instance]
2026-02-26 19:18:04.785328 | controller |
2026-02-26 19:18:04.785358 | controller | TASK [libvirt_manager : Create group inventories] ******************************
2026-02-26 19:18:04.785366 | controller | Thursday 26 February 2026  19:18:03 +0000 (0:00:00.024)       0:01:28.189 *****
2026-02-26 19:18:04.785377 | controller | changed: [instance] => (item=compute)
2026-02-26 19:18:04.816879 | controller | changed: [instance] => (item=controller)
2026-02-26 19:18:04.816916 | controller | changed: [instance] => (item=crc)
2026-02-26 19:18:04.816926 | controller |
2026-02-26 19:18:04.816934 | controller | TASK [libvirt_manager : Create "all" group inventory file] *********************
2026-02-26 19:18:04.816941 | controller | Thursday 26 February 2026  19:18:04 +0000 (0:00:01.054)       0:01:29.244 *****
2026-02-26 19:18:04.816955 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance
2026-02-26 19:18:04.995333 | controller |
2026-02-26 19:18:04.995364 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] *****************
2026-02-26 19:18:04.995373 | controller | Thursday 26 February 2026  19:18:04 +0000 (0:00:00.031)       0:01:29.276 *****
2026-02-26 19:18:04.995387 | controller | ok: [instance]
2026-02-26 19:18:05.015770 | controller |
2026-02-26 19:18:05.015796 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] *************
2026-02-26 19:18:05.015804 | controller | Thursday 26 February 2026  19:18:04 +0000 (0:00:00.178)       0:01:29.454 *****
2026-02-26 19:18:05.015814 | controller | skipping: [instance]
2026-02-26 19:18:05.384238 | controller |
2026-02-26 19:18:05.384272 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] ***
2026-02-26 19:18:05.384280 | controller | Thursday 26 February 2026  19:18:05 +0000 (0:00:00.020)       0:01:29.475 *****
2026-02-26 19:18:05.384290 | controller | changed: [instance]
2026-02-26 19:18:05.403842 | controller |
2026-02-26 19:18:05.403874 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] *********************
2026-02-26 19:18:05.403885 | controller | Thursday 26 February 2026  19:18:05 +0000 (0:00:00.368)       0:01:29.843 *****
2026-02-26 19:18:05.403897 | controller | skipping: [instance]
2026-02-26 19:18:05.403929 | controller |
2026-02-26 19:18:05.404158 | controller | TASK [libvirt_manager : Write merged all-group.yml] ****************************
2026-02-26 19:18:05.424703 | controller | Thursday 26 February 2026  19:18:05 +0000 (0:00:00.020)       0:01:29.863 *****
2026-02-26 19:18:05.424758 | controller | skipping: [instance]
2026-02-26 19:18:05.464686 | controller |
2026-02-26 19:18:05.464722 | controller | TASK [libvirt_manager : Ensure storage pool is present.] ***********************
2026-02-26 19:18:05.464752 | controller | Thursday 26 February 2026  19:18:05 +0000 (0:00:00.020)       0:01:29.884 *****
2026-02-26 19:18:05.464771 | controller | skipping: [instance]
2026-02-26 19:18:05.530542 | controller |
2026-02-26 19:18:05.530561 | controller | TASK [libvirt_manager : Ensure images are present] *****************************
2026-02-26 19:18:05.530568 | controller | Thursday 26 February 2026  19:18:05 +0000 (0:00:00.039)       0:01:29.924 *****
2026-02-26 19:18:05.530577 | controller | skipping: [instance] => (item=crc)
2026-02-26 19:18:05.736828 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute)
2026-02-26 19:18:05.736867 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller)
2026-02-26 19:18:05.736881 | controller |
2026-02-26 19:18:05.736888 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2026-02-26 19:18:05.736894 | controller | Thursday 26 February 2026  19:18:05 +0000 (0:00:00.065)       0:01:29.989 *****
2026-02-26 19:18:05.736904 | controller | changed: [instance]
2026-02-26 19:18:05.736934 | controller |
2026-02-26 19:18:05.736942 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2026-02-26 19:18:05.737029 | controller | Thursday 26 February 2026  19:18:05 +0000 (0:00:00.206)       0:01:30.196 *****
2026-02-26 19:18:05.918511 | controller | ok: [instance]
2026-02-26 19:18:36.023759 | controller |
2026-02-26 19:18:36.023797 | controller | TASK [libvirt_manager : Download base image] ***********************************
2026-02-26 19:18:36.023807 | controller | Thursday 26 February 2026  19:18:05 +0000 (0:00:00.181)       0:01:30.377 *****
2026-02-26 19:18:36.023820 | controller | changed: [instance]
2026-02-26 19:18:36.223258 | controller |
2026-02-26 19:18:36.223283 | controller | TASK [libvirt_manager : Check image] *******************************************
2026-02-26 19:18:36.223291 | controller | Thursday 26 February 2026  19:18:36 +0000 (0:00:30.104)       0:02:00.482 *****
2026-02-26 19:18:36.223301 | controller | ok: [instance]
2026-02-26 19:18:36.264770 | controller |
2026-02-26 19:18:36.264788 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2026-02-26 19:18:36.264796 | controller | Thursday 26 February 2026  19:18:36 +0000 (0:00:00.199)       0:02:00.682 *****
2026-02-26 19:18:36.264804 | controller | ok: [instance] => changed=false
2026-02-26 19:18:36.475230 | controller |   msg: All assertions passed
2026-02-26 19:18:36.475252 | controller |
2026-02-26 19:18:36.475259 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2026-02-26 19:18:36.475265 | controller | Thursday 26 February 2026  19:18:36 +0000 (0:00:00.041)       0:02:00.724 *****
2026-02-26 19:18:36.475273 | controller | changed: [instance]
2026-02-26 19:18:36.682861 | controller |
2026-02-26 19:18:36.682890 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2026-02-26 19:18:36.682900 | controller | Thursday 26 February 2026  19:18:36 +0000 (0:00:00.210)       0:02:00.934 *****
2026-02-26 19:18:36.682911 | controller | ok: [instance]
2026-02-26 19:18:36.682940 | controller |
2026-02-26 19:18:36.682950 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2026-02-26 19:18:36.683018 | controller | Thursday 26 February 2026  19:18:36 +0000 (0:00:00.207)       0:02:01.142 *****
2026-02-26 19:18:36.879402 | controller | ok: [instance]
2026-02-26 19:18:36.901863 | controller |
2026-02-26 19:18:36.901899 | controller | TASK [libvirt_manager : Download base image] ***********************************
2026-02-26 19:18:36.901909 | controller | Thursday 26 February 2026  19:18:36 +0000 (0:00:00.196)       0:02:01.338 *****
2026-02-26 19:18:36.901922 | controller | skipping: [instance]
2026-02-26 19:18:36.901963 | controller |
2026-02-26 19:18:36.901973 | controller | TASK [libvirt_manager : Check image] *******************************************
2026-02-26 19:18:36.901989 | controller | Thursday 26 February 2026  19:18:36 +0000 (0:00:00.022)       0:02:01.361 *****
2026-02-26 19:18:37.100829 | controller | ok: [instance]
2026-02-26 19:18:37.141921 | controller |
2026-02-26 19:18:37.141944 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2026-02-26 19:18:37.141953 | controller | Thursday 26 February 2026  19:18:37 +0000 (0:00:00.198)       0:02:01.560 *****
2026-02-26 19:18:37.141964 | controller | ok: [instance] => changed=false
2026-02-26 19:18:37.353400 | controller |   msg: All assertions passed
2026-02-26 19:18:37.353428 | controller |
2026-02-26 19:18:37.353436 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2026-02-26 19:18:37.353443 | controller | Thursday 26 February 2026  19:18:37 +0000 (0:00:00.040)       0:02:01.601 *****
2026-02-26 19:18:37.353453 | controller | ok: [instance]
2026-02-26 19:18:37.530173 | controller |
2026-02-26 19:18:37.530200 | controller | TASK [libvirt_manager : Get ssh key state] *************************************
2026-02-26 19:18:37.530209 | controller | Thursday 26 February 2026  19:18:37 +0000 (0:00:00.211)       0:02:01.812 *****
2026-02-26 19:18:37.530218 | controller | ok: [instance]
2026-02-26 19:18:37.917576 | controller |
2026-02-26 19:18:37.917606 | controller | TASK [libvirt_manager : Create temporary ssh keypair] **************************
2026-02-26 19:18:37.917623 | controller | Thursday 26 February 2026  19:18:37 +0000 (0:00:00.176)       0:02:01.989 *****
2026-02-26 19:18:37.917634 | controller | changed: [instance]
2026-02-26 19:18:38.088084 | controller |
2026-02-26 19:18:38.088111 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************
2026-02-26 19:18:38.088119 | controller | Thursday 26 February 2026  19:18:37 +0000 (0:00:00.387)       0:02:02.376 *****
2026-02-26 19:18:38.088129 | controller | ok: [instance]
2026-02-26 19:18:38.255807 | controller |
2026-02-26 19:18:38.255839 | controller | TASK [libvirt_manager : Slurp private key for later use] ***********************
2026-02-26 19:18:38.255849 | controller | Thursday 26 February 2026  19:18:38 +0000 (0:00:00.170)       0:02:02.547 *****
2026-02-26 19:18:38.255861 | controller | ok: [instance]
2026-02-26 19:18:38.660291 | controller |
2026-02-26 19:18:38.660323 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] ***
2026-02-26 19:18:38.660331 | controller | Thursday 26 February 2026  19:18:38 +0000 (0:00:00.167)       0:02:02.715 *****
2026-02-26 19:18:38.660342 | controller | changed: [instance]
2026-02-26 19:18:38.681795 | controller |
2026-02-26 19:18:38.681820 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] **************
2026-02-26 19:18:38.681829 | controller | Thursday 26 February 2026  19:18:38 +0000 (0:00:00.404)       0:02:03.119 *****
2026-02-26 19:18:38.681839 | controller | ok: [instance]
2026-02-26 19:18:38.912850 | controller |
2026-02-26 19:18:38.912884 | controller | TASK [libvirt_manager : List existing networks] ********************************
2026-02-26 19:18:38.912892 | controller | Thursday 26 February 2026  19:18:38 +0000 (0:00:00.021)       0:02:03.141 *****
2026-02-26 19:18:38.912903 | controller | ok: [instance]
2026-02-26 19:18:39.379679 | controller |
2026-02-26 19:18:39.379709 | controller | TASK [libvirt_manager : Gather pool fact] **************************************
2026-02-26 19:18:39.379717 | controller | Thursday 26 February 2026  19:18:38 +0000 (0:00:00.230)       0:02:03.372 *****
2026-02-26 19:18:39.379763 | controller | ok: [instance]
2026-02-26 19:18:39.379785 | controller |
2026-02-26 19:18:39.379937 | controller | TASK [libvirt_manager : Create and run VMs] ************************************
2026-02-26 19:18:39.380037 | controller | Thursday 26 February 2026  19:18:39 +0000 (0:00:00.467)       0:02:03.839 *****
2026-02-26 19:18:39.501002 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-02-26 19:18:39.501090 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-02-26 19:18:39.501244 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-02-26 19:18:39.501309 | controller |
2026-02-26 19:18:39.501430 | controller | TASK [libvirt_manager : Create VM image for compute-0] *************************
2026-02-26 19:18:39.501539 | controller | Thursday 26 February 2026  19:18:39 +0000 (0:00:00.121)       0:02:03.960 *****
2026-02-26 19:18:39.762512 | controller | changed: [instance]
2026-02-26 19:18:39.762559 | controller |
2026-02-26 19:18:39.762669 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ********
2026-02-26 19:18:39.762798 | controller | Thursday 26 February 2026  19:18:39 +0000 (0:00:00.261)       0:02:04.222 *****
2026-02-26 19:18:39.980767 | controller | changed: [instance]
2026-02-26 19:18:39.980817 | controller |
2026-02-26 19:18:39.980907 | controller | TASK [libvirt_manager : Define VMs for type compute-0] *************************
2026-02-26 19:18:39.980997 | controller | Thursday 26 February 2026  19:18:39 +0000 (0:00:00.218)       0:02:04.440 *****
2026-02-26 19:18:40.269231 | controller | changed: [instance]
2026-02-26 19:18:40.269277 | controller |
2026-02-26 19:18:40.269389 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] ***********
2026-02-26 19:18:40.269488 | controller | Thursday 26 February 2026  19:18:40 +0000 (0:00:00.288)       0:02:04.728 *****
2026-02-26 19:18:40.298419 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-02-26 19:18:40.298500 | controller |
2026-02-26 19:18:40.298593 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-02-26 19:18:40.298686 | controller | Thursday 26 February 2026  19:18:40 +0000 (0:00:00.029)       0:02:04.758 *****
2026-02-26 19:18:40.343955 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-02-26 19:18:40.344118 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-02-26 19:18:40.344277 | controller |
2026-02-26 19:18:40.344391 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-02-26 19:18:40.344482 | controller | Thursday 26 February 2026  19:18:40 +0000 (0:00:00.045)       0:02:04.803 *****
2026-02-26 19:18:40.575496 | controller | ok: [instance]
2026-02-26 19:18:40.619850 | controller |
2026-02-26 19:18:40.619875 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-02-26 19:18:40.619885 | controller | Thursday 26 February 2026  19:18:40 +0000 (0:00:00.231)       0:02:05.034 *****
2026-02-26 19:18:40.619896 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 19:18:40.620057 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 19:18:40.620073 | controller |
2026-02-26 19:18:40.620083 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-02-26 19:18:40.849213 | controller | Thursday 26 February 2026  19:18:40 +0000 (0:00:00.044)       0:02:05.079 *****
2026-02-26 19:18:40.849247 | controller | ok: [instance]
2026-02-26 19:18:41.048905 | controller |
2026-02-26 19:18:41.048950 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-02-26 19:18:41.048960 | controller | Thursday 26 February 2026  19:18:40 +0000 (0:00:00.229)       0:02:05.308 *****
2026-02-26 19:18:41.048974 | controller | ok: [instance]
2026-02-26 19:18:41.049009 | controller |
2026-02-26 19:18:41.049019 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************
2026-02-26 19:18:41.339641 | controller | Thursday 26 February 2026  19:18:41 +0000 (0:00:00.199)       0:02:05.508 *****
2026-02-26 19:18:41.339678 | controller | changed: [instance]
2026-02-26 19:18:41.571552 | controller |
2026-02-26 19:18:41.571579 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-02-26 19:18:41.571587 | controller | Thursday 26 February 2026  19:18:41 +0000 (0:00:00.290)       0:02:05.798 *****
2026-02-26 19:18:41.571597 | controller | ok: [instance]
2026-02-26 19:18:41.617840 | controller |
2026-02-26 19:18:41.617880 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-02-26 19:18:41.617891 | controller | Thursday 26 February 2026  19:18:41 +0000 (0:00:00.232)       0:02:06.030 *****
2026-02-26 19:18:41.617904 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 19:18:41.851828 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 19:18:41.851859 | controller |
2026-02-26 19:18:41.851869 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-02-26 19:18:41.851876 | controller | Thursday 26 February 2026  19:18:41 +0000 (0:00:00.046)       0:02:06.077 *****
2026-02-26 19:18:41.851888 | controller | ok: [instance]
2026-02-26 19:18:41.851919 | controller |
2026-02-26 19:18:41.852129 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-02-26 19:18:42.054804 | controller | Thursday 26 February 2026  19:18:41 +0000 (0:00:00.234)       0:02:06.311 *****
2026-02-26 19:18:42.054840 | controller | ok: [instance]
2026-02-26 19:18:43.344750 | controller |
2026-02-26 19:18:43.344780 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] *********
2026-02-26 19:18:43.344789 | controller | Thursday 26 February 2026  19:18:42 +0000 (0:00:00.202)       0:02:06.514 *****
2026-02-26 19:18:43.344799 | controller | changed: [instance]
2026-02-26 19:18:43.365890 | controller |
2026-02-26 19:18:43.365926 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] *****
2026-02-26 19:18:43.365936 | controller | Thursday 26 February 2026  19:18:43 +0000 (0:00:01.289)       0:02:07.804 *****
2026-02-26 19:18:43.365948 | controller | skipping: [instance]
2026-02-26 19:18:43.393876 | controller |
2026-02-26 19:18:43.393906 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ********
2026-02-26 19:18:43.393918 | controller | Thursday 26 February 2026  19:18:43 +0000 (0:00:00.021)       0:02:07.825 *****
2026-02-26 19:18:43.393933 | controller | skipping: [instance]
2026-02-26 19:18:43.394132 | controller |
2026-02-26 19:18:43.394159 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] **************
2026-02-26 19:18:43.424857 | controller | Thursday 26 February 2026  19:18:43 +0000 (0:00:00.028)       0:02:07.853 *****
2026-02-26 19:18:43.424886 | controller | skipping: [instance]
2026-02-26 19:18:43.425096 | controller |
2026-02-26 19:18:43.425126 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] ***********************
2026-02-26 19:18:43.452195 | controller | Thursday 26 February 2026  19:18:43 +0000 (0:00:00.030)       0:02:07.884 *****
2026-02-26 19:18:43.452221 | controller | skipping: [instance]
2026-02-26 19:18:44.673714 | controller |
2026-02-26 19:18:44.673792 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-02-26 19:18:44.673805 | controller | Thursday 26 February 2026  19:18:43 +0000 (0:00:00.027)       0:02:07.911 *****
2026-02-26 19:18:44.673816 | controller | changed: [instance]
2026-02-26 19:18:44.711286 | controller |
2026-02-26 19:18:44.711309 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-02-26 19:18:44.711318 | controller | Thursday 26 February 2026  19:18:44 +0000 (0:00:01.221)       0:02:09.132 *****
2026-02-26 19:18:44.711329 | controller | ok: [instance]
2026-02-26 19:18:44.765835 | controller |
2026-02-26 19:18:44.765879 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-02-26 19:18:44.765889 | controller | Thursday 26 February 2026  19:18:44 +0000 (0:00:00.037)       0:02:09.170 *****
2026-02-26 19:18:44.765907 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2026-02-26 19:18:44.961847 | controller |
2026-02-26 19:18:44.961874 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2026-02-26 19:18:44.961882 | controller | Thursday 26 February 2026  19:18:44 +0000 (0:00:00.054)       0:02:09.225 *****
2026-02-26 19:18:44.961893 | controller | ok: [instance]
2026-02-26 19:18:44.961918 | controller |
2026-02-26 19:18:44.962221 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2026-02-26 19:18:45.023837 | controller | Thursday 26 February 2026  19:18:44 +0000 (0:00:00.196)       0:02:09.421 *****
2026-02-26 19:18:45.023866 | controller | ok: [instance]
2026-02-26 19:18:45.024256 | controller |
2026-02-26 19:18:45.069753 | controller | TASK [libvirt_manager : Define the user data] **********************************
2026-02-26 19:18:45.069777 | controller | Thursday 26 February 2026  19:18:45 +0000 (0:00:00.062)       0:02:09.483 *****
2026-02-26 19:18:45.069790 | controller | ok: [instance]
2026-02-26 19:18:45.112657 | controller |
2026-02-26 19:18:45.112679 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2026-02-26 19:18:45.112688 | controller | Thursday 26 February 2026  19:18:45 +0000 (0:00:00.045)       0:02:09.529 *****
2026-02-26 19:18:45.112699 | controller | skipping: [instance]
2026-02-26 19:18:45.156753 | controller |
2026-02-26 19:18:45.156773 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2026-02-26 19:18:45.156780 | controller | Thursday 26 February 2026  19:18:45 +0000 (0:00:00.042)       0:02:09.572 *****
2026-02-26 19:18:45.156789 | controller | skipping: [instance]
2026-02-26 19:18:45.220203 | controller |
2026-02-26 19:18:45.220226 | controller | TASK [Call the config_drive role] **********************************************
2026-02-26 19:18:45.220235 | controller | Thursday 26 February 2026  19:18:45 +0000 (0:00:00.044)       0:02:09.616 *****
2026-02-26 19:18:45.220245 | controller |
2026-02-26 19:18:45.623585 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2026-02-26 19:18:45.623617 | controller | Thursday 26 February 2026  19:18:45 +0000 (0:00:00.063)       0:02:09.679 *****
2026-02-26 19:18:45.623629 | controller | ok: [instance] => (item=artifacts)
2026-02-26 19:18:46.862582 | controller | ok: [instance] => (item=logs)
2026-02-26 19:18:46.862618 | controller |
2026-02-26 19:18:46.862629 | controller | TASK [config_drive : Install required RPM packages] ****************************
2026-02-26 19:18:46.862642 | controller | Thursday 26 February 2026  19:18:45 +0000 (0:00:00.403)       0:02:10.082 *****
2026-02-26 19:18:46.862653 | controller | ok: [instance]
2026-02-26 19:18:47.078703 | controller |
2026-02-26 19:18:47.078823 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2026-02-26 19:18:47.078837 | controller | Thursday 26 February 2026  19:18:46 +0000 (0:00:01.238)       0:02:11.321 *****
2026-02-26 19:18:47.078848 | controller | changed: [instance]
2026-02-26 19:18:47.451169 | controller |
2026-02-26 19:18:47.451197 | controller | TASK [config_drive : Generate meta-data] ***************************************
2026-02-26 19:18:47.451205 | controller | Thursday 26 February 2026  19:18:47 +0000 (0:00:00.216)       0:02:11.538 *****
2026-02-26 19:18:47.451215 | controller | changed: [instance]
2026-02-26 19:18:47.822898 | controller |
2026-02-26 19:18:47.822937 | controller | TASK [config_drive : Generate user-data] ***************************************
2026-02-26 19:18:47.822945 | controller | Thursday 26 February 2026  19:18:47 +0000 (0:00:00.372)       0:02:11.910 *****
2026-02-26 19:18:47.822955 | controller | changed: [instance]
2026-02-26 19:18:47.869645 | controller |
2026-02-26 19:18:47.869675 | controller | TASK [config_drive : Generate network-data] ************************************
2026-02-26 19:18:47.869684 | controller | Thursday 26 February 2026  19:18:47 +0000 (0:00:00.371)       0:02:12.282 *****
2026-02-26 19:18:47.869694 | controller | skipping: [instance]
2026-02-26 19:18:48.074790 | controller |
2026-02-26 19:18:48.074818 | controller | TASK [config_drive : Check ISO availability] ***********************************
2026-02-26 19:18:48.074826 | controller | Thursday 26 February 2026  19:18:47 +0000 (0:00:00.046)       0:02:12.329 *****
2026-02-26 19:18:48.074840 | controller | ok: [instance]
2026-02-26 19:18:48.118922 | controller |
2026-02-26 19:18:48.118953 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2026-02-26 19:18:48.118963 | controller | Thursday 26 February 2026  19:18:48 +0000 (0:00:00.205)       0:02:12.534 *****
2026-02-26 19:18:48.118975 | controller | skipping: [instance]
2026-02-26 19:18:48.356876 | controller |
2026-02-26 19:18:48.356904 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2026-02-26 19:18:48.356912 | controller | Thursday 26 February 2026  19:18:48 +0000 (0:00:00.044)       0:02:12.578 *****
2026-02-26 19:18:48.356923 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log
2026-02-26 19:18:48.635713 | controller | changed: [instance]
2026-02-26 19:18:48.635776 | controller |
2026-02-26 19:18:48.635786 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-02-26 19:18:48.635794 | controller | Thursday 26 February 2026  19:18:48 +0000 (0:00:00.237)       0:02:12.816 *****
2026-02-26 19:18:48.635806 | controller | changed: [instance]
2026-02-26 19:18:48.682880 | controller |
2026-02-26 19:18:48.682919 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-02-26 19:18:48.682929 | controller | Thursday 26 February 2026  19:18:48 +0000 (0:00:00.278)       0:02:13.094 *****
2026-02-26 19:18:48.682941 | controller | skipping: [instance]
2026-02-26 19:18:48.682973 | controller |
2026-02-26 19:18:48.682983 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ********************
2026-02-26 19:18:48.683070 | controller | Thursday 26 February 2026  19:18:48 +0000 (0:00:00.047)       0:02:13.142 *****
2026-02-26 19:18:48.712280 | controller | skipping: [instance]
2026-02-26 19:18:48.958708 | controller |
2026-02-26 19:18:48.958761 | controller | TASK [libvirt_manager : Create VM image for controller-0] **********************
2026-02-26 19:18:48.958772 | controller | Thursday 26 February 2026  19:18:48 +0000 (0:00:00.029)       0:02:13.171 *****
2026-02-26 19:18:48.958783 | controller | changed: [instance]
2026-02-26 19:18:49.186679 | controller |
2026-02-26 19:18:49.186712 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] *****
2026-02-26 19:18:49.186722 | controller | Thursday 26 February 2026  19:18:48 +0000 (0:00:00.246)       0:02:13.417 *****
2026-02-26 19:18:49.186768 | controller | changed: [instance]
2026-02-26 19:18:49.517270 | controller |
2026-02-26 19:18:49.517300 | controller | TASK [libvirt_manager : Define VMs for type controller-0] **********************
2026-02-26 19:18:49.517308 | controller | Thursday 26 February 2026  19:18:49 +0000 (0:00:00.227)       0:02:13.645 *****
2026-02-26 19:18:49.517323 | controller | changed: [instance]
2026-02-26 19:18:49.547285 | controller |
2026-02-26 19:18:49.547305 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ********
2026-02-26 19:18:49.547313 | controller | Thursday 26 February 2026  19:18:49 +0000 (0:00:00.330)       0:02:13.976 *****
2026-02-26 19:18:49.547322 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-02-26 19:18:49.626706 | controller |
2026-02-26 19:18:49.626785 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-02-26 19:18:49.626797 | controller | Thursday 26 February 2026  19:18:49 +0000 (0:00:00.029)       0:02:14.006 *****
2026-02-26 19:18:49.626808 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-02-26 19:18:49.863891 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-02-26 19:18:49.863925 | controller |
2026-02-26 19:18:49.863935 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-02-26 19:18:49.863942 | controller | Thursday 26 February 2026  19:18:49 +0000 (0:00:00.079)       0:02:14.086 *****
2026-02-26 19:18:49.863961 | controller | ok: [instance]
2026-02-26 19:18:49.863983 | controller |
2026-02-26 19:18:49.863992 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-02-26 19:18:49.864106 | controller | Thursday 26 February 2026  19:18:49 +0000 (0:00:00.237)       0:02:14.323 *****
2026-02-26 19:18:49.912316 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 19:18:50.145366 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 19:18:50.145396 | controller |
2026-02-26 19:18:50.145405 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-02-26 19:18:50.145411 | controller | Thursday 26 February 2026  19:18:49 +0000 (0:00:00.048)       0:02:14.371 *****
2026-02-26 19:18:50.145420 | controller | ok: [instance]
2026-02-26 19:18:50.346815 | controller |
2026-02-26 19:18:50.346848 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-02-26 19:18:50.346856 | controller | Thursday 26 February 2026  19:18:50 +0000 (0:00:00.233)       0:02:14.604 *****
2026-02-26 19:18:50.346866 | controller | ok: [instance]
2026-02-26 19:18:50.346888 | controller |
2026-02-26 19:18:50.346896 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] *********
2026-02-26 19:18:50.346972 | controller | Thursday 26 February 2026  19:18:50 +0000 (0:00:00.201)       0:02:14.806 *****
2026-02-26 19:18:50.637397 | controller | changed: [instance]
2026-02-26 19:18:50.873815 | controller |
2026-02-26 19:18:50.873845 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-02-26 19:18:50.873853 | controller | Thursday 26 February 2026  19:18:50 +0000 (0:00:00.290)       0:02:15.096 *****
2026-02-26 19:18:50.873863 | controller | ok: [instance]
2026-02-26 19:18:50.874091 | controller |
2026-02-26 19:18:50.874105 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-02-26 19:18:50.918843 | controller | Thursday 26 February 2026  19:18:50 +0000 (0:00:00.236)       0:02:15.333 *****
2026-02-26 19:18:50.918879 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 19:18:50.918907 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 19:18:50.918915 | controller |
2026-02-26 19:18:50.919121 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-02-26 19:18:51.157846 | controller | Thursday 26 February 2026  19:18:50 +0000 (0:00:00.044)       0:02:15.378 *****
2026-02-26 19:18:51.157887 | controller | ok: [instance]
2026-02-26 19:18:51.157919 | controller |
2026-02-26 19:18:51.158126 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-02-26 19:18:51.362559 | controller | Thursday 26 February 2026  19:18:51 +0000 (0:00:00.238)       0:02:15.617 *****
2026-02-26 19:18:51.362593 | controller | ok: [instance]
2026-02-26 19:18:51.655794 | controller |
2026-02-26 19:18:51.655827 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ******
2026-02-26 19:18:51.655836 | controller | Thursday 26 February 2026  19:18:51 +0000 (0:00:00.204)       0:02:15.821 *****
2026-02-26 19:18:51.655850 | controller | changed: [instance]
2026-02-26 19:18:51.678161 | controller |
2026-02-26 19:18:51.678188 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] ***
2026-02-26 19:18:51.678197 | controller | Thursday 26 February 2026  19:18:51 +0000 (0:00:00.293)       0:02:16.115 *****
2026-02-26 19:18:51.678208 | controller | skipping: [instance]
2026-02-26 19:18:51.706858 | controller |
2026-02-26 19:18:51.706915 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] *****
2026-02-26 19:18:51.706925 | controller | Thursday 26 February 2026  19:18:51 +0000 (0:00:00.022)       0:02:16.137 *****
2026-02-26 19:18:51.706939 | controller | skipping: [instance]
2026-02-26 19:18:51.734807 | controller |
2026-02-26 19:18:51.734844 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] ***********
2026-02-26 19:18:51.734853 | controller | Thursday 26 February 2026  19:18:51 +0000 (0:00:00.028)       0:02:16.166 *****
2026-02-26 19:18:51.734866 | controller | skipping: [instance]
2026-02-26 19:18:51.734907 | controller |
2026-02-26 19:18:51.735103 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ********************
2026-02-26 19:18:51.761838 | controller | Thursday 26 February 2026  19:18:51 +0000 (0:00:00.028)       0:02:16.194 *****
2026-02-26 19:18:51.761853 | controller | skipping: [instance]
2026-02-26 19:18:51.761958 | controller |
2026-02-26 19:18:51.761968 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-02-26 19:18:51.761978 | controller | Thursday 26 February 2026  19:18:51 +0000 (0:00:00.026)       0:02:16.221 *****
2026-02-26 19:18:51.984251 | controller | changed: [instance]
2026-02-26 19:18:52.022345 | controller |
2026-02-26 19:18:52.022370 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-02-26 19:18:52.022380 | controller | Thursday 26 February 2026  19:18:51 +0000 (0:00:00.221)       0:02:16.443 *****
2026-02-26 19:18:52.022392 | controller | ok: [instance]
2026-02-26 19:18:52.079578 | controller |
2026-02-26 19:18:52.079603 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-02-26 19:18:52.079612 | controller | Thursday 26 February 2026  19:18:52 +0000 (0:00:00.038)       0:02:16.481 *****
2026-02-26 19:18:52.079624 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2026-02-26 19:18:52.276857 | controller |
2026-02-26 19:18:52.276895 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2026-02-26 19:18:52.276903 | controller | Thursday 26 February 2026  19:18:52 +0000 (0:00:00.057)       0:02:16.538 *****
2026-02-26 19:18:52.276914 | controller | ok: [instance]
2026-02-26 19:18:52.276972 | controller |
2026-02-26 19:18:52.276980 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2026-02-26 19:18:52.276988 | controller | Thursday 26 February 2026  19:18:52 +0000 (0:00:00.197)       0:02:16.736 *****
2026-02-26 19:18:52.341380 | controller | ok: [instance]
2026-02-26 19:18:52.389636 | controller |
2026-02-26 19:18:52.389667 | controller | TASK [libvirt_manager : Define the user data] **********************************
2026-02-26 19:18:52.389676 | controller | Thursday 26 February 2026  19:18:52 +0000 (0:00:00.064)       0:02:16.800 *****
2026-02-26 19:18:52.389687 | controller | ok: [instance]
2026-02-26 19:18:52.433653 | controller |
2026-02-26 19:18:52.433688 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2026-02-26 19:18:52.433702 | controller | Thursday 26 February 2026  19:18:52 +0000 (0:00:00.048)       0:02:16.849 *****
2026-02-26 19:18:52.433715 | controller | skipping: [instance]
2026-02-26 19:18:52.478494 | controller |
2026-02-26 19:18:52.478517 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2026-02-26 19:18:52.478525 | controller | Thursday 26 February 2026  19:18:52 +0000 (0:00:00.043)       0:02:16.893 *****
2026-02-26 19:18:52.478535 | controller | skipping: [instance]
2026-02-26 19:18:52.538908 | controller |
2026-02-26 19:18:52.538939 | controller | TASK [Call the config_drive role] **********************************************
2026-02-26 19:18:52.538949 | controller | Thursday 26 February 2026  19:18:52 +0000 (0:00:00.044)       0:02:16.937 *****
2026-02-26 19:18:52.538962 | controller |
2026-02-26 19:18:52.539010 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2026-02-26 19:18:52.539114 | controller | Thursday 26 February 2026  19:18:52 +0000 (0:00:00.060)       0:02:16.998 *****
2026-02-26 19:18:52.943687 | controller | ok: [instance] => (item=artifacts)
2026-02-26 19:18:54.189766 | controller | ok: [instance] => (item=logs)
2026-02-26 19:18:54.189799 | controller |
2026-02-26 19:18:54.189807 | controller | TASK [config_drive : Install required RPM packages] ****************************
2026-02-26 19:18:54.189813 | controller | Thursday 26 February 2026  19:18:52 +0000 (0:00:00.404)       0:02:17.403 *****
2026-02-26 19:18:54.189823 | controller | ok: [instance]
2026-02-26 19:18:54.403317 | controller |
2026-02-26 19:18:54.403343 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2026-02-26 19:18:54.403351 | controller | Thursday 26 February 2026  19:18:54 +0000 (0:00:01.246)       0:02:18.649 *****
2026-02-26 19:18:54.403361 | controller | changed: [instance]
2026-02-26 19:18:54.774409 | controller |
2026-02-26 19:18:54.774435 | controller | TASK [config_drive : Generate meta-data] ***************************************
2026-02-26 19:18:54.774443 | controller | Thursday 26 February 2026  19:18:54 +0000 (0:00:00.213)       0:02:18.862 *****
2026-02-26 19:18:54.774452 | controller | changed: [instance]
2026-02-26 19:18:55.150640 | controller |
2026-02-26 19:18:55.150670 | controller | TASK [config_drive : Generate user-data] ***************************************
2026-02-26 19:18:55.150678 | controller | Thursday 26 February 2026  19:18:54 +0000 (0:00:00.371)       0:02:19.233 *****
2026-02-26 19:18:55.150688 | controller | changed: [instance]
2026-02-26 19:18:55.197227 | controller |
2026-02-26 19:18:55.197249 | controller | TASK [config_drive : Generate network-data] ************************************
2026-02-26 19:18:55.197258 | controller | Thursday 26 February 2026  19:18:55 +0000 (0:00:00.376)       0:02:19.609 *****
2026-02-26 19:18:55.197269 | controller | skipping: [instance]
2026-02-26 19:18:55.396269 | controller |
2026-02-26 19:18:55.396289 | controller | TASK [config_drive : Check ISO availability] ***********************************
2026-02-26 19:18:55.396297 | controller | Thursday 26 February 2026  19:18:55 +0000 (0:00:00.046)       0:02:19.656 *****
2026-02-26 19:18:55.396306 | controller | ok: [instance]
2026-02-26 19:18:55.437913 | controller |
2026-02-26 19:18:55.437954 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2026-02-26 19:18:55.437970 | controller | Thursday 26 February 2026  19:18:55 +0000 (0:00:00.199)       0:02:19.855 *****
2026-02-26 19:18:55.437984 | controller | skipping: [instance]
2026-02-26 19:18:55.438017 | controller |
2026-02-26 19:18:55.438027 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2026-02-26 19:18:55.438088 | controller | Thursday 26 February 2026  19:18:55 +0000 (0:00:00.041)       0:02:19.897 *****
2026-02-26 19:18:55.669803 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log
2026-02-26 19:18:55.670160 | controller | changed: [instance]
2026-02-26 19:18:55.946693 | controller |
2026-02-26 19:18:55.946760 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-02-26 19:18:55.946776 | controller | Thursday 26 February 2026  19:18:55 +0000 (0:00:00.232)       0:02:20.129 *****
2026-02-26 19:18:55.946788 | controller | changed: [instance]
2026-02-26 19:18:55.990695 | controller |
2026-02-26 19:18:55.990720 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-02-26 19:18:55.990758 | controller | Thursday 26 February 2026  19:18:55 +0000 (0:00:00.276)       0:02:20.405 *****
2026-02-26 19:18:55.990774 | controller | skipping: [instance]
2026-02-26 19:18:56.017834 | controller |
2026-02-26 19:18:56.017857 | controller | TASK [libvirt_manager : Configure boot order for controller-0] *****************
2026-02-26 19:18:56.017867 | controller | Thursday 26 February 2026  19:18:55 +0000 (0:00:00.044)       0:02:20.450 *****
2026-02-26 19:18:56.017878 | controller | skipping: [instance]
2026-02-26 19:18:56.264441 | controller |
2026-02-26 19:18:56.264469 | controller | TASK [libvirt_manager : Create VM image for crc-0] *****************************
2026-02-26 19:18:56.264481 | controller | Thursday 26 February 2026  19:18:56 +0000 (0:00:00.027)       0:02:20.477 *****
2026-02-26 19:18:56.264491 | controller | changed: [instance]
2026-02-26 19:18:56.487859 | controller |
2026-02-26 19:18:56.487889 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************
2026-02-26 19:18:56.487903 | controller | Thursday 26 February 2026  19:18:56 +0000 (0:00:00.246)       0:02:20.723 *****
2026-02-26 19:18:56.487914 | controller | changed: [instance]
2026-02-26 19:18:56.487920 | controller |
2026-02-26 19:18:56.487925 | controller | TASK [libvirt_manager : Define VMs for type crc-0] *****************************
2026-02-26 19:18:56.487933 | controller | Thursday 26 February 2026  19:18:56 +0000 (0:00:00.223)       0:02:20.947 *****
2026-02-26 19:18:56.777481 | controller | changed: [instance]
2026-02-26 19:18:56.806230 | controller |
2026-02-26 19:18:56.806253 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] ***************
2026-02-26 19:18:56.806263 | controller | Thursday 26 February 2026  19:18:56 +0000 (0:00:00.289)       0:02:21.236 *****
2026-02-26 19:18:56.806275 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-02-26 19:18:56.850892 | controller |
2026-02-26 19:18:56.850915 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-02-26 19:18:56.850925 | controller | Thursday 26 February 2026  19:18:56 +0000 (0:00:00.028)       0:02:21.265 *****
2026-02-26 19:18:56.850936 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-02-26 19:18:57.082063 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-02-26 19:18:57.082087 | controller |
2026-02-26 19:18:57.082094 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-02-26 19:18:57.082100 | controller | Thursday 26 February 2026  19:18:56 +0000 (0:00:00.044)       0:02:21.310 *****
2026-02-26 19:18:57.082110 | controller | ok: [instance]
2026-02-26 19:18:57.082133 | controller |
2026-02-26 19:18:57.082374 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-02-26 19:18:57.082485 | controller | Thursday 26 February 2026  19:18:57 +0000 (0:00:00.231)       0:02:21.541 *****
2026-02-26 19:18:57.127928 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 19:18:57.359926 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 19:18:57.359976 | controller |
2026-02-26 19:18:57.359990 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-02-26 19:18:57.360001 | controller | Thursday 26 February 2026  19:18:57 +0000 (0:00:00.045)       0:02:21.587 *****
2026-02-26 19:18:57.360019 | controller | ok: [instance]
2026-02-26 19:18:57.360049 | controller |
2026-02-26 19:18:57.360064 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-02-26 19:18:57.562453 | controller | Thursday 26 February 2026  19:18:57 +0000 (0:00:00.232)       0:02:21.819 *****
2026-02-26 19:18:57.562490 | controller | ok: [instance]
2026-02-26 19:18:57.852224 | controller |
2026-02-26 19:18:57.852248 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] ****************
2026-02-26 19:18:57.852257 | controller | Thursday 26 February 2026  19:18:57 +0000 (0:00:00.202)       0:02:22.021 *****
2026-02-26 19:18:57.852267 | controller | changed: [instance]
2026-02-26 19:18:58.082885 | controller |
2026-02-26 19:18:58.082920 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-02-26 19:18:58.082930 | controller | Thursday 26 February 2026  19:18:57 +0000 (0:00:00.289)       0:02:22.311 *****
2026-02-26 19:18:58.082943 | controller | ok: [instance]
2026-02-26 19:18:58.082978 | controller |
2026-02-26 19:18:58.082988 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-02-26 19:18:58.127919 | controller | Thursday 26 February 2026  19:18:58 +0000 (0:00:00.230)       0:02:22.542 *****
2026-02-26 19:18:58.127974 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 19:18:58.128020 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 19:18:58.128033 | controller |
2026-02-26 19:18:58.128067 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-02-26 19:18:58.128178 | controller | Thursday 26 February 2026  19:18:58 +0000 (0:00:00.045)       0:02:22.587 *****
2026-02-26 19:18:58.358814 | controller | ok: [instance]
2026-02-26 19:18:58.358846 | controller |
2026-02-26 19:18:58.358856 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-02-26 19:18:58.358866 | controller | Thursday 26 February 2026  19:18:58 +0000 (0:00:00.230)       0:02:22.818 *****
2026-02-26 19:18:58.564288 | controller | ok: [instance]
2026-02-26 19:18:58.858266 | controller |
2026-02-26 19:18:58.858297 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] *************
2026-02-26 19:18:58.858305 | controller | Thursday 26 February 2026  19:18:58 +0000 (0:00:00.205)       0:02:23.023 *****
2026-02-26 19:18:58.858316 | controller | changed: [instance]
2026-02-26 19:18:58.880568 | controller |
2026-02-26 19:18:58.880588 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] *********
2026-02-26 19:18:58.880596 | controller | Thursday 26 February 2026  19:18:58 +0000 (0:00:00.293)       0:02:23.317 *****
2026-02-26 19:18:58.880609 | controller | skipping: [instance]
2026-02-26 19:18:58.909825 | controller |
2026-02-26 19:18:58.909856 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************
2026-02-26 19:18:58.909866 | controller | Thursday 26 February 2026  19:18:58 +0000 (0:00:00.022)       0:02:23.339 *****
2026-02-26 19:18:58.909878 | controller | skipping: [instance]
2026-02-26 19:18:58.937884 | controller |
2026-02-26 19:18:58.937919 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ******************
2026-02-26 19:18:58.937929 | controller | Thursday 26 February 2026  19:18:58 +0000 (0:00:00.029)       0:02:23.369 *****
2026-02-26 19:18:58.937941 | controller | skipping: [instance]
2026-02-26 19:18:58.937972 | controller |
2026-02-26 19:18:58.937983 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] ***************************
2026-02-26 19:18:58.938123 | controller | Thursday 26 February 2026  19:18:58 +0000 (0:00:00.028)       0:02:23.397 *****
2026-02-26 19:18:58.965685 | controller | skipping: [instance]
2026-02-26 19:18:59.183378 | controller |
2026-02-26 19:18:59.183406 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-02-26 19:18:59.183414 | controller | Thursday 26 February 2026  19:18:58 +0000 (0:00:00.027)       0:02:23.425 *****
2026-02-26 19:18:59.183424 | controller | changed: [instance]
2026-02-26 19:18:59.219824 | controller |
2026-02-26 19:18:59.219847 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-02-26 19:18:59.219856 | controller | Thursday 26 February 2026  19:18:59 +0000 (0:00:00.217)       0:02:23.642 *****
2026-02-26 19:18:59.219867 | controller | ok: [instance]
2026-02-26 19:18:59.219926 | controller |
2026-02-26 19:18:59.219945 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-02-26 19:18:59.219957 | controller | Thursday 26 February 2026  19:18:59 +0000 (0:00:00.036)       0:02:23.679 *****
2026-02-26 19:18:59.246432 | controller | skipping: [instance]
2026-02-26 19:18:59.272753 | controller |
2026-02-26 19:18:59.272777 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-02-26 19:18:59.272787 | controller | Thursday 26 February 2026  19:18:59 +0000 (0:00:00.026)       0:02:23.705 *****
2026-02-26 19:18:59.272797 | controller | skipping: [instance]
2026-02-26 19:18:59.318182 | controller |
2026-02-26 19:18:59.318205 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-02-26 19:18:59.318215 | controller | Thursday 26 February 2026  19:18:59 +0000 (0:00:00.026)       0:02:23.732 *****
2026-02-26 19:18:59.318225 | controller | skipping: [instance]
2026-02-26 19:18:59.342626 | controller |
2026-02-26 19:18:59.342650 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************
2026-02-26 19:18:59.342660 | controller | Thursday 26 February 2026  19:18:59 +0000 (0:00:00.045)       0:02:23.777 *****
2026-02-26 19:18:59.342671 | controller | skipping: [instance]
2026-02-26 19:18:59.404387 | controller |
2026-02-26 19:18:59.404411 | controller | TASK [libvirt_manager : Start (power-on) VMs] **********************************
2026-02-26 19:18:59.404421 | controller | Thursday 26 February 2026  19:18:59 +0000 (0:00:00.024)       0:02:23.802 *****
2026-02-26 19:18:59.404431 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance
2026-02-26 19:18:59.642157 | controller |
2026-02-26 19:18:59.642187 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] *****************
2026-02-26 19:18:59.642200 | controller | Thursday 26 February 2026  19:18:59 +0000 (0:00:00.061)       0:02:23.863 *****
2026-02-26 19:18:59.642211 | controller | ok: [instance] => (item=crc)
2026-02-26 19:19:01.715364 | controller |
2026-02-26 19:19:01.715393 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] **********************
2026-02-26 19:19:01.715401 | controller | Thursday 26 February 2026  19:18:59 +0000 (0:00:00.237)       0:02:24.101 *****
2026-02-26 19:19:01.715412 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-02-26 19:19:02.568399 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-02-26 19:19:02.568428 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-02-26 19:19:02.568436 | controller |
2026-02-26 19:19:02.568442 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-02-26 19:19:02.568448 | controller | Thursday 26 February 2026  19:19:01 +0000 (0:00:02.073)       0:02:26.174 *****
2026-02-26 19:19:02.568457 | controller | changed: [instance]
2026-02-26 19:19:03.354997 | controller |
2026-02-26 19:19:03.355028 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-02-26 19:19:03.355036 | controller | Thursday 26 February 2026  19:19:02 +0000 (0:00:00.853)       0:02:27.027 *****
2026-02-26 19:19:03.355046 | controller | changed: [instance]
2026-02-26 19:19:04.166256 | controller |
2026-02-26 19:19:04.166285 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-02-26 19:19:04.166293 | controller | Thursday 26 February 2026  19:19:03 +0000 (0:00:00.786)       0:02:27.814 *****
2026-02-26 19:19:04.166303 | controller | changed: [instance]
2026-02-26 19:19:04.887255 | controller |
2026-02-26 19:19:04.887284 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] ***************************
2026-02-26 19:19:04.887296 | controller | Thursday 26 February 2026  19:19:04 +0000 (0:00:00.811)       0:02:28.625 *****
2026-02-26 19:19:04.887307 | controller | changed: [instance] => (item=compute-0.utility)
2026-02-26 19:19:27.860451 | controller | changed: [instance] => (item=controller-0.utility)
2026-02-26 19:19:27.860490 | controller | changed: [instance] => (item=crc-0.utility)
2026-02-26 19:19:27.860499 | controller |
2026-02-26 19:19:27.860505 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] ****************************
2026-02-26 19:19:27.860511 | controller | Thursday 26 February 2026  19:19:04 +0000 (0:00:00.720)       0:02:29.345 *****
2026-02-26 19:19:27.860522 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2026-02-26 19:19:27.860545 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left).
2026-02-26 19:19:27.860678 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left).
2026-02-26 19:19:27.860692 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left).
2026-02-26 19:19:27.860795 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left).
2026-02-26 19:19:27.860906 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left).
2026-02-26 19:19:27.860990 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left).
2026-02-26 19:19:27.861090 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j646319788517.24731', 'results_file': '/home/zuul/.ansible_async/j646319788517.24731', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'})
2026-02-26 19:19:27.861195 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j849429344101.24749', 'results_file': '/home/zuul/.ansible_async/j849429344101.24749', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'})
2026-02-26 19:19:27.861294 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j624817604406.24765', 'results_file': '/home/zuul/.ansible_async/j624817604406.24765', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'})
2026-02-26 19:19:27.861384 | controller |
2026-02-26 19:19:27.861482 | controller | TASK [libvirt_manager : Configure managed VMs] *********************************
2026-02-26 19:19:27.861599 | controller | Thursday 26 February 2026  19:19:27 +0000 (0:00:22.973)       0:02:52.319 *****
2026-02-26 19:19:27.981414 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-02-26 19:19:27.981495 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-02-26 19:19:27.981605 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-02-26 19:19:27.981717 | controller |
2026-02-26 19:19:27.981862 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-02-26 19:19:27.981933 | controller | Thursday 26 February 2026  19:19:27 +0000 (0:00:00.121)       0:02:52.441 *****
2026-02-26 19:19:28.009347 | controller | skipping: [instance]
2026-02-26 19:19:28.009423 | controller |
2026-02-26 19:19:28.009523 | controller | TASK [Push ssh jumper/configuration for compute-0] *****************************
2026-02-26 19:19:28.009622 | controller | Thursday 26 February 2026  19:19:28 +0000 (0:00:00.028)       0:02:52.469 *****
2026-02-26 19:19:28.049226 | controller |
2026-02-26 19:19:28.049312 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-02-26 19:19:28.049410 | controller | Thursday 26 February 2026  19:19:28 +0000 (0:00:00.039)       0:02:52.509 *****
2026-02-26 19:19:28.128937 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2026-02-26 19:19:28.129019 | controller |
2026-02-26 19:19:28.129133 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-02-26 19:19:28.129217 | controller | Thursday 26 February 2026  19:19:28 +0000 (0:00:00.079)       0:02:52.588 *****
2026-02-26 19:19:28.368114 | controller | changed: [instance]
2026-02-26 19:19:28.587385 | controller |
2026-02-26 19:19:28.587416 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-02-26 19:19:28.587424 | controller | Thursday 26 February 2026  19:19:28 +0000 (0:00:00.238)       0:02:52.827 *****
2026-02-26 19:19:28.587434 | controller | changed: [instance]
2026-02-26 19:19:28.991304 | controller |
2026-02-26 19:19:28.991335 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] *******************
2026-02-26 19:19:28.991343 | controller | Thursday 26 February 2026  19:19:28 +0000 (0:00:00.219)       0:02:53.046 *****
2026-02-26 19:19:28.991353 | controller | changed: [instance]
2026-02-26 19:19:29.019582 | controller |
2026-02-26 19:19:29.019657 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ******************
2026-02-26 19:19:29.019666 | controller | Thursday 26 February 2026  19:19:28 +0000 (0:00:00.404)       0:02:53.450 *****
2026-02-26 19:19:29.019682 | controller | skipping: [instance]
2026-02-26 19:19:29.019705 | controller |
2026-02-26 19:19:29.019714 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-02-26 19:19:29.047148 | controller | Thursday 26 February 2026  19:19:29 +0000 (0:00:00.028)       0:02:53.479 *****
2026-02-26 19:19:29.047188 | controller | skipping: [instance]
2026-02-26 19:19:29.047241 | controller |
2026-02-26 19:19:29.047366 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] *****************
2026-02-26 19:19:29.047528 | controller | Thursday 26 February 2026  19:19:29 +0000 (0:00:00.027)       0:02:53.506 *****
2026-02-26 19:19:29.116965 | controller | skipping: [instance]
2026-02-26 19:19:29.117027 | controller |
2026-02-26 19:19:29.117036 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ******************
2026-02-26 19:19:29.117045 | controller | Thursday 26 February 2026  19:19:29 +0000 (0:00:00.069)       0:02:53.576 *****
2026-02-26 19:19:29.166398 | controller | skipping: [instance]
2026-02-26 19:19:29.166465 | controller |
2026-02-26 19:19:29.166493 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-02-26 19:19:29.166615 | controller | Thursday 26 February 2026  19:19:29 +0000 (0:00:00.049)       0:02:53.626 *****
2026-02-26 19:19:29.190067 | controller | skipping: [instance]
2026-02-26 19:19:29.190145 | controller |
2026-02-26 19:19:29.190287 | controller | TASK [Push ssh jumper/configuration for controller-0] **************************
2026-02-26 19:19:29.190353 | controller | Thursday 26 February 2026  19:19:29 +0000 (0:00:00.023)       0:02:53.649 *****
2026-02-26 19:19:29.232009 | controller |
2026-02-26 19:19:29.232072 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-02-26 19:19:29.232210 | controller | Thursday 26 February 2026  19:19:29 +0000 (0:00:00.041)       0:02:53.691 *****
2026-02-26 19:19:29.318321 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2026-02-26 19:19:29.318390 | controller |
2026-02-26 19:19:29.318476 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-02-26 19:19:29.318572 | controller | Thursday 26 February 2026  19:19:29 +0000 (0:00:00.086)       0:02:53.777 *****
2026-02-26 19:19:29.589705 | controller | ok: [instance]
2026-02-26 19:19:29.589793 | controller |
2026-02-26 19:19:29.589835 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-02-26 19:19:29.589938 | controller | Thursday 26 February 2026  19:19:29 +0000 (0:00:00.266)       0:02:54.044 *****
2026-02-26 19:19:29.823200 | controller | ok: [instance]
2026-02-26 19:19:29.823252 | controller |
2026-02-26 19:19:29.823362 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] ****************
2026-02-26 19:19:29.823461 | controller | Thursday 26 February 2026  19:19:29 +0000 (0:00:00.238)       0:02:54.282 *****
2026-02-26 19:19:30.215189 | controller | changed: [instance]
2026-02-26 19:19:30.215238 | controller |
2026-02-26 19:19:30.215350 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] ***************
2026-02-26 19:19:30.215439 | controller | Thursday 26 February 2026  19:19:30 +0000 (0:00:00.392)       0:02:54.674 *****
2026-02-26 19:19:30.244897 | controller | skipping: [instance]
2026-02-26 19:19:30.244985 | controller |
2026-02-26 19:19:30.245083 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-02-26 19:19:30.245180 | controller | Thursday 26 February 2026  19:19:30 +0000 (0:00:00.029)       0:02:54.704 *****
2026-02-26 19:19:30.271627 | controller | skipping: [instance]
2026-02-26 19:19:30.271790 | controller |
2026-02-26 19:19:30.271948 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] **************
2026-02-26 19:19:30.272105 | controller | Thursday 26 February 2026  19:19:30 +0000 (0:00:00.026)       0:02:54.731 *****
2026-02-26 19:19:31.833067 | controller | changed: [instance -> controller-0.instance]
2026-02-26 19:19:31.833125 | controller |
2026-02-26 19:19:31.833227 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] ***************
2026-02-26 19:19:31.833327 | controller | Thursday 26 February 2026  19:19:31 +0000 (0:00:01.561)       0:02:56.292 *****
2026-02-26 19:19:32.896669 | controller | changed: [instance -> controller-0.instance]
2026-02-26 19:19:32.940267 | controller |
2026-02-26 19:19:32.940294 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-02-26 19:19:32.940304 | controller | Thursday 26 February 2026  19:19:32 +0000 (0:00:01.063)       0:02:57.355 *****
2026-02-26 19:19:32.940315 | controller |
2026-02-26 19:19:33.142550 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2026-02-26 19:19:33.142583 | controller | Thursday 26 February 2026  19:19:32 +0000 (0:00:00.044)       0:02:57.399 *****
2026-02-26 19:19:33.142594 | controller | ok: [instance]
2026-02-26 19:19:33.167641 | controller |
2026-02-26 19:19:33.167658 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2026-02-26 19:19:33.167665 | controller | Thursday 26 February 2026  19:19:33 +0000 (0:00:00.202)       0:02:57.601 *****
2026-02-26 19:19:33.167674 | controller | ok: [instance]
2026-02-26 19:19:33.196150 | controller |
2026-02-26 19:19:33.196170 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2026-02-26 19:19:33.196179 | controller | Thursday 26 February 2026  19:19:33 +0000 (0:00:00.025)       0:02:57.627 *****
2026-02-26 19:19:33.196190 | controller | skipping: [instance]
2026-02-26 19:19:33.240226 | controller |
2026-02-26 19:19:33.240247 | controller | TASK [Push ssh jumper/configuration for crc-0] *********************************
2026-02-26 19:19:33.240256 | controller | Thursday 26 February 2026  19:19:33 +0000 (0:00:00.028)       0:02:57.655 *****
2026-02-26 19:19:33.240267 | controller |
2026-02-26 19:19:33.326203 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-02-26 19:19:33.326222 | controller | Thursday 26 February 2026  19:19:33 +0000 (0:00:00.044)       0:02:57.699 *****
2026-02-26 19:19:33.326233 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'})
2026-02-26 19:19:33.543126 | controller |
2026-02-26 19:19:33.543156 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-02-26 19:19:33.543163 | controller | Thursday 26 February 2026  19:19:33 +0000 (0:00:00.085)       0:02:57.785 *****
2026-02-26 19:19:33.543173 | controller | ok: [instance]
2026-02-26 19:19:33.757872 | controller |
2026-02-26 19:19:33.757911 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-02-26 19:19:33.757919 | controller | Thursday 26 February 2026  19:19:33 +0000 (0:00:00.216)       0:02:58.002 *****
2026-02-26 19:19:33.757930 | controller | ok: [instance]
2026-02-26 19:19:34.149670 | controller |
2026-02-26 19:19:34.149703 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] ***********************
2026-02-26 19:19:34.149715 | controller | Thursday 26 February 2026  19:19:33 +0000 (0:00:00.214)       0:02:58.217 *****
2026-02-26 19:19:34.149725 | controller | changed: [instance]
2026-02-26 19:19:34.895011 | controller |
2026-02-26 19:19:34.895043 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] **********************
2026-02-26 19:19:34.895051 | controller | Thursday 26 February 2026  19:19:34 +0000 (0:00:00.391)       0:02:58.608 *****
2026-02-26 19:19:34.895061 | controller | changed: [instance]
2026-02-26 19:19:34.938415 | controller |
2026-02-26 19:19:34.938442 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-02-26 19:19:34.938450 | controller | Thursday 26 February 2026  19:19:34 +0000 (0:00:00.737)       0:02:59.346 *****
2026-02-26 19:19:34.938460 | controller | skipping: [instance]
2026-02-26 19:19:35.002919 | controller |
2026-02-26 19:19:35.002944 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] *********************
2026-02-26 19:19:35.002952 | controller | Thursday 26 February 2026  19:19:34 +0000 (0:00:00.050)       0:02:59.397 *****
2026-02-26 19:19:35.002962 | controller | skipping: [instance]
2026-02-26 19:19:35.065380 | controller |
2026-02-26 19:19:35.065404 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] **********************
2026-02-26 19:19:35.065412 | controller | Thursday 26 February 2026  19:19:35 +0000 (0:00:00.064)       0:02:59.462 *****
2026-02-26 19:19:35.065422 | controller | skipping: [instance]
2026-02-26 19:19:35.133066 | controller |
2026-02-26 19:19:35.133088 | controller | TASK [Create VBMC entity] ******************************************************
2026-02-26 19:19:35.133096 | controller | Thursday 26 February 2026  19:19:35 +0000 (0:00:00.062)       0:02:59.524 *****
2026-02-26 19:19:35.133112 | controller | skipping: [instance] => (item=compute-0)
2026-02-26 19:19:35.412059 | controller | skipping: [instance] => (item=controller-0)
2026-02-26 19:19:35.412084 | controller | skipping: [instance] => (item=crc-0)
2026-02-26 19:19:35.412091 | controller | skipping: [instance]
2026-02-26 19:19:35.412098 | controller |
2026-02-26 19:19:35.412103 | controller | TASK [libvirt_manager : List running virtual machines.] ************************
2026-02-26 19:19:35.412109 | controller | Thursday 26 February 2026  19:19:35 +0000 (0:00:00.067)       0:02:59.592 *****
2026-02-26 19:19:35.412119 | controller | ok: [instance]
2026-02-26 19:19:35.846121 | controller |
2026-02-26 19:19:35.846151 | controller | TASK [libvirt_manager : Dump UUIDs] ********************************************
2026-02-26 19:19:35.846159 | controller | Thursday 26 February 2026  19:19:35 +0000 (0:00:00.279)       0:02:59.871 *****
2026-02-26 19:19:35.846169 | controller | changed: [instance]
2026-02-26 19:19:35.897820 | controller |
2026-02-26 19:19:35.897848 | controller | TASK [Ensure fresh vbmc listing] ***********************************************
2026-02-26 19:19:35.897856 | controller | Thursday 26 February 2026  19:19:35 +0000 (0:00:00.433)       0:03:00.305 *****
2026-02-26 19:19:35.897866 | controller | skipping: [instance]
2026-02-26 19:19:35.941112 | controller |
2026-02-26 19:19:35.941145 | controller | TASK [libvirt_manager : Update vbmc related fact] ******************************
2026-02-26 19:19:35.941154 | controller | Thursday 26 February 2026  19:19:35 +0000 (0:00:00.051)       0:03:00.356 *****
2026-02-26 19:19:35.941164 | controller | skipping: [instance]
2026-02-26 19:19:35.979497 | controller |
2026-02-26 19:19:35.979536 | controller | TASK [libvirt_manager : Dump vbmc known hosts] *********************************
2026-02-26 19:19:35.979546 | controller | Thursday 26 February 2026  19:19:35 +0000 (0:00:00.043)       0:03:00.400 *****
2026-02-26 19:19:35.979558 | controller | skipping: [instance]
2026-02-26 19:19:36.813143 | controller |
2026-02-26 19:19:36.813197 | controller | TASK [libvirt_manager : Copy authorized_keys] **********************************
2026-02-26 19:19:36.813206 | controller | Thursday 26 February 2026  19:19:35 +0000 (0:00:00.038)       0:03:00.438 *****
2026-02-26 19:19:36.813220 | controller | changed: [instance]
2026-02-26 19:19:37.636798 | controller |
2026-02-26 19:19:37.636854 | controller | TASK [libvirt_manager : Enable root access on CRC] *****************************
2026-02-26 19:19:37.636864 | controller | Thursday 26 February 2026  19:19:36 +0000 (0:00:00.833)       0:03:01.271 *****
2026-02-26 19:19:37.636877 | controller | changed: [instance]
2026-02-26 19:19:37.688444 | controller |
2026-02-26 19:19:37.688485 | controller | TASK [reproducer : Get deployed VM group inventories] **************************
2026-02-26 19:19:37.688493 | controller | Thursday 26 February 2026  19:19:37 +0000 (0:00:00.823)       0:03:02.095 *****
2026-02-26 19:19:37.688507 | controller | skipping: [instance]
2026-02-26 19:19:37.757471 | controller |
2026-02-26 19:19:37.757500 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] *************
2026-02-26 19:19:37.757509 | controller | Thursday 26 February 2026  19:19:37 +0000 (0:00:00.052)       0:03:02.147 *****
2026-02-26 19:19:37.757521 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance)
2026-02-26 19:19:37.809237 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0)
2026-02-26 19:19:37.809268 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0)
2026-02-26 19:19:37.809276 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0)
2026-02-26 19:19:37.809282 | controller |
2026-02-26 19:19:37.809289 | controller | TASK [reproducer : Gather inventories from instance] ***************************
2026-02-26 19:19:37.809295 | controller | Thursday 26 February 2026  19:19:37 +0000 (0:00:00.068)       0:03:02.216 *****
2026-02-26 19:19:37.809314 | controller | skipping: [instance]
2026-02-26 19:19:37.857186 | controller |
2026-02-26 19:19:37.857219 | controller | TASK [reproducer : Gather inventories from compute-0] **************************
2026-02-26 19:19:37.857227 | controller | Thursday 26 February 2026  19:19:37 +0000 (0:00:00.052)       0:03:02.268 *****
2026-02-26 19:19:37.857245 | controller | skipping: [instance]
2026-02-26 19:19:37.899021 | controller |
2026-02-26 19:19:37.899080 | controller | TASK [reproducer : Gather inventories from controller-0] ***********************
2026-02-26 19:19:37.899090 | controller | Thursday 26 February 2026  19:19:37 +0000 (0:00:00.047)       0:03:02.315 *****
2026-02-26 19:19:37.899103 | controller | skipping: [instance]
2026-02-26 19:19:37.940413 | controller |
2026-02-26 19:19:37.940486 | controller | TASK [reproducer : Gather inventories from crc-0] ******************************
2026-02-26 19:19:37.940497 | controller | Thursday 26 February 2026  19:19:37 +0000 (0:00:00.041)       0:03:02.357 *****
2026-02-26 19:19:37.940511 | controller | skipping: [instance]
2026-02-26 19:19:38.621562 | controller |
2026-02-26 19:19:38.621601 | controller | TASK [reproducer : Push generated inventory from hypervisor] *******************
2026-02-26 19:19:38.621611 | controller | Thursday 26 February 2026  19:19:37 +0000 (0:00:00.041)       0:03:02.398 *****
2026-02-26 19:19:38.621622 | controller | changed: [instance]
2026-02-26 19:19:38.656389 | controller |
2026-02-26 19:19:38.656419 | controller | TASK [reproducer : Slurp devscripts private key] *******************************
2026-02-26 19:19:38.656427 | controller | Thursday 26 February 2026  19:19:38 +0000 (0:00:00.681)       0:03:03.080 *****
2026-02-26 19:19:38.656438 | controller | skipping: [instance]
2026-02-26 19:19:38.691053 | controller |
2026-02-26 19:19:38.691081 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] *****************
2026-02-26 19:19:38.691090 | controller | Thursday 26 February 2026  19:19:38 +0000 (0:00:00.035)       0:03:03.115 *****
2026-02-26 19:19:38.691101 | controller | skipping: [instance]
2026-02-26 19:19:38.731190 | controller |
2026-02-26 19:19:38.731222 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] *********
2026-02-26 19:19:38.731231 | controller | Thursday 26 February 2026  19:19:38 +0000 (0:00:00.034)       0:03:03.150 *****
2026-02-26 19:19:38.731244 | controller | skipping: [instance]
2026-02-26 19:19:38.773998 | controller |
2026-02-26 19:19:38.774094 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-02-26 19:19:38.774105 | controller | Thursday 26 February 2026  19:19:38 +0000 (0:00:00.040)       0:03:03.190 *****
2026-02-26 19:19:38.774127 | controller | skipping: [instance]
2026-02-26 19:19:38.815529 | controller |
2026-02-26 19:19:38.815598 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-02-26 19:19:38.815608 | controller | Thursday 26 February 2026  19:19:38 +0000 (0:00:00.042)       0:03:03.233 *****
2026-02-26 19:19:38.815625 | controller | skipping: [instance]
2026-02-26 19:19:38.851774 | controller |
2026-02-26 19:19:38.851813 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-02-26 19:19:38.851823 | controller | Thursday 26 February 2026  19:19:38 +0000 (0:00:00.041)       0:03:03.274 *****
2026-02-26 19:19:38.851836 | controller | skipping: [instance]
2026-02-26 19:19:38.895428 | controller |
2026-02-26 19:19:38.895458 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-02-26 19:19:38.895468 | controller | Thursday 26 February 2026  19:19:38 +0000 (0:00:00.036)       0:03:03.311 *****
2026-02-26 19:19:38.895479 | controller | skipping: [instance]
2026-02-26 19:19:38.933201 | controller |
2026-02-26 19:19:38.933241 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-02-26 19:19:38.933250 | controller | Thursday 26 February 2026  19:19:38 +0000 (0:00:00.043)       0:03:03.354 *****
2026-02-26 19:19:38.933263 | controller | skipping: [instance]
2026-02-26 19:19:38.984076 | controller |
2026-02-26 19:19:38.984112 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-02-26 19:19:38.984121 | controller | Thursday 26 February 2026  19:19:38 +0000 (0:00:00.036)       0:03:03.391 *****
2026-02-26 19:19:38.984133 | controller | skipping: [instance]
2026-02-26 19:19:39.042417 | controller |
2026-02-26 19:19:39.042453 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-02-26 19:19:39.042462 | controller | Thursday 26 February 2026  19:19:38 +0000 (0:00:00.051)       0:03:03.443 *****
2026-02-26 19:19:39.042474 | controller | skipping: [instance]
2026-02-26 19:19:39.084582 | controller |
2026-02-26 19:19:39.084621 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] *********************
2026-02-26 19:19:39.084636 | controller | Thursday 26 February 2026  19:19:39 +0000 (0:00:00.058)       0:03:03.501 *****
2026-02-26 19:19:39.084648 | controller | skipping: [instance]
2026-02-26 19:19:39.308277 | controller |
2026-02-26 19:19:39.308330 | controller | TASK [reproducer : Configure Controller node] **********************************
2026-02-26 19:19:39.308341 | controller | Thursday 26 February 2026  19:19:39 +0000 (0:00:00.042)       0:03:03.543 *****
2026-02-26 19:19:39.308355 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance
2026-02-26 19:19:40.766723 | controller |
2026-02-26 19:19:40.766807 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2026-02-26 19:19:40.766816 | controller | Thursday 26 February 2026  19:19:39 +0000 (0:00:00.223)       0:03:03.767 *****
2026-02-26 19:19:40.766826 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2026-02-26 19:19:40.787865 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2026-02-26 19:19:40.787888 | controller |
2026-02-26 19:19:40.787895 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2026-02-26 19:19:40.787901 | controller | Thursday 26 February 2026  19:19:40 +0000 (0:00:01.458)       0:03:05.225 *****
2026-02-26 19:19:40.787910 | controller | skipping: [instance]
2026-02-26 19:19:41.485487 | controller |
2026-02-26 19:19:41.485521 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-02-26 19:19:41.485529 | controller | Thursday 26 February 2026  19:19:40 +0000 (0:00:00.021)       0:03:05.247 *****
2026-02-26 19:19:41.485556 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:41.523305 | controller |
2026-02-26 19:19:41.523333 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-02-26 19:19:41.523341 | controller | Thursday 26 February 2026  19:19:41 +0000 (0:00:00.697)       0:03:05.944 *****
2026-02-26 19:19:41.523350 | controller | skipping: [instance]
2026-02-26 19:19:41.558638 | controller |
2026-02-26 19:19:41.558766 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-02-26 19:19:41.558784 | controller | Thursday 26 February 2026  19:19:41 +0000 (0:00:00.038)       0:03:05.982 *****
2026-02-26 19:19:41.558801 | controller | skipping: [instance]
2026-02-26 19:19:41.558905 | controller |
2026-02-26 19:19:41.558949 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-02-26 19:19:41.558965 | controller | Thursday 26 February 2026  19:19:41 +0000 (0:00:00.035)       0:03:06.018 *****
2026-02-26 19:19:41.596171 | controller | skipping: [instance]
2026-02-26 19:19:41.646471 | controller |
2026-02-26 19:19:41.646523 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-02-26 19:19:41.646535 | controller | Thursday 26 February 2026  19:19:41 +0000 (0:00:00.036)       0:03:06.055 *****
2026-02-26 19:19:41.646547 | controller | skipping: [instance]
2026-02-26 19:19:41.683078 | controller |
2026-02-26 19:19:41.683118 | controller | TASK [reproducer : Get rhos-release] *******************************************
2026-02-26 19:19:41.683126 | controller | Thursday 26 February 2026  19:19:41 +0000 (0:00:00.050)       0:03:06.105 *****
2026-02-26 19:19:41.683138 | controller | skipping: [instance]
2026-02-26 19:19:41.683193 | controller |
2026-02-26 19:19:41.683210 | controller | TASK [reproducer : Install repos] **********************************************
2026-02-26 19:19:41.683219 | controller | Thursday 26 February 2026  19:19:41 +0000 (0:00:00.036)       0:03:06.142 *****
2026-02-26 19:19:41.723034 | controller | skipping: [instance]
2026-02-26 19:19:41.723077 | controller |
2026-02-26 19:19:41.723085 | controller | TASK [reproducer : Run custom commands after rhos-release setup] ***************
2026-02-26 19:19:41.723094 | controller | Thursday 26 February 2026  19:19:41 +0000 (0:00:00.040)       0:03:06.182 *****
2026-02-26 19:19:41.763217 | controller | skipping: [instance]
2026-02-26 19:19:41.763340 | controller |
2026-02-26 19:19:41.763358 | controller | TASK [reproducer : Create bundle for CRC] **************************************
2026-02-26 19:19:41.763425 | controller | Thursday 26 February 2026  19:19:41 +0000 (0:00:00.040)       0:03:06.222 *****
2026-02-26 19:19:41.799754 | controller | skipping: [instance]
2026-02-26 19:19:41.799867 | controller |
2026-02-26 19:19:41.799882 | controller | TASK [reproducer : Install some tools] *****************************************
2026-02-26 19:19:43.049203 | controller | Thursday 26 February 2026  19:19:41 +0000 (0:00:00.036)       0:03:06.259 *****
2026-02-26 19:19:43.049284 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:44.181687 | controller |
2026-02-26 19:19:44.181717 | controller | TASK [reproducer : Inject command aliases for faster debugging] ****************
2026-02-26 19:19:44.181725 | controller | Thursday 26 February 2026  19:19:43 +0000 (0:00:01.248)       0:03:07.507 *****
2026-02-26 19:19:44.181768 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:44.181788 | controller |
2026-02-26 19:19:44.181796 | controller | TASK [reproducer : Build job inventory for hook usage] *************************
2026-02-26 19:19:44.181934 | controller | Thursday 26 February 2026  19:19:44 +0000 (0:00:01.133)       0:03:08.641 *****
2026-02-26 19:19:44.807433 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:45.784013 | controller |
2026-02-26 19:19:45.784049 | controller | TASK [reproducer : Push the MAC mapping data] **********************************
2026-02-26 19:19:45.784063 | controller | Thursday 26 February 2026  19:19:44 +0000 (0:00:00.625)       0:03:09.266 *****
2026-02-26 19:19:45.784076 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:46.809660 | controller |
2026-02-26 19:19:46.809693 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] ***************************
2026-02-26 19:19:46.809701 | controller | Thursday 26 February 2026  19:19:45 +0000 (0:00:00.976)       0:03:10.242 *****
2026-02-26 19:19:46.809711 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2026-02-26 19:19:47.526354 | controller | skipping: [instance] => (item=compute-0)
2026-02-26 19:19:47.526419 | controller | skipping: [instance] => (item=controller-0)
2026-02-26 19:19:47.526427 | controller | skipping: [instance] => (item=crc-0)
2026-02-26 19:19:47.526435 | controller |
2026-02-26 19:19:47.526457 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] *****************
2026-02-26 19:19:47.526464 | controller | Thursday 26 February 2026  19:19:46 +0000 (0:00:01.026)       0:03:11.268 *****
2026-02-26 19:19:47.526479 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2026-02-26 19:19:49.386546 | controller | skipping: [instance] => (item=compute-0)
2026-02-26 19:19:49.386577 | controller | skipping: [instance] => (item=controller-0)
2026-02-26 19:19:49.386584 | controller | skipping: [instance] => (item=crc-0)
2026-02-26 19:19:49.386590 | controller |
2026-02-26 19:19:49.386596 | controller | TASK [reproducer : Inject SSH configuration] ***********************************
2026-02-26 19:19:49.386602 | controller | Thursday 26 February 2026  19:19:47 +0000 (0:00:00.715)       0:03:11.984 *****
2026-02-26 19:19:49.386612 | controller | skipping: [instance] => (item=instance)
2026-02-26 19:19:49.981114 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0)
2026-02-26 19:19:49.981146 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2026-02-26 19:19:49.981154 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0)
2026-02-26 19:19:49.981160 | controller |
2026-02-26 19:19:49.981165 | controller | TASK [reproducer : Create kube directory] **************************************
2026-02-26 19:19:49.981171 | controller | Thursday 26 February 2026  19:19:49 +0000 (0:00:01.861)       0:03:13.845 *****
2026-02-26 19:19:49.981181 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:50.965525 | controller |
2026-02-26 19:19:50.965555 | controller | TASK [reproducer : Inject kubeconfig content] **********************************
2026-02-26 19:19:50.965563 | controller | Thursday 26 February 2026  19:19:49 +0000 (0:00:00.594)       0:03:14.440 *****
2026-02-26 19:19:50.965574 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:51.940772 | controller |
2026-02-26 19:19:51.940802 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************
2026-02-26 19:19:51.940811 | controller | Thursday 26 February 2026  19:19:50 +0000 (0:00:00.984)       0:03:15.424 *****
2026-02-26 19:19:51.940821 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:51.976280 | controller |
2026-02-26 19:19:51.976310 | controller | TASK [reproducer : Inject devscripts private key if set] ***********************
2026-02-26 19:19:51.976318 | controller | Thursday 26 February 2026  19:19:51 +0000 (0:00:00.975)       0:03:16.400 *****
2026-02-26 19:19:51.976328 | controller | skipping: [instance]
2026-02-26 19:19:52.586407 | controller |
2026-02-26 19:19:52.586438 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ******************************
2026-02-26 19:19:52.586446 | controller | Thursday 26 February 2026  19:19:51 +0000 (0:00:00.035)       0:03:16.435 *****
2026-02-26 19:19:52.586456 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:53.178194 | controller |
2026-02-26 19:19:53.178230 | controller | TASK [manage_secrets : Ensure directory tree exist] ****************************
2026-02-26 19:19:53.178239 | controller | Thursday 26 February 2026  19:19:52 +0000 (0:00:00.609)       0:03:17.045 *****
2026-02-26 19:19:53.178250 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:53.219129 | controller |
2026-02-26 19:19:53.219153 | controller | TASK [manage_secrets : Assert we get needed data] ******************************
2026-02-26 19:19:53.219161 | controller | Thursday 26 February 2026  19:19:53 +0000 (0:00:00.591)       0:03:17.637 *****
2026-02-26 19:19:53.219171 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:53.284293 | controller |
2026-02-26 19:19:53.284316 | controller | TASK [manage_secrets : Push reproducer secrets] ********************************
2026-02-26 19:19:53.284325 | controller | Thursday 26 February 2026  19:19:53 +0000 (0:00:00.040)       0:03:17.678 *****
2026-02-26 19:19:53.284335 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'})
2026-02-26 19:19:53.338805 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'})
2026-02-26 19:19:53.338828 | controller |
2026-02-26 19:19:53.338836 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2026-02-26 19:19:53.338842 | controller | Thursday 26 February 2026  19:19:53 +0000 (0:00:00.065)       0:03:17.743 *****
2026-02-26 19:19:53.338852 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-02-26 19:19:53.389208 | controller |   _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt
2026-02-26 19:19:53.389234 | controller |
2026-02-26 19:19:53.389241 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2026-02-26 19:19:53.389247 | controller | Thursday 26 February 2026  19:19:53 +0000 (0:00:00.054)       0:03:17.798 *****
2026-02-26 19:19:53.389257 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-02-26 19:19:53.438569 | controller |   _secret_file: ''
2026-02-26 19:19:53.438600 | controller |
2026-02-26 19:19:53.438608 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2026-02-26 19:19:53.438614 | controller | Thursday 26 February 2026  19:19:53 +0000 (0:00:00.050)       0:03:17.848 *****
2026-02-26 19:19:53.438624 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-02-26 19:19:53.487130 | controller |   _secret_content: my-default-location-place
2026-02-26 19:19:53.487157 | controller |
2026-02-26 19:19:53.487165 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2026-02-26 19:19:53.487175 | controller | Thursday 26 February 2026  19:19:53 +0000 (0:00:00.049)       0:03:17.897 *****
2026-02-26 19:19:53.487185 | controller | skipping: [instance]
2026-02-26 19:19:53.534633 | controller |
2026-02-26 19:19:53.534657 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2026-02-26 19:19:53.534665 | controller | Thursday 26 February 2026  19:19:53 +0000 (0:00:00.048)       0:03:17.946 *****
2026-02-26 19:19:53.534675 | controller | skipping: [instance]
2026-02-26 19:19:53.586715 | controller |
2026-02-26 19:19:53.586763 | controller | TASK [manage_secrets : Copy file to location] **********************************
2026-02-26 19:19:53.586771 | controller | Thursday 26 February 2026  19:19:53 +0000 (0:00:00.047)       0:03:17.993 *****
2026-02-26 19:19:53.586786 | controller | skipping: [instance]
2026-02-26 19:19:54.560516 | controller |
2026-02-26 19:19:54.560549 | controller | TASK [manage_secrets : Create file from content] *******************************
2026-02-26 19:19:54.560557 | controller | Thursday 26 February 2026  19:19:53 +0000 (0:00:00.052)       0:03:18.046 *****
2026-02-26 19:19:54.560567 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:54.617019 | controller |
2026-02-26 19:19:54.617040 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2026-02-26 19:19:54.617047 | controller | Thursday 26 February 2026  19:19:54 +0000 (0:00:00.973)       0:03:19.019 *****
2026-02-26 19:19:54.617057 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-02-26 19:19:54.664623 | controller |   _secret_dest: /home/zuul/ipmi-things
2026-02-26 19:19:54.664645 | controller |
2026-02-26 19:19:54.664653 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2026-02-26 19:19:54.664659 | controller | Thursday 26 February 2026  19:19:54 +0000 (0:00:00.056)       0:03:19.076 *****
2026-02-26 19:19:54.664668 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-02-26 19:19:54.714054 | controller |   _secret_file: /tmp/ipmi-things
2026-02-26 19:19:54.714076 | controller |
2026-02-26 19:19:54.714085 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2026-02-26 19:19:54.714091 | controller | Thursday 26 February 2026  19:19:54 +0000 (0:00:00.047)       0:03:19.124 *****
2026-02-26 19:19:54.714100 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-02-26 19:19:54.767290 | controller |   _secret_content: ''
2026-02-26 19:19:54.767311 | controller |
2026-02-26 19:19:54.767319 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2026-02-26 19:19:54.767325 | controller | Thursday 26 February 2026  19:19:54 +0000 (0:00:00.049)       0:03:19.173 *****
2026-02-26 19:19:54.767334 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false
2026-02-26 19:19:55.328120 | controller |   msg: All assertions passed
2026-02-26 19:19:55.328150 | controller |
2026-02-26 19:19:55.328158 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2026-02-26 19:19:55.328164 | controller | Thursday 26 February 2026  19:19:54 +0000 (0:00:00.053)       0:03:19.226 *****
2026-02-26 19:19:55.328174 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:56.307064 | controller |
2026-02-26 19:19:56.307096 | controller | TASK [manage_secrets : Copy file to location] **********************************
2026-02-26 19:19:56.307104 | controller | Thursday 26 February 2026  19:19:55 +0000 (0:00:00.560)       0:03:19.787 *****
2026-02-26 19:19:56.307115 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:56.361236 | controller |
2026-02-26 19:19:56.361257 | controller | TASK [manage_secrets : Create file from content] *******************************
2026-02-26 19:19:56.361265 | controller | Thursday 26 February 2026  19:19:56 +0000 (0:00:00.978)       0:03:20.765 *****
2026-02-26 19:19:56.361274 | controller | skipping: [instance]
2026-02-26 19:19:56.922970 | controller |
2026-02-26 19:19:56.923002 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] **********************************
2026-02-26 19:19:56.923010 | controller | Thursday 26 February 2026  19:19:56 +0000 (0:00:00.055)       0:03:20.820 *****
2026-02-26 19:19:56.923020 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:19:57.519915 | controller |
2026-02-26 19:19:57.519947 | controller | TASK [reproducer : Check if async file is still available] *********************
2026-02-26 19:19:57.519955 | controller | Thursday 26 February 2026  19:19:56 +0000 (0:00:00.561)       0:03:21.382 *****
2026-02-26 19:19:57.519966 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:20:47.720385 | controller |
2026-02-26 19:20:47.720428 | controller | TASK [reproducer : Check package install status] *******************************
2026-02-26 19:20:47.720437 | controller | Thursday 26 February 2026  19:19:57 +0000 (0:00:00.596)       0:03:21.979 *****
2026-02-26 19:20:47.720450 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left).
2026-02-26 19:20:47.720467 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left).
2026-02-26 19:20:47.720481 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left).
2026-02-26 19:20:47.720487 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left).
2026-02-26 19:20:47.720492 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left).
2026-02-26 19:20:47.720503 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left).
2026-02-26 19:20:47.720508 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left).
2026-02-26 19:20:47.720513 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left).
2026-02-26 19:20:47.720519 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left).
2026-02-26 19:20:47.720526 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:20:47.720578 | controller |
2026-02-26 19:20:47.720589 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] ***************
2026-02-26 19:20:47.720674 | controller | Thursday 26 February 2026  19:20:47 +0000 (0:00:50.199)       0:04:12.179 *****
2026-02-26 19:20:48.396410 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:20:50.836841 | controller |
2026-02-26 19:20:50.836870 | controller | TASK [sushy_emulator : Install required packages] ******************************
2026-02-26 19:20:50.836878 | controller | Thursday 26 February 2026  19:20:48 +0000 (0:00:00.676)       0:04:12.855 *****
2026-02-26 19:20:50.836888 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:20:50.880676 | controller |
2026-02-26 19:20:50.880705 | controller | TASK [sushy_emulator : Get ingresses domain] ***********************************
2026-02-26 19:20:50.880713 | controller | Thursday 26 February 2026  19:20:50 +0000 (0:00:02.440)       0:04:15.296 *****
2026-02-26 19:20:50.880723 | controller | skipping: [instance]
2026-02-26 19:20:50.923702 | controller |
2026-02-26 19:20:50.923759 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] *********************
2026-02-26 19:20:50.923772 | controller | Thursday 26 February 2026  19:20:50 +0000 (0:00:00.043)       0:04:15.339 *****
2026-02-26 19:20:50.923783 | controller | skipping: [instance]
2026-02-26 19:20:51.549914 | controller |
2026-02-26 19:20:51.549943 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] **********************
2026-02-26 19:20:51.549952 | controller | Thursday 26 February 2026  19:20:50 +0000 (0:00:00.043)       0:04:15.383 *****
2026-02-26 19:20:51.549962 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:20:52.094275 | controller |
2026-02-26 19:20:52.094307 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ********************
2026-02-26 19:20:52.094316 | controller | Thursday 26 February 2026  19:20:51 +0000 (0:00:00.626)       0:04:16.009 *****
2026-02-26 19:20:52.094326 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:20:52.409741 | controller |
2026-02-26 19:20:52.409781 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] *******************************
2026-02-26 19:20:52.409790 | controller | Thursday 26 February 2026  19:20:52 +0000 (0:00:00.544)       0:04:16.553 *****
2026-02-26 19:20:52.409800 | controller | changed: [instance]
2026-02-26 19:20:53.005999 | controller |
2026-02-26 19:20:53.006039 | controller | TASK [sushy_emulator : Run ssh-keyscan] ****************************************
2026-02-26 19:20:53.006047 | controller | Thursday 26 February 2026  19:20:52 +0000 (0:00:00.315)       0:04:16.868 *****
2026-02-26 19:20:53.006059 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:20:53.006078 | controller |
2026-02-26 19:20:53.006253 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************
2026-02-26 19:20:54.026166 | controller | Thursday 26 February 2026  19:20:53 +0000 (0:00:00.596)       0:04:17.465 *****
2026-02-26 19:20:54.026209 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:20:54.067703 | controller |
2026-02-26 19:20:54.067746 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-02-26 19:20:54.067779 | controller | Thursday 26 February 2026  19:20:54 +0000 (0:00:01.020)       0:04:18.485 *****
2026-02-26 19:20:54.067790 | controller | skipping: [instance]
2026-02-26 19:20:54.111123 | controller |
2026-02-26 19:20:54.111141 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-02-26 19:20:54.111149 | controller | Thursday 26 February 2026  19:20:54 +0000 (0:00:00.041)       0:04:18.526 *****
2026-02-26 19:20:54.111158 | controller | skipping: [instance]
2026-02-26 19:20:54.147155 | controller |
2026-02-26 19:20:54.147172 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-02-26 19:20:54.147180 | controller | Thursday 26 February 2026  19:20:54 +0000 (0:00:00.043)       0:04:18.570 *****
2026-02-26 19:20:54.147189 | controller | skipping: [instance]
2026-02-26 19:20:54.193475 | controller |
2026-02-26 19:20:54.193497 | controller | TASK [sushy_emulator : Generate list of filtered VMs] **************************
2026-02-26 19:20:54.193506 | controller | Thursday 26 February 2026  19:20:54 +0000 (0:00:00.036)       0:04:18.606 *****
2026-02-26 19:20:54.193517 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:20:54.229317 | controller |
2026-02-26 19:20:54.229339 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] ***************************
2026-02-26 19:20:54.229348 | controller | Thursday 26 February 2026  19:20:54 +0000 (0:00:00.046)       0:04:18.652 *****
2026-02-26 19:20:54.229359 | controller | skipping: [instance]
2026-02-26 19:20:54.265431 | controller |
2026-02-26 19:20:54.265449 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ********
2026-02-26 19:20:54.265457 | controller | Thursday 26 February 2026  19:20:54 +0000 (0:00:00.035)       0:04:18.688 *****
2026-02-26 19:20:54.265470 | controller | skipping: [instance]
2026-02-26 19:20:54.302044 | controller |
2026-02-26 19:20:54.302062 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] ***************
2026-02-26 19:20:54.302069 | controller | Thursday 26 February 2026  19:20:54 +0000 (0:00:00.036)       0:04:18.724 *****
2026-02-26 19:20:54.302077 | controller | skipping: [instance]
2026-02-26 19:20:54.302211 | controller |
2026-02-26 19:20:54.302347 | controller | TASK [sushy_emulator : Generate htpasswd string] *******************************
2026-02-26 19:20:54.302488 | controller | Thursday 26 February 2026  19:20:54 +0000 (0:00:00.036)       0:04:18.761 *****
2026-02-26 19:20:54.889072 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:20:54.985105 | controller |
2026-02-26 19:20:54.985135 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] *********************
2026-02-26 19:20:54.985143 | controller | Thursday 26 February 2026  19:20:54 +0000 (0:00:00.586)       0:04:19.348 *****
2026-02-26 19:20:54.985153 | controller | skipping: [instance] => (item=secret)
2026-02-26 19:20:55.985511 | controller | skipping: [instance] => (item=configmap)
2026-02-26 19:20:55.985547 | controller | skipping: [instance] => (item=pod)
2026-02-26 19:20:55.985555 | controller | skipping: [instance] => (item=service)
2026-02-26 19:20:55.985560 | controller | skipping: [instance] => (item=route)
2026-02-26 19:20:55.985566 | controller | skipping: [instance]
2026-02-26 19:20:55.985572 | controller |
2026-02-26 19:20:55.985578 | controller | TASK [sushy_emulator : Write sushy emulator config] ****************************
2026-02-26 19:20:55.985584 | controller | Thursday 26 February 2026  19:20:54 +0000 (0:00:00.095)       0:04:19.444 *****
2026-02-26 19:20:55.985593 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:20:56.941564 | controller |
2026-02-26 19:20:56.941604 | controller | TASK [sushy_emulator : Write htpasswd string to file] **************************
2026-02-26 19:20:56.941625 | controller | Thursday 26 February 2026  19:20:55 +0000 (0:00:01.000)       0:04:20.444 *****
2026-02-26 19:20:56.941638 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:20:56.977722 | controller |
2026-02-26 19:20:56.977769 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ********************
2026-02-26 19:20:56.977777 | controller | Thursday 26 February 2026  19:20:56 +0000 (0:00:00.955)       0:04:21.400 *****
2026-02-26 19:20:56.977787 | controller | skipping: [instance]
2026-02-26 19:20:57.018715 | controller |
2026-02-26 19:20:57.018763 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] ***
2026-02-26 19:20:57.018779 | controller | Thursday 26 February 2026  19:20:56 +0000 (0:00:00.036)       0:04:21.437 *****
2026-02-26 19:20:57.018789 | controller | skipping: [instance]
2026-02-26 19:20:57.093390 | controller |
2026-02-26 19:20:57.093416 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] *************************
2026-02-26 19:20:57.093424 | controller | Thursday 26 February 2026  19:20:57 +0000 (0:00:00.037)       0:04:21.474 *****
2026-02-26 19:20:57.093433 | controller | skipping: [instance] => (item=secret)
2026-02-26 19:20:57.128697 | controller | skipping: [instance] => (item=configmap)
2026-02-26 19:20:57.128716 | controller | skipping: [instance] => (item=service)
2026-02-26 19:20:57.128724 | controller | skipping: [instance] => (item=route)
2026-02-26 19:20:57.128749 | controller | skipping: [instance]
2026-02-26 19:20:57.128764 | controller |
2026-02-26 19:20:57.128769 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] **********************
2026-02-26 19:20:57.128775 | controller | Thursday 26 February 2026  19:20:57 +0000 (0:00:00.077)       0:04:21.552 *****
2026-02-26 19:20:57.128783 | controller | skipping: [instance]
2026-02-26 19:20:58.623150 | controller |
2026-02-26 19:20:58.623183 | controller | TASK [podman : Ensure podman is installed] *************************************
2026-02-26 19:20:58.623192 | controller | Thursday 26 February 2026  19:20:57 +0000 (0:00:00.035)       0:04:21.588 *****
2026-02-26 19:20:58.623202 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:20:59.364958 | controller |
2026-02-26 19:20:59.364989 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] *********************
2026-02-26 19:20:59.364997 | controller | Thursday 26 February 2026  19:20:58 +0000 (0:00:01.494)       0:04:23.082 *****
2026-02-26 19:20:59.365007 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:20:59.405880 | controller |
2026-02-26 19:20:59.405903 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] *******************
2026-02-26 19:20:59.405911 | controller | Thursday 26 February 2026  19:20:59 +0000 (0:00:00.741)       0:04:23.824 *****
2026-02-26 19:20:59.405920 | controller | skipping: [instance]
2026-02-26 19:20:59.445138 | controller |
2026-02-26 19:20:59.445165 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] *******************
2026-02-26 19:20:59.445173 | controller | Thursday 26 February 2026  19:20:59 +0000 (0:00:00.041)       0:04:23.865 *****
2026-02-26 19:20:59.445183 | controller | skipping: [instance]
2026-02-26 19:20:59.489007 | controller |
2026-02-26 19:20:59.489031 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] ***
2026-02-26 19:20:59.489038 | controller | Thursday 26 February 2026  19:20:59 +0000 (0:00:00.039)       0:04:23.904 *****
2026-02-26 19:20:59.489048 | controller | skipping: [instance]
2026-02-26 19:21:09.849831 | controller |
2026-02-26 19:21:09.849869 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ********************
2026-02-26 19:21:09.849878 | controller | Thursday 26 February 2026  19:20:59 +0000 (0:00:00.043)       0:04:23.948 *****
2026-02-26 19:21:09.849888 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:11.279664 | controller |
2026-02-26 19:21:11.279699 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] **************
2026-02-26 19:21:11.279712 | controller | Thursday 26 February 2026  19:21:09 +0000 (0:00:10.360)       0:04:34.308 *****
2026-02-26 19:21:11.279743 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:12.578474 | controller |
2026-02-26 19:21:12.578513 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2026-02-26 19:21:12.578526 | controller | Thursday 26 February 2026  19:21:11 +0000 (0:00:01.428)       0:04:35.737 *****
2026-02-26 19:21:12.578539 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2026-02-26 19:21:12.616897 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2026-02-26 19:21:12.616918 | controller |
2026-02-26 19:21:12.616926 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] *************
2026-02-26 19:21:12.616931 | controller | Thursday 26 February 2026  19:21:12 +0000 (0:00:01.300)       0:04:37.037 *****
2026-02-26 19:21:12.616940 | controller | skipping: [instance]
2026-02-26 19:21:13.270892 | controller |
2026-02-26 19:21:13.270930 | controller | TASK [reproducer : Check if baremetal-info.yml exists] *************************
2026-02-26 19:21:13.270938 | controller | Thursday 26 February 2026  19:21:12 +0000 (0:00:00.038)       0:04:37.075 *****
2026-02-26 19:21:13.270949 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:13.307403 | controller |
2026-02-26 19:21:13.307436 | controller | TASK [reproducer : Get content of baremetal-info file] *************************
2026-02-26 19:21:13.307444 | controller | Thursday 26 February 2026  19:21:13 +0000 (0:00:00.654)       0:04:37.730 *****
2026-02-26 19:21:13.307455 | controller | skipping: [instance]
2026-02-26 19:21:13.349115 | controller |
2026-02-26 19:21:13.349150 | controller | TASK [reproducer : Interpret remote file content as yaml] **********************
2026-02-26 19:21:13.349158 | controller | Thursday 26 February 2026  19:21:13 +0000 (0:00:00.036)       0:04:37.766 *****
2026-02-26 19:21:13.349168 | controller | skipping: [instance]
2026-02-26 19:21:13.349338 | controller |
2026-02-26 19:21:13.349509 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2026-02-26 19:21:13.349592 | controller | Thursday 26 February 2026  19:21:13 +0000 (0:00:00.042)       0:04:37.808 *****
2026-02-26 19:21:13.393274 | controller | skipping: [instance]
2026-02-26 19:21:13.430820 | controller |
2026-02-26 19:21:13.430851 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2026-02-26 19:21:13.430861 | controller | Thursday 26 February 2026  19:21:13 +0000 (0:00:00.043)       0:04:37.852 *****
2026-02-26 19:21:13.430873 | controller | skipping: [instance]
2026-02-26 19:21:13.591127 | controller |
2026-02-26 19:21:13.591161 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] *****************
2026-02-26 19:21:13.591169 | controller | Thursday 26 February 2026  19:21:13 +0000 (0:00:00.037)       0:04:37.890 *****
2026-02-26 19:21:13.591180 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'})
2026-02-26 19:21:14.778039 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'})
2026-02-26 19:21:14.778072 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'})
2026-02-26 19:21:14.778080 | controller |
2026-02-26 19:21:14.778086 | controller | TASK [reproducer : Output baremetal info file] *********************************
2026-02-26 19:21:14.778092 | controller | Thursday 26 February 2026  19:21:13 +0000 (0:00:00.160)       0:04:38.050 *****
2026-02-26 19:21:14.778102 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:14.817398 | controller |
2026-02-26 19:21:14.817429 | controller | TASK [reproducer : Output ironic_nodes to file] ********************************
2026-02-26 19:21:14.817439 | controller | Thursday 26 February 2026  19:21:14 +0000 (0:00:01.187)       0:04:39.237 *****
2026-02-26 19:21:14.817451 | controller | skipping: [instance]
2026-02-26 19:21:14.949498 | controller |
2026-02-26 19:21:14.949528 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] *******************
2026-02-26 19:21:14.949536 | controller | Thursday 26 February 2026  19:21:14 +0000 (0:00:00.039)       0:04:39.276 *****
2026-02-26 19:21:14.949546 | controller |
2026-02-26 19:21:15.043267 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] ***
2026-02-26 19:21:15.043302 | controller | Thursday 26 February 2026  19:21:14 +0000 (0:00:00.132)       0:04:39.408 *****
2026-02-26 19:21:15.043314 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:15.088931 | controller |
2026-02-26 19:21:15.088950 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2026-02-26 19:21:15.088958 | controller | Thursday 26 February 2026  19:21:15 +0000 (0:00:00.093)       0:04:39.502 *****
2026-02-26 19:21:15.088967 | controller | skipping: [instance]
2026-02-26 19:21:15.126456 | controller |
2026-02-26 19:21:15.126474 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2026-02-26 19:21:15.126482 | controller | Thursday 26 February 2026  19:21:15 +0000 (0:00:00.045)       0:04:39.548 *****
2026-02-26 19:21:15.126497 | controller | skipping: [instance]
2026-02-26 19:21:16.453322 | controller |
2026-02-26 19:21:16.453360 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] ***
2026-02-26 19:21:16.453368 | controller | Thursday 26 February 2026  19:21:15 +0000 (0:00:00.037)       0:04:39.586 *****
2026-02-26 19:21:16.453379 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:23.760524 | controller |
2026-02-26 19:21:23.760555 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] ***
2026-02-26 19:21:23.760563 | controller | Thursday 26 February 2026  19:21:16 +0000 (0:00:01.326)       0:04:40.912 *****
2026-02-26 19:21:23.760574 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1)
2026-02-26 19:21:23.857597 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b)
2026-02-26 19:21:23.857625 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282)
2026-02-26 19:21:23.857632 | controller |
2026-02-26 19:21:23.857638 | controller | TASK [sushy_emulator : Verify baremetal VM power status] ***********************
2026-02-26 19:21:23.857644 | controller | Thursday 26 February 2026  19:21:23 +0000 (0:00:07.306)       0:04:48.219 *****
2026-02-26 19:21:23.857658 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0)
2026-02-26 19:21:24.083791 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0)
2026-02-26 19:21:24.083821 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0)
2026-02-26 19:21:24.083829 | controller |
2026-02-26 19:21:24.083835 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] **********
2026-02-26 19:21:24.083841 | controller | Thursday 26 February 2026  19:21:23 +0000 (0:00:00.097)       0:04:48.316 *****
2026-02-26 19:21:24.083850 | controller | ok: [instance -> localhost]
2026-02-26 19:21:26.235186 | controller |
2026-02-26 19:21:26.235247 | controller | TASK [reproducer : Sync local repositories to other hosts if present] **********
2026-02-26 19:21:26.235256 | controller | Thursday 26 February 2026  19:21:24 +0000 (0:00:00.222)       0:04:48.539 *****
2026-02-26 19:21:26.235271 | controller | changed: [instance -> localhost] => (item=controller-0)
2026-02-26 19:21:26.967047 | controller |
2026-02-26 19:21:26.967121 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] ****
2026-02-26 19:21:26.967130 | controller | Thursday 26 February 2026  19:21:26 +0000 (0:00:02.154)       0:04:50.693 *****
2026-02-26 19:21:26.967145 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:27.779638 | controller |
2026-02-26 19:21:27.779698 | controller | TASK [reproducer : Install ansible dependencies] *******************************
2026-02-26 19:21:27.779708 | controller | Thursday 26 February 2026  19:21:26 +0000 (0:00:00.731)       0:04:51.425 *****
2026-02-26 19:21:27.779721 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:29.047023 | controller |
2026-02-26 19:21:29.047084 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] ***
2026-02-26 19:21:29.047094 | controller | Thursday 26 February 2026  19:21:27 +0000 (0:00:00.812)       0:04:52.238 *****
2026-02-26 19:21:29.047109 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:29.728302 | controller |
2026-02-26 19:21:29.728368 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] ****
2026-02-26 19:21:29.728378 | controller | Thursday 26 February 2026  19:21:29 +0000 (0:00:01.267)       0:04:53.505 *****
2026-02-26 19:21:29.728392 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:30.906947 | controller |
2026-02-26 19:21:30.907004 | controller | TASK [reproducer : Inject local environment parameters] ************************
2026-02-26 19:21:30.907014 | controller | Thursday 26 February 2026  19:21:29 +0000 (0:00:00.680)       0:04:54.186 *****
2026-02-26 19:21:30.907029 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:31.531546 | controller |
2026-02-26 19:21:31.531608 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] ***
2026-02-26 19:21:31.531626 | controller | Thursday 26 February 2026  19:21:30 +0000 (0:00:01.178)       0:04:55.365 *****
2026-02-26 19:21:31.531640 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:32.215854 | controller |
2026-02-26 19:21:32.215936 | controller | TASK [reproducer : Get interfaces-info content] ********************************
2026-02-26 19:21:32.215948 | controller | Thursday 26 February 2026  19:21:31 +0000 (0:00:00.624)       0:04:55.990 *****
2026-02-26 19:21:32.215963 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:33.651892 | controller |
2026-02-26 19:21:33.651972 | controller | TASK [reproducer : Wait for OCP nodes to be ready] *****************************
2026-02-26 19:21:33.651982 | controller | Thursday 26 February 2026  19:21:32 +0000 (0:00:00.684)       0:04:56.674 *****
2026-02-26 19:21:33.651997 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2026-02-26 19:21:33.688398 | controller |
2026-02-26 19:21:33.688432 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-02-26 19:21:33.688441 | controller | Thursday 26 February 2026  19:21:33 +0000 (0:00:01.436)       0:04:58.110 *****
2026-02-26 19:21:33.688453 | controller | skipping: [instance]
2026-02-26 19:21:33.724919 | controller |
2026-02-26 19:21:33.724958 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-02-26 19:21:33.724967 | controller | Thursday 26 February 2026  19:21:33 +0000 (0:00:00.037)       0:04:58.147 *****
2026-02-26 19:21:33.724979 | controller | skipping: [instance]
2026-02-26 19:21:33.765856 | controller |
2026-02-26 19:21:33.765895 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-02-26 19:21:33.765904 | controller | Thursday 26 February 2026  19:21:33 +0000 (0:00:00.036)       0:04:58.184 *****
2026-02-26 19:21:33.765916 | controller | skipping: [instance]
2026-02-26 19:21:33.803772 | controller |
2026-02-26 19:21:33.803801 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-02-26 19:21:33.803810 | controller | Thursday 26 February 2026  19:21:33 +0000 (0:00:00.040)       0:04:58.224 *****
2026-02-26 19:21:33.803820 | controller | skipping: [instance]
2026-02-26 19:21:33.840364 | controller |
2026-02-26 19:21:33.840389 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-02-26 19:21:33.840406 | controller | Thursday 26 February 2026  19:21:33 +0000 (0:00:00.038)       0:04:58.263 *****
2026-02-26 19:21:33.840416 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:33.949182 | controller |
2026-02-26 19:21:33.949242 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-02-26 19:21:33.949253 | controller | Thursday 26 February 2026  19:21:33 +0000 (0:00:00.036)       0:04:58.299 *****
2026-02-26 19:21:33.949284 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}})
2026-02-26 19:21:33.949516 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={})
2026-02-26 19:21:33.949674 | controller |
2026-02-26 19:21:33.949881 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-02-26 19:21:33.950042 | controller | Thursday 26 February 2026  19:21:33 +0000 (0:00:00.108)       0:04:58.408 *****
2026-02-26 19:21:33.998587 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance
2026-02-26 19:21:33.998801 | controller |
2026-02-26 19:21:33.998989 | controller | TASK [networking_mapper : Gather the facts] ************************************
2026-02-26 19:21:33.999132 | controller | Thursday 26 February 2026  19:21:33 +0000 (0:00:00.049)       0:04:58.458 *****
2026-02-26 19:21:37.513889 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2026-02-26 19:21:38.649717 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0)
2026-02-26 19:21:38.649809 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2026-02-26 19:21:38.649818 | controller |
2026-02-26 19:21:38.649826 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] ***
2026-02-26 19:21:38.649833 | controller | Thursday 26 February 2026  19:21:37 +0000 (0:00:03.513)       0:05:01.972 *****
2026-02-26 19:21:38.649847 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:39.171889 | controller |
2026-02-26 19:21:39.171965 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-02-26 19:21:39.171976 | controller | Thursday 26 February 2026  19:21:38 +0000 (0:00:01.135)       0:05:03.107 *****
2026-02-26 19:21:39.171997 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:40.143059 | controller |
2026-02-26 19:21:40.143110 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-02-26 19:21:40.143120 | controller | Thursday 26 February 2026  19:21:39 +0000 (0:00:00.522)       0:05:03.629 *****
2026-02-26 19:21:40.143132 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:40.229607 | controller |
2026-02-26 19:21:40.229651 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-02-26 19:21:40.229660 | controller | Thursday 26 February 2026  19:21:40 +0000 (0:00:00.971)       0:05:04.601 *****
2026-02-26 19:21:40.229672 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:40.285551 | controller |
2026-02-26 19:21:40.285590 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-02-26 19:21:40.285599 | controller | Thursday 26 February 2026  19:21:40 +0000 (0:00:00.086)       0:05:04.688 *****
2026-02-26 19:21:40.285610 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:41.255081 | controller |
2026-02-26 19:21:41.255112 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-02-26 19:21:41.255121 | controller | Thursday 26 February 2026  19:21:40 +0000 (0:00:00.055)       0:05:04.744 *****
2026-02-26 19:21:41.255132 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:42.291784 | controller |
2026-02-26 19:21:42.291840 | controller | TASK [reproducer : Inject CRC ssh key] *****************************************
2026-02-26 19:21:42.291858 | controller | Thursday 26 February 2026  19:21:41 +0000 (0:00:00.969)       0:05:05.714 *****
2026-02-26 19:21:42.291872 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:48.396458 | controller |
2026-02-26 19:21:48.396491 | controller | TASK [reproducer : Ensure we have all dependencies installed] ******************
2026-02-26 19:21:48.396499 | controller | Thursday 26 February 2026  19:21:42 +0000 (0:00:01.035)       0:05:06.750 *****
2026-02-26 19:21:48.396510 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left).
2026-02-26 19:21:48.607367 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:48.607402 | controller |
2026-02-26 19:21:48.607409 | controller | TASK [Configure ntp service] ***************************************************
2026-02-26 19:21:48.607415 | controller | Thursday 26 February 2026  19:21:48 +0000 (0:00:06.105)       0:05:12.855 *****
2026-02-26 19:21:48.607425 | controller |
2026-02-26 19:21:49.571490 | controller | TASK [cifmw_ntp : Install chrony] **********************************************
2026-02-26 19:21:49.571522 | controller | Thursday 26 February 2026  19:21:48 +0000 (0:00:00.211)       0:05:13.066 *****
2026-02-26 19:21:49.571533 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:50.473388 | controller |
2026-02-26 19:21:50.473418 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] *************************
2026-02-26 19:21:50.473426 | controller | Thursday 26 February 2026  19:21:49 +0000 (0:00:00.964)       0:05:14.030 *****
2026-02-26 19:21:50.473437 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True})
2026-02-26 19:21:51.425126 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'})
2026-02-26 19:21:51.425156 | controller |
2026-02-26 19:21:51.425164 | controller | TASK [cifmw_ntp : Render chrony extra config file] *****************************
2026-02-26 19:21:51.425170 | controller | Thursday 26 February 2026  19:21:50 +0000 (0:00:00.901)       0:05:14.932 *****
2026-02-26 19:21:51.425184 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:52.059572 | controller |
2026-02-26 19:21:52.059604 | controller | TASK [cifmw_ntp : Enable chrony service] ***************************************
2026-02-26 19:21:52.059612 | controller | Thursday 26 February 2026  19:21:51 +0000 (0:00:00.951)       0:05:15.884 *****
2026-02-26 19:21:52.059623 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:52.198571 | controller |
2026-02-26 19:21:52.198603 | controller | TASK [reproducer : Configure CRC node if available] ****************************
2026-02-26 19:21:52.198611 | controller | Thursday 26 February 2026  19:21:52 +0000 (0:00:00.634)       0:05:16.518 *****
2026-02-26 19:21:52.198622 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance
2026-02-26 19:21:52.198833 | controller |
2026-02-26 19:21:52.198847 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] ***
2026-02-26 19:21:52.198857 | controller | Thursday 26 February 2026  19:21:52 +0000 (0:00:00.138)       0:05:16.657 *****
2026-02-26 19:21:52.648751 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:53.137524 | controller |
2026-02-26 19:21:53.137557 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ********************
2026-02-26 19:21:53.137565 | controller | Thursday 26 February 2026  19:21:52 +0000 (0:00:00.450)       0:05:17.107 *****
2026-02-26 19:21:53.137575 | controller | ok: [instance -> crc-0(crc-0.instance)]
2026-02-26 19:21:53.793381 | controller |
2026-02-26 19:21:53.793418 | controller | TASK [reproducer : Configure local DNS for CRC pod] ****************************
2026-02-26 19:21:53.793426 | controller | Thursday 26 February 2026  19:21:53 +0000 (0:00:00.488)       0:05:17.596 *****
2026-02-26 19:21:53.793436 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-02-26 19:21:54.320810 | controller |
2026-02-26 19:21:54.320850 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] ***************
2026-02-26 19:21:54.320873 | controller | Thursday 26 February 2026  19:21:53 +0000 (0:00:00.650)       0:05:18.247 *****
2026-02-26 19:21:54.320885 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-02-26 19:21:54.370054 | controller |
2026-02-26 19:21:54.370075 | controller | TASK [Restart DNS in CRC VM] ***************************************************
2026-02-26 19:21:54.370083 | controller | Thursday 26 February 2026  19:21:54 +0000 (0:00:00.532)       0:05:18.779 *****
2026-02-26 19:21:54.370092 | controller |
2026-02-26 19:21:54.802565 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] ***************
2026-02-26 19:21:54.802599 | controller | Thursday 26 February 2026  19:21:54 +0000 (0:00:00.049)       0:05:18.829 *****
2026-02-26 19:21:54.802611 | controller | ok: [instance -> crc-0(crc-0.instance)]
2026-02-26 19:21:55.565516 | controller |
2026-02-26 19:21:55.565549 | controller | TASK [openshift_setup : Restart dnsmasq service if used] ***********************
2026-02-26 19:21:55.565558 | controller | Thursday 26 February 2026  19:21:54 +0000 (0:00:00.429)       0:05:19.258 *****
2026-02-26 19:21:55.565568 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-02-26 19:21:55.594263 | controller |
2026-02-26 19:21:55.594285 | controller | TASK [openshift_setup : Stop dnsmasq] ******************************************
2026-02-26 19:21:55.594293 | controller | Thursday 26 February 2026  19:21:55 +0000 (0:00:00.765)       0:05:20.024 *****
2026-02-26 19:21:55.594302 | controller | skipping: [instance]
2026-02-26 19:21:55.631433 | controller |
2026-02-26 19:21:55.631454 | controller | TASK [openshift_setup : Start dnsmasq] *****************************************
2026-02-26 19:21:55.631462 | controller | Thursday 26 February 2026  19:21:55 +0000 (0:00:00.028)       0:05:20.053 *****
2026-02-26 19:21:55.631471 | controller | skipping: [instance]
2026-02-26 19:21:55.842156 | controller |
2026-02-26 19:21:55.842186 | controller | TASK [reproducer : Remove entry from /etc/hosts] *******************************
2026-02-26 19:21:55.842195 | controller | Thursday 26 February 2026  19:21:55 +0000 (0:00:00.037)       0:05:20.090 *****
2026-02-26 19:21:55.842205 | controller | changed: [instance]
2026-02-26 19:21:55.915202 | controller |
2026-02-26 19:21:55.915233 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] **********************
2026-02-26 19:21:55.915241 | controller | Thursday 26 February 2026  19:21:55 +0000 (0:00:00.210)       0:05:20.301 *****
2026-02-26 19:21:55.915251 | controller | skipping: [instance] => (item=)
2026-02-26 19:21:55.946567 | controller |
2026-02-26 19:21:55.946593 | controller | TASK [dnsmasq : Assert we have needed address data] ****************************
2026-02-26 19:21:55.946602 | controller | Thursday 26 February 2026  19:21:55 +0000 (0:00:00.073)       0:05:20.374 *****
2026-02-26 19:21:55.946611 | controller | ok: [instance]
2026-02-26 19:21:56.017263 | controller |
2026-02-26 19:21:56.017288 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-02-26 19:21:56.017297 | controller | Thursday 26 February 2026  19:21:55 +0000 (0:00:00.031)       0:05:20.406 *****
2026-02-26 19:21:56.017306 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2026-02-26 19:21:56.254260 | controller |
2026-02-26 19:21:56.254285 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-02-26 19:21:56.254297 | controller | Thursday 26 February 2026  19:21:56 +0000 (0:00:00.070)       0:05:20.476 *****
2026-02-26 19:21:56.254307 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2026-02-26 19:21:56.299459 | controller |
2026-02-26 19:21:56.299482 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************
2026-02-26 19:21:56.299490 | controller | Thursday 26 February 2026  19:21:56 +0000 (0:00:00.236)       0:05:20.713 *****
2026-02-26 19:21:56.299500 | controller |
2026-02-26 19:21:56.356977 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-02-26 19:21:56.357002 | controller | Thursday 26 February 2026  19:21:56 +0000 (0:00:00.045)       0:05:20.758 *****
2026-02-26 19:21:56.357014 | controller | ok: [instance]
2026-02-26 19:21:56.411959 | controller |
2026-02-26 19:21:56.411986 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-02-26 19:21:56.411994 | controller | Thursday 26 February 2026  19:21:56 +0000 (0:00:00.057)       0:05:20.816 *****
2026-02-26 19:21:56.412010 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-02-26 19:21:56.666661 | controller |
2026-02-26 19:21:56.666692 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-02-26 19:21:56.666700 | controller | Thursday 26 February 2026  19:21:56 +0000 (0:00:00.054)       0:05:20.871 *****
2026-02-26 19:21:56.666710 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-02-26 19:21:56.725533 | controller |
2026-02-26 19:21:56.725554 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-02-26 19:21:56.725562 | controller | Thursday 26 February 2026  19:21:56 +0000 (0:00:00.254)       0:05:21.125 *****
2026-02-26 19:21:56.725576 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-02-26 19:21:57.128462 | controller | skipping: [instance]
2026-02-26 19:21:57.128491 | controller |
2026-02-26 19:21:57.128499 | controller | TASK [reproducer : Ensure "testing" domain is "local"] *************************
2026-02-26 19:21:57.128506 | controller | Thursday 26 February 2026  19:21:56 +0000 (0:00:00.059)       0:05:21.185 *****
2026-02-26 19:21:57.128516 | controller | changed: [instance]
2026-02-26 19:21:57.778221 | controller |
2026-02-26 19:21:57.778252 | controller | TASK [reproducer : Flush handlers] *********************************************
2026-02-26 19:21:57.778266 | controller | Thursday 26 February 2026  19:21:57 +0000 (0:00:00.389)       0:05:21.574 *****
2026-02-26 19:21:57.778272 | controller |
2026-02-26 19:21:57.778277 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] ***********************************
2026-02-26 19:21:57.778283 | controller | Thursday 26 February 2026  19:21:57 +0000 (0:00:00.012)       0:05:21.587 *****
2026-02-26 19:21:57.778292 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:21:58.143528 | controller |
2026-02-26 19:21:58.143558 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-02-26 19:21:58.143566 | controller | Thursday 26 February 2026  19:21:57 +0000 (0:00:00.649)       0:05:22.237 *****
2026-02-26 19:21:58.143577 | controller | changed: [instance]
2026-02-26 19:21:58.311069 | controller |
2026-02-26 19:21:58.311104 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] ****************
2026-02-26 19:21:58.311112 | controller | Thursday 26 February 2026  19:21:58 +0000 (0:00:00.365)       0:05:22.602 *****
2026-02-26 19:21:58.311122 | controller | skipping: [instance] => (item=controller-0)
2026-02-26 19:21:59.769874 | controller | skipping: [instance] => (item=crc-0)
2026-02-26 19:21:59.769912 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0)
2026-02-26 19:21:59.769922 | controller |
2026-02-26 19:21:59.769929 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] **************
2026-02-26 19:21:59.769935 | controller | Thursday 26 February 2026  19:21:58 +0000 (0:00:00.167)       0:05:22.770 *****
2026-02-26 19:21:59.769962 | controller | changed: [instance -> compute-0(compute-0.instance)]
2026-02-26 19:21:59.769999 | controller |
2026-02-26 19:21:59.770008 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2026-02-26 19:21:59.788722 | controller | Thursday 26 February 2026  19:21:59 +0000 (0:00:01.459)       0:05:24.229 *****
2026-02-26 19:21:59.788783 | controller | skipping: [instance]
2026-02-26 19:22:00.310892 | controller |
2026-02-26 19:22:00.310930 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-02-26 19:22:00.310939 | controller | Thursday 26 February 2026  19:21:59 +0000 (0:00:00.018)       0:05:24.248 *****
2026-02-26 19:22:00.310996 | controller | ok: [instance -> compute-0(compute-0.instance)]
2026-02-26 19:22:00.344521 | controller |
2026-02-26 19:22:00.344541 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-02-26 19:22:00.344549 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.521)       0:05:24.770 *****
2026-02-26 19:22:00.344558 | controller | skipping: [instance]
2026-02-26 19:22:00.377345 | controller |
2026-02-26 19:22:00.377372 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-02-26 19:22:00.377382 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.033)       0:05:24.803 *****
2026-02-26 19:22:00.377393 | controller | skipping: [instance]
2026-02-26 19:22:00.411957 | controller |
2026-02-26 19:22:00.412040 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-02-26 19:22:00.412062 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.032)       0:05:24.836 *****
2026-02-26 19:22:00.412081 | controller | skipping: [instance]
2026-02-26 19:22:00.454848 | controller |
2026-02-26 19:22:00.454912 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-02-26 19:22:00.454923 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.034)       0:05:24.871 *****
2026-02-26 19:22:00.454935 | controller | skipping: [instance]
2026-02-26 19:22:00.454997 | controller |
2026-02-26 19:22:00.455034 | controller | TASK [reproducer : Get rhos-release and setup repos] ***************************
2026-02-26 19:22:00.490682 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.042)       0:05:24.914 *****
2026-02-26 19:22:00.490720 | controller | skipping: [instance]
2026-02-26 19:22:00.510860 | controller |
2026-02-26 19:22:00.510906 | controller | TASK [reproducer : Create repositories on computes] ****************************
2026-02-26 19:22:00.510914 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.035)       0:05:24.949 *****
2026-02-26 19:22:00.510927 | controller | skipping: [instance]
2026-02-26 19:22:00.543624 | controller |
2026-02-26 19:22:00.543645 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] *********************
2026-02-26 19:22:00.543652 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.020)       0:05:24.970 *****
2026-02-26 19:22:00.543662 | controller | skipping: [instance]
2026-02-26 19:22:00.543689 | controller |
2026-02-26 19:22:00.543891 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] *******
2026-02-26 19:22:00.543930 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.033)       0:05:25.003 *****
2026-02-26 19:22:00.601906 | controller | ok: [instance]
2026-02-26 19:22:00.703283 | controller |
2026-02-26 19:22:00.703326 | controller | TASK [reproducer : Push local code] ********************************************
2026-02-26 19:22:00.703335 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.056)       0:05:25.060 *****
2026-02-26 19:22:00.703348 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance
2026-02-26 19:22:00.703700 | controller |
2026-02-26 19:22:00.703718 | controller | TASK [reproducer : Check if repository directories already exist] **************
2026-02-26 19:22:00.754412 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.102)       0:05:25.162 *****
2026-02-26 19:22:00.754433 | controller | skipping: [instance]
2026-02-26 19:22:00.797530 | controller |
2026-02-26 19:22:00.797553 | controller | TASK [reproducer : Ensure we are not in the job_id branch] *********************
2026-02-26 19:22:00.797561 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.050)       0:05:25.213 *****
2026-02-26 19:22:00.797571 | controller | skipping: [instance]
2026-02-26 19:22:00.838307 | controller |
2026-02-26 19:22:00.838335 | controller | TASK [reproducer : Fetch zuul.items repositories] ******************************
2026-02-26 19:22:00.838343 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.043)       0:05:25.257 *****
2026-02-26 19:22:00.838352 | controller | skipping: [instance]
2026-02-26 19:22:00.877406 | controller |
2026-02-26 19:22:00.877433 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] **********
2026-02-26 19:22:00.877441 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.040)       0:05:25.297 *****
2026-02-26 19:22:00.877451 | controller | skipping: [instance]
2026-02-26 19:22:00.877522 | controller |
2026-02-26 19:22:00.877533 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] ***
2026-02-26 19:22:00.877543 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.038)       0:05:25.336 *****
2026-02-26 19:22:00.911891 | controller | skipping: [instance]
2026-02-26 19:22:00.911958 | controller |
2026-02-26 19:22:00.911970 | controller | TASK [reproducer : Create target directories beforehand] ***********************
2026-02-26 19:22:00.912123 | controller | Thursday 26 February 2026  19:22:00 +0000 (0:00:00.034)       0:05:25.371 *****
2026-02-26 19:22:01.404687 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators)
2026-02-26 19:22:01.404895 | controller |
2026-02-26 19:22:01.405064 | controller | TASK [reproducer : Sync local repositories to ansible controller] **************
2026-02-26 19:22:01.405201 | controller | Thursday 26 February 2026  19:22:01 +0000 (0:00:00.492)       0:05:25.864 *****
2026-02-26 19:22:02.042033 | controller | ok: [instance -> localhost] => (item=ci-framework)
2026-02-26 19:22:02.087979 | controller |
2026-02-26 19:22:02.088028 | controller | TASK [reproducer : Sync remote repositories] ***********************************
2026-02-26 19:22:02.088039 | controller | Thursday 26 February 2026  19:22:02 +0000 (0:00:00.636)       0:05:26.501 *****
2026-02-26 19:22:02.088053 | controller | skipping: [instance] => (item=ci-framework)
2026-02-26 19:22:02.088087 | controller | skipping: [instance]
2026-02-26 19:22:02.088397 | controller |
2026-02-26 19:22:02.167940 | controller | TASK [reproducer : Ensure default repositories are present] ********************
2026-02-26 19:22:02.167994 | controller | Thursday 26 February 2026  19:22:02 +0000 (0:00:00.046)       0:05:26.547 *****
2026-02-26 19:22:02.168011 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework)
2026-02-26 19:22:02.168058 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls)
2026-02-26 19:22:02.168066 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture)
2026-02-26 19:22:02.168075 | controller |
2026-02-26 19:22:02.168174 | controller | TASK [reproducer : Check repository availability: ci-framework] ****************
2026-02-26 19:22:02.168194 | controller | Thursday 26 February 2026  19:22:02 +0000 (0:00:00.079)       0:05:26.627 *****
2026-02-26 19:22:02.701833 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:02.702057 | controller |
2026-02-26 19:22:02.702075 | controller | TASK [reproducer : Clone repository if needed: ci-framework] *******************
2026-02-26 19:22:02.744328 | controller | Thursday 26 February 2026  19:22:02 +0000 (0:00:00.533)       0:05:27.161 *****
2026-02-26 19:22:02.744365 | controller | skipping: [instance]
2026-02-26 19:22:02.744408 | controller |
2026-02-26 19:22:02.744418 | controller | TASK [reproducer : Check repository availability: install_yamls] ***************
2026-02-26 19:22:02.744551 | controller | Thursday 26 February 2026  19:22:02 +0000 (0:00:00.042)       0:05:27.203 *****
2026-02-26 19:22:03.331348 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:03.331386 | controller |
2026-02-26 19:22:03.331595 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ******************
2026-02-26 19:22:03.375759 | controller | Thursday 26 February 2026  19:22:03 +0000 (0:00:00.586)       0:05:27.790 *****
2026-02-26 19:22:03.375798 | controller | skipping: [instance]
2026-02-26 19:22:03.375912 | controller |
2026-02-26 19:22:03.375924 | controller | TASK [reproducer : Check repository availability: architecture] ****************
2026-02-26 19:22:03.375932 | controller | Thursday 26 February 2026  19:22:03 +0000 (0:00:00.044)       0:05:27.835 *****
2026-02-26 19:22:03.893165 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:03.893209 | controller |
2026-02-26 19:22:03.893220 | controller | TASK [reproducer : Clone repository if needed: architecture] *******************
2026-02-26 19:22:03.893230 | controller | Thursday 26 February 2026  19:22:03 +0000 (0:00:00.517)       0:05:28.352 *****
2026-02-26 19:22:06.150895 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:06.151060 | controller |
2026-02-26 19:22:06.151079 | controller | TASK [reproducer : Install collections on controller-0] ************************
2026-02-26 19:22:06.151258 | controller | Thursday 26 February 2026  19:22:06 +0000 (0:00:02.257)       0:05:30.609 *****
2026-02-26 19:22:26.232865 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:27.234166 | controller |
2026-02-26 19:22:27.234199 | controller | TASK [reproducer : Inject CI Framework motd] ***********************************
2026-02-26 19:22:27.234215 | controller | Thursday 26 February 2026  19:22:26 +0000 (0:00:20.081)       0:05:50.691 *****
2026-02-26 19:22:27.234226 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:27.331825 | controller |
2026-02-26 19:22:27.331862 | controller | TASK [reproducer : Rotate some logs] *******************************************
2026-02-26 19:22:27.331871 | controller | Thursday 26 February 2026  19:22:27 +0000 (0:00:01.001)       0:05:51.693 *****
2026-02-26 19:22:27.331882 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log)
2026-02-26 19:22:27.331930 | controller |
2026-02-26 19:22:27.332163 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] *********************
2026-02-26 19:22:27.332203 | controller | Thursday 26 February 2026  19:22:27 +0000 (0:00:00.097)       0:05:51.791 *****
2026-02-26 19:22:27.759381 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:27.795871 | controller |
2026-02-26 19:22:27.795905 | controller | TASK [reproducer : Rotate log if present] **************************************
2026-02-26 19:22:27.795914 | controller | Thursday 26 February 2026  19:22:27 +0000 (0:00:00.427)       0:05:52.218 *****
2026-02-26 19:22:27.795927 | controller | skipping: [instance]
2026-02-26 19:22:27.795957 | controller |
2026-02-26 19:22:27.795981 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] ***********************
2026-02-26 19:22:27.796008 | controller | Thursday 26 February 2026  19:22:27 +0000 (0:00:00.036)       0:05:52.255 *****
2026-02-26 19:22:27.840866 | controller | skipping: [instance]
2026-02-26 19:22:27.840900 | controller |
2026-02-26 19:22:27.840908 | controller | TASK [cifmw_setup : Get customized parameters] *********************************
2026-02-26 19:22:27.840917 | controller | Thursday 26 February 2026  19:22:27 +0000 (0:00:00.045)       0:05:52.300 *****
2026-02-26 19:22:27.936268 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:28.377428 | controller |
2026-02-26 19:22:28.377458 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-02-26 19:22:28.377466 | controller | Thursday 26 February 2026  19:22:27 +0000 (0:00:00.095)       0:05:52.395 *****
2026-02-26 19:22:28.377477 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:28.412826 | controller |
2026-02-26 19:22:28.412855 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-02-26 19:22:28.412863 | controller | Thursday 26 February 2026  19:22:28 +0000 (0:00:00.441)       0:05:52.836 *****
2026-02-26 19:22:28.412873 | controller | skipping: [instance]
2026-02-26 19:22:28.412931 | controller |
2026-02-26 19:22:28.412948 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-02-26 19:22:28.412958 | controller | Thursday 26 February 2026  19:22:28 +0000 (0:00:00.035)       0:05:52.872 *****
2026-02-26 19:22:28.450174 | controller | skipping: [instance]
2026-02-26 19:22:28.450248 | controller |
2026-02-26 19:22:28.450269 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-02-26 19:22:28.450412 | controller | Thursday 26 February 2026  19:22:28 +0000 (0:00:00.037)       0:05:52.909 *****
2026-02-26 19:22:28.488511 | controller | skipping: [instance]
2026-02-26 19:22:28.530648 | controller |
2026-02-26 19:22:28.530674 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-02-26 19:22:28.530682 | controller | Thursday 26 February 2026  19:22:28 +0000 (0:00:00.037)       0:05:52.947 *****
2026-02-26 19:22:28.530692 | controller | skipping: [instance]
2026-02-26 19:22:28.530934 | controller |
2026-02-26 19:22:29.837808 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2026-02-26 19:22:29.837839 | controller | Thursday 26 February 2026  19:22:28 +0000 (0:00:00.042)       0:05:52.990 *****
2026-02-26 19:22:29.837851 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:22:29.838406 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:22:30.807818 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:22:30.807866 | controller | changed: [instance -> controller-0]
2026-02-26 19:22:30.807875 | controller |
2026-02-26 19:22:30.807881 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2026-02-26 19:22:30.807887 | controller | Thursday 26 February 2026  19:22:29 +0000 (0:00:01.307)       0:05:54.297 *****
2026-02-26 19:22:30.807897 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:32.026668 | controller |
2026-02-26 19:22:32.026702 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2026-02-26 19:22:32.026710 | controller | Thursday 26 February 2026  19:22:30 +0000 (0:00:00.969)       0:05:55.267 *****
2026-02-26 19:22:32.026741 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:32.026766 | controller |
2026-02-26 19:22:32.026774 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2026-02-26 19:22:32.026916 | controller | Thursday 26 February 2026  19:22:32 +0000 (0:00:01.218)       0:05:56.486 *****
2026-02-26 19:22:39.450838 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:39.450890 | controller |
2026-02-26 19:22:39.451094 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2026-02-26 19:22:40.360677 | controller | Thursday 26 February 2026  19:22:39 +0000 (0:00:07.424)       0:06:03.910 *****
2026-02-26 19:22:40.360712 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:40.396761 | controller |
2026-02-26 19:22:40.396795 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2026-02-26 19:22:40.396805 | controller | Thursday 26 February 2026  19:22:40 +0000 (0:00:00.909)       0:06:04.819 *****
2026-02-26 19:22:40.396817 | controller | skipping: [instance]
2026-02-26 19:22:41.460414 | controller |
2026-02-26 19:22:41.460450 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2026-02-26 19:22:41.460458 | controller | Thursday 26 February 2026  19:22:40 +0000 (0:00:00.036)       0:06:04.856 *****
2026-02-26 19:22:41.460469 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:41.511377 | controller |
2026-02-26 19:22:41.511420 | controller | TASK [repo_setup : Get component repo] *****************************************
2026-02-26 19:22:41.511430 | controller | Thursday 26 February 2026  19:22:41 +0000 (0:00:01.063)       0:06:05.919 *****
2026-02-26 19:22:41.511444 | controller | skipping: [instance]
2026-02-26 19:22:41.511476 | controller |
2026-02-26 19:22:41.511487 | controller | TASK [repo_setup : Rename component repo] **************************************
2026-02-26 19:22:41.511588 | controller | Thursday 26 February 2026  19:22:41 +0000 (0:00:00.051)       0:06:05.970 *****
2026-02-26 19:22:41.563954 | controller | skipping: [instance]
2026-02-26 19:22:41.564294 | controller |
2026-02-26 19:22:41.617295 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2026-02-26 19:22:41.617329 | controller | Thursday 26 February 2026  19:22:41 +0000 (0:00:00.052)       0:06:06.023 *****
2026-02-26 19:22:41.617341 | controller | skipping: [instance]
2026-02-26 19:22:41.617360 | controller |
2026-02-26 19:22:41.617442 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2026-02-26 19:22:41.617569 | controller | Thursday 26 February 2026  19:22:41 +0000 (0:00:00.053)       0:06:06.076 *****
2026-02-26 19:22:42.446288 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:42.446610 | controller |
2026-02-26 19:22:43.264163 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2026-02-26 19:22:43.264193 | controller | Thursday 26 February 2026  19:22:42 +0000 (0:00:00.828)       0:06:06.905 *****
2026-02-26 19:22:43.264206 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:43.302899 | controller |
2026-02-26 19:22:43.302951 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2026-02-26 19:22:43.302960 | controller | Thursday 26 February 2026  19:22:43 +0000 (0:00:00.817)       0:06:07.723 *****
2026-02-26 19:22:43.302987 | controller | skipping: [instance]
2026-02-26 19:22:43.340741 | controller |
2026-02-26 19:22:43.340769 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2026-02-26 19:22:43.340789 | controller | Thursday 26 February 2026  19:22:43 +0000 (0:00:00.038)       0:06:07.762 *****
2026-02-26 19:22:43.340800 | controller | skipping: [instance]
2026-02-26 19:22:43.377093 | controller |
2026-02-26 19:22:43.377149 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2026-02-26 19:22:43.377160 | controller | Thursday 26 February 2026  19:22:43 +0000 (0:00:00.038)       0:06:07.800 *****
2026-02-26 19:22:43.377173 | controller | skipping: [instance]
2026-02-26 19:22:43.377548 | controller |
2026-02-26 19:22:43.377590 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2026-02-26 19:22:43.377745 | controller | Thursday 26 February 2026  19:22:43 +0000 (0:00:00.036)       0:06:07.836 *****
2026-02-26 19:22:43.426598 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:43.463251 | controller |
2026-02-26 19:22:43.463270 | controller | TASK [repo_setup : Create download directory] **********************************
2026-02-26 19:22:43.463278 | controller | Thursday 26 February 2026  19:22:43 +0000 (0:00:00.049)       0:06:07.885 *****
2026-02-26 19:22:43.463287 | controller | skipping: [instance]
2026-02-26 19:22:43.498670 | controller |
2026-02-26 19:22:43.498688 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2026-02-26 19:22:43.498695 | controller | Thursday 26 February 2026  19:22:43 +0000 (0:00:00.036)       0:06:07.922 *****
2026-02-26 19:22:43.498704 | controller | skipping: [instance]
2026-02-26 19:22:43.533477 | controller |
2026-02-26 19:22:43.533495 | controller | TASK [Download the RPM] ********************************************************
2026-02-26 19:22:43.533503 | controller | Thursday 26 February 2026  19:22:43 +0000 (0:00:00.035)       0:06:07.958 *****
2026-02-26 19:22:43.533512 | controller | skipping: [instance]
2026-02-26 19:22:43.572236 | controller |
2026-02-26 19:22:43.572255 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2026-02-26 19:22:43.572263 | controller | Thursday 26 February 2026  19:22:43 +0000 (0:00:00.034)       0:06:07.992 *****
2026-02-26 19:22:43.572271 | controller | skipping: [instance]
2026-02-26 19:22:43.608468 | controller |
2026-02-26 19:22:43.608487 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2026-02-26 19:22:43.608495 | controller | Thursday 26 February 2026  19:22:43 +0000 (0:00:00.038)       0:06:08.031 *****
2026-02-26 19:22:43.608503 | controller | skipping: [instance]
2026-02-26 19:22:43.644092 | controller |
2026-02-26 19:22:43.644136 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2026-02-26 19:22:43.644144 | controller | Thursday 26 February 2026  19:22:43 +0000 (0:00:00.036)       0:06:08.068 *****
2026-02-26 19:22:43.644156 | controller | skipping: [instance]
2026-02-26 19:22:43.644174 | controller |
2026-02-26 19:22:43.644182 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2026-02-26 19:22:43.680522 | controller | Thursday 26 February 2026  19:22:43 +0000 (0:00:00.035)       0:06:08.103 *****
2026-02-26 19:22:43.680548 | controller | skipping: [instance]
2026-02-26 19:22:44.100681 | controller |
2026-02-26 19:22:44.100716 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2026-02-26 19:22:44.100724 | controller | Thursday 26 February 2026  19:22:43 +0000 (0:00:00.036)       0:06:08.140 *****
2026-02-26 19:22:44.100754 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:44.149823 | controller |
2026-02-26 19:22:44.149846 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2026-02-26 19:22:44.149853 | controller | Thursday 26 February 2026  19:22:44 +0000 (0:00:00.419)       0:06:08.559 *****
2026-02-26 19:22:44.149863 | controller | skipping: [instance]
2026-02-26 19:22:44.149891 | controller |
2026-02-26 19:22:44.150214 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2026-02-26 19:22:44.198903 | controller | Thursday 26 February 2026  19:22:44 +0000 (0:00:00.049)       0:06:08.609 *****
2026-02-26 19:22:44.198957 | controller | skipping: [instance]
2026-02-26 19:22:44.199069 | controller |
2026-02-26 19:22:44.199453 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2026-02-26 19:22:44.236201 | controller | Thursday 26 February 2026  19:22:44 +0000 (0:00:00.048)       0:06:08.657 *****
2026-02-26 19:22:44.236241 | controller | skipping: [instance]
2026-02-26 19:22:44.236286 | controller |
2026-02-26 19:22:44.236384 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2026-02-26 19:22:44.236474 | controller | Thursday 26 February 2026  19:22:44 +0000 (0:00:00.037)       0:06:08.695 *****
2026-02-26 19:22:44.287120 | controller | skipping: [instance]
2026-02-26 19:22:44.287219 | controller |
2026-02-26 19:22:44.287336 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2026-02-26 19:22:44.287595 | controller | Thursday 26 February 2026  19:22:44 +0000 (0:00:00.050)       0:06:08.746 *****
2026-02-26 19:22:44.336215 | controller | skipping: [instance]
2026-02-26 19:22:44.336311 | controller |
2026-02-26 19:22:44.336428 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2026-02-26 19:22:44.336541 | controller | Thursday 26 February 2026  19:22:44 +0000 (0:00:00.049)       0:06:08.795 *****
2026-02-26 19:22:44.385623 | controller | skipping: [instance]
2026-02-26 19:22:44.385697 | controller |
2026-02-26 19:22:44.385820 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2026-02-26 19:22:44.385925 | controller | Thursday 26 February 2026  19:22:44 +0000 (0:00:00.049)       0:06:08.845 *****
2026-02-26 19:22:44.433869 | controller | skipping: [instance]
2026-02-26 19:22:44.433984 | controller |
2026-02-26 19:22:44.434119 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] ***
2026-02-26 19:22:44.434232 | controller | Thursday 26 February 2026  19:22:44 +0000 (0:00:00.048)       0:06:08.893 *****
2026-02-26 19:22:44.486388 | controller | skipping: [instance]
2026-02-26 19:22:44.486490 | controller |
2026-02-26 19:22:44.486506 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2026-02-26 19:22:44.486662 | controller | Thursday 26 February 2026  19:22:44 +0000 (0:00:00.052)       0:06:08.946 *****
2026-02-26 19:22:45.027467 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:45.027546 | controller |
2026-02-26 19:22:45.027642 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2026-02-26 19:22:45.027761 | controller | Thursday 26 February 2026  19:22:45 +0000 (0:00:00.540)       0:06:09.487 *****
2026-02-26 19:22:46.038117 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:22:46.038153 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:22:46.038267 | controller | changed: [instance -> controller-0]
2026-02-26 19:22:46.038363 | controller |
2026-02-26 19:22:46.038472 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2026-02-26 19:22:46.038559 | controller | Thursday 26 February 2026  19:22:46 +0000 (0:00:01.010)       0:06:10.497 *****
2026-02-26 19:22:46.709783 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:46.709842 | controller |
2026-02-26 19:22:46.709957 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2026-02-26 19:22:46.710065 | controller | Thursday 26 February 2026  19:22:46 +0000 (0:00:00.671)       0:06:11.169 *****
2026-02-26 19:22:47.199710 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:47.199791 | controller |
2026-02-26 19:22:47.200064 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2026-02-26 19:22:47.257848 | controller | Thursday 26 February 2026  19:22:47 +0000 (0:00:00.489)       0:06:11.659 *****
2026-02-26 19:22:47.257880 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:22:47.258095 | controller | ok: [instance -> controller-0]
2026-02-26 19:22:47.258114 | controller |
2026-02-26 19:22:47.258127 | controller | TASK [ci_setup : List packages to install] *************************************
2026-02-26 19:22:47.297670 | controller | Thursday 26 February 2026  19:22:47 +0000 (0:00:00.058)       0:06:11.717 *****
2026-02-26 19:22:47.297692 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:22:47.297954 | controller |
2026-02-26 19:22:47.297992 | controller | TASK [ci_setup : Install needed packages] **************************************
2026-02-26 19:23:19.319214 | controller | Thursday 26 February 2026  19:22:47 +0000 (0:00:00.040)       0:06:11.757 *****
2026-02-26 19:23:19.319261 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:19.764646 | controller |
2026-02-26 19:23:19.764678 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2026-02-26 19:23:19.764686 | controller | Thursday 26 February 2026  19:23:19 +0000 (0:00:32.020)       0:06:43.778 *****
2026-02-26 19:23:19.764697 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:20.233880 | controller |
2026-02-26 19:23:20.233917 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2026-02-26 19:23:20.233927 | controller | Thursday 26 February 2026  19:23:19 +0000 (0:00:00.445)       0:06:44.223 *****
2026-02-26 19:23:20.233940 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:20.233974 | controller |
2026-02-26 19:23:20.233984 | controller | TASK [ci_setup : Install openshift client] *************************************
2026-02-26 19:23:20.234098 | controller | Thursday 26 February 2026  19:23:20 +0000 (0:00:00.469)       0:06:44.693 *****
2026-02-26 19:23:26.315406 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:26.363839 | controller |
2026-02-26 19:23:26.363875 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2026-02-26 19:23:26.363885 | controller | Thursday 26 February 2026  19:23:26 +0000 (0:00:06.081)       0:06:50.774 *****
2026-02-26 19:23:26.363897 | controller | skipping: [instance]
2026-02-26 19:23:26.363927 | controller |
2026-02-26 19:23:26.363937 | controller | TASK [ci_setup : Create completion file] ***************************************
2026-02-26 19:23:26.364087 | controller | Thursday 26 February 2026  19:23:26 +0000 (0:00:00.048)       0:06:50.823 *****
2026-02-26 19:23:26.930766 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:26.931059 | controller |
2026-02-26 19:23:26.931098 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2026-02-26 19:23:27.376881 | controller | Thursday 26 February 2026  19:23:26 +0000 (0:00:00.566)       0:06:51.390 *****
2026-02-26 19:23:27.376929 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:27.415871 | controller |
2026-02-26 19:23:27.415906 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2026-02-26 19:23:27.415916 | controller | Thursday 26 February 2026  19:23:27 +0000 (0:00:00.446)       0:06:51.836 *****
2026-02-26 19:23:27.415929 | controller | skipping: [instance]
2026-02-26 19:23:27.416143 | controller |
2026-02-26 19:23:27.416174 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2026-02-26 19:23:27.454954 | controller | Thursday 26 February 2026  19:23:27 +0000 (0:00:00.039)       0:06:51.875 *****
2026-02-26 19:23:27.454981 | controller | skipping: [instance]
2026-02-26 19:23:27.491511 | controller |
2026-02-26 19:23:27.491532 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2026-02-26 19:23:27.491541 | controller | Thursday 26 February 2026  19:23:27 +0000 (0:00:00.038)       0:06:51.914 *****
2026-02-26 19:23:27.491552 | controller | skipping: [instance]
2026-02-26 19:23:27.529894 | controller |
2026-02-26 19:23:27.529916 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2026-02-26 19:23:27.529926 | controller | Thursday 26 February 2026  19:23:27 +0000 (0:00:00.036)       0:06:51.950 *****
2026-02-26 19:23:27.529937 | controller | skipping: [instance]
2026-02-26 19:23:27.565402 | controller |
2026-02-26 19:23:27.565445 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2026-02-26 19:23:27.565455 | controller | Thursday 26 February 2026  19:23:27 +0000 (0:00:00.038)       0:06:51.989 *****
2026-02-26 19:23:27.565469 | controller | skipping: [instance]
2026-02-26 19:23:27.602799 | controller |
2026-02-26 19:23:27.602832 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2026-02-26 19:23:27.602840 | controller | Thursday 26 February 2026  19:23:27 +0000 (0:00:00.035)       0:06:52.024 *****
2026-02-26 19:23:27.602851 | controller | skipping: [instance]
2026-02-26 19:23:27.602877 | controller |
2026-02-26 19:23:27.603102 | controller | TASK [ci_setup : Manage directories] *******************************************
2026-02-26 19:23:27.603140 | controller | Thursday 26 February 2026  19:23:27 +0000 (0:00:00.037)       0:06:52.062 *****
2026-02-26 19:23:29.975756 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:23:29.975810 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:23:29.975937 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:23:29.976036 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:23:29.976129 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:23:29.976221 | controller | changed: [instance -> controller-0]
2026-02-26 19:23:29.976313 | controller |
2026-02-26 19:23:29.976413 | controller | TASK [Prepare install_yamls make targets] **************************************
2026-02-26 19:23:29.976538 | controller | Thursday 26 February 2026  19:23:29 +0000 (0:00:02.372)       0:06:54.435 *****
2026-02-26 19:23:30.127287 | controller |
2026-02-26 19:23:30.127385 | controller | TASK [install_yamls : Ensure directories exist] ********************************
2026-02-26 19:23:30.127505 | controller | Thursday 26 February 2026  19:23:30 +0000 (0:00:00.151)       0:06:54.586 *****
2026-02-26 19:23:31.484884 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:23:31.484946 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:23:31.485076 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:23:31.485431 | controller | changed: [instance -> controller-0]
2026-02-26 19:23:31.543545 | controller |
2026-02-26 19:23:31.543563 | controller | TASK [Create variables with local repos based on Zuul items] *******************
2026-02-26 19:23:31.543571 | controller | Thursday 26 February 2026  19:23:31 +0000 (0:00:01.357)       0:06:55.944 *****
2026-02-26 19:23:31.543580 | controller |
2026-02-26 19:23:31.543748 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] ***********
2026-02-26 19:23:31.582803 | controller | Thursday 26 February 2026  19:23:31 +0000 (0:00:00.058)       0:06:56.003 *****
2026-02-26 19:23:31.582830 | controller | skipping: [instance]
2026-02-26 19:23:31.583040 | controller |
2026-02-26 19:23:31.583129 | controller | TASK [install_yamls : Print helpful data for debugging] ************************
2026-02-26 19:23:31.583163 | controller | Thursday 26 February 2026  19:23:31 +0000 (0:00:00.039)       0:06:56.042 *****
2026-02-26 19:23:31.625750 | controller | skipping: [instance]
2026-02-26 19:23:31.687828 | controller |
2026-02-26 19:23:31.687850 | controller | TASK [Customize install_yamls devsetup vars if needed] *************************
2026-02-26 19:23:31.687858 | controller | Thursday 26 February 2026  19:23:31 +0000 (0:00:00.042)       0:06:56.085 *****
2026-02-26 19:23:31.687868 | controller |
2026-02-26 19:23:31.726287 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] ***
2026-02-26 19:23:31.726318 | controller | Thursday 26 February 2026  19:23:31 +0000 (0:00:00.061)       0:06:56.146 *****
2026-02-26 19:23:31.726331 | controller | skipping: [instance]
2026-02-26 19:23:31.726357 | controller |
2026-02-26 19:23:31.726366 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] ***
2026-02-26 19:23:31.726473 | controller | Thursday 26 February 2026  19:23:31 +0000 (0:00:00.039)       0:06:56.186 *****
2026-02-26 19:23:31.766162 | controller | skipping: [instance]
2026-02-26 19:23:31.766347 | controller |
2026-02-26 19:23:31.766373 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] ***
2026-02-26 19:23:31.804296 | controller | Thursday 26 February 2026  19:23:31 +0000 (0:00:00.039)       0:06:56.225 *****
2026-02-26 19:23:31.804337 | controller | skipping: [instance]
2026-02-26 19:23:31.804366 | controller |
2026-02-26 19:23:31.804375 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] ***
2026-02-26 19:23:31.804456 | controller | Thursday 26 February 2026  19:23:31 +0000 (0:00:00.038)       0:06:56.263 *****
2026-02-26 19:23:31.847621 | controller | skipping: [instance]
2026-02-26 19:23:31.847664 | controller |
2026-02-26 19:23:31.847818 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ********
2026-02-26 19:23:31.847921 | controller | Thursday 26 February 2026  19:23:31 +0000 (0:00:00.043)       0:06:56.307 *****
2026-02-26 19:23:31.942899 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 19:23:31.942964 | controller | ok: [instance -> controller-0]
2026-02-26 19:23:31.943072 | controller |
2026-02-26 19:23:31.943165 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] ***
2026-02-26 19:23:31.943269 | controller | Thursday 26 February 2026  19:23:31 +0000 (0:00:00.095)       0:06:56.402 *****
2026-02-26 19:23:32.006013 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:32.006066 | controller |
2026-02-26 19:23:32.006160 | controller | TASK [install_yamls : Get environment structure] *******************************
2026-02-26 19:23:32.006265 | controller | Thursday 26 February 2026  19:23:32 +0000 (0:00:00.062)       0:06:56.465 *****
2026-02-26 19:23:32.839153 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:32.839202 | controller |
2026-02-26 19:23:32.839295 | controller | TASK [install_yamls : Ensure Output directory exists] **************************
2026-02-26 19:23:32.839389 | controller | Thursday 26 February 2026  19:23:32 +0000 (0:00:00.833)       0:06:57.298 *****
2026-02-26 19:23:32.875343 | controller | skipping: [instance]
2026-02-26 19:23:32.875387 | controller |
2026-02-26 19:23:32.875496 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] ***
2026-02-26 19:23:32.875594 | controller | Thursday 26 February 2026  19:23:32 +0000 (0:00:00.036)       0:06:57.335 *****
2026-02-26 19:23:32.919995 | controller | skipping: [instance]
2026-02-26 19:23:32.920095 | controller |
2026-02-26 19:23:32.920220 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] ***
2026-02-26 19:23:32.920326 | controller | Thursday 26 February 2026  19:23:32 +0000 (0:00:00.044)       0:06:57.379 *****
2026-02-26 19:23:32.957055 | controller | skipping: [instance]
2026-02-26 19:23:32.957147 | controller |
2026-02-26 19:23:32.957255 | controller | TASK [install_yamls : Set install_yamls default values] ************************
2026-02-26 19:23:32.957350 | controller | Thursday 26 February 2026  19:23:32 +0000 (0:00:00.036)       0:06:57.416 *****
2026-02-26 19:23:33.007957 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:33.008059 | controller |
2026-02-26 19:23:33.008175 | controller | TASK [install_yamls : Show the env structure] **********************************
2026-02-26 19:23:33.008287 | controller | Thursday 26 February 2026  19:23:33 +0000 (0:00:00.051)       0:06:57.467 *****
2026-02-26 19:23:33.049021 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:33.049106 | controller |
2026-02-26 19:23:33.049200 | controller | TASK [install_yamls : Show the env structure defaults] *************************
2026-02-26 19:23:33.049292 | controller | Thursday 26 February 2026  19:23:33 +0000 (0:00:00.040)       0:06:57.508 *****
2026-02-26 19:23:33.197271 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:33.197312 | controller |
2026-02-26 19:23:33.197467 | controller | TASK [install_yamls : Generate make targets] ***********************************
2026-02-26 19:23:33.197600 | controller | Thursday 26 February 2026  19:23:33 +0000 (0:00:00.148)       0:06:57.656 *****
2026-02-26 19:23:33.782599 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:33.782643 | controller |
2026-02-26 19:23:33.782922 | controller | TASK [install_yamls : Debug generate_make module] ******************************
2026-02-26 19:23:33.831061 | controller | Thursday 26 February 2026  19:23:33 +0000 (0:00:00.585)       0:06:58.242 *****
2026-02-26 19:23:33.831089 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:33.831149 | controller |
2026-02-26 19:23:33.831248 | controller | TASK [install_yamls : Create the install_yamls parameters file] ****************
2026-02-26 19:23:33.831350 | controller | Thursday 26 February 2026  19:23:33 +0000 (0:00:00.048)       0:06:58.290 *****
2026-02-26 19:23:34.692835 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:34.692879 | controller |
2026-02-26 19:23:34.692992 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] ***
2026-02-26 19:23:34.693102 | controller | Thursday 26 February 2026  19:23:34 +0000 (0:00:00.862)       0:06:59.152 *****
2026-02-26 19:23:34.739909 | controller | skipping: [instance]
2026-02-26 19:23:34.740035 | controller |
2026-02-26 19:23:34.740125 | controller | TASK [discover_latest_image : Get latest image] ********************************
2026-02-26 19:23:34.740219 | controller | Thursday 26 February 2026  19:23:34 +0000 (0:00:00.047)       0:06:59.199 *****
2026-02-26 19:23:35.485632 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:35.485712 | controller |
2026-02-26 19:23:35.485849 | controller | TASK [discover_latest_image : Export facts accordingly] ************************
2026-02-26 19:23:35.485948 | controller | Thursday 26 February 2026  19:23:35 +0000 (0:00:00.745)       0:06:59.945 *****
2026-02-26 19:23:35.538642 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:35.538719 | controller |
2026-02-26 19:23:35.538846 | controller | TASK [cifmw_setup : Create artifacts with custom params] ***********************
2026-02-26 19:23:35.538948 | controller | Thursday 26 February 2026  19:23:35 +0000 (0:00:00.053)       0:06:59.998 *****
2026-02-26 19:23:36.398590 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:36.398646 | controller |
2026-02-26 19:23:36.398778 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] *******
2026-02-26 19:23:36.398905 | controller | Thursday 26 February 2026  19:23:36 +0000 (0:00:00.859)       0:07:00.858 *****
2026-02-26 19:23:36.868357 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 19:23:36.868428 | controller |
2026-02-26 19:23:36.868526 | controller | TASK [Configure CRC network if needed] *****************************************
2026-02-26 19:23:36.868614 | controller | Thursday 26 February 2026  19:23:36 +0000 (0:00:00.469)       0:07:01.327 *****
2026-02-26 19:23:37.012098 | controller |
2026-02-26 19:23:37.012136 | controller | TASK [openshift_setup : Gather network.operator info] **************************
2026-02-26 19:23:37.012245 | controller | Thursday 26 February 2026  19:23:37 +0000 (0:00:00.144)       0:07:01.471 *****
2026-02-26 19:23:38.098829 | controller | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)')))
2026-02-26 19:23:38.100448 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false
2026-02-26 19:23:38.100542 | controller |   module_stderr: |-
2026-02-26 19:23:38.100634 | controller |     Shared connection to controller-0.utility closed.
2026-02-26 19:23:38.100716 | controller |   module_stdout: |-
2026-02-26 19:23:38.100830 | controller |     Traceback (most recent call last):
2026-02-26 19:23:38.100925 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 700, in urlopen
2026-02-26 19:23:38.101026 | controller |         httplib_response = self._make_request(
2026-02-26 19:23:38.101116 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 383, in _make_request
2026-02-26 19:23:38.101202 | controller |         self._validate_conn(conn)
2026-02-26 19:23:38.101290 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1015, in _validate_conn
2026-02-26 19:23:38.101375 | controller |         conn.connect()
2026-02-26 19:23:38.101461 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connection.py", line 411, in connect
2026-02-26 19:23:38.101548 | controller |         self.sock = ssl_wrap_socket(
2026-02-26 19:23:38.101638 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket
2026-02-26 19:23:38.101737 | controller |         ssl_sock = _ssl_wrap_socket_impl(
2026-02-26 19:23:38.101842 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl
2026-02-26 19:23:38.101920 | controller |         return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
2026-02-26 19:23:38.102018 | controller |       File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket
2026-02-26 19:23:38.102114 | controller |         return self.sslsocket_class._create(
2026-02-26 19:23:38.102200 | controller |       File "/usr/lib64/python3.9/ssl.py", line 1076, in _create
2026-02-26 19:23:38.102286 | controller |         self.do_handshake()
2026-02-26 19:23:38.102373 | controller |       File "/usr/lib64/python3.9/ssl.py", line 1345, in do_handshake
2026-02-26 19:23:38.102459 | controller |         self._sslobj.do_handshake()
2026-02-26 19:23:38.102546 | controller |     ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)
2026-02-26 19:23:38.102628 | controller |
2026-02-26 19:23:38.102712 | controller |     During handling of the above exception, another exception occurred:
2026-02-26 19:23:38.102809 | controller |
2026-02-26 19:23:38.102895 | controller |     Traceback (most recent call last):
2026-02-26 19:23:38.102989 | controller |       File "/tmp/ansible-tmp-1772133817.0455208-28546-251293899228826/AnsiballZ_k8s_info.py", line 107, in <module>
2026-02-26 19:23:38.103082 | controller |         _ansiballz_main()
2026-02-26 19:23:38.103168 | controller |       File "/tmp/ansible-tmp-1772133817.0455208-28546-251293899228826/AnsiballZ_k8s_info.py", line 99, in _ansiballz_main
2026-02-26 19:23:38.103275 | controller |         invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS)
2026-02-26 19:23:38.103355 | controller |       File "/tmp/ansible-tmp-1772133817.0455208-28546-251293899228826/AnsiballZ_k8s_info.py", line 47, in invoke_module
2026-02-26 19:23:38.103446 | controller |         runpy.run_module(mod_name='ansible_collections.kubernetes.core.plugins.modules.k8s_info', init_globals=dict(_module_fqn='ansible_collections.kubernetes.core.plugins.modules.k8s_info', _modlib_path=modlib_path),
2026-02-26 19:23:38.103542 | controller |       File "/usr/lib64/python3.9/runpy.py", line 225, in run_module
2026-02-26 19:23:38.103622 | controller |         return _run_module_code(code, init_globals, run_name, mod_spec)
2026-02-26 19:23:38.103710 | controller |       File "/usr/lib64/python3.9/runpy.py", line 97, in _run_module_code
2026-02-26 19:23:38.103843 | controller |         _run_code(code, mod_globals, init_globals,
2026-02-26 19:23:38.103954 | controller |       File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code
2026-02-26 19:23:38.104049 | controller |         exec(code, run_globals)
2026-02-26 19:23:38.104131 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_1sxvb2eb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 229, in <module>
2026-02-26 19:23:38.104233 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_1sxvb2eb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 221, in main
2026-02-26 19:23:38.104324 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_1sxvb2eb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 352, in get_api_client
2026-02-26 19:23:38.104399 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_1sxvb2eb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 246, in wrapper
2026-02-26 19:23:38.104492 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_1sxvb2eb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 259, in create_api_client
2026-02-26 19:23:38.104583 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 84, in __init__
2026-02-26 19:23:38.104669 | controller |         self.__discoverer = discoverer(self, cache_file)
2026-02-26 19:23:38.104771 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_1sxvb2eb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 190, in __init__
2026-02-26 19:23:38.104875 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_1sxvb2eb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 45, in __init__
2026-02-26 19:23:38.104958 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_1sxvb2eb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 92, in __init_cache
2026-02-26 19:23:38.105067 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/discovery.py", line 146, in _load_server_info
2026-02-26 19:23:38.105144 | controller |         'kubernetes': self.client.request('get', '/version', serializer=just_json)
2026-02-26 19:23:38.105227 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 55, in inner
2026-02-26 19:23:38.105311 | controller |         resp = func(self, *args, **kwargs)
2026-02-26 19:23:38.105394 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 277, in request
2026-02-26 19:23:38.105466 | controller |         api_response = self.client.call_api(
2026-02-26 19:23:38.105550 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 348, in call_api
2026-02-26 19:23:38.105634 | controller |         return self.__call_api(resource_path, method,
2026-02-26 19:23:38.105720 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 180, in __call_api
2026-02-26 19:23:38.105834 | controller |         response_data = self.request(
2026-02-26 19:23:38.105923 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 373, in request
2026-02-26 19:23:38.106031 | controller |         return self.rest_client.GET(url,
2026-02-26 19:23:38.106134 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 244, in GET
2026-02-26 19:23:38.106218 | controller |         return self.request("GET", url,
2026-02-26 19:23:38.106302 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 217, in request
2026-02-26 19:23:38.106394 | controller |         r = self.pool_manager.request(method, url,
2026-02-26 19:23:38.106481 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 74, in request
2026-02-26 19:23:38.106564 | controller |         return self.request_encode_url(
2026-02-26 19:23:38.106649 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 96, in request_encode_url
2026-02-26 19:23:38.106741 | controller |         return self.urlopen(method, url, **extra_kw)
2026-02-26 19:23:38.106838 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/poolmanager.py", line 376, in urlopen
2026-02-26 19:23:38.106920 | controller |         response = conn.urlopen(method, u.request_uri, **kw)
2026-02-26 19:23:38.107016 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen
2026-02-26 19:23:38.107105 | controller |         return self.urlopen(
2026-02-26 19:23:38.107191 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen
2026-02-26 19:23:38.107272 | controller |         return self.urlopen(
2026-02-26 19:23:38.107357 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen
2026-02-26 19:23:38.107441 | controller |         return self.urlopen(
2026-02-26 19:23:38.107572 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 756, in urlopen
2026-02-26 19:23:38.107659 | controller |         retries = retries.increment(
2026-02-26 19:23:38.107761 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 576, in increment
2026-02-26 19:23:38.107860 | controller |         raise MaxRetryError(_pool, url, error or ResponseError(cause))
2026-02-26 19:23:38.107958 | controller |     urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)')))
2026-02-26 19:23:38.108059 | controller |   msg: |-
2026-02-26 19:23:38.108156 | controller |     MODULE FAILURE
2026-02-26 19:23:38.108252 | controller |     See stdout/stderr for the exact error
2026-02-26 19:23:38.108334 | controller |   rc: 1
2026-02-26 19:23:38.109554 | controller |
2026-02-26 19:23:38.109639 | controller | TASK [Create dnsmasq dir] ******************************************************
2026-02-26 19:23:38.109743 | controller | Thursday 26 February 2026  19:23:38 +0000 (0:00:01.097)       0:07:02.569 *****
2026-02-26 19:23:38.310924 | controller | changed: [instance]
2026-02-26 19:23:38.310977 | controller |
2026-02-26 19:23:38.311097 | controller | TASK [Get journalctl in a file] ************************************************
2026-02-26 19:23:38.311193 | controller | Thursday 26 February 2026  19:23:38 +0000 (0:00:00.201)       0:07:02.770 *****
2026-02-26 19:23:38.529400 | controller | changed: [instance]
2026-02-26 19:23:38.529450 | controller |
2026-02-26 19:23:38.529561 | controller | TASK [Dump journalctl output] **************************************************
2026-02-26 19:23:38.529649 | controller | Thursday 26 February 2026  19:23:38 +0000 (0:00:00.218)       0:07:02.988 *****
2026-02-26 19:23:38.917075 | controller | changed: [instance]
2026-02-26 19:23:38.917155 | controller |
2026-02-26 19:23:38.917273 | controller | TASK [Copy all dnsmasq config] *************************************************
2026-02-26 19:23:38.917364 | controller | Thursday 26 February 2026  19:23:38 +0000 (0:00:00.387)       0:07:03.376 *****
2026-02-26 19:23:39.423370 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2026-02-26 19:23:39.423430 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/)
2026-02-26 19:23:39.423720 | controller |
2026-02-26 19:23:39.621319 | controller | TASK [Create log directory] ****************************************************
2026-02-26 19:23:39.621354 | controller | Thursday 26 February 2026  19:23:39 +0000 (0:00:00.506)       0:07:03.882 *****
2026-02-26 19:23:39.621366 | controller | changed: [instance]
2026-02-26 19:23:40.470815 | controller |
2026-02-26 19:23:40.470845 | controller | TASK [Sync logs from controller-0] *********************************************
2026-02-26 19:23:40.470853 | controller | Thursday 26 February 2026  19:23:39 +0000 (0:00:00.197)       0:07:04.080 *****
2026-02-26 19:23:40.470863 | controller | changed: [instance]
2026-02-26 19:23:40.470892 | controller |
2026-02-26 19:23:40.470902 | controller | PLAY RECAP *********************************************************************
2026-02-26 19:23:40.471051 | controller | instance                   : ok=541  changed=208  unreachable=0    failed=1    skipped=229  rescued=0    ignored=0
2026-02-26 19:23:40.472958 | controller |
2026-02-26 19:23:40.472992 | controller | Thursday 26 February 2026  19:23:40 +0000 (0:00:00.848)       0:07:04.928 *****
2026-02-26 19:23:40.583782 | controller | ===============================================================================
2026-02-26 19:23:40.583815 | controller | reproducer : Check package install status ------------------------------ 50.20s
2026-02-26 19:23:40.583823 | controller | ci_setup : Install needed packages ------------------------------------- 32.02s
2026-02-26 19:23:40.583829 | controller | libvirt_manager : Download base image ---------------------------------- 30.10s
2026-02-26 19:23:40.583834 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 22.97s
2026-02-26 19:23:40.583839 | controller | reproducer : Install collections on controller-0 ----------------------- 20.08s
2026-02-26 19:23:40.583845 | controller | libvirt_manager : Install packages required for using KVM -------------- 10.39s
2026-02-26 19:23:40.583850 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.36s
2026-02-26 19:23:40.583855 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.42s
2026-02-26 19:23:40.583860 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 7.31s
2026-02-26 19:23:40.583866 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.11s
2026-02-26 19:23:40.583871 | controller | ci_setup : Install openshift client ------------------------------------- 6.08s
2026-02-26 19:23:40.583876 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.12s
2026-02-26 19:23:40.583881 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.77s
2026-02-26 19:23:40.583886 | controller | networking_mapper : Gather the facts ------------------------------------ 3.51s
2026-02-26 19:23:40.583892 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.10s
2026-02-26 19:23:40.583897 | controller | sushy_emulator : Install required packages ------------------------------ 2.44s
2026-02-26 19:23:40.583902 | controller | ci_setup : Manage directories ------------------------------------------- 2.37s
2026-02-26 19:23:40.583907 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.26s
2026-02-26 19:23:40.583912 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.15s
2026-02-26 19:23:40.583921 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s
2026-02-26 19:23:40.583931 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml']
2026-02-26 19:23:40.584357 | controller | WARNING  An error occurred during the test sequence action: 'converge'. Cleaning up.
2026-02-26 19:23:40.592854 | controller | INFO     Running crc_layout > cleanup
2026-02-26 19:23:40.593299 | controller | WARNING  Skipping, cleanup playbook not configured.
2026-02-26 19:23:40.600905 | controller | INFO     Running crc_layout > destroy
2026-02-26 19:23:40.601260 | controller | WARNING  Skipping, instances are delegated.
2026-02-26 19:23:40.601585 | controller | INFO     Pruning extra files from scenario ephemeral directory
2026-02-26 19:23:40.603133 | controller | INFO     Writing /tmp/report.html report.
2026-02-26 19:23:40.775976 | [controller] Waiting on logger
2026-02-26 19:23:45.915810 | [controller] Waiting on logger
2026-02-26 19:23:56.347807 | [controller] Waiting on logger
2026-02-26 19:24:06.779820 | [controller] Waiting on logger
2026-02-26 19:24:10.702193 | [Zuul] Log Stream did not terminate
2026-02-26 19:24:10.702480 | controller | ERROR
2026-02-26 19:24:10.702603 | controller | {
2026-02-26 19:24:10.702644 | controller |   "delta": "0:08:42.648409",
2026-02-26 19:24:10.702670 | controller |   "end": "2026-02-26 19:23:40.667285",
2026-02-26 19:24:10.702692 | controller |   "msg": "non-zero return code",
2026-02-26 19:24:10.702712 | controller |   "rc": 1,
2026-02-26 19:24:10.702731 | controller |   "start": "2026-02-26 19:14:58.018876"
2026-02-26 19:24:10.702749 | controller | }
failure
2026-02-26 19:24:10.754959 | 
2026-02-26 19:24:10.755061 | PLAY RECAP
2026-02-26 19:24:10.755107 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0
2026-02-26 19:24:10.755131 | 
2026-02-26 19:24:10.830715 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2026-02-26 19:24:10.831481 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2026-02-26 19:24:11.349838 | 
2026-02-26 19:24:11.349937 | PLAY [Run ci/playbooks/collect-logs.yml]
2026-02-26 19:24:11.370022 | 
2026-02-26 19:24:11.370095 | TASK [Filter out host if needed]
2026-02-26 19:24:11.378522 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller
2026-02-26 19:24:11.383045 | 
2026-02-26 19:24:11.383112 | TASK [Ensure file is present]
2026-02-26 19:24:11.747158 | controller | ok
2026-02-26 19:24:11.752559 | 
2026-02-26 19:24:11.752639 | TASK [Manage molecule report file]
2026-02-26 19:24:11.773191 | [controller] Waiting on logger
2026-02-26 19:24:21.115824 | [controller] Waiting on logger
2026-02-26 19:24:31.547835 | [controller] Waiting on logger
2026-02-26 19:24:40.891860 | [controller] Waiting on logger
2026-02-26 19:24:42.146350 | [Zuul] Log Stream did not terminate
2026-02-26 19:24:42.146585 | controller | changed
2026-02-26 19:24:42.151950 | 
2026-02-26 19:24:42.152012 | TASK [Check if we get ci-framework-data basedir]
2026-02-26 19:24:42.424526 | controller | ok
2026-02-26 19:24:42.429515 | 
2026-02-26 19:24:42.429592 | TASK [Create ci-framework-data log directory for zuul]
2026-02-26 19:24:42.814152 | controller | changed
2026-02-26 19:24:42.819944 | 
2026-02-26 19:24:42.820014 | TASK [Copy ci-framework interesting files]
2026-02-26 19:24:42.840669 | [controller] Waiting on logger
2026-02-26 19:24:53.243793 | [controller] Waiting on logger
2026-02-26 19:25:03.675849 | [controller] Waiting on logger
2026-02-26 19:25:13.019762 | [controller] Waiting on logger
2026-02-26 19:25:13.123357 | [Zuul] Log Stream did not terminate
2026-02-26 19:25:13.123579 | controller | changed
2026-02-26 19:25:13.128897 | 
2026-02-26 19:25:13.128962 | TASK [Get SELinux listing]
2026-02-26 19:25:14.172001 | [controller] Waiting on logger
2026-02-26 19:25:20.430456 | controller | changed
2026-02-26 19:25:20.436251 | 
2026-02-26 19:25:20.436340 | TASK [Generate log index]
2026-02-26 19:25:21.497276 | controller | changed
2026-02-26 19:25:21.502091 | 
2026-02-26 19:25:21.502164 | TASK [Get some env related data]
2026-02-26 19:25:25.499903 | [controller] Waiting on logger
2026-02-26 19:25:26.525348 | controller | changed
2026-02-26 19:25:26.530620 | 
2026-02-26 19:25:26.530684 | TASK [Generate list of logs to collect in home directory]
2026-02-26 19:25:26.921616 | controller | ok: All paths examined
2026-02-26 19:25:26.926844 | 
2026-02-26 19:25:26.926903 | LOOP [Copy logs from home directory]
2026-02-26 19:25:27.530789 | controller | changed:
2026-02-26 19:25:27.531009 | controller | {
2026-02-26 19:25:27.531042 | controller |   "atime": 1743544925.4788878,
2026-02-26 19:25:27.531064 | controller |   "ctime": 1743545329.1409318,
2026-02-26 19:25:27.531082 | controller |   "dev": 64513,
2026-02-26 19:25:27.531099 | controller |   "gid": 1000,
2026-02-26 19:25:27.531114 | controller |   "gr_name": "zuul",
2026-02-26 19:25:27.531129 | controller |   "inode": 4518807,
2026-02-26 19:25:27.531143 | controller |   "isblk": false,
2026-02-26 19:25:27.531157 | controller |   "ischr": false,
2026-02-26 19:25:27.531171 | controller |   "isdir": false,
2026-02-26 19:25:27.531194 | controller |   "isfifo": false,
2026-02-26 19:25:27.531211 | controller |   "isgid": false,
2026-02-26 19:25:27.531228 | controller |   "islnk": false,
2026-02-26 19:25:27.531244 | controller |   "isreg": true,
2026-02-26 19:25:27.531260 | controller |   "issock": false,
2026-02-26 19:25:27.531276 | controller |   "isuid": false,
2026-02-26 19:25:27.531357 | controller |   "mode": "0644",
2026-02-26 19:25:27.531386 | controller |   "mtime": 1743545329.1409318,
2026-02-26 19:25:27.531407 | controller |   "nlink": 1,
2026-02-26 19:25:27.531425 | controller |   "path": "/home/zuul/crc-setup.log",
2026-02-26 19:25:27.531440 | controller |   "pw_name": "zuul",
2026-02-26 19:25:27.531455 | controller |   "rgrp": true,
2026-02-26 19:25:27.531469 | controller |   "roth": true,
2026-02-26 19:25:27.531483 | controller |   "rusr": true,
2026-02-26 19:25:27.531549 | controller |   "size": 4108,
2026-02-26 19:25:27.531582 | controller |   "uid": 1000,
2026-02-26 19:25:27.531600 | controller |   "wgrp": false,
2026-02-26 19:25:27.531616 | controller |   "woth": false,
2026-02-26 19:25:27.531631 | controller |   "wusr": true,
2026-02-26 19:25:27.531646 | controller |   "xgrp": false,
2026-02-26 19:25:27.531660 | controller |   "xoth": false,
2026-02-26 19:25:27.531673 | controller |   "xusr": false
2026-02-26 19:25:27.531687 | controller | }
2026-02-26 19:25:28.097719 | controller | changed:
2026-02-26 19:25:28.097892 | controller | {
2026-02-26 19:25:28.097928 | controller |   "atime": 1743545331.0429637,
2026-02-26 19:25:28.097952 | controller |   "ctime": 1743545842.0111232,
2026-02-26 19:25:28.097971 | controller |   "dev": 64513,
2026-02-26 19:25:28.097989 | controller |   "gid": 1000,
2026-02-26 19:25:28.098007 | controller |   "gr_name": "zuul",
2026-02-26 19:25:28.098024 | controller |   "inode": 4194437,
2026-02-26 19:25:28.098045 | controller |   "isblk": false,
2026-02-26 19:25:28.098061 | controller |   "ischr": false,
2026-02-26 19:25:28.098076 | controller |   "isdir": false,
2026-02-26 19:25:28.098090 | controller |   "isfifo": false,
2026-02-26 19:25:28.098106 | controller |   "isgid": false,
2026-02-26 19:25:28.098121 | controller |   "islnk": false,
2026-02-26 19:25:28.098138 | controller |   "isreg": true,
2026-02-26 19:25:28.098154 | controller |   "issock": false,
2026-02-26 19:25:28.098170 | controller |   "isuid": false,
2026-02-26 19:25:28.098185 | controller |   "mode": "0644",
2026-02-26 19:25:28.098200 | controller |   "mtime": 1743545842.0111232,
2026-02-26 19:25:28.098216 | controller |   "nlink": 1,
2026-02-26 19:25:28.098231 | controller |   "path": "/home/zuul/crc-start.log",
2026-02-26 19:25:28.098247 | controller |   "pw_name": "zuul",
2026-02-26 19:25:28.098262 | controller |   "rgrp": true,
2026-02-26 19:25:28.098277 | controller |   "roth": true,
2026-02-26 19:25:28.098292 | controller |   "rusr": true,
2026-02-26 19:25:28.098335 | controller |   "size": 4023,
2026-02-26 19:25:28.098353 | controller |   "uid": 1000,
2026-02-26 19:25:28.098370 | controller |   "wgrp": false,
2026-02-26 19:25:28.098385 | controller |   "woth": false,
2026-02-26 19:25:28.098399 | controller |   "wusr": true,
2026-02-26 19:25:28.098414 | controller |   "xgrp": false,
2026-02-26 19:25:28.098427 | controller |   "xoth": false,
2026-02-26 19:25:28.098443 | controller |   "xusr": false
2026-02-26 19:25:28.098459 | controller | }
2026-02-26 19:25:28.642382 | controller | changed:
2026-02-26 19:25:28.642474 | controller | {
2026-02-26 19:25:28.642499 | controller |   "atime": 1772133279.0887349,
2026-02-26 19:25:28.642517 | controller |   "ctime": 1772133295.4488857,
2026-02-26 19:25:28.642533 | controller |   "dev": 64513,
2026-02-26 19:25:28.642550 | controller |   "gid": 1000,
2026-02-26 19:25:28.642578 | controller |   "gr_name": "zuul",
2026-02-26 19:25:28.642594 | controller |   "inode": 4638645,
2026-02-26 19:25:28.642611 | controller |   "isblk": false,
2026-02-26 19:25:28.642626 | controller |   "ischr": false,
2026-02-26 19:25:28.642641 | controller |   "isdir": false,
2026-02-26 19:25:28.642655 | controller |   "isfifo": false,
2026-02-26 19:25:28.642670 | controller |   "isgid": false,
2026-02-26 19:25:28.642685 | controller |   "islnk": false,
2026-02-26 19:25:28.642702 | controller |   "isreg": true,
2026-02-26 19:25:28.642717 | controller |   "issock": false,
2026-02-26 19:25:28.642731 | controller |   "isuid": false,
2026-02-26 19:25:28.642745 | controller |   "mode": "0644",
2026-02-26 19:25:28.642760 | controller |   "mtime": 1772133295.4488857,
2026-02-26 19:25:28.642774 | controller |   "nlink": 1,
2026-02-26 19:25:28.642789 | controller |   "path": "/home/zuul/ansible.log",
2026-02-26 19:25:28.642804 | controller |   "pw_name": "zuul",
2026-02-26 19:25:28.642818 | controller |   "rgrp": true,
2026-02-26 19:25:28.642832 | controller |   "roth": true,
2026-02-26 19:25:28.642846 | controller |   "rusr": true,
2026-02-26 19:25:28.642860 | controller |   "size": 6749,
2026-02-26 19:25:28.642874 | controller |   "uid": 1000,
2026-02-26 19:25:28.642888 | controller |   "wgrp": false,
2026-02-26 19:25:28.642902 | controller |   "woth": false,
2026-02-26 19:25:28.642915 | controller |   "wusr": true,
2026-02-26 19:25:28.642929 | controller |   "xgrp": false,
2026-02-26 19:25:28.642942 | controller |   "xoth": false,
2026-02-26 19:25:28.642956 | controller |   "xusr": false
2026-02-26 19:25:28.642969 | controller | }
2026-02-26 19:25:28.650750 | 
2026-02-26 19:25:28.650854 | TASK [Copy crio stats log file]
2026-02-26 19:25:28.664131 | controller | skipping: Conditional result was False
2026-02-26 19:25:28.669597 | 
2026-02-26 19:25:28.669671 | TASK [Get SELinux related data]
2026-02-26 19:25:33.696762 | controller | ERROR
2026-02-26 19:25:33.696991 | controller | {
2026-02-26 19:25:33.697024 | controller |   "delta": "0:00:00.009526",
2026-02-26 19:25:33.697048 | controller |   "end": "2026-02-26 19:25:28.943175",
2026-02-26 19:25:33.697078 | controller |   "msg": "non-zero return code",
2026-02-26 19:25:33.697097 | controller |   "rc": 1,
2026-02-26 19:25:33.697114 | controller |   "start": "2026-02-26 19:25:28.933649"
2026-02-26 19:25:33.697130 | controller | }
2026-02-26 19:25:33.697152 | controller | ERROR: Ignoring Errors
2026-02-26 19:25:33.702433 | 
2026-02-26 19:25:33.702495 | TASK [Create system configuration directory]
2026-02-26 19:25:33.947971 | controller | changed
2026-02-26 19:25:33.954527 | 
2026-02-26 19:25:33.954635 | TASK [Get some of the system configurations]
2026-02-26 19:25:33.975907 | [controller] Waiting on logger
2026-02-26 19:25:35.931771 | [controller] Waiting on logger
2026-02-26 19:25:39.086255 | controller | changed
2026-02-26 19:25:39.091628 | 
2026-02-26 19:25:39.091705 | TASK [Copy generated documentation if available]
2026-02-26 19:25:39.104895 | controller | skipping: Conditional result was False
2026-02-26 19:25:39.110390 | 
2026-02-26 19:25:39.110456 | TASK [Copy generated AsciiDoc documentation if available]
2026-02-26 19:25:39.123680 | controller | skipping: Conditional result was False
2026-02-26 19:25:39.128886 | 
2026-02-26 19:25:39.128951 | TASK [Compress logs bigger than 2MB]
2026-02-26 19:25:39.149676 | [controller] Waiting on logger
2026-02-26 19:25:54.748019 | [controller] Waiting on logger
2026-02-26 19:26:04.091686 | [controller] Waiting on logger
2026-02-26 19:26:09.400195 | [Zuul] Log Stream did not terminate
2026-02-26 19:26:09.400421 | controller | changed
2026-02-26 19:26:09.405569 | 
2026-02-26 19:26:09.405633 | TASK [Copy files from workspace on node]
2026-02-26 19:26:09.423605 | controller | ok
2026-02-26 19:26:09.445816 | 
2026-02-26 19:26:09.445890 | TASK [fetch-output : Set log path for multiple nodes]
2026-02-26 19:26:09.459511 | controller | skipping: Conditional result was False
2026-02-26 19:26:09.465255 | 
2026-02-26 19:26:09.465342 | TASK [fetch-output : Set log path for single node]
2026-02-26 19:26:09.493462 | controller | ok
2026-02-26 19:26:09.498329 | 
2026-02-26 19:26:09.498402 | LOOP [fetch-output : Ensure local output dirs]
2026-02-26 19:26:09.693523 | controller -> localhost | ok: "/var/lib/zuul/builds/887aa6d2228f4b4e801f111ad7ae8901/work/logs"
2026-02-26 19:26:09.693870 | controller -> localhost | changed: All items complete
2026-02-26 19:26:09.693914 | 
2026-02-26 19:26:09.867953 | controller -> localhost | changed: "/var/lib/zuul/builds/887aa6d2228f4b4e801f111ad7ae8901/work/artifacts"
2026-02-26 19:26:10.042703 | controller -> localhost | changed: "/var/lib/zuul/builds/887aa6d2228f4b4e801f111ad7ae8901/work/docs"
2026-02-26 19:26:10.055826 | 
2026-02-26 19:26:10.055959 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-02-26 19:26:10.672802 | controller | changed:
2026-02-26 19:26:10.673011 | controller | .d..t...... ./
2026-02-26 19:26:10.673047 | controller | >f+++++++++ README.html
2026-02-26 19:26:10.673072 | controller | >f+++++++++ ansible-execution.log
2026-02-26 19:26:10.673095 | controller | >f+++++++++ ansible.log
2026-02-26 19:26:10.673117 | controller | >f+++++++++ crc-setup.log
2026-02-26 19:26:10.673137 | controller | >f+++++++++ crc-start.log
2026-02-26 19:26:10.673157 | controller | >f+++++++++ dmesg.log
2026-02-26 19:26:10.673177 | controller | >f+++++++++ installed-pkgs.log
2026-02-26 19:26:10.673196 | controller | >f+++++++++ python.log
2026-02-26 19:26:10.673214 | controller | >f+++++++++ registries.conf
2026-02-26 19:26:10.673232 | controller | >f+++++++++ report.html
2026-02-26 19:26:10.673251 | controller | >f+++++++++ selinux-denials.log
2026-02-26 19:26:10.673270 | controller | >f+++++++++ selinux-listing.log
2026-02-26 19:26:10.673288 | controller | cd+++++++++ ci-framework-data/
2026-02-26 19:26:10.673332 | controller | cd+++++++++ ci-framework-data/artifacts/
2026-02-26 19:26:10.673354 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml
2026-02-26 19:26:10.673373 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/
2026-02-26 19:26:10.673391 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf
2026-02-26 19:26:10.673415 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf
2026-02-26 19:26:10.673435 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf
2026-02-26 19:26:10.673454 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf
2026-02-26 19:26:10.673472 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf
2026-02-26 19:26:10.673490 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log
2026-02-26 19:26:10.673507 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf
2026-02-26 19:26:10.673525 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf
2026-02-26 19:26:10.673542 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf
2026-02-26 19:26:10.673572 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf
2026-02-26 19:26:10.673590 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/
2026-02-26 19:26:10.673608 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:8a:f4:7d
2026-02-26 19:26:10.673626 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:af:c1:1f
2026-02-26 19:26:10.673643 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:1f:c6:51
2026-02-26 19:26:10.673659 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:15:50:37
2026-02-26 19:26:10.673675 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:89:08:69
2026-02-26 19:26:10.673692 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:75:42:70
2026-02-26 19:26:10.673709 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/
2026-02-26 19:26:10.673726 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml
2026-02-26 19:26:10.673743 | controller | cd+++++++++ ci-framework-data/logs/
2026-02-26 19:26:10.673760 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log
2026-02-26 19:26:10.673776 | controller | cd+++++++++ ci-framework-data/logs/controller-0/
2026-02-26 19:26:10.673793 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log
2026-02-26 19:26:10.673810 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/
2026-02-26 19:26:10.673826 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/
2026-02-26 19:26:10.673843 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml
2026-02-26 19:26:10.673861 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml
2026-02-26 19:26:10.673879 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/
2026-02-26 19:26:10.673895 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/
2026-02-26 19:26:10.673912 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/
2026-02-26 19:26:10.673929 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/
2026-02-26 19:26:10.673946 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml
2026-02-26 19:26:10.673963 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml
2026-02-26 19:26:10.673980 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/
2026-02-26 19:26:10.673997 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo
2026-02-26 19:26:10.674017 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo
2026-02-26 19:26:10.674037 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5
2026-02-26 19:26:10.674056 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo
2026-02-26 19:26:10.674074 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo
2026-02-26 19:26:10.674091 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo
2026-02-26 19:26:10.674108 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo
2026-02-26 19:26:10.674125 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/
2026-02-26 19:26:10.674142 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/
2026-02-26 19:26:10.674160 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd
2026-02-26 19:26:10.674177 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf
2026-02-26 19:26:10.674194 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts
2026-02-26 19:26:10.674211 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/
2026-02-26 19:26:10.674227 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/
2026-02-26 19:26:10.674244 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml
2026-02-26 19:26:10.674260 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml
2026-02-26 19:26:10.674277 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml
2026-02-26 19:26:10.674308 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml
2026-02-26 19:26:10.674333 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/
2026-02-26 19:26:10.674352 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt
2026-02-26 19:26:10.674370 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/
2026-02-26 19:26:10.674387 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/
2026-02-26 19:26:10.674404 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd
2026-02-26 19:26:10.674421 | controller | cd+++++++++ registries.conf.d/
2026-02-26 19:26:10.674438 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf
2026-02-26 19:26:10.674456 | controller | cd+++++++++ system-config/
2026-02-26 19:26:10.674473 | controller | cd+++++++++ system-config/libvirt/
2026-02-26 19:26:10.674490 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf
2026-02-26 19:26:10.674508 | controller | >f+++++++++ system-config/libvirt/libvirt.conf
2026-02-26 19:26:10.674526 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf
2026-02-26 19:26:10.674543 | controller | >f+++++++++ system-config/libvirt/network.conf
2026-02-26 19:26:10.674570 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf
2026-02-26 19:26:10.674588 | controller | >f+++++++++ system-config/libvirt/qemu.conf
2026-02-26 19:26:10.674605 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf
2026-02-26 19:26:10.674621 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf
2026-02-26 19:26:10.674645 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf
2026-02-26 19:26:10.674663 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf
2026-02-26 19:26:10.674679 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf
2026-02-26 19:26:10.674696 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf
2026-02-26 19:26:10.674713 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf
2026-02-26 19:26:10.674730 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf
2026-02-26 19:26:10.674747 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf
2026-02-26 19:26:10.674764 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf
2026-02-26 19:26:11.108117 | controller | changed: .d..t...... ./
2026-02-26 19:26:11.545382 | controller | changed: .d..t...... ./
2026-02-26 19:26:11.556826 | 
2026-02-26 19:26:11.556894 | TASK [Return artifact to Zuul]
2026-02-26 19:26:11.585124 | controller | ok
2026-02-26 19:26:11.603129 | 
2026-02-26 19:26:11.603211 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host]
2026-02-26 19:26:11.603327 | 
2026-02-26 19:26:11.603362 | PLAY RECAP
2026-02-26 19:26:11.603399 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1
2026-02-26 19:26:11.603420 | 
2026-02-26 19:26:11.677234 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2026-02-26 19:26:11.678032 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-02-26 19:26:12.194061 | 
2026-02-26 19:26:12.194162 | PLAY [all]
2026-02-26 19:26:12.212776 | 
2026-02-26 19:26:12.212851 | TASK [include_role : fetch-output]
2026-02-26 19:26:12.240926 | controller | ok
2026-02-26 19:26:12.257726 | 
2026-02-26 19:26:12.257807 | TASK [fetch-output : Set log path for multiple nodes]
2026-02-26 19:26:12.301660 | controller | skipping: Conditional result was False
2026-02-26 19:26:12.307409 | 
2026-02-26 19:26:12.307479 | TASK [fetch-output : Set log path for single node]
2026-02-26 19:26:12.335432 | controller | ok
2026-02-26 19:26:12.340619 | 
2026-02-26 19:26:12.340690 | LOOP [fetch-output : Ensure local output dirs]
2026-02-26 19:26:12.662677 | controller -> localhost | ok: "/var/lib/zuul/builds/887aa6d2228f4b4e801f111ad7ae8901/work/logs"
2026-02-26 19:26:12.858385 | controller -> localhost | ok: "/var/lib/zuul/builds/887aa6d2228f4b4e801f111ad7ae8901/work/artifacts"
2026-02-26 19:26:13.055670 | controller -> localhost | ok: "/var/lib/zuul/builds/887aa6d2228f4b4e801f111ad7ae8901/work/docs"
2026-02-26 19:26:13.071361 | 
2026-02-26 19:26:13.071499 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-02-26 19:26:13.651883 | controller | ok
2026-02-26 19:26:13.652071 | controller | ok: All items complete
2026-02-26 19:26:13.652103 | 
2026-02-26 19:26:14.079960 | controller | ok
2026-02-26 19:26:14.509346 | controller | ok
2026-02-26 19:26:14.526826 | 
2026-02-26 19:26:14.526929 | TASK [include_role : fetch-output-openshift]
2026-02-26 19:26:14.540655 | controller | skipping: Conditional result was False
2026-02-26 19:26:14.546444 | 
2026-02-26 19:26:14.546519 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-02-26 19:26:14.885608 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006028
2026-02-26 19:26:15.076875 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006141
2026-02-26 19:26:15.111331 | 
2026-02-26 19:26:15.111424 | PLAY [all]
2026-02-26 19:26:15.125616 | 
2026-02-26 19:26:15.125690 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-02-26 19:26:15.580683 | controller | changed
2026-02-26 19:26:15.602412 | 
2026-02-26 19:26:15.602464 | PLAY RECAP
2026-02-26 19:26:15.602508 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2026-02-26 19:26:15.602532 | 
2026-02-26 19:26:15.669697 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-02-26 19:26:15.670465 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master]
2026-02-26 19:26:16.213110 | 
2026-02-26 19:26:16.213215 | PLAY [localhost]
2026-02-26 19:26:16.230093 | 
2026-02-26 19:26:16.230170 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-02-26 19:26:16.541145 | localhost | changed
2026-02-26 19:26:16.545540 | 
2026-02-26 19:26:16.545643 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-02-26 19:26:16.572866 | localhost | ok
2026-02-26 19:26:16.580537 | 
2026-02-26 19:26:16.580618 | TASK [add-fileserver : Create SSH private key tempfile]
2026-02-26 19:26:16.881222 | localhost | changed
2026-02-26 19:26:16.886614 | 
2026-02-26 19:26:16.886691 | TASK [add-fileserver : Create SSH private key from secret]
2026-02-26 19:26:17.430239 | localhost | changed
2026-02-26 19:26:17.435187 | 
2026-02-26 19:26:17.435272 | TASK [add-fileserver : Add fileserver ssh key]
2026-02-26 19:26:17.766733 | localhost | Identity added: /var/lib/zuul/builds/887aa6d2228f4b4e801f111ad7ae8901/work/tmp/ansible.gf30vmyl (/var/lib/zuul/builds/887aa6d2228f4b4e801f111ad7ae8901/work/tmp/ansible.gf30vmyl)
2026-02-26 19:26:17.766908 | localhost | ok: Runtime: 0:00:00.006332
2026-02-26 19:26:17.771112 | 
2026-02-26 19:26:17.771187 | TASK [add-fileserver : Remove SSH private key from disk]
2026-02-26 19:26:17.991318 | localhost | ok: Runtime: 0:00:00.004442
2026-02-26 19:26:17.996000 | 
2026-02-26 19:26:17.996078 | TASK [add-fileserver : Add fileserver to inventory]
2026-02-26 19:26:18.044176 | localhost | changed
2026-02-26 19:26:18.049283 | 
2026-02-26 19:26:18.049409 | TASK [add-fileserver : Add fileserver server to known hosts]
2026-02-26 19:26:18.361017 | localhost | changed
2026-02-26 19:26:18.379746 | 
2026-02-26 19:26:18.379839 | PLAY [localhost]
2026-02-26 19:26:18.390789 | 
2026-02-26 19:26:18.390853 | TASK [Generate bulk log download script]
2026-02-26 19:26:18.408230 | localhost | ok
2026-02-26 19:26:18.418981 | 
2026-02-26 19:26:18.419052 | TASK [local-log-download : Check API endpoint is defined]
2026-02-26 19:26:18.445484 | localhost | ok: All assertions passed
2026-02-26 19:26:18.449625 | 
2026-02-26 19:26:18.449692 | TASK [local-log-download : Create download script]
2026-02-26 19:26:18.796171 | localhost -> localhost | changed
2026-02-26 19:26:18.804845 | 
2026-02-26 19:26:18.804923 | TASK [Register quick-download link]
2026-02-26 19:26:18.821316 | localhost | ok
2026-02-26 19:26:18.855146 | 
2026-02-26 19:26:18.855218 | PLAY [logserver.rdoproject.org]
2026-02-26 19:26:18.864503 | 
2026-02-26 19:26:18.864575 | TASK [Set zuul-log-path fact]
2026-02-26 19:26:18.880062 | logserver.rdoproject.org | ok
2026-02-26 19:26:18.888584 | 
2026-02-26 19:26:18.888651 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-02-26 19:26:18.913868 | logserver.rdoproject.org | ok
2026-02-26 19:26:18.919276 | 
2026-02-26 19:26:18.919359 | TASK [upload-logs : Create log directories]
2026-02-26 19:26:20.740439 | logserver.rdoproject.org | changed
2026-02-26 19:26:20.743379 | 
2026-02-26 19:26:20.743442 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-02-26 19:26:20.969216 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005153
2026-02-26 19:26:20.973464 | 
2026-02-26 19:26:20.973529 | TASK [upload-logs : Upload logs to log server]
2026-02-26 19:26:22.520106 | logserver.rdoproject.org | Output suppressed because no_log was given
2026-02-26 19:26:22.522873 | 
2026-02-26 19:26:22.522937 | LOOP [upload-logs : Compress console log and json output]
2026-02-26 19:26:22.559845 | logserver.rdoproject.org | skipping: Conditional result was False
2026-02-26 19:26:22.567580 | logserver.rdoproject.org | skipping: Conditional result was False
2026-02-26 19:26:22.579393 | 
2026-02-26 19:26:22.579465 | LOOP [upload-logs : Upload compressed console log and json output]
2026-02-26 19:26:22.613203 | logserver.rdoproject.org | skipping: Conditional result was False
2026-02-26 19:26:22.613464 | 
2026-02-26 19:26:22.616823 | logserver.rdoproject.org | skipping: Conditional result was False
2026-02-26 19:26:22.625954 | 
2026-02-26 19:26:22.626026 | LOOP [upload-logs : Upload console log and json output]