2026-03-16 14:25:50.813593 | Job console starting...
2026-03-16 14:25:51.073834 | Updating repositories
2026-03-16 14:25:51.102144 | Preparing job workspace
2026-03-16 14:25:58.025035 | Running Ansible setup...
2026-03-16 14:26:01.612877 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-03-16 14:26:02.118258 | 
2026-03-16 14:26:02.118400 | PLAY [localhost]
2026-03-16 14:26:02.126651 | 
2026-03-16 14:26:02.126723 | TASK [Gathering Facts]
2026-03-16 14:26:02.931167 | localhost | ok
2026-03-16 14:26:02.944425 | 
2026-03-16 14:26:02.944518 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-16 14:26:03.262321 | localhost -> localhost | changed
2026-03-16 14:26:03.268183 | 
2026-03-16 14:26:03.268270 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-16 14:26:03.949725 | localhost -> localhost | changed
2026-03-16 14:26:03.958666 | 
2026-03-16 14:26:03.958748 | TASK [Setup log path fact]
2026-03-16 14:26:03.976215 | localhost | ok
2026-03-16 14:26:03.987568 | 
2026-03-16 14:26:03.987634 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-16 14:26:04.005039 | localhost | ok
2026-03-16 14:26:04.012109 | 
2026-03-16 14:26:04.012176 | TASK [emit-job-header : Print job information]
2026-03-16 14:26:04.038969 | # Job Information
2026-03-16 14:26:04.039085 | Ansible Version: 2.15.12
2026-03-16 14:26:04.039115 | Job: cifmw-molecule-reproducer
2026-03-16 14:26:04.039138 | Pipeline: github-check
2026-03-16 14:26:04.039161 | Executor: ibm-bm4-ze.softwarefactory-project.io
2026-03-16 14:26:04.039181 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3129
2026-03-16 14:26:04.039201 | Log URL (when completed): https://logserver.rdoproject.org/d66/rdoproject.org/d66db8af36854395b2cd08caae64fa6d/
2026-03-16 14:26:04.039221 | Event ID: e2445310-2143-11f1-86ed-493aa75875c3
2026-03-16 14:26:04.042700 | 
2026-03-16 14:26:04.042762 | LOOP [emit-job-header : Print node information]
2026-03-16 14:26:04.126189 | localhost | ok:
2026-03-16 14:26:04.126443 | localhost | # Node Information
2026-03-16 14:26:04.126478 | localhost | Inventory Hostname: controller
2026-03-16 14:26:04.126503 | localhost | Hostname: np0005648472
2026-03-16 14:26:04.126525 | localhost | Username: zuul
2026-03-16 14:26:04.126546 | localhost | Distro: CentOS 9
2026-03-16 14:26:04.126576 | localhost | Provider: ibm-bm4-nodepool
2026-03-16 14:26:04.126602 | localhost | Region: regionOne
2026-03-16 14:26:04.126626 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm
2026-03-16 14:26:04.126649 | localhost | Product Name: OpenStack Compute
2026-03-16 14:26:04.126671 | localhost | Interface IP: 192.168.26.187
2026-03-16 14:26:04.156246 | 
2026-03-16 14:26:04.156341 | PLAY [all]
2026-03-16 14:26:04.162848 | 
2026-03-16 14:26:04.162911 | TASK [Gather network facts]
2026-03-16 14:26:04.567088 | controller | ok
2026-03-16 14:26:04.580758 | 
2026-03-16 14:26:04.580827 | TASK [include_role : start-zuul-console]
2026-03-16 14:26:04.599496 | controller | ok
2026-03-16 14:26:04.610097 | 
2026-03-16 14:26:04.610160 | TASK [start-zuul-console : Start zuul_console daemon.]
2026-03-16 14:26:04.961151 | controller | ok
2026-03-16 14:26:04.968940 | 
2026-03-16 14:26:04.968996 | TASK [include_role : add-build-sshkey]
2026-03-16 14:26:04.986736 | controller | ok
2026-03-16 14:26:04.998136 | 
2026-03-16 14:26:04.998198 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-16 14:26:05.184341 | controller -> localhost | ok
2026-03-16 14:26:05.189797 | 
2026-03-16 14:26:05.189869 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-16 14:26:05.208532 | controller | ok
2026-03-16 14:26:05.220779 | controller | included: /var/lib/zuul/builds/d66db8af36854395b2cd08caae64fa6d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-16 14:26:05.226172 | 
2026-03-16 14:26:05.226248 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-16 14:26:06.060550 | controller -> localhost | Generating public/private rsa key pair.
2026-03-16 14:26:06.060729 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/d66db8af36854395b2cd08caae64fa6d/work/d66db8af36854395b2cd08caae64fa6d_id_rsa.
2026-03-16 14:26:06.060763 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/d66db8af36854395b2cd08caae64fa6d/work/d66db8af36854395b2cd08caae64fa6d_id_rsa.pub.
2026-03-16 14:26:06.060786 | controller -> localhost | The key fingerprint is:
2026-03-16 14:26:06.060806 | controller -> localhost | SHA256:C1xZHbrrWSM+c6OzmoG8CAAuL7cp6wOwZEz8jt2q6Bw zuul-build-sshkey
2026-03-16 14:26:06.060824 | controller -> localhost | The key's randomart image is:
2026-03-16 14:26:06.060843 | controller -> localhost | +---[RSA 3072]----+
2026-03-16 14:26:06.060861 | controller -> localhost | |.         ....   |
2026-03-16 14:26:06.060879 | controller -> localhost | | o       o ..    |
2026-03-16 14:26:06.060896 | controller -> localhost | |+ .     o .      |
2026-03-16 14:26:06.060913 | controller -> localhost | |++ . . .   .     |
2026-03-16 14:26:06.060930 | controller -> localhost | |*o+ . o S .      |
2026-03-16 14:26:06.060947 | controller -> localhost | |++ o o o . .     |
2026-03-16 14:26:06.060963 | controller -> localhost | |oE+ . o o o o    |
2026-03-16 14:26:06.060979 | controller -> localhost | |++.= . . =++o.   |
2026-03-16 14:26:06.061004 | controller -> localhost | |=B= . . o.*B .   |
2026-03-16 14:26:06.061019 | controller -> localhost | +----[SHA256]-----+
2026-03-16 14:26:06.061061 | controller -> localhost | ok: Runtime: 0:00:00.508293
2026-03-16 14:26:06.066783 | 
2026-03-16 14:26:06.066846 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-16 14:26:06.084799 | controller | ok
2026-03-16 14:26:06.093677 | controller | included: /var/lib/zuul/builds/d66db8af36854395b2cd08caae64fa6d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-16 14:26:06.101219 | 
2026-03-16 14:26:06.101305 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-16 14:26:06.114765 | controller | skipping: Conditional result was False
2026-03-16 14:26:06.119761 | 
2026-03-16 14:26:06.119827 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-16 14:26:06.565174 | controller | changed
2026-03-16 14:26:06.569995 | 
2026-03-16 14:26:06.570058 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-16 14:26:06.822010 | controller | ok
2026-03-16 14:26:06.826576 | 
2026-03-16 14:26:06.826634 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-16 14:26:07.858085 | controller | changed
2026-03-16 14:26:07.863200 | 
2026-03-16 14:26:07.863287 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-16 14:26:08.897143 | controller | changed
2026-03-16 14:26:08.902183 | 
2026-03-16 14:26:08.902267 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-16 14:26:08.917103 | controller | skipping: Conditional result was False
2026-03-16 14:26:08.922731 | 
2026-03-16 14:26:08.922798 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-16 14:26:09.240913 | controller -> localhost | changed
2026-03-16 14:26:09.249732 | 
2026-03-16 14:26:09.249806 | TASK [add-build-sshkey : Add back temp key]
2026-03-16 14:26:09.497120 | controller -> localhost | Identity added: /var/lib/zuul/builds/d66db8af36854395b2cd08caae64fa6d/work/d66db8af36854395b2cd08caae64fa6d_id_rsa (zuul-build-sshkey)
2026-03-16 14:26:09.497406 | controller -> localhost | ok: Runtime: 0:00:00.009915
2026-03-16 14:26:09.503344 | 
2026-03-16 14:26:09.503414 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-16 14:26:09.889492 | controller | ok
2026-03-16 14:26:09.894096 | 
2026-03-16 14:26:09.894163 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-16 14:26:09.928235 | controller | skipping: Conditional result was False
2026-03-16 14:26:09.937956 | 
2026-03-16 14:26:09.938023 | TASK [include_role : validate-host]
2026-03-16 14:26:09.967844 | controller | ok
2026-03-16 14:26:09.993490 | 
2026-03-16 14:26:09.993679 | TASK [validate-host : Define zuul_info_dir fact]
2026-03-16 14:26:10.023386 | controller | ok
2026-03-16 14:26:10.027610 | 
2026-03-16 14:26:10.027669 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2026-03-16 14:26:10.266007 | controller -> localhost | ok
2026-03-16 14:26:10.271440 | 
2026-03-16 14:26:10.271499 | TASK [validate-host : Collect information about the host]
2026-03-16 14:26:10.971038 | controller | ok
2026-03-16 14:26:10.980746 | 
2026-03-16 14:26:10.980812 | TASK [validate-host : Sanitize hostname]
2026-03-16 14:26:11.030372 | controller | ok
2026-03-16 14:26:11.035708 | 
2026-03-16 14:26:11.035778 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2026-03-16 14:26:11.437672 | controller -> localhost | changed
2026-03-16 14:26:11.443914 | 
2026-03-16 14:26:11.443996 | TASK [validate-host : Collect information about zuul worker]
2026-03-16 14:26:11.822208 | controller | ok
2026-03-16 14:26:11.828050 | 
2026-03-16 14:26:11.828173 | TASK [validate-host : Write out all zuul information for each host]
2026-03-16 14:26:12.208481 | controller -> localhost | changed
2026-03-16 14:26:12.218446 | 
2026-03-16 14:26:12.218511 | TASK [include_role : prepare-workspace-openshift]
2026-03-16 14:26:12.243942 | controller | skipping: Conditional result was False
2026-03-16 14:26:12.249256 | 
2026-03-16 14:26:12.249354 | TASK [include_role : remove-zuul-sshkey]
2026-03-16 14:26:12.274658 | controller | skipping: Conditional result was False
2026-03-16 14:26:12.283209 | 
2026-03-16 14:26:12.283374 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-16 14:26:12.538848 | controller | ok: "logs"
2026-03-16 14:26:12.539110 | controller | ok: All items complete
2026-03-16 14:26:12.539145 | 
2026-03-16 14:26:12.758289 | controller | ok: "artifacts"
2026-03-16 14:26:12.984920 | controller | ok: "docs"
2026-03-16 14:26:13.000352 | 
2026-03-16 14:26:13.000548 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-16 14:26:13.254656 | controller | changed: "logs"
2026-03-16 14:26:13.469021 | controller | changed: "artifacts"
2026-03-16 14:26:13.687387 | controller | changed: "docs"
2026-03-16 14:26:13.710835 | 
2026-03-16 14:26:13.710955 | PLAY RECAP
2026-03-16 14:26:13.711007 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-03-16 14:26:13.711037 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-16 14:26:13.711057 | 
2026-03-16 14:26:13.811895 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-03-16 14:26:13.812907 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2026-03-16 14:26:14.394262 | 
2026-03-16 14:26:14.394413 | PLAY [all]
2026-03-16 14:26:14.413845 | 
2026-03-16 14:26:14.413921 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2026-03-16 14:26:14.473625 | controller | ok
2026-03-16 14:26:14.478778 | 
2026-03-16 14:26:14.478882 | TASK [mirror-info-fork : Create /etc/ci]
2026-03-16 14:26:14.883694 | controller | changed
2026-03-16 14:26:14.889669 | 
2026-03-16 14:26:14.889779 | TASK [mirror-info-fork : Install ci_mirror script]
2026-03-16 14:26:16.166147 | controller | changed
2026-03-16 14:26:16.176024 | 
2026-03-16 14:26:16.176097 | LOOP [add-authorized-keys : Enable access via build key on all nodes]
2026-03-16 14:26:16.622562 | controller | changed:
2026-03-16 14:26:16.622767 | controller | {
2026-03-16 14:26:16.622803 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com"
2026-03-16 14:26:16.622836 | controller | }
2026-03-16 14:26:16.888514 | controller | changed:
2026-03-16 14:26:16.888591 | controller | {
2026-03-16 14:26:16.888621 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com"
2026-03-16 14:26:16.888645 | controller | }
2026-03-16 14:26:17.158090 | controller | changed:
2026-03-16 14:26:17.158177 | controller | {
2026-03-16 14:26:17.158207 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com"
2026-03-16 14:26:17.158236 | controller | }
2026-03-16 14:26:17.477471 | controller | changed:
2026-03-16 14:26:17.477533 | controller | {
2026-03-16 14:26:17.477558 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com"
2026-03-16 14:26:17.477579 | controller | }
2026-03-16 14:26:17.779774 | controller | changed:
2026-03-16 14:26:17.779844 | controller | {
2026-03-16 14:26:17.779869 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com"
2026-03-16 14:26:17.779888 | controller | }
2026-03-16 14:26:18.065982 | controller | changed:
2026-03-16 14:26:18.066060 | controller | {
2026-03-16 14:26:18.066086 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com"
2026-03-16 14:26:18.066107 | controller | }
2026-03-16 14:26:18.355602 | controller | changed:
2026-03-16 14:26:18.355703 | controller | {
2026-03-16 14:26:18.355731 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen"
2026-03-16 14:26:18.355753 | controller | }
2026-03-16 14:26:18.627653 | controller | changed:
2026-03-16 14:26:18.627952 | controller | {
2026-03-16 14:26:18.627989 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora"
2026-03-16 14:26:18.628012 | controller | }
2026-03-16 14:26:18.909140 | controller | changed:
2026-03-16 14:26:18.909218 | controller | {
2026-03-16 14:26:18.909246 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner"
2026-03-16 14:26:18.909267 | controller | }
2026-03-16 14:26:19.207518 | controller | changed:
2026-03-16 14:26:19.207610 | controller | {
2026-03-16 14:26:19.207636 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com"
2026-03-16 14:26:19.207656 | controller | }
2026-03-16 14:26:19.463775 | controller | changed:
2026-03-16 14:26:19.463845 | controller | {
2026-03-16 14:26:19.463871 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com"
2026-03-16 14:26:19.463892 | controller | }
2026-03-16 14:26:19.748979 | controller | changed:
2026-03-16 14:26:19.749030 | controller | {
2026-03-16 14:26:19.749056 | controller |   "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com"
2026-03-16 14:26:19.749075 | controller | }
2026-03-16 14:26:20.031636 | controller | changed:
2026-03-16 14:26:20.031707 | controller | {
2026-03-16 14:26:20.031734 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com"
2026-03-16 14:26:20.031754 | controller | }
2026-03-16 14:26:20.316877 | controller | changed:
2026-03-16 14:26:20.316999 | controller | {
2026-03-16 14:26:20.317029 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel"
2026-03-16 14:26:20.317053 | controller | }
2026-03-16 14:26:20.623404 | controller | changed:
2026-03-16 14:26:20.623506 | controller | {
2026-03-16 14:26:20.623534 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux"
2026-03-16 14:26:20.623556 | controller | }
2026-03-16 14:26:20.909944 | controller | changed:
2026-03-16 14:26:20.910002 | controller | {
2026-03-16 14:26:20.910028 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr"
2026-03-16 14:26:20.910049 | controller | }
2026-03-16 14:26:21.200181 | controller | changed:
2026-03-16 14:26:21.200239 | controller | {
2026-03-16 14:26:21.200267 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com"
2026-03-16 14:26:21.200317 | controller | }
2026-03-16 14:26:21.484157 | controller | changed:
2026-03-16 14:26:21.484209 | controller | {
2026-03-16 14:26:21.484234 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb"
2026-03-16 14:26:21.484261 | controller | }
2026-03-16 14:26:21.759600 | controller | changed:
2026-03-16 14:26:21.759652 | controller | {
2026-03-16 14:26:21.759677 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9"
2026-03-16 14:26:21.759696 | controller | }
2026-03-16 14:26:22.040023 | controller | changed:
2026-03-16 14:26:22.040074 | controller | {
2026-03-16 14:26:22.040099 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora"
2026-03-16 14:26:22.040119 | controller | }
2026-03-16 14:26:22.327082 | controller | changed:
2026-03-16 14:26:22.327134 | controller | {
2026-03-16 14:26:22.327159 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac"
2026-03-16 14:26:22.327178 | controller | }
2026-03-16 14:26:22.599764 | controller | changed:
2026-03-16 14:26:22.599817 | controller | {
2026-03-16 14:26:22.599843 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop"
2026-03-16 14:26:22.599862 | controller | }
2026-03-16 14:26:22.879855 | controller | changed:
2026-03-16 14:26:22.879905 | controller | {
2026-03-16 14:26:22.879930 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com"
2026-03-16 14:26:22.879951 | controller | }
2026-03-16 14:26:23.151343 | controller | changed:
2026-03-16 14:26:23.151398 | controller | {
2026-03-16 14:26:23.151423 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com"
2026-03-16 14:26:23.151443 | controller | }
2026-03-16 14:26:23.429716 | controller | changed:
2026-03-16 14:26:23.429786 | controller | {
2026-03-16 14:26:23.429812 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com"
2026-03-16 14:26:23.429831 | controller | }
2026-03-16 14:26:23.707551 | controller | changed:
2026-03-16 14:26:23.707667 | controller | {
2026-03-16 14:26:23.707694 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono"
2026-03-16 14:26:23.707714 | controller | }
2026-03-16 14:26:23.723088 | 
2026-03-16 14:26:23.723165 | TASK [Set timezone to UTC]
2026-03-16 14:26:24.258984 | controller | changed: executed `/bin/timedatectl set-timezone UTC`
2026-03-16 14:26:24.263682 | 
2026-03-16 14:26:24.263746 | TASK [Create nodepool directory]
2026-03-16 14:26:24.560655 | controller | changed
2026-03-16 14:26:24.567693 | 
2026-03-16 14:26:24.567762 | TASK [Create nodepool sub_nodes file]
2026-03-16 14:26:25.567930 | controller | changed
2026-03-16 14:26:25.573031 | 
2026-03-16 14:26:25.573127 | TASK [Create nodepool sub_nodes_private file]
2026-03-16 14:26:26.597907 | controller | changed
2026-03-16 14:26:26.604089 | 
2026-03-16 14:26:26.604273 | LOOP [Populate nodepool sub_nodes file]
2026-03-16 14:26:26.636086 | 
2026-03-16 14:26:26.636235 | LOOP [Populate nodepool sub_nodes_private file]
2026-03-16 14:26:26.668060 | 
2026-03-16 14:26:26.668218 | TASK [Create nodepool primary file]
2026-03-16 14:26:26.701509 | controller | skipping: Conditional result was False
2026-03-16 14:26:26.716002 | 
2026-03-16 14:26:26.716083 | TASK [Create nodepool node_private for this node]
2026-03-16 14:26:27.682439 | controller | changed
2026-03-16 14:26:27.688514 | 
2026-03-16 14:26:27.688605 | LOOP [Copy ssh keys to nodepool directory]
2026-03-16 14:26:28.064452 | controller | ok: Item: id_rsa Runtime: 0:00:00.003855
2026-03-16 14:26:28.064674 | 
2026-03-16 14:26:28.284044 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.005427
2026-03-16 14:26:28.297183 | 
2026-03-16 14:26:28.297339 | TASK [Add sudoers role for zuul-sudo-grep.sh]
2026-03-16 14:26:29.222345 | controller | changed
2026-03-16 14:26:29.227197 | 
2026-03-16 14:26:29.227262 | TASK [Validate sudoers config after edits]
2026-03-16 14:26:29.490681 | controller | /etc/sudoers: parsed OK
2026-03-16 14:26:29.490737 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK
2026-03-16 14:26:29.490749 | controller | /etc/sudoers.d/zuul: parsed OK
2026-03-16 14:26:29.490756 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK
2026-03-16 14:26:29.753933 | controller | ok: Runtime: 0:00:00.005415
2026-03-16 14:26:29.759206 | 
2026-03-16 14:26:29.759272 | TASK [Show the environment passed in to job shell scripts]
2026-03-16 14:26:30.012166 | controller | SHELL=/bin/bash
2026-03-16 14:26:30.012198 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework
2026-03-16 14:26:30.012207 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework
2026-03-16 14:26:30.012214 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/29/3129/ffea16a0351abc6072e7a7dd6cc09b59fff3da7e
2026-03-16 14:26:30.012219 | controller | PWD=/home/zuul
2026-03-16 14:26:30.012224 | controller | ZUUL_PIPELINE=github-check
2026-03-16 14:26:30.012229 | controller | LOGNAME=zuul
2026-03-16 14:26:30.012234 | controller | XDG_SESSION_TYPE=tty
2026-03-16 14:26:30.012266 | controller | _=/usr/bin/env
2026-03-16 14:26:30.012273 | controller | MOTD_SHOWN=pam
2026-03-16 14:26:30.012278 | controller | HOME=/home/zuul
2026-03-16 14:26:30.012283 | controller | LANG=en_US.UTF-8
2026-03-16 14:26:30.012288 | controller | SSH_CONNECTION=192.168.26.12 36126 192.168.26.187 22
2026-03-16 14:26:30.012293 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET
2026-03-16 14:26:30.012300 | controller | ZUUL_CHANGE_IDS=3129,ffea16a0351abc6072e7a7dd6cc09b59fff3da7e
2026-03-16 14:26:30.012305 | controller | WORKSPACE=/home/zuul/workspace
2026-03-16 14:26:30.012310 | controller | XDG_SESSION_CLASS=user
2026-03-16 14:26:30.012315 | controller | SELINUX_ROLE_REQUESTED=
2026-03-16 14:26:30.012320 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s
2026-03-16 14:26:30.012325 | controller | USER=zuul
2026-03-16 14:26:30.012330 | controller | ZUUL_VOTING=True
2026-03-16 14:26:30.012334 | controller | BUILD_TIMEOUT=5400000
2026-03-16 14:26:30.012339 | controller | SELINUX_USE_CURRENT_RANGE=
2026-03-16 14:26:30.012344 | controller | SHLVL=1
2026-03-16 14:26:30.012349 | controller | ZUUL_PATCHSET=ffea16a0351abc6072e7a7dd6cc09b59fff3da7e
2026-03-16 14:26:30.012354 | controller | XDG_SESSION_ID=1
2026-03-16 14:26:30.012358 | controller | ZUUL_BRANCH=main
2026-03-16 14:26:30.012363 | controller | XDG_RUNTIME_DIR=/run/user/1000
2026-03-16 14:26:30.012368 | controller | SSH_CLIENT=192.168.26.12 36126 22
2026-03-16 14:26:30.012373 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/
2026-03-16 14:26:30.012378 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima:
2026-03-16 14:26:30.012383 | controller | which_declare=declare -f
2026-03-16 14:26:30.012388 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
2026-03-16 14:26:30.012393 | controller | SELINUX_LEVEL_REQUESTED=
2026-03-16 14:26:30.012398 | controller | ZUUL_CHANGE=3129
2026-03-16 14:26:30.012402 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus
2026-03-16 14:26:30.012407 | controller | ZUUL_UUID=d66db8af36854395b2cd08caae64fa6d
2026-03-16 14:26:30.012412 | controller | BASH_FUNC_which%%=() {  ( alias;
2026-03-16 14:26:30.012417 | controller |  eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
2026-03-16 14:26:30.012422 | controller | }
2026-03-16 14:26:30.284322 | controller | ok: Runtime: 0:00:00.005037
2026-03-16 14:26:30.289613 | 
2026-03-16 14:26:30.289674 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars]
2026-03-16 14:26:30.303404 | controller | skipping: Conditional result was False
2026-03-16 14:26:30.308318 | 
2026-03-16 14:26:30.308380 | TASK [Symlink /home/zuul-worker/workspace]
2026-03-16 14:26:30.856234 | controller | skipping: Conditional result was False
2026-03-16 14:26:30.862105 | 
2026-03-16 14:26:30.862172 | TASK [Ensure legacy workspace directory]
2026-03-16 14:26:31.103588 | controller | changed
2026-03-16 14:26:31.120500 | 
2026-03-16 14:26:31.120552 | PLAY RECAP
2026-03-16 14:26:31.120598 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-03-16 14:26:31.120621 | 
2026-03-16 14:26:31.191504 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2026-03-16 14:26:31.192328 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2026-03-16 14:26:31.671865 | 
2026-03-16 14:26:31.671977 | PLAY [Run ci/playbooks/dump_zuul_data.yml]
2026-03-16 14:26:31.691768 | 
2026-03-16 14:26:31.691845 | TASK [Create zuul-output directory]
2026-03-16 14:26:32.057085 | controller | changed
2026-03-16 14:26:32.061969 | 
2026-03-16 14:26:32.062043 | TASK [Slurp Zuul inventory test]
2026-03-16 14:26:32.330713 | controller -> localhost | ok
2026-03-16 14:26:32.336706 | 
2026-03-16 14:26:32.336771 | TASK [Save zuul inventory]
2026-03-16 14:26:33.443626 | controller | changed
2026-03-16 14:26:33.448389 | 
2026-03-16 14:26:33.448464 | TASK [Save zuul vars without the change_message]
2026-03-16 14:26:34.431655 | controller | changed
2026-03-16 14:26:34.449509 | 
2026-03-16 14:26:34.449562 | PLAY RECAP
2026-03-16 14:26:34.449603 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-16 14:26:34.449626 | 
2026-03-16 14:26:34.515608 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2026-03-16 14:26:34.516456 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2026-03-16 14:26:35.032174 | 
2026-03-16 14:26:35.032290 | PLAY [Run ci/playbooks/molecule-prepare.yml]
2026-03-16 14:26:35.052622 | 
2026-03-16 14:26:35.052703 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh]
2026-03-16 14:26:35.071612 | controller | ok
2026-03-16 14:26:35.088330 | 
2026-03-16 14:26:35.088419 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2026-03-16 14:26:35.111646 | controller | skipping: Conditional result was False
2026-03-16 14:26:35.117422 | 
2026-03-16 14:26:35.117496 | TASK [mirror-info-fork : Create /etc/ci]
2026-03-16 14:26:35.480715 | controller | ok
2026-03-16 14:26:35.486254 | 
2026-03-16 14:26:35.486392 | TASK [mirror-info-fork : Install ci_mirror script]
2026-03-16 14:26:36.377729 | controller | ok
2026-03-16 14:26:36.386877 | 
2026-03-16 14:26:36.386942 | TASK [Prepare workspace]
2026-03-16 14:26:36.404803 | controller | ok
2026-03-16 14:26:36.421122 | 
2026-03-16 14:26:36.421193 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-16 14:26:36.764363 | controller | ok
2026-03-16 14:26:36.769888 | 
2026-03-16 14:26:36.769966 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-16 14:26:39.152645 | controller | Output suppressed because no_log was given
2026-03-16 14:26:39.161606 | 
2026-03-16 14:26:39.161672 | LOOP [Create zuul-output directory]
2026-03-16 14:26:39.410262 | controller | changed: "/home/zuul/ci-framework-data/logs"
2026-03-16 14:26:39.627907 | controller | ok: "/home/zuul/zuul-output/logs"
2026-03-16 14:26:39.636474 | 
2026-03-16 14:26:39.636536 | TASK [Install required packages]
2026-03-16 14:27:09.374354 | controller | ok: Nothing to do
2026-03-16 14:27:09.379256 | 
2026-03-16 14:27:09.379365 | TASK [Install venv]
2026-03-16 14:28:07.839570 | controller | changed
2026-03-16 14:28:07.866944 | 
2026-03-16 14:28:07.867033 | PLAY RECAP
2026-03-16 14:28:07.867088 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-16 14:28:07.867110 | 
2026-03-16 14:28:08.000870 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2026-03-16 14:28:08.001681 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2026-03-16 14:28:08.541716 | 
2026-03-16 14:28:08.541836 | PLAY [Run ci/playbooks/molecule-test.yml]
2026-03-16 14:28:08.561663 | 
2026-03-16 14:28:08.561741 | TASK [Gather required facts]
2026-03-16 14:28:09.123749 | controller | ok
2026-03-16 14:28:09.128884 | 
2026-03-16 14:28:09.128956 | TASK [Load environment var if instructed to]
2026-03-16 14:28:09.156225 | controller | skipping: Conditional result was False
2026-03-16 14:28:09.161744 | 
2026-03-16 14:28:09.161806 | TASK [Ensure group_vars dir exists]
2026-03-16 14:28:09.560628 | controller | ok
2026-03-16 14:28:09.565846 | 
2026-03-16 14:28:09.565917 | TASK [Print related variables]
2026-03-16 14:28:09.596832 | controller | ok:
2026-03-16 14:28:09.596969 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml
2026-03-16 14:28:09.596998 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer
2026-03-16 14:28:09.601567 | 
2026-03-16 14:28:09.601632 | TASK [Run molecule]
2026-03-16 14:28:10.613616 | controller | INFO     Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml
2026-03-16 14:28:10.867102 | controller | INFO     Performing prerun with role_name_check=0...
2026-03-16 14:28:28.017796 | controller | WARNING  Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.018146 | controller | WARNING  Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.018169 | controller | WARNING  Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.018188 | controller | WARNING  Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.018580 | controller | WARNING  Another version of 'cifmw.general' 1.0.0+ffea16a0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+ffea16a0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.018993 | controller | WARNING  Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.019409 | controller | WARNING  Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.019990 | controller | WARNING  Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.020405 | controller | WARNING  Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.020800 | controller | WARNING  Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.021206 | controller | WARNING  Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.021595 | controller | WARNING  Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.021970 | controller | WARNING  Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.022381 | controller | WARNING  Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.022785 | controller | WARNING  Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 14:28:28.032033 | controller | INFO     Running crc_layout > prepare
2026-03-16 14:28:28.717361 | controller |
2026-03-16 14:28:28.717475 | controller | PLAY [Prepare] *****************************************************************
2026-03-16 14:28:28.717557 | controller |
2026-03-16 14:28:28.717571 | controller | TASK [Gathering Facts] *********************************************************
2026-03-16 14:28:28.717655 | controller | Monday 16 March 2026  14:28:28 +0000 (0:00:00.020)       0:00:00.020 **********
2026-03-16 14:28:29.570610 | controller | ok: [instance]
2026-03-16 14:28:29.570741 | controller |
2026-03-16 14:28:29.570780 | controller | TASK [Create custom basedir] ***************************************************
2026-03-16 14:28:29.570876 | controller | Monday 16 March 2026  14:28:29 +0000 (0:00:00.854)       0:00:00.874 **********
2026-03-16 14:28:29.898780 | controller | changed: [instance]
2026-03-16 14:28:29.898822 | controller |
2026-03-16 14:28:29.898929 | controller | TASK [test_deps : Gather facts if they don't exist] ****************************
2026-03-16 14:28:29.899027 | controller | Monday 16 March 2026  14:28:29 +0000 (0:00:00.327)       0:00:01.202 **********
2026-03-16 14:28:29.918496 | controller | skipping: [instance]
2026-03-16 14:28:29.918591 | controller |
2026-03-16 14:28:29.918728 | controller | TASK [test_deps : Gather variables for each operating system] ******************
2026-03-16 14:28:29.918839 | controller | Monday 16 March 2026  14:28:29 +0000 (0:00:00.020)       0:00:01.223 **********
2026-03-16 14:28:29.962029 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)
2026-03-16 14:28:29.962102 | controller |
2026-03-16 14:28:29.962210 | controller | TASK [test_deps : Detect mirrors file] *****************************************
2026-03-16 14:28:29.962507 | controller | Monday 16 March 2026  14:28:29 +0000 (0:00:00.043)       0:00:01.266 **********
2026-03-16 14:28:30.274844 | controller | ok: [instance]
2026-03-16 14:28:30.274894 | controller |
2026-03-16 14:28:30.274979 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] ***********
2026-03-16 14:28:30.275614 | controller | Monday 16 March 2026  14:28:30 +0000 (0:00:00.312)       0:00:01.578 **********
2026-03-16 14:28:30.507358 | controller | ok: [instance]
2026-03-16 14:28:30.507387 | controller |
2026-03-16 14:28:30.507523 | controller | TASK [test_deps : Disable ubi 9 repos] *****************************************
2026-03-16 14:28:30.507576 | controller | Monday 16 March 2026  14:28:30 +0000 (0:00:00.232)       0:00:01.811 **********
2026-03-16 14:28:31.194804 | controller | ok: [instance] => (item=ubi-9-appstream)
2026-03-16 14:28:31.194889 | controller | ok: [instance] => (item=ubi-9-baseos)
2026-03-16 14:28:31.195002 | controller | ok: [instance] => (item=ubi-9-codeready-builder)
2026-03-16 14:28:31.195127 | controller |
2026-03-16 14:28:31.195257 | controller | TASK [Deploy repo-setup] *******************************************************
2026-03-16 14:28:31.195365 | controller | Monday 16 March 2026  14:28:31 +0000 (0:00:00.687)       0:00:02.498 **********
2026-03-16 14:28:31.253865 | controller |
2026-03-16 14:28:31.254034 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2026-03-16 14:28:31.254226 | controller | Monday 16 March 2026  14:28:31 +0000 (0:00:00.059)       0:00:02.558 **********
2026-03-16 14:28:31.782711 | controller | changed: [instance] => (item=tmp)
2026-03-16 14:28:31.782786 | controller | changed: [instance] => (item=artifacts/repositories)
2026-03-16 14:28:31.782852 | controller | changed: [instance] => (item=venv/repo_setup)
2026-03-16 14:28:31.782933 | controller |
2026-03-16 14:28:31.783022 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2026-03-16 14:28:31.783104 | controller | Monday 16 March 2026  14:28:31 +0000 (0:00:00.528)       0:00:03.086 **********
2026-03-16 14:28:32.719146 | controller | ok: [instance]
2026-03-16 14:28:32.719511 | controller |
2026-03-16 14:28:33.847255 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2026-03-16 14:28:33.847295 | controller | Monday 16 March 2026  14:28:32 +0000 (0:00:00.936)       0:00:04.023 **********
2026-03-16 14:28:33.847307 | controller | changed: [instance]
2026-03-16 14:28:41.305682 | controller |
2026-03-16 14:28:41.305726 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2026-03-16 14:28:41.305734 | controller | Monday 16 March 2026  14:28:33 +0000 (0:00:01.127)       0:00:05.150 **********
2026-03-16 14:28:41.305745 | controller | changed: [instance]
2026-03-16 14:28:42.032228 | controller |
2026-03-16 14:28:42.032268 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2026-03-16 14:28:42.032277 | controller | Monday 16 March 2026  14:28:41 +0000 (0:00:07.457)       0:00:12.608 **********
2026-03-16 14:28:42.032288 | controller | changed: [instance]
2026-03-16 14:28:42.032307 | controller |
2026-03-16 14:28:42.032316 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2026-03-16 14:28:42.066301 | controller | Monday 16 March 2026  14:28:42 +0000 (0:00:00.727)       0:00:13.336 **********
2026-03-16 14:28:42.066339 | controller | skipping: [instance]
2026-03-16 14:28:42.898294 | controller |
2026-03-16 14:28:42.898332 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2026-03-16 14:28:42.898341 | controller | Monday 16 March 2026  14:28:42 +0000 (0:00:00.034)       0:00:13.370 **********
2026-03-16 14:28:42.898352 | controller | changed: [instance]
2026-03-16 14:28:42.939366 | controller |
2026-03-16 14:28:42.939438 | controller | TASK [repo_setup : Get component repo] *****************************************
2026-03-16 14:28:42.939451 | controller | Monday 16 March 2026  14:28:42 +0000 (0:00:00.831)       0:00:14.202 **********
2026-03-16 14:28:42.939469 | controller | skipping: [instance]
2026-03-16 14:28:42.979208 | controller |
2026-03-16 14:28:42.979258 | controller | TASK [repo_setup : Rename component repo] **************************************
2026-03-16 14:28:42.979268 | controller | Monday 16 March 2026  14:28:42 +0000 (0:00:00.041)       0:00:14.243 **********
2026-03-16 14:28:42.979282 | controller | skipping: [instance]
2026-03-16 14:28:43.015653 | controller |
2026-03-16 14:28:43.015692 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2026-03-16 14:28:43.015702 | controller | Monday 16 March 2026  14:28:42 +0000 (0:00:00.039)       0:00:14.282 **********
2026-03-16 14:28:43.015715 | controller | skipping: [instance]
2026-03-16 14:28:43.575324 | controller |
2026-03-16 14:28:43.575375 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2026-03-16 14:28:43.575385 | controller | Monday 16 March 2026  14:28:43 +0000 (0:00:00.036)       0:00:14.319 **********
2026-03-16 14:28:43.575399 | controller | changed: [instance]
2026-03-16 14:28:44.019987 | controller |
2026-03-16 14:28:44.020032 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2026-03-16 14:28:44.020040 | controller | Monday 16 March 2026  14:28:43 +0000 (0:00:00.559)       0:00:14.879 **********
2026-03-16 14:28:44.020052 | controller | changed: [instance]
2026-03-16 14:28:44.049371 | controller |
2026-03-16 14:28:44.049448 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2026-03-16 14:28:44.049459 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.444)       0:00:15.324 **********
2026-03-16 14:28:44.049477 | controller | skipping: [instance]
2026-03-16 14:28:44.079893 | controller |
2026-03-16 14:28:44.079930 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2026-03-16 14:28:44.079939 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.029)       0:00:15.353 **********
2026-03-16 14:28:44.079956 | controller | skipping: [instance]
2026-03-16 14:28:44.110303 | controller |
2026-03-16 14:28:44.110334 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2026-03-16 14:28:44.110345 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.030)       0:00:15.384 **********
2026-03-16 14:28:44.110359 | controller | skipping: [instance]
2026-03-16 14:28:44.148544 | controller |
2026-03-16 14:28:44.148564 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2026-03-16 14:28:44.148573 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.030)       0:00:15.414 **********
2026-03-16 14:28:44.148584 | controller | ok: [instance]
2026-03-16 14:28:44.176183 | controller |
2026-03-16 14:28:44.176204 | controller | TASK [repo_setup : Create download directory] **********************************
2026-03-16 14:28:44.176211 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.038)       0:00:15.452 **********
2026-03-16 14:28:44.176228 | controller | skipping: [instance]
2026-03-16 14:28:44.176252 | controller |
2026-03-16 14:28:44.176512 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2026-03-16 14:28:44.204307 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.027)       0:00:15.480 **********
2026-03-16 14:28:44.204362 | controller | skipping: [instance]
2026-03-16 14:28:44.204401 | controller |
2026-03-16 14:28:44.204414 | controller | TASK [Download the RPM] ********************************************************
2026-03-16 14:28:44.204603 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.028)       0:00:15.508 **********
2026-03-16 14:28:44.231544 | controller | skipping: [instance]
2026-03-16 14:28:44.231634 | controller |
2026-03-16 14:28:44.231840 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2026-03-16 14:28:44.231917 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.027)       0:00:15.536 **********
2026-03-16 14:28:44.259436 | controller | skipping: [instance]
2026-03-16 14:28:44.259543 | controller |
2026-03-16 14:28:44.259721 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2026-03-16 14:28:44.259858 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.027)       0:00:15.563 **********
2026-03-16 14:28:44.285431 | controller | skipping: [instance]
2026-03-16 14:28:44.285509 | controller |
2026-03-16 14:28:44.285718 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2026-03-16 14:28:44.285786 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.026)       0:00:15.590 **********
2026-03-16 14:28:44.313920 | controller | skipping: [instance]
2026-03-16 14:28:44.314094 | controller |
2026-03-16 14:28:44.314364 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2026-03-16 14:28:44.314453 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.028)       0:00:15.618 **********
2026-03-16 14:28:44.339836 | controller | skipping: [instance]
2026-03-16 14:28:44.339930 | controller |
2026-03-16 14:28:44.340071 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2026-03-16 14:28:44.340214 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.025)       0:00:15.644 **********
2026-03-16 14:28:44.532071 | controller | ok: [instance]
2026-03-16 14:28:44.759172 | controller |
2026-03-16 14:28:44.759215 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2026-03-16 14:28:44.759223 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.191)       0:00:15.835 **********
2026-03-16 14:28:44.759234 | controller | changed: [instance]
2026-03-16 14:28:45.000699 | controller |
2026-03-16 14:28:45.000735 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2026-03-16 14:28:45.000744 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.227)       0:00:16.063 **********
2026-03-16 14:28:45.000754 | controller | changed: [instance]
2026-03-16 14:28:45.031724 | controller |
2026-03-16 14:28:45.031761 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2026-03-16 14:28:45.031770 | controller | Monday 16 March 2026  14:28:44 +0000 (0:00:00.241)       0:00:16.304 **********
2026-03-16 14:28:45.031781 | controller | skipping: [instance]
2026-03-16 14:28:45.060750 | controller |
2026-03-16 14:28:45.060775 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2026-03-16 14:28:45.060782 | controller | Monday 16 March 2026  14:28:45 +0000 (0:00:00.030)       0:00:16.335 **********
2026-03-16 14:28:45.060791 | controller | skipping: [instance]
2026-03-16 14:28:45.089685 | controller |
2026-03-16 14:28:45.089703 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2026-03-16 14:28:45.089711 | controller | Monday 16 March 2026  14:28:45 +0000 (0:00:00.029)       0:00:16.364 **********
2026-03-16 14:28:45.089720 | controller | skipping: [instance]
2026-03-16 14:28:45.114857 | controller |
2026-03-16 14:28:45.114876 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2026-03-16 14:28:45.114884 | controller | Monday 16 March 2026  14:28:45 +0000 (0:00:00.028)       0:00:16.393 **********
2026-03-16 14:28:45.114893 | controller | skipping: [instance]
2026-03-16 14:28:45.139874 | controller |
2026-03-16 14:28:45.139891 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2026-03-16 14:28:45.139906 | controller | Monday 16 March 2026  14:28:45 +0000 (0:00:00.025)       0:00:16.419 **********
2026-03-16 14:28:45.139916 | controller | skipping: [instance]
2026-03-16 14:28:45.163599 | controller |
2026-03-16 14:28:45.163624 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] ***
2026-03-16 14:28:45.163631 | controller | Monday 16 March 2026  14:28:45 +0000 (0:00:00.025)       0:00:16.444 **********
2026-03-16 14:28:45.163639 | controller | skipping: [instance]
2026-03-16 14:28:45.181422 | controller |
2026-03-16 14:28:45.181439 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2026-03-16 14:28:45.181446 | controller | Monday 16 March 2026  14:28:45 +0000 (0:00:00.023)       0:00:16.468 **********
2026-03-16 14:28:45.181456 | controller | skipping: [instance]
2026-03-16 14:28:45.181597 | controller |
2026-03-16 14:28:45.181762 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2026-03-16 14:28:45.181900 | controller | Monday 16 March 2026  14:28:45 +0000 (0:00:00.018)       0:00:16.486 **********
2026-03-16 14:28:45.211795 | controller | skipping: [instance]
2026-03-16 14:28:45.211944 | controller |
2026-03-16 14:28:45.212088 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2026-03-16 14:28:45.212272 | controller | Monday 16 March 2026  14:28:45 +0000 (0:00:00.030)       0:00:16.516 **********
2026-03-16 14:28:45.230517 | controller | skipping: [instance]
2026-03-16 14:28:45.230679 | controller |
2026-03-16 14:28:45.230825 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2026-03-16 14:28:45.230977 | controller | Monday 16 March 2026  14:28:45 +0000 (0:00:00.018)       0:00:16.535 **********
2026-03-16 14:28:45.250379 | controller | skipping: [instance]
2026-03-16 14:28:45.250542 | controller |
2026-03-16 14:28:45.250710 | controller | TASK [test_deps : Look for redhat-release rpm] *********************************
2026-03-16 14:28:45.250861 | controller | Monday 16 March 2026  14:28:45 +0000 (0:00:00.019)       0:00:16.555 **********
2026-03-16 14:28:45.291825 | controller | skipping: [instance]
2026-03-16 14:28:45.291988 | controller |
2026-03-16 14:28:45.292159 | controller | TASK [test_deps : Remove redhat-release] ***************************************
2026-03-16 14:28:45.292291 | controller | Monday 16 March 2026  14:28:45 +0000 (0:00:00.041)       0:00:16.596 **********
2026-03-16 14:28:45.325417 | controller | skipping: [instance]
2026-03-16 14:28:45.325595 | controller |
2026-03-16 14:28:45.325780 | controller | TASK [test_deps : Install centos-stream-release] *******************************
2026-03-16 14:28:45.325938 | controller | Monday 16 March 2026  14:28:45 +0000 (0:00:00.033)       0:00:16.629 **********
2026-03-16 14:28:45.356928 | controller | skipping: [instance]
2026-03-16 14:28:45.357092 | controller |
2026-03-16 14:28:45.357276 | controller | TASK [test_deps : Install additional packages] *********************************
2026-03-16 14:28:45.357407 | controller | Monday 16 March 2026  14:28:45 +0000 (0:00:00.031)       0:00:16.661 **********
2026-03-16 14:28:45.386753 | controller | skipping: [instance]
2026-03-16 14:28:45.386920 | controller |
2026-03-16 14:28:45.387076 | controller | TASK [test_deps : Install selinux python libs] *********************************
2026-03-16 14:28:45.387269 | controller | Monday 16 March 2026  14:28:45 +0000 (0:00:00.029)       0:00:16.691 **********
2026-03-16 14:29:27.990322 | controller | ok: [instance]
2026-03-16 14:29:29.178848 | controller |
2026-03-16 14:29:29.178879 | controller | TASK [test_deps : Install python yaml libs] ************************************
2026-03-16 14:29:29.178886 | controller | Monday 16 March 2026  14:29:27 +0000 (0:00:42.602)       0:00:59.293 **********
2026-03-16 14:29:29.178896 | controller | ok: [instance]
2026-03-16 14:29:29.209323 | controller |
2026-03-16 14:29:29.209371 | controller | TASK [test_deps : Install extra packages] **************************************
2026-03-16 14:29:29.209385 | controller | Monday 16 March 2026  14:29:29 +0000 (0:00:01.189)       0:01:00.483 **********
2026-03-16 14:29:29.209403 | controller | skipping: [instance]
2026-03-16 14:29:29.209415 | controller |
2026-03-16 14:29:29.209428 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2026-03-16 14:29:29.250173 | controller | Monday 16 March 2026  14:29:29 +0000 (0:00:00.030)       0:01:00.513 **********
2026-03-16 14:29:29.250196 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml)
2026-03-16 14:29:29.268243 | controller |
2026-03-16 14:29:29.268267 | controller | TASK [ci_setup : List packages to install] *************************************
2026-03-16 14:29:29.268276 | controller | Monday 16 March 2026  14:29:29 +0000 (0:00:00.040)       0:01:00.554 **********
2026-03-16 14:29:29.268294 | controller | ok: [instance] =>
2026-03-16 14:29:29.269431 | controller |   cifmw_ci_setup_packages:
2026-03-16 14:29:29.269455 | controller |   - bash-completion
2026-03-16 14:29:34.139702 | controller |   - ca-certificates
2026-03-16 14:29:34.139733 | controller |   - git-core
2026-03-16 14:29:34.139741 | controller |   - make
2026-03-16 14:29:34.139751 | controller |   - tar
2026-03-16 14:29:34.139757 | controller |   - tmux
2026-03-16 14:29:34.139764 | controller |   - python3-pip
2026-03-16 14:29:34.139769 | controller |
2026-03-16 14:29:34.139775 | controller | TASK [ci_setup : Install needed packages] **************************************
2026-03-16 14:29:34.139781 | controller | Monday 16 March 2026  14:29:29 +0000 (0:00:00.018)       0:01:00.572 **********
2026-03-16 14:29:34.139791 | controller | changed: [instance]
2026-03-16 14:29:34.674592 | controller |
2026-03-16 14:29:34.674630 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2026-03-16 14:29:34.674639 | controller | Monday 16 March 2026  14:29:34 +0000 (0:00:04.871)       0:01:05.443 **********
2026-03-16 14:29:34.674649 | controller | ok: [instance]
2026-03-16 14:29:34.868927 | controller |
2026-03-16 14:29:34.868956 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2026-03-16 14:29:34.868966 | controller | Monday 16 March 2026  14:29:34 +0000 (0:00:00.534)       0:01:05.978 **********
2026-03-16 14:29:34.868978 | controller | changed: [instance]
2026-03-16 14:29:41.044977 | controller |
2026-03-16 14:29:41.045019 | controller | TASK [ci_setup : Install openshift client] *************************************
2026-03-16 14:29:41.045028 | controller | Monday 16 March 2026  14:29:34 +0000 (0:00:00.194)       0:01:06.173 **********
2026-03-16 14:29:41.045038 | controller | changed: [instance]
2026-03-16 14:29:41.082209 | controller |
2026-03-16 14:29:41.082244 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2026-03-16 14:29:41.082253 | controller | Monday 16 March 2026  14:29:41 +0000 (0:00:06.176)       0:01:12.349 **********
2026-03-16 14:29:41.082264 | controller | ok: [instance]
2026-03-16 14:29:41.082296 | controller |
2026-03-16 14:29:41.082480 | controller | TASK [ci_setup : Create completion file] ***************************************
2026-03-16 14:29:41.348236 | controller | Monday 16 March 2026  14:29:41 +0000 (0:00:00.037)       0:01:12.386 **********
2026-03-16 14:29:41.348276 | controller | changed: [instance]
2026-03-16 14:29:41.348316 | controller |
2026-03-16 14:29:41.348336 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2026-03-16 14:29:41.348347 | controller | Monday 16 March 2026  14:29:41 +0000 (0:00:00.265)       0:01:12.652 **********
2026-03-16 14:29:41.630284 | controller | changed: [instance]
2026-03-16 14:29:41.630345 | controller |
2026-03-16 14:29:41.630359 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2026-03-16 14:29:41.630387 | controller | Monday 16 March 2026  14:29:41 +0000 (0:00:00.282)       0:01:12.934 **********
2026-03-16 14:29:41.648067 | controller | skipping: [instance]
2026-03-16 14:29:41.664881 | controller |
2026-03-16 14:29:41.664902 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2026-03-16 14:29:41.664911 | controller | Monday 16 March 2026  14:29:41 +0000 (0:00:00.017)       0:01:12.952 **********
2026-03-16 14:29:41.664922 | controller | skipping: [instance]
2026-03-16 14:29:41.681303 | controller |
2026-03-16 14:29:41.681337 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2026-03-16 14:29:41.681347 | controller | Monday 16 March 2026  14:29:41 +0000 (0:00:00.016)       0:01:12.969 **********
2026-03-16 14:29:41.681358 | controller | skipping: [instance]
2026-03-16 14:29:41.681533 | controller |
2026-03-16 14:29:41.681554 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2026-03-16 14:29:41.697828 | controller | Monday 16 March 2026  14:29:41 +0000 (0:00:00.016)       0:01:12.985 **********
2026-03-16 14:29:41.697853 | controller | skipping: [instance]
2026-03-16 14:29:41.713687 | controller |
2026-03-16 14:29:41.713705 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2026-03-16 14:29:41.713719 | controller | Monday 16 March 2026  14:29:41 +0000 (0:00:00.016)       0:01:13.002 **********
2026-03-16 14:29:41.713728 | controller | skipping: [instance]
2026-03-16 14:29:41.734616 | controller |
2026-03-16 14:29:41.734644 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2026-03-16 14:29:41.734657 | controller | Monday 16 March 2026  14:29:41 +0000 (0:00:00.015)       0:01:13.018 **********
2026-03-16 14:29:41.734671 | controller | skipping: [instance]
2026-03-16 14:29:41.734893 | controller |
2026-03-16 14:29:41.735177 | controller | TASK [ci_setup : Manage directories] *******************************************
2026-03-16 14:29:41.735419 | controller | Monday 16 March 2026  14:29:41 +0000 (0:00:00.021)       0:01:13.039 **********
2026-03-16 14:29:42.665202 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr)
2026-03-16 14:29:42.665252 | controller | changed: [instance] => (item=/opt/basedir/logs)
2026-03-16 14:29:42.665261 | controller | ok: [instance] => (item=/opt/basedir/tmp)
2026-03-16 14:29:42.665267 | controller | changed: [instance] => (item=/opt/basedir/volumes)
2026-03-16 14:29:42.665275 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters)
2026-03-16 14:29:42.665561 | controller |
2026-03-16 14:29:42.984265 | controller | TASK [Create secret file] ******************************************************
2026-03-16 14:29:42.984301 | controller | Monday 16 March 2026  14:29:42 +0000 (0:00:00.929)       0:01:13.969 **********
2026-03-16 14:29:42.984316 | controller | changed: [instance]
2026-03-16 14:29:42.984348 | controller |
2026-03-16 14:29:42.984357 | controller | PLAY RECAP *********************************************************************
2026-03-16 14:29:42.984364 | controller | instance                   : ok=31   changed=17   unreachable=0    failed=0    skipped=36   rescued=0    ignored=0
2026-03-16 14:29:42.984371 | controller |
2026-03-16 14:29:42.984385 | controller | Monday 16 March 2026  14:29:42 +0000 (0:00:00.318)       0:01:14.287 **********
2026-03-16 14:29:42.984392 | controller | ===============================================================================
2026-03-16 14:29:42.984401 | controller | test_deps : Install selinux python libs -------------------------------- 42.60s
2026-03-16 14:29:42.984428 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.46s
2026-03-16 14:29:42.986007 | controller | ci_setup : Install openshift client ------------------------------------- 6.18s
2026-03-16 14:29:43.041384 | controller | ci_setup : Install needed packages -------------------------------------- 4.87s
2026-03-16 14:29:43.041409 | controller | test_deps : Install python yaml libs ------------------------------------ 1.19s
2026-03-16 14:29:43.041417 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.13s
2026-03-16 14:29:43.041423 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.94s
2026-03-16 14:29:43.041428 | controller | ci_setup : Manage directories ------------------------------------------- 0.93s
2026-03-16 14:29:43.041434 | controller | Gathering Facts --------------------------------------------------------- 0.85s
2026-03-16 14:29:43.041439 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.83s
2026-03-16 14:29:43.041445 | controller | repo_setup : Install repo-setup package --------------------------------- 0.73s
2026-03-16 14:29:43.041450 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.69s
2026-03-16 14:29:43.041455 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.56s
2026-03-16 14:29:43.041461 | controller | ci_setup : Gather version of openshift client --------------------------- 0.53s
2026-03-16 14:29:43.041466 | controller | repo_setup : Ensure directories are present ----------------------------- 0.53s
2026-03-16 14:29:43.041471 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.44s
2026-03-16 14:29:43.041476 | controller | Create custom basedir --------------------------------------------------- 0.33s
2026-03-16 14:29:43.041482 | controller | Create secret file ------------------------------------------------------ 0.32s
2026-03-16 14:29:43.041487 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.31s
2026-03-16 14:29:43.041497 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.28s
2026-03-16 14:29:43.041507 | controller | INFO     Running crc_layout > converge
2026-03-16 14:29:43.606502 | controller |
2026-03-16 14:29:43.606731 | controller | PLAY [Converge] ****************************************************************
2026-03-16 14:29:43.606888 | controller |
2026-03-16 14:29:43.607048 | controller | TASK [Gathering Facts] *********************************************************
2026-03-16 14:29:43.607203 | controller | Monday 16 March 2026  14:29:43 +0000 (0:00:00.025)       0:00:00.025 **********
2026-03-16 14:29:44.401329 | controller | ok: [instance]
2026-03-16 14:29:44.422250 | controller |
2026-03-16 14:29:44.422302 | controller | TASK [Load networking definition from scenario file] ***************************
2026-03-16 14:29:44.422317 | controller | Monday 16 March 2026  14:29:44 +0000 (0:00:00.794)       0:00:00.820 **********
2026-03-16 14:29:44.422337 | controller | ok: [instance]
2026-03-16 14:29:44.439223 | controller |
2026-03-16 14:29:44.439250 | controller | TASK [discover_latest_image : Set the discovered image vars to empty/null] *****
2026-03-16 14:29:44.439259 | controller | Monday 16 March 2026  14:29:44 +0000 (0:00:00.020)       0:00:00.841 **********
2026-03-16 14:29:44.439272 | controller | ok: [instance]
2026-03-16 14:29:44.439320 | controller |
2026-03-16 14:29:44.439341 | controller | TASK [discover_latest_image : Discover images] *********************************
2026-03-16 14:29:44.439355 | controller | Monday 16 March 2026  14:29:44 +0000 (0:00:00.017)       0:00:00.858 **********
2026-03-16 14:29:44.478273 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/discover_latest_image/tasks/per-image.yml for instance => (item={'key': 'default', 'value': {'base_url': 'https://cloud.centos.org/centos/9-stream/x86_64/images/', 'qcow_prefix': 'CentOS-Stream-GenericCloud-', 'images_file': 'CHECKSUM'}})
2026-03-16 14:29:44.519243 | controller |
2026-03-16 14:29:44.519265 | controller | TASK [discover_latest_image : Ensure the current image dict entry has the expected data] ***
2026-03-16 14:29:44.519275 | controller | Monday 16 March 2026  14:29:44 +0000 (0:00:00.038)       0:00:00.897 **********
2026-03-16 14:29:44.519286 | controller | ok: [instance] => changed=false
2026-03-16 14:29:44.519316 | controller |   msg: All assertions passed
2026-03-16 14:29:44.519326 | controller |
2026-03-16 14:29:44.519567 | controller | TASK [discover_latest_image : Get latest image for the current entry] **********
2026-03-16 14:29:46.199235 | controller | Monday 16 March 2026  14:29:44 +0000 (0:00:00.041)       0:00:00.938 **********
2026-03-16 14:29:46.199270 | controller | changed: [instance]
2026-03-16 14:29:46.199301 | controller |
2026-03-16 14:29:46.199535 | controller | TASK [discover_latest_image : Append the current return value to the discovered images dict] ***
2026-03-16 14:29:46.232335 | controller | Monday 16 March 2026  14:29:46 +0000 (0:00:01.680)       0:00:02.618 **********
2026-03-16 14:29:46.232396 | controller | ok: [instance]
2026-03-16 14:29:46.265241 | controller |
2026-03-16 14:29:46.265279 | controller | TASK [discover_latest_image : Export single-image facts if an image with name 'default' was discovered] ***
2026-03-16 14:29:46.265289 | controller | Monday 16 March 2026  14:29:46 +0000 (0:00:00.032)       0:00:02.651 **********
2026-03-16 14:29:46.265302 | controller | ok: [instance]
2026-03-16 14:29:46.265332 | controller |
2026-03-16 14:29:46.265342 | controller | TASK [reproducer : Load CI job environment] ************************************
2026-03-16 14:29:46.265442 | controller | Monday 16 March 2026  14:29:46 +0000 (0:00:00.033)       0:00:02.684 **********
2026-03-16 14:29:46.287805 | controller | skipping: [instance]
2026-03-16 14:29:46.335603 | controller |
2026-03-16 14:29:46.335623 | controller | TASK [Build final libvirt layout] **********************************************
2026-03-16 14:29:46.335631 | controller | Monday 16 March 2026  14:29:46 +0000 (0:00:00.022)       0:00:02.707 **********
2026-03-16 14:29:46.335641 | controller |
2026-03-16 14:29:46.413195 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] ***********
2026-03-16 14:29:46.413217 | controller | Monday 16 March 2026  14:29:46 +0000 (0:00:00.048)       0:00:02.755 **********
2026-03-16 14:29:46.413228 | controller | ok: [instance]
2026-03-16 14:29:46.413314 | controller |
2026-03-16 14:29:46.413332 | controller | TASK [libvirt_manager : Patch the layout if needed] ****************************
2026-03-16 14:29:46.413342 | controller | Monday 16 March 2026  14:29:46 +0000 (0:00:00.077)       0:00:02.832 **********
2026-03-16 14:29:46.476324 | controller | skipping: [instance]
2026-03-16 14:29:46.476390 | controller |
2026-03-16 14:29:46.476410 | controller | TASK [reproducer : Assert no conflicting parameters were passed] ***************
2026-03-16 14:29:46.476423 | controller | Monday 16 March 2026  14:29:46 +0000 (0:00:00.063)       0:00:02.895 **********
2026-03-16 14:29:46.503279 | controller | ok: [instance]
2026-03-16 14:29:46.503394 | controller |
2026-03-16 14:29:46.503544 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] ***
2026-03-16 14:29:46.503608 | controller | Monday 16 March 2026  14:29:46 +0000 (0:00:00.027)       0:00:02.922 **********
2026-03-16 14:29:46.526629 | controller | ok: [instance] => changed=false
2026-03-16 14:29:46.526732 | controller |   msg: All assertions passed
2026-03-16 14:29:46.526855 | controller |
2026-03-16 14:29:46.527011 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************
2026-03-16 14:29:46.527141 | controller | Monday 16 March 2026  14:29:46 +0000 (0:00:00.023)       0:00:02.946 **********
2026-03-16 14:29:46.566597 | controller | ok: [instance]
2026-03-16 14:29:46.566709 | controller |
2026-03-16 14:29:46.567000 | controller | TASK [reproducer : Ensure directories are present] *****************************
2026-03-16 14:29:47.010183 | controller | Monday 16 March 2026  14:29:46 +0000 (0:00:00.039)       0:00:02.986 **********
2026-03-16 14:29:47.010206 | controller | ok: [instance] => (item=artifacts)
2026-03-16 14:29:47.010233 | controller | ok: [instance] => (item=logs)
2026-03-16 14:29:47.010572 | controller |
2026-03-16 14:29:47.085437 | controller | TASK [Bootstrap libvirt if needed] *********************************************
2026-03-16 14:29:47.085471 | controller | Monday 16 March 2026  14:29:47 +0000 (0:00:00.443)       0:00:03.429 **********
2026-03-16 14:29:47.085491 | controller |
2026-03-16 14:29:47.261226 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************
2026-03-16 14:29:47.261256 | controller | Monday 16 March 2026  14:29:47 +0000 (0:00:00.075)       0:00:03.504 **********
2026-03-16 14:29:47.261269 | controller | ok: [instance]
2026-03-16 14:29:47.529198 | controller |
2026-03-16 14:29:47.529236 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] *************
2026-03-16 14:29:47.529245 | controller | Monday 16 March 2026  14:29:47 +0000 (0:00:00.175)       0:00:03.680 **********
2026-03-16 14:29:47.529257 | controller | changed: [instance]
2026-03-16 14:29:47.529352 | controller |
2026-03-16 14:29:47.529375 | controller | TASK [libvirt_manager : Check if KVM is enabled] *******************************
2026-03-16 14:29:47.799598 | controller | Monday 16 March 2026  14:29:47 +0000 (0:00:00.268)       0:00:03.948 **********
2026-03-16 14:29:47.799620 | controller | ok: [instance]
2026-03-16 14:29:47.829622 | controller |
2026-03-16 14:29:47.829641 | controller | TASK [libvirt_manager : Fail if KVM not enabled] *******************************
2026-03-16 14:29:47.829649 | controller | Monday 16 March 2026  14:29:47 +0000 (0:00:00.270)       0:00:04.218 **********
2026-03-16 14:29:47.829667 | controller | skipping: [instance]
2026-03-16 14:29:47.848014 | controller |
2026-03-16 14:29:47.848030 | controller | TASK [libvirt_manager : Check if VMX virtualization] ***************************
2026-03-16 14:29:47.848037 | controller | Monday 16 March 2026  14:29:47 +0000 (0:00:00.030)       0:00:04.248 **********
2026-03-16 14:29:47.848045 | controller | skipping: [instance]
2026-03-16 14:29:47.869674 | controller |
2026-03-16 14:29:47.869710 | controller | TASK [libvirt_manager : Check if SVM virtualization] ***************************
2026-03-16 14:29:47.869724 | controller | Monday 16 March 2026  14:29:47 +0000 (0:00:00.018)       0:00:04.267 **********
2026-03-16 14:29:47.869735 | controller | ok: [instance]
2026-03-16 14:29:47.900271 | controller |
2026-03-16 14:29:47.900306 | controller | TASK [libvirt_manager : Enable VMX virtualization] *****************************
2026-03-16 14:29:47.900316 | controller | Monday 16 March 2026  14:29:47 +0000 (0:00:00.021)       0:00:04.288 **********
2026-03-16 14:29:47.900329 | controller | skipping: [instance]
2026-03-16 14:29:47.900361 | controller |
2026-03-16 14:29:47.900370 | controller | TASK [libvirt_manager : Install packages required for using KVM] ***************
2026-03-16 14:29:47.900439 | controller | Monday 16 March 2026  14:29:47 +0000 (0:00:00.030)       0:00:04.319 **********
2026-03-16 14:30:00.618538 | controller | changed: [instance]
2026-03-16 14:30:00.618598 | controller |
2026-03-16 14:30:00.618610 | controller | TASK [libvirt_manager : Create rules.d polkit folder] **************************
2026-03-16 14:30:00.618713 | controller | Monday 16 March 2026  14:30:00 +0000 (0:00:12.717)       0:00:17.037 **********
2026-03-16 14:30:00.863133 | controller | changed: [instance]
2026-03-16 14:30:01.414328 | controller |
2026-03-16 14:30:01.414384 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] *********************
2026-03-16 14:30:01.414394 | controller | Monday 16 March 2026  14:30:00 +0000 (0:00:00.244)       0:00:17.281 **********
2026-03-16 14:30:01.414408 | controller | changed: [instance]
2026-03-16 14:30:02.008050 | controller |
2026-03-16 14:30:02.008085 | controller | TASK [libvirt_manager : Restart service polkit service] ************************
2026-03-16 14:30:02.008093 | controller | Monday 16 March 2026  14:30:01 +0000 (0:00:00.551)       0:00:17.833 **********
2026-03-16 14:30:02.008105 | controller | changed: [instance]
2026-03-16 14:30:02.218735 | controller |
2026-03-16 14:30:02.218763 | controller | TASK [libvirt_manager : Remove directory for service override] *****************
2026-03-16 14:30:02.218771 | controller | Monday 16 March 2026  14:30:02 +0000 (0:00:00.594)       0:00:18.427 **********
2026-03-16 14:30:02.218793 | controller | ok: [instance]
2026-03-16 14:30:02.934922 | controller |
2026-03-16 14:30:02.934954 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] ***
2026-03-16 14:30:02.934962 | controller | Monday 16 March 2026  14:30:02 +0000 (0:00:00.210)       0:00:18.637 **********
2026-03-16 14:30:02.934973 | controller | ok: [instance]
2026-03-16 14:30:03.787215 | controller |
2026-03-16 14:30:03.787255 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************
2026-03-16 14:30:03.787263 | controller | Monday 16 March 2026  14:30:02 +0000 (0:00:00.715)       0:00:19.353 **********
2026-03-16 14:30:03.787276 | controller | changed: [instance]
2026-03-16 14:30:03.787304 | controller |
2026-03-16 14:30:03.787514 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] ****
2026-03-16 14:30:03.899303 | controller | Monday 16 March 2026  14:30:03 +0000 (0:00:00.852)       0:00:20.206 **********
2026-03-16 14:30:03.899340 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu)
2026-03-16 14:30:04.243547 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface)
2026-03-16 14:30:04.243571 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network)
2026-03-16 14:30:04.243579 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev)
2026-03-16 14:30:04.243586 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter)
2026-03-16 14:30:04.243592 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret)
2026-03-16 14:30:04.243597 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage)
2026-03-16 14:30:04.243603 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy)
2026-03-16 14:30:04.243608 | controller |
2026-03-16 14:30:04.243614 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] *********
2026-03-16 14:30:04.243620 | controller | Monday 16 March 2026  14:30:03 +0000 (0:00:00.111)       0:00:20.317 **********
2026-03-16 14:30:04.243629 | controller | ok: [instance]
2026-03-16 14:30:04.614689 | controller |
2026-03-16 14:30:04.614713 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] **********
2026-03-16 14:30:04.614721 | controller | Monday 16 March 2026  14:30:04 +0000 (0:00:00.344)       0:00:20.662 **********
2026-03-16 14:30:04.614731 | controller | ok: [instance]
2026-03-16 14:30:04.968784 | controller |
2026-03-16 14:30:04.968808 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] **************
2026-03-16 14:30:04.968824 | controller | Monday 16 March 2026  14:30:04 +0000 (0:00:00.371)       0:00:21.033 **********
2026-03-16 14:30:04.968834 | controller | ok: [instance]
2026-03-16 14:30:05.325271 | controller |
2026-03-16 14:30:05.325333 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] ****
2026-03-16 14:30:05.325343 | controller | Monday 16 March 2026  14:30:04 +0000 (0:00:00.354)       0:00:21.388 **********
2026-03-16 14:30:05.325357 | controller | ok: [instance]
2026-03-16 14:30:05.325379 | controller |
2026-03-16 14:30:05.325388 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] *****
2026-03-16 14:30:05.670091 | controller | Monday 16 March 2026  14:30:05 +0000 (0:00:00.356)       0:00:21.744 **********
2026-03-16 14:30:05.670181 | controller | ok: [instance]
2026-03-16 14:30:05.670216 | controller |
2026-03-16 14:30:05.670387 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] *********
2026-03-16 14:30:05.670429 | controller | Monday 16 March 2026  14:30:05 +0000 (0:00:00.344)       0:00:22.089 **********
2026-03-16 14:30:06.027532 | controller | ok: [instance]
2026-03-16 14:30:06.385450 | controller |
2026-03-16 14:30:06.385478 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ******
2026-03-16 14:30:06.385487 | controller | Monday 16 March 2026  14:30:06 +0000 (0:00:00.356)       0:00:22.446 **********
2026-03-16 14:30:06.385497 | controller | ok: [instance]
2026-03-16 14:30:06.731213 | controller |
2026-03-16 14:30:06.731252 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] *******
2026-03-16 14:30:06.731260 | controller | Monday 16 March 2026  14:30:06 +0000 (0:00:00.358)       0:00:22.804 **********
2026-03-16 14:30:06.731272 | controller | ok: [instance]
2026-03-16 14:30:06.731297 | controller |
2026-03-16 14:30:06.731480 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] ***********
2026-03-16 14:30:07.063644 | controller | Monday 16 March 2026  14:30:06 +0000 (0:00:00.345)       0:00:23.150 **********
2026-03-16 14:30:07.063680 | controller | ok: [instance]
2026-03-16 14:30:07.400548 | controller |
2026-03-16 14:30:07.400577 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ******
2026-03-16 14:30:07.400585 | controller | Monday 16 March 2026  14:30:07 +0000 (0:00:00.332)       0:00:23.482 **********
2026-03-16 14:30:07.400596 | controller | ok: [instance]
2026-03-16 14:30:07.748712 | controller |
2026-03-16 14:30:07.748756 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] *******
2026-03-16 14:30:07.748765 | controller | Monday 16 March 2026  14:30:07 +0000 (0:00:00.336)       0:00:23.819 **********
2026-03-16 14:30:07.748775 | controller | ok: [instance]
2026-03-16 14:30:08.120279 | controller |
2026-03-16 14:30:08.120340 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] ***********
2026-03-16 14:30:08.120350 | controller | Monday 16 March 2026  14:30:07 +0000 (0:00:00.348)       0:00:24.167 **********
2026-03-16 14:30:08.120364 | controller | ok: [instance]
2026-03-16 14:30:08.120405 | controller |
2026-03-16 14:30:08.120414 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] *****
2026-03-16 14:30:08.120510 | controller | Monday 16 March 2026  14:30:08 +0000 (0:00:00.371)       0:00:24.539 **********
2026-03-16 14:30:08.468036 | controller | ok: [instance]
2026-03-16 14:30:08.839250 | controller |
2026-03-16 14:30:08.839305 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ******
2026-03-16 14:30:08.839317 | controller | Monday 16 March 2026  14:30:08 +0000 (0:00:00.347)       0:00:24.887 **********
2026-03-16 14:30:08.839332 | controller | ok: [instance]
2026-03-16 14:30:09.203428 | controller |
2026-03-16 14:30:09.203494 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] **********
2026-03-16 14:30:09.203504 | controller | Monday 16 March 2026  14:30:08 +0000 (0:00:00.371)       0:00:25.258 **********
2026-03-16 14:30:09.203520 | controller | ok: [instance]
2026-03-16 14:30:09.543058 | controller |
2026-03-16 14:30:09.543098 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] *******
2026-03-16 14:30:09.543106 | controller | Monday 16 March 2026  14:30:09 +0000 (0:00:00.363)       0:00:25.622 **********
2026-03-16 14:30:09.543131 | controller | ok: [instance]
2026-03-16 14:30:09.883210 | controller |
2026-03-16 14:30:09.883248 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ********
2026-03-16 14:30:09.883263 | controller | Monday 16 March 2026  14:30:09 +0000 (0:00:00.339)       0:00:25.962 **********
2026-03-16 14:30:09.883275 | controller | ok: [instance]
2026-03-16 14:30:09.883297 | controller |
2026-03-16 14:30:09.883305 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************
2026-03-16 14:30:09.883384 | controller | Monday 16 March 2026  14:30:09 +0000 (0:00:00.340)       0:00:26.302 **********
2026-03-16 14:30:10.244235 | controller | ok: [instance]
2026-03-16 14:30:10.601580 | controller |
2026-03-16 14:30:10.601616 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ******
2026-03-16 14:30:10.601624 | controller | Monday 16 March 2026  14:30:10 +0000 (0:00:00.360)       0:00:26.663 **********
2026-03-16 14:30:10.601635 | controller | ok: [instance]
2026-03-16 14:30:10.952003 | controller |
2026-03-16 14:30:10.952030 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] *******
2026-03-16 14:30:10.952038 | controller | Monday 16 March 2026  14:30:10 +0000 (0:00:00.357)       0:00:27.020 **********
2026-03-16 14:30:10.952055 | controller | ok: [instance]
2026-03-16 14:30:11.317845 | controller |
2026-03-16 14:30:11.317870 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] ***********
2026-03-16 14:30:11.317880 | controller | Monday 16 March 2026  14:30:10 +0000 (0:00:00.350)       0:00:27.371 **********
2026-03-16 14:30:11.317892 | controller | ok: [instance]
2026-03-16 14:30:11.664968 | controller |
2026-03-16 14:30:11.665002 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ********
2026-03-16 14:30:11.665010 | controller | Monday 16 March 2026  14:30:11 +0000 (0:00:00.365)       0:00:27.736 **********
2026-03-16 14:30:11.665021 | controller | ok: [instance]
2026-03-16 14:30:12.027230 | controller |
2026-03-16 14:30:12.027272 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] *********
2026-03-16 14:30:12.027282 | controller | Monday 16 March 2026  14:30:11 +0000 (0:00:00.347)       0:00:28.083 **********
2026-03-16 14:30:12.027296 | controller | ok: [instance]
2026-03-16 14:30:12.027326 | controller |
2026-03-16 14:30:12.027502 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] *************
2026-03-16 14:30:12.381348 | controller | Monday 16 March 2026  14:30:12 +0000 (0:00:00.362)       0:00:28.446 **********
2026-03-16 14:30:12.381446 | controller | ok: [instance]
2026-03-16 14:30:12.407822 | controller |
2026-03-16 14:30:12.407869 | controller | TASK [libvirt_manager : Manage service for older releases] *********************
2026-03-16 14:30:12.407880 | controller | Monday 16 March 2026  14:30:12 +0000 (0:00:00.353)       0:00:28.800 **********
2026-03-16 14:30:12.407895 | controller | skipping: [instance]
2026-03-16 14:30:12.703255 | controller |
2026-03-16 14:30:12.703292 | controller | TASK [libvirt_manager : Get libvirt group users] *******************************
2026-03-16 14:30:12.703302 | controller | Monday 16 March 2026  14:30:12 +0000 (0:00:00.026)       0:00:28.826 **********
2026-03-16 14:30:12.703313 | controller | ok: [instance]
2026-03-16 14:30:12.703540 | controller |
2026-03-16 14:30:12.703588 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] ***************
2026-03-16 14:30:13.125953 | controller | Monday 16 March 2026  14:30:12 +0000 (0:00:00.295)       0:00:29.122 **********
2026-03-16 14:30:13.126013 | controller | ok: [instance]
2026-03-16 14:30:13.475188 | controller |
2026-03-16 14:30:13.475233 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] ***
2026-03-16 14:30:13.475243 | controller | Monday 16 March 2026  14:30:13 +0000 (0:00:00.422)       0:00:29.544 **********
2026-03-16 14:30:13.475256 | controller | changed: [instance]
2026-03-16 14:30:13.768729 | controller |
2026-03-16 14:30:13.768769 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] *********
2026-03-16 14:30:13.768779 | controller | Monday 16 March 2026  14:30:13 +0000 (0:00:00.349)       0:00:29.893 **********
2026-03-16 14:30:13.768793 | controller | [WARNING]: Reset is not implemented for this connection
2026-03-16 14:30:13.779324 | controller | changed: [instance]
2026-03-16 14:30:13.895619 | controller |
2026-03-16 14:30:13.895651 | controller | TASK [libvirt_manager : Ensure we reload user env] *****************************
2026-03-16 14:30:13.895660 | controller | Monday 16 March 2026  14:30:13 +0000 (0:00:00.287)       0:00:30.181 **********
2026-03-16 14:30:13.895668 | controller |
2026-03-16 14:30:13.895682 | controller | TASK [reproducer : Deploy networks in libvirt] *********************************
2026-03-16 14:30:13.895689 | controller | Monday 16 March 2026  14:30:13 +0000 (0:00:00.015)       0:00:30.197 **********
2026-03-16 14:30:13.895713 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance
2026-03-16 14:30:13.943877 | controller |
2026-03-16 14:30:13.943908 | controller | TASK [reproducer : Ensure networks are consistent] *****************************
2026-03-16 14:30:13.943921 | controller | Monday 16 March 2026  14:30:13 +0000 (0:00:00.116)       0:00:30.314 **********
2026-03-16 14:30:13.943936 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance
2026-03-16 14:30:13.997008 | controller |
2026-03-16 14:30:13.997032 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-16 14:30:13.997042 | controller | Monday 16 March 2026  14:30:13 +0000 (0:00:00.048)       0:00:30.362 **********
2026-03-16 14:30:13.997054 | controller | ok: [instance] => (item=compute)
2026-03-16 14:30:14.050541 | controller | ok: [instance] => (item=controller)
2026-03-16 14:30:14.050570 | controller | ok: [instance] => (item=crc)
2026-03-16 14:30:14.050583 | controller |
2026-03-16 14:30:14.050595 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-16 14:30:14.050606 | controller | Monday 16 March 2026  14:30:13 +0000 (0:00:00.052)       0:00:30.415 **********
2026-03-16 14:30:14.050621 | controller | ok: [instance]
2026-03-16 14:30:14.050866 | controller |
2026-03-16 14:30:14.051107 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2026-03-16 14:30:14.051357 | controller | Monday 16 March 2026  14:30:14 +0000 (0:00:00.053)       0:00:30.469 **********
2026-03-16 14:30:14.100859 | controller | ok: [instance] => changed=false
2026-03-16 14:30:14.101112 | controller |   msg: All assertions passed
2026-03-16 14:30:14.101394 | controller |
2026-03-16 14:30:14.101554 | controller | TASK [Ensure we get latest OCP config] *****************************************
2026-03-16 14:30:14.101687 | controller | Monday 16 March 2026  14:30:14 +0000 (0:00:00.050)       0:00:30.520 **********
2026-03-16 14:30:14.149961 | controller |
2026-03-16 14:30:14.150258 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] *****
2026-03-16 14:30:14.150492 | controller | Monday 16 March 2026  14:30:14 +0000 (0:00:00.049)       0:00:30.569 **********
2026-03-16 14:30:14.238429 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.54', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'})
2026-03-16 14:30:14.238602 | controller | ok: [instance] => (item={})
2026-03-16 14:30:14.238753 | controller |
2026-03-16 14:30:14.238876 | controller | TASK [devscripts : Check if num_masters is equal to 1 when cifmw_devscripts_sno] ***
2026-03-16 14:30:14.238995 | controller | Monday 16 March 2026  14:30:14 +0000 (0:00:00.088)       0:00:30.658 **********
2026-03-16 14:30:14.274584 | controller | skipping: [instance]
2026-03-16 14:30:14.274734 | controller |
2026-03-16 14:30:14.274865 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] ****************
2026-03-16 14:30:14.274985 | controller | Monday 16 March 2026  14:30:14 +0000 (0:00:00.036)       0:00:30.694 **********
2026-03-16 14:30:14.297907 | controller | skipping: [instance]
2026-03-16 14:30:14.298041 | controller |
2026-03-16 14:30:14.298197 | controller | TASK [devscripts : Ensure output directory exists] *****************************
2026-03-16 14:30:14.298344 | controller | Monday 16 March 2026  14:30:14 +0000 (0:00:00.023)       0:00:30.717 **********
2026-03-16 14:30:14.533201 | controller | ok: [instance]
2026-03-16 14:30:14.533227 | controller |
2026-03-16 14:30:14.533235 | controller | TASK [devscripts : Output built config for easier debugging] *******************
2026-03-16 14:30:14.533250 | controller | Monday 16 March 2026  14:30:14 +0000 (0:00:00.234)       0:00:30.952 **********
2026-03-16 14:30:14.905824 | controller | changed: [instance]
2026-03-16 14:30:15.666302 | controller |
2026-03-16 14:30:15.666363 | controller | TASK [ci_network : Remove the local dns configuration] *************************
2026-03-16 14:30:15.666374 | controller | Monday 16 March 2026  14:30:14 +0000 (0:00:00.372)       0:00:31.324 **********
2026-03-16 14:30:15.666392 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf)
2026-03-16 14:30:15.695141 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf)
2026-03-16 14:30:15.695201 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf)
2026-03-16 14:30:15.695210 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf)
2026-03-16 14:30:15.695219 | controller |
2026-03-16 14:30:15.695226 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] **************
2026-03-16 14:30:15.695233 | controller | Monday 16 March 2026  14:30:15 +0000 (0:00:00.760)       0:00:32.085 **********
2026-03-16 14:30:15.695247 | controller | skipping: [instance]
2026-03-16 14:30:16.093834 | controller |
2026-03-16 14:30:16.093864 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] *********
2026-03-16 14:30:16.093872 | controller | Monday 16 March 2026  14:30:15 +0000 (0:00:00.029)       0:00:32.114 **********
2026-03-16 14:30:16.093884 | controller | changed: [instance]
2026-03-16 14:30:16.566616 | controller |
2026-03-16 14:30:16.566658 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ******************
2026-03-16 14:30:16.566666 | controller | Monday 16 March 2026  14:30:16 +0000 (0:00:00.390)       0:00:32.504 **********
2026-03-16 14:30:16.566672 | controller |
2026-03-16 14:30:16.566685 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-16 14:30:16.566691 | controller | Monday 16 March 2026  14:30:16 +0000 (0:00:00.008)       0:00:32.512 **********
2026-03-16 14:30:16.566702 | controller | changed: [instance]
2026-03-16 14:30:16.641870 | controller |
2026-03-16 14:30:16.641913 | controller | TASK [Ensure no default networks exists] ***************************************
2026-03-16 14:30:16.641926 | controller | Monday 16 March 2026  14:30:16 +0000 (0:00:00.472)       0:00:32.985 **********
2026-03-16 14:30:16.641943 | controller |
2026-03-16 14:30:17.873581 | controller | TASK [libvirt_manager : Deactivate crc] ****************************************
2026-03-16 14:30:17.873614 | controller | Monday 16 March 2026  14:30:16 +0000 (0:00:00.075)       0:00:33.060 **********
2026-03-16 14:30:17.873626 | controller | ok: [instance]
2026-03-16 14:30:18.107723 | controller |
2026-03-16 14:30:18.107757 | controller | TASK [libvirt_manager : Removing crc] ******************************************
2026-03-16 14:30:18.107766 | controller | Monday 16 March 2026  14:30:17 +0000 (0:00:01.231)       0:00:34.292 **********
2026-03-16 14:30:18.107776 | controller | ok: [instance]
2026-03-16 14:30:18.668541 | controller |
2026-03-16 14:30:18.668573 | controller | TASK [libvirt_manager : Deactivate default] ************************************
2026-03-16 14:30:18.668586 | controller | Monday 16 March 2026  14:30:18 +0000 (0:00:00.234)       0:00:34.526 **********
2026-03-16 14:30:18.668597 | controller | ok: [instance]
2026-03-16 14:30:18.887375 | controller |
2026-03-16 14:30:18.887455 | controller | TASK [libvirt_manager : Removing default] **************************************
2026-03-16 14:30:18.887471 | controller | Monday 16 March 2026  14:30:18 +0000 (0:00:00.560)       0:00:35.087 **********
2026-03-16 14:30:18.887493 | controller | ok: [instance]
2026-03-16 14:30:20.089075 | controller |
2026-03-16 14:30:20.089105 | controller | TASK [reproducer : Ensure firewalld is installed] ******************************
2026-03-16 14:30:20.089113 | controller | Monday 16 March 2026  14:30:18 +0000 (0:00:00.218)       0:00:35.306 **********
2026-03-16 14:30:20.089139 | controller | ok: [instance]
2026-03-16 14:30:20.402559 | controller |
2026-03-16 14:30:20.402589 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************
2026-03-16 14:30:20.402597 | controller | Monday 16 March 2026  14:30:20 +0000 (0:00:01.201)       0:00:36.508 **********
2026-03-16 14:30:20.402607 | controller | ok: [instance]
2026-03-16 14:30:20.710976 | controller |
2026-03-16 14:30:20.711005 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] ***********************
2026-03-16 14:30:20.711021 | controller | Monday 16 March 2026  14:30:20 +0000 (0:00:00.313)       0:00:36.821 **********
2026-03-16 14:30:20.711033 | controller | changed: [instance]
2026-03-16 14:30:22.006736 | controller |
2026-03-16 14:30:22.006766 | controller | TASK [reproducer : Ensure IP forwarding is enabled] ****************************
2026-03-16 14:30:22.006774 | controller | Monday 16 March 2026  14:30:20 +0000 (0:00:00.308)       0:00:37.130 **********
2026-03-16 14:30:22.006784 | controller | changed: [instance]
2026-03-16 14:30:24.559214 | controller |
2026-03-16 14:30:24.559247 | controller | TASK [reproducer : Ensure the required parameters are loaded] ******************
2026-03-16 14:30:24.559257 | controller | Monday 16 March 2026  14:30:22 +0000 (0:00:01.295)       0:00:38.425 **********
2026-03-16 14:30:24.559270 | controller | changed: [instance] => (item=arptables)
2026-03-16 14:30:24.885916 | controller | changed: [instance] => (item=iptables)
2026-03-16 14:30:24.885949 | controller | changed: [instance] => (item=ip6tables)
2026-03-16 14:30:24.885959 | controller |
2026-03-16 14:30:24.885966 | controller | TASK [reproducer : Ensure firewall service is enabled and started] *************
2026-03-16 14:30:24.885973 | controller | Monday 16 March 2026  14:30:24 +0000 (0:00:02.552)       0:00:40.978 **********
2026-03-16 14:30:24.885987 | controller | ok: [instance]
2026-03-16 14:30:24.975960 | controller |
2026-03-16 14:30:24.976001 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] *************
2026-03-16 14:30:24.976012 | controller | Monday 16 March 2026  14:30:24 +0000 (0:00:00.326)       0:00:41.305 **********
2026-03-16 14:30:24.976026 | controller | ok: [instance]
2026-03-16 14:30:25.018350 | controller |
2026-03-16 14:30:25.018403 | controller | TASK [Ensure the required network configurations are applied] ******************
2026-03-16 14:30:25.018417 | controller | Monday 16 March 2026  14:30:24 +0000 (0:00:00.089)       0:00:41.395 **********
2026-03-16 14:30:25.018433 | controller |
2026-03-16 14:30:25.018460 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] ***
2026-03-16 14:30:25.018473 | controller | Monday 16 March 2026  14:30:25 +0000 (0:00:00.042)       0:00:41.437 **********
2026-03-16 14:30:25.039837 | controller | skipping: [instance]
2026-03-16 14:30:25.039884 | controller |
2026-03-16 14:30:25.040001 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ******
2026-03-16 14:30:25.040092 | controller | Monday 16 March 2026  14:30:25 +0000 (0:00:00.021)       0:00:41.459 **********
2026-03-16 14:30:25.063804 | controller | skipping: [instance]
2026-03-16 14:30:25.063849 | controller |
2026-03-16 14:30:25.063965 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-16 14:30:25.064062 | controller | Monday 16 March 2026  14:30:25 +0000 (0:00:00.023)       0:00:41.483 **********
2026-03-16 14:30:25.085776 | controller | skipping: [instance]
2026-03-16 14:30:25.085835 | controller |
2026-03-16 14:30:25.085939 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ******
2026-03-16 14:30:25.086038 | controller | Monday 16 March 2026  14:30:25 +0000 (0:00:00.022)       0:00:41.505 **********
2026-03-16 14:30:25.111213 | controller | skipping: [instance]
2026-03-16 14:30:25.111272 | controller |
2026-03-16 14:30:25.111384 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] **********************
2026-03-16 14:30:25.111494 | controller | Monday 16 March 2026  14:30:25 +0000 (0:00:00.025)       0:00:41.530 **********
2026-03-16 14:30:25.148103 | controller | ok: [instance]
2026-03-16 14:30:25.179242 | controller |
2026-03-16 14:30:25.179271 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] ***
2026-03-16 14:30:25.179280 | controller | Monday 16 March 2026  14:30:25 +0000 (0:00:00.036)       0:00:41.567 **********
2026-03-16 14:30:25.179297 | controller | skipping: [instance]
2026-03-16 14:30:25.179327 | controller |
2026-03-16 14:30:25.179336 | controller | TASK [ci_nmstate : Get k8s nodes] **********************************************
2026-03-16 14:30:25.179393 | controller | Monday 16 March 2026  14:30:25 +0000 (0:00:00.031)       0:00:41.598 **********
2026-03-16 14:30:25.199877 | controller | skipping: [instance]
2026-03-16 14:30:25.255212 | controller |
2026-03-16 14:30:25.255232 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ********
2026-03-16 14:30:25.255240 | controller | Monday 16 March 2026  14:30:25 +0000 (0:00:00.020)       0:00:41.619 **********
2026-03-16 14:30:25.255258 | controller | ok: [instance]
2026-03-16 14:30:25.255313 | controller |
2026-03-16 14:30:25.255337 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] *************************
2026-03-16 14:30:25.255351 | controller | Monday 16 March 2026  14:30:25 +0000 (0:00:00.055)       0:00:41.674 **********
2026-03-16 14:30:25.278099 | controller | skipping: [instance]
2026-03-16 14:30:25.324720 | controller |
2026-03-16 14:30:25.324739 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] *********************
2026-03-16 14:30:25.324746 | controller | Monday 16 March 2026  14:30:25 +0000 (0:00:00.022)       0:00:41.697 **********
2026-03-16 14:30:25.324755 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost)
2026-03-16 14:30:25.634424 | controller |
2026-03-16 14:30:25.634444 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2026-03-16 14:30:25.634452 | controller | Monday 16 March 2026  14:30:25 +0000 (0:00:00.046)       0:00:41.743 **********
2026-03-16 14:30:25.634461 | controller | ok: [instance -> localhost]
2026-03-16 14:30:33.653593 | controller |
2026-03-16 14:30:33.653635 | controller | TASK [ci_nmstate : Install required packages on localhost] *********************
2026-03-16 14:30:33.653644 | controller | Monday 16 March 2026  14:30:25 +0000 (0:00:00.310)       0:00:42.053 **********
2026-03-16 14:30:33.653661 | controller | changed: [instance -> localhost]
2026-03-16 14:30:33.833929 | controller |
2026-03-16 14:30:33.833957 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2026-03-16 14:30:33.833965 | controller | Monday 16 March 2026  14:30:33 +0000 (0:00:08.018)       0:00:50.072 **********
2026-03-16 14:30:33.833975 | controller | changed: [instance]
2026-03-16 14:30:34.159878 | controller |
2026-03-16 14:30:34.159906 | controller | TASK [ci_nmstate : Save nmstate state for localhost] ***************************
2026-03-16 14:30:34.159914 | controller | Monday 16 March 2026  14:30:33 +0000 (0:00:00.180)       0:00:50.253 **********
2026-03-16 14:30:34.159924 | controller | changed: [instance]
2026-03-16 14:30:35.757614 | controller |
2026-03-16 14:30:35.757646 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] *********************
2026-03-16 14:30:35.757654 | controller | Monday 16 March 2026  14:30:34 +0000 (0:00:00.325)       0:00:50.579 **********
2026-03-16 14:30:35.757664 | controller | changed: [instance -> localhost]
2026-03-16 14:30:36.083621 | controller |
2026-03-16 14:30:36.083640 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ******************
2026-03-16 14:30:36.083647 | controller | Monday 16 March 2026  14:30:35 +0000 (0:00:01.597)       0:00:52.176 **********
2026-03-16 14:30:36.083656 | controller | changed: [instance]
2026-03-16 14:30:36.112139 | controller |
2026-03-16 14:30:36.112155 | controller | TASK [reproducer : Select right domain] ****************************************
2026-03-16 14:30:36.112162 | controller | Monday 16 March 2026  14:30:36 +0000 (0:00:00.326)       0:00:52.503 **********
2026-03-16 14:30:36.112170 | controller | ok: [instance]
2026-03-16 14:30:36.224206 | controller |
2026-03-16 14:30:36.224239 | controller | TASK [Create the virtual networks] *********************************************
2026-03-16 14:30:36.224252 | controller | Monday 16 March 2026  14:30:36 +0000 (0:00:00.028)       0:00:52.531 **********
2026-03-16 14:30:36.224264 | controller |
2026-03-16 14:30:36.240096 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ********************
2026-03-16 14:30:36.240112 | controller | Monday 16 March 2026  14:30:36 +0000 (0:00:00.111)       0:00:52.643 **********
2026-03-16 14:30:36.240142 | controller | ok: [instance]
2026-03-16 14:30:36.412113 | controller |
2026-03-16 14:30:36.412153 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] *******
2026-03-16 14:30:36.412161 | controller | Monday 16 March 2026  14:30:36 +0000 (0:00:00.016)       0:00:52.659 **********
2026-03-16 14:30:36.412170 | controller | ok: [instance]
2026-03-16 14:30:36.439744 | controller |
2026-03-16 14:30:36.439762 | controller | TASK [libvirt_manager : Load file if exists] ***********************************
2026-03-16 14:30:36.439768 | controller | Monday 16 March 2026  14:30:36 +0000 (0:00:00.171)       0:00:52.831 **********
2026-03-16 14:30:36.439776 | controller | skipping: [instance]
2026-03-16 14:30:36.498893 | controller |
2026-03-16 14:30:36.498910 | controller | TASK [libvirt_manager : Update fact with existing content] *********************
2026-03-16 14:30:36.498922 | controller | Monday 16 March 2026  14:30:36 +0000 (0:00:00.027)       0:00:52.859 **********
2026-03-16 14:30:36.498931 | controller | skipping: [instance]
2026-03-16 14:30:36.547856 | controller |
2026-03-16 14:30:36.547873 | controller | TASK [libvirt_manager : Generate VM list] **************************************
2026-03-16 14:30:36.547880 | controller | Monday 16 March 2026  14:30:36 +0000 (0:00:00.058)       0:00:52.918 **********
2026-03-16 14:30:36.547887 | controller | ok: [instance]
2026-03-16 14:30:36.659370 | controller |
2026-03-16 14:30:36.659409 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] *********************
2026-03-16 14:30:36.659417 | controller | Monday 16 March 2026  14:30:36 +0000 (0:00:00.048)       0:00:52.966 **********
2026-03-16 14:30:36.659430 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-16 14:30:36.659723 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-16 14:30:36.659746 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-16 14:30:36.692586 | controller |
2026-03-16 14:30:36.692617 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] **********************
2026-03-16 14:30:36.692627 | controller | Monday 16 March 2026  14:30:36 +0000 (0:00:00.111)       0:00:53.078 **********
2026-03-16 14:30:36.692638 | controller | skipping: [instance]
2026-03-16 14:30:37.009036 | controller |
2026-03-16 14:30:37.009064 | controller | TASK [libvirt_manager : Dump MAC mapping] **************************************
2026-03-16 14:30:37.009072 | controller | Monday 16 March 2026  14:30:36 +0000 (0:00:00.033)       0:00:53.111 **********
2026-03-16 14:30:37.009081 | controller | changed: [instance]
2026-03-16 14:30:37.096345 | controller |
2026-03-16 14:30:37.096393 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] ***********************
2026-03-16 14:30:37.096408 | controller | Monday 16 March 2026  14:30:37 +0000 (0:00:00.316)       0:00:53.428 **********
2026-03-16 14:30:37.096426 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes)
2026-03-16 14:30:37.096470 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers)
2026-03-16 14:30:37.096482 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps)
2026-03-16 14:30:37.096496 | controller |
2026-03-16 14:30:37.096819 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-16 14:30:37.146101 | controller | Monday 16 March 2026  14:30:37 +0000 (0:00:00.086)       0:00:53.515 **********
2026-03-16 14:30:37.146146 | controller | changed: [instance]
2026-03-16 14:30:37.420742 | controller |
2026-03-16 14:30:37.420766 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-16 14:30:37.420776 | controller | Monday 16 March 2026  14:30:37 +0000 (0:00:00.050)       0:00:53.565 **********
2026-03-16 14:30:37.420787 | controller | changed: [instance]
2026-03-16 14:30:37.625538 | controller |
2026-03-16 14:30:37.625556 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-16 14:30:37.625563 | controller | Monday 16 March 2026  14:30:37 +0000 (0:00:00.274)       0:00:53.839 **********
2026-03-16 14:30:37.625572 | controller | changed: [instance]
2026-03-16 14:30:38.001777 | controller |
2026-03-16 14:30:38.001805 | controller | TASK [libvirt_manager : daniel debug] ******************************************
2026-03-16 14:30:38.001813 | controller | Monday 16 March 2026  14:30:37 +0000 (0:00:00.204)       0:00:54.044 **********
2026-03-16 14:30:38.001823 | controller | changed: [instance]
2026-03-16 14:30:38.052975 | controller |
2026-03-16 14:30:38.052993 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-16 14:30:38.053000 | controller | Monday 16 March 2026  14:30:37 +0000 (0:00:00.376)       0:00:54.420 **********
2026-03-16 14:30:38.053009 | controller | changed: [instance]
2026-03-16 14:30:38.241257 | controller |
2026-03-16 14:30:38.241306 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-16 14:30:38.241316 | controller | Monday 16 March 2026  14:30:38 +0000 (0:00:00.051)       0:00:54.472 **********
2026-03-16 14:30:38.241329 | controller | changed: [instance]
2026-03-16 14:30:38.241348 | controller |
2026-03-16 14:30:38.241356 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-16 14:30:38.241398 | controller | Monday 16 March 2026  14:30:38 +0000 (0:00:00.188)       0:00:54.660 **********
2026-03-16 14:30:38.453225 | controller | changed: [instance]
2026-03-16 14:30:38.453276 | controller |
2026-03-16 14:30:38.453373 | controller | TASK [libvirt_manager : daniel debug] ******************************************
2026-03-16 14:30:38.453474 | controller | Monday 16 March 2026  14:30:38 +0000 (0:00:00.211)       0:00:54.872 **********
2026-03-16 14:30:38.818264 | controller | changed: [instance]
2026-03-16 14:30:38.818318 | controller |
2026-03-16 14:30:38.818339 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-16 14:30:38.818367 | controller | Monday 16 March 2026  14:30:38 +0000 (0:00:00.364)       0:00:55.237 **********
2026-03-16 14:30:38.870305 | controller | changed: [instance]
2026-03-16 14:30:38.870358 | controller |
2026-03-16 14:30:38.870370 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-16 14:30:38.870407 | controller | Monday 16 March 2026  14:30:38 +0000 (0:00:00.052)       0:00:55.289 **********
2026-03-16 14:30:39.063578 | controller | changed: [instance]
2026-03-16 14:30:39.267600 | controller |
2026-03-16 14:30:39.267628 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-16 14:30:39.267637 | controller | Monday 16 March 2026  14:30:39 +0000 (0:00:00.193)       0:00:55.482 **********
2026-03-16 14:30:39.267646 | controller | changed: [instance]
2026-03-16 14:30:39.622245 | controller |
2026-03-16 14:30:39.622272 | controller | TASK [libvirt_manager : daniel debug] ******************************************
2026-03-16 14:30:39.622279 | controller | Monday 16 March 2026  14:30:39 +0000 (0:00:00.204)       0:00:55.686 **********
2026-03-16 14:30:39.622287 | controller | changed: [instance]
2026-03-16 14:30:39.622293 | controller |
2026-03-16 14:30:39.622298 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ********************
2026-03-16 14:30:39.622305 | controller | Monday 16 March 2026  14:30:39 +0000 (0:00:00.354)       0:00:56.041 **********
2026-03-16 14:30:39.802267 | controller | ok: [instance]
2026-03-16 14:30:39.802415 | controller |
2026-03-16 14:30:39.802441 | controller | TASK [libvirt_manager : checking if ansible-inventory is available] ************
2026-03-16 14:30:39.802458 | controller | Monday 16 March 2026  14:30:39 +0000 (0:00:00.179)       0:00:56.221 **********
2026-03-16 14:30:39.978951 | controller | changed: [instance]
2026-03-16 14:30:40.457204 | controller |
2026-03-16 14:30:40.457239 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ******************
2026-03-16 14:30:40.457247 | controller | Monday 16 March 2026  14:30:39 +0000 (0:00:00.176)       0:00:56.398 **********
2026-03-16 14:30:40.457258 | controller | changed: [instance]
2026-03-16 14:30:40.479574 | controller |
2026-03-16 14:30:40.479606 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-16 14:30:40.479616 | controller | Monday 16 March 2026  14:30:40 +0000 (0:00:00.478)       0:00:56.876 **********
2026-03-16 14:30:40.479628 | controller | skipping: [instance]
2026-03-16 14:30:40.500170 | controller |
2026-03-16 14:30:40.500191 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-16 14:30:40.500200 | controller | Monday 16 March 2026  14:30:40 +0000 (0:00:00.022)       0:00:56.898 **********
2026-03-16 14:30:40.500210 | controller | skipping: [instance]
2026-03-16 14:30:40.500315 | controller |
2026-03-16 14:30:40.500324 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-16 14:30:40.500332 | controller | Monday 16 March 2026  14:30:40 +0000 (0:00:00.020)       0:00:56.919 **********
2026-03-16 14:30:40.520979 | controller | skipping: [instance]
2026-03-16 14:30:40.545047 | controller |
2026-03-16 14:30:40.545069 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-16 14:30:40.545078 | controller | Monday 16 March 2026  14:30:40 +0000 (0:00:00.020)       0:00:56.940 **********
2026-03-16 14:30:40.545095 | controller | skipping: [instance]
2026-03-16 14:30:40.563211 | controller |
2026-03-16 14:30:40.563244 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-16 14:30:40.563252 | controller | Monday 16 March 2026  14:30:40 +0000 (0:00:00.023)       0:00:56.964 **********
2026-03-16 14:30:40.563263 | controller | ok: [instance]
2026-03-16 14:30:40.563289 | controller |
2026-03-16 14:30:40.563528 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-16 14:30:40.642395 | controller | Monday 16 March 2026  14:30:40 +0000 (0:00:00.018)       0:00:56.982 **********
2026-03-16 14:30:40.642458 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2026-03-16 14:30:40.660070 | controller |
2026-03-16 14:30:40.660092 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-16 14:30:40.660100 | controller | Monday 16 March 2026  14:30:40 +0000 (0:00:00.078)       0:00:57.061 **********
2026-03-16 14:30:40.660110 | controller | skipping: [instance]
2026-03-16 14:30:40.660233 | controller |
2026-03-16 14:30:40.660375 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-16 14:30:40.660504 | controller | Monday 16 March 2026  14:30:40 +0000 (0:00:00.018)       0:00:57.079 **********
2026-03-16 14:30:40.851495 | controller | changed: [instance]
2026-03-16 14:30:41.233247 | controller |
2026-03-16 14:30:41.233286 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-16 14:30:41.233296 | controller | Monday 16 March 2026  14:30:40 +0000 (0:00:00.191)       0:00:57.270 **********
2026-03-16 14:30:41.233309 | controller | changed: [instance]
2026-03-16 14:30:41.233339 | controller |
2026-03-16 14:30:41.233349 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-16 14:30:41.233377 | controller | Monday 16 March 2026  14:30:41 +0000 (0:00:00.381)       0:00:57.652 **********
2026-03-16 14:30:41.291818 | controller | ok: [instance]
2026-03-16 14:30:41.322011 | controller |
2026-03-16 14:30:41.322027 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-16 14:30:41.322045 | controller | Monday 16 March 2026  14:30:41 +0000 (0:00:00.058)       0:00:57.711 **********
2026-03-16 14:30:41.322054 | controller | ok: [instance]
2026-03-16 14:30:41.681024 | controller |
2026-03-16 14:30:41.681049 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-16 14:30:41.681058 | controller | Monday 16 March 2026  14:30:41 +0000 (0:00:00.030)       0:00:57.741 **********
2026-03-16 14:30:41.681068 | controller | changed: [instance]
2026-03-16 14:30:41.785158 | controller |
2026-03-16 14:30:41.785183 | controller | TASK [libvirt_manager : Manage networks if needed] *****************************
2026-03-16 14:30:41.785190 | controller | Monday 16 March 2026  14:30:41 +0000 (0:00:00.359)       0:00:58.100 **********
2026-03-16 14:30:41.785200 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance
2026-03-16 14:30:41.832820 | controller |
2026-03-16 14:30:41.832841 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] ***
2026-03-16 14:30:41.832848 | controller | Monday 16 March 2026  14:30:41 +0000 (0:00:00.104)       0:00:58.204 **********
2026-03-16 14:30:41.832857 | controller | ok: [instance] => (item=public)
2026-03-16 14:30:42.242018 | controller | ok: [instance] => (item=osp_trunk)
2026-03-16 14:30:42.242052 | controller |
2026-03-16 14:30:42.242060 | controller | TASK [libvirt_manager : Ensure networks are defined] ***************************
2026-03-16 14:30:42.242066 | controller | Monday 16 March 2026  14:30:41 +0000 (0:00:00.047)       0:00:58.252 **********
2026-03-16 14:30:42.242076 | controller | changed: [instance] => (item=cifmw-public)
2026-03-16 14:30:42.794201 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-16 14:30:42.794246 | controller |
2026-03-16 14:30:42.794257 | controller | TASK [libvirt_manager : Ensure networks are created/started] *******************
2026-03-16 14:30:42.794266 | controller | Monday 16 March 2026  14:30:42 +0000 (0:00:00.408)       0:00:58.661 **********
2026-03-16 14:30:42.794281 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 14:30:43.209742 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 14:30:43.209780 | controller |
2026-03-16 14:30:43.209791 | controller | TASK [libvirt_manager : Ensure networks are active] ****************************
2026-03-16 14:30:43.209800 | controller | Monday 16 March 2026  14:30:42 +0000 (0:00:00.551)       0:00:59.213 **********
2026-03-16 14:30:43.209814 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 14:30:43.607864 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 14:30:43.607890 | controller |
2026-03-16 14:30:43.607898 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ******************
2026-03-16 14:30:43.607904 | controller | Monday 16 March 2026  14:30:43 +0000 (0:00:00.415)       0:00:59.628 **********
2026-03-16 14:30:43.607914 | controller | changed: [instance] => (item=cifmw-public)
2026-03-16 14:30:43.666356 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-16 14:30:43.666376 | controller |
2026-03-16 14:30:43.666385 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] **********
2026-03-16 14:30:43.666392 | controller | Monday 16 March 2026  14:30:43 +0000 (0:00:00.398)       0:01:00.026 **********
2026-03-16 14:30:43.666402 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance
2026-03-16 14:30:43.666464 | controller |
2026-03-16 14:30:43.666474 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] ***********************
2026-03-16 14:30:43.666483 | controller | Monday 16 March 2026  14:30:43 +0000 (0:00:00.058)       0:01:00.085 **********
2026-03-16 14:30:43.842241 | controller | ok: [instance]
2026-03-16 14:30:43.842304 | controller |
2026-03-16 14:30:43.842322 | controller | TASK [libvirt_manager : Fetch bridges ports link info] *************************
2026-03-16 14:30:43.842335 | controller | Monday 16 March 2026  14:30:43 +0000 (0:00:00.175)       0:01:00.261 **********
2026-03-16 14:30:44.198765 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 14:30:44.262265 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 14:30:44.262303 | controller |
2026-03-16 14:30:44.262314 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************
2026-03-16 14:30:44.262329 | controller | Monday 16 March 2026  14:30:44 +0000 (0:00:00.356)       0:01:00.617 **********
2026-03-16 14:30:44.262343 | controller |
2026-03-16 14:30:44.297242 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2026-03-16 14:30:44.297274 | controller | Monday 16 March 2026  14:30:44 +0000 (0:00:00.063)       0:01:00.681 **********
2026-03-16 14:30:44.297288 | controller | skipping: [instance]
2026-03-16 14:30:45.515205 | controller |
2026-03-16 14:30:45.515238 | controller | TASK [ci_nmstate : Install required packages on instance] **********************
2026-03-16 14:30:45.515246 | controller | Monday 16 March 2026  14:30:44 +0000 (0:00:00.034)       0:01:00.716 **********
2026-03-16 14:30:45.515257 | controller | ok: [instance]
2026-03-16 14:30:45.515351 | controller |
2026-03-16 14:30:45.515384 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2026-03-16 14:30:45.515399 | controller | Monday 16 March 2026  14:30:45 +0000 (0:00:01.217)       0:01:01.934 **********
2026-03-16 14:30:45.696210 | controller | ok: [instance]
2026-03-16 14:30:45.696288 | controller |
2026-03-16 14:30:45.696310 | controller | TASK [ci_nmstate : Save nmstate state for instance] ****************************
2026-03-16 14:30:45.696321 | controller | Monday 16 March 2026  14:30:45 +0000 (0:00:00.181)       0:01:02.115 **********
2026-03-16 14:30:46.044602 | controller | changed: [instance]
2026-03-16 14:30:47.654749 | controller |
2026-03-16 14:30:47.654779 | controller | TASK [ci_nmstate : Apply the desidered state on instance] **********************
2026-03-16 14:30:47.654787 | controller | Monday 16 March 2026  14:30:46 +0000 (0:00:00.348)       0:01:02.463 **********
2026-03-16 14:30:47.654797 | controller | changed: [instance]
2026-03-16 14:30:47.991678 | controller |
2026-03-16 14:30:47.991708 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] *******************
2026-03-16 14:30:47.991716 | controller | Monday 16 March 2026  14:30:47 +0000 (0:00:01.610)       0:01:04.073 **********
2026-03-16 14:30:47.991725 | controller | changed: [instance]
2026-03-16 14:30:48.021639 | controller |
2026-03-16 14:30:48.021659 | controller | TASK [Create extra network configuration] **************************************
2026-03-16 14:30:48.021668 | controller | Monday 16 March 2026  14:30:47 +0000 (0:00:00.336)       0:01:04.410 **********
2026-03-16 14:30:48.021678 | controller | skipping: [instance]
2026-03-16 14:30:48.050944 | controller |
2026-03-16 14:30:48.050970 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] **************
2026-03-16 14:30:48.050979 | controller | Monday 16 March 2026  14:30:48 +0000 (0:00:00.030)       0:01:04.440 **********
2026-03-16 14:30:48.050990 | controller | skipping: [instance]
2026-03-16 14:30:48.481864 | controller |
2026-03-16 14:30:48.481900 | controller | TASK [libvirt_manager : Refresh networking facts on host] **********************
2026-03-16 14:30:48.481910 | controller | Monday 16 March 2026  14:30:48 +0000 (0:00:00.029)       0:01:04.470 **********
2026-03-16 14:30:48.481922 | controller | ok: [instance]
2026-03-16 14:30:48.620377 | controller |
2026-03-16 14:30:48.620403 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] **********
2026-03-16 14:30:48.620412 | controller | Monday 16 March 2026  14:30:48 +0000 (0:00:00.430)       0:01:04.900 **********
2026-03-16 14:30:48.620423 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 14:30:48.620467 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 14:30:48.620476 | controller |
2026-03-16 14:30:48.620486 | controller | TASK [dnsmasq : Install needed packages] ***************************************
2026-03-16 14:30:48.620511 | controller | Monday 16 March 2026  14:30:48 +0000 (0:00:00.138)       0:01:05.039 **********
2026-03-16 14:30:49.804828 | controller | ok: [instance]
2026-03-16 14:30:49.804869 | controller |
2026-03-16 14:30:49.805018 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ******
2026-03-16 14:30:49.805086 | controller | Monday 16 March 2026  14:30:49 +0000 (0:00:01.184)       0:01:06.224 **********
2026-03-16 14:30:53.416984 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'})
2026-03-16 14:30:53.622225 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'})
2026-03-16 14:30:53.622275 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'})
2026-03-16 14:30:53.622293 | controller |
2026-03-16 14:30:53.622301 | controller | TASK [dnsmasq : Manage configuration directory] ********************************
2026-03-16 14:30:53.622309 | controller | Monday 16 March 2026  14:30:53 +0000 (0:00:03.611)       0:01:09.835 **********
2026-03-16 14:30:53.622324 | controller | changed: [instance]
2026-03-16 14:30:53.987789 | controller |
2026-03-16 14:30:53.987821 | controller | TASK [dnsmasq : Manage systemd unit file] **************************************
2026-03-16 14:30:53.987829 | controller | Monday 16 March 2026  14:30:53 +0000 (0:00:00.205)       0:01:10.041 **********
2026-03-16 14:30:53.987840 | controller | changed: [instance]
2026-03-16 14:30:54.401896 | controller |
2026-03-16 14:30:54.401926 | controller | TASK [dnsmasq : Manage base configuration file] ********************************
2026-03-16 14:30:54.401935 | controller | Monday 16 March 2026  14:30:53 +0000 (0:00:00.365)       0:01:10.406 **********
2026-03-16 14:30:54.401945 | controller | changed: [instance]
2026-03-16 14:30:54.432965 | controller |
2026-03-16 14:30:54.432986 | controller | TASK [dnsmasq : Render listener configuration] *********************************
2026-03-16 14:30:54.432993 | controller | Monday 16 March 2026  14:30:54 +0000 (0:00:00.414)       0:01:10.820 **********
2026-03-16 14:30:54.433002 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance
2026-03-16 14:30:54.796665 | controller |
2026-03-16 14:30:54.796694 | controller | TASK [dnsmasq : Create listener configuration file] ****************************
2026-03-16 14:30:54.796702 | controller | Monday 16 March 2026  14:30:54 +0000 (0:00:00.031)       0:01:10.852 **********
2026-03-16 14:30:54.796712 | controller | changed: [instance]
2026-03-16 14:30:54.815850 | controller |
2026-03-16 14:30:54.815874 | controller | TASK [dnsmasq : Remove listener configuration file] ****************************
2026-03-16 14:30:54.815882 | controller | Monday 16 March 2026  14:30:54 +0000 (0:00:00.363)       0:01:11.215 **********
2026-03-16 14:30:54.815891 | controller | skipping: [instance]
2026-03-16 14:30:54.849210 | controller |
2026-03-16 14:30:54.849249 | controller | TASK [dnsmasq : Render dns configuration] **************************************
2026-03-16 14:30:54.849257 | controller | Monday 16 March 2026  14:30:54 +0000 (0:00:00.019)       0:01:11.235 **********
2026-03-16 14:30:54.849274 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance
2026-03-16 14:30:54.849293 | controller |
2026-03-16 14:30:54.849369 | controller | TASK [dnsmasq : Create dns configuration file] *********************************
2026-03-16 14:30:54.849470 | controller | Monday 16 March 2026  14:30:54 +0000 (0:00:00.033)       0:01:11.268 **********
2026-03-16 14:30:55.205106 | controller | changed: [instance]
2026-03-16 14:30:55.205204 | controller |
2026-03-16 14:30:55.205461 | controller | TASK [dnsmasq : Remove dns configuration file] *********************************
2026-03-16 14:30:55.226661 | controller | Monday 16 March 2026  14:30:55 +0000 (0:00:00.355)       0:01:11.624 **********
2026-03-16 14:30:55.226695 | controller | skipping: [instance]
2026-03-16 14:30:55.432222 | controller |
2026-03-16 14:30:55.432259 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] ***
2026-03-16 14:30:55.432269 | controller | Monday 16 March 2026  14:30:55 +0000 (0:00:00.021)       0:01:11.646 **********
2026-03-16 14:30:55.432283 | controller | ok: [instance] => (item=127.0.0.2)
2026-03-16 14:30:56.081493 | controller |
2026-03-16 14:30:56.081531 | controller | TASK [dnsmasq : Enable and start service] **************************************
2026-03-16 14:30:56.081538 | controller | Monday 16 March 2026  14:30:55 +0000 (0:00:00.205)       0:01:11.851 **********
2026-03-16 14:30:56.081548 | controller | changed: [instance]
2026-03-16 14:30:56.101098 | controller |
2026-03-16 14:30:56.101113 | controller | TASK [dnsmasq : Stop service] **************************************************
2026-03-16 14:30:56.101134 | controller | Monday 16 March 2026  14:30:56 +0000 (0:00:00.649)       0:01:12.500 **********
2026-03-16 14:30:56.101145 | controller | skipping: [instance]
2026-03-16 14:30:56.120242 | controller |
2026-03-16 14:30:56.120262 | controller | TASK [dnsmasq : Remove unit file] **********************************************
2026-03-16 14:30:56.120271 | controller | Monday 16 March 2026  14:30:56 +0000 (0:00:00.019)       0:01:12.520 **********
2026-03-16 14:30:56.120281 | controller | skipping: [instance]
2026-03-16 14:30:56.120315 | controller |
2026-03-16 14:30:56.120324 | controller | TASK [dnsmasq : Remove main configuration files] *******************************
2026-03-16 14:30:56.120412 | controller | Monday 16 March 2026  14:30:56 +0000 (0:00:00.019)       0:01:12.539 **********
2026-03-16 14:30:56.150912 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2026-03-16 14:30:56.268075 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d)
2026-03-16 14:30:56.268094 | controller | skipping: [instance]
2026-03-16 14:30:56.268102 | controller |
2026-03-16 14:30:56.268108 | controller | TASK [Create dnsmasq networks] *************************************************
2026-03-16 14:30:56.268114 | controller | Monday 16 March 2026  14:30:56 +0000 (0:00:00.030)       0:01:12.570 **********
2026-03-16 14:30:56.268141 | controller |
2026-03-16 14:30:56.298092 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2026-03-16 14:30:56.298110 | controller | Monday 16 March 2026  14:30:56 +0000 (0:00:00.117)       0:01:12.687 **********
2026-03-16 14:30:56.298136 | controller | ok: [instance] => changed=false
2026-03-16 14:30:56.335593 | controller |   msg: All assertions passed
2026-03-16 14:30:56.335609 | controller |
2026-03-16 14:30:56.335616 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2026-03-16 14:30:56.335621 | controller | Monday 16 March 2026  14:30:56 +0000 (0:00:00.030)       0:01:12.717 **********
2026-03-16 14:30:56.335629 | controller | ok: [instance] => changed=false
2026-03-16 14:30:56.755757 | controller |   msg: All assertions passed
2026-03-16 14:30:56.755787 | controller |
2026-03-16 14:30:56.755794 | controller | TASK [dnsmasq : Create network] ************************************************
2026-03-16 14:30:56.755801 | controller | Monday 16 March 2026  14:30:56 +0000 (0:00:00.037)       0:01:12.755 **********
2026-03-16 14:30:56.755810 | controller | changed: [instance]
2026-03-16 14:30:56.774242 | controller |
2026-03-16 14:30:56.774266 | controller | TASK [dnsmasq : Remove network] ************************************************
2026-03-16 14:30:56.774275 | controller | Monday 16 March 2026  14:30:56 +0000 (0:00:00.419)       0:01:13.174 **********
2026-03-16 14:30:56.774286 | controller | skipping: [instance]
2026-03-16 14:30:56.774313 | controller |
2026-03-16 14:30:56.774323 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2026-03-16 14:30:56.774382 | controller | Monday 16 March 2026  14:30:56 +0000 (0:00:00.018)       0:01:13.193 **********
2026-03-16 14:30:56.799051 | controller | skipping: [instance]
2026-03-16 14:30:56.828229 | controller |
2026-03-16 14:30:56.828271 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2026-03-16 14:30:56.828281 | controller | Monday 16 March 2026  14:30:56 +0000 (0:00:00.024)       0:01:13.218 **********
2026-03-16 14:30:56.828294 | controller | ok: [instance] => changed=false
2026-03-16 14:30:56.828558 | controller |   msg: All assertions passed
2026-03-16 14:30:56.865042 | controller |
2026-03-16 14:30:56.865063 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2026-03-16 14:30:56.865072 | controller | Monday 16 March 2026  14:30:56 +0000 (0:00:00.029)       0:01:13.247 **********
2026-03-16 14:30:56.865082 | controller | ok: [instance] => changed=false
2026-03-16 14:30:57.288192 | controller |   msg: All assertions passed
2026-03-16 14:30:57.288233 | controller |
2026-03-16 14:30:57.288243 | controller | TASK [dnsmasq : Create network] ************************************************
2026-03-16 14:30:57.288250 | controller | Monday 16 March 2026  14:30:56 +0000 (0:00:00.036)       0:01:13.284 **********
2026-03-16 14:30:57.288270 | controller | changed: [instance]
2026-03-16 14:30:57.288311 | controller |
2026-03-16 14:30:57.288441 | controller | TASK [dnsmasq : Remove network] ************************************************
2026-03-16 14:30:57.288458 | controller | Monday 16 March 2026  14:30:57 +0000 (0:00:00.423)       0:01:13.707 **********
2026-03-16 14:30:57.307282 | controller | skipping: [instance]
2026-03-16 14:30:57.307346 | controller |
2026-03-16 14:30:57.307357 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2026-03-16 14:30:57.307368 | controller | Monday 16 March 2026  14:30:57 +0000 (0:00:00.019)       0:01:13.726 **********
2026-03-16 14:30:57.331008 | controller | skipping: [instance]
2026-03-16 14:30:57.361994 | controller |
2026-03-16 14:30:57.362014 | controller | TASK [Deploy radvd for IPv6 router advertisements] *****************************
2026-03-16 14:30:57.362028 | controller | Monday 16 March 2026  14:30:57 +0000 (0:00:00.023)       0:01:13.750 **********
2026-03-16 14:30:57.362038 | controller | skipping: [instance]
2026-03-16 14:30:57.836224 | controller |
2026-03-16 14:30:57.836252 | controller | TASK [libvirt_manager : Ensure network is in correct zone] *********************
2026-03-16 14:30:57.836260 | controller | Monday 16 March 2026  14:30:57 +0000 (0:00:00.030)       0:01:13.781 **********
2026-03-16 14:30:57.836270 | controller | changed: [instance] => (item=cifmw-public)
2026-03-16 14:30:57.873169 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-16 14:30:57.873198 | controller |
2026-03-16 14:30:57.873206 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-16 14:30:57.873212 | controller | Monday 16 March 2026  14:30:57 +0000 (0:00:00.473)       0:01:14.255 **********
2026-03-16 14:30:57.873222 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public)
2026-03-16 14:30:58.194131 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk)
2026-03-16 14:30:58.194161 | controller |
2026-03-16 14:30:58.194169 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-16 14:30:58.194176 | controller | Monday 16 March 2026  14:30:57 +0000 (0:00:00.036)       0:01:14.292 **********
2026-03-16 14:30:58.194186 | controller | ok: [instance]
2026-03-16 14:30:58.229859 | controller |
2026-03-16 14:30:58.229880 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2026-03-16 14:30:58.229888 | controller | Monday 16 March 2026  14:30:58 +0000 (0:00:00.320)       0:01:14.613 **********
2026-03-16 14:30:58.229897 | controller | ok: [instance]
2026-03-16 14:30:58.426184 | controller |
2026-03-16 14:30:58.426213 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-16 14:30:58.426221 | controller | Monday 16 March 2026  14:30:58 +0000 (0:00:00.036)       0:01:14.649 **********
2026-03-16 14:30:58.426231 | controller | ok: [instance]
2026-03-16 14:30:58.460248 | controller |
2026-03-16 14:30:58.460286 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2026-03-16 14:30:58.460300 | controller | Monday 16 March 2026  14:30:58 +0000 (0:00:00.196)       0:01:14.845 **********
2026-03-16 14:30:58.460316 | controller | ok: [instance]
2026-03-16 14:30:58.460368 | controller |
2026-03-16 14:30:58.460608 | controller | TASK [libvirt_manager : Output _network_data] **********************************
2026-03-16 14:30:58.794838 | controller | Monday 16 March 2026  14:30:58 +0000 (0:00:00.034)       0:01:14.879 **********
2026-03-16 14:30:58.794875 | controller | changed: [instance]
2026-03-16 14:30:59.112688 | controller |
2026-03-16 14:30:59.112706 | controller | TASK [libvirt_manager : Output pub_net] ****************************************
2026-03-16 14:30:59.112713 | controller | Monday 16 March 2026  14:30:58 +0000 (0:00:00.333)       0:01:15.213 **********
2026-03-16 14:30:59.112721 | controller | changed: [instance]
2026-03-16 14:30:59.442775 | controller |
2026-03-16 14:30:59.442798 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ******************
2026-03-16 14:30:59.442807 | controller | Monday 16 March 2026  14:30:59 +0000 (0:00:00.318)       0:01:15.532 **********
2026-03-16 14:30:59.442818 | controller | changed: [instance]
2026-03-16 14:30:59.531809 | controller |
2026-03-16 14:30:59.531843 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ********************
2026-03-16 14:30:59.531856 | controller | Monday 16 March 2026  14:30:59 +0000 (0:00:00.329)       0:01:15.861 **********
2026-03-16 14:30:59.531872 | controller | ok: [instance]
2026-03-16 14:30:59.856410 | controller |
2026-03-16 14:30:59.856450 | controller | TASK [libvirt_manager : Save networking_mapper patch] **************************
2026-03-16 14:30:59.856460 | controller | Monday 16 March 2026  14:30:59 +0000 (0:00:00.088)       0:01:15.950 **********
2026-03-16 14:30:59.856474 | controller | changed: [instance]
2026-03-16 14:30:59.880642 | controller |
2026-03-16 14:30:59.880663 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-16 14:30:59.880670 | controller | Monday 16 March 2026  14:30:59 +0000 (0:00:00.324)       0:01:16.275 **********
2026-03-16 14:30:59.880683 | controller | skipping: [instance]
2026-03-16 14:30:59.902189 | controller |
2026-03-16 14:30:59.902219 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-16 14:30:59.902231 | controller | Monday 16 March 2026  14:30:59 +0000 (0:00:00.024)       0:01:16.300 **********
2026-03-16 14:30:59.902241 | controller | skipping: [instance]
2026-03-16 14:30:59.902317 | controller |
2026-03-16 14:30:59.902356 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-16 14:30:59.902390 | controller | Monday 16 March 2026  14:30:59 +0000 (0:00:00.021)       0:01:16.321 **********
2026-03-16 14:30:59.924178 | controller | skipping: [instance]
2026-03-16 14:30:59.946050 | controller |
2026-03-16 14:30:59.946068 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-16 14:30:59.946077 | controller | Monday 16 March 2026  14:30:59 +0000 (0:00:00.021)       0:01:16.343 **********
2026-03-16 14:30:59.946086 | controller | skipping: [instance]
2026-03-16 14:30:59.966088 | controller |
2026-03-16 14:30:59.966103 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-16 14:30:59.966109 | controller | Monday 16 March 2026  14:30:59 +0000 (0:00:00.022)       0:01:16.365 **********
2026-03-16 14:30:59.966116 | controller | ok: [instance]
2026-03-16 14:31:00.084015 | controller |
2026-03-16 14:31:00.084032 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-16 14:31:00.084039 | controller | Monday 16 March 2026  14:30:59 +0000 (0:00:00.019)       0:01:16.385 **********
2026-03-16 14:31:00.084050 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2026-03-16 14:31:00.102257 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}})
2026-03-16 14:31:00.102301 | controller |
2026-03-16 14:31:00.102315 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-16 14:31:00.102327 | controller | Monday 16 March 2026  14:31:00 +0000 (0:00:00.118)       0:01:16.503 **********
2026-03-16 14:31:00.102343 | controller | skipping: [instance]
2026-03-16 14:31:00.102354 | controller |
2026-03-16 14:31:00.102364 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-16 14:31:00.102390 | controller | Monday 16 March 2026  14:31:00 +0000 (0:00:00.018)       0:01:16.521 **********
2026-03-16 14:31:00.292020 | controller | ok: [instance]
2026-03-16 14:31:00.668645 | controller |
2026-03-16 14:31:00.668664 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-16 14:31:00.668672 | controller | Monday 16 March 2026  14:31:00 +0000 (0:00:00.189)       0:01:16.711 **********
2026-03-16 14:31:00.668680 | controller | changed: [instance]
2026-03-16 14:31:00.729212 | controller |
2026-03-16 14:31:00.729247 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-16 14:31:00.729255 | controller | Monday 16 March 2026  14:31:00 +0000 (0:00:00.376)       0:01:17.087 **********
2026-03-16 14:31:00.729265 | controller | ok: [instance]
2026-03-16 14:31:00.729290 | controller |
2026-03-16 14:31:00.729298 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-16 14:31:00.729510 | controller | Monday 16 March 2026  14:31:00 +0000 (0:00:00.060)       0:01:17.148 **********
2026-03-16 14:31:00.760325 | controller | ok: [instance]
2026-03-16 14:31:01.177273 | controller |
2026-03-16 14:31:01.177312 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-16 14:31:01.177322 | controller | Monday 16 March 2026  14:31:00 +0000 (0:00:00.030)       0:01:17.179 **********
2026-03-16 14:31:01.177336 | controller | changed: [instance]
2026-03-16 14:31:01.205244 | controller |
2026-03-16 14:31:01.205289 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] ***
2026-03-16 14:31:01.205303 | controller | Monday 16 March 2026  14:31:01 +0000 (0:00:00.417)       0:01:17.596 **********
2026-03-16 14:31:01.205322 | controller | ok: [instance]
2026-03-16 14:31:01.205378 | controller |
2026-03-16 14:31:01.205395 | controller | TASK [libvirt_manager : Unset patch] *******************************************
2026-03-16 14:31:01.205473 | controller | Monday 16 March 2026  14:31:01 +0000 (0:00:00.028)       0:01:17.624 **********
2026-03-16 14:31:01.224319 | controller | ok: [instance]
2026-03-16 14:31:01.224384 | controller |
2026-03-16 14:31:01.224590 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] ****************
2026-03-16 14:31:01.244617 | controller | Monday 16 March 2026  14:31:01 +0000 (0:00:00.019)       0:01:17.643 **********
2026-03-16 14:31:01.244638 | controller | ok: [instance]
2026-03-16 14:31:01.317452 | controller |
2026-03-16 14:31:01.317501 | controller | TASK [libvirt_manager : Reserve IPs on networks] *******************************
2026-03-16 14:31:01.317517 | controller | Monday 16 March 2026  14:31:01 +0000 (0:00:00.020)       0:01:17.663 **********
2026-03-16 14:31:01.317535 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane)
2026-03-16 14:31:01.317995 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi)
2026-03-16 14:31:01.318013 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage)
2026-03-16 14:31:01.318020 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant)
2026-03-16 14:31:01.318030 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external)
2026-03-16 14:31:01.448476 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt)
2026-03-16 14:31:01.448511 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public)
2026-03-16 14:31:01.448532 | controller |
2026-03-16 14:31:01.448543 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-16 14:31:01.448554 | controller | Monday 16 March 2026  14:31:01 +0000 (0:00:00.072)       0:01:17.736 **********
2026-03-16 14:31:01.448577 | controller | ok: [instance] => (item=compute-0 - ctlplane)
2026-03-16 14:31:01.448845 | controller | ok: [instance] => (item=controller-0 - ctlplane)
2026-03-16 14:31:01.449096 | controller | ok: [instance] => (item=crc-0 - ctlplane)
2026-03-16 14:31:01.449393 | controller |
2026-03-16 14:31:01.449544 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-16 14:31:01.449662 | controller | Monday 16 March 2026  14:31:01 +0000 (0:00:00.131)       0:01:17.867 **********
2026-03-16 14:31:01.530653 | controller | skipping: [instance] => (item=compute-0 - internalapi)
2026-03-16 14:31:01.530825 | controller | skipping: [instance] => (item=controller-0 - internalapi)
2026-03-16 14:31:01.530976 | controller | skipping: [instance] => (item=crc-0 - internalapi)
2026-03-16 14:31:01.531143 | controller | skipping: [instance]
2026-03-16 14:31:01.531282 | controller |
2026-03-16 14:31:01.531424 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-16 14:31:01.531542 | controller | Monday 16 March 2026  14:31:01 +0000 (0:00:00.082)       0:01:17.950 **********
2026-03-16 14:31:01.607632 | controller | skipping: [instance] => (item=compute-0 - storage)
2026-03-16 14:31:01.607911 | controller | skipping: [instance] => (item=controller-0 - storage)
2026-03-16 14:31:01.608203 | controller | skipping: [instance] => (item=crc-0 - storage)
2026-03-16 14:31:01.608424 | controller | skipping: [instance]
2026-03-16 14:31:01.608537 | controller |
2026-03-16 14:31:01.608656 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-16 14:31:01.608772 | controller | Monday 16 March 2026  14:31:01 +0000 (0:00:00.076)       0:01:18.027 **********
2026-03-16 14:31:01.686776 | controller | skipping: [instance] => (item=compute-0 - tenant)
2026-03-16 14:31:01.687053 | controller | skipping: [instance] => (item=controller-0 - tenant)
2026-03-16 14:31:01.687308 | controller | skipping: [instance] => (item=crc-0 - tenant)
2026-03-16 14:31:01.687447 | controller | skipping: [instance]
2026-03-16 14:31:01.687561 | controller |
2026-03-16 14:31:01.687680 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-16 14:31:01.687796 | controller | Monday 16 March 2026  14:31:01 +0000 (0:00:00.079)       0:01:18.106 **********
2026-03-16 14:31:01.767436 | controller | skipping: [instance] => (item=compute-0 - external)
2026-03-16 14:31:01.767585 | controller | skipping: [instance] => (item=controller-0 - external)
2026-03-16 14:31:01.767710 | controller | skipping: [instance] => (item=crc-0 - external)
2026-03-16 14:31:01.767827 | controller | skipping: [instance]
2026-03-16 14:31:01.767939 | controller |
2026-03-16 14:31:01.768056 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-16 14:31:01.768197 | controller | Monday 16 March 2026  14:31:01 +0000 (0:00:00.080)       0:01:18.186 **********
2026-03-16 14:31:01.846103 | controller | skipping: [instance] => (item=compute-0 - storagemgmt)
2026-03-16 14:31:01.846462 | controller | skipping: [instance] => (item=controller-0 - storagemgmt)
2026-03-16 14:31:01.846651 | controller | skipping: [instance] => (item=crc-0 - storagemgmt)
2026-03-16 14:31:01.846768 | controller | skipping: [instance]
2026-03-16 14:31:01.846899 | controller |
2026-03-16 14:31:01.847019 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-16 14:31:01.847170 | controller | Monday 16 March 2026  14:31:01 +0000 (0:00:00.078)       0:01:18.265 **********
2026-03-16 14:31:01.979570 | controller | ok: [instance] => (item=compute-0 - public)
2026-03-16 14:31:01.979843 | controller | ok: [instance] => (item=controller-0 - public)
2026-03-16 14:31:01.979967 | controller | ok: [instance] => (item=crc-0 - public)
2026-03-16 14:31:01.980079 | controller |
2026-03-16 14:31:01.980224 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ******************************
2026-03-16 14:31:01.980352 | controller | Monday 16 March 2026  14:31:01 +0000 (0:00:00.133)       0:01:18.399 **********
2026-03-16 14:31:02.084673 | controller |
2026-03-16 14:31:02.084955 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************
2026-03-16 14:31:02.085150 | controller | Monday 16 March 2026  14:31:02 +0000 (0:00:00.105)       0:01:18.504 **********
2026-03-16 14:31:02.122547 | controller | ok: [instance]
2026-03-16 14:31:02.122825 | controller |
2026-03-16 14:31:02.123075 | controller | TASK [dnsmasq : Assert we have needed host data] *******************************
2026-03-16 14:31:02.123229 | controller | Monday 16 March 2026  14:31:02 +0000 (0:00:00.037)       0:01:18.542 **********
2026-03-16 14:31:02.218879 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:ba:3e:9c', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2026-03-16 14:31:02.219202 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:aa:23:ce', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2026-03-16 14:31:02.219373 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:e2:02:77', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2026-03-16 14:31:02.219514 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:1e:1d:c5', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2026-03-16 14:31:02.219643 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:70:3b:a3', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2026-03-16 14:31:02.219768 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:26:05:5f', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2026-03-16 14:31:02.219885 | controller |
2026-03-16 14:31:02.220010 | controller | TASK [dnsmasq : Ensure networks exists] ****************************************
2026-03-16 14:31:02.220163 | controller | Monday 16 March 2026  14:31:02 +0000 (0:00:00.096)       0:01:18.638 **********
2026-03-16 14:31:02.271298 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk)
2026-03-16 14:31:02.271506 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public)
2026-03-16 14:31:02.271623 | controller |
2026-03-16 14:31:02.271744 | controller | TASK [dnsmasq : Check network file status] *************************************
2026-03-16 14:31:02.271860 | controller | Monday 16 March 2026  14:31:02 +0000 (0:00:00.052)       0:01:18.690 **********
2026-03-16 14:31:02.444902 | controller | ok: [instance]
2026-03-16 14:31:02.468278 | controller |
2026-03-16 14:31:02.468316 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2026-03-16 14:31:02.468326 | controller | Monday 16 March 2026  14:31:02 +0000 (0:00:00.173)       0:01:18.863 **********
2026-03-16 14:31:02.468346 | controller | ok: [instance]
2026-03-16 14:31:02.468394 | controller |
2026-03-16 14:31:02.468405 | controller | TASK [dnsmasq : Check network file status] *************************************
2026-03-16 14:31:02.468623 | controller | Monday 16 March 2026  14:31:02 +0000 (0:00:00.023)       0:01:18.887 **********
2026-03-16 14:31:02.639920 | controller | ok: [instance]
2026-03-16 14:31:02.661098 | controller |
2026-03-16 14:31:02.661135 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2026-03-16 14:31:02.661147 | controller | Monday 16 March 2026  14:31:02 +0000 (0:00:00.169)       0:01:19.057 **********
2026-03-16 14:31:02.661156 | controller | ok: [instance]
2026-03-16 14:31:02.680702 | controller |
2026-03-16 14:31:02.680725 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] ****************************
2026-03-16 14:31:02.680734 | controller | Monday 16 March 2026  14:31:02 +0000 (0:00:00.023)       0:01:19.080 **********
2026-03-16 14:31:02.680746 | controller | ok: [instance]
2026-03-16 14:31:02.850005 | controller |
2026-03-16 14:31:02.850022 | controller | TASK [dnsmasq : Compute entry] *************************************************
2026-03-16 14:31:02.850034 | controller | Monday 16 March 2026  14:31:02 +0000 (0:00:00.019)       0:01:19.099 **********
2026-03-16 14:31:02.850043 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:ba:3e:9c', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2026-03-16 14:31:02.886309 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:aa:23:ce', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2026-03-16 14:31:02.886350 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:e2:02:77', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2026-03-16 14:31:02.886379 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:1e:1d:c5', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2026-03-16 14:31:02.886390 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:70:3b:a3', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2026-03-16 14:31:02.886400 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:26:05:5f', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2026-03-16 14:31:02.886410 | controller |
2026-03-16 14:31:02.886421 | controller | TASK [dnsmasq : Create add/remove sets] ****************************************
2026-03-16 14:31:02.886432 | controller | Monday 16 March 2026  14:31:02 +0000 (0:00:00.169)       0:01:19.268 **********
2026-03-16 14:31:02.886448 | controller | ok: [instance]
2026-03-16 14:31:02.886459 | controller |
2026-03-16 14:31:02.886473 | controller | TASK [dnsmasq : Add DHCP entries] **********************************************
2026-03-16 14:31:04.837857 | controller | Monday 16 March 2026  14:31:02 +0000 (0:00:00.036)       0:01:19.305 **********
2026-03-16 14:31:04.837895 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:ba:3e:9c', 'entry': 'set:compute,52:54:00:ba:3e:9c,192.168.140.100,compute-0', 'state': 'present'})
2026-03-16 14:31:04.860618 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:aa:23:ce', 'entry': 'set:controller,52:54:01:aa:23:ce,192.168.140.9,controller-0', 'state': 'present'})
2026-03-16 14:31:04.860639 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:e2:02:77', 'entry': 'set:ocp,52:54:02:e2:02:77,192.168.140.10,crc-0', 'state': 'present'})
2026-03-16 14:31:04.860648 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:1e:1d:c5', 'entry': 'set:compute,52:54:00:1e:1d:c5,192.168.101.100,compute-0', 'state': 'present'})
2026-03-16 14:31:04.860655 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:70:3b:a3', 'entry': 'set:controller,52:54:01:70:3b:a3,192.168.101.9,controller-0', 'state': 'present'})
2026-03-16 14:31:04.860661 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:26:05:5f', 'entry': 'set:ocp,52:54:02:26:05:5f,192.168.101.10,crc-0', 'state': 'present'})
2026-03-16 14:31:04.860668 | controller |
2026-03-16 14:31:04.860674 | controller | TASK [dnsmasq : Remove DHCP entries] *******************************************
2026-03-16 14:31:04.860681 | controller | Monday 16 March 2026  14:31:04 +0000 (0:00:01.950)       0:01:21.256 **********
2026-03-16 14:31:04.860690 | controller | skipping: [instance]
2026-03-16 14:31:05.067291 | controller |
2026-03-16 14:31:05.067319 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] ***********
2026-03-16 14:31:05.067327 | controller | Monday 16 March 2026  14:31:04 +0000 (0:00:00.023)       0:01:21.279 **********
2026-03-16 14:31:05.067353 | controller | ok: [instance] => (item=compute-0)
2026-03-16 14:31:05.067381 | controller | ok: [instance] => (item=controller-0)
2026-03-16 14:31:05.067393 | controller | ok: [instance] => (item=crc-0)
2026-03-16 14:31:05.067679 | controller |
2026-03-16 14:31:05.180968 | controller | TASK [Inject VMs in the .utility zone] *****************************************
2026-03-16 14:31:05.180997 | controller | Monday 16 March 2026  14:31:05 +0000 (0:00:00.206)       0:01:21.486 **********
2026-03-16 14:31:05.181014 | controller |
2026-03-16 14:31:05.223356 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-16 14:31:05.223405 | controller | Monday 16 March 2026  14:31:05 +0000 (0:00:00.113)       0:01:21.600 **********
2026-03-16 14:31:05.223426 | controller | ok: [instance]
2026-03-16 14:31:05.223471 | controller |
2026-03-16 14:31:05.223486 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-16 14:31:05.223558 | controller | Monday 16 March 2026  14:31:05 +0000 (0:00:00.042)       0:01:21.642 **********
2026-03-16 14:31:05.443263 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-16 14:31:05.443376 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-16 14:31:05.443397 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-16 14:31:05.443408 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-16 14:31:05.443418 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-16 14:31:05.443428 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-16 14:31:05.443438 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-16 14:31:05.443458 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 14:31:05.443474 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 14:31:05.443585 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-16 14:31:05.443610 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-16 14:31:05.443671 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-16 14:31:05.443784 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-16 14:31:05.443867 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-16 14:31:05.443979 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-16 14:31:05.444059 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-16 14:31:05.444161 | controller |
2026-03-16 14:31:05.444268 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-16 14:31:05.444372 | controller | Monday 16 March 2026  14:31:05 +0000 (0:00:00.219)       0:01:21.861 **********
2026-03-16 14:31:08.408309 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-16 14:31:08.408408 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-16 14:31:08.408425 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-16 14:31:08.408436 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-16 14:31:08.408451 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-16 14:31:08.408462 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-16 14:31:08.408472 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-16 14:31:08.408481 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 14:31:08.408495 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 14:31:08.408530 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-16 14:31:08.408543 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-16 14:31:08.408578 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-16 14:31:08.409216 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-16 14:31:08.735240 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-16 14:31:08.735280 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-16 14:31:08.735291 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-16 14:31:08.735300 | controller |
2026-03-16 14:31:08.735309 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-16 14:31:08.735329 | controller | Monday 16 March 2026  14:31:08 +0000 (0:00:02.965)       0:01:24.827 **********
2026-03-16 14:31:08.735343 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-16 14:31:08.735379 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-16 14:31:08.735411 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-16 14:31:08.736247 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-16 14:31:08.736311 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-16 14:31:08.736343 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-16 14:31:08.736355 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-16 14:31:08.736365 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 14:31:08.736381 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 14:31:08.736391 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-16 14:31:08.736401 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-16 14:31:08.736414 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-16 14:31:08.736454 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-16 14:31:08.736876 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-16 14:31:08.736905 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-16 14:31:08.771615 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-16 14:31:08.771636 | controller |
2026-03-16 14:31:08.771643 | controller | TASK [dnsmasq : Remove crc.testing from host_records] **************************
2026-03-16 14:31:08.771650 | controller | Monday 16 March 2026  14:31:08 +0000 (0:00:00.327)       0:01:25.154 **********
2026-03-16 14:31:08.771658 | controller | skipping: [instance]
2026-03-16 14:31:08.791242 | controller |
2026-03-16 14:31:08.791262 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] ****************
2026-03-16 14:31:08.791271 | controller | Monday 16 March 2026  14:31:08 +0000 (0:00:00.036)       0:01:25.190 **********
2026-03-16 14:31:08.791281 | controller | ok: [instance]
2026-03-16 14:31:08.791462 | controller |
2026-03-16 14:31:08.791629 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] **************
2026-03-16 14:31:08.791785 | controller | Monday 16 March 2026  14:31:08 +0000 (0:00:00.019)       0:01:25.210 **********
2026-03-16 14:31:08.836173 | controller | skipping: [instance] => (item=compute)
2026-03-16 14:31:08.836378 | controller | skipping: [instance] => (item=controller)
2026-03-16 14:31:08.836544 | controller | skipping: [instance] => (item=crc)
2026-03-16 14:31:08.836706 | controller | skipping: [instance]
2026-03-16 14:31:08.836827 | controller |
2026-03-16 14:31:08.836954 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] *******
2026-03-16 14:31:08.837078 | controller | Monday 16 March 2026  14:31:08 +0000 (0:00:00.045)       0:01:25.255 **********
2026-03-16 14:31:08.869160 | controller | skipping: [instance]
2026-03-16 14:31:08.869360 | controller |
2026-03-16 14:31:08.869531 | controller | TASK [libvirt_manager : Ensure some domains are local] *************************
2026-03-16 14:31:08.869692 | controller | Monday 16 March 2026  14:31:08 +0000 (0:00:00.032)       0:01:25.288 **********
2026-03-16 14:31:09.229223 | controller | changed: [instance]
2026-03-16 14:31:09.837797 | controller |
2026-03-16 14:31:09.837830 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************
2026-03-16 14:31:09.837838 | controller | Monday 16 March 2026  14:31:09 +0000 (0:00:00.348)       0:01:25.636 **********
2026-03-16 14:31:09.837844 | controller |
2026-03-16 14:31:09.837849 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2026-03-16 14:31:09.837854 | controller | Monday 16 March 2026  14:31:09 +0000 (0:00:00.011)       0:01:25.647 **********
2026-03-16 14:31:09.837868 | controller | changed: [instance]
2026-03-16 14:31:10.190612 | controller |
2026-03-16 14:31:10.190645 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-16 14:31:10.190654 | controller | Monday 16 March 2026  14:31:09 +0000 (0:00:00.608)       0:01:26.256 **********
2026-03-16 14:31:10.190664 | controller | changed: [instance]
2026-03-16 14:31:10.528390 | controller |
2026-03-16 14:31:10.528431 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] *************************************
2026-03-16 14:31:10.528446 | controller | Monday 16 March 2026  14:31:10 +0000 (0:00:00.352)       0:01:26.609 **********
2026-03-16 14:31:10.528457 | controller | changed: [instance]
2026-03-16 14:31:10.528475 | controller |
2026-03-16 14:31:10.528483 | controller | TASK [reproducer : Delegate our domains to our own instance] *******************
2026-03-16 14:31:10.528609 | controller | Monday 16 March 2026  14:31:10 +0000 (0:00:00.338)       0:01:26.947 **********
2026-03-16 14:31:10.886197 | controller | changed: [instance]
2026-03-16 14:31:11.246220 | controller |
2026-03-16 14:31:11.246256 | controller | TASK [reproducer : Ensure "utility" domain is local] ***************************
2026-03-16 14:31:11.246266 | controller | Monday 16 March 2026  14:31:10 +0000 (0:00:00.357)       0:01:27.305 **********
2026-03-16 14:31:11.246279 | controller | changed: [instance]
2026-03-16 14:31:11.246325 | controller |
2026-03-16 14:31:11.246515 | controller | TASK [Build utility records dataset] *******************************************
2026-03-16 14:31:11.283731 | controller | Monday 16 March 2026  14:31:11 +0000 (0:00:00.360)       0:01:27.665 **********
2026-03-16 14:31:11.283758 | controller |
2026-03-16 14:31:11.375645 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-16 14:31:11.375713 | controller | Monday 16 March 2026  14:31:11 +0000 (0:00:00.037)       0:01:27.703 **********
2026-03-16 14:31:11.375731 | controller | ok: [instance]
2026-03-16 14:31:11.375777 | controller |
2026-03-16 14:31:11.375790 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-16 14:31:11.469272 | controller | Monday 16 March 2026  14:31:11 +0000 (0:00:00.090)       0:01:27.793 **********
2026-03-16 14:31:11.469297 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-16 14:31:11.469335 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 14:31:11.469816 | controller |
2026-03-16 14:31:11.919789 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-16 14:31:11.919822 | controller | Monday 16 March 2026  14:31:11 +0000 (0:00:00.094)       0:01:27.888 **********
2026-03-16 14:31:11.919836 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-16 14:31:12.190969 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 14:31:12.190996 | controller |
2026-03-16 14:31:12.191003 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-16 14:31:12.191009 | controller | Monday 16 March 2026  14:31:11 +0000 (0:00:00.450)       0:01:28.338 **********
2026-03-16 14:31:12.191019 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-16 14:31:12.239279 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 14:31:12.239324 | controller |
2026-03-16 14:31:12.239332 | controller | TASK [dnsmasq : Remove crc.testing from host_records] **************************
2026-03-16 14:31:12.239338 | controller | Monday 16 March 2026  14:31:12 +0000 (0:00:00.271)       0:01:28.610 **********
2026-03-16 14:31:12.239348 | controller | skipping: [instance]
2026-03-16 14:31:12.239373 | controller |
2026-03-16 14:31:12.239381 | controller | TASK [reproducer : Flush handlers] *********************************************
2026-03-16 14:31:12.239672 | controller | Monday 16 March 2026  14:31:12 +0000 (0:00:00.037)       0:01:28.648 **********
2026-03-16 14:31:12.696432 | controller |
2026-03-16 14:31:12.696476 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-16 14:31:12.696485 | controller | Monday 16 March 2026  14:31:12 +0000 (0:00:00.010)       0:01:28.658 **********
2026-03-16 14:31:12.696497 | controller | changed: [instance]
2026-03-16 14:31:13.038231 | controller |
2026-03-16 14:31:13.038279 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-16 14:31:13.038287 | controller | Monday 16 March 2026  14:31:12 +0000 (0:00:00.456)       0:01:29.115 **********
2026-03-16 14:31:13.038307 | controller | changed: [instance]
2026-03-16 14:31:13.038330 | controller |
2026-03-16 14:31:13.038338 | controller | TASK [reproducer : Bootstrap nat64 if needed] **********************************
2026-03-16 14:31:13.038401 | controller | Monday 16 March 2026  14:31:13 +0000 (0:00:00.342)       0:01:29.457 **********
2026-03-16 14:31:13.070258 | controller | skipping: [instance]
2026-03-16 14:31:13.070378 | controller |
2026-03-16 14:31:13.070482 | controller | TASK [reproducer : Deploy CRC if needed] ***************************************
2026-03-16 14:31:13.070507 | controller | Monday 16 March 2026  14:31:13 +0000 (0:00:00.032)       0:01:29.489 **********
2026-03-16 14:31:13.147079 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance
2026-03-16 14:31:13.360218 | controller |
2026-03-16 14:31:13.360242 | controller | TASK [reproducer : Check for CRC availability in known path] *******************
2026-03-16 14:31:13.360254 | controller | Monday 16 March 2026  14:31:13 +0000 (0:00:00.076)       0:01:29.566 **********
2026-03-16 14:31:13.360264 | controller | ok: [instance]
2026-03-16 14:31:13.390285 | controller |
2026-03-16 14:31:13.390337 | controller | TASK [Deploy CRC if needed] ****************************************************
2026-03-16 14:31:13.390352 | controller | Monday 16 March 2026  14:31:13 +0000 (0:00:00.212)       0:01:29.779 **********
2026-03-16 14:31:13.390370 | controller | skipping: [instance]
2026-03-16 14:31:13.708589 | controller |
2026-03-16 14:31:13.708620 | controller | TASK [rhol_crc : Stop CRC VM] **************************************************
2026-03-16 14:31:13.708628 | controller | Monday 16 March 2026  14:31:13 +0000 (0:00:00.030)       0:01:29.809 **********
2026-03-16 14:31:13.708638 | controller | ok: [instance]
2026-03-16 14:31:13.934629 | controller |
2026-03-16 14:31:13.934659 | controller | TASK [rhol_crc : Undefine CRC VM] **********************************************
2026-03-16 14:31:13.934667 | controller | Monday 16 March 2026  14:31:13 +0000 (0:00:00.318)       0:01:30.127 **********
2026-03-16 14:31:13.934677 | controller | ok: [instance]
2026-03-16 14:31:14.144950 | controller |
2026-03-16 14:31:14.144982 | controller | TASK [rhol_crc : Destroy CRC network] ******************************************
2026-03-16 14:31:14.144990 | controller | Monday 16 March 2026  14:31:13 +0000 (0:00:00.225)       0:01:30.353 **********
2026-03-16 14:31:14.145000 | controller | ok: [instance]
2026-03-16 14:31:14.356432 | controller |
2026-03-16 14:31:14.356461 | controller | TASK [rhol_crc : Undefine CRC network] *****************************************
2026-03-16 14:31:14.356468 | controller | Monday 16 March 2026  14:31:14 +0000 (0:00:00.210)       0:01:30.564 **********
2026-03-16 14:31:14.356478 | controller | ok: [instance]
2026-03-16 14:31:14.577852 | controller |
2026-03-16 14:31:14.577891 | controller | TASK [rhol_crc : Destroy default network] **************************************
2026-03-16 14:31:14.577899 | controller | Monday 16 March 2026  14:31:14 +0000 (0:00:00.211)       0:01:30.775 **********
2026-03-16 14:31:14.577910 | controller | ok: [instance]
2026-03-16 14:31:14.617556 | controller |
2026-03-16 14:31:14.617585 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-16 14:31:14.617594 | controller | Monday 16 March 2026  14:31:14 +0000 (0:00:00.221)       0:01:30.996 **********
2026-03-16 14:31:14.617605 | controller |
2026-03-16 14:31:14.806692 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2026-03-16 14:31:14.806719 | controller | Monday 16 March 2026  14:31:14 +0000 (0:00:00.040)       0:01:31.036 **********
2026-03-16 14:31:14.806731 | controller | ok: [instance]
2026-03-16 14:31:14.829924 | controller |
2026-03-16 14:31:14.829947 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2026-03-16 14:31:14.829955 | controller | Monday 16 March 2026  14:31:14 +0000 (0:00:00.189)       0:01:31.225 **********
2026-03-16 14:31:14.829964 | controller | ok: [instance]
2026-03-16 14:31:14.857232 | controller |
2026-03-16 14:31:14.857252 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2026-03-16 14:31:14.857259 | controller | Monday 16 March 2026  14:31:14 +0000 (0:00:00.023)       0:01:31.249 **********
2026-03-16 14:31:14.857273 | controller | skipping: [instance]
2026-03-16 14:31:15.133747 | controller |
2026-03-16 14:31:15.133779 | controller | TASK [reproducer : Slurp ssh key for CRC access] *******************************
2026-03-16 14:31:15.133787 | controller | Monday 16 March 2026  14:31:14 +0000 (0:00:00.027)       0:01:31.276 **********
2026-03-16 14:31:15.133796 | controller | ok: [instance]
2026-03-16 14:31:15.348716 | controller |
2026-03-16 14:31:15.348742 | controller | TASK [reproducer : Get kubeconfig file from crc directory] *********************
2026-03-16 14:31:15.348750 | controller | Monday 16 March 2026  14:31:15 +0000 (0:00:00.276)       0:01:31.552 **********
2026-03-16 14:31:15.348759 | controller | ok: [instance]
2026-03-16 14:31:15.515560 | controller |
2026-03-16 14:31:15.515580 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] *************
2026-03-16 14:31:15.515587 | controller | Monday 16 March 2026  14:31:15 +0000 (0:00:00.215)       0:01:31.768 **********
2026-03-16 14:31:15.515595 | controller | ok: [instance]
2026-03-16 14:31:15.571814 | controller |
2026-03-16 14:31:15.571834 | controller | TASK [Ensure we expose openshift_login related facts] **************************
2026-03-16 14:31:15.571843 | controller | Monday 16 March 2026  14:31:15 +0000 (0:00:00.166)       0:01:31.935 **********
2026-03-16 14:31:15.571853 | controller |
2026-03-16 14:31:15.615838 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-03-16 14:31:15.615854 | controller | Monday 16 March 2026  14:31:15 +0000 (0:00:00.056)       0:01:31.991 **********
2026-03-16 14:31:15.615867 | controller | ok: [instance] => changed=false
2026-03-16 14:31:15.787268 | controller |   msg: All assertions passed
2026-03-16 14:31:15.787318 | controller |
2026-03-16 14:31:15.787328 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-03-16 14:31:15.787341 | controller | Monday 16 March 2026  14:31:15 +0000 (0:00:00.043)       0:01:32.034 **********
2026-03-16 14:31:15.787353 | controller | ok: [instance]
2026-03-16 14:31:15.787381 | controller |
2026-03-16 14:31:15.787390 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-03-16 14:31:15.787572 | controller | Monday 16 March 2026  14:31:15 +0000 (0:00:00.171)       0:01:32.206 **********
2026-03-16 14:31:15.969268 | controller | ok: [instance]
2026-03-16 14:31:15.969333 | controller |
2026-03-16 14:31:15.969345 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-03-16 14:31:15.969412 | controller | Monday 16 March 2026  14:31:15 +0000 (0:00:00.181)       0:01:32.388 **********
2026-03-16 14:31:15.993024 | controller | ok: [instance] => changed=false
2026-03-16 14:31:16.174212 | controller |   msg: All assertions passed
2026-03-16 14:31:16.174235 | controller |
2026-03-16 14:31:16.174245 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-03-16 14:31:16.174252 | controller | Monday 16 March 2026  14:31:15 +0000 (0:00:00.024)       0:01:32.412 **********
2026-03-16 14:31:16.174263 | controller | ok: [instance]
2026-03-16 14:31:16.174304 | controller |
2026-03-16 14:31:16.174484 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-03-16 14:31:16.346648 | controller | Monday 16 March 2026  14:31:16 +0000 (0:00:00.181)       0:01:32.593 **********
2026-03-16 14:31:16.346687 | controller | ok: [instance]
2026-03-16 14:31:16.395193 | controller |
2026-03-16 14:31:16.395222 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-03-16 14:31:16.395231 | controller | Monday 16 March 2026  14:31:16 +0000 (0:00:00.172)       0:01:32.765 **********
2026-03-16 14:31:16.395242 | controller | ok: [instance]
2026-03-16 14:31:16.395268 | controller |
2026-03-16 14:31:16.395532 | controller | TASK [reproducer : Remove CRC managed zone delegation] *************************
2026-03-16 14:31:16.758629 | controller | Monday 16 March 2026  14:31:16 +0000 (0:00:00.048)       0:01:32.814 **********
2026-03-16 14:31:16.758658 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf)
2026-03-16 14:31:16.777299 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf)
2026-03-16 14:31:16.777319 | controller |
2026-03-16 14:31:16.777328 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************
2026-03-16 14:31:16.777335 | controller | Monday 16 March 2026  14:31:16 +0000 (0:00:00.363)       0:01:33.177 **********
2026-03-16 14:31:16.777345 | controller | skipping: [instance]
2026-03-16 14:31:16.800266 | controller |
2026-03-16 14:31:16.800321 | controller | TASK [Load the architecture local kustomize patches] ***************************
2026-03-16 14:31:16.800332 | controller | Monday 16 March 2026  14:31:16 +0000 (0:00:00.018)       0:01:33.196 **********
2026-03-16 14:31:16.800346 | controller | skipping: [instance]
2026-03-16 14:31:16.800380 | controller |
2026-03-16 14:31:16.800392 | controller | TASK [reproducer : Consume libvirt_manager] ************************************
2026-03-16 14:31:16.800423 | controller | Monday 16 March 2026  14:31:16 +0000 (0:00:00.023)       0:01:33.219 **********
2026-03-16 14:31:16.922648 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance
2026-03-16 14:31:16.945152 | controller |
2026-03-16 14:31:16.945169 | controller | TASK [libvirt_manager : Import layout generator if needed] *********************
2026-03-16 14:31:16.945176 | controller | Monday 16 March 2026  14:31:16 +0000 (0:00:00.122)       0:01:33.341 **********
2026-03-16 14:31:16.945185 | controller | skipping: [instance]
2026-03-16 14:31:17.334223 | controller |
2026-03-16 14:31:17.334257 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] *****************
2026-03-16 14:31:17.334267 | controller | Monday 16 March 2026  14:31:16 +0000 (0:00:00.022)       0:01:33.364 **********
2026-03-16 14:31:17.334287 | controller | changed: [instance]
2026-03-16 14:31:17.334315 | controller |
2026-03-16 14:31:17.334325 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] ****************
2026-03-16 14:31:17.334350 | controller | Monday 16 March 2026  14:31:17 +0000 (0:00:00.389)       0:01:33.753 **********
2026-03-16 14:31:17.827714 | controller | changed: [instance]
2026-03-16 14:31:17.827815 | controller |
2026-03-16 14:31:17.827929 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] **************************
2026-03-16 14:31:17.828036 | controller | Monday 16 March 2026  14:31:17 +0000 (0:00:00.482)       0:01:34.236 **********
2026-03-16 14:31:17.828144 | controller |
2026-03-16 14:31:17.828283 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-16 14:31:17.828388 | controller | Monday 16 March 2026  14:31:17 +0000 (0:00:00.010)       0:01:34.247 **********
2026-03-16 14:31:18.255260 | controller | changed: [instance]
2026-03-16 14:31:18.885493 | controller |
2026-03-16 14:31:18.885523 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2026-03-16 14:31:18.885534 | controller | Monday 16 March 2026  14:31:18 +0000 (0:00:00.427)       0:01:34.674 **********
2026-03-16 14:31:18.885545 | controller | changed: [instance]
2026-03-16 14:31:18.916297 | controller |
2026-03-16 14:31:18.916314 | controller | TASK [Deploy virtualbmc] *******************************************************
2026-03-16 14:31:18.916321 | controller | Monday 16 March 2026  14:31:18 +0000 (0:00:00.630)       0:01:35.304 **********
2026-03-16 14:31:18.916330 | controller | skipping: [instance]
2026-03-16 14:31:18.947463 | controller |
2026-03-16 14:31:18.947480 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] ***********
2026-03-16 14:31:18.947487 | controller | Monday 16 March 2026  14:31:18 +0000 (0:00:00.031)       0:01:35.335 **********
2026-03-16 14:31:18.947496 | controller | skipping: [instance]
2026-03-16 14:31:19.458199 | controller |
2026-03-16 14:31:19.458231 | controller | TASK [libvirt_manager : Create needed workload directory] **********************
2026-03-16 14:31:19.458239 | controller | Monday 16 March 2026  14:31:18 +0000 (0:00:00.031)       0:01:35.366 **********
2026-03-16 14:31:19.458250 | controller | changed: [instance] => (item=workload)
2026-03-16 14:31:19.458285 | controller | changed: [instance] => (item=reproducer-inventory)
2026-03-16 14:31:19.458295 | controller | ok: [instance] => (item=volumes)
2026-03-16 14:31:19.458573 | controller |
2026-03-16 14:31:19.837888 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] **********************
2026-03-16 14:31:19.837922 | controller | Monday 16 March 2026  14:31:19 +0000 (0:00:00.510)       0:01:35.877 **********
2026-03-16 14:31:19.837934 | controller | changed: [instance] => (item=workload)
2026-03-16 14:31:19.863297 | controller | changed: [instance] => (item=volumes)
2026-03-16 14:31:19.863320 | controller |
2026-03-16 14:31:19.863328 | controller | TASK [libvirt_manager : Generate networking data] ******************************
2026-03-16 14:31:19.863335 | controller | Monday 16 March 2026  14:31:19 +0000 (0:00:00.379)       0:01:36.256 **********
2026-03-16 14:31:19.863350 | controller | skipping: [instance]
2026-03-16 14:31:20.825711 | controller |
2026-03-16 14:31:20.825741 | controller | TASK [libvirt_manager : Create group inventories] ******************************
2026-03-16 14:31:20.825748 | controller | Monday 16 March 2026  14:31:19 +0000 (0:00:00.025)       0:01:36.282 **********
2026-03-16 14:31:20.825758 | controller | changed: [instance] => (item=compute)
2026-03-16 14:31:20.856155 | controller | changed: [instance] => (item=controller)
2026-03-16 14:31:20.856180 | controller | changed: [instance] => (item=crc)
2026-03-16 14:31:20.856188 | controller |
2026-03-16 14:31:20.856194 | controller | TASK [libvirt_manager : Create "all" group inventory file] *********************
2026-03-16 14:31:20.856201 | controller | Monday 16 March 2026  14:31:20 +0000 (0:00:00.962)       0:01:37.244 **********
2026-03-16 14:31:20.856211 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance
2026-03-16 14:31:21.029191 | controller |
2026-03-16 14:31:21.029220 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] *****************
2026-03-16 14:31:21.029228 | controller | Monday 16 March 2026  14:31:20 +0000 (0:00:00.030)       0:01:37.275 **********
2026-03-16 14:31:21.029238 | controller | ok: [instance]
2026-03-16 14:31:21.029260 | controller |
2026-03-16 14:31:21.029278 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] *************
2026-03-16 14:31:21.029383 | controller | Monday 16 March 2026  14:31:21 +0000 (0:00:00.172)       0:01:37.448 **********
2026-03-16 14:31:21.048823 | controller | skipping: [instance]
2026-03-16 14:31:21.408600 | controller |
2026-03-16 14:31:21.408629 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] ***
2026-03-16 14:31:21.408637 | controller | Monday 16 March 2026  14:31:21 +0000 (0:00:00.019)       0:01:37.467 **********
2026-03-16 14:31:21.408647 | controller | changed: [instance]
2026-03-16 14:31:21.428547 | controller |
2026-03-16 14:31:21.428570 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] *********************
2026-03-16 14:31:21.428578 | controller | Monday 16 March 2026  14:31:21 +0000 (0:00:00.359)       0:01:37.827 **********
2026-03-16 14:31:21.428587 | controller | skipping: [instance]
2026-03-16 14:31:21.448216 | controller |
2026-03-16 14:31:21.448240 | controller | TASK [libvirt_manager : Write merged all-group.yml] ****************************
2026-03-16 14:31:21.448250 | controller | Monday 16 March 2026  14:31:21 +0000 (0:00:00.020)       0:01:37.847 **********
2026-03-16 14:31:21.448261 | controller | skipping: [instance]
2026-03-16 14:31:21.448300 | controller |
2026-03-16 14:31:21.448309 | controller | TASK [libvirt_manager : Ensure storage pool is present.] ***********************
2026-03-16 14:31:21.448318 | controller | Monday 16 March 2026  14:31:21 +0000 (0:00:00.019)       0:01:37.867 **********
2026-03-16 14:31:21.487246 | controller | skipping: [instance]
2026-03-16 14:31:21.487284 | controller |
2026-03-16 14:31:21.487293 | controller | TASK [libvirt_manager : Ensure images are present] *****************************
2026-03-16 14:31:21.487303 | controller | Monday 16 March 2026  14:31:21 +0000 (0:00:00.038)       0:01:37.906 **********
2026-03-16 14:31:21.553238 | controller | skipping: [instance] => (item=crc)
2026-03-16 14:31:21.553514 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute)
2026-03-16 14:31:21.553530 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller)
2026-03-16 14:31:21.553540 | controller |
2026-03-16 14:31:21.755235 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2026-03-16 14:31:21.755280 | controller | Monday 16 March 2026  14:31:21 +0000 (0:00:00.065)       0:01:37.972 **********
2026-03-16 14:31:21.755298 | controller | changed: [instance]
2026-03-16 14:31:21.929086 | controller |
2026-03-16 14:31:21.929133 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2026-03-16 14:31:21.929144 | controller | Monday 16 March 2026  14:31:21 +0000 (0:00:00.201)       0:01:38.174 **********
2026-03-16 14:31:21.929154 | controller | ok: [instance]
2026-03-16 14:31:53.236767 | controller |
2026-03-16 14:31:53.236799 | controller | TASK [libvirt_manager : Download base image] ***********************************
2026-03-16 14:31:53.236816 | controller | Monday 16 March 2026  14:31:21 +0000 (0:00:00.173)       0:01:38.348 **********
2026-03-16 14:31:53.236826 | controller | changed: [instance]
2026-03-16 14:31:53.423182 | controller |
2026-03-16 14:31:53.423221 | controller | TASK [libvirt_manager : Check image] *******************************************
2026-03-16 14:31:53.423229 | controller | Monday 16 March 2026  14:31:53 +0000 (0:00:31.307)       0:02:09.656 **********
2026-03-16 14:31:53.423241 | controller | ok: [instance]
2026-03-16 14:31:53.463311 | controller |
2026-03-16 14:31:53.463344 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2026-03-16 14:31:53.463352 | controller | Monday 16 March 2026  14:31:53 +0000 (0:00:00.186)       0:02:09.842 **********
2026-03-16 14:31:53.463362 | controller | ok: [instance] => changed=false
2026-03-16 14:31:53.463387 | controller |   msg: All assertions passed
2026-03-16 14:31:53.463471 | controller |
2026-03-16 14:31:53.463689 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2026-03-16 14:31:53.664501 | controller | Monday 16 March 2026  14:31:53 +0000 (0:00:00.040)       0:02:09.882 **********
2026-03-16 14:31:53.664535 | controller | changed: [instance]
2026-03-16 14:31:53.870026 | controller |
2026-03-16 14:31:53.870056 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2026-03-16 14:31:53.870064 | controller | Monday 16 March 2026  14:31:53 +0000 (0:00:00.200)       0:02:10.083 **********
2026-03-16 14:31:53.870075 | controller | ok: [instance]
2026-03-16 14:31:54.065875 | controller |
2026-03-16 14:31:54.065907 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2026-03-16 14:31:54.065917 | controller | Monday 16 March 2026  14:31:53 +0000 (0:00:00.205)       0:02:10.289 **********
2026-03-16 14:31:54.065929 | controller | ok: [instance]
2026-03-16 14:31:54.088631 | controller |
2026-03-16 14:31:54.088653 | controller | TASK [libvirt_manager : Download base image] ***********************************
2026-03-16 14:31:54.088662 | controller | Monday 16 March 2026  14:31:54 +0000 (0:00:00.195)       0:02:10.484 **********
2026-03-16 14:31:54.088673 | controller | skipping: [instance]
2026-03-16 14:31:54.290160 | controller |
2026-03-16 14:31:54.290185 | controller | TASK [libvirt_manager : Check image] *******************************************
2026-03-16 14:31:54.290194 | controller | Monday 16 March 2026  14:31:54 +0000 (0:00:00.023)       0:02:10.507 **********
2026-03-16 14:31:54.290204 | controller | ok: [instance]
2026-03-16 14:31:54.329287 | controller |
2026-03-16 14:31:54.329309 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2026-03-16 14:31:54.329318 | controller | Monday 16 March 2026  14:31:54 +0000 (0:00:00.201)       0:02:10.709 **********
2026-03-16 14:31:54.329330 | controller | ok: [instance] => changed=false
2026-03-16 14:31:54.531792 | controller |   msg: All assertions passed
2026-03-16 14:31:54.531833 | controller |
2026-03-16 14:31:54.531842 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2026-03-16 14:31:54.531850 | controller | Monday 16 March 2026  14:31:54 +0000 (0:00:00.039)       0:02:10.748 **********
2026-03-16 14:31:54.531862 | controller | ok: [instance]
2026-03-16 14:31:54.698613 | controller |
2026-03-16 14:31:54.698639 | controller | TASK [libvirt_manager : Get ssh key state] *************************************
2026-03-16 14:31:54.698648 | controller | Monday 16 March 2026  14:31:54 +0000 (0:00:00.202)       0:02:10.950 **********
2026-03-16 14:31:54.698658 | controller | ok: [instance]
2026-03-16 14:31:55.067989 | controller |
2026-03-16 14:31:55.068012 | controller | TASK [libvirt_manager : Create temporary ssh keypair] **************************
2026-03-16 14:31:55.068019 | controller | Monday 16 March 2026  14:31:54 +0000 (0:00:00.166)       0:02:11.117 **********
2026-03-16 14:31:55.068029 | controller | changed: [instance]
2026-03-16 14:31:55.233386 | controller |
2026-03-16 14:31:55.233419 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************
2026-03-16 14:31:55.233427 | controller | Monday 16 March 2026  14:31:55 +0000 (0:00:00.369)       0:02:11.487 **********
2026-03-16 14:31:55.233436 | controller | ok: [instance]
2026-03-16 14:31:55.396526 | controller |
2026-03-16 14:31:55.396552 | controller | TASK [libvirt_manager : Slurp private key for later use] ***********************
2026-03-16 14:31:55.396561 | controller | Monday 16 March 2026  14:31:55 +0000 (0:00:00.165)       0:02:11.652 **********
2026-03-16 14:31:55.396577 | controller | ok: [instance]
2026-03-16 14:31:55.772046 | controller |
2026-03-16 14:31:55.772068 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] ***
2026-03-16 14:31:55.772083 | controller | Monday 16 March 2026  14:31:55 +0000 (0:00:00.163)       0:02:11.815 **********
2026-03-16 14:31:55.772092 | controller | changed: [instance]
2026-03-16 14:31:55.791208 | controller |
2026-03-16 14:31:55.791225 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] **************
2026-03-16 14:31:55.791232 | controller | Monday 16 March 2026  14:31:55 +0000 (0:00:00.375)       0:02:12.191 **********
2026-03-16 14:31:55.791240 | controller | ok: [instance]
2026-03-16 14:31:55.791486 | controller |
2026-03-16 14:31:56.003191 | controller | TASK [libvirt_manager : List existing networks] ********************************
2026-03-16 14:31:56.003229 | controller | Monday 16 March 2026  14:31:55 +0000 (0:00:00.019)       0:02:12.210 **********
2026-03-16 14:31:56.003241 | controller | ok: [instance]
2026-03-16 14:31:56.447728 | controller |
2026-03-16 14:31:56.447756 | controller | TASK [libvirt_manager : Gather pool fact] **************************************
2026-03-16 14:31:56.447763 | controller | Monday 16 March 2026  14:31:56 +0000 (0:00:00.211)       0:02:12.422 **********
2026-03-16 14:31:56.447773 | controller | ok: [instance]
2026-03-16 14:31:56.565861 | controller |
2026-03-16 14:31:56.565885 | controller | TASK [libvirt_manager : Create and run VMs] ************************************
2026-03-16 14:31:56.565893 | controller | Monday 16 March 2026  14:31:56 +0000 (0:00:00.444)       0:02:12.866 **********
2026-03-16 14:31:56.565904 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-16 14:31:56.803830 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-16 14:31:56.803861 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-16 14:31:56.803871 | controller |
2026-03-16 14:31:56.803878 | controller | TASK [libvirt_manager : Create VM image for compute-0] *************************
2026-03-16 14:31:56.803885 | controller | Monday 16 March 2026  14:31:56 +0000 (0:00:00.118)       0:02:12.984 **********
2026-03-16 14:31:56.803897 | controller | changed: [instance]
2026-03-16 14:31:57.015064 | controller |
2026-03-16 14:31:57.015094 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ********
2026-03-16 14:31:57.015103 | controller | Monday 16 March 2026  14:31:56 +0000 (0:00:00.238)       0:02:13.223 **********
2026-03-16 14:31:57.015145 | controller | changed: [instance]
2026-03-16 14:31:57.325242 | controller |
2026-03-16 14:31:57.325275 | controller | TASK [libvirt_manager : Define VMs for type compute-0] *************************
2026-03-16 14:31:57.325284 | controller | Monday 16 March 2026  14:31:57 +0000 (0:00:00.211)       0:02:13.434 **********
2026-03-16 14:31:57.325296 | controller | changed: [instance]
2026-03-16 14:31:57.325322 | controller |
2026-03-16 14:31:57.325425 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] ***********
2026-03-16 14:31:57.325442 | controller | Monday 16 March 2026  14:31:57 +0000 (0:00:00.310)       0:02:13.744 **********
2026-03-16 14:31:57.353728 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-16 14:31:57.397319 | controller |
2026-03-16 14:31:57.397368 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-16 14:31:57.397383 | controller | Monday 16 March 2026  14:31:57 +0000 (0:00:00.028)       0:02:13.773 **********
2026-03-16 14:31:57.397401 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-16 14:31:57.397446 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-16 14:31:57.397458 | controller |
2026-03-16 14:31:57.397480 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-16 14:31:57.613564 | controller | Monday 16 March 2026  14:31:57 +0000 (0:00:00.043)       0:02:13.816 **********
2026-03-16 14:31:57.613592 | controller | ok: [instance]
2026-03-16 14:31:57.656871 | controller |
2026-03-16 14:31:57.656892 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-16 14:31:57.656901 | controller | Monday 16 March 2026  14:31:57 +0000 (0:00:00.216)       0:02:14.032 **********
2026-03-16 14:31:57.656912 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 14:31:57.877294 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 14:31:57.877329 | controller |
2026-03-16 14:31:57.877343 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-16 14:31:57.877353 | controller | Monday 16 March 2026  14:31:57 +0000 (0:00:00.043)       0:02:14.076 **********
2026-03-16 14:31:57.877369 | controller | ok: [instance]
2026-03-16 14:31:57.877411 | controller |
2026-03-16 14:31:57.877425 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-16 14:31:57.877517 | controller | Monday 16 March 2026  14:31:57 +0000 (0:00:00.220)       0:02:14.296 **********
2026-03-16 14:31:58.065543 | controller | ok: [instance]
2026-03-16 14:31:58.332873 | controller |
2026-03-16 14:31:58.332904 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************
2026-03-16 14:31:58.332912 | controller | Monday 16 March 2026  14:31:58 +0000 (0:00:00.188)       0:02:14.484 **********
2026-03-16 14:31:58.332922 | controller | changed: [instance]
2026-03-16 14:31:58.565647 | controller |
2026-03-16 14:31:58.565682 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-16 14:31:58.565691 | controller | Monday 16 March 2026  14:31:58 +0000 (0:00:00.267)       0:02:14.752 **********
2026-03-16 14:31:58.565705 | controller | ok: [instance]
2026-03-16 14:31:58.608902 | controller |
2026-03-16 14:31:58.608925 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-16 14:31:58.608932 | controller | Monday 16 March 2026  14:31:58 +0000 (0:00:00.232)       0:02:14.984 **********
2026-03-16 14:31:58.608942 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 14:31:58.832225 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 14:31:58.832274 | controller |
2026-03-16 14:31:58.832285 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-16 14:31:58.832293 | controller | Monday 16 March 2026  14:31:58 +0000 (0:00:00.043)       0:02:15.028 **********
2026-03-16 14:31:58.832306 | controller | ok: [instance]
2026-03-16 14:31:59.029626 | controller |
2026-03-16 14:31:59.029659 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-16 14:31:59.029666 | controller | Monday 16 March 2026  14:31:58 +0000 (0:00:00.223)       0:02:15.251 **********
2026-03-16 14:31:59.029676 | controller | ok: [instance]
2026-03-16 14:31:59.304865 | controller |
2026-03-16 14:31:59.304895 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] *********
2026-03-16 14:31:59.304903 | controller | Monday 16 March 2026  14:31:59 +0000 (0:00:00.197)       0:02:15.448 **********
2026-03-16 14:31:59.304914 | controller | changed: [instance]
2026-03-16 14:31:59.324837 | controller |
2026-03-16 14:31:59.324856 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] *****
2026-03-16 14:31:59.324864 | controller | Monday 16 March 2026  14:31:59 +0000 (0:00:00.275)       0:02:15.724 **********
2026-03-16 14:31:59.324873 | controller | skipping: [instance]
2026-03-16 14:31:59.350571 | controller |
2026-03-16 14:31:59.350589 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ********
2026-03-16 14:31:59.350597 | controller | Monday 16 March 2026  14:31:59 +0000 (0:00:00.020)       0:02:15.744 **********
2026-03-16 14:31:59.350606 | controller | skipping: [instance]
2026-03-16 14:31:59.378690 | controller |
2026-03-16 14:31:59.378716 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] **************
2026-03-16 14:31:59.378725 | controller | Monday 16 March 2026  14:31:59 +0000 (0:00:00.025)       0:02:15.769 **********
2026-03-16 14:31:59.378735 | controller | skipping: [instance]
2026-03-16 14:31:59.402581 | controller |
2026-03-16 14:31:59.402607 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] ***********************
2026-03-16 14:31:59.402621 | controller | Monday 16 March 2026  14:31:59 +0000 (0:00:00.027)       0:02:15.797 **********
2026-03-16 14:31:59.402631 | controller | skipping: [instance]
2026-03-16 14:31:59.606657 | controller |
2026-03-16 14:31:59.606688 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-16 14:31:59.606696 | controller | Monday 16 March 2026  14:31:59 +0000 (0:00:00.023)       0:02:15.821 **********
2026-03-16 14:31:59.606706 | controller | changed: [instance]
2026-03-16 14:31:59.645440 | controller |
2026-03-16 14:31:59.645465 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-16 14:31:59.645474 | controller | Monday 16 March 2026  14:31:59 +0000 (0:00:00.203)       0:02:16.025 **********
2026-03-16 14:31:59.645485 | controller | ok: [instance]
2026-03-16 14:31:59.699476 | controller |
2026-03-16 14:31:59.699494 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-16 14:31:59.699500 | controller | Monday 16 March 2026  14:31:59 +0000 (0:00:00.038)       0:02:16.064 **********
2026-03-16 14:31:59.699512 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2026-03-16 14:31:59.891259 | controller |
2026-03-16 14:31:59.891292 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2026-03-16 14:31:59.891302 | controller | Monday 16 March 2026  14:31:59 +0000 (0:00:00.054)       0:02:16.118 **********
2026-03-16 14:31:59.891315 | controller | ok: [instance]
2026-03-16 14:31:59.891343 | controller |
2026-03-16 14:31:59.891353 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2026-03-16 14:31:59.891403 | controller | Monday 16 March 2026  14:31:59 +0000 (0:00:00.191)       0:02:16.310 **********
2026-03-16 14:31:59.953987 | controller | ok: [instance]
2026-03-16 14:31:59.999261 | controller |
2026-03-16 14:31:59.999296 | controller | TASK [libvirt_manager : Define the user data] **********************************
2026-03-16 14:31:59.999306 | controller | Monday 16 March 2026  14:31:59 +0000 (0:00:00.062)       0:02:16.372 **********
2026-03-16 14:31:59.999319 | controller | ok: [instance]
2026-03-16 14:32:00.041787 | controller |
2026-03-16 14:32:00.041818 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2026-03-16 14:32:00.041828 | controller | Monday 16 March 2026  14:31:59 +0000 (0:00:00.045)       0:02:16.418 **********
2026-03-16 14:32:00.041841 | controller | skipping: [instance]
2026-03-16 14:32:00.083846 | controller |
2026-03-16 14:32:00.083865 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2026-03-16 14:32:00.083877 | controller | Monday 16 March 2026  14:32:00 +0000 (0:00:00.042)       0:02:16.461 **********
2026-03-16 14:32:00.083886 | controller | skipping: [instance]
2026-03-16 14:32:00.144155 | controller |
2026-03-16 14:32:00.144189 | controller | TASK [Call the config_drive role] **********************************************
2026-03-16 14:32:00.144199 | controller | Monday 16 March 2026  14:32:00 +0000 (0:00:00.042)       0:02:16.503 **********
2026-03-16 14:32:00.144211 | controller |
2026-03-16 14:32:00.536242 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2026-03-16 14:32:00.536268 | controller | Monday 16 March 2026  14:32:00 +0000 (0:00:00.060)       0:02:16.563 **********
2026-03-16 14:32:00.536279 | controller | ok: [instance] => (item=artifacts)
2026-03-16 14:32:00.536305 | controller | ok: [instance] => (item=logs)
2026-03-16 14:32:00.536312 | controller |
2026-03-16 14:32:00.536320 | controller | TASK [config_drive : Install required RPM packages] ****************************
2026-03-16 14:32:00.536342 | controller | Monday 16 March 2026  14:32:00 +0000 (0:00:00.391)       0:02:16.955 **********
2026-03-16 14:32:01.755714 | controller | ok: [instance]
2026-03-16 14:32:01.961201 | controller |
2026-03-16 14:32:01.961227 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2026-03-16 14:32:01.961237 | controller | Monday 16 March 2026  14:32:01 +0000 (0:00:01.219)       0:02:18.174 **********
2026-03-16 14:32:01.961248 | controller | changed: [instance]
2026-03-16 14:32:01.961312 | controller |
2026-03-16 14:32:01.961341 | controller | TASK [config_drive : Generate meta-data] ***************************************
2026-03-16 14:32:01.961352 | controller | Monday 16 March 2026  14:32:01 +0000 (0:00:00.205)       0:02:18.380 **********
2026-03-16 14:32:02.307237 | controller | changed: [instance]
2026-03-16 14:32:02.307282 | controller |
2026-03-16 14:32:02.307294 | controller | TASK [config_drive : Generate user-data] ***************************************
2026-03-16 14:32:02.307458 | controller | Monday 16 March 2026  14:32:02 +0000 (0:00:00.345)       0:02:18.726 **********
2026-03-16 14:32:02.663747 | controller | changed: [instance]
2026-03-16 14:32:02.707299 | controller |
2026-03-16 14:32:02.707332 | controller | TASK [config_drive : Generate network-data] ************************************
2026-03-16 14:32:02.707342 | controller | Monday 16 March 2026  14:32:02 +0000 (0:00:00.356)       0:02:19.082 **********
2026-03-16 14:32:02.707353 | controller | skipping: [instance]
2026-03-16 14:32:02.707382 | controller |
2026-03-16 14:32:02.707394 | controller | TASK [config_drive : Check ISO availability] ***********************************
2026-03-16 14:32:02.898074 | controller | Monday 16 March 2026  14:32:02 +0000 (0:00:00.043)       0:02:19.126 **********
2026-03-16 14:32:02.898134 | controller | ok: [instance]
2026-03-16 14:32:02.940258 | controller |
2026-03-16 14:32:02.940279 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2026-03-16 14:32:02.940288 | controller | Monday 16 March 2026  14:32:02 +0000 (0:00:00.190)       0:02:19.317 **********
2026-03-16 14:32:02.940298 | controller | skipping: [instance]
2026-03-16 14:32:02.940352 | controller |
2026-03-16 14:32:02.940369 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2026-03-16 14:32:02.940381 | controller | Monday 16 March 2026  14:32:02 +0000 (0:00:00.042)       0:02:19.359 **********
2026-03-16 14:32:03.174175 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log
2026-03-16 14:32:03.440155 | controller | changed: [instance]
2026-03-16 14:32:03.440182 | controller |
2026-03-16 14:32:03.440190 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-16 14:32:03.440196 | controller | Monday 16 March 2026  14:32:03 +0000 (0:00:00.233)       0:02:19.593 **********
2026-03-16 14:32:03.440206 | controller | changed: [instance]
2026-03-16 14:32:03.484152 | controller |
2026-03-16 14:32:03.484178 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-16 14:32:03.484186 | controller | Monday 16 March 2026  14:32:03 +0000 (0:00:00.265)       0:02:19.859 **********
2026-03-16 14:32:03.484195 | controller | skipping: [instance]
2026-03-16 14:32:03.511516 | controller |
2026-03-16 14:32:03.511541 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ********************
2026-03-16 14:32:03.511550 | controller | Monday 16 March 2026  14:32:03 +0000 (0:00:00.044)       0:02:19.903 **********
2026-03-16 14:32:03.511561 | controller | skipping: [instance]
2026-03-16 14:32:03.744649 | controller |
2026-03-16 14:32:03.744678 | controller | TASK [libvirt_manager : Create VM image for controller-0] **********************
2026-03-16 14:32:03.744686 | controller | Monday 16 March 2026  14:32:03 +0000 (0:00:00.027)       0:02:19.930 **********
2026-03-16 14:32:03.744696 | controller | changed: [instance]
2026-03-16 14:32:03.957932 | controller |
2026-03-16 14:32:03.957953 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] *****
2026-03-16 14:32:03.957964 | controller | Monday 16 March 2026  14:32:03 +0000 (0:00:00.232)       0:02:20.163 **********
2026-03-16 14:32:03.957973 | controller | changed: [instance]
2026-03-16 14:32:04.235629 | controller |
2026-03-16 14:32:04.235660 | controller | TASK [libvirt_manager : Define VMs for type controller-0] **********************
2026-03-16 14:32:04.235668 | controller | Monday 16 March 2026  14:32:03 +0000 (0:00:00.213)       0:02:20.377 **********
2026-03-16 14:32:04.235678 | controller | changed: [instance]
2026-03-16 14:32:04.263992 | controller |
2026-03-16 14:32:04.264026 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ********
2026-03-16 14:32:04.264037 | controller | Monday 16 March 2026  14:32:04 +0000 (0:00:00.277)       0:02:20.654 **********
2026-03-16 14:32:04.264050 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-16 14:32:04.306797 | controller |
2026-03-16 14:32:04.306826 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-16 14:32:04.306835 | controller | Monday 16 March 2026  14:32:04 +0000 (0:00:00.028)       0:02:20.683 **********
2026-03-16 14:32:04.306847 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-16 14:32:04.523929 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-16 14:32:04.523954 | controller |
2026-03-16 14:32:04.523962 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-16 14:32:04.523968 | controller | Monday 16 March 2026  14:32:04 +0000 (0:00:00.042)       0:02:20.725 **********
2026-03-16 14:32:04.523977 | controller | ok: [instance]
2026-03-16 14:32:04.568370 | controller |
2026-03-16 14:32:04.568418 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-16 14:32:04.568432 | controller | Monday 16 March 2026  14:32:04 +0000 (0:00:00.217)       0:02:20.943 **********
2026-03-16 14:32:04.568450 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 14:32:04.790830 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 14:32:04.790858 | controller |
2026-03-16 14:32:04.790866 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-16 14:32:04.790872 | controller | Monday 16 March 2026  14:32:04 +0000 (0:00:00.044)       0:02:20.987 **********
2026-03-16 14:32:04.790881 | controller | ok: [instance]
2026-03-16 14:32:04.981546 | controller |
2026-03-16 14:32:04.981571 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-16 14:32:04.981579 | controller | Monday 16 March 2026  14:32:04 +0000 (0:00:00.222)       0:02:21.210 **********
2026-03-16 14:32:04.981590 | controller | ok: [instance]
2026-03-16 14:32:05.256964 | controller |
2026-03-16 14:32:05.256995 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] *********
2026-03-16 14:32:05.257003 | controller | Monday 16 March 2026  14:32:04 +0000 (0:00:00.190)       0:02:21.400 **********
2026-03-16 14:32:05.257012 | controller | changed: [instance]
2026-03-16 14:32:05.477976 | controller |
2026-03-16 14:32:05.478006 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-16 14:32:05.478015 | controller | Monday 16 March 2026  14:32:05 +0000 (0:00:00.275)       0:02:21.676 **********
2026-03-16 14:32:05.478025 | controller | ok: [instance]
2026-03-16 14:32:05.522364 | controller |
2026-03-16 14:32:05.522414 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-16 14:32:05.522429 | controller | Monday 16 March 2026  14:32:05 +0000 (0:00:00.220)       0:02:21.897 **********
2026-03-16 14:32:05.522446 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 14:32:05.522491 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 14:32:05.522503 | controller |
2026-03-16 14:32:05.522517 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-16 14:32:05.747803 | controller | Monday 16 March 2026  14:32:05 +0000 (0:00:00.044)       0:02:21.941 **********
2026-03-16 14:32:05.747839 | controller | ok: [instance]
2026-03-16 14:32:05.943639 | controller |
2026-03-16 14:32:05.943658 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-16 14:32:05.943666 | controller | Monday 16 March 2026  14:32:05 +0000 (0:00:00.225)       0:02:22.167 **********
2026-03-16 14:32:05.943675 | controller | ok: [instance]
2026-03-16 14:32:06.249298 | controller |
2026-03-16 14:32:06.249369 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ******
2026-03-16 14:32:06.249383 | controller | Monday 16 March 2026  14:32:05 +0000 (0:00:00.195)       0:02:22.362 **********
2026-03-16 14:32:06.249404 | controller | changed: [instance]
2026-03-16 14:32:06.270250 | controller |
2026-03-16 14:32:06.270306 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] ***
2026-03-16 14:32:06.270321 | controller | Monday 16 March 2026  14:32:06 +0000 (0:00:00.305)       0:02:22.668 **********
2026-03-16 14:32:06.270339 | controller | skipping: [instance]
2026-03-16 14:32:06.270349 | controller |
2026-03-16 14:32:06.270363 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] *****
2026-03-16 14:32:06.343809 | controller | Monday 16 March 2026  14:32:06 +0000 (0:00:00.021)       0:02:22.689 **********
2026-03-16 14:32:06.343870 | controller | skipping: [instance]
2026-03-16 14:32:06.370287 | controller |
2026-03-16 14:32:06.370347 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] ***********
2026-03-16 14:32:06.370362 | controller | Monday 16 March 2026  14:32:06 +0000 (0:00:00.073)       0:02:22.763 **********
2026-03-16 14:32:06.370380 | controller | skipping: [instance]
2026-03-16 14:32:06.370436 | controller |
2026-03-16 14:32:06.370451 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ********************
2026-03-16 14:32:06.370522 | controller | Monday 16 March 2026  14:32:06 +0000 (0:00:00.026)       0:02:22.789 **********
2026-03-16 14:32:06.394200 | controller | skipping: [instance]
2026-03-16 14:32:06.599393 | controller |
2026-03-16 14:32:06.599419 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-16 14:32:06.599428 | controller | Monday 16 March 2026  14:32:06 +0000 (0:00:00.024)       0:02:22.813 **********
2026-03-16 14:32:06.599445 | controller | changed: [instance]
2026-03-16 14:32:06.599465 | controller |
2026-03-16 14:32:06.599701 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-16 14:32:06.636559 | controller | Monday 16 March 2026  14:32:06 +0000 (0:00:00.205)       0:02:23.018 **********
2026-03-16 14:32:06.636578 | controller | ok: [instance]
2026-03-16 14:32:06.686958 | controller |
2026-03-16 14:32:06.686988 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-16 14:32:06.687000 | controller | Monday 16 March 2026  14:32:06 +0000 (0:00:00.037)       0:02:23.056 **********
2026-03-16 14:32:06.687016 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2026-03-16 14:32:06.874782 | controller |
2026-03-16 14:32:06.874813 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2026-03-16 14:32:06.874822 | controller | Monday 16 March 2026  14:32:06 +0000 (0:00:00.050)       0:02:23.106 **********
2026-03-16 14:32:06.874833 | controller | ok: [instance]
2026-03-16 14:32:06.933877 | controller |
2026-03-16 14:32:06.933904 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2026-03-16 14:32:06.933912 | controller | Monday 16 March 2026  14:32:06 +0000 (0:00:00.187)       0:02:23.293 **********
2026-03-16 14:32:06.933922 | controller | ok: [instance]
2026-03-16 14:32:06.977963 | controller |
2026-03-16 14:32:06.977983 | controller | TASK [libvirt_manager : Define the user data] **********************************
2026-03-16 14:32:06.977991 | controller | Monday 16 March 2026  14:32:06 +0000 (0:00:00.059)       0:02:23.353 **********
2026-03-16 14:32:06.978001 | controller | ok: [instance]
2026-03-16 14:32:07.019601 | controller |
2026-03-16 14:32:07.019619 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2026-03-16 14:32:07.019627 | controller | Monday 16 March 2026  14:32:06 +0000 (0:00:00.044)       0:02:23.397 **********
2026-03-16 14:32:07.019635 | controller | skipping: [instance]
2026-03-16 14:32:07.060321 | controller |
2026-03-16 14:32:07.060366 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2026-03-16 14:32:07.060380 | controller | Monday 16 March 2026  14:32:07 +0000 (0:00:00.041)       0:02:23.439 **********
2026-03-16 14:32:07.060397 | controller | skipping: [instance]
2026-03-16 14:32:07.117790 | controller |
2026-03-16 14:32:07.117825 | controller | TASK [Call the config_drive role] **********************************************
2026-03-16 14:32:07.117834 | controller | Monday 16 March 2026  14:32:07 +0000 (0:00:00.040)       0:02:23.479 **********
2026-03-16 14:32:07.117846 | controller |
2026-03-16 14:32:07.500242 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2026-03-16 14:32:07.500277 | controller | Monday 16 March 2026  14:32:07 +0000 (0:00:00.057)       0:02:23.537 **********
2026-03-16 14:32:07.500292 | controller | ok: [instance] => (item=artifacts)
2026-03-16 14:32:08.704589 | controller | ok: [instance] => (item=logs)
2026-03-16 14:32:08.704620 | controller |
2026-03-16 14:32:08.704629 | controller | TASK [config_drive : Install required RPM packages] ****************************
2026-03-16 14:32:08.704635 | controller | Monday 16 March 2026  14:32:07 +0000 (0:00:00.382)       0:02:23.919 **********
2026-03-16 14:32:08.704646 | controller | ok: [instance]
2026-03-16 14:32:08.912827 | controller |
2026-03-16 14:32:08.912860 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2026-03-16 14:32:08.912873 | controller | Monday 16 March 2026  14:32:08 +0000 (0:00:01.204)       0:02:25.123 **********
2026-03-16 14:32:08.912885 | controller | changed: [instance]
2026-03-16 14:32:09.258899 | controller |
2026-03-16 14:32:09.258932 | controller | TASK [config_drive : Generate meta-data] ***************************************
2026-03-16 14:32:09.258940 | controller | Monday 16 March 2026  14:32:08 +0000 (0:00:00.208)       0:02:25.331 **********
2026-03-16 14:32:09.258949 | controller | changed: [instance]
2026-03-16 14:32:09.615003 | controller |
2026-03-16 14:32:09.615022 | controller | TASK [config_drive : Generate user-data] ***************************************
2026-03-16 14:32:09.615033 | controller | Monday 16 March 2026  14:32:09 +0000 (0:00:00.346)       0:02:25.678 **********
2026-03-16 14:32:09.615042 | controller | changed: [instance]
2026-03-16 14:32:09.659290 | controller |
2026-03-16 14:32:09.659330 | controller | TASK [config_drive : Generate network-data] ************************************
2026-03-16 14:32:09.659341 | controller | Monday 16 March 2026  14:32:09 +0000 (0:00:00.356)       0:02:26.034 **********
2026-03-16 14:32:09.659355 | controller | skipping: [instance]
2026-03-16 14:32:09.659667 | controller |
2026-03-16 14:32:09.659703 | controller | TASK [config_drive : Check ISO availability] ***********************************
2026-03-16 14:32:09.847923 | controller | Monday 16 March 2026  14:32:09 +0000 (0:00:00.044)       0:02:26.078 **********
2026-03-16 14:32:09.847944 | controller | ok: [instance]
2026-03-16 14:32:09.888309 | controller |
2026-03-16 14:32:09.888342 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2026-03-16 14:32:09.888351 | controller | Monday 16 March 2026  14:32:09 +0000 (0:00:00.188)       0:02:26.267 **********
2026-03-16 14:32:09.888363 | controller | skipping: [instance]
2026-03-16 14:32:09.888396 | controller |
2026-03-16 14:32:09.888729 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2026-03-16 14:32:10.118568 | controller | Monday 16 March 2026  14:32:09 +0000 (0:00:00.040)       0:02:26.307 **********
2026-03-16 14:32:10.118589 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log
2026-03-16 14:32:10.381480 | controller | changed: [instance]
2026-03-16 14:32:10.381512 | controller |
2026-03-16 14:32:10.381520 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-16 14:32:10.381526 | controller | Monday 16 March 2026  14:32:10 +0000 (0:00:00.230)       0:02:26.537 **********
2026-03-16 14:32:10.381535 | controller | changed: [instance]
2026-03-16 14:32:10.426218 | controller |
2026-03-16 14:32:10.426246 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-16 14:32:10.426253 | controller | Monday 16 March 2026  14:32:10 +0000 (0:00:00.262)       0:02:26.800 **********
2026-03-16 14:32:10.426263 | controller | skipping: [instance]
2026-03-16 14:32:10.426285 | controller |
2026-03-16 14:32:10.426496 | controller | TASK [libvirt_manager : Configure boot order for controller-0] *****************
2026-03-16 14:32:10.454135 | controller | Monday 16 March 2026  14:32:10 +0000 (0:00:00.045)       0:02:26.845 **********
2026-03-16 14:32:10.454161 | controller | skipping: [instance]
2026-03-16 14:32:10.690684 | controller |
2026-03-16 14:32:10.690706 | controller | TASK [libvirt_manager : Create VM image for crc-0] *****************************
2026-03-16 14:32:10.690713 | controller | Monday 16 March 2026  14:32:10 +0000 (0:00:00.027)       0:02:26.873 **********
2026-03-16 14:32:10.690723 | controller | changed: [instance]
2026-03-16 14:32:10.907221 | controller |
2026-03-16 14:32:10.907262 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************
2026-03-16 14:32:10.907272 | controller | Monday 16 March 2026  14:32:10 +0000 (0:00:00.236)       0:02:27.110 **********
2026-03-16 14:32:10.907285 | controller | changed: [instance]
2026-03-16 14:32:11.182640 | controller |
2026-03-16 14:32:11.182674 | controller | TASK [libvirt_manager : Define VMs for type crc-0] *****************************
2026-03-16 14:32:11.182682 | controller | Monday 16 March 2026  14:32:10 +0000 (0:00:00.216)       0:02:27.326 **********
2026-03-16 14:32:11.182693 | controller | changed: [instance]
2026-03-16 14:32:11.210533 | controller |
2026-03-16 14:32:11.210559 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] ***************
2026-03-16 14:32:11.210567 | controller | Monday 16 March 2026  14:32:11 +0000 (0:00:00.275)       0:02:27.601 **********
2026-03-16 14:32:11.210585 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-16 14:32:11.255008 | controller |
2026-03-16 14:32:11.255028 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-16 14:32:11.255036 | controller | Monday 16 March 2026  14:32:11 +0000 (0:00:00.028)       0:02:27.629 **********
2026-03-16 14:32:11.255046 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-16 14:32:11.473236 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-16 14:32:11.473272 | controller |
2026-03-16 14:32:11.473281 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-16 14:32:11.473288 | controller | Monday 16 March 2026  14:32:11 +0000 (0:00:00.043)       0:02:27.673 **********
2026-03-16 14:32:11.473300 | controller | ok: [instance]
2026-03-16 14:32:11.473327 | controller |
2026-03-16 14:32:11.473337 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-16 14:32:11.473480 | controller | Monday 16 March 2026  14:32:11 +0000 (0:00:00.218)       0:02:27.892 **********
2026-03-16 14:32:11.518240 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 14:32:11.730770 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 14:32:11.730801 | controller |
2026-03-16 14:32:11.730809 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-16 14:32:11.730819 | controller | Monday 16 March 2026  14:32:11 +0000 (0:00:00.044)       0:02:27.937 **********
2026-03-16 14:32:11.730829 | controller | ok: [instance]
2026-03-16 14:32:11.919466 | controller |
2026-03-16 14:32:11.919493 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-16 14:32:11.919501 | controller | Monday 16 March 2026  14:32:11 +0000 (0:00:00.212)       0:02:28.149 **********
2026-03-16 14:32:11.919511 | controller | ok: [instance]
2026-03-16 14:32:12.197107 | controller |
2026-03-16 14:32:12.197151 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] ****************
2026-03-16 14:32:12.197158 | controller | Monday 16 March 2026  14:32:11 +0000 (0:00:00.188)       0:02:28.338 **********
2026-03-16 14:32:12.197169 | controller | changed: [instance]
2026-03-16 14:32:12.421706 | controller |
2026-03-16 14:32:12.421739 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-16 14:32:12.421747 | controller | Monday 16 March 2026  14:32:12 +0000 (0:00:00.277)       0:02:28.616 **********
2026-03-16 14:32:12.421758 | controller | ok: [instance]
2026-03-16 14:32:12.463214 | controller |
2026-03-16 14:32:12.463238 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-16 14:32:12.463247 | controller | Monday 16 March 2026  14:32:12 +0000 (0:00:00.224)       0:02:28.840 **********
2026-03-16 14:32:12.463258 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 14:32:12.463284 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 14:32:12.463618 | controller |
2026-03-16 14:32:12.681189 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-16 14:32:12.681223 | controller | Monday 16 March 2026  14:32:12 +0000 (0:00:00.041)       0:02:28.882 **********
2026-03-16 14:32:12.681236 | controller | ok: [instance]
2026-03-16 14:32:12.875245 | controller |
2026-03-16 14:32:12.875287 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-16 14:32:12.875296 | controller | Monday 16 March 2026  14:32:12 +0000 (0:00:00.217)       0:02:29.100 **********
2026-03-16 14:32:12.875310 | controller | ok: [instance]
2026-03-16 14:32:12.875353 | controller |
2026-03-16 14:32:12.875436 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] *************
2026-03-16 14:32:12.875465 | controller | Monday 16 March 2026  14:32:12 +0000 (0:00:00.194)       0:02:29.294 **********
2026-03-16 14:32:13.153763 | controller | changed: [instance]
2026-03-16 14:32:13.174890 | controller |
2026-03-16 14:32:13.174918 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] *********
2026-03-16 14:32:13.174932 | controller | Monday 16 March 2026  14:32:13 +0000 (0:00:00.278)       0:02:29.572 **********
2026-03-16 14:32:13.174944 | controller | skipping: [instance]
2026-03-16 14:32:13.199895 | controller |
2026-03-16 14:32:13.199915 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************
2026-03-16 14:32:13.199922 | controller | Monday 16 March 2026  14:32:13 +0000 (0:00:00.021)       0:02:29.594 **********
2026-03-16 14:32:13.199931 | controller | skipping: [instance]
2026-03-16 14:32:13.224283 | controller |
2026-03-16 14:32:13.224307 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ******************
2026-03-16 14:32:13.224316 | controller | Monday 16 March 2026  14:32:13 +0000 (0:00:00.025)       0:02:29.619 **********
2026-03-16 14:32:13.224327 | controller | skipping: [instance]
2026-03-16 14:32:13.224483 | controller |
2026-03-16 14:32:13.224500 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] ***************************
2026-03-16 14:32:13.248954 | controller | Monday 16 March 2026  14:32:13 +0000 (0:00:00.024)       0:02:29.643 **********
2026-03-16 14:32:13.248978 | controller | skipping: [instance]
2026-03-16 14:32:13.450002 | controller |
2026-03-16 14:32:13.450031 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-16 14:32:13.450039 | controller | Monday 16 March 2026  14:32:13 +0000 (0:00:00.024)       0:02:29.668 **********
2026-03-16 14:32:13.450185 | controller | changed: [instance]
2026-03-16 14:32:13.486842 | controller |
2026-03-16 14:32:13.486860 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-16 14:32:13.486867 | controller | Monday 16 March 2026  14:32:13 +0000 (0:00:00.200)       0:02:29.869 **********
2026-03-16 14:32:13.486876 | controller | ok: [instance]
2026-03-16 14:32:13.514280 | controller |
2026-03-16 14:32:13.514321 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-16 14:32:13.514332 | controller | Monday 16 March 2026  14:32:13 +0000 (0:00:00.037)       0:02:29.906 **********
2026-03-16 14:32:13.514347 | controller | skipping: [instance]
2026-03-16 14:32:13.540787 | controller |
2026-03-16 14:32:13.540809 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-16 14:32:13.540817 | controller | Monday 16 March 2026  14:32:13 +0000 (0:00:00.027)       0:02:29.933 **********
2026-03-16 14:32:13.540830 | controller | skipping: [instance]
2026-03-16 14:32:13.586764 | controller |
2026-03-16 14:32:13.586793 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-16 14:32:13.586803 | controller | Monday 16 March 2026  14:32:13 +0000 (0:00:00.026)       0:02:29.960 **********
2026-03-16 14:32:13.586815 | controller | skipping: [instance]
2026-03-16 14:32:13.612042 | controller |
2026-03-16 14:32:13.612072 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************
2026-03-16 14:32:13.612079 | controller | Monday 16 March 2026  14:32:13 +0000 (0:00:00.045)       0:02:30.006 **********
2026-03-16 14:32:13.612088 | controller | skipping: [instance]
2026-03-16 14:32:13.673278 | controller |
2026-03-16 14:32:13.673310 | controller | TASK [libvirt_manager : Start (power-on) VMs] **********************************
2026-03-16 14:32:13.673320 | controller | Monday 16 March 2026  14:32:13 +0000 (0:00:00.025)       0:02:30.031 **********
2026-03-16 14:32:13.673334 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance
2026-03-16 14:32:13.905923 | controller |
2026-03-16 14:32:13.905953 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] *****************
2026-03-16 14:32:13.905961 | controller | Monday 16 March 2026  14:32:13 +0000 (0:00:00.061)       0:02:30.092 **********
2026-03-16 14:32:13.905971 | controller | ok: [instance] => (item=crc)
2026-03-16 14:32:15.972044 | controller |
2026-03-16 14:32:15.972086 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] **********************
2026-03-16 14:32:15.972093 | controller | Monday 16 March 2026  14:32:13 +0000 (0:00:00.232)       0:02:30.325 **********
2026-03-16 14:32:15.972103 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-16 14:32:16.501990 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-16 14:32:16.502031 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-16 14:32:16.502039 | controller |
2026-03-16 14:32:16.502045 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-16 14:32:16.502059 | controller | Monday 16 March 2026  14:32:15 +0000 (0:00:02.065)       0:02:32.391 **********
2026-03-16 14:32:16.502069 | controller | changed: [instance]
2026-03-16 14:32:16.956095 | controller |
2026-03-16 14:32:16.956141 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-16 14:32:16.956152 | controller | Monday 16 March 2026  14:32:16 +0000 (0:00:00.530)       0:02:32.921 **********
2026-03-16 14:32:16.956163 | controller | changed: [instance]
2026-03-16 14:32:17.443955 | controller |
2026-03-16 14:32:17.443988 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-16 14:32:17.443996 | controller | Monday 16 March 2026  14:32:16 +0000 (0:00:00.453)       0:02:33.375 **********
2026-03-16 14:32:17.444006 | controller | changed: [instance]
2026-03-16 14:32:18.144843 | controller |
2026-03-16 14:32:18.144868 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] ***************************
2026-03-16 14:32:18.144876 | controller | Monday 16 March 2026  14:32:17 +0000 (0:00:00.487)       0:02:33.862 **********
2026-03-16 14:32:18.144885 | controller | changed: [instance] => (item=compute-0.utility)
2026-03-16 14:32:41.120272 | controller | changed: [instance] => (item=controller-0.utility)
2026-03-16 14:32:41.120305 | controller | changed: [instance] => (item=crc-0.utility)
2026-03-16 14:32:41.120312 | controller |
2026-03-16 14:32:41.120324 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] ****************************
2026-03-16 14:32:41.120330 | controller | Monday 16 March 2026  14:32:18 +0000 (0:00:00.696)       0:02:34.559 **********
2026-03-16 14:32:41.120339 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2026-03-16 14:32:41.225729 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left).
2026-03-16 14:32:41.225748 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left).
2026-03-16 14:32:41.225755 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left).
2026-03-16 14:32:41.225761 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left).
2026-03-16 14:32:41.225766 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left).
2026-03-16 14:32:41.225771 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left).
2026-03-16 14:32:41.225776 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j904345384772.22371', 'results_file': '/home/zuul/.ansible_async/j904345384772.22371', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'})
2026-03-16 14:32:41.225786 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j870211079437.22388', 'results_file': '/home/zuul/.ansible_async/j870211079437.22388', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'})
2026-03-16 14:32:41.225791 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j730407619182.22404', 'results_file': '/home/zuul/.ansible_async/j730407619182.22404', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'})
2026-03-16 14:32:41.225796 | controller |
2026-03-16 14:32:41.225801 | controller | TASK [libvirt_manager : Configure managed VMs] *********************************
2026-03-16 14:32:41.225806 | controller | Monday 16 March 2026  14:32:41 +0000 (0:00:22.975)       0:02:57.534 **********
2026-03-16 14:32:41.225815 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-16 14:32:41.251150 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-16 14:32:41.251174 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-16 14:32:41.251182 | controller |
2026-03-16 14:32:41.251188 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-16 14:32:41.251194 | controller | Monday 16 March 2026  14:32:41 +0000 (0:00:00.110)       0:02:57.644 **********
2026-03-16 14:32:41.251203 | controller | skipping: [instance]
2026-03-16 14:32:41.292539 | controller |
2026-03-16 14:32:41.292558 | controller | TASK [Push ssh jumper/configuration for compute-0] *****************************
2026-03-16 14:32:41.292566 | controller | Monday 16 March 2026  14:32:41 +0000 (0:00:00.025)       0:02:57.670 **********
2026-03-16 14:32:41.292575 | controller |
2026-03-16 14:32:41.387608 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-16 14:32:41.387628 | controller | Monday 16 March 2026  14:32:41 +0000 (0:00:00.041)       0:02:57.711 **********
2026-03-16 14:32:41.387642 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2026-03-16 14:32:41.613518 | controller |
2026-03-16 14:32:41.613560 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-16 14:32:41.613568 | controller | Monday 16 March 2026  14:32:41 +0000 (0:00:00.094)       0:02:57.806 **********
2026-03-16 14:32:41.613579 | controller | changed: [instance]
2026-03-16 14:32:41.613595 | controller |
2026-03-16 14:32:41.613601 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-16 14:32:41.613608 | controller | Monday 16 March 2026  14:32:41 +0000 (0:00:00.225)       0:02:58.032 **********
2026-03-16 14:32:41.830898 | controller | changed: [instance]
2026-03-16 14:32:42.215871 | controller |
2026-03-16 14:32:42.215911 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] *******************
2026-03-16 14:32:42.215919 | controller | Monday 16 March 2026  14:32:41 +0000 (0:00:00.217)       0:02:58.250 **********
2026-03-16 14:32:42.215929 | controller | changed: [instance]
2026-03-16 14:32:42.216178 | controller |
2026-03-16 14:32:42.244668 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ******************
2026-03-16 14:32:42.244692 | controller | Monday 16 March 2026  14:32:42 +0000 (0:00:00.385)       0:02:58.635 **********
2026-03-16 14:32:42.244703 | controller | skipping: [instance]
2026-03-16 14:32:42.273213 | controller |
2026-03-16 14:32:42.273254 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-16 14:32:42.273262 | controller | Monday 16 March 2026  14:32:42 +0000 (0:00:00.028)       0:02:58.663 **********
2026-03-16 14:32:42.273272 | controller | skipping: [instance]
2026-03-16 14:32:42.322450 | controller |
2026-03-16 14:32:42.322467 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] *****************
2026-03-16 14:32:42.322475 | controller | Monday 16 March 2026  14:32:42 +0000 (0:00:00.028)       0:02:58.692 **********
2026-03-16 14:32:42.322483 | controller | skipping: [instance]
2026-03-16 14:32:42.367402 | controller |
2026-03-16 14:32:42.367420 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ******************
2026-03-16 14:32:42.367427 | controller | Monday 16 March 2026  14:32:42 +0000 (0:00:00.049)       0:02:58.741 **********
2026-03-16 14:32:42.367435 | controller | skipping: [instance]
2026-03-16 14:32:42.390317 | controller |
2026-03-16 14:32:42.390335 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-16 14:32:42.390343 | controller | Monday 16 March 2026  14:32:42 +0000 (0:00:00.044)       0:02:58.786 **********
2026-03-16 14:32:42.390352 | controller | skipping: [instance]
2026-03-16 14:32:42.427428 | controller |
2026-03-16 14:32:42.427457 | controller | TASK [Push ssh jumper/configuration for controller-0] **************************
2026-03-16 14:32:42.427465 | controller | Monday 16 March 2026  14:32:42 +0000 (0:00:00.022)       0:02:58.809 **********
2026-03-16 14:32:42.427473 | controller |
2026-03-16 14:32:42.505484 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-16 14:32:42.505504 | controller | Monday 16 March 2026  14:32:42 +0000 (0:00:00.037)       0:02:58.846 **********
2026-03-16 14:32:42.505521 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2026-03-16 14:32:42.733197 | controller |
2026-03-16 14:32:42.733225 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-16 14:32:42.733232 | controller | Monday 16 March 2026  14:32:42 +0000 (0:00:00.077)       0:02:58.924 **********
2026-03-16 14:32:42.733241 | controller | ok: [instance]
2026-03-16 14:32:42.956841 | controller |
2026-03-16 14:32:42.956871 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-16 14:32:42.956879 | controller | Monday 16 March 2026  14:32:42 +0000 (0:00:00.227)       0:02:59.152 **********
2026-03-16 14:32:42.956889 | controller | ok: [instance]
2026-03-16 14:32:43.360644 | controller |
2026-03-16 14:32:43.360671 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] ****************
2026-03-16 14:32:43.360678 | controller | Monday 16 March 2026  14:32:42 +0000 (0:00:00.222)       0:02:59.375 **********
2026-03-16 14:32:43.360688 | controller | changed: [instance]
2026-03-16 14:32:43.388202 | controller |
2026-03-16 14:32:43.388227 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] ***************
2026-03-16 14:32:43.388235 | controller | Monday 16 March 2026  14:32:43 +0000 (0:00:00.404)       0:02:59.779 **********
2026-03-16 14:32:43.388244 | controller | skipping: [instance]
2026-03-16 14:32:43.414961 | controller |
2026-03-16 14:32:43.414987 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-16 14:32:43.414995 | controller | Monday 16 March 2026  14:32:43 +0000 (0:00:00.027)       0:02:59.807 **********
2026-03-16 14:32:43.415005 | controller | skipping: [instance]
2026-03-16 14:32:45.059443 | controller |
2026-03-16 14:32:45.059477 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] **************
2026-03-16 14:32:45.059485 | controller | Monday 16 March 2026  14:32:43 +0000 (0:00:00.026)       0:02:59.834 **********
2026-03-16 14:32:45.059496 | controller | changed: [instance -> controller-0.instance]
2026-03-16 14:32:46.159487 | controller |
2026-03-16 14:32:46.159520 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] ***************
2026-03-16 14:32:46.159528 | controller | Monday 16 March 2026  14:32:45 +0000 (0:00:01.644)       0:03:01.478 **********
2026-03-16 14:32:46.159543 | controller | changed: [instance -> controller-0.instance]
2026-03-16 14:32:46.197547 | controller |
2026-03-16 14:32:46.197572 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-16 14:32:46.197580 | controller | Monday 16 March 2026  14:32:46 +0000 (0:00:01.100)       0:03:02.578 **********
2026-03-16 14:32:46.197589 | controller |
2026-03-16 14:32:46.423784 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2026-03-16 14:32:46.423813 | controller | Monday 16 March 2026  14:32:46 +0000 (0:00:00.038)       0:03:02.616 **********
2026-03-16 14:32:46.423824 | controller | ok: [instance]
2026-03-16 14:32:46.450047 | controller |
2026-03-16 14:32:46.450075 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2026-03-16 14:32:46.450083 | controller | Monday 16 March 2026  14:32:46 +0000 (0:00:00.226)       0:03:02.842 **********
2026-03-16 14:32:46.450093 | controller | ok: [instance]
2026-03-16 14:32:46.489248 | controller |
2026-03-16 14:32:46.489296 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2026-03-16 14:32:46.489304 | controller | Monday 16 March 2026  14:32:46 +0000 (0:00:00.026)       0:03:02.869 **********
2026-03-16 14:32:46.489324 | controller | skipping: [instance]
2026-03-16 14:32:46.489476 | controller |
2026-03-16 14:32:46.489545 | controller | TASK [Push ssh jumper/configuration for crc-0] *********************************
2026-03-16 14:32:46.538286 | controller | Monday 16 March 2026  14:32:46 +0000 (0:00:00.039)       0:03:02.908 **********
2026-03-16 14:32:46.538339 | controller |
2026-03-16 14:32:46.538363 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-16 14:32:46.538408 | controller | Monday 16 March 2026  14:32:46 +0000 (0:00:00.049)       0:03:02.957 **********
2026-03-16 14:32:46.621725 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'})
2026-03-16 14:32:46.835229 | controller |
2026-03-16 14:32:46.835279 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-16 14:32:46.835288 | controller | Monday 16 March 2026  14:32:46 +0000 (0:00:00.083)       0:03:03.040 **********
2026-03-16 14:32:46.835300 | controller | ok: [instance]
2026-03-16 14:32:47.080158 | controller |
2026-03-16 14:32:47.080194 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-16 14:32:47.080202 | controller | Monday 16 March 2026  14:32:46 +0000 (0:00:00.212)       0:03:03.253 **********
2026-03-16 14:32:47.080214 | controller | ok: [instance]
2026-03-16 14:32:47.608551 | controller |
2026-03-16 14:32:47.608595 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] ***********************
2026-03-16 14:32:47.608603 | controller | Monday 16 March 2026  14:32:47 +0000 (0:00:00.245)       0:03:03.498 **********
2026-03-16 14:32:47.608612 | controller | changed: [instance]
2026-03-16 14:32:48.495380 | controller |
2026-03-16 14:32:48.495413 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] **********************
2026-03-16 14:32:48.495420 | controller | Monday 16 March 2026  14:32:47 +0000 (0:00:00.528)       0:03:04.027 **********
2026-03-16 14:32:48.495430 | controller | changed: [instance]
2026-03-16 14:32:48.523612 | controller |
2026-03-16 14:32:48.523633 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-16 14:32:48.523641 | controller | Monday 16 March 2026  14:32:48 +0000 (0:00:00.886)       0:03:04.914 **********
2026-03-16 14:32:48.523650 | controller | skipping: [instance]
2026-03-16 14:32:48.570066 | controller |
2026-03-16 14:32:48.570085 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] *********************
2026-03-16 14:32:48.570093 | controller | Monday 16 March 2026  14:32:48 +0000 (0:00:00.028)       0:03:04.942 **********
2026-03-16 14:32:48.570102 | controller | skipping: [instance]
2026-03-16 14:32:48.627821 | controller |
2026-03-16 14:32:48.627840 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] **********************
2026-03-16 14:32:48.627848 | controller | Monday 16 March 2026  14:32:48 +0000 (0:00:00.046)       0:03:04.989 **********
2026-03-16 14:32:48.627857 | controller | skipping: [instance]
2026-03-16 14:32:48.686265 | controller |
2026-03-16 14:32:48.686282 | controller | TASK [Create VBMC entity] ******************************************************
2026-03-16 14:32:48.686289 | controller | Monday 16 March 2026  14:32:48 +0000 (0:00:00.057)       0:03:05.047 **********
2026-03-16 14:32:48.686297 | controller | skipping: [instance] => (item=compute-0)
2026-03-16 14:32:48.941575 | controller | skipping: [instance] => (item=controller-0)
2026-03-16 14:32:48.941624 | controller | skipping: [instance] => (item=crc-0)
2026-03-16 14:32:48.941633 | controller | skipping: [instance]
2026-03-16 14:32:48.941639 | controller |
2026-03-16 14:32:48.941645 | controller | TASK [libvirt_manager : List running virtual machines.] ************************
2026-03-16 14:32:48.941650 | controller | Monday 16 March 2026  14:32:48 +0000 (0:00:00.058)       0:03:05.105 **********
2026-03-16 14:32:48.941660 | controller | ok: [instance]
2026-03-16 14:32:49.340684 | controller |
2026-03-16 14:32:49.340725 | controller | TASK [libvirt_manager : Dump UUIDs] ********************************************
2026-03-16 14:32:49.340742 | controller | Monday 16 March 2026  14:32:48 +0000 (0:00:00.255)       0:03:05.360 **********
2026-03-16 14:32:49.340755 | controller | changed: [instance]
2026-03-16 14:32:49.382834 | controller |
2026-03-16 14:32:49.382853 | controller | TASK [Ensure fresh vbmc listing] ***********************************************
2026-03-16 14:32:49.382860 | controller | Monday 16 March 2026  14:32:49 +0000 (0:00:00.398)       0:03:05.759 **********
2026-03-16 14:32:49.382868 | controller | skipping: [instance]
2026-03-16 14:32:49.423440 | controller |
2026-03-16 14:32:49.423459 | controller | TASK [libvirt_manager : Update vbmc related fact] ******************************
2026-03-16 14:32:49.423466 | controller | Monday 16 March 2026  14:32:49 +0000 (0:00:00.042)       0:03:05.802 **********
2026-03-16 14:32:49.423474 | controller | skipping: [instance]
2026-03-16 14:32:49.466569 | controller |
2026-03-16 14:32:49.466590 | controller | TASK [libvirt_manager : Dump vbmc known hosts] *********************************
2026-03-16 14:32:49.466597 | controller | Monday 16 March 2026  14:32:49 +0000 (0:00:00.040)       0:03:05.842 **********
2026-03-16 14:32:49.466605 | controller | skipping: [instance]
2026-03-16 14:32:50.259955 | controller |
2026-03-16 14:32:50.259997 | controller | TASK [libvirt_manager : Copy authorized_keys] **********************************
2026-03-16 14:32:50.260014 | controller | Monday 16 March 2026  14:32:49 +0000 (0:00:00.043)       0:03:05.885 **********
2026-03-16 14:32:50.260024 | controller | changed: [instance]
2026-03-16 14:32:51.069904 | controller |
2026-03-16 14:32:51.069948 | controller | TASK [libvirt_manager : Enable root access on CRC] *****************************
2026-03-16 14:32:51.069956 | controller | Monday 16 March 2026  14:32:50 +0000 (0:00:00.793)       0:03:06.678 **********
2026-03-16 14:32:51.069968 | controller | changed: [instance]
2026-03-16 14:32:51.069987 | controller |
2026-03-16 14:32:51.069993 | controller | TASK [reproducer : Get deployed VM group inventories] **************************
2026-03-16 14:32:51.070000 | controller | Monday 16 March 2026  14:32:51 +0000 (0:00:00.809)       0:03:07.488 **********
2026-03-16 14:32:51.115803 | controller | skipping: [instance]
2026-03-16 14:32:51.115858 | controller |
2026-03-16 14:32:51.115971 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] *************
2026-03-16 14:32:51.116076 | controller | Monday 16 March 2026  14:32:51 +0000 (0:00:00.045)       0:03:07.534 **********
2026-03-16 14:32:51.186632 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance)
2026-03-16 14:32:51.186730 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0)
2026-03-16 14:32:51.186829 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0)
2026-03-16 14:32:51.186919 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0)
2026-03-16 14:32:51.187030 | controller |
2026-03-16 14:32:51.187158 | controller | TASK [reproducer : Gather inventories from instance] ***************************
2026-03-16 14:32:51.187241 | controller | Monday 16 March 2026  14:32:51 +0000 (0:00:00.071)       0:03:07.606 **********
2026-03-16 14:32:51.237980 | controller | skipping: [instance]
2026-03-16 14:32:51.238076 | controller |
2026-03-16 14:32:51.238202 | controller | TASK [reproducer : Gather inventories from compute-0] **************************
2026-03-16 14:32:51.238316 | controller | Monday 16 March 2026  14:32:51 +0000 (0:00:00.051)       0:03:07.657 **********
2026-03-16 14:32:51.277613 | controller | skipping: [instance]
2026-03-16 14:32:51.321790 | controller |
2026-03-16 14:32:51.321814 | controller | TASK [reproducer : Gather inventories from controller-0] ***********************
2026-03-16 14:32:51.321822 | controller | Monday 16 March 2026  14:32:51 +0000 (0:00:00.039)       0:03:07.696 **********
2026-03-16 14:32:51.321832 | controller | skipping: [instance]
2026-03-16 14:32:51.363837 | controller |
2026-03-16 14:32:51.363860 | controller | TASK [reproducer : Gather inventories from crc-0] ******************************
2026-03-16 14:32:51.363868 | controller | Monday 16 March 2026  14:32:51 +0000 (0:00:00.043)       0:03:07.740 **********
2026-03-16 14:32:51.363878 | controller | skipping: [instance]
2026-03-16 14:32:52.041423 | controller |
2026-03-16 14:32:52.041493 | controller | TASK [reproducer : Push generated inventory from hypervisor] *******************
2026-03-16 14:32:52.041505 | controller | Monday 16 March 2026  14:32:51 +0000 (0:00:00.042)       0:03:07.783 **********
2026-03-16 14:32:52.041525 | controller | changed: [instance]
2026-03-16 14:32:52.078924 | controller |
2026-03-16 14:32:52.078964 | controller | TASK [reproducer : Slurp devscripts private key] *******************************
2026-03-16 14:32:52.078972 | controller | Monday 16 March 2026  14:32:52 +0000 (0:00:00.677)       0:03:08.460 **********
2026-03-16 14:32:52.078987 | controller | skipping: [instance]
2026-03-16 14:32:52.113630 | controller |
2026-03-16 14:32:52.113669 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] *****************
2026-03-16 14:32:52.113677 | controller | Monday 16 March 2026  14:32:52 +0000 (0:00:00.038)       0:03:08.498 **********
2026-03-16 14:32:52.113689 | controller | skipping: [instance]
2026-03-16 14:32:52.152889 | controller |
2026-03-16 14:32:52.152920 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] *********
2026-03-16 14:32:52.152927 | controller | Monday 16 March 2026  14:32:52 +0000 (0:00:00.034)       0:03:08.533 **********
2026-03-16 14:32:52.152945 | controller | skipping: [instance]
2026-03-16 14:32:52.188724 | controller |
2026-03-16 14:32:52.188761 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-03-16 14:32:52.188769 | controller | Monday 16 March 2026  14:32:52 +0000 (0:00:00.039)       0:03:08.572 **********
2026-03-16 14:32:52.188779 | controller | skipping: [instance]
2026-03-16 14:32:52.234604 | controller |
2026-03-16 14:32:52.234635 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-03-16 14:32:52.234643 | controller | Monday 16 March 2026  14:32:52 +0000 (0:00:00.035)       0:03:08.607 **********
2026-03-16 14:32:52.234653 | controller | skipping: [instance]
2026-03-16 14:32:52.281142 | controller |
2026-03-16 14:32:52.281176 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-03-16 14:32:52.281184 | controller | Monday 16 March 2026  14:32:52 +0000 (0:00:00.046)       0:03:08.653 **********
2026-03-16 14:32:52.281194 | controller | skipping: [instance]
2026-03-16 14:32:52.281433 | controller |
2026-03-16 14:32:52.281446 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-03-16 14:32:52.321636 | controller | Monday 16 March 2026  14:32:52 +0000 (0:00:00.045)       0:03:08.699 **********
2026-03-16 14:32:52.321658 | controller | skipping: [instance]
2026-03-16 14:32:52.359758 | controller |
2026-03-16 14:32:52.359775 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-03-16 14:32:52.359782 | controller | Monday 16 March 2026  14:32:52 +0000 (0:00:00.041)       0:03:08.741 **********
2026-03-16 14:32:52.359790 | controller | skipping: [instance]
2026-03-16 14:32:52.401787 | controller |
2026-03-16 14:32:52.401807 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-03-16 14:32:52.401814 | controller | Monday 16 March 2026  14:32:52 +0000 (0:00:00.037)       0:03:08.778 **********
2026-03-16 14:32:52.401823 | controller | skipping: [instance]
2026-03-16 14:32:52.452386 | controller |
2026-03-16 14:32:52.452411 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-03-16 14:32:52.452419 | controller | Monday 16 March 2026  14:32:52 +0000 (0:00:00.042)       0:03:08.821 **********
2026-03-16 14:32:52.452429 | controller | skipping: [instance]
2026-03-16 14:32:52.490485 | controller |
2026-03-16 14:32:52.490509 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] *********************
2026-03-16 14:32:52.490517 | controller | Monday 16 March 2026  14:32:52 +0000 (0:00:00.050)       0:03:08.871 **********
2026-03-16 14:32:52.490527 | controller | skipping: [instance]
2026-03-16 14:32:52.650569 | controller |
2026-03-16 14:32:52.650598 | controller | TASK [reproducer : Configure Controller node] **********************************
2026-03-16 14:32:52.650605 | controller | Monday 16 March 2026  14:32:52 +0000 (0:00:00.038)       0:03:08.909 **********
2026-03-16 14:32:52.650615 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance
2026-03-16 14:32:52.650782 | controller |
2026-03-16 14:32:52.650799 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2026-03-16 14:32:54.058964 | controller | Monday 16 March 2026  14:32:52 +0000 (0:00:00.160)       0:03:09.069 **********
2026-03-16 14:32:54.059017 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2026-03-16 14:32:54.059040 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2026-03-16 14:32:54.059110 | controller |
2026-03-16 14:32:54.059223 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2026-03-16 14:32:54.059316 | controller | Monday 16 March 2026  14:32:54 +0000 (0:00:01.408)       0:03:10.478 **********
2026-03-16 14:32:54.077672 | controller | skipping: [instance]
2026-03-16 14:32:54.077750 | controller |
2026-03-16 14:32:54.077846 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-03-16 14:32:54.077946 | controller | Monday 16 March 2026  14:32:54 +0000 (0:00:00.019)       0:03:10.497 **********
2026-03-16 14:32:54.685919 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:32:54.719352 | controller |
2026-03-16 14:32:54.719391 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-03-16 14:32:54.719399 | controller | Monday 16 March 2026  14:32:54 +0000 (0:00:00.607)       0:03:11.104 **********
2026-03-16 14:32:54.719411 | controller | skipping: [instance]
2026-03-16 14:32:54.719419 | controller |
2026-03-16 14:32:54.719545 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-03-16 14:32:54.719649 | controller | Monday 16 March 2026  14:32:54 +0000 (0:00:00.034)       0:03:11.138 **********
2026-03-16 14:32:54.754064 | controller | skipping: [instance]
2026-03-16 14:32:54.754337 | controller |
2026-03-16 14:32:54.754517 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-03-16 14:32:54.754611 | controller | Monday 16 March 2026  14:32:54 +0000 (0:00:00.034)       0:03:11.173 **********
2026-03-16 14:32:54.789260 | controller | skipping: [instance]
2026-03-16 14:32:54.789331 | controller |
2026-03-16 14:32:54.789486 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-03-16 14:32:54.789573 | controller | Monday 16 March 2026  14:32:54 +0000 (0:00:00.035)       0:03:11.208 **********
2026-03-16 14:32:54.829548 | controller | skipping: [instance]
2026-03-16 14:32:54.829620 | controller |
2026-03-16 14:32:54.829758 | controller | TASK [reproducer : Get rhos-release] *******************************************
2026-03-16 14:32:54.829842 | controller | Monday 16 March 2026  14:32:54 +0000 (0:00:00.040)       0:03:11.249 **********
2026-03-16 14:32:54.861546 | controller | skipping: [instance]
2026-03-16 14:32:54.861725 | controller |
2026-03-16 14:32:54.861912 | controller | TASK [reproducer : Install repos] **********************************************
2026-03-16 14:32:54.862137 | controller | Monday 16 March 2026  14:32:54 +0000 (0:00:00.031)       0:03:11.281 **********
2026-03-16 14:32:54.898696 | controller | skipping: [instance]
2026-03-16 14:32:54.898775 | controller |
2026-03-16 14:32:54.898879 | controller | TASK [reproducer : Run custom commands after rhos-release setup] ***************
2026-03-16 14:32:54.899006 | controller | Monday 16 March 2026  14:32:54 +0000 (0:00:00.037)       0:03:11.318 **********
2026-03-16 14:32:54.931786 | controller | skipping: [instance]
2026-03-16 14:32:54.931894 | controller |
2026-03-16 14:32:54.932180 | controller | TASK [reproducer : Create bundle for CRC] **************************************
2026-03-16 14:32:54.932392 | controller | Monday 16 March 2026  14:32:54 +0000 (0:00:00.032)       0:03:11.351 **********
2026-03-16 14:32:54.961639 | controller | skipping: [instance]
2026-03-16 14:32:54.961672 | controller |
2026-03-16 14:32:54.961771 | controller | TASK [reproducer : Install some tools] *****************************************
2026-03-16 14:32:54.961861 | controller | Monday 16 March 2026  14:32:54 +0000 (0:00:00.030)       0:03:11.381 **********
2026-03-16 14:32:55.979245 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:32:57.046795 | controller |
2026-03-16 14:32:57.046829 | controller | TASK [reproducer : Inject command aliases for faster debugging] ****************
2026-03-16 14:32:57.046837 | controller | Monday 16 March 2026  14:32:55 +0000 (0:00:01.016)       0:03:12.398 **********
2026-03-16 14:32:57.046848 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:32:57.645891 | controller |
2026-03-16 14:32:57.645929 | controller | TASK [reproducer : Build job inventory for hook usage] *************************
2026-03-16 14:32:57.645937 | controller | Monday 16 March 2026  14:32:57 +0000 (0:00:01.067)       0:03:13.465 **********
2026-03-16 14:32:57.645948 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:32:57.645974 | controller |
2026-03-16 14:32:57.646450 | controller | TASK [reproducer : Push the MAC mapping data] **********************************
2026-03-16 14:32:58.587294 | controller | Monday 16 March 2026  14:32:57 +0000 (0:00:00.599)       0:03:14.064 **********
2026-03-16 14:32:58.587381 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:32:59.638217 | controller |
2026-03-16 14:32:59.638270 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] ***************************
2026-03-16 14:32:59.638282 | controller | Monday 16 March 2026  14:32:58 +0000 (0:00:00.941)       0:03:15.006 **********
2026-03-16 14:32:59.638300 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2026-03-16 14:33:00.344225 | controller | skipping: [instance] => (item=compute-0)
2026-03-16 14:33:00.344262 | controller | skipping: [instance] => (item=controller-0)
2026-03-16 14:33:00.344270 | controller | skipping: [instance] => (item=crc-0)
2026-03-16 14:33:00.344276 | controller |
2026-03-16 14:33:00.344281 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] *****************
2026-03-16 14:33:00.344287 | controller | Monday 16 March 2026  14:32:59 +0000 (0:00:01.050)       0:03:16.056 **********
2026-03-16 14:33:00.344298 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2026-03-16 14:33:02.206599 | controller | skipping: [instance] => (item=compute-0)
2026-03-16 14:33:02.206636 | controller | skipping: [instance] => (item=controller-0)
2026-03-16 14:33:02.206643 | controller | skipping: [instance] => (item=crc-0)
2026-03-16 14:33:02.206648 | controller |
2026-03-16 14:33:02.206654 | controller | TASK [reproducer : Inject SSH configuration] ***********************************
2026-03-16 14:33:02.206661 | controller | Monday 16 March 2026  14:33:00 +0000 (0:00:00.705)       0:03:16.762 **********
2026-03-16 14:33:02.206672 | controller | skipping: [instance] => (item=instance)
2026-03-16 14:33:02.816722 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0)
2026-03-16 14:33:02.816761 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2026-03-16 14:33:02.816767 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0)
2026-03-16 14:33:02.816773 | controller |
2026-03-16 14:33:02.816778 | controller | TASK [reproducer : Create kube directory] **************************************
2026-03-16 14:33:02.816784 | controller | Monday 16 March 2026  14:33:02 +0000 (0:00:01.857)       0:03:18.619 **********
2026-03-16 14:33:02.816794 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:33:04.007739 | controller |
2026-03-16 14:33:04.007773 | controller | TASK [reproducer : Inject kubeconfig content] **********************************
2026-03-16 14:33:04.007781 | controller | Monday 16 March 2026  14:33:02 +0000 (0:00:00.615)       0:03:19.235 **********
2026-03-16 14:33:04.007791 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:33:05.037776 | controller |
2026-03-16 14:33:05.037810 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************
2026-03-16 14:33:05.037817 | controller | Monday 16 March 2026  14:33:04 +0000 (0:00:01.191)       0:03:20.426 **********
2026-03-16 14:33:05.037834 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:33:05.078982 | controller |
2026-03-16 14:33:05.079028 | controller | TASK [reproducer : Inject devscripts private key if set] ***********************
2026-03-16 14:33:05.079035 | controller | Monday 16 March 2026  14:33:05 +0000 (0:00:01.030)       0:03:21.456 **********
2026-03-16 14:33:05.079046 | controller | skipping: [instance]
2026-03-16 14:33:05.705980 | controller |
2026-03-16 14:33:05.706026 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ******************************
2026-03-16 14:33:05.706034 | controller | Monday 16 March 2026  14:33:05 +0000 (0:00:00.041)       0:03:21.498 **********
2026-03-16 14:33:05.706045 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:33:06.316929 | controller |
2026-03-16 14:33:06.316963 | controller | TASK [manage_secrets : Ensure directory tree exist] ****************************
2026-03-16 14:33:06.316971 | controller | Monday 16 March 2026  14:33:05 +0000 (0:00:00.626)       0:03:22.124 **********
2026-03-16 14:33:06.316997 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:33:06.361697 | controller |
2026-03-16 14:33:06.361716 | controller | TASK [manage_secrets : Assert we get needed data] ******************************
2026-03-16 14:33:06.361723 | controller | Monday 16 March 2026  14:33:06 +0000 (0:00:00.611)       0:03:22.735 **********
2026-03-16 14:33:06.361732 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:33:06.430253 | controller |
2026-03-16 14:33:06.430270 | controller | TASK [manage_secrets : Push reproducer secrets] ********************************
2026-03-16 14:33:06.430277 | controller | Monday 16 March 2026  14:33:06 +0000 (0:00:00.045)       0:03:22.781 **********
2026-03-16 14:33:06.430286 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'})
2026-03-16 14:33:06.488788 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'})
2026-03-16 14:33:06.488820 | controller |
2026-03-16 14:33:06.488829 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2026-03-16 14:33:06.488835 | controller | Monday 16 March 2026  14:33:06 +0000 (0:00:00.068)       0:03:22.849 **********
2026-03-16 14:33:06.488843 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-16 14:33:06.541282 | controller |   _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt
2026-03-16 14:33:06.541300 | controller |
2026-03-16 14:33:06.541306 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2026-03-16 14:33:06.541312 | controller | Monday 16 March 2026  14:33:06 +0000 (0:00:00.058)       0:03:22.908 **********
2026-03-16 14:33:06.541320 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-16 14:33:06.593229 | controller |   _secret_file: ''
2026-03-16 14:33:06.593247 | controller |
2026-03-16 14:33:06.593255 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2026-03-16 14:33:06.593261 | controller | Monday 16 March 2026  14:33:06 +0000 (0:00:00.052)       0:03:22.960 **********
2026-03-16 14:33:06.593270 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-16 14:33:06.642608 | controller |   _secret_content: my-default-location-place
2026-03-16 14:33:06.642625 | controller |
2026-03-16 14:33:06.642632 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2026-03-16 14:33:06.642638 | controller | Monday 16 March 2026  14:33:06 +0000 (0:00:00.051)       0:03:23.012 **********
2026-03-16 14:33:06.642646 | controller | skipping: [instance]
2026-03-16 14:33:06.696435 | controller |
2026-03-16 14:33:06.696452 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2026-03-16 14:33:06.696459 | controller | Monday 16 March 2026  14:33:06 +0000 (0:00:00.049)       0:03:23.062 **********
2026-03-16 14:33:06.696467 | controller | skipping: [instance]
2026-03-16 14:33:06.744778 | controller |
2026-03-16 14:33:06.744796 | controller | TASK [manage_secrets : Copy file to location] **********************************
2026-03-16 14:33:06.744802 | controller | Monday 16 March 2026  14:33:06 +0000 (0:00:00.053)       0:03:23.115 **********
2026-03-16 14:33:06.744811 | controller | skipping: [instance]
2026-03-16 14:33:07.733662 | controller |
2026-03-16 14:33:07.733694 | controller | TASK [manage_secrets : Create file from content] *******************************
2026-03-16 14:33:07.733701 | controller | Monday 16 March 2026  14:33:06 +0000 (0:00:00.048)       0:03:23.164 **********
2026-03-16 14:33:07.733713 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:33:07.787910 | controller |
2026-03-16 14:33:07.787939 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2026-03-16 14:33:07.787947 | controller | Monday 16 March 2026  14:33:07 +0000 (0:00:00.988)       0:03:24.152 **********
2026-03-16 14:33:07.787957 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-16 14:33:07.836757 | controller |   _secret_dest: /home/zuul/ipmi-things
2026-03-16 14:33:07.836788 | controller |
2026-03-16 14:33:07.836795 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2026-03-16 14:33:07.836801 | controller | Monday 16 March 2026  14:33:07 +0000 (0:00:00.054)       0:03:24.207 **********
2026-03-16 14:33:07.836811 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-16 14:33:07.886659 | controller |   _secret_file: /tmp/ipmi-things
2026-03-16 14:33:07.886689 | controller |
2026-03-16 14:33:07.886696 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2026-03-16 14:33:07.886702 | controller | Monday 16 March 2026  14:33:07 +0000 (0:00:00.048)       0:03:24.255 **********
2026-03-16 14:33:07.886728 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-16 14:33:07.942902 | controller |   _secret_content: ''
2026-03-16 14:33:07.942925 | controller |
2026-03-16 14:33:07.942933 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2026-03-16 14:33:07.942947 | controller | Monday 16 March 2026  14:33:07 +0000 (0:00:00.049)       0:03:24.305 **********
2026-03-16 14:33:07.942959 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false
2026-03-16 14:33:08.542761 | controller |   msg: All assertions passed
2026-03-16 14:33:08.542794 | controller |
2026-03-16 14:33:08.542802 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2026-03-16 14:33:08.542808 | controller | Monday 16 March 2026  14:33:07 +0000 (0:00:00.056)       0:03:24.361 **********
2026-03-16 14:33:08.542819 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:33:09.618657 | controller |
2026-03-16 14:33:09.618692 | controller | TASK [manage_secrets : Copy file to location] **********************************
2026-03-16 14:33:09.618699 | controller | Monday 16 March 2026  14:33:08 +0000 (0:00:00.599)       0:03:24.961 **********
2026-03-16 14:33:09.618710 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:33:09.677284 | controller |
2026-03-16 14:33:09.677310 | controller | TASK [manage_secrets : Create file from content] *******************************
2026-03-16 14:33:09.677318 | controller | Monday 16 March 2026  14:33:09 +0000 (0:00:01.075)       0:03:26.037 **********
2026-03-16 14:33:09.677328 | controller | skipping: [instance]
2026-03-16 14:33:10.311999 | controller |
2026-03-16 14:33:10.312033 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] **********************************
2026-03-16 14:33:10.312040 | controller | Monday 16 March 2026  14:33:09 +0000 (0:00:00.059)       0:03:26.096 **********
2026-03-16 14:33:10.312052 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:33:11.047681 | controller |
2026-03-16 14:33:11.047714 | controller | TASK [reproducer : Check if async file is still available] *********************
2026-03-16 14:33:11.047722 | controller | Monday 16 March 2026  14:33:10 +0000 (0:00:00.634)       0:03:26.730 **********
2026-03-16 14:33:11.047733 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:33:56.532237 | controller |
2026-03-16 14:33:56.535461 | controller | TASK [reproducer : Check package install status] *******************************
2026-03-16 14:33:56.535484 | controller | Monday 16 March 2026  14:33:11 +0000 (0:00:00.735)       0:03:27.466 **********
2026-03-16 14:33:56.535500 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left).
2026-03-16 14:33:56.535705 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left).
2026-03-16 14:33:56.535847 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left).
2026-03-16 14:33:56.535977 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left).
2026-03-16 14:33:56.536128 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left).
2026-03-16 14:33:56.536460 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left).
2026-03-16 14:33:56.536583 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left).
2026-03-16 14:33:56.539677 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left).
2026-03-16 14:33:56.539774 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:33:56.539871 | controller |
2026-03-16 14:33:56.540018 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] ***************
2026-03-16 14:33:56.540055 | controller | Monday 16 March 2026  14:33:56 +0000 (0:00:45.480)       0:04:12.946 **********
2026-03-16 14:33:57.172820 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:33:57.172910 | controller |
2026-03-16 14:33:57.172939 | controller | TASK [sushy_emulator : Install required packages] ******************************
2026-03-16 14:33:57.173038 | controller | Monday 16 March 2026  14:33:57 +0000 (0:00:00.642)       0:04:13.588 **********
2026-03-16 14:33:59.717357 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:33:59.766539 | controller |
2026-03-16 14:33:59.766570 | controller | TASK [sushy_emulator : Get ingresses domain] ***********************************
2026-03-16 14:33:59.766578 | controller | Monday 16 March 2026  14:33:59 +0000 (0:00:02.546)       0:04:16.135 **********
2026-03-16 14:33:59.766589 | controller | skipping: [instance]
2026-03-16 14:33:59.816790 | controller |
2026-03-16 14:33:59.816818 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] *********************
2026-03-16 14:33:59.816826 | controller | Monday 16 March 2026  14:33:59 +0000 (0:00:00.050)       0:04:16.185 **********
2026-03-16 14:33:59.816837 | controller | skipping: [instance]
2026-03-16 14:34:01.482063 | controller |
2026-03-16 14:34:01.482099 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] **********************
2026-03-16 14:34:01.482106 | controller | Monday 16 March 2026  14:33:59 +0000 (0:00:00.050)       0:04:16.236 **********
2026-03-16 14:34:01.482129 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:02.022548 | controller |
2026-03-16 14:34:02.022588 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ********************
2026-03-16 14:34:02.022603 | controller | Monday 16 March 2026  14:34:01 +0000 (0:00:01.664)       0:04:17.901 **********
2026-03-16 14:34:02.022614 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:02.328856 | controller |
2026-03-16 14:34:02.328921 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] *******************************
2026-03-16 14:34:02.328931 | controller | Monday 16 March 2026  14:34:02 +0000 (0:00:00.540)       0:04:18.441 **********
2026-03-16 14:34:02.328945 | controller | changed: [instance]
2026-03-16 14:34:03.111208 | controller |
2026-03-16 14:34:03.111268 | controller | TASK [sushy_emulator : Run ssh-keyscan] ****************************************
2026-03-16 14:34:03.111277 | controller | Monday 16 March 2026  14:34:02 +0000 (0:00:00.306)       0:04:18.747 **********
2026-03-16 14:34:03.111291 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:04.320291 | controller |
2026-03-16 14:34:04.320344 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************
2026-03-16 14:34:04.320353 | controller | Monday 16 March 2026  14:34:03 +0000 (0:00:00.782)       0:04:19.529 **********
2026-03-16 14:34:04.320365 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:04.366840 | controller |
2026-03-16 14:34:04.366861 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-16 14:34:04.366869 | controller | Monday 16 March 2026  14:34:04 +0000 (0:00:01.207)       0:04:20.736 **********
2026-03-16 14:34:04.366879 | controller | skipping: [instance]
2026-03-16 14:34:04.416525 | controller |
2026-03-16 14:34:04.416550 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-16 14:34:04.416559 | controller | Monday 16 March 2026  14:34:04 +0000 (0:00:00.049)       0:04:20.786 **********
2026-03-16 14:34:04.416569 | controller | skipping: [instance]
2026-03-16 14:34:04.461927 | controller |
2026-03-16 14:34:04.461949 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-16 14:34:04.461957 | controller | Monday 16 March 2026  14:34:04 +0000 (0:00:00.049)       0:04:20.835 **********
2026-03-16 14:34:04.461968 | controller | skipping: [instance]
2026-03-16 14:34:04.522506 | controller |
2026-03-16 14:34:04.522529 | controller | TASK [sushy_emulator : Generate list of filtered VMs] **************************
2026-03-16 14:34:04.522537 | controller | Monday 16 March 2026  14:34:04 +0000 (0:00:00.045)       0:04:20.881 **********
2026-03-16 14:34:04.522547 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:04.571271 | controller |
2026-03-16 14:34:04.571302 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] ***************************
2026-03-16 14:34:04.571309 | controller | Monday 16 March 2026  14:34:04 +0000 (0:00:00.060)       0:04:20.941 **********
2026-03-16 14:34:04.571320 | controller | skipping: [instance]
2026-03-16 14:34:04.614466 | controller |
2026-03-16 14:34:04.614492 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ********
2026-03-16 14:34:04.614499 | controller | Monday 16 March 2026  14:34:04 +0000 (0:00:00.048)       0:04:20.990 **********
2026-03-16 14:34:04.614509 | controller | skipping: [instance]
2026-03-16 14:34:04.659228 | controller |
2026-03-16 14:34:04.659247 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] ***************
2026-03-16 14:34:04.659255 | controller | Monday 16 March 2026  14:34:04 +0000 (0:00:00.043)       0:04:21.033 **********
2026-03-16 14:34:04.659264 | controller | skipping: [instance]
2026-03-16 14:34:05.388462 | controller |
2026-03-16 14:34:05.388517 | controller | TASK [sushy_emulator : Generate htpasswd string] *******************************
2026-03-16 14:34:05.388527 | controller | Monday 16 March 2026  14:34:04 +0000 (0:00:00.044)       0:04:21.078 **********
2026-03-16 14:34:05.388541 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:05.512766 | controller |
2026-03-16 14:34:05.513601 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] *********************
2026-03-16 14:34:05.513613 | controller | Monday 16 March 2026  14:34:05 +0000 (0:00:00.727)       0:04:21.805 **********
2026-03-16 14:34:05.513627 | controller | skipping: [instance] => (item=secret)
2026-03-16 14:34:06.814241 | controller | skipping: [instance] => (item=configmap)
2026-03-16 14:34:06.814293 | controller | skipping: [instance] => (item=pod)
2026-03-16 14:34:06.814300 | controller | skipping: [instance] => (item=service)
2026-03-16 14:34:06.814306 | controller | skipping: [instance] => (item=route)
2026-03-16 14:34:06.814311 | controller | skipping: [instance]
2026-03-16 14:34:06.814317 | controller |
2026-03-16 14:34:06.814323 | controller | TASK [sushy_emulator : Write sushy emulator config] ****************************
2026-03-16 14:34:06.814329 | controller | Monday 16 March 2026  14:34:05 +0000 (0:00:00.120)       0:04:21.926 **********
2026-03-16 14:34:06.814339 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:07.871445 | controller |
2026-03-16 14:34:07.871499 | controller | TASK [sushy_emulator : Write htpasswd string to file] **************************
2026-03-16 14:34:07.871509 | controller | Monday 16 March 2026  14:34:06 +0000 (0:00:01.306)       0:04:23.232 **********
2026-03-16 14:34:07.871522 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:07.917523 | controller |
2026-03-16 14:34:07.917556 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ********************
2026-03-16 14:34:07.917564 | controller | Monday 16 March 2026  14:34:07 +0000 (0:00:01.056)       0:04:24.289 **********
2026-03-16 14:34:07.917575 | controller | skipping: [instance]
2026-03-16 14:34:07.957743 | controller |
2026-03-16 14:34:07.957767 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] ***
2026-03-16 14:34:07.957776 | controller | Monday 16 March 2026  14:34:07 +0000 (0:00:00.046)       0:04:24.336 **********
2026-03-16 14:34:07.957785 | controller | skipping: [instance]
2026-03-16 14:34:08.048552 | controller |
2026-03-16 14:34:08.048613 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] *************************
2026-03-16 14:34:08.048629 | controller | Monday 16 March 2026  14:34:07 +0000 (0:00:00.040)       0:04:24.377 **********
2026-03-16 14:34:08.048642 | controller | skipping: [instance] => (item=secret)
2026-03-16 14:34:08.093038 | controller | skipping: [instance] => (item=configmap)
2026-03-16 14:34:08.093062 | controller | skipping: [instance] => (item=service)
2026-03-16 14:34:08.093070 | controller | skipping: [instance] => (item=route)
2026-03-16 14:34:08.093080 | controller | skipping: [instance]
2026-03-16 14:34:08.093087 | controller |
2026-03-16 14:34:08.093099 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] **********************
2026-03-16 14:34:08.093105 | controller | Monday 16 March 2026  14:34:08 +0000 (0:00:00.089)       0:04:24.466 **********
2026-03-16 14:34:08.093113 | controller | skipping: [instance]
2026-03-16 14:34:09.870817 | controller |
2026-03-16 14:34:09.870859 | controller | TASK [podman : Ensure podman is installed] *************************************
2026-03-16 14:34:09.870867 | controller | Monday 16 March 2026  14:34:08 +0000 (0:00:00.045)       0:04:24.512 **********
2026-03-16 14:34:09.870879 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:10.785659 | controller |
2026-03-16 14:34:10.785723 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] *********************
2026-03-16 14:34:10.785733 | controller | Monday 16 March 2026  14:34:09 +0000 (0:00:01.777)       0:04:26.289 **********
2026-03-16 14:34:10.785746 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:10.846073 | controller |
2026-03-16 14:34:10.846102 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] *******************
2026-03-16 14:34:10.846110 | controller | Monday 16 March 2026  14:34:10 +0000 (0:00:00.914)       0:04:27.203 **********
2026-03-16 14:34:10.846137 | controller | skipping: [instance]
2026-03-16 14:34:10.902580 | controller |
2026-03-16 14:34:10.902610 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] *******************
2026-03-16 14:34:10.902620 | controller | Monday 16 March 2026  14:34:10 +0000 (0:00:00.061)       0:04:27.265 **********
2026-03-16 14:34:10.902634 | controller | skipping: [instance]
2026-03-16 14:34:10.977863 | controller |
2026-03-16 14:34:10.977892 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] ***
2026-03-16 14:34:10.977900 | controller | Monday 16 March 2026  14:34:10 +0000 (0:00:00.056)       0:04:27.321 **********
2026-03-16 14:34:10.977910 | controller | skipping: [instance]
2026-03-16 14:34:23.087525 | controller |
2026-03-16 14:34:23.087579 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ********************
2026-03-16 14:34:23.087588 | controller | Monday 16 March 2026  14:34:10 +0000 (0:00:00.074)       0:04:27.396 **********
2026-03-16 14:34:23.087601 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:24.835797 | controller |
2026-03-16 14:34:24.835851 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] **************
2026-03-16 14:34:24.835860 | controller | Monday 16 March 2026  14:34:23 +0000 (0:00:12.109)       0:04:39.505 **********
2026-03-16 14:34:24.835874 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:26.185295 | controller |
2026-03-16 14:34:26.185357 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2026-03-16 14:34:26.185367 | controller | Monday 16 March 2026  14:34:24 +0000 (0:00:01.748)       0:04:41.254 **********
2026-03-16 14:34:26.185382 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2026-03-16 14:34:26.231746 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2026-03-16 14:34:26.231783 | controller |
2026-03-16 14:34:26.231791 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] *************
2026-03-16 14:34:26.231797 | controller | Monday 16 March 2026  14:34:26 +0000 (0:00:01.349)       0:04:42.603 **********
2026-03-16 14:34:26.231809 | controller | skipping: [instance]
2026-03-16 14:34:27.018217 | controller |
2026-03-16 14:34:27.018272 | controller | TASK [reproducer : Check if baremetal-info.yml exists] *************************
2026-03-16 14:34:27.018282 | controller | Monday 16 March 2026  14:34:26 +0000 (0:00:00.045)       0:04:42.648 **********
2026-03-16 14:34:27.018295 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:27.063378 | controller |
2026-03-16 14:34:27.063413 | controller | TASK [reproducer : Get content of baremetal-info file] *************************
2026-03-16 14:34:27.063421 | controller | Monday 16 March 2026  14:34:27 +0000 (0:00:00.787)       0:04:43.436 **********
2026-03-16 14:34:27.063433 | controller | skipping: [instance]
2026-03-16 14:34:27.119878 | controller |
2026-03-16 14:34:27.119904 | controller | TASK [reproducer : Interpret remote file content as yaml] **********************
2026-03-16 14:34:27.119912 | controller | Monday 16 March 2026  14:34:27 +0000 (0:00:00.043)       0:04:43.479 **********
2026-03-16 14:34:27.119932 | controller | skipping: [instance]
2026-03-16 14:34:27.181201 | controller |
2026-03-16 14:34:27.181232 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2026-03-16 14:34:27.181241 | controller | Monday 16 March 2026  14:34:27 +0000 (0:00:00.058)       0:04:43.538 **********
2026-03-16 14:34:27.181252 | controller | skipping: [instance]
2026-03-16 14:34:27.230758 | controller |
2026-03-16 14:34:27.230788 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2026-03-16 14:34:27.230796 | controller | Monday 16 March 2026  14:34:27 +0000 (0:00:00.061)       0:04:43.600 **********
2026-03-16 14:34:27.230809 | controller | skipping: [instance]
2026-03-16 14:34:27.367740 | controller |
2026-03-16 14:34:27.367800 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] *****************
2026-03-16 14:34:27.367809 | controller | Monday 16 March 2026  14:34:27 +0000 (0:00:00.049)       0:04:43.649 **********
2026-03-16 14:34:27.367822 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'})
2026-03-16 14:34:28.524961 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'})
2026-03-16 14:34:28.525017 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'})
2026-03-16 14:34:28.525036 | controller |
2026-03-16 14:34:28.525043 | controller | TASK [reproducer : Output baremetal info file] *********************************
2026-03-16 14:34:28.525056 | controller | Monday 16 March 2026  14:34:27 +0000 (0:00:00.136)       0:04:43.786 **********
2026-03-16 14:34:28.525069 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:28.573099 | controller |
2026-03-16 14:34:28.573191 | controller | TASK [reproducer : Output ironic_nodes to file] ********************************
2026-03-16 14:34:28.573205 | controller | Monday 16 March 2026  14:34:28 +0000 (0:00:01.157)       0:04:44.943 **********
2026-03-16 14:34:28.573223 | controller | skipping: [instance]
2026-03-16 14:34:28.701584 | controller |
2026-03-16 14:34:28.701625 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] *******************
2026-03-16 14:34:28.701635 | controller | Monday 16 March 2026  14:34:28 +0000 (0:00:00.047)       0:04:44.990 **********
2026-03-16 14:34:28.701647 | controller |
2026-03-16 14:34:28.763458 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] ***
2026-03-16 14:34:28.763485 | controller | Monday 16 March 2026  14:34:28 +0000 (0:00:00.129)       0:04:45.120 **********
2026-03-16 14:34:28.763499 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:28.820497 | controller |
2026-03-16 14:34:28.820527 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2026-03-16 14:34:28.820536 | controller | Monday 16 March 2026  14:34:28 +0000 (0:00:00.062)       0:04:45.182 **********
2026-03-16 14:34:28.820547 | controller | skipping: [instance]
2026-03-16 14:34:28.868957 | controller |
2026-03-16 14:34:28.868983 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2026-03-16 14:34:28.868991 | controller | Monday 16 March 2026  14:34:28 +0000 (0:00:00.057)       0:04:45.239 **********
2026-03-16 14:34:28.869001 | controller | skipping: [instance]
2026-03-16 14:34:30.379553 | controller |
2026-03-16 14:34:30.379590 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] ***
2026-03-16 14:34:30.379598 | controller | Monday 16 March 2026  14:34:28 +0000 (0:00:00.048)       0:04:45.288 **********
2026-03-16 14:34:30.379609 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:38.263259 | controller |
2026-03-16 14:34:38.263300 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] ***
2026-03-16 14:34:38.263308 | controller | Monday 16 March 2026  14:34:30 +0000 (0:00:01.510)       0:04:46.798 **********
2026-03-16 14:34:38.263320 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1)
2026-03-16 14:34:38.263551 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b)
2026-03-16 14:34:38.263563 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282)
2026-03-16 14:34:38.263569 | controller |
2026-03-16 14:34:38.263577 | controller | TASK [sushy_emulator : Verify baremetal VM power status] ***********************
2026-03-16 14:34:38.428328 | controller | Monday 16 March 2026  14:34:38 +0000 (0:00:07.883)       0:04:54.681 **********
2026-03-16 14:34:38.428354 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0)
2026-03-16 14:34:38.706315 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0)
2026-03-16 14:34:38.706373 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0)
2026-03-16 14:34:38.706382 | controller |
2026-03-16 14:34:38.706388 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] **********
2026-03-16 14:34:38.706394 | controller | Monday 16 March 2026  14:34:38 +0000 (0:00:00.165)       0:04:54.847 **********
2026-03-16 14:34:38.706404 | controller | ok: [instance -> localhost]
2026-03-16 14:34:38.706534 | controller |
2026-03-16 14:34:38.706545 | controller | TASK [reproducer : Sync local repositories to other hosts if present] **********
2026-03-16 14:34:38.706554 | controller | Monday 16 March 2026  14:34:38 +0000 (0:00:00.277)       0:04:55.125 **********
2026-03-16 14:34:40.614934 | controller | changed: [instance -> localhost] => (item=controller-0)
2026-03-16 14:34:41.301982 | controller |
2026-03-16 14:34:41.302024 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] ****
2026-03-16 14:34:41.302033 | controller | Monday 16 March 2026  14:34:40 +0000 (0:00:01.908)       0:04:57.033 **********
2026-03-16 14:34:41.302054 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:42.130155 | controller |
2026-03-16 14:34:42.130211 | controller | TASK [reproducer : Install ansible dependencies] *******************************
2026-03-16 14:34:42.130220 | controller | Monday 16 March 2026  14:34:41 +0000 (0:00:00.686)       0:04:57.719 **********
2026-03-16 14:34:42.130232 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:43.279192 | controller |
2026-03-16 14:34:43.279231 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] ***
2026-03-16 14:34:43.279238 | controller | Monday 16 March 2026  14:34:42 +0000 (0:00:00.828)       0:04:58.548 **********
2026-03-16 14:34:43.279249 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:43.943239 | controller |
2026-03-16 14:34:43.943278 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] ****
2026-03-16 14:34:43.943285 | controller | Monday 16 March 2026  14:34:43 +0000 (0:00:01.149)       0:04:59.698 **********
2026-03-16 14:34:43.943296 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:45.049802 | controller |
2026-03-16 14:34:45.049839 | controller | TASK [reproducer : Inject local environment parameters] ************************
2026-03-16 14:34:45.049847 | controller | Monday 16 March 2026  14:34:43 +0000 (0:00:00.663)       0:05:00.361 **********
2026-03-16 14:34:45.049862 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:45.633637 | controller |
2026-03-16 14:34:45.633669 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] ***
2026-03-16 14:34:45.633677 | controller | Monday 16 March 2026  14:34:45 +0000 (0:00:01.106)       0:05:01.468 **********
2026-03-16 14:34:45.633687 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:46.266879 | controller |
2026-03-16 14:34:46.266916 | controller | TASK [reproducer : Get interfaces-info content] ********************************
2026-03-16 14:34:46.266924 | controller | Monday 16 March 2026  14:34:45 +0000 (0:00:00.584)       0:05:02.052 **********
2026-03-16 14:34:46.266935 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:47.694793 | controller |
2026-03-16 14:34:47.694831 | controller | TASK [reproducer : Wait for OCP nodes to be ready] *****************************
2026-03-16 14:34:47.694839 | controller | Monday 16 March 2026  14:34:46 +0000 (0:00:00.632)       0:05:02.685 **********
2026-03-16 14:34:47.694853 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2026-03-16 14:34:47.734357 | controller |
2026-03-16 14:34:47.734379 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-16 14:34:47.734387 | controller | Monday 16 March 2026  14:34:47 +0000 (0:00:01.427)       0:05:04.113 **********
2026-03-16 14:34:47.734397 | controller | skipping: [instance]
2026-03-16 14:34:47.769306 | controller |
2026-03-16 14:34:47.769323 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-16 14:34:47.769330 | controller | Monday 16 March 2026  14:34:47 +0000 (0:00:00.039)       0:05:04.153 **********
2026-03-16 14:34:47.769339 | controller | skipping: [instance]
2026-03-16 14:34:47.808166 | controller |
2026-03-16 14:34:47.808187 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-16 14:34:47.808194 | controller | Monday 16 March 2026  14:34:47 +0000 (0:00:00.035)       0:05:04.188 **********
2026-03-16 14:34:47.808203 | controller | skipping: [instance]
2026-03-16 14:34:47.845468 | controller |
2026-03-16 14:34:47.845489 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-16 14:34:47.845496 | controller | Monday 16 March 2026  14:34:47 +0000 (0:00:00.038)       0:05:04.227 **********
2026-03-16 14:34:47.845505 | controller | skipping: [instance]
2026-03-16 14:34:47.884026 | controller |
2026-03-16 14:34:47.884059 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-16 14:34:47.884067 | controller | Monday 16 March 2026  14:34:47 +0000 (0:00:00.037)       0:05:04.264 **********
2026-03-16 14:34:47.884076 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:48.034947 | controller |
2026-03-16 14:34:48.034987 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-16 14:34:48.034996 | controller | Monday 16 March 2026  14:34:47 +0000 (0:00:00.038)       0:05:04.303 **********
2026-03-16 14:34:48.035017 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}})
2026-03-16 14:34:48.086038 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={})
2026-03-16 14:34:48.086084 | controller |
2026-03-16 14:34:48.086093 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-16 14:34:48.086100 | controller | Monday 16 March 2026  14:34:48 +0000 (0:00:00.150)       0:05:04.453 **********
2026-03-16 14:34:48.086111 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance
2026-03-16 14:34:51.660707 | controller |
2026-03-16 14:34:51.660746 | controller | TASK [networking_mapper : Gather the facts] ************************************
2026-03-16 14:34:51.660754 | controller | Monday 16 March 2026  14:34:48 +0000 (0:00:00.051)       0:05:04.505 **********
2026-03-16 14:34:51.660765 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2026-03-16 14:34:52.648438 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0)
2026-03-16 14:34:52.648478 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2026-03-16 14:34:52.648489 | controller |
2026-03-16 14:34:52.648498 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] ***
2026-03-16 14:34:52.648506 | controller | Monday 16 March 2026  14:34:51 +0000 (0:00:03.574)       0:05:08.079 **********
2026-03-16 14:34:52.648519 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:53.132806 | controller |
2026-03-16 14:34:53.132844 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-16 14:34:53.132852 | controller | Monday 16 March 2026  14:34:52 +0000 (0:00:00.987)       0:05:09.067 **********
2026-03-16 14:34:53.132863 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:54.061193 | controller |
2026-03-16 14:34:54.061233 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-16 14:34:54.061242 | controller | Monday 16 March 2026  14:34:53 +0000 (0:00:00.484)       0:05:09.551 **********
2026-03-16 14:34:54.061252 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:54.150954 | controller |
2026-03-16 14:34:54.150979 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-16 14:34:54.150987 | controller | Monday 16 March 2026  14:34:54 +0000 (0:00:00.928)       0:05:10.479 **********
2026-03-16 14:34:54.150996 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:54.209771 | controller |
2026-03-16 14:34:54.209791 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-16 14:34:54.209803 | controller | Monday 16 March 2026  14:34:54 +0000 (0:00:00.090)       0:05:10.570 **********
2026-03-16 14:34:54.209813 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:54.210013 | controller |
2026-03-16 14:34:54.210198 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-16 14:34:54.210337 | controller | Monday 16 March 2026  14:34:54 +0000 (0:00:00.059)       0:05:10.629 **********
2026-03-16 14:34:55.197682 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:34:55.197861 | controller |
2026-03-16 14:34:55.198000 | controller | TASK [reproducer : Inject CRC ssh key] *****************************************
2026-03-16 14:34:55.198167 | controller | Monday 16 March 2026  14:34:55 +0000 (0:00:00.987)       0:05:11.616 **********
2026-03-16 14:34:56.269594 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:02.269820 | controller |
2026-03-16 14:35:02.269858 | controller | TASK [reproducer : Ensure we have all dependencies installed] ******************
2026-03-16 14:35:02.269866 | controller | Monday 16 March 2026  14:34:56 +0000 (0:00:01.071)       0:05:12.688 **********
2026-03-16 14:35:02.269876 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left).
2026-03-16 14:35:02.458113 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:02.458167 | controller |
2026-03-16 14:35:02.458175 | controller | TASK [Configure ntp service] ***************************************************
2026-03-16 14:35:02.458205 | controller | Monday 16 March 2026  14:35:02 +0000 (0:00:06.000)       0:05:18.688 **********
2026-03-16 14:35:02.458216 | controller |
2026-03-16 14:35:03.501135 | controller | TASK [cifmw_ntp : Install chrony] **********************************************
2026-03-16 14:35:03.501173 | controller | Monday 16 March 2026  14:35:02 +0000 (0:00:00.188)       0:05:18.877 **********
2026-03-16 14:35:03.501185 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:04.539041 | controller |
2026-03-16 14:35:04.539087 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] *************************
2026-03-16 14:35:04.539096 | controller | Monday 16 March 2026  14:35:03 +0000 (0:00:01.042)       0:05:19.920 **********
2026-03-16 14:35:04.539106 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True})
2026-03-16 14:35:05.526998 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'})
2026-03-16 14:35:05.527035 | controller |
2026-03-16 14:35:05.527042 | controller | TASK [cifmw_ntp : Render chrony extra config file] *****************************
2026-03-16 14:35:05.527049 | controller | Monday 16 March 2026  14:35:04 +0000 (0:00:01.037)       0:05:20.957 **********
2026-03-16 14:35:05.527059 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:06.186047 | controller |
2026-03-16 14:35:06.186095 | controller | TASK [cifmw_ntp : Enable chrony service] ***************************************
2026-03-16 14:35:06.186104 | controller | Monday 16 March 2026  14:35:05 +0000 (0:00:00.988)       0:05:21.945 **********
2026-03-16 14:35:06.186114 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:06.316504 | controller |
2026-03-16 14:35:06.316529 | controller | TASK [reproducer : Configure CRC node if available] ****************************
2026-03-16 14:35:06.316537 | controller | Monday 16 March 2026  14:35:06 +0000 (0:00:00.659)       0:05:22.605 **********
2026-03-16 14:35:06.316547 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance
2026-03-16 14:35:06.801204 | controller |
2026-03-16 14:35:06.801242 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] ***
2026-03-16 14:35:06.801250 | controller | Monday 16 March 2026  14:35:06 +0000 (0:00:00.130)       0:05:22.735 **********
2026-03-16 14:35:06.801262 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:07.362756 | controller |
2026-03-16 14:35:07.362794 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ********************
2026-03-16 14:35:07.362802 | controller | Monday 16 March 2026  14:35:06 +0000 (0:00:00.480)       0:05:23.216 **********
2026-03-16 14:35:07.362813 | controller | ok: [instance -> crc-0(crc-0.instance)]
2026-03-16 14:35:07.990260 | controller |
2026-03-16 14:35:07.990299 | controller | TASK [reproducer : Configure local DNS for CRC pod] ****************************
2026-03-16 14:35:07.990308 | controller | Monday 16 March 2026  14:35:07 +0000 (0:00:00.565)       0:05:23.781 **********
2026-03-16 14:35:07.990318 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-16 14:35:08.575618 | controller |
2026-03-16 14:35:08.575662 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] ***************
2026-03-16 14:35:08.575670 | controller | Monday 16 March 2026  14:35:07 +0000 (0:00:00.627)       0:05:24.409 **********
2026-03-16 14:35:08.575681 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-16 14:35:08.622727 | controller |
2026-03-16 14:35:08.622763 | controller | TASK [Restart DNS in CRC VM] ***************************************************
2026-03-16 14:35:08.622773 | controller | Monday 16 March 2026  14:35:08 +0000 (0:00:00.585)       0:05:24.994 **********
2026-03-16 14:35:08.622785 | controller |
2026-03-16 14:35:09.116745 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] ***************
2026-03-16 14:35:09.116800 | controller | Monday 16 March 2026  14:35:08 +0000 (0:00:00.047)       0:05:25.042 **********
2026-03-16 14:35:09.116812 | controller | ok: [instance -> crc-0(crc-0.instance)]
2026-03-16 14:35:09.880929 | controller |
2026-03-16 14:35:09.880995 | controller | TASK [openshift_setup : Restart dnsmasq service if used] ***********************
2026-03-16 14:35:09.881009 | controller | Monday 16 March 2026  14:35:09 +0000 (0:00:00.492)       0:05:25.534 **********
2026-03-16 14:35:09.881019 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-16 14:35:09.911843 | controller |
2026-03-16 14:35:09.911871 | controller | TASK [openshift_setup : Stop dnsmasq] ******************************************
2026-03-16 14:35:09.911880 | controller | Monday 16 March 2026  14:35:09 +0000 (0:00:00.762)       0:05:26.297 **********
2026-03-16 14:35:09.911892 | controller | skipping: [instance]
2026-03-16 14:35:09.949808 | controller |
2026-03-16 14:35:09.949831 | controller | TASK [openshift_setup : Start dnsmasq] *****************************************
2026-03-16 14:35:09.949839 | controller | Monday 16 March 2026  14:35:09 +0000 (0:00:00.033)       0:05:26.330 **********
2026-03-16 14:35:09.949848 | controller | skipping: [instance]
2026-03-16 14:35:10.182334 | controller |
2026-03-16 14:35:10.182368 | controller | TASK [reproducer : Remove entry from /etc/hosts] *******************************
2026-03-16 14:35:10.182377 | controller | Monday 16 March 2026  14:35:09 +0000 (0:00:00.038)       0:05:26.369 **********
2026-03-16 14:35:10.182387 | controller | changed: [instance]
2026-03-16 14:35:10.259237 | controller |
2026-03-16 14:35:10.259272 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] **********************
2026-03-16 14:35:10.259283 | controller | Monday 16 March 2026  14:35:10 +0000 (0:00:00.232)       0:05:26.601 **********
2026-03-16 14:35:10.259297 | controller | skipping: [instance] => (item=)
2026-03-16 14:35:10.300996 | controller |
2026-03-16 14:35:10.301019 | controller | TASK [dnsmasq : Assert we have needed address data] ****************************
2026-03-16 14:35:10.301027 | controller | Monday 16 March 2026  14:35:10 +0000 (0:00:00.077)       0:05:26.678 **********
2026-03-16 14:35:10.301036 | controller | ok: [instance]
2026-03-16 14:35:10.386256 | controller |
2026-03-16 14:35:10.388299 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-16 14:35:10.388315 | controller | Monday 16 March 2026  14:35:10 +0000 (0:00:00.042)       0:05:26.720 **********
2026-03-16 14:35:10.388327 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2026-03-16 14:35:10.626023 | controller |
2026-03-16 14:35:10.626046 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-16 14:35:10.626054 | controller | Monday 16 March 2026  14:35:10 +0000 (0:00:00.082)       0:05:26.802 **********
2026-03-16 14:35:10.626065 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2026-03-16 14:35:10.675718 | controller |
2026-03-16 14:35:10.675737 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************
2026-03-16 14:35:10.675744 | controller | Monday 16 March 2026  14:35:10 +0000 (0:00:00.242)       0:05:27.045 **********
2026-03-16 14:35:10.675753 | controller |
2026-03-16 14:35:10.736861 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-16 14:35:10.736885 | controller | Monday 16 March 2026  14:35:10 +0000 (0:00:00.049)       0:05:27.094 **********
2026-03-16 14:35:10.736895 | controller | ok: [instance]
2026-03-16 14:35:10.798304 | controller |
2026-03-16 14:35:10.798322 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-16 14:35:10.798330 | controller | Monday 16 March 2026  14:35:10 +0000 (0:00:00.060)       0:05:27.155 **********
2026-03-16 14:35:10.798339 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-16 14:35:11.044800 | controller |
2026-03-16 14:35:11.044841 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-16 14:35:11.044850 | controller | Monday 16 March 2026  14:35:10 +0000 (0:00:00.061)       0:05:27.217 **********
2026-03-16 14:35:11.044862 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-16 14:35:11.099630 | controller |
2026-03-16 14:35:11.099648 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-16 14:35:11.099655 | controller | Monday 16 March 2026  14:35:11 +0000 (0:00:00.246)       0:05:27.463 **********
2026-03-16 14:35:11.099673 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-16 14:35:11.099996 | controller | skipping: [instance]
2026-03-16 14:35:11.139939 | controller |
2026-03-16 14:35:11.139962 | controller | TASK [dnsmasq : Remove crc.testing from host_records] **************************
2026-03-16 14:35:11.139970 | controller | Monday 16 March 2026  14:35:11 +0000 (0:00:00.054)       0:05:27.518 **********
2026-03-16 14:35:11.139980 | controller | skipping: [instance]
2026-03-16 14:35:11.140148 | controller |
2026-03-16 14:35:11.140294 | controller | TASK [reproducer : Ensure "testing" domain is "local"] *************************
2026-03-16 14:35:11.140428 | controller | Monday 16 March 2026  14:35:11 +0000 (0:00:00.034)       0:05:27.552 **********
2026-03-16 14:35:11.544101 | controller | changed: [instance]
2026-03-16 14:35:12.254155 | controller |
2026-03-16 14:35:12.254196 | controller | TASK [reproducer : Flush handlers] *********************************************
2026-03-16 14:35:12.254204 | controller | Monday 16 March 2026  14:35:11 +0000 (0:00:00.396)       0:05:27.949 **********
2026-03-16 14:35:12.254221 | controller |
2026-03-16 14:35:12.254227 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] ***********************************
2026-03-16 14:35:12.254232 | controller | Monday 16 March 2026  14:35:11 +0000 (0:00:00.013)       0:05:27.962 **********
2026-03-16 14:35:12.254243 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:12.254389 | controller |
2026-03-16 14:35:12.254520 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-16 14:35:12.254639 | controller | Monday 16 March 2026  14:35:12 +0000 (0:00:00.706)       0:05:28.669 **********
2026-03-16 14:35:12.624228 | controller | changed: [instance]
2026-03-16 14:35:12.624303 | controller |
2026-03-16 14:35:12.624314 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] ****************
2026-03-16 14:35:12.624387 | controller | Monday 16 March 2026  14:35:12 +0000 (0:00:00.374)       0:05:29.043 **********
2026-03-16 14:35:12.798593 | controller | skipping: [instance] => (item=controller-0)
2026-03-16 14:35:14.307801 | controller | skipping: [instance] => (item=crc-0)
2026-03-16 14:35:14.307836 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0)
2026-03-16 14:35:14.307844 | controller |
2026-03-16 14:35:14.307850 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] **************
2026-03-16 14:35:14.307856 | controller | Monday 16 March 2026  14:35:12 +0000 (0:00:00.172)       0:05:29.215 **********
2026-03-16 14:35:14.307866 | controller | changed: [instance -> compute-0(compute-0.instance)]
2026-03-16 14:35:14.327949 | controller |
2026-03-16 14:35:14.327992 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2026-03-16 14:35:14.328000 | controller | Monday 16 March 2026  14:35:14 +0000 (0:00:01.511)       0:05:30.726 **********
2026-03-16 14:35:14.328011 | controller | skipping: [instance]
2026-03-16 14:35:14.328036 | controller |
2026-03-16 14:35:14.328044 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-03-16 14:35:14.328066 | controller | Monday 16 March 2026  14:35:14 +0000 (0:00:00.020)       0:05:30.746 **********
2026-03-16 14:35:14.886298 | controller | ok: [instance -> compute-0(compute-0.instance)]
2026-03-16 14:35:14.886362 | controller |
2026-03-16 14:35:14.886572 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-03-16 14:35:14.921546 | controller | Monday 16 March 2026  14:35:14 +0000 (0:00:00.558)       0:05:31.305 **********
2026-03-16 14:35:14.921612 | controller | skipping: [instance]
2026-03-16 14:35:14.921755 | controller |
2026-03-16 14:35:14.963929 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-03-16 14:35:14.963978 | controller | Monday 16 March 2026  14:35:14 +0000 (0:00:00.035)       0:05:31.340 **********
2026-03-16 14:35:14.963994 | controller | skipping: [instance]
2026-03-16 14:35:14.996194 | controller |
2026-03-16 14:35:14.996231 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-03-16 14:35:14.996239 | controller | Monday 16 March 2026  14:35:14 +0000 (0:00:00.040)       0:05:31.380 **********
2026-03-16 14:35:14.996257 | controller | skipping: [instance]
2026-03-16 14:35:14.996388 | controller |
2026-03-16 14:35:14.996412 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-03-16 14:35:15.035142 | controller | Monday 16 March 2026  14:35:14 +0000 (0:00:00.034)       0:05:31.415 **********
2026-03-16 14:35:15.035170 | controller | skipping: [instance]
2026-03-16 14:35:15.035199 | controller |
2026-03-16 14:35:15.035206 | controller | TASK [reproducer : Get rhos-release and setup repos] ***************************
2026-03-16 14:35:15.035213 | controller | Monday 16 March 2026  14:35:15 +0000 (0:00:00.038)       0:05:31.454 **********
2026-03-16 14:35:15.070228 | controller | skipping: [instance]
2026-03-16 14:35:15.070281 | controller |
2026-03-16 14:35:15.070549 | controller | TASK [reproducer : Create repositories on computes] ****************************
2026-03-16 14:35:15.090281 | controller | Monday 16 March 2026  14:35:15 +0000 (0:00:00.034)       0:05:31.489 **********
2026-03-16 14:35:15.090305 | controller | skipping: [instance]
2026-03-16 14:35:15.120169 | controller |
2026-03-16 14:35:15.120189 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] *********************
2026-03-16 14:35:15.120197 | controller | Monday 16 March 2026  14:35:15 +0000 (0:00:00.019)       0:05:31.509 **********
2026-03-16 14:35:15.120206 | controller | skipping: [instance]
2026-03-16 14:35:15.180707 | controller |
2026-03-16 14:35:15.180726 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] *******
2026-03-16 14:35:15.180734 | controller | Monday 16 March 2026  14:35:15 +0000 (0:00:00.029)       0:05:31.539 **********
2026-03-16 14:35:15.180743 | controller | ok: [instance]
2026-03-16 14:35:15.281055 | controller |
2026-03-16 14:35:15.281102 | controller | TASK [reproducer : Push local code] ********************************************
2026-03-16 14:35:15.281111 | controller | Monday 16 March 2026  14:35:15 +0000 (0:00:00.060)       0:05:31.600 **********
2026-03-16 14:35:15.281138 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance
2026-03-16 14:35:15.321482 | controller |
2026-03-16 14:35:15.321504 | controller | TASK [reproducer : Check if repository directories already exist] **************
2026-03-16 14:35:15.321518 | controller | Monday 16 March 2026  14:35:15 +0000 (0:00:00.100)       0:05:31.700 **********
2026-03-16 14:35:15.321528 | controller | skipping: [instance]
2026-03-16 14:35:15.362720 | controller |
2026-03-16 14:35:15.362763 | controller | TASK [reproducer : Ensure we are not in the job_id branch] *********************
2026-03-16 14:35:15.362772 | controller | Monday 16 March 2026  14:35:15 +0000 (0:00:00.040)       0:05:31.740 **********
2026-03-16 14:35:15.362783 | controller | skipping: [instance]
2026-03-16 14:35:15.362800 | controller |
2026-03-16 14:35:15.362809 | controller | TASK [reproducer : Fetch zuul.items repositories] ******************************
2026-03-16 14:35:15.362886 | controller | Monday 16 March 2026  14:35:15 +0000 (0:00:00.041)       0:05:31.782 **********
2026-03-16 14:35:15.404443 | controller | skipping: [instance]
2026-03-16 14:35:15.404482 | controller |
2026-03-16 14:35:15.404696 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] **********
2026-03-16 14:35:15.404731 | controller | Monday 16 March 2026  14:35:15 +0000 (0:00:00.041)       0:05:31.823 **********
2026-03-16 14:35:15.444041 | controller | skipping: [instance]
2026-03-16 14:35:15.480787 | controller |
2026-03-16 14:35:15.480808 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] ***
2026-03-16 14:35:15.480816 | controller | Monday 16 March 2026  14:35:15 +0000 (0:00:00.039)       0:05:31.863 **********
2026-03-16 14:35:15.480826 | controller | skipping: [instance]
2026-03-16 14:35:15.962859 | controller |
2026-03-16 14:35:15.962901 | controller | TASK [reproducer : Create target directories beforehand] ***********************
2026-03-16 14:35:15.962910 | controller | Monday 16 March 2026  14:35:15 +0000 (0:00:00.036)       0:05:31.900 **********
2026-03-16 14:35:15.962921 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators)
2026-03-16 14:35:15.962937 | controller |
2026-03-16 14:35:15.962943 | controller | TASK [reproducer : Sync local repositories to ansible controller] **************
2026-03-16 14:35:15.962950 | controller | Monday 16 March 2026  14:35:15 +0000 (0:00:00.481)       0:05:32.382 **********
2026-03-16 14:35:16.545911 | controller | ok: [instance -> localhost] => (item=ci-framework)
2026-03-16 14:35:16.587055 | controller |
2026-03-16 14:35:16.587113 | controller | TASK [reproducer : Sync remote repositories] ***********************************
2026-03-16 14:35:16.587142 | controller | Monday 16 March 2026  14:35:16 +0000 (0:00:00.582)       0:05:32.964 **********
2026-03-16 14:35:16.587178 | controller | skipping: [instance] => (item=ci-framework)
2026-03-16 14:35:16.587186 | controller | skipping: [instance]
2026-03-16 14:35:16.587191 | controller |
2026-03-16 14:35:16.587199 | controller | TASK [reproducer : Ensure default repositories are present] ********************
2026-03-16 14:35:16.587285 | controller | Monday 16 March 2026  14:35:16 +0000 (0:00:00.041)       0:05:33.006 **********
2026-03-16 14:35:16.663338 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework)
2026-03-16 14:35:16.663450 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls)
2026-03-16 14:35:16.663587 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture)
2026-03-16 14:35:16.663690 | controller |
2026-03-16 14:35:16.663801 | controller | TASK [reproducer : Check repository availability: ci-framework] ****************
2026-03-16 14:35:16.663898 | controller | Monday 16 March 2026  14:35:16 +0000 (0:00:00.076)       0:05:33.082 **********
2026-03-16 14:35:17.140494 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:17.140536 | controller |
2026-03-16 14:35:17.140668 | controller | TASK [reproducer : Clone repository if needed: ci-framework] *******************
2026-03-16 14:35:17.140753 | controller | Monday 16 March 2026  14:35:17 +0000 (0:00:00.476)       0:05:33.559 **********
2026-03-16 14:35:17.179533 | controller | skipping: [instance]
2026-03-16 14:35:17.179577 | controller |
2026-03-16 14:35:17.179696 | controller | TASK [reproducer : Check repository availability: install_yamls] ***************
2026-03-16 14:35:17.179786 | controller | Monday 16 March 2026  14:35:17 +0000 (0:00:00.039)       0:05:33.598 **********
2026-03-16 14:35:17.644836 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:17.644879 | controller |
2026-03-16 14:35:17.644980 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ******************
2026-03-16 14:35:17.645069 | controller | Monday 16 March 2026  14:35:17 +0000 (0:00:00.465)       0:05:34.064 **********
2026-03-16 14:35:17.682154 | controller | skipping: [instance]
2026-03-16 14:35:17.682262 | controller |
2026-03-16 14:35:17.682362 | controller | TASK [reproducer : Check repository availability: architecture] ****************
2026-03-16 14:35:17.682455 | controller | Monday 16 March 2026  14:35:17 +0000 (0:00:00.037)       0:05:34.101 **********
2026-03-16 14:35:18.133352 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:18.133406 | controller |
2026-03-16 14:35:18.133519 | controller | TASK [reproducer : Clone repository if needed: architecture] *******************
2026-03-16 14:35:18.133614 | controller | Monday 16 March 2026  14:35:18 +0000 (0:00:00.450)       0:05:34.552 **********
2026-03-16 14:35:20.615523 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:20.615571 | controller |
2026-03-16 14:35:20.615781 | controller | TASK [reproducer : Install collections on controller-0] ************************
2026-03-16 14:35:41.591908 | controller | Monday 16 March 2026  14:35:20 +0000 (0:00:02.482)       0:05:37.034 **********
2026-03-16 14:35:41.591954 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:42.689976 | controller |
2026-03-16 14:35:42.690020 | controller | TASK [reproducer : Inject CI Framework motd] ***********************************
2026-03-16 14:35:42.690039 | controller | Monday 16 March 2026  14:35:41 +0000 (0:00:20.975)       0:05:58.010 **********
2026-03-16 14:35:42.690051 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:42.690081 | controller |
2026-03-16 14:35:42.690088 | controller | TASK [reproducer : Rotate some logs] *******************************************
2026-03-16 14:35:42.690096 | controller | Monday 16 March 2026  14:35:42 +0000 (0:00:01.098)       0:05:59.108 **********
2026-03-16 14:35:42.799261 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log)
2026-03-16 14:35:42.799349 | controller |
2026-03-16 14:35:42.799619 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] *********************
2026-03-16 14:35:43.309257 | controller | Monday 16 March 2026  14:35:42 +0000 (0:00:00.109)       0:05:59.218 **********
2026-03-16 14:35:43.309300 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:43.349279 | controller |
2026-03-16 14:35:43.349372 | controller | TASK [reproducer : Rotate log if present] **************************************
2026-03-16 14:35:43.349383 | controller | Monday 16 March 2026  14:35:43 +0000 (0:00:00.510)       0:05:59.728 **********
2026-03-16 14:35:43.349403 | controller | skipping: [instance]
2026-03-16 14:35:43.391404 | controller |
2026-03-16 14:35:43.391432 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] ***********************
2026-03-16 14:35:43.391439 | controller | Monday 16 March 2026  14:35:43 +0000 (0:00:00.040)       0:05:59.768 **********
2026-03-16 14:35:43.391450 | controller | skipping: [instance]
2026-03-16 14:35:43.391589 | controller |
2026-03-16 14:35:43.391637 | controller | TASK [cifmw_setup : Get customized parameters] *********************************
2026-03-16 14:35:43.391651 | controller | Monday 16 March 2026  14:35:43 +0000 (0:00:00.042)       0:05:59.810 **********
2026-03-16 14:35:43.509274 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:43.509341 | controller |
2026-03-16 14:35:43.509536 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-03-16 14:35:44.045913 | controller | Monday 16 March 2026  14:35:43 +0000 (0:00:00.117)       0:05:59.928 **********
2026-03-16 14:35:44.045966 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:44.045997 | controller |
2026-03-16 14:35:44.046005 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-03-16 14:35:44.046096 | controller | Monday 16 March 2026  14:35:44 +0000 (0:00:00.536)       0:06:00.465 **********
2026-03-16 14:35:44.089713 | controller | skipping: [instance]
2026-03-16 14:35:44.089780 | controller |
2026-03-16 14:35:44.089790 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-03-16 14:35:44.089802 | controller | Monday 16 March 2026  14:35:44 +0000 (0:00:00.043)       0:06:00.508 **********
2026-03-16 14:35:44.131281 | controller | skipping: [instance]
2026-03-16 14:35:44.131370 | controller |
2026-03-16 14:35:44.131383 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-03-16 14:35:44.181289 | controller | Monday 16 March 2026  14:35:44 +0000 (0:00:00.041)       0:06:00.550 **********
2026-03-16 14:35:44.181335 | controller | skipping: [instance]
2026-03-16 14:35:44.181366 | controller |
2026-03-16 14:35:44.181630 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-03-16 14:35:44.235703 | controller | Monday 16 March 2026  14:35:44 +0000 (0:00:00.050)       0:06:00.600 **********
2026-03-16 14:35:44.235732 | controller | skipping: [instance]
2026-03-16 14:35:45.795059 | controller |
2026-03-16 14:35:45.795094 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2026-03-16 14:35:45.795135 | controller | Monday 16 March 2026  14:35:44 +0000 (0:00:00.053)       0:06:00.654 **********
2026-03-16 14:35:45.795151 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 14:35:46.896918 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 14:35:46.896969 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 14:35:46.896977 | controller | changed: [instance -> controller-0]
2026-03-16 14:35:46.896984 | controller |
2026-03-16 14:35:46.896990 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2026-03-16 14:35:46.896995 | controller | Monday 16 March 2026  14:35:45 +0000 (0:00:01.558)       0:06:02.213 **********
2026-03-16 14:35:46.897006 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:48.270244 | controller |
2026-03-16 14:35:48.270281 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2026-03-16 14:35:48.270294 | controller | Monday 16 March 2026  14:35:46 +0000 (0:00:01.102)       0:06:03.315 **********
2026-03-16 14:35:48.270305 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:55.923015 | controller |
2026-03-16 14:35:55.923054 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2026-03-16 14:35:55.923062 | controller | Monday 16 March 2026  14:35:48 +0000 (0:00:01.373)       0:06:04.689 **********
2026-03-16 14:35:55.923074 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:55.923171 | controller |
2026-03-16 14:35:55.923186 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2026-03-16 14:35:55.923286 | controller | Monday 16 March 2026  14:35:55 +0000 (0:00:07.652)       0:06:12.342 **********
2026-03-16 14:35:56.900371 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:56.900432 | controller |
2026-03-16 14:35:56.900520 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2026-03-16 14:35:56.900608 | controller | Monday 16 March 2026  14:35:56 +0000 (0:00:00.977)       0:06:13.319 **********
2026-03-16 14:35:56.946340 | controller | skipping: [instance]
2026-03-16 14:35:56.946391 | controller |
2026-03-16 14:35:56.946518 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2026-03-16 14:35:56.946609 | controller | Monday 16 March 2026  14:35:56 +0000 (0:00:00.046)       0:06:13.365 **********
2026-03-16 14:35:58.889856 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:35:58.944983 | controller |
2026-03-16 14:35:58.945018 | controller | TASK [repo_setup : Get component repo] *****************************************
2026-03-16 14:35:58.945027 | controller | Monday 16 March 2026  14:35:58 +0000 (0:00:01.943)       0:06:15.308 **********
2026-03-16 14:35:58.945037 | controller | skipping: [instance]
2026-03-16 14:35:58.997689 | controller |
2026-03-16 14:35:58.997721 | controller | TASK [repo_setup : Rename component repo] **************************************
2026-03-16 14:35:58.997729 | controller | Monday 16 March 2026  14:35:58 +0000 (0:00:00.055)       0:06:15.364 **********
2026-03-16 14:35:58.997739 | controller | skipping: [instance]
2026-03-16 14:35:59.058949 | controller |
2026-03-16 14:35:59.058975 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2026-03-16 14:35:59.058985 | controller | Monday 16 March 2026  14:35:58 +0000 (0:00:00.052)       0:06:15.416 **********
2026-03-16 14:35:59.058997 | controller | skipping: [instance]
2026-03-16 14:35:59.917677 | controller |
2026-03-16 14:35:59.917718 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2026-03-16 14:35:59.917728 | controller | Monday 16 March 2026  14:35:59 +0000 (0:00:00.061)       0:06:15.478 **********
2026-03-16 14:35:59.917741 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:36:00.814266 | controller |
2026-03-16 14:36:00.814303 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2026-03-16 14:36:00.814311 | controller | Monday 16 March 2026  14:35:59 +0000 (0:00:00.858)       0:06:16.336 **********
2026-03-16 14:36:00.814322 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:36:00.814415 | controller |
2026-03-16 14:36:00.814451 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2026-03-16 14:36:00.814466 | controller | Monday 16 March 2026  14:36:00 +0000 (0:00:00.896)       0:06:17.233 **********
2026-03-16 14:36:00.852630 | controller | skipping: [instance]
2026-03-16 14:36:00.890558 | controller |
2026-03-16 14:36:00.890603 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2026-03-16 14:36:00.890614 | controller | Monday 16 March 2026  14:36:00 +0000 (0:00:00.038)       0:06:17.271 **********
2026-03-16 14:36:00.890629 | controller | skipping: [instance]
2026-03-16 14:36:00.930677 | controller |
2026-03-16 14:36:00.930706 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2026-03-16 14:36:00.930714 | controller | Monday 16 March 2026  14:36:00 +0000 (0:00:00.037)       0:06:17.309 **********
2026-03-16 14:36:00.930724 | controller | skipping: [instance]
2026-03-16 14:36:00.982876 | controller |
2026-03-16 14:36:00.982896 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2026-03-16 14:36:00.982910 | controller | Monday 16 March 2026  14:36:00 +0000 (0:00:00.040)       0:06:17.350 **********
2026-03-16 14:36:00.982919 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:36:01.020109 | controller |
2026-03-16 14:36:01.020162 | controller | TASK [repo_setup : Create download directory] **********************************
2026-03-16 14:36:01.020171 | controller | Monday 16 March 2026  14:36:00 +0000 (0:00:00.052)       0:06:17.402 **********
2026-03-16 14:36:01.020183 | controller | skipping: [instance]
2026-03-16 14:36:01.057193 | controller |
2026-03-16 14:36:01.057218 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2026-03-16 14:36:01.057226 | controller | Monday 16 March 2026  14:36:01 +0000 (0:00:00.037)       0:06:17.439 **********
2026-03-16 14:36:01.057235 | controller | skipping: [instance]
2026-03-16 14:36:01.057436 | controller |
2026-03-16 14:36:01.057449 | controller | TASK [Download the RPM] ********************************************************
2026-03-16 14:36:01.094862 | controller | Monday 16 March 2026  14:36:01 +0000 (0:00:00.037)       0:06:17.476 **********
2026-03-16 14:36:01.094890 | controller | skipping: [instance]
2026-03-16 14:36:01.140138 | controller |
2026-03-16 14:36:01.140186 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2026-03-16 14:36:01.140195 | controller | Monday 16 March 2026  14:36:01 +0000 (0:00:00.037)       0:06:17.514 **********
2026-03-16 14:36:01.140206 | controller | skipping: [instance]
2026-03-16 14:36:01.140230 | controller |
2026-03-16 14:36:01.140304 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2026-03-16 14:36:01.140396 | controller | Monday 16 March 2026  14:36:01 +0000 (0:00:00.045)       0:06:17.559 **********
2026-03-16 14:36:01.180516 | controller | skipping: [instance]
2026-03-16 14:36:01.180581 | controller |
2026-03-16 14:36:01.180689 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2026-03-16 14:36:01.180772 | controller | Monday 16 March 2026  14:36:01 +0000 (0:00:00.040)       0:06:17.600 **********
2026-03-16 14:36:01.224744 | controller | skipping: [instance]
2026-03-16 14:36:01.224825 | controller |
2026-03-16 14:36:01.224926 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2026-03-16 14:36:01.225021 | controller | Monday 16 March 2026  14:36:01 +0000 (0:00:00.044)       0:06:17.644 **********
2026-03-16 14:36:01.266562 | controller | skipping: [instance]
2026-03-16 14:36:01.266643 | controller |
2026-03-16 14:36:01.266739 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2026-03-16 14:36:01.266834 | controller | Monday 16 March 2026  14:36:01 +0000 (0:00:00.041)       0:06:17.685 **********
2026-03-16 14:36:01.748592 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:36:01.748663 | controller |
2026-03-16 14:36:01.748778 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2026-03-16 14:36:01.748797 | controller | Monday 16 March 2026  14:36:01 +0000 (0:00:00.481)       0:06:18.167 **********
2026-03-16 14:36:01.811069 | controller | skipping: [instance]
2026-03-16 14:36:01.811206 | controller |
2026-03-16 14:36:01.811331 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2026-03-16 14:36:01.811440 | controller | Monday 16 March 2026  14:36:01 +0000 (0:00:00.062)       0:06:18.230 **********
2026-03-16 14:36:01.865610 | controller | skipping: [instance]
2026-03-16 14:36:01.865686 | controller |
2026-03-16 14:36:01.865780 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2026-03-16 14:36:01.865872 | controller | Monday 16 March 2026  14:36:01 +0000 (0:00:00.054)       0:06:18.285 **********
2026-03-16 14:36:01.912317 | controller | skipping: [instance]
2026-03-16 14:36:01.912397 | controller |
2026-03-16 14:36:01.912487 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2026-03-16 14:36:01.912570 | controller | Monday 16 March 2026  14:36:01 +0000 (0:00:00.046)       0:06:18.331 **********
2026-03-16 14:36:01.964023 | controller | skipping: [instance]
2026-03-16 14:36:01.964055 | controller |
2026-03-16 14:36:01.964207 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2026-03-16 14:36:01.964345 | controller | Monday 16 March 2026  14:36:01 +0000 (0:00:00.051)       0:06:18.383 **********
2026-03-16 14:36:02.013004 | controller | skipping: [instance]
2026-03-16 14:36:02.013066 | controller |
2026-03-16 14:36:02.013081 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2026-03-16 14:36:02.064853 | controller | Monday 16 March 2026  14:36:02 +0000 (0:00:00.048)       0:06:18.432 **********
2026-03-16 14:36:02.064877 | controller | skipping: [instance]
2026-03-16 14:36:02.064939 | controller |
2026-03-16 14:36:02.065030 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2026-03-16 14:36:02.065142 | controller | Monday 16 March 2026  14:36:02 +0000 (0:00:00.051)       0:06:18.483 **********
2026-03-16 14:36:02.124186 | controller | skipping: [instance]
2026-03-16 14:36:02.124307 | controller |
2026-03-16 14:36:02.124403 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] ***
2026-03-16 14:36:02.124494 | controller | Monday 16 March 2026  14:36:02 +0000 (0:00:00.059)       0:06:18.543 **********
2026-03-16 14:36:02.177686 | controller | skipping: [instance]
2026-03-16 14:36:02.177745 | controller |
2026-03-16 14:36:02.177844 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2026-03-16 14:36:02.177945 | controller | Monday 16 March 2026  14:36:02 +0000 (0:00:00.053)       0:06:18.597 **********
2026-03-16 14:36:02.806773 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:36:02.806826 | controller |
2026-03-16 14:36:02.806920 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2026-03-16 14:36:02.807008 | controller | Monday 16 March 2026  14:36:02 +0000 (0:00:00.628)       0:06:19.225 **********
2026-03-16 14:36:03.852472 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 14:36:03.852977 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 14:36:04.619299 | controller | changed: [instance -> controller-0]
2026-03-16 14:36:04.619340 | controller |
2026-03-16 14:36:04.619349 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2026-03-16 14:36:04.619357 | controller | Monday 16 March 2026  14:36:03 +0000 (0:00:01.045)       0:06:20.271 **********
2026-03-16 14:36:04.619369 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:36:05.164582 | controller |
2026-03-16 14:36:05.164632 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2026-03-16 14:36:05.164641 | controller | Monday 16 March 2026  14:36:04 +0000 (0:00:00.766)       0:06:21.038 **********
2026-03-16 14:36:05.164652 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:36:05.225650 | controller |
2026-03-16 14:36:05.225689 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2026-03-16 14:36:05.225698 | controller | Monday 16 March 2026  14:36:05 +0000 (0:00:00.544)       0:06:21.582 **********
2026-03-16 14:36:05.225710 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 14:36:05.225733 | controller | ok: [instance -> controller-0]
2026-03-16 14:36:05.225866 | controller |
2026-03-16 14:36:05.225885 | controller | TASK [ci_setup : List packages to install] *************************************
2026-03-16 14:36:05.225968 | controller | Monday 16 March 2026  14:36:05 +0000 (0:00:00.062)       0:06:21.645 **********
2026-03-16 14:36:05.273091 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 14:36:05.273367 | controller |
2026-03-16 14:36:05.273412 | controller | TASK [ci_setup : Install needed packages] **************************************
2026-03-16 14:36:41.787851 | controller | Monday 16 March 2026  14:36:05 +0000 (0:00:00.047)       0:06:21.692 **********
2026-03-16 14:36:41.787901 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false
2026-03-16 14:36:41.797688 | controller |   censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result'
2026-03-16 14:36:41.797716 | controller |
2026-03-16 14:36:42.023715 | controller | TASK [Create dnsmasq dir] ******************************************************
2026-03-16 14:36:42.023736 | controller | Monday 16 March 2026  14:36:41 +0000 (0:00:36.524)       0:06:58.217 **********
2026-03-16 14:36:42.023746 | controller | changed: [instance]
2026-03-16 14:36:42.285513 | controller |
2026-03-16 14:36:42.285538 | controller | TASK [Get journalctl in a file] ************************************************
2026-03-16 14:36:42.285545 | controller | Monday 16 March 2026  14:36:42 +0000 (0:00:00.225)       0:06:58.442 **********
2026-03-16 14:36:42.285554 | controller | changed: [instance]
2026-03-16 14:36:42.681197 | controller |
2026-03-16 14:36:42.681226 | controller | TASK [Dump journalctl output] **************************************************
2026-03-16 14:36:42.681234 | controller | Monday 16 March 2026  14:36:42 +0000 (0:00:00.261)       0:06:58.704 **********
2026-03-16 14:36:42.681243 | controller | changed: [instance]
2026-03-16 14:36:42.681267 | controller |
2026-03-16 14:36:42.681489 | controller | TASK [Copy all dnsmasq config] *************************************************
2026-03-16 14:36:43.195838 | controller | Monday 16 March 2026  14:36:42 +0000 (0:00:00.395)       0:06:59.100 **********
2026-03-16 14:36:43.195872 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2026-03-16 14:36:43.397736 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/)
2026-03-16 14:36:43.397768 | controller |
2026-03-16 14:36:43.397775 | controller | TASK [Create log directory] ****************************************************
2026-03-16 14:36:43.397781 | controller | Monday 16 March 2026  14:36:43 +0000 (0:00:00.514)       0:06:59.614 **********
2026-03-16 14:36:43.397791 | controller | changed: [instance]
2026-03-16 14:36:44.249847 | controller |
2026-03-16 14:36:44.249885 | controller | TASK [Sync logs from controller-0] *********************************************
2026-03-16 14:36:44.249893 | controller | Monday 16 March 2026  14:36:43 +0000 (0:00:00.201)       0:06:59.816 **********
2026-03-16 14:36:44.249903 | controller | changed: [instance]
2026-03-16 14:36:44.250150 | controller |
2026-03-16 14:36:44.250169 | controller | PLAY RECAP *********************************************************************
2026-03-16 14:36:44.250930 | controller | instance                   : ok=527  changed=202  unreachable=0    failed=1    skipped=216  rescued=0    ignored=0
2026-03-16 14:36:44.250969 | controller |
2026-03-16 14:36:44.251177 | controller | Monday 16 March 2026  14:36:44 +0000 (0:00:00.850)       0:07:00.667 **********
2026-03-16 14:36:44.251195 | controller | ===============================================================================
2026-03-16 14:36:44.251202 | controller | reproducer : Check package install status ------------------------------ 45.48s
2026-03-16 14:36:44.251208 | controller | ci_setup : Install needed packages ------------------------------------- 36.52s
2026-03-16 14:36:44.251213 | controller | libvirt_manager : Download base image ---------------------------------- 31.31s
2026-03-16 14:36:44.251219 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 22.98s
2026-03-16 14:36:44.251224 | controller | reproducer : Install collections on controller-0 ----------------------- 20.98s
2026-03-16 14:36:44.251230 | controller | libvirt_manager : Install packages required for using KVM -------------- 12.72s
2026-03-16 14:36:44.251238 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 12.11s
2026-03-16 14:36:44.251255 | controller | ci_nmstate : Install required packages on localhost --------------------- 8.02s
2026-03-16 14:36:44.251269 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 7.88s
2026-03-16 14:36:44.251286 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.65s
2026-03-16 14:36:44.251438 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.00s
2026-03-16 14:36:44.251579 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.61s
2026-03-16 14:36:44.251607 | controller | networking_mapper : Gather the facts ------------------------------------ 3.57s
2026-03-16 14:36:44.251616 | controller | dnsmasq : Add/Remove address -------------------------------------------- 2.97s
2026-03-16 14:36:44.251961 | controller | reproducer : Ensure the required parameters are loaded ------------------ 2.55s
2026-03-16 14:36:44.252107 | controller | sushy_emulator : Install required packages ------------------------------ 2.55s
2026-03-16 14:36:44.252145 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.48s
2026-03-16 14:36:44.252157 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s
2026-03-16 14:36:44.252170 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 1.95s
2026-03-16 14:36:44.363518 | controller | repo_setup : Run repo-setup --------------------------------------------- 1.94s
2026-03-16 14:36:44.363549 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml']
2026-03-16 14:36:44.363982 | controller | WARNING  An error occurred during the test sequence action: 'converge'. Cleaning up.
2026-03-16 14:36:44.373196 | controller | INFO     Running crc_layout > cleanup
2026-03-16 14:36:44.373661 | controller | WARNING  Skipping, cleanup playbook not configured.
2026-03-16 14:36:44.381645 | controller | INFO     Running crc_layout > destroy
2026-03-16 14:36:44.381979 | controller | WARNING  Skipping, instances are delegated.
2026-03-16 14:36:44.382342 | controller | INFO     Pruning extra files from scenario ephemeral directory
2026-03-16 14:36:44.383762 | controller | INFO     Writing /tmp/report.html report.
2026-03-16 14:36:44.745985 | [controller] Waiting on logger
2026-03-16 14:36:49.915859 | [controller] Waiting on logger
2026-03-16 14:37:00.347988 | [controller] Waiting on logger
2026-03-16 14:37:10.779866 | [controller] Waiting on logger
2026-03-16 14:37:14.481905 | [Zuul] Log Stream did not terminate
2026-03-16 14:37:14.482216 | controller | ERROR
2026-03-16 14:37:14.482386 | controller | {
2026-03-16 14:37:14.482442 | controller |   "delta": "0:08:34.471816",
2026-03-16 14:37:14.482477 | controller |   "end": "2026-03-16 14:36:44.446822",
2026-03-16 14:37:14.482506 | controller |   "msg": "non-zero return code",
2026-03-16 14:37:14.482533 | controller |   "rc": 1,
2026-03-16 14:37:14.482559 | controller |   "start": "2026-03-16 14:28:09.975006"
2026-03-16 14:37:14.482592 | controller | }
failure
2026-03-16 14:37:14.535261 | 
2026-03-16 14:37:14.535336 | PLAY RECAP
2026-03-16 14:37:14.535376 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0
2026-03-16 14:37:14.535396 | 
2026-03-16 14:37:14.595338 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2026-03-16 14:37:14.596260 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2026-03-16 14:37:15.094710 | 
2026-03-16 14:37:15.094807 | PLAY [Run ci/playbooks/collect-logs.yml]
2026-03-16 14:37:15.114622 | 
2026-03-16 14:37:15.114690 | TASK [Filter out host if needed]
2026-03-16 14:37:15.122989 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller
2026-03-16 14:37:15.127210 | 
2026-03-16 14:37:15.127277 | TASK [Ensure file is present]
2026-03-16 14:37:15.562647 | controller | ok
2026-03-16 14:37:15.567914 | 
2026-03-16 14:37:15.567975 | TASK [Manage molecule report file]
2026-03-16 14:37:15.590093 | [controller] Waiting on logger
2026-03-16 14:37:24.923883 | [controller] Waiting on logger
2026-03-16 14:37:35.356004 | [controller] Waiting on logger
2026-03-16 14:37:45.787965 | [controller] Waiting on logger
2026-03-16 14:37:46.041135 | [Zuul] Log Stream did not terminate
2026-03-16 14:37:46.041465 | controller | changed
2026-03-16 14:37:46.047606 | 
2026-03-16 14:37:46.047681 | TASK [Check if we get ci-framework-data basedir]
2026-03-16 14:37:46.299543 | controller | ok
2026-03-16 14:37:46.304117 | 
2026-03-16 14:37:46.304176 | TASK [Create ci-framework-data log directory for zuul]
2026-03-16 14:37:46.646665 | controller | changed
2026-03-16 14:37:46.651763 | 
2026-03-16 14:37:46.651825 | TASK [Copy ci-framework interesting files]
2026-03-16 14:37:49.755874 | [controller] Waiting on logger
2026-03-16 14:38:00.187823 | [controller] Waiting on logger
2026-03-16 14:38:10.619987 | [controller] Waiting on logger
2026-03-16 14:38:16.921419 | [Zuul] Log Stream did not terminate
2026-03-16 14:38:16.921655 | controller | changed
2026-03-16 14:38:16.926602 | 
2026-03-16 14:38:16.926666 | TASK [Get SELinux listing]
2026-03-16 14:38:16.945495 | [controller] Waiting on logger
2026-03-16 14:38:27.387784 | [controller] Waiting on logger
2026-03-16 14:38:36.768382 | [controller] Waiting on logger
2026-03-16 14:38:47.163797 | [controller] Waiting on logger
2026-03-16 14:38:47.208623 | [Zuul] Log Stream did not terminate
2026-03-16 14:38:47.208834 | controller | changed
2026-03-16 14:38:47.215291 | 
2026-03-16 14:38:47.215384 | TASK [Generate log index]
2026-03-16 14:38:49.446161 | controller | changed
2026-03-16 14:38:49.450850 | 
2026-03-16 14:38:49.450911 | TASK [Get some env related data]
2026-03-16 14:38:50.491747 | [controller] Waiting on logger
2026-03-16 14:39:05.787737 | [controller] Waiting on logger
2026-03-16 14:39:09.115807 | [controller] Waiting on logger
2026-03-16 14:39:21.212511 | [Zuul] Log Stream did not terminate
2026-03-16 14:39:21.212696 | controller | changed
2026-03-16 14:39:21.217663 | 
2026-03-16 14:39:21.217728 | TASK [Generate list of logs to collect in home directory]
2026-03-16 14:39:21.712999 | controller | ok: All paths examined
2026-03-16 14:39:21.718432 | 
2026-03-16 14:39:21.718495 | LOOP [Copy logs from home directory]
2026-03-16 14:39:22.810555 | controller | changed:
2026-03-16 14:39:22.810774 | controller | {
2026-03-16 14:39:22.810805 | controller |   "atime": 1772005405.932821,
2026-03-16 14:39:22.810826 | controller |   "ctime": 1772006396.9238591,
2026-03-16 14:39:22.810844 | controller |   "dev": 64513,
2026-03-16 14:39:22.810865 | controller |   "gid": 1000,
2026-03-16 14:39:22.810883 | controller |   "gr_name": "zuul",
2026-03-16 14:39:22.810899 | controller |   "inode": 2773,
2026-03-16 14:39:22.810914 | controller |   "isblk": false,
2026-03-16 14:39:22.810931 | controller |   "ischr": false,
2026-03-16 14:39:22.810946 | controller |   "isdir": false,
2026-03-16 14:39:22.810968 | controller |   "isfifo": false,
2026-03-16 14:39:22.810985 | controller |   "isgid": false,
2026-03-16 14:39:22.811003 | controller |   "islnk": false,
2026-03-16 14:39:22.811018 | controller |   "isreg": true,
2026-03-16 14:39:22.811033 | controller |   "issock": false,
2026-03-16 14:39:22.811047 | controller |   "isuid": false,
2026-03-16 14:39:22.811060 | controller |   "mode": "0644",
2026-03-16 14:39:22.811074 | controller |   "mtime": 1772006396.9238591,
2026-03-16 14:39:22.811088 | controller |   "nlink": 1,
2026-03-16 14:39:22.811101 | controller |   "path": "/home/zuul/crc-setup.log",
2026-03-16 14:39:22.811116 | controller |   "pw_name": "zuul",
2026-03-16 14:39:22.811131 | controller |   "rgrp": true,
2026-03-16 14:39:22.811145 | controller |   "roth": true,
2026-03-16 14:39:22.811259 | controller |   "rusr": true,
2026-03-16 14:39:22.811290 | controller |   "size": 4108,
2026-03-16 14:39:22.811372 | controller |   "uid": 1000,
2026-03-16 14:39:22.811393 | controller |   "wgrp": false,
2026-03-16 14:39:22.811410 | controller |   "woth": false,
2026-03-16 14:39:22.811425 | controller |   "wusr": true,
2026-03-16 14:39:22.811440 | controller |   "xgrp": false,
2026-03-16 14:39:22.811454 | controller |   "xoth": false,
2026-03-16 14:39:22.811468 | controller |   "xusr": false
2026-03-16 14:39:22.811483 | controller | }
2026-03-16 14:39:23.924825 | controller | changed:
2026-03-16 14:39:23.924915 | controller | {
2026-03-16 14:39:23.924942 | controller |   "atime": 1772006398.6759083,
2026-03-16 14:39:23.924962 | controller |   "ctime": 1772007098.5537844,
2026-03-16 14:39:23.924980 | controller |   "dev": 64513,
2026-03-16 14:39:23.924997 | controller |   "gid": 1000,
2026-03-16 14:39:23.925013 | controller |   "gr_name": "zuul",
2026-03-16 14:39:23.925092 | controller |   "inode": 359205,
2026-03-16 14:39:23.925159 | controller |   "isblk": false,
2026-03-16 14:39:23.925255 | controller |   "ischr": false,
2026-03-16 14:39:23.925276 | controller |   "isdir": false,
2026-03-16 14:39:23.925309 | controller |   "isfifo": false,
2026-03-16 14:39:23.925342 | controller |   "isgid": false,
2026-03-16 14:39:23.925361 | controller |   "islnk": false,
2026-03-16 14:39:23.925377 | controller |   "isreg": true,
2026-03-16 14:39:23.925391 | controller |   "issock": false,
2026-03-16 14:39:23.925407 | controller |   "isuid": false,
2026-03-16 14:39:23.925482 | controller |   "mode": "0644",
2026-03-16 14:39:23.925509 | controller |   "mtime": 1772007098.5537844,
2026-03-16 14:39:23.925527 | controller |   "nlink": 1,
2026-03-16 14:39:23.925543 | controller |   "path": "/home/zuul/crc-start.log",
2026-03-16 14:39:23.925559 | controller |   "pw_name": "zuul",
2026-03-16 14:39:23.925573 | controller |   "rgrp": true,
2026-03-16 14:39:23.925588 | controller |   "roth": true,
2026-03-16 14:39:23.925604 | controller |   "rusr": true,
2026-03-16 14:39:23.925618 | controller |   "size": 4654,
2026-03-16 14:39:23.925632 | controller |   "uid": 1000,
2026-03-16 14:39:23.925645 | controller |   "wgrp": false,
2026-03-16 14:39:23.925659 | controller |   "woth": false,
2026-03-16 14:39:23.925672 | controller |   "wusr": true,
2026-03-16 14:39:23.925686 | controller |   "xgrp": false,
2026-03-16 14:39:23.925700 | controller |   "xoth": false,
2026-03-16 14:39:23.925713 | controller |   "xusr": false
2026-03-16 14:39:23.925726 | controller | }
2026-03-16 14:39:25.092832 | controller | changed:
2026-03-16 14:39:25.092924 | controller | {
2026-03-16 14:39:25.092952 | controller |   "atime": 1773671271.2111506,
2026-03-16 14:39:25.092970 | controller |   "ctime": 1773671287.3922884,
2026-03-16 14:39:25.092988 | controller |   "dev": 64513,
2026-03-16 14:39:25.093006 | controller |   "gid": 1000,
2026-03-16 14:39:25.093022 | controller |   "gr_name": "zuul",
2026-03-16 14:39:25.093037 | controller |   "inode": 359222,
2026-03-16 14:39:25.093055 | controller |   "isblk": false,
2026-03-16 14:39:25.093071 | controller |   "ischr": false,
2026-03-16 14:39:25.093094 | controller |   "isdir": false,
2026-03-16 14:39:25.093108 | controller |   "isfifo": false,
2026-03-16 14:39:25.093128 | controller |   "isgid": false,
2026-03-16 14:39:25.093145 | controller |   "islnk": false,
2026-03-16 14:39:25.093159 | controller |   "isreg": true,
2026-03-16 14:39:25.093174 | controller |   "issock": false,
2026-03-16 14:39:25.093188 | controller |   "isuid": false,
2026-03-16 14:39:25.093202 | controller |   "mode": "0644",
2026-03-16 14:39:25.093216 | controller |   "mtime": 1773671287.3922884,
2026-03-16 14:39:25.093229 | controller |   "nlink": 1,
2026-03-16 14:39:25.093243 | controller |   "path": "/home/zuul/ansible.log",
2026-03-16 14:39:25.093257 | controller |   "pw_name": "zuul",
2026-03-16 14:39:25.093272 | controller |   "rgrp": true,
2026-03-16 14:39:25.093287 | controller |   "roth": true,
2026-03-16 14:39:25.093337 | controller |   "rusr": true,
2026-03-16 14:39:25.093359 | controller |   "size": 6749,
2026-03-16 14:39:25.093374 | controller |   "uid": 1000,
2026-03-16 14:39:25.093389 | controller |   "wgrp": false,
2026-03-16 14:39:25.093403 | controller |   "woth": false,
2026-03-16 14:39:25.093417 | controller |   "wusr": true,
2026-03-16 14:39:25.093430 | controller |   "xgrp": false,
2026-03-16 14:39:25.093444 | controller |   "xoth": false,
2026-03-16 14:39:25.093457 | controller |   "xusr": false
2026-03-16 14:39:25.093471 | controller | }
2026-03-16 14:39:25.104132 | 
2026-03-16 14:39:25.104246 | TASK [Copy crio stats log file]
2026-03-16 14:39:25.117714 | controller | skipping: Conditional result was False
2026-03-16 14:39:25.122837 | 
2026-03-16 14:39:25.122902 | TASK [Get SELinux related data]
2026-03-16 14:39:25.143183 | [controller] Waiting on logger
2026-03-16 14:39:35.547709 | [controller] Waiting on logger
2026-03-16 14:39:44.891931 | [controller] Waiting on logger
2026-03-16 14:39:55.323948 | [controller] Waiting on logger
2026-03-16 14:39:55.659216 | [Zuul] Log Stream did not terminate
2026-03-16 14:39:55.659397 | controller | ERROR
2026-03-16 14:39:55.659497 | controller | {
2026-03-16 14:39:55.659529 | controller |   "delta": "0:00:00.014320",
2026-03-16 14:39:55.659551 | controller |   "end": "2026-03-16 14:39:25.624302",
2026-03-16 14:39:55.659570 | controller |   "msg": "non-zero return code",
2026-03-16 14:39:55.659589 | controller |   "rc": 1,
2026-03-16 14:39:55.659607 | controller |   "start": "2026-03-16 14:39:25.609982"
2026-03-16 14:39:55.659627 | controller | }
2026-03-16 14:39:55.659654 | controller | ERROR: Ignoring Errors
2026-03-16 14:39:55.664739 | 
2026-03-16 14:39:55.664804 | TASK [Create system configuration directory]
2026-03-16 14:39:56.057469 | controller | changed
2026-03-16 14:39:56.062434 | 
2026-03-16 14:39:56.062499 | TASK [Get some of the system configurations]
2026-03-16 14:39:56.082633 | [controller] Waiting on logger
2026-03-16 14:40:06.523896 | [controller] Waiting on logger
2026-03-16 14:40:15.867928 | [controller] Waiting on logger
2026-03-16 14:40:26.299952 | [controller] Waiting on logger
2026-03-16 14:40:26.524761 | [Zuul] Log Stream did not terminate
2026-03-16 14:40:26.524995 | controller | changed
2026-03-16 14:40:26.530780 | 
2026-03-16 14:40:26.530847 | TASK [Copy generated documentation if available]
2026-03-16 14:40:26.544549 | controller | skipping: Conditional result was False
2026-03-16 14:40:26.549924 | 
2026-03-16 14:40:26.549994 | TASK [Copy generated AsciiDoc documentation if available]
2026-03-16 14:40:26.563460 | controller | skipping: Conditional result was False
2026-03-16 14:40:26.569209 | 
2026-03-16 14:40:26.569282 | TASK [Compress logs bigger than 2MB]
2026-03-16 14:40:29.691966 | [controller] Waiting on logger
2026-03-16 14:40:44.220048 | [controller] Waiting on logger
2026-03-16 14:40:54.652421 | [controller] Waiting on logger
2026-03-16 14:40:56.913340 | [Zuul] Log Stream did not terminate
2026-03-16 14:40:56.913726 | controller | changed
2026-03-16 14:40:56.919213 | 
2026-03-16 14:40:56.919278 | TASK [Copy files from workspace on node]
2026-03-16 14:40:56.937348 | controller | ok
2026-03-16 14:40:56.958699 | 
2026-03-16 14:40:56.958769 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-16 14:40:56.971596 | controller | skipping: Conditional result was False
2026-03-16 14:40:56.976722 | 
2026-03-16 14:40:56.976788 | TASK [fetch-output : Set log path for single node]
2026-03-16 14:40:56.994724 | controller | ok
2026-03-16 14:40:56.999439 | 
2026-03-16 14:40:56.999506 | LOOP [fetch-output : Ensure local output dirs]
2026-03-16 14:40:57.182732 | controller -> localhost | ok: "/var/lib/zuul/builds/d66db8af36854395b2cd08caae64fa6d/work/logs"
2026-03-16 14:40:57.182946 | controller -> localhost | changed: All items complete
2026-03-16 14:40:57.182978 | 
2026-03-16 14:40:57.355834 | controller -> localhost | changed: "/var/lib/zuul/builds/d66db8af36854395b2cd08caae64fa6d/work/artifacts"
2026-03-16 14:40:57.530918 | controller -> localhost | changed: "/var/lib/zuul/builds/d66db8af36854395b2cd08caae64fa6d/work/docs"
2026-03-16 14:40:57.545397 | 
2026-03-16 14:40:57.545511 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-16 14:41:04.059832 | [controller] Waiting on logger
2026-03-16 14:41:14.492364 | [controller] Waiting on logger
2026-03-16 14:41:23.872507 | [controller] Waiting on logger
2026-03-16 14:41:34.267627 | [controller] Waiting on logger
2026-03-16 14:41:44.700024 | [controller] Waiting on logger
2026-03-16 14:41:54.043849 | [controller] Waiting on logger
2026-03-16 14:42:04.476222 | [controller] Waiting on logger
2026-03-16 14:42:13.856687 | [controller] Waiting on logger
2026-03-16 14:42:24.251837 | [controller] Waiting on logger
2026-03-16 14:42:34.683910 | [controller] Waiting on logger
2026-03-16 14:42:44.027993 | [controller] Waiting on logger
2026-03-16 14:42:54.459980 | [controller] Waiting on logger
2026-03-16 14:43:03.840523 | [controller] Waiting on logger
2026-03-16 14:43:14.236122 | [controller] Waiting on logger
2026-03-16 14:43:24.667678 | [controller] Waiting on logger
2026-03-16 14:43:34.011867 | [controller] Waiting on logger
2026-03-16 14:43:44.443803 | [controller] Waiting on logger
2026-03-16 14:43:53.824978 | [controller] Waiting on logger
2026-03-16 14:44:04.220019 | [controller] Waiting on logger
2026-03-16 14:44:14.651909 | [controller] Waiting on logger
2026-03-16 14:44:23.995942 | [controller] Waiting on logger
2026-03-16 14:44:34.427774 | [controller] Waiting on logger
2026-03-16 14:44:43.808577 | [controller] Waiting on logger
2026-03-16 14:44:54.203945 | [controller] Waiting on logger
2026-03-16 14:45:04.635782 | [controller] Waiting on logger
2026-03-16 14:45:13.979916 | [controller] Waiting on logger
2026-03-16 14:45:24.411816 | [controller] Waiting on logger
2026-03-16 14:45:33.792221 | [controller] Waiting on logger
2026-03-16 14:45:44.187963 | [controller] Waiting on logger
2026-03-16 14:45:54.619857 | [controller] Waiting on logger
2026-03-16 14:46:03.963813 | [controller] Waiting on logger
2026-03-16 14:46:14.395764 | [controller] Waiting on logger
2026-03-16 14:46:23.776398 | [controller] Waiting on logger
2026-03-16 14:46:34.171891 | [controller] Waiting on logger
2026-03-16 14:46:44.603753 | [controller] Waiting on logger
2026-03-16 14:46:53.947768 | [controller] Waiting on logger
2026-03-16 14:47:04.380184 | [controller] Waiting on logger
2026-03-16 14:47:13.760217 | [controller] Waiting on logger
2026-03-16 14:47:24.155839 | [controller] Waiting on logger
2026-03-16 14:47:34.588070 | [controller] Waiting on logger
2026-03-16 14:47:43.931979 | [controller] Waiting on logger
2026-03-16 14:47:54.364013 | [controller] Waiting on logger
2026-03-16 14:48:04.795992 | [controller] Waiting on logger
2026-03-16 14:48:14.139913 | [controller] Waiting on logger
2026-03-16 14:48:24.572031 | [controller] Waiting on logger
2026-03-16 14:48:33.916140 | [controller] Waiting on logger
2026-03-16 14:48:44.347921 | [controller] Waiting on logger
2026-03-16 14:48:54.780450 | [controller] Waiting on logger
2026-03-16 14:49:04.123976 | [controller] Waiting on logger
2026-03-16 14:49:14.555889 | [controller] Waiting on logger
2026-03-16 14:49:23.899744 | [controller] Waiting on logger
2026-03-16 14:49:34.331925 | [controller] Waiting on logger
2026-03-16 14:49:44.763871 | [controller] Waiting on logger
2026-03-16 14:49:54.107963 | [controller] Waiting on logger
2026-03-16 14:50:02.778102 | controller | changed:
2026-03-16 14:50:02.778191 | controller | .d..t...... ./
2026-03-16 14:50:02.778218 | controller | >f+++++++++ README.html
2026-03-16 14:50:02.778237 | controller | >f+++++++++ ansible-execution.log
2026-03-16 14:50:02.778257 | controller | >f+++++++++ ansible.log
2026-03-16 14:50:02.778275 | controller | >f+++++++++ crc-setup.log
2026-03-16 14:50:02.778291 | controller | >f+++++++++ crc-start.log
2026-03-16 14:50:02.778332 | controller | >f+++++++++ dmesg.log
2026-03-16 14:50:02.778351 | controller | >f+++++++++ installed-pkgs.log
2026-03-16 14:50:02.778368 | controller | >f+++++++++ python.log
2026-03-16 14:50:02.778384 | controller | >f+++++++++ registries.conf
2026-03-16 14:50:02.778400 | controller | >f+++++++++ report.html
2026-03-16 14:50:02.778415 | controller | >f+++++++++ selinux-denials.log
2026-03-16 14:50:02.778429 | controller | >f+++++++++ selinux-listing.log
2026-03-16 14:50:02.778443 | controller | cd+++++++++ ci-framework-data/
2026-03-16 14:50:02.778458 | controller | cd+++++++++ ci-framework-data/artifacts/
2026-03-16 14:50:02.778472 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml
2026-03-16 14:50:02.778486 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/
2026-03-16 14:50:02.778500 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf
2026-03-16 14:50:02.778515 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf
2026-03-16 14:50:02.778529 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf
2026-03-16 14:50:02.778551 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf
2026-03-16 14:50:02.778568 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf
2026-03-16 14:50:02.778582 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log
2026-03-16 14:50:02.778596 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf
2026-03-16 14:50:02.778610 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf
2026-03-16 14:50:02.778624 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf
2026-03-16 14:50:02.778637 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf
2026-03-16 14:50:02.778651 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/
2026-03-16 14:50:02.778664 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:ba:3e:9c
2026-03-16 14:50:02.778679 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:aa:23:ce
2026-03-16 14:50:02.778693 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:e2:02:77
2026-03-16 14:50:02.778707 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:1e:1d:c5
2026-03-16 14:50:02.778721 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:70:3b:a3
2026-03-16 14:50:02.778734 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:26:05:5f
2026-03-16 14:50:02.778748 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/
2026-03-16 14:50:02.778762 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml
2026-03-16 14:50:02.778775 | controller | cd+++++++++ ci-framework-data/logs/
2026-03-16 14:50:02.778789 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log
2026-03-16 14:50:02.778802 | controller | cd+++++++++ ci-framework-data/logs/controller-0/
2026-03-16 14:50:02.778815 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log
2026-03-16 14:50:02.778829 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/
2026-03-16 14:50:02.778847 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/
2026-03-16 14:50:02.778862 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml
2026-03-16 14:50:02.778877 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml
2026-03-16 14:50:02.778891 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/
2026-03-16 14:50:02.778905 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo
2026-03-16 14:50:02.778919 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo
2026-03-16 14:50:02.778932 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5
2026-03-16 14:50:02.778946 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo
2026-03-16 14:50:02.778960 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo
2026-03-16 14:50:02.778973 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo
2026-03-16 14:50:02.778987 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo
2026-03-16 14:50:02.779000 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/
2026-03-16 14:50:02.779014 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd
2026-03-16 14:50:02.779028 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf
2026-03-16 14:50:02.779041 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts
2026-03-16 14:50:02.779055 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/
2026-03-16 14:50:02.779069 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml
2026-03-16 14:50:02.779082 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml
2026-03-16 14:50:02.779096 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml
2026-03-16 14:50:02.779110 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml
2026-03-16 14:50:02.779125 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/
2026-03-16 14:50:02.779139 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt
2026-03-16 14:50:02.779154 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/
2026-03-16 14:50:02.779168 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd
2026-03-16 14:50:02.779182 | controller | cd+++++++++ registries.conf.d/
2026-03-16 14:50:02.779196 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf
2026-03-16 14:50:02.779210 | controller | cd+++++++++ system-config/
2026-03-16 14:50:02.779224 | controller | cd+++++++++ system-config/libvirt/
2026-03-16 14:50:02.779238 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf
2026-03-16 14:50:02.779252 | controller | >f+++++++++ system-config/libvirt/libvirt.conf
2026-03-16 14:50:02.779266 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf
2026-03-16 14:50:02.779280 | controller | >f+++++++++ system-config/libvirt/network.conf
2026-03-16 14:50:02.779307 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf
2026-03-16 14:50:02.779333 | controller | >f+++++++++ system-config/libvirt/qemu.conf
2026-03-16 14:50:02.779350 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf
2026-03-16 14:50:02.779366 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf
2026-03-16 14:50:02.779382 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf
2026-03-16 14:50:02.779397 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf
2026-03-16 14:50:02.779412 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf
2026-03-16 14:50:02.779426 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf
2026-03-16 14:50:02.779439 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf
2026-03-16 14:50:02.779453 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf
2026-03-16 14:50:02.779466 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf
2026-03-16 14:50:02.779479 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf
2026-03-16 14:50:03.251264 | controller | changed: .d..t...... ./
2026-03-16 14:50:03.717078 | controller | changed: .d..t...... ./
2026-03-16 14:50:03.737106 | 
2026-03-16 14:50:03.737196 | TASK [Return artifact to Zuul]
2026-03-16 14:50:03.766148 | controller | ok
2026-03-16 14:50:03.784678 | 
2026-03-16 14:50:03.784736 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host]
2026-03-16 14:50:03.784862 | 
2026-03-16 14:50:03.784891 | PLAY RECAP
2026-03-16 14:50:03.784931 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1
2026-03-16 14:50:03.784954 | 
2026-03-16 14:50:03.868560 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2026-03-16 14:50:03.869348 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-03-16 14:50:04.366048 | 
2026-03-16 14:50:04.366168 | PLAY [all]
2026-03-16 14:50:04.384497 | 
2026-03-16 14:50:04.384581 | TASK [include_role : fetch-output]
2026-03-16 14:50:04.412961 | controller | ok
2026-03-16 14:50:04.430192 | 
2026-03-16 14:50:04.430273 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-16 14:50:04.464792 | controller | skipping: Conditional result was False
2026-03-16 14:50:04.470475 | 
2026-03-16 14:50:04.470563 | TASK [fetch-output : Set log path for single node]
2026-03-16 14:50:04.498118 | controller | ok
2026-03-16 14:50:04.503114 | 
2026-03-16 14:50:04.503185 | LOOP [fetch-output : Ensure local output dirs]
2026-03-16 14:50:04.807826 | controller -> localhost | ok: "/var/lib/zuul/builds/d66db8af36854395b2cd08caae64fa6d/work/logs"
2026-03-16 14:50:04.987225 | controller -> localhost | ok: "/var/lib/zuul/builds/d66db8af36854395b2cd08caae64fa6d/work/artifacts"
2026-03-16 14:50:05.161725 | controller -> localhost | ok: "/var/lib/zuul/builds/d66db8af36854395b2cd08caae64fa6d/work/docs"
2026-03-16 14:50:05.170704 | 
2026-03-16 14:50:05.170822 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-16 14:50:05.797785 | controller | ok
2026-03-16 14:50:05.798009 | controller | ok: All items complete
2026-03-16 14:50:05.798039 | 
2026-03-16 14:50:06.268235 | controller | ok
2026-03-16 14:50:06.724877 | controller | ok
2026-03-16 14:50:06.736268 | 
2026-03-16 14:50:06.736394 | TASK [include_role : fetch-output-openshift]
2026-03-16 14:50:06.749973 | controller | skipping: Conditional result was False
2026-03-16 14:50:06.755663 | 
2026-03-16 14:50:06.755737 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-16 14:50:07.071751 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006023
2026-03-16 14:50:07.251421 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.007120
2026-03-16 14:50:07.279364 | 
2026-03-16 14:50:07.279452 | PLAY [all]
2026-03-16 14:50:07.293430 | 
2026-03-16 14:50:07.293498 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-16 14:50:07.974477 | controller | changed
2026-03-16 14:50:07.995554 | 
2026-03-16 14:50:07.995617 | PLAY RECAP
2026-03-16 14:50:07.995662 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2026-03-16 14:50:07.995684 | 
2026-03-16 14:50:08.066464 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-03-16 14:50:08.067199 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master]
2026-03-16 14:50:08.590852 | 
2026-03-16 14:50:08.590951 | PLAY [localhost]
2026-03-16 14:50:08.606588 | 
2026-03-16 14:50:08.606660 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-16 14:50:08.897648 | localhost | changed
2026-03-16 14:50:08.902112 | 
2026-03-16 14:50:08.902200 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-16 14:50:08.929386 | localhost | ok
2026-03-16 14:50:08.936987 | 
2026-03-16 14:50:08.937073 | TASK [add-fileserver : Create SSH private key tempfile]
2026-03-16 14:50:09.207168 | localhost | changed
2026-03-16 14:50:09.212593 | 
2026-03-16 14:50:09.212660 | TASK [add-fileserver : Create SSH private key from secret]
2026-03-16 14:50:09.725626 | localhost | changed
2026-03-16 14:50:09.730635 | 
2026-03-16 14:50:09.730716 | TASK [add-fileserver : Add fileserver ssh key]
2026-03-16 14:50:10.052647 | localhost | Identity added: /var/lib/zuul/builds/d66db8af36854395b2cd08caae64fa6d/work/tmp/ansible.o6cneb53 (/var/lib/zuul/builds/d66db8af36854395b2cd08caae64fa6d/work/tmp/ansible.o6cneb53)
2026-03-16 14:50:10.052800 | localhost | ok: Runtime: 0:00:00.005970
2026-03-16 14:50:10.056939 | 
2026-03-16 14:50:10.057010 | TASK [add-fileserver : Remove SSH private key from disk]
2026-03-16 14:50:10.266586 | localhost | ok: Runtime: 0:00:00.004294
2026-03-16 14:50:10.270900 | 
2026-03-16 14:50:10.270964 | TASK [add-fileserver : Add fileserver to inventory]
2026-03-16 14:50:10.318818 | localhost | changed
2026-03-16 14:50:10.323394 | 
2026-03-16 14:50:10.323455 | TASK [add-fileserver : Add fileserver server to known hosts]
2026-03-16 14:50:10.613768 | localhost | changed
2026-03-16 14:50:10.632371 | 
2026-03-16 14:50:10.632447 | PLAY [localhost]
2026-03-16 14:50:10.642660 | 
2026-03-16 14:50:10.642721 | TASK [Generate bulk log download script]
2026-03-16 14:50:10.660798 | localhost | ok
2026-03-16 14:50:10.671075 | 
2026-03-16 14:50:10.671139 | TASK [local-log-download : Check API endpoint is defined]
2026-03-16 14:50:10.697869 | localhost | ok: All assertions passed
2026-03-16 14:50:10.701836 | 
2026-03-16 14:50:10.701895 | TASK [local-log-download : Create download script]
2026-03-16 14:50:11.022689 | localhost -> localhost | changed
2026-03-16 14:50:11.031427 | 
2026-03-16 14:50:11.031508 | TASK [Register quick-download link]
2026-03-16 14:50:11.052079 | localhost | ok
2026-03-16 14:50:11.086627 | 
2026-03-16 14:50:11.086685 | PLAY [logserver.rdoproject.org]
2026-03-16 14:50:11.095645 | 
2026-03-16 14:50:11.095706 | TASK [Set zuul-log-path fact]
2026-03-16 14:50:11.111048 | logserver.rdoproject.org | ok
2026-03-16 14:50:11.119716 | 
2026-03-16 14:50:11.119792 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-16 14:50:11.136468 | logserver.rdoproject.org | ok
2026-03-16 14:50:11.141273 | 
2026-03-16 14:50:11.141352 | TASK [upload-logs : Create log directories]
2026-03-16 14:50:13.055830 | logserver.rdoproject.org | changed
2026-03-16 14:50:13.059062 | 
2026-03-16 14:50:13.059130 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-16 14:50:13.265159 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005049
2026-03-16 14:50:13.269507 | 
2026-03-16 14:50:13.269579 | TASK [upload-logs : Upload logs to log server]
2026-03-16 14:50:14.787418 | logserver.rdoproject.org | Output suppressed because no_log was given
2026-03-16 14:50:14.790058 | 
2026-03-16 14:50:14.790120 | LOOP [upload-logs : Compress console log and json output]
2026-03-16 14:50:14.826618 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-16 14:50:14.834892 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-16 14:50:14.847930 | 
2026-03-16 14:50:14.848013 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-16 14:50:14.881675 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-16 14:50:14.881894 | 
2026-03-16 14:50:14.885289 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-16 14:50:14.895692 | 
2026-03-16 14:50:14.895775 | LOOP [upload-logs : Upload console log and json output]