2026-02-25 15:37:20.756851 | Job console starting... 2026-02-25 15:37:20.974485 | Updating repositories 2026-02-25 15:37:22.578911 | Preparing job workspace 2026-02-25 15:37:30.601236 | Running Ansible setup... 2026-02-25 15:37:34.022641 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-25 15:37:34.526269 | 2026-02-25 15:37:34.526378 | PLAY [localhost] 2026-02-25 15:37:34.534772 | 2026-02-25 15:37:34.534865 | TASK [Gathering Facts] 2026-02-25 15:37:35.300506 | localhost | ok 2026-02-25 15:37:35.313138 | 2026-02-25 15:37:35.313218 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-02-25 15:37:35.622091 | localhost -> localhost | changed 2026-02-25 15:37:35.648370 | 2026-02-25 15:37:35.648442 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-02-25 15:37:36.289392 | localhost -> localhost | changed 2026-02-25 15:37:36.297358 | 2026-02-25 15:37:36.297432 | TASK [Setup log path fact] 2026-02-25 15:37:36.313824 | localhost | ok 2026-02-25 15:37:36.324087 | 2026-02-25 15:37:36.324156 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-25 15:37:36.339832 | localhost | ok 2026-02-25 15:37:36.346504 | 2026-02-25 15:37:36.346569 | TASK [emit-job-header : Print job information] 2026-02-25 15:37:36.372941 | # Job Information 2026-02-25 15:37:36.373051 | Ansible Version: 2.15.12 2026-02-25 15:37:36.373079 | Job: cifmw-molecule-reproducer 2026-02-25 15:37:36.373101 | Pipeline: github-check 2026-02-25 15:37:36.373121 | Executor: ibm-bm4-ze.softwarefactory-project.io 2026-02-25 15:37:36.373140 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3704 2026-02-25 15:37:36.373158 | Log URL (when completed): https://logserver.rdoproject.org/b37/rdoproject.org/b37114dec2754585958f470bb78dd97b/ 2026-02-25 15:37:36.373177 | Event ID: bb5ea090-125f-11f1-951a-9931e236e018 2026-02-25 15:37:36.376595 | 2026-02-25 15:37:36.376657 | LOOP [emit-job-header : Print node information] 2026-02-25 15:37:36.453526 | localhost | ok: 2026-02-25 15:37:36.453650 | localhost | # Node Information 2026-02-25 15:37:36.453679 | localhost | Inventory Hostname: controller 2026-02-25 15:37:36.453702 | localhost | Hostname: np0005629675 2026-02-25 15:37:36.453722 | localhost | Username: zuul 2026-02-25 15:37:36.453742 | localhost | Distro: CentOS 9 2026-02-25 15:37:36.453760 | localhost | Provider: ibm-bm4-nodepool 2026-02-25 15:37:36.453777 | localhost | Region: regionOne 2026-02-25 15:37:36.453805 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2026-02-25 15:37:36.453823 | localhost | Product Name: OpenStack Compute 2026-02-25 15:37:36.453840 | localhost | Interface IP: 192.168.26.153 2026-02-25 15:37:36.476156 | 2026-02-25 15:37:36.476208 | PLAY [all] 2026-02-25 15:37:36.481866 | 2026-02-25 15:37:36.481927 | TASK [Gather network facts] 2026-02-25 15:37:36.936396 | controller | ok 2026-02-25 15:37:36.950028 | 2026-02-25 15:37:36.950091 | TASK [include_role : start-zuul-console] 2026-02-25 15:37:36.967756 | controller | ok 2026-02-25 15:37:36.978166 | 2026-02-25 15:37:36.978235 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-02-25 15:37:37.349930 | controller | ok 2026-02-25 15:37:37.358042 | 2026-02-25 15:37:37.358108 | TASK [include_role : add-build-sshkey] 2026-02-25 15:37:37.375602 | controller | ok 2026-02-25 15:37:37.387183 | 2026-02-25 15:37:37.387246 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-02-25 15:37:37.562246 | controller -> localhost | ok 2026-02-25 15:37:37.567338 | 2026-02-25 15:37:37.567406 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-02-25 15:37:37.585829 | controller | ok 2026-02-25 15:37:37.597429 | controller | included: /var/lib/zuul/builds/b37114dec2754585958f470bb78dd97b/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-25 15:37:37.602912 | 2026-02-25 15:37:37.602978 | TASK [add-build-sshkey : Create Temp SSH key] 2026-02-25 15:37:38.252853 | controller -> localhost | Generating public/private rsa key pair. 2026-02-25 15:37:38.253058 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/b37114dec2754585958f470bb78dd97b/work/b37114dec2754585958f470bb78dd97b_id_rsa. 2026-02-25 15:37:38.253094 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/b37114dec2754585958f470bb78dd97b/work/b37114dec2754585958f470bb78dd97b_id_rsa.pub. 2026-02-25 15:37:38.253119 | controller -> localhost | The key fingerprint is: 2026-02-25 15:37:38.253139 | controller -> localhost | SHA256:RDuPUT8sfB1Qa8yFbaRIJHmwxrExeeoo3h3G6LsXOXo zuul-build-sshkey 2026-02-25 15:37:38.253160 | controller -> localhost | The key's randomart image is: 2026-02-25 15:37:38.253179 | controller -> localhost | +---[RSA 3072]----+ 2026-02-25 15:37:38.253197 | controller -> localhost | | . B=+oo+o| 2026-02-25 15:37:38.253215 | controller -> localhost | | . =o@o=.=o| 2026-02-25 15:37:38.253231 | controller -> localhost | | = B+* B. | 2026-02-25 15:37:38.253248 | controller -> localhost | | . *.o o | 2026-02-25 15:37:38.253265 | controller -> localhost | | S=.. | 2026-02-25 15:37:38.253281 | controller -> localhost | | . o O | 2026-02-25 15:37:38.253328 | controller -> localhost | | . + + + | 2026-02-25 15:37:38.253360 | controller -> localhost | | . + E | 2026-02-25 15:37:38.253380 | controller -> localhost | | o= | 2026-02-25 15:37:38.253398 | controller -> localhost | +----[SHA256]-----+ 2026-02-25 15:37:38.253442 | controller -> localhost | ok: Runtime: 0:00:00.347954 2026-02-25 15:37:38.258670 | 2026-02-25 15:37:38.258733 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-02-25 15:37:38.276356 | controller | ok 2026-02-25 15:37:38.285168 | controller | included: /var/lib/zuul/builds/b37114dec2754585958f470bb78dd97b/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-25 15:37:38.292233 | 2026-02-25 15:37:38.292319 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-02-25 15:37:38.305853 | controller | skipping: Conditional result was False 2026-02-25 15:37:38.310658 | 2026-02-25 15:37:38.310720 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-02-25 15:37:38.764981 | controller | changed 2026-02-25 15:37:38.769149 | 2026-02-25 15:37:38.769210 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-02-25 15:37:39.020655 | controller | ok 2026-02-25 15:37:39.025061 | 2026-02-25 15:37:39.025121 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-02-25 15:37:40.138663 | controller | changed 2026-02-25 15:37:40.143228 | 2026-02-25 15:37:40.143319 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-02-25 15:37:41.307807 | controller | changed 2026-02-25 15:37:41.312612 | 2026-02-25 15:37:41.312679 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-02-25 15:37:41.325938 | controller | skipping: Conditional result was False 2026-02-25 15:37:41.331379 | 2026-02-25 15:37:41.331443 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-02-25 15:37:41.628425 | controller -> localhost | changed 2026-02-25 15:37:41.638079 | 2026-02-25 15:37:41.638165 | TASK [add-build-sshkey : Add back temp key] 2026-02-25 15:37:41.853546 | controller -> localhost | Identity added: /var/lib/zuul/builds/b37114dec2754585958f470bb78dd97b/work/b37114dec2754585958f470bb78dd97b_id_rsa (zuul-build-sshkey) 2026-02-25 15:37:41.853697 | controller -> localhost | ok: Runtime: 0:00:00.006685 2026-02-25 15:37:41.858883 | 2026-02-25 15:37:41.858947 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-02-25 15:37:42.222539 | controller | ok 2026-02-25 15:37:42.226890 | 2026-02-25 15:37:42.226976 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-02-25 15:37:42.250468 | controller | skipping: Conditional result was False 2026-02-25 15:37:42.259490 | 2026-02-25 15:37:42.259561 | TASK [include_role : validate-host] 2026-02-25 15:37:42.277143 | controller | ok 2026-02-25 15:37:42.294395 | 2026-02-25 15:37:42.294468 | TASK [validate-host : Define zuul_info_dir fact] 2026-02-25 15:37:42.321758 | controller | ok 2026-02-25 15:37:42.326228 | 2026-02-25 15:37:42.326313 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-02-25 15:37:42.521791 | controller -> localhost | ok 2026-02-25 15:37:42.528751 | 2026-02-25 15:37:42.528846 | TASK [validate-host : Collect information about the host] 2026-02-25 15:37:43.222438 | controller | ok 2026-02-25 15:37:43.230192 | 2026-02-25 15:37:43.230257 | TASK [validate-host : Sanitize hostname] 2026-02-25 15:37:43.268113 | controller | ok 2026-02-25 15:37:43.272628 | 2026-02-25 15:37:43.272693 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-02-25 15:37:43.630311 | controller -> localhost | changed 2026-02-25 15:37:43.635711 | 2026-02-25 15:37:43.635807 | TASK [validate-host : Collect information about zuul worker] 2026-02-25 15:37:44.049128 | controller | ok 2026-02-25 15:37:44.053658 | 2026-02-25 15:37:44.053728 | TASK [validate-host : Write out all zuul information for each host] 2026-02-25 15:37:44.401019 | controller -> localhost | changed 2026-02-25 15:37:44.410509 | 2026-02-25 15:37:44.410581 | TASK [include_role : prepare-workspace-openshift] 2026-02-25 15:37:44.423645 | controller | skipping: Conditional result was False 2026-02-25 15:37:44.428359 | 2026-02-25 15:37:44.428424 | TASK [include_role : remove-zuul-sshkey] 2026-02-25 15:37:44.441380 | controller | skipping: Conditional result was False 2026-02-25 15:37:44.446388 | 2026-02-25 15:37:44.446451 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-02-25 15:37:44.700325 | controller | ok: "logs" 2026-02-25 15:37:44.700538 | controller | ok: All items complete 2026-02-25 15:37:44.700567 | 2026-02-25 15:37:44.922204 | controller | ok: "artifacts" 2026-02-25 15:37:45.147173 | controller | ok: "docs" 2026-02-25 15:37:45.154634 | 2026-02-25 15:37:45.154697 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-02-25 15:37:45.416743 | controller | changed: "logs" 2026-02-25 15:37:45.660803 | controller | changed: "artifacts" 2026-02-25 15:37:45.912127 | controller | changed: "docs" 2026-02-25 15:37:45.937757 | 2026-02-25 15:37:45.937842 | PLAY RECAP 2026-02-25 15:37:45.937888 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-25 15:37:45.937916 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-25 15:37:45.937936 | 2026-02-25 15:37:46.014723 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-25 15:37:46.015435 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-25 15:37:46.520194 | 2026-02-25 15:37:46.520319 | PLAY [all] 2026-02-25 15:37:46.538619 | 2026-02-25 15:37:46.538698 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-25 15:37:46.587654 | controller | ok 2026-02-25 15:37:46.592607 | 2026-02-25 15:37:46.592687 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-25 15:37:46.996868 | controller | changed 2026-02-25 15:37:47.002155 | 2026-02-25 15:37:47.002225 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-25 15:37:48.268020 | controller | changed 2026-02-25 15:37:48.277537 | 2026-02-25 15:37:48.277606 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2026-02-25 15:37:48.692101 | controller | changed: 2026-02-25 15:37:48.692328 | controller | { 2026-02-25 15:37:48.692369 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2026-02-25 15:37:48.692401 | controller | } 2026-02-25 15:37:48.978893 | controller | changed: 2026-02-25 15:37:48.978951 | controller | { 2026-02-25 15:37:48.978981 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2026-02-25 15:37:48.979002 | controller | } 2026-02-25 15:37:49.288291 | controller | changed: 2026-02-25 15:37:49.288355 | controller | { 2026-02-25 15:37:49.288379 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2026-02-25 15:37:49.288398 | controller | } 2026-02-25 15:37:49.577328 | controller | changed: 2026-02-25 15:37:49.577383 | controller | { 2026-02-25 15:37:49.577410 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2026-02-25 15:37:49.577430 | controller | } 2026-02-25 15:37:49.873014 | controller | changed: 2026-02-25 15:37:49.873061 | controller | { 2026-02-25 15:37:49.873085 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2026-02-25 15:37:49.873103 | controller | } 2026-02-25 15:37:50.177470 | controller | changed: 2026-02-25 15:37:50.177565 | controller | { 2026-02-25 15:37:50.177592 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2026-02-25 15:37:50.177612 | controller | } 2026-02-25 15:37:50.480075 | controller | changed: 2026-02-25 15:37:50.480141 | controller | { 2026-02-25 15:37:50.480167 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2026-02-25 15:37:50.480187 | controller | } 2026-02-25 15:37:50.775485 | controller | changed: 2026-02-25 15:37:50.775543 | controller | { 2026-02-25 15:37:50.775570 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2026-02-25 15:37:50.775590 | controller | } 2026-02-25 15:37:51.055634 | controller | changed: 2026-02-25 15:37:51.055698 | controller | { 2026-02-25 15:37:51.055725 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2026-02-25 15:37:51.055745 | controller | } 2026-02-25 15:37:51.374039 | controller | changed: 2026-02-25 15:37:51.374116 | controller | { 2026-02-25 15:37:51.374143 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2026-02-25 15:37:51.374162 | controller | } 2026-02-25 15:37:51.656581 | controller | changed: 2026-02-25 15:37:51.656647 | controller | { 2026-02-25 15:37:51.656671 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2026-02-25 15:37:51.656690 | controller | } 2026-02-25 15:37:51.953957 | controller | changed: 2026-02-25 15:37:51.954075 | controller | { 2026-02-25 15:37:51.954107 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2026-02-25 15:37:51.954128 | controller | } 2026-02-25 15:37:52.253844 | controller | changed: 2026-02-25 15:37:52.253896 | controller | { 2026-02-25 15:37:52.253922 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com" 2026-02-25 15:37:52.253942 | controller | } 2026-02-25 15:37:52.550365 | controller | changed: 2026-02-25 15:37:52.550412 | controller | { 2026-02-25 15:37:52.550436 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2026-02-25 15:37:52.550453 | controller | } 2026-02-25 15:37:52.844395 | controller | changed: 2026-02-25 15:37:52.844461 | controller | { 2026-02-25 15:37:52.844486 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2026-02-25 15:37:52.844507 | controller | } 2026-02-25 15:37:53.157698 | controller | changed: 2026-02-25 15:37:53.157807 | controller | { 2026-02-25 15:37:53.157837 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2026-02-25 15:37:53.157857 | controller | } 2026-02-25 15:37:53.470428 | controller | changed: 2026-02-25 15:37:53.470484 | controller | { 2026-02-25 15:37:53.470510 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2026-02-25 15:37:53.470530 | controller | } 2026-02-25 15:37:53.772412 | controller | changed: 2026-02-25 15:37:53.772469 | controller | { 2026-02-25 15:37:53.772496 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2026-02-25 15:37:53.772524 | controller | } 2026-02-25 15:37:54.070922 | controller | changed: 2026-02-25 15:37:54.071015 | controller | { 2026-02-25 15:37:54.071040 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2026-02-25 15:37:54.071059 | controller | } 2026-02-25 15:37:54.359085 | controller | changed: 2026-02-25 15:37:54.359146 | controller | { 2026-02-25 15:37:54.359171 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2026-02-25 15:37:54.359191 | controller | } 2026-02-25 15:37:54.657387 | controller | changed: 2026-02-25 15:37:54.657470 | controller | { 2026-02-25 15:37:54.657497 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2026-02-25 15:37:54.657517 | controller | } 2026-02-25 15:37:54.958651 | controller | changed: 2026-02-25 15:37:54.958735 | controller | { 2026-02-25 15:37:54.958760 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2026-02-25 15:37:54.958780 | controller | } 2026-02-25 15:37:55.274590 | controller | changed: 2026-02-25 15:37:55.274685 | controller | { 2026-02-25 15:37:55.274711 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2026-02-25 15:37:55.274733 | controller | } 2026-02-25 15:37:55.562366 | controller | changed: 2026-02-25 15:37:55.562429 | controller | { 2026-02-25 15:37:55.562455 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2026-02-25 15:37:55.562474 | controller | } 2026-02-25 15:37:55.871651 | controller | changed: 2026-02-25 15:37:55.871718 | controller | { 2026-02-25 15:37:55.871743 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2026-02-25 15:37:55.871762 | controller | } 2026-02-25 15:37:56.191218 | controller | changed: 2026-02-25 15:37:56.191331 | controller | { 2026-02-25 15:37:56.191365 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2026-02-25 15:37:56.191386 | controller | } 2026-02-25 15:37:56.207046 | 2026-02-25 15:37:56.207146 | TASK [Set timezone to UTC] 2026-02-25 15:37:56.730442 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2026-02-25 15:37:56.736416 | 2026-02-25 15:37:56.736484 | TASK [Create nodepool directory] 2026-02-25 15:37:57.009450 | controller | changed 2026-02-25 15:37:57.014688 | 2026-02-25 15:37:57.014755 | TASK [Create nodepool sub_nodes file] 2026-02-25 15:37:57.993252 | controller | changed 2026-02-25 15:37:58.003504 | 2026-02-25 15:37:58.003587 | TASK [Create nodepool sub_nodes_private file] 2026-02-25 15:37:59.020235 | controller | changed 2026-02-25 15:37:59.024985 | 2026-02-25 15:37:59.025047 | LOOP [Populate nodepool sub_nodes file] 2026-02-25 15:37:59.054203 | 2026-02-25 15:37:59.054340 | LOOP [Populate nodepool sub_nodes_private file] 2026-02-25 15:37:59.083556 | 2026-02-25 15:37:59.083676 | TASK [Create nodepool primary file] 2026-02-25 15:37:59.107077 | controller | skipping: Conditional result was False 2026-02-25 15:37:59.112177 | 2026-02-25 15:37:59.112244 | TASK [Create nodepool node_private for this node] 2026-02-25 15:38:00.167262 | controller | changed 2026-02-25 15:38:00.172535 | 2026-02-25 15:38:00.172595 | LOOP [Copy ssh keys to nodepool directory] 2026-02-25 15:38:00.560010 | controller | ok: Item: id_rsa Runtime: 0:00:00.005761 2026-02-25 15:38:00.560162 | 2026-02-25 15:38:00.797819 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.005876 2026-02-25 15:38:00.810598 | 2026-02-25 15:38:00.810666 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2026-02-25 15:38:01.897112 | controller | changed 2026-02-25 15:38:01.901918 | 2026-02-25 15:38:01.901980 | TASK [Validate sudoers config after edits] 2026-02-25 15:38:02.188810 | controller | /etc/sudoers: parsed OK 2026-02-25 15:38:02.188863 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2026-02-25 15:38:02.188872 | controller | /etc/sudoers.d/zuul: parsed OK 2026-02-25 15:38:02.188877 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2026-02-25 15:38:02.427143 | controller | ok: Runtime: 0:00:00.005451 2026-02-25 15:38:02.432356 | 2026-02-25 15:38:02.432416 | TASK [Show the environment passed in to job shell scripts] 2026-02-25 15:38:02.710614 | controller | SHELL=/bin/bash 2026-02-25 15:38:02.710666 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2026-02-25 15:38:02.710688 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2026-02-25 15:38:02.710704 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/06/3706/c8624b7468d2ae8916f1fc7427f6643fbf0ac01c^openstack-k8s-operators/ci-framework:main:refs/changes/04/3704/37dfd862c334dda801964f6b3c71086ecff5a352 2026-02-25 15:38:02.710773 | controller | PWD=/home/zuul 2026-02-25 15:38:02.710782 | controller | ZUUL_PIPELINE=github-check 2026-02-25 15:38:02.710788 | controller | LOGNAME=zuul 2026-02-25 15:38:02.710794 | controller | XDG_SESSION_TYPE=tty 2026-02-25 15:38:02.710799 | controller | _=/usr/bin/env 2026-02-25 15:38:02.710804 | controller | MOTD_SHOWN=pam 2026-02-25 15:38:02.710809 | controller | HOME=/home/zuul 2026-02-25 15:38:02.710815 | controller | LANG=en_US.UTF-8 2026-02-25 15:38:02.710820 | controller | SSH_CONNECTION=192.168.26.12 42828 192.168.26.153 22 2026-02-25 15:38:02.710826 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2026-02-25 15:38:02.710832 | controller | ZUUL_CHANGE_IDS=3706,c8624b7468d2ae8916f1fc7427f6643fbf0ac01c 3704,37dfd862c334dda801964f6b3c71086ecff5a352 2026-02-25 15:38:02.710838 | controller | WORKSPACE=/home/zuul/workspace 2026-02-25 15:38:02.710844 | controller | XDG_SESSION_CLASS=user 2026-02-25 15:38:02.710850 | controller | SELINUX_ROLE_REQUESTED= 2026-02-25 15:38:02.710855 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2026-02-25 15:38:02.710860 | controller | USER=zuul 2026-02-25 15:38:02.710866 | controller | ZUUL_VOTING=True 2026-02-25 15:38:02.710872 | controller | BUILD_TIMEOUT=5400000 2026-02-25 15:38:02.710877 | controller | SELINUX_USE_CURRENT_RANGE= 2026-02-25 15:38:02.710882 | controller | SHLVL=1 2026-02-25 15:38:02.710888 | controller | ZUUL_PATCHSET=37dfd862c334dda801964f6b3c71086ecff5a352 2026-02-25 15:38:02.710893 | controller | XDG_SESSION_ID=1 2026-02-25 15:38:02.710899 | controller | ZUUL_BRANCH=main 2026-02-25 15:38:02.710905 | controller | XDG_RUNTIME_DIR=/run/user/1000 2026-02-25 15:38:02.710910 | controller | SSH_CLIENT=192.168.26.12 42828 22 2026-02-25 15:38:02.710916 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2026-02-25 15:38:02.710921 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2026-02-25 15:38:02.710935 | controller | which_declare=declare -f 2026-02-25 15:38:02.710942 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2026-02-25 15:38:02.710947 | controller | SELINUX_LEVEL_REQUESTED= 2026-02-25 15:38:02.710953 | controller | ZUUL_CHANGE=3704 2026-02-25 15:38:02.710958 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2026-02-25 15:38:02.710963 | controller | ZUUL_UUID=b37114dec2754585958f470bb78dd97b 2026-02-25 15:38:02.710971 | controller | BASH_FUNC_which%%=() { ( alias; 2026-02-25 15:38:02.710977 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2026-02-25 15:38:02.710982 | controller | } 2026-02-25 15:38:02.957075 | controller | ok: Runtime: 0:00:00.007077 2026-02-25 15:38:02.962004 | 2026-02-25 15:38:02.962073 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2026-02-25 15:38:02.974862 | controller | skipping: Conditional result was False 2026-02-25 15:38:02.979932 | 2026-02-25 15:38:02.980007 | TASK [Symlink /home/zuul-worker/workspace] 2026-02-25 15:38:03.522639 | controller | skipping: Conditional result was False 2026-02-25 15:38:03.527946 | 2026-02-25 15:38:03.528011 | TASK [Ensure legacy workspace directory] 2026-02-25 15:38:03.799961 | controller | changed 2026-02-25 15:38:03.817276 | 2026-02-25 15:38:03.817380 | PLAY RECAP 2026-02-25 15:38:03.817431 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-25 15:38:03.817456 | 2026-02-25 15:38:03.886221 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-25 15:38:03.886918 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-25 15:38:04.361269 | 2026-02-25 15:38:04.361377 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2026-02-25 15:38:04.381531 | 2026-02-25 15:38:04.381606 | TASK [Create zuul-output directory] 2026-02-25 15:38:04.745548 | controller | changed 2026-02-25 15:38:04.750222 | 2026-02-25 15:38:04.750311 | TASK [Slurp Zuul inventory test] 2026-02-25 15:38:05.017062 | controller -> localhost | ok 2026-02-25 15:38:05.023214 | 2026-02-25 15:38:05.023312 | TASK [Save zuul inventory] 2026-02-25 15:38:06.225961 | controller | changed 2026-02-25 15:38:06.231253 | 2026-02-25 15:38:06.231336 | TASK [Save zuul vars without the change_message] 2026-02-25 15:38:07.341512 | controller | changed 2026-02-25 15:38:07.359691 | 2026-02-25 15:38:07.359779 | PLAY RECAP 2026-02-25 15:38:07.359843 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-25 15:38:07.359869 | 2026-02-25 15:38:07.421798 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-25 15:38:07.422667 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-25 15:38:07.951285 | 2026-02-25 15:38:07.951401 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2026-02-25 15:38:07.971276 | 2026-02-25 15:38:07.971364 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2026-02-25 15:38:07.989247 | controller | ok 2026-02-25 15:38:08.005954 | 2026-02-25 15:38:08.006054 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-25 15:38:08.029006 | controller | skipping: Conditional result was False 2026-02-25 15:38:08.034418 | 2026-02-25 15:38:08.034492 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-25 15:38:08.416884 | controller | ok 2026-02-25 15:38:08.422169 | 2026-02-25 15:38:08.422237 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-25 15:38:09.421734 | controller | ok 2026-02-25 15:38:09.430755 | 2026-02-25 15:38:09.430826 | TASK [Prepare workspace] 2026-02-25 15:38:09.448375 | controller | ok 2026-02-25 15:38:09.464182 | 2026-02-25 15:38:09.464247 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-02-25 15:38:09.837631 | controller | ok 2026-02-25 15:38:09.842633 | 2026-02-25 15:38:09.842691 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-02-25 15:38:12.229556 | controller | Output suppressed because no_log was given 2026-02-25 15:38:12.237753 | 2026-02-25 15:38:12.237820 | LOOP [Create zuul-output directory] 2026-02-25 15:38:12.494991 | controller | changed: "/home/zuul/ci-framework-data/logs" 2026-02-25 15:38:12.734351 | controller | ok: "/home/zuul/zuul-output/logs" 2026-02-25 15:38:12.742189 | 2026-02-25 15:38:12.742282 | TASK [Install required packages] 2026-02-25 15:38:28.394020 | controller | ok: Nothing to do 2026-02-25 15:38:28.398942 | 2026-02-25 15:38:28.399014 | TASK [Install venv] 2026-02-25 15:39:26.228519 | controller | changed 2026-02-25 15:39:26.252257 | 2026-02-25 15:39:26.252372 | PLAY RECAP 2026-02-25 15:39:26.252419 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-25 15:39:26.252441 | 2026-02-25 15:39:26.319573 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-25 15:39:26.320332 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-25 15:39:26.797217 | 2026-02-25 15:39:26.797332 | PLAY [Run ci/playbooks/molecule-test.yml] 2026-02-25 15:39:26.815944 | 2026-02-25 15:39:26.816012 | TASK [Gather required facts] 2026-02-25 15:39:27.343912 | controller | ok 2026-02-25 15:39:27.349176 | 2026-02-25 15:39:27.349254 | TASK [Load environment var if instructed to] 2026-02-25 15:39:27.373477 | controller | skipping: Conditional result was False 2026-02-25 15:39:27.379580 | 2026-02-25 15:39:27.379662 | TASK [Ensure group_vars dir exists] 2026-02-25 15:39:27.754468 | controller | ok 2026-02-25 15:39:27.759524 | 2026-02-25 15:39:27.759590 | TASK [Print related variables] 2026-02-25 15:39:27.788141 | controller | ok: 2026-02-25 15:39:27.788255 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2026-02-25 15:39:27.788284 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2026-02-25 15:39:27.792952 | 2026-02-25 15:39:27.793016 | TASK [Run molecule] 2026-02-25 15:39:28.777614 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2026-02-25 15:39:29.033869 | controller | INFO Performing prerun with role_name_check=0... 2026-02-25 15:39:47.293860 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.294250 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.294684 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.295127 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.295598 | controller | WARNING Another version of 'cifmw.general' 1.0.0+26aa17cd was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+26aa17cd (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.296033 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.296492 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.296925 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.297363 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.297784 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.298228 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.298644 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.299050 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.299492 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.299908 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 15:39:47.309676 | controller | INFO Running crc_layout > prepare 2026-02-25 15:39:48.001620 | controller | 2026-02-25 15:39:48.001673 | controller | PLAY [Prepare] ***************************************************************** 2026-02-25 15:39:48.001780 | controller | 2026-02-25 15:39:48.001868 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-25 15:39:48.001959 | controller | Wednesday 25 February 2026 15:39:47 +0000 (0:00:00.020) 0:00:00.020 **** 2026-02-25 15:39:48.876008 | controller | ok: [instance] 2026-02-25 15:39:48.876068 | controller | 2026-02-25 15:39:48.876246 | controller | TASK [Create custom basedir] *************************************************** 2026-02-25 15:39:48.876343 | controller | Wednesday 25 February 2026 15:39:48 +0000 (0:00:00.875) 0:00:00.895 **** 2026-02-25 15:39:49.209054 | controller | changed: [instance] 2026-02-25 15:39:49.209116 | controller | 2026-02-25 15:39:49.209271 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2026-02-25 15:39:49.209364 | controller | Wednesday 25 February 2026 15:39:49 +0000 (0:00:00.333) 0:00:01.229 **** 2026-02-25 15:39:49.230946 | controller | skipping: [instance] 2026-02-25 15:39:49.231010 | controller | 2026-02-25 15:39:49.231151 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2026-02-25 15:39:49.231308 | controller | Wednesday 25 February 2026 15:39:49 +0000 (0:00:00.021) 0:00:01.251 **** 2026-02-25 15:39:49.277322 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2026-02-25 15:39:49.277408 | controller | 2026-02-25 15:39:49.277521 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2026-02-25 15:39:49.277611 | controller | Wednesday 25 February 2026 15:39:49 +0000 (0:00:00.046) 0:00:01.297 **** 2026-02-25 15:39:49.579806 | controller | ok: [instance] 2026-02-25 15:39:49.579853 | controller | 2026-02-25 15:39:49.579944 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2026-02-25 15:39:49.580030 | controller | Wednesday 25 February 2026 15:39:49 +0000 (0:00:00.302) 0:00:01.599 **** 2026-02-25 15:39:49.798552 | controller | ok: [instance] 2026-02-25 15:39:49.798596 | controller | 2026-02-25 15:39:49.798689 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2026-02-25 15:39:49.798779 | controller | Wednesday 25 February 2026 15:39:49 +0000 (0:00:00.218) 0:00:01.818 **** 2026-02-25 15:39:50.516875 | controller | ok: [instance] => (item=ubi-9-appstream) 2026-02-25 15:39:50.516921 | controller | ok: [instance] => (item=ubi-9-baseos) 2026-02-25 15:39:50.517019 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2026-02-25 15:39:50.517105 | controller | 2026-02-25 15:39:50.517208 | controller | TASK [Deploy repo-setup] ******************************************************* 2026-02-25 15:39:50.517313 | controller | Wednesday 25 February 2026 15:39:50 +0000 (0:00:00.717) 0:00:02.536 **** 2026-02-25 15:39:50.577938 | controller | 2026-02-25 15:39:50.578024 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-25 15:39:50.578146 | controller | Wednesday 25 February 2026 15:39:50 +0000 (0:00:00.061) 0:00:02.598 **** 2026-02-25 15:39:51.101507 | controller | changed: [instance] => (item=tmp) 2026-02-25 15:39:51.101604 | controller | changed: [instance] => (item=artifacts/repositories) 2026-02-25 15:39:51.101708 | controller | changed: [instance] => (item=venv/repo_setup) 2026-02-25 15:39:51.101805 | controller | 2026-02-25 15:39:51.101910 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-25 15:39:51.102001 | controller | Wednesday 25 February 2026 15:39:51 +0000 (0:00:00.523) 0:00:03.121 **** 2026-02-25 15:39:51.960201 | controller | ok: [instance] 2026-02-25 15:39:53.088337 | controller | 2026-02-25 15:39:53.088391 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-25 15:39:53.088402 | controller | Wednesday 25 February 2026 15:39:51 +0000 (0:00:00.858) 0:00:03.979 **** 2026-02-25 15:39:53.088414 | controller | changed: [instance] 2026-02-25 15:40:00.691298 | controller | 2026-02-25 15:40:00.691346 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-25 15:40:00.691356 | controller | Wednesday 25 February 2026 15:39:53 +0000 (0:00:01.128) 0:00:05.107 **** 2026-02-25 15:40:00.691368 | controller | changed: [instance] 2026-02-25 15:40:01.432313 | controller | 2026-02-25 15:40:01.432364 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-25 15:40:01.432374 | controller | Wednesday 25 February 2026 15:40:00 +0000 (0:00:07.603) 0:00:12.711 **** 2026-02-25 15:40:01.432387 | controller | changed: [instance] 2026-02-25 15:40:01.432414 | controller | 2026-02-25 15:40:01.432425 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-25 15:40:01.432514 | controller | Wednesday 25 February 2026 15:40:01 +0000 (0:00:00.740) 0:00:13.451 **** 2026-02-25 15:40:01.458902 | controller | skipping: [instance] 2026-02-25 15:40:02.321696 | controller | 2026-02-25 15:40:02.321733 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-25 15:40:02.321741 | controller | Wednesday 25 February 2026 15:40:01 +0000 (0:00:00.026) 0:00:13.478 **** 2026-02-25 15:40:02.321751 | controller | changed: [instance] 2026-02-25 15:40:02.362856 | controller | 2026-02-25 15:40:02.362880 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-25 15:40:02.362889 | controller | Wednesday 25 February 2026 15:40:02 +0000 (0:00:00.862) 0:00:14.341 **** 2026-02-25 15:40:02.362900 | controller | skipping: [instance] 2026-02-25 15:40:02.408304 | controller | 2026-02-25 15:40:02.408362 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-25 15:40:02.408372 | controller | Wednesday 25 February 2026 15:40:02 +0000 (0:00:00.041) 0:00:14.382 **** 2026-02-25 15:40:02.408386 | controller | skipping: [instance] 2026-02-25 15:40:02.408710 | controller | 2026-02-25 15:40:02.451218 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-25 15:40:02.451250 | controller | Wednesday 25 February 2026 15:40:02 +0000 (0:00:00.045) 0:00:14.428 **** 2026-02-25 15:40:02.451268 | controller | skipping: [instance] 2026-02-25 15:40:03.243236 | controller | 2026-02-25 15:40:03.243283 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-25 15:40:03.243292 | controller | Wednesday 25 February 2026 15:40:02 +0000 (0:00:00.042) 0:00:14.470 **** 2026-02-25 15:40:03.243303 | controller | changed: [instance] 2026-02-25 15:40:03.717861 | controller | 2026-02-25 15:40:03.717887 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-25 15:40:03.717894 | controller | Wednesday 25 February 2026 15:40:03 +0000 (0:00:00.791) 0:00:15.262 **** 2026-02-25 15:40:03.717903 | controller | changed: [instance] 2026-02-25 15:40:03.751320 | controller | 2026-02-25 15:40:03.751367 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-25 15:40:03.751379 | controller | Wednesday 25 February 2026 15:40:03 +0000 (0:00:00.474) 0:00:15.736 **** 2026-02-25 15:40:03.751395 | controller | skipping: [instance] 2026-02-25 15:40:03.751404 | controller | 2026-02-25 15:40:03.751412 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-25 15:40:03.751423 | controller | Wednesday 25 February 2026 15:40:03 +0000 (0:00:00.034) 0:00:15.771 **** 2026-02-25 15:40:03.782064 | controller | skipping: [instance] 2026-02-25 15:40:03.814944 | controller | 2026-02-25 15:40:03.814964 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-25 15:40:03.814972 | controller | Wednesday 25 February 2026 15:40:03 +0000 (0:00:00.030) 0:00:15.802 **** 2026-02-25 15:40:03.814980 | controller | skipping: [instance] 2026-02-25 15:40:03.855286 | controller | 2026-02-25 15:40:03.855314 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-25 15:40:03.855323 | controller | Wednesday 25 February 2026 15:40:03 +0000 (0:00:00.032) 0:00:15.834 **** 2026-02-25 15:40:03.855335 | controller | ok: [instance] 2026-02-25 15:40:03.855370 | controller | 2026-02-25 15:40:03.855381 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-25 15:40:03.855492 | controller | Wednesday 25 February 2026 15:40:03 +0000 (0:00:00.040) 0:00:15.874 **** 2026-02-25 15:40:03.890282 | controller | skipping: [instance] 2026-02-25 15:40:03.921149 | controller | 2026-02-25 15:40:03.921190 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-25 15:40:03.921198 | controller | Wednesday 25 February 2026 15:40:03 +0000 (0:00:00.035) 0:00:15.910 **** 2026-02-25 15:40:03.921207 | controller | skipping: [instance] 2026-02-25 15:40:03.952702 | controller | 2026-02-25 15:40:03.952724 | controller | TASK [Download the RPM] ******************************************************** 2026-02-25 15:40:03.952732 | controller | Wednesday 25 February 2026 15:40:03 +0000 (0:00:00.030) 0:00:15.940 **** 2026-02-25 15:40:03.952743 | controller | skipping: [instance] 2026-02-25 15:40:03.952895 | controller | 2026-02-25 15:40:03.953067 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-25 15:40:03.953224 | controller | Wednesday 25 February 2026 15:40:03 +0000 (0:00:00.032) 0:00:15.973 **** 2026-02-25 15:40:03.980862 | controller | skipping: [instance] 2026-02-25 15:40:03.981039 | controller | 2026-02-25 15:40:03.981207 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-25 15:40:03.981334 | controller | Wednesday 25 February 2026 15:40:03 +0000 (0:00:00.028) 0:00:16.001 **** 2026-02-25 15:40:04.012618 | controller | skipping: [instance] 2026-02-25 15:40:04.012856 | controller | 2026-02-25 15:40:04.013100 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-25 15:40:04.013312 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.031) 0:00:16.032 **** 2026-02-25 15:40:04.055798 | controller | skipping: [instance] 2026-02-25 15:40:04.055961 | controller | 2026-02-25 15:40:04.056131 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-25 15:40:04.056305 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.043) 0:00:16.076 **** 2026-02-25 15:40:04.082531 | controller | skipping: [instance] 2026-02-25 15:40:04.082695 | controller | 2026-02-25 15:40:04.082855 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-25 15:40:04.083016 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.026) 0:00:16.102 **** 2026-02-25 15:40:04.274851 | controller | ok: [instance] 2026-02-25 15:40:04.500283 | controller | 2026-02-25 15:40:04.500333 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-25 15:40:04.500342 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.191) 0:00:16.294 **** 2026-02-25 15:40:04.500355 | controller | changed: [instance] 2026-02-25 15:40:04.744640 | controller | 2026-02-25 15:40:04.744679 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-25 15:40:04.744688 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.225) 0:00:16.520 **** 2026-02-25 15:40:04.744699 | controller | changed: [instance] 2026-02-25 15:40:04.773182 | controller | 2026-02-25 15:40:04.773206 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-25 15:40:04.773215 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.244) 0:00:16.764 **** 2026-02-25 15:40:04.773226 | controller | skipping: [instance] 2026-02-25 15:40:04.799350 | controller | 2026-02-25 15:40:04.799399 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-25 15:40:04.799412 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.028) 0:00:16.793 **** 2026-02-25 15:40:04.799439 | controller | skipping: [instance] 2026-02-25 15:40:04.799481 | controller | 2026-02-25 15:40:04.799495 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-25 15:40:04.799531 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.026) 0:00:16.819 **** 2026-02-25 15:40:04.828318 | controller | skipping: [instance] 2026-02-25 15:40:04.856223 | controller | 2026-02-25 15:40:04.856251 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-25 15:40:04.856262 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.028) 0:00:16.848 **** 2026-02-25 15:40:04.856274 | controller | skipping: [instance] 2026-02-25 15:40:04.882815 | controller | 2026-02-25 15:40:04.882842 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-25 15:40:04.882860 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.027) 0:00:16.876 **** 2026-02-25 15:40:04.882872 | controller | skipping: [instance] 2026-02-25 15:40:04.909020 | controller | 2026-02-25 15:40:04.909037 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-25 15:40:04.909044 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.026) 0:00:16.902 **** 2026-02-25 15:40:04.909056 | controller | skipping: [instance] 2026-02-25 15:40:04.929018 | controller | 2026-02-25 15:40:04.929035 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-25 15:40:04.929043 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.026) 0:00:16.928 **** 2026-02-25 15:40:04.929051 | controller | skipping: [instance] 2026-02-25 15:40:04.965343 | controller | 2026-02-25 15:40:04.965363 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-25 15:40:04.965372 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.020) 0:00:16.949 **** 2026-02-25 15:40:04.965382 | controller | skipping: [instance] 2026-02-25 15:40:04.965535 | controller | 2026-02-25 15:40:04.965687 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-25 15:40:04.965839 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.036) 0:00:16.985 **** 2026-02-25 15:40:04.988984 | controller | skipping: [instance] 2026-02-25 15:40:04.989191 | controller | 2026-02-25 15:40:04.989399 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-25 15:40:04.989553 | controller | Wednesday 25 February 2026 15:40:04 +0000 (0:00:00.023) 0:00:17.009 **** 2026-02-25 15:40:05.013916 | controller | skipping: [instance] 2026-02-25 15:40:05.014098 | controller | 2026-02-25 15:40:05.014258 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2026-02-25 15:40:05.014385 | controller | Wednesday 25 February 2026 15:40:05 +0000 (0:00:00.024) 0:00:17.034 **** 2026-02-25 15:40:05.047709 | controller | skipping: [instance] 2026-02-25 15:40:05.047888 | controller | 2026-02-25 15:40:05.048071 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2026-02-25 15:40:05.048244 | controller | Wednesday 25 February 2026 15:40:05 +0000 (0:00:00.033) 0:00:17.067 **** 2026-02-25 15:40:05.082697 | controller | skipping: [instance] 2026-02-25 15:40:05.082860 | controller | 2026-02-25 15:40:05.083026 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2026-02-25 15:40:05.083200 | controller | Wednesday 25 February 2026 15:40:05 +0000 (0:00:00.035) 0:00:17.103 **** 2026-02-25 15:40:05.114605 | controller | skipping: [instance] 2026-02-25 15:40:05.114771 | controller | 2026-02-25 15:40:05.114923 | controller | TASK [test_deps : Install additional packages] ********************************* 2026-02-25 15:40:05.115084 | controller | Wednesday 25 February 2026 15:40:05 +0000 (0:00:00.031) 0:00:17.134 **** 2026-02-25 15:40:05.144871 | controller | skipping: [instance] 2026-02-25 15:40:05.145050 | controller | 2026-02-25 15:40:05.145236 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2026-02-25 15:40:05.145390 | controller | Wednesday 25 February 2026 15:40:05 +0000 (0:00:00.030) 0:00:17.165 **** 2026-02-25 15:40:48.792249 | controller | ok: [instance] 2026-02-25 15:40:50.000895 | controller | 2026-02-25 15:40:50.000934 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2026-02-25 15:40:50.000942 | controller | Wednesday 25 February 2026 15:40:48 +0000 (0:00:43.646) 0:01:00.811 **** 2026-02-25 15:40:50.000953 | controller | ok: [instance] 2026-02-25 15:40:50.034000 | controller | 2026-02-25 15:40:50.034032 | controller | TASK [test_deps : Install extra packages] ************************************** 2026-02-25 15:40:50.034045 | controller | Wednesday 25 February 2026 15:40:49 +0000 (0:00:01.208) 0:01:02.020 **** 2026-02-25 15:40:50.034061 | controller | skipping: [instance] 2026-02-25 15:40:50.074106 | controller | 2026-02-25 15:40:50.074128 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-25 15:40:50.074138 | controller | Wednesday 25 February 2026 15:40:50 +0000 (0:00:00.033) 0:01:02.053 **** 2026-02-25 15:40:50.074149 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2026-02-25 15:40:50.095399 | controller | 2026-02-25 15:40:50.095449 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-25 15:40:50.095472 | controller | Wednesday 25 February 2026 15:40:50 +0000 (0:00:00.040) 0:01:02.094 **** 2026-02-25 15:40:50.095489 | controller | ok: [instance] => 2026-02-25 15:40:50.095528 | controller | cifmw_ci_setup_packages: 2026-02-25 15:40:50.095542 | controller | - bash-completion 2026-02-25 15:40:50.095574 | controller | - ca-certificates 2026-02-25 15:40:50.095586 | controller | - git-core 2026-02-25 15:40:50.096180 | controller | - make 2026-02-25 15:41:01.609051 | controller | - tar 2026-02-25 15:41:01.609094 | controller | - tmux 2026-02-25 15:41:01.609102 | controller | - python3-pip 2026-02-25 15:41:01.609108 | controller | 2026-02-25 15:41:01.609113 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-25 15:41:01.609120 | controller | Wednesday 25 February 2026 15:40:50 +0000 (0:00:00.021) 0:01:02.115 **** 2026-02-25 15:41:01.609132 | controller | changed: [instance] 2026-02-25 15:41:02.202477 | controller | 2026-02-25 15:41:02.202519 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-25 15:41:02.202528 | controller | Wednesday 25 February 2026 15:41:01 +0000 (0:00:11.513) 0:01:13.628 **** 2026-02-25 15:41:02.202540 | controller | ok: [instance] 2026-02-25 15:41:02.202578 | controller | 2026-02-25 15:41:02.202586 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-25 15:41:02.202696 | controller | Wednesday 25 February 2026 15:41:02 +0000 (0:00:00.593) 0:01:14.222 **** 2026-02-25 15:41:02.406775 | controller | changed: [instance] 2026-02-25 15:41:26.385107 | controller | 2026-02-25 15:41:26.385149 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-25 15:41:26.385177 | controller | Wednesday 25 February 2026 15:41:02 +0000 (0:00:00.204) 0:01:14.426 **** 2026-02-25 15:41:26.385192 | controller | changed: [instance] 2026-02-25 15:41:26.420013 | controller | 2026-02-25 15:41:26.420030 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-25 15:41:26.420036 | controller | Wednesday 25 February 2026 15:41:26 +0000 (0:00:23.975) 0:01:38.401 **** 2026-02-25 15:41:26.420044 | controller | ok: [instance] 2026-02-25 15:41:26.692559 | controller | 2026-02-25 15:41:26.692580 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-25 15:41:26.692588 | controller | Wednesday 25 February 2026 15:41:26 +0000 (0:00:00.038) 0:01:38.440 **** 2026-02-25 15:41:26.692597 | controller | changed: [instance] 2026-02-25 15:41:26.970629 | controller | 2026-02-25 15:41:26.970651 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-25 15:41:26.970659 | controller | Wednesday 25 February 2026 15:41:26 +0000 (0:00:00.272) 0:01:38.712 **** 2026-02-25 15:41:26.970667 | controller | changed: [instance] 2026-02-25 15:41:26.989784 | controller | 2026-02-25 15:41:26.989798 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-25 15:41:26.989805 | controller | Wednesday 25 February 2026 15:41:26 +0000 (0:00:00.278) 0:01:38.990 **** 2026-02-25 15:41:26.989813 | controller | skipping: [instance] 2026-02-25 15:41:27.007788 | controller | 2026-02-25 15:41:27.007807 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-25 15:41:27.007815 | controller | Wednesday 25 February 2026 15:41:26 +0000 (0:00:00.019) 0:01:39.009 **** 2026-02-25 15:41:27.007825 | controller | skipping: [instance] 2026-02-25 15:41:27.025772 | controller | 2026-02-25 15:41:27.025789 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-25 15:41:27.025797 | controller | Wednesday 25 February 2026 15:41:27 +0000 (0:00:00.017) 0:01:39.027 **** 2026-02-25 15:41:27.025805 | controller | skipping: [instance] 2026-02-25 15:41:27.044248 | controller | 2026-02-25 15:41:27.044282 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-25 15:41:27.044291 | controller | Wednesday 25 February 2026 15:41:27 +0000 (0:00:00.018) 0:01:39.045 **** 2026-02-25 15:41:27.044302 | controller | skipping: [instance] 2026-02-25 15:41:27.044328 | controller | 2026-02-25 15:41:27.044534 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-25 15:41:27.062334 | controller | Wednesday 25 February 2026 15:41:27 +0000 (0:00:00.018) 0:01:39.064 **** 2026-02-25 15:41:27.062385 | controller | skipping: [instance] 2026-02-25 15:41:27.085233 | controller | 2026-02-25 15:41:27.085257 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-25 15:41:27.085264 | controller | Wednesday 25 February 2026 15:41:27 +0000 (0:00:00.017) 0:01:39.082 **** 2026-02-25 15:41:27.085274 | controller | skipping: [instance] 2026-02-25 15:41:27.085309 | controller | 2026-02-25 15:41:27.085315 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-25 15:41:27.085323 | controller | Wednesday 25 February 2026 15:41:27 +0000 (0:00:00.023) 0:01:39.105 **** 2026-02-25 15:41:28.075250 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2026-02-25 15:41:28.075333 | controller | changed: [instance] => (item=/opt/basedir/logs) 2026-02-25 15:41:28.075345 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2026-02-25 15:41:28.075352 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2026-02-25 15:41:28.075359 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2026-02-25 15:41:28.075366 | controller | 2026-02-25 15:41:28.075372 | controller | TASK [Create secret file] ****************************************************** 2026-02-25 15:41:28.075382 | controller | Wednesday 25 February 2026 15:41:28 +0000 (0:00:00.989) 0:01:40.094 **** 2026-02-25 15:41:28.404437 | controller | changed: [instance] 2026-02-25 15:41:28.404510 | controller | 2026-02-25 15:41:28.404529 | controller | PLAY RECAP ********************************************************************* 2026-02-25 15:41:28.405308 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2026-02-25 15:41:28.405365 | controller | 2026-02-25 15:41:28.405426 | controller | Wednesday 25 February 2026 15:41:28 +0000 (0:00:00.329) 0:01:40.424 **** 2026-02-25 15:41:28.405437 | controller | =============================================================================== 2026-02-25 15:41:28.405445 | controller | test_deps : Install selinux python libs -------------------------------- 43.65s 2026-02-25 15:41:28.405453 | controller | ci_setup : Install openshift client ------------------------------------ 23.98s 2026-02-25 15:41:28.405460 | controller | ci_setup : Install needed packages ------------------------------------- 11.51s 2026-02-25 15:41:28.405467 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.60s 2026-02-25 15:41:28.405475 | controller | test_deps : Install python yaml libs ------------------------------------ 1.21s 2026-02-25 15:41:28.405485 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.13s 2026-02-25 15:41:28.405513 | controller | ci_setup : Manage directories ------------------------------------------- 0.99s 2026-02-25 15:41:28.405521 | controller | Gathering Facts --------------------------------------------------------- 0.88s 2026-02-25 15:41:28.405531 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.86s 2026-02-25 15:41:28.406261 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.86s 2026-02-25 15:41:28.406320 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.79s 2026-02-25 15:41:28.406329 | controller | repo_setup : Install repo-setup package --------------------------------- 0.74s 2026-02-25 15:41:28.406335 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.72s 2026-02-25 15:41:28.406340 | controller | ci_setup : Gather version of openshift client --------------------------- 0.59s 2026-02-25 15:41:28.406346 | controller | repo_setup : Ensure directories are present ----------------------------- 0.52s 2026-02-25 15:41:28.406351 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.47s 2026-02-25 15:41:28.406357 | controller | Create custom basedir --------------------------------------------------- 0.33s 2026-02-25 15:41:28.406364 | controller | Create secret file ------------------------------------------------------ 0.33s 2026-02-25 15:41:28.406447 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.30s 2026-02-25 15:41:28.406479 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.28s 2026-02-25 15:41:28.478372 | controller | INFO Running crc_layout > converge 2026-02-25 15:41:29.042451 | controller | 2026-02-25 15:41:29.042646 | controller | PLAY [Converge] **************************************************************** 2026-02-25 15:41:29.042831 | controller | 2026-02-25 15:41:29.042979 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-25 15:41:29.043102 | controller | Wednesday 25 February 2026 15:41:29 +0000 (0:00:00.025) 0:00:00.025 **** 2026-02-25 15:41:30.855657 | controller | ok: [instance] 2026-02-25 15:41:30.881388 | controller | 2026-02-25 15:41:30.881432 | controller | TASK [Load networking definition from scenario file] *************************** 2026-02-25 15:41:30.881444 | controller | Wednesday 25 February 2026 15:41:30 +0000 (0:00:01.812) 0:00:01.837 **** 2026-02-25 15:41:30.881463 | controller | ok: [instance] 2026-02-25 15:41:32.699339 | controller | 2026-02-25 15:41:32.699382 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-25 15:41:32.699393 | controller | Wednesday 25 February 2026 15:41:30 +0000 (0:00:00.025) 0:00:01.863 **** 2026-02-25 15:41:32.699406 | controller | changed: [instance] 2026-02-25 15:41:32.699438 | controller | 2026-02-25 15:41:32.699447 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-25 15:41:32.699548 | controller | Wednesday 25 February 2026 15:41:32 +0000 (0:00:01.818) 0:00:03.681 **** 2026-02-25 15:41:32.728300 | controller | ok: [instance] 2026-02-25 15:41:32.751007 | controller | 2026-02-25 15:41:32.751040 | controller | TASK [reproducer : Load CI job environment] ************************************ 2026-02-25 15:41:32.751051 | controller | Wednesday 25 February 2026 15:41:32 +0000 (0:00:00.028) 0:00:03.710 **** 2026-02-25 15:41:32.751059 | controller | skipping: [instance] 2026-02-25 15:41:32.799366 | controller | 2026-02-25 15:41:32.799404 | controller | TASK [Build final libvirt layout] ********************************************** 2026-02-25 15:41:32.799418 | controller | Wednesday 25 February 2026 15:41:32 +0000 (0:00:00.022) 0:00:03.733 **** 2026-02-25 15:41:32.799434 | controller | 2026-02-25 15:41:32.876309 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2026-02-25 15:41:32.876340 | controller | Wednesday 25 February 2026 15:41:32 +0000 (0:00:00.048) 0:00:03.781 **** 2026-02-25 15:41:32.876352 | controller | ok: [instance] 2026-02-25 15:41:32.876670 | controller | 2026-02-25 15:41:32.876722 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2026-02-25 15:41:32.941069 | controller | Wednesday 25 February 2026 15:41:32 +0000 (0:00:00.077) 0:00:03.858 **** 2026-02-25 15:41:32.941089 | controller | skipping: [instance] 2026-02-25 15:41:32.967480 | controller | 2026-02-25 15:41:32.967512 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2026-02-25 15:41:32.967526 | controller | Wednesday 25 February 2026 15:41:32 +0000 (0:00:00.064) 0:00:03.923 **** 2026-02-25 15:41:32.967542 | controller | ok: [instance] 2026-02-25 15:41:32.967809 | controller | 2026-02-25 15:41:32.968056 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2026-02-25 15:41:32.968347 | controller | Wednesday 25 February 2026 15:41:32 +0000 (0:00:00.027) 0:00:03.950 **** 2026-02-25 15:41:32.992573 | controller | ok: [instance] => changed=false 2026-02-25 15:41:32.992760 | controller | msg: All assertions passed 2026-02-25 15:41:32.992902 | controller | 2026-02-25 15:41:32.993048 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2026-02-25 15:41:32.993217 | controller | Wednesday 25 February 2026 15:41:32 +0000 (0:00:00.025) 0:00:03.975 **** 2026-02-25 15:41:33.035588 | controller | ok: [instance] 2026-02-25 15:41:33.035875 | controller | 2026-02-25 15:41:33.036122 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2026-02-25 15:41:33.036404 | controller | Wednesday 25 February 2026 15:41:33 +0000 (0:00:00.042) 0:00:04.018 **** 2026-02-25 15:41:33.491935 | controller | ok: [instance] => (item=artifacts) 2026-02-25 15:41:33.565565 | controller | ok: [instance] => (item=logs) 2026-02-25 15:41:33.565606 | controller | 2026-02-25 15:41:33.565617 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2026-02-25 15:41:33.565634 | controller | Wednesday 25 February 2026 15:41:33 +0000 (0:00:00.455) 0:00:04.473 **** 2026-02-25 15:41:33.565648 | controller | 2026-02-25 15:41:33.745734 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2026-02-25 15:41:33.745755 | controller | Wednesday 25 February 2026 15:41:33 +0000 (0:00:00.074) 0:00:04.548 **** 2026-02-25 15:41:33.745766 | controller | ok: [instance] 2026-02-25 15:41:34.018231 | controller | 2026-02-25 15:41:34.018251 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2026-02-25 15:41:34.018259 | controller | Wednesday 25 February 2026 15:41:33 +0000 (0:00:00.180) 0:00:04.728 **** 2026-02-25 15:41:34.018268 | controller | changed: [instance] 2026-02-25 15:41:34.293668 | controller | 2026-02-25 15:41:34.293691 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2026-02-25 15:41:34.293699 | controller | Wednesday 25 February 2026 15:41:34 +0000 (0:00:00.272) 0:00:05.000 **** 2026-02-25 15:41:34.293718 | controller | ok: [instance] 2026-02-25 15:41:34.321921 | controller | 2026-02-25 15:41:34.321943 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2026-02-25 15:41:34.321952 | controller | Wednesday 25 February 2026 15:41:34 +0000 (0:00:00.275) 0:00:05.276 **** 2026-02-25 15:41:34.321964 | controller | skipping: [instance] 2026-02-25 15:41:34.338831 | controller | 2026-02-25 15:41:34.338852 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2026-02-25 15:41:34.338861 | controller | Wednesday 25 February 2026 15:41:34 +0000 (0:00:00.028) 0:00:05.304 **** 2026-02-25 15:41:34.338872 | controller | skipping: [instance] 2026-02-25 15:41:34.360329 | controller | 2026-02-25 15:41:34.360378 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2026-02-25 15:41:34.360389 | controller | Wednesday 25 February 2026 15:41:34 +0000 (0:00:00.016) 0:00:05.321 **** 2026-02-25 15:41:34.360403 | controller | ok: [instance] 2026-02-25 15:41:34.360439 | controller | 2026-02-25 15:41:34.360449 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2026-02-25 15:41:34.360484 | controller | Wednesday 25 February 2026 15:41:34 +0000 (0:00:00.021) 0:00:05.343 **** 2026-02-25 15:41:34.388331 | controller | skipping: [instance] 2026-02-25 15:41:34.388557 | controller | 2026-02-25 15:41:34.388583 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2026-02-25 15:41:42.978190 | controller | Wednesday 25 February 2026 15:41:34 +0000 (0:00:00.028) 0:00:05.371 **** 2026-02-25 15:41:42.978240 | controller | changed: [instance] 2026-02-25 15:41:42.978265 | controller | 2026-02-25 15:41:42.978274 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2026-02-25 15:41:42.978400 | controller | Wednesday 25 February 2026 15:41:42 +0000 (0:00:08.589) 0:00:13.960 **** 2026-02-25 15:41:43.188355 | controller | changed: [instance] 2026-02-25 15:41:43.188402 | controller | 2026-02-25 15:41:43.188412 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2026-02-25 15:41:43.188421 | controller | Wednesday 25 February 2026 15:41:43 +0000 (0:00:00.209) 0:00:14.170 **** 2026-02-25 15:41:43.691968 | controller | changed: [instance] 2026-02-25 15:41:44.260959 | controller | 2026-02-25 15:41:44.260991 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2026-02-25 15:41:44.260999 | controller | Wednesday 25 February 2026 15:41:43 +0000 (0:00:00.503) 0:00:14.673 **** 2026-02-25 15:41:44.261010 | controller | changed: [instance] 2026-02-25 15:41:44.450890 | controller | 2026-02-25 15:41:44.450916 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2026-02-25 15:41:44.450924 | controller | Wednesday 25 February 2026 15:41:44 +0000 (0:00:00.569) 0:00:15.243 **** 2026-02-25 15:41:44.450934 | controller | ok: [instance] 2026-02-25 15:41:45.086299 | controller | 2026-02-25 15:41:45.086340 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2026-02-25 15:41:45.086350 | controller | Wednesday 25 February 2026 15:41:44 +0000 (0:00:00.190) 0:00:15.433 **** 2026-02-25 15:41:45.086364 | controller | ok: [instance] 2026-02-25 15:41:45.086371 | controller | 2026-02-25 15:41:45.086378 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2026-02-25 15:41:45.086395 | controller | Wednesday 25 February 2026 15:41:45 +0000 (0:00:00.635) 0:00:16.068 **** 2026-02-25 15:41:45.847759 | controller | changed: [instance] 2026-02-25 15:41:45.931366 | controller | 2026-02-25 15:41:45.931414 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2026-02-25 15:41:45.931424 | controller | Wednesday 25 February 2026 15:41:45 +0000 (0:00:00.761) 0:00:16.830 **** 2026-02-25 15:41:45.931439 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2026-02-25 15:41:45.931475 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2026-02-25 15:41:45.931484 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2026-02-25 15:41:45.931491 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2026-02-25 15:41:45.931501 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2026-02-25 15:41:45.932214 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2026-02-25 15:41:46.275290 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2026-02-25 15:41:46.275333 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2026-02-25 15:41:46.275342 | controller | 2026-02-25 15:41:46.275350 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2026-02-25 15:41:46.275357 | controller | Wednesday 25 February 2026 15:41:45 +0000 (0:00:00.083) 0:00:16.913 **** 2026-02-25 15:41:46.275369 | controller | ok: [instance] 2026-02-25 15:41:46.275401 | controller | 2026-02-25 15:41:46.275411 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2026-02-25 15:41:46.592276 | controller | Wednesday 25 February 2026 15:41:46 +0000 (0:00:00.344) 0:00:17.258 **** 2026-02-25 15:41:46.592310 | controller | ok: [instance] 2026-02-25 15:41:46.901823 | controller | 2026-02-25 15:41:46.901862 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2026-02-25 15:41:46.901870 | controller | Wednesday 25 February 2026 15:41:46 +0000 (0:00:00.316) 0:00:17.574 **** 2026-02-25 15:41:46.901882 | controller | ok: [instance] 2026-02-25 15:41:47.208308 | controller | 2026-02-25 15:41:47.208343 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2026-02-25 15:41:47.208352 | controller | Wednesday 25 February 2026 15:41:46 +0000 (0:00:00.309) 0:00:17.884 **** 2026-02-25 15:41:47.208363 | controller | ok: [instance] 2026-02-25 15:41:47.208385 | controller | 2026-02-25 15:41:47.208393 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2026-02-25 15:41:47.208443 | controller | Wednesday 25 February 2026 15:41:47 +0000 (0:00:00.306) 0:00:18.191 **** 2026-02-25 15:41:47.519868 | controller | ok: [instance] 2026-02-25 15:41:47.830900 | controller | 2026-02-25 15:41:47.830938 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2026-02-25 15:41:47.830946 | controller | Wednesday 25 February 2026 15:41:47 +0000 (0:00:00.311) 0:00:18.502 **** 2026-02-25 15:41:47.830958 | controller | ok: [instance] 2026-02-25 15:41:48.141087 | controller | 2026-02-25 15:41:48.141112 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2026-02-25 15:41:48.141119 | controller | Wednesday 25 February 2026 15:41:47 +0000 (0:00:00.310) 0:00:18.813 **** 2026-02-25 15:41:48.141133 | controller | ok: [instance] 2026-02-25 15:41:48.449297 | controller | 2026-02-25 15:41:48.449336 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2026-02-25 15:41:48.449347 | controller | Wednesday 25 February 2026 15:41:48 +0000 (0:00:00.310) 0:00:19.123 **** 2026-02-25 15:41:48.449367 | controller | ok: [instance] 2026-02-25 15:41:48.449409 | controller | 2026-02-25 15:41:48.449419 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2026-02-25 15:41:48.449429 | controller | Wednesday 25 February 2026 15:41:48 +0000 (0:00:00.308) 0:00:19.432 **** 2026-02-25 15:41:48.759211 | controller | ok: [instance] 2026-02-25 15:41:49.069320 | controller | 2026-02-25 15:41:49.069347 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2026-02-25 15:41:49.069355 | controller | Wednesday 25 February 2026 15:41:48 +0000 (0:00:00.309) 0:00:19.741 **** 2026-02-25 15:41:49.069365 | controller | ok: [instance] 2026-02-25 15:41:49.378852 | controller | 2026-02-25 15:41:49.378874 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2026-02-25 15:41:49.378882 | controller | Wednesday 25 February 2026 15:41:49 +0000 (0:00:00.310) 0:00:20.052 **** 2026-02-25 15:41:49.378891 | controller | ok: [instance] 2026-02-25 15:41:49.688331 | controller | 2026-02-25 15:41:49.688375 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2026-02-25 15:41:49.688385 | controller | Wednesday 25 February 2026 15:41:49 +0000 (0:00:00.309) 0:00:20.361 **** 2026-02-25 15:41:49.688399 | controller | ok: [instance] 2026-02-25 15:41:49.993783 | controller | 2026-02-25 15:41:49.993818 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2026-02-25 15:41:49.993826 | controller | Wednesday 25 February 2026 15:41:49 +0000 (0:00:00.309) 0:00:20.670 **** 2026-02-25 15:41:49.993837 | controller | ok: [instance] 2026-02-25 15:41:50.308778 | controller | 2026-02-25 15:41:50.308819 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2026-02-25 15:41:50.308828 | controller | Wednesday 25 February 2026 15:41:49 +0000 (0:00:00.305) 0:00:20.976 **** 2026-02-25 15:41:50.308839 | controller | ok: [instance] 2026-02-25 15:41:50.625454 | controller | 2026-02-25 15:41:50.625494 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2026-02-25 15:41:50.625502 | controller | Wednesday 25 February 2026 15:41:50 +0000 (0:00:00.314) 0:00:21.291 **** 2026-02-25 15:41:50.625514 | controller | ok: [instance] 2026-02-25 15:41:50.941857 | controller | 2026-02-25 15:41:50.941887 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2026-02-25 15:41:50.941896 | controller | Wednesday 25 February 2026 15:41:50 +0000 (0:00:00.316) 0:00:21.607 **** 2026-02-25 15:41:50.941906 | controller | ok: [instance] 2026-02-25 15:41:51.255593 | controller | 2026-02-25 15:41:51.255630 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2026-02-25 15:41:51.255639 | controller | Wednesday 25 February 2026 15:41:50 +0000 (0:00:00.316) 0:00:21.924 **** 2026-02-25 15:41:51.255650 | controller | ok: [instance] 2026-02-25 15:41:51.578700 | controller | 2026-02-25 15:41:51.578734 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2026-02-25 15:41:51.578742 | controller | Wednesday 25 February 2026 15:41:51 +0000 (0:00:00.313) 0:00:22.238 **** 2026-02-25 15:41:51.578754 | controller | ok: [instance] 2026-02-25 15:41:51.906243 | controller | 2026-02-25 15:41:51.906273 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2026-02-25 15:41:51.906281 | controller | Wednesday 25 February 2026 15:41:51 +0000 (0:00:00.322) 0:00:22.561 **** 2026-02-25 15:41:51.906292 | controller | ok: [instance] 2026-02-25 15:41:51.906388 | controller | 2026-02-25 15:41:51.906398 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2026-02-25 15:41:51.906406 | controller | Wednesday 25 February 2026 15:41:51 +0000 (0:00:00.327) 0:00:22.888 **** 2026-02-25 15:41:52.221874 | controller | ok: [instance] 2026-02-25 15:41:52.535945 | controller | 2026-02-25 15:41:52.535972 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2026-02-25 15:41:52.535980 | controller | Wednesday 25 February 2026 15:41:52 +0000 (0:00:00.315) 0:00:23.204 **** 2026-02-25 15:41:52.535990 | controller | ok: [instance] 2026-02-25 15:41:52.842955 | controller | 2026-02-25 15:41:52.842977 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2026-02-25 15:41:52.842985 | controller | Wednesday 25 February 2026 15:41:52 +0000 (0:00:00.314) 0:00:23.518 **** 2026-02-25 15:41:52.843002 | controller | ok: [instance] 2026-02-25 15:41:53.147145 | controller | 2026-02-25 15:41:53.147193 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2026-02-25 15:41:53.147208 | controller | Wednesday 25 February 2026 15:41:52 +0000 (0:00:00.307) 0:00:23.825 **** 2026-02-25 15:41:53.147219 | controller | ok: [instance] 2026-02-25 15:41:53.456778 | controller | 2026-02-25 15:41:53.456803 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2026-02-25 15:41:53.456811 | controller | Wednesday 25 February 2026 15:41:53 +0000 (0:00:00.303) 0:00:24.129 **** 2026-02-25 15:41:53.456821 | controller | ok: [instance] 2026-02-25 15:41:53.477324 | controller | 2026-02-25 15:41:53.477366 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2026-02-25 15:41:53.477377 | controller | Wednesday 25 February 2026 15:41:53 +0000 (0:00:00.309) 0:00:24.439 **** 2026-02-25 15:41:53.477391 | controller | skipping: [instance] 2026-02-25 15:41:53.750311 | controller | 2026-02-25 15:41:53.750352 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2026-02-25 15:41:53.750362 | controller | Wednesday 25 February 2026 15:41:53 +0000 (0:00:00.020) 0:00:24.459 **** 2026-02-25 15:41:53.750374 | controller | ok: [instance] 2026-02-25 15:41:53.750405 | controller | 2026-02-25 15:41:53.750413 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2026-02-25 15:41:53.750421 | controller | Wednesday 25 February 2026 15:41:53 +0000 (0:00:00.272) 0:00:24.732 **** 2026-02-25 15:41:54.113269 | controller | ok: [instance] 2026-02-25 15:41:54.415697 | controller | 2026-02-25 15:41:54.415729 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2026-02-25 15:41:54.415739 | controller | Wednesday 25 February 2026 15:41:54 +0000 (0:00:00.363) 0:00:25.095 **** 2026-02-25 15:41:54.415751 | controller | changed: [instance] 2026-02-25 15:41:54.692555 | controller | 2026-02-25 15:41:54.692576 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2026-02-25 15:41:54.692584 | controller | Wednesday 25 February 2026 15:41:54 +0000 (0:00:00.302) 0:00:25.398 **** 2026-02-25 15:41:54.692592 | controller | [WARNING]: Reset is not implemented for this connection 2026-02-25 15:41:54.703363 | controller | changed: [instance] 2026-02-25 15:41:54.703396 | controller | 2026-02-25 15:41:54.703404 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2026-02-25 15:41:54.703409 | controller | Wednesday 25 February 2026 15:41:54 +0000 (0:00:00.271) 0:00:25.669 **** 2026-02-25 15:41:54.703414 | controller | 2026-02-25 15:41:54.703419 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2026-02-25 15:41:54.703426 | controller | Wednesday 25 February 2026 15:41:54 +0000 (0:00:00.015) 0:00:25.685 **** 2026-02-25 15:41:54.775814 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2026-02-25 15:41:54.775889 | controller | 2026-02-25 15:41:54.775903 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2026-02-25 15:41:54.775917 | controller | Wednesday 25 February 2026 15:41:54 +0000 (0:00:00.072) 0:00:25.758 **** 2026-02-25 15:41:54.816044 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2026-02-25 15:41:54.862285 | controller | 2026-02-25 15:41:54.862308 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-02-25 15:41:54.862317 | controller | Wednesday 25 February 2026 15:41:54 +0000 (0:00:00.040) 0:00:25.798 **** 2026-02-25 15:41:54.862329 | controller | ok: [instance] => (item=compute) 2026-02-25 15:41:54.862357 | controller | ok: [instance] => (item=controller) 2026-02-25 15:41:54.862365 | controller | ok: [instance] => (item=crc) 2026-02-25 15:41:54.862372 | controller | 2026-02-25 15:41:54.862378 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-02-25 15:41:54.862387 | controller | Wednesday 25 February 2026 15:41:54 +0000 (0:00:00.046) 0:00:25.844 **** 2026-02-25 15:41:54.901084 | controller | ok: [instance] 2026-02-25 15:41:54.901253 | controller | 2026-02-25 15:41:54.901371 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-02-25 15:41:54.901533 | controller | Wednesday 25 February 2026 15:41:54 +0000 (0:00:00.039) 0:00:25.884 **** 2026-02-25 15:41:54.942963 | controller | ok: [instance] => changed=false 2026-02-25 15:41:54.943083 | controller | msg: All assertions passed 2026-02-25 15:41:54.943205 | controller | 2026-02-25 15:41:54.943322 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2026-02-25 15:41:54.943428 | controller | Wednesday 25 February 2026 15:41:54 +0000 (0:00:00.041) 0:00:25.925 **** 2026-02-25 15:41:55.003924 | controller | 2026-02-25 15:41:55.004105 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2026-02-25 15:41:55.004219 | controller | Wednesday 25 February 2026 15:41:55 +0000 (0:00:00.061) 0:00:25.986 **** 2026-02-25 15:41:55.082202 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.49', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2026-02-25 15:41:55.082413 | controller | ok: [instance] => (item={}) 2026-02-25 15:41:55.082489 | controller | 2026-02-25 15:41:55.082629 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2026-02-25 15:41:55.082707 | controller | Wednesday 25 February 2026 15:41:55 +0000 (0:00:00.078) 0:00:26.065 **** 2026-02-25 15:41:55.099870 | controller | skipping: [instance] 2026-02-25 15:41:55.100058 | controller | 2026-02-25 15:41:55.100277 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2026-02-25 15:41:55.100408 | controller | Wednesday 25 February 2026 15:41:55 +0000 (0:00:00.017) 0:00:26.082 **** 2026-02-25 15:41:55.314182 | controller | ok: [instance] 2026-02-25 15:41:55.650503 | controller | 2026-02-25 15:41:55.650523 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2026-02-25 15:41:55.650531 | controller | Wednesday 25 February 2026 15:41:55 +0000 (0:00:00.213) 0:00:26.296 **** 2026-02-25 15:41:55.650540 | controller | changed: [instance] 2026-02-25 15:41:56.364945 | controller | 2026-02-25 15:41:56.364976 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2026-02-25 15:41:56.364984 | controller | Wednesday 25 February 2026 15:41:55 +0000 (0:00:00.336) 0:00:26.633 **** 2026-02-25 15:41:56.364994 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2026-02-25 15:41:56.390563 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2026-02-25 15:41:56.390580 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2026-02-25 15:41:56.390587 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2026-02-25 15:41:56.390592 | controller | 2026-02-25 15:41:56.390597 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2026-02-25 15:41:56.390602 | controller | Wednesday 25 February 2026 15:41:56 +0000 (0:00:00.714) 0:00:27.347 **** 2026-02-25 15:41:56.390610 | controller | skipping: [instance] 2026-02-25 15:41:56.745374 | controller | 2026-02-25 15:41:56.745427 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2026-02-25 15:41:56.745442 | controller | Wednesday 25 February 2026 15:41:56 +0000 (0:00:00.026) 0:00:27.373 **** 2026-02-25 15:41:56.745460 | controller | changed: [instance] 2026-02-25 15:41:56.745505 | controller | 2026-02-25 15:41:56.745517 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2026-02-25 15:41:56.745527 | controller | Wednesday 25 February 2026 15:41:56 +0000 (0:00:00.345) 0:00:27.719 **** 2026-02-25 15:41:56.745536 | controller | 2026-02-25 15:41:56.745548 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-25 15:41:57.150137 | controller | Wednesday 25 February 2026 15:41:56 +0000 (0:00:00.008) 0:00:27.727 **** 2026-02-25 15:41:57.150206 | controller | changed: [instance] 2026-02-25 15:41:57.222308 | controller | 2026-02-25 15:41:57.222350 | controller | TASK [Ensure no default networks exists] *************************************** 2026-02-25 15:41:57.222361 | controller | Wednesday 25 February 2026 15:41:57 +0000 (0:00:00.404) 0:00:28.132 **** 2026-02-25 15:41:57.222376 | controller | 2026-02-25 15:41:58.400558 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2026-02-25 15:41:58.400594 | controller | Wednesday 25 February 2026 15:41:57 +0000 (0:00:00.072) 0:00:28.204 **** 2026-02-25 15:41:58.400607 | controller | ok: [instance] 2026-02-25 15:41:58.640981 | controller | 2026-02-25 15:41:58.641015 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2026-02-25 15:41:58.641023 | controller | Wednesday 25 February 2026 15:41:58 +0000 (0:00:01.178) 0:00:29.382 **** 2026-02-25 15:41:58.641034 | controller | ok: [instance] 2026-02-25 15:41:59.174270 | controller | 2026-02-25 15:41:59.174318 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2026-02-25 15:41:59.174329 | controller | Wednesday 25 February 2026 15:41:58 +0000 (0:00:00.240) 0:00:29.623 **** 2026-02-25 15:41:59.174342 | controller | ok: [instance] 2026-02-25 15:41:59.174425 | controller | 2026-02-25 15:41:59.174465 | controller | TASK [libvirt_manager : Removing default] ************************************** 2026-02-25 15:41:59.400372 | controller | Wednesday 25 February 2026 15:41:59 +0000 (0:00:00.533) 0:00:30.156 **** 2026-02-25 15:41:59.400412 | controller | ok: [instance] 2026-02-25 15:42:00.644228 | controller | 2026-02-25 15:42:00.644263 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2026-02-25 15:42:00.644271 | controller | Wednesday 25 February 2026 15:41:59 +0000 (0:00:00.226) 0:00:30.383 **** 2026-02-25 15:42:00.644282 | controller | ok: [instance] 2026-02-25 15:42:00.958831 | controller | 2026-02-25 15:42:00.958866 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2026-02-25 15:42:00.958874 | controller | Wednesday 25 February 2026 15:42:00 +0000 (0:00:01.243) 0:00:31.626 **** 2026-02-25 15:42:00.958893 | controller | ok: [instance] 2026-02-25 15:42:01.280896 | controller | 2026-02-25 15:42:01.280926 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2026-02-25 15:42:01.280934 | controller | Wednesday 25 February 2026 15:42:00 +0000 (0:00:00.314) 0:00:31.941 **** 2026-02-25 15:42:01.280945 | controller | changed: [instance] 2026-02-25 15:42:01.616292 | controller | 2026-02-25 15:42:01.616344 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2026-02-25 15:42:01.616356 | controller | Wednesday 25 February 2026 15:42:01 +0000 (0:00:00.321) 0:00:32.263 **** 2026-02-25 15:42:01.616371 | controller | changed: [instance] 2026-02-25 15:42:03.275967 | controller | 2026-02-25 15:42:03.276005 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2026-02-25 15:42:03.276013 | controller | Wednesday 25 February 2026 15:42:01 +0000 (0:00:00.335) 0:00:32.598 **** 2026-02-25 15:42:03.276025 | controller | changed: [instance] => (item=arptables) 2026-02-25 15:42:03.611689 | controller | changed: [instance] => (item=iptables) 2026-02-25 15:42:03.611729 | controller | changed: [instance] => (item=ip6tables) 2026-02-25 15:42:03.611737 | controller | 2026-02-25 15:42:03.611743 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2026-02-25 15:42:03.611749 | controller | Wednesday 25 February 2026 15:42:03 +0000 (0:00:01.659) 0:00:34.258 **** 2026-02-25 15:42:03.611760 | controller | ok: [instance] 2026-02-25 15:42:03.730073 | controller | 2026-02-25 15:42:03.730115 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2026-02-25 15:42:03.730125 | controller | Wednesday 25 February 2026 15:42:03 +0000 (0:00:00.335) 0:00:34.593 **** 2026-02-25 15:42:03.730137 | controller | ok: [instance] 2026-02-25 15:42:03.774264 | controller | 2026-02-25 15:42:03.774304 | controller | TASK [Ensure the required network configurations are applied] ****************** 2026-02-25 15:42:03.774314 | controller | Wednesday 25 February 2026 15:42:03 +0000 (0:00:00.118) 0:00:34.712 **** 2026-02-25 15:42:03.774327 | controller | 2026-02-25 15:42:03.798845 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2026-02-25 15:42:03.798881 | controller | Wednesday 25 February 2026 15:42:03 +0000 (0:00:00.044) 0:00:34.756 **** 2026-02-25 15:42:03.798895 | controller | skipping: [instance] 2026-02-25 15:42:03.823749 | controller | 2026-02-25 15:42:03.823769 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2026-02-25 15:42:03.823778 | controller | Wednesday 25 February 2026 15:42:03 +0000 (0:00:00.024) 0:00:34.781 **** 2026-02-25 15:42:03.823786 | controller | skipping: [instance] 2026-02-25 15:42:03.847906 | controller | 2026-02-25 15:42:03.847922 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-25 15:42:03.847929 | controller | Wednesday 25 February 2026 15:42:03 +0000 (0:00:00.024) 0:00:34.806 **** 2026-02-25 15:42:03.847937 | controller | skipping: [instance] 2026-02-25 15:42:03.931901 | controller | 2026-02-25 15:42:03.931929 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2026-02-25 15:42:03.931938 | controller | Wednesday 25 February 2026 15:42:03 +0000 (0:00:00.024) 0:00:34.830 **** 2026-02-25 15:42:03.931949 | controller | skipping: [instance] 2026-02-25 15:42:03.932109 | controller | 2026-02-25 15:42:03.932308 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2026-02-25 15:42:03.932471 | controller | Wednesday 25 February 2026 15:42:03 +0000 (0:00:00.084) 0:00:34.914 **** 2026-02-25 15:42:03.977094 | controller | ok: [instance] 2026-02-25 15:42:03.977293 | controller | 2026-02-25 15:42:03.977450 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2026-02-25 15:42:03.977597 | controller | Wednesday 25 February 2026 15:42:03 +0000 (0:00:00.045) 0:00:34.960 **** 2026-02-25 15:42:04.013703 | controller | skipping: [instance] 2026-02-25 15:42:04.013848 | controller | 2026-02-25 15:42:04.013985 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2026-02-25 15:42:04.014112 | controller | Wednesday 25 February 2026 15:42:04 +0000 (0:00:00.036) 0:00:34.996 **** 2026-02-25 15:42:04.040088 | controller | skipping: [instance] 2026-02-25 15:42:04.040278 | controller | 2026-02-25 15:42:04.040444 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2026-02-25 15:42:04.040598 | controller | Wednesday 25 February 2026 15:42:04 +0000 (0:00:00.026) 0:00:35.023 **** 2026-02-25 15:42:04.100221 | controller | ok: [instance] 2026-02-25 15:42:04.100358 | controller | 2026-02-25 15:42:04.100481 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2026-02-25 15:42:04.100600 | controller | Wednesday 25 February 2026 15:42:04 +0000 (0:00:00.060) 0:00:35.083 **** 2026-02-25 15:42:04.123933 | controller | skipping: [instance] 2026-02-25 15:42:04.124089 | controller | 2026-02-25 15:42:04.124275 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2026-02-25 15:42:04.124428 | controller | Wednesday 25 February 2026 15:42:04 +0000 (0:00:00.023) 0:00:35.107 **** 2026-02-25 15:42:04.175682 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2026-02-25 15:42:04.175836 | controller | 2026-02-25 15:42:04.175981 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-25 15:42:04.176121 | controller | Wednesday 25 February 2026 15:42:04 +0000 (0:00:00.051) 0:00:35.158 **** 2026-02-25 15:42:04.525396 | controller | ok: [instance -> localhost] 2026-02-25 15:42:04.525452 | controller | 2026-02-25 15:42:04.525595 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2026-02-25 15:42:11.186823 | controller | Wednesday 25 February 2026 15:42:04 +0000 (0:00:00.349) 0:00:35.508 **** 2026-02-25 15:42:11.186868 | controller | changed: [instance -> localhost] 2026-02-25 15:42:11.390606 | controller | 2026-02-25 15:42:11.390655 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-25 15:42:11.390665 | controller | Wednesday 25 February 2026 15:42:11 +0000 (0:00:06.660) 0:00:42.168 **** 2026-02-25 15:42:11.390676 | controller | changed: [instance] 2026-02-25 15:42:11.749708 | controller | 2026-02-25 15:42:11.749736 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2026-02-25 15:42:11.749744 | controller | Wednesday 25 February 2026 15:42:11 +0000 (0:00:00.204) 0:00:42.373 **** 2026-02-25 15:42:11.749761 | controller | changed: [instance] 2026-02-25 15:42:13.366092 | controller | 2026-02-25 15:42:13.366125 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2026-02-25 15:42:13.366133 | controller | Wednesday 25 February 2026 15:42:11 +0000 (0:00:00.358) 0:00:42.731 **** 2026-02-25 15:42:13.366144 | controller | changed: [instance -> localhost] 2026-02-25 15:42:13.745319 | controller | 2026-02-25 15:42:13.745359 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2026-02-25 15:42:13.745369 | controller | Wednesday 25 February 2026 15:42:13 +0000 (0:00:01.616) 0:00:44.348 **** 2026-02-25 15:42:13.746073 | controller | changed: [instance] 2026-02-25 15:42:13.779285 | controller | 2026-02-25 15:42:13.779325 | controller | TASK [reproducer : Select right domain] **************************************** 2026-02-25 15:42:13.779336 | controller | Wednesday 25 February 2026 15:42:13 +0000 (0:00:00.379) 0:00:44.727 **** 2026-02-25 15:42:13.779348 | controller | ok: [instance] 2026-02-25 15:42:13.779659 | controller | 2026-02-25 15:42:13.779698 | controller | TASK [Create the virtual networks] ********************************************* 2026-02-25 15:42:13.897094 | controller | Wednesday 25 February 2026 15:42:13 +0000 (0:00:00.034) 0:00:44.761 **** 2026-02-25 15:42:13.897119 | controller | 2026-02-25 15:42:13.918289 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2026-02-25 15:42:13.918318 | controller | Wednesday 25 February 2026 15:42:13 +0000 (0:00:00.117) 0:00:44.879 **** 2026-02-25 15:42:13.918332 | controller | ok: [instance] 2026-02-25 15:42:13.918362 | controller | 2026-02-25 15:42:13.918370 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2026-02-25 15:42:13.918379 | controller | Wednesday 25 February 2026 15:42:13 +0000 (0:00:00.021) 0:00:44.900 **** 2026-02-25 15:42:14.112034 | controller | ok: [instance] 2026-02-25 15:42:14.141331 | controller | 2026-02-25 15:42:14.141371 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2026-02-25 15:42:14.141380 | controller | Wednesday 25 February 2026 15:42:14 +0000 (0:00:00.193) 0:00:45.093 **** 2026-02-25 15:42:14.141393 | controller | skipping: [instance] 2026-02-25 15:42:14.141424 | controller | 2026-02-25 15:42:14.141434 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2026-02-25 15:42:14.141477 | controller | Wednesday 25 February 2026 15:42:14 +0000 (0:00:00.029) 0:00:45.123 **** 2026-02-25 15:42:14.169246 | controller | skipping: [instance] 2026-02-25 15:42:14.222755 | controller | 2026-02-25 15:42:14.222773 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2026-02-25 15:42:14.222780 | controller | Wednesday 25 February 2026 15:42:14 +0000 (0:00:00.027) 0:00:45.151 **** 2026-02-25 15:42:14.222789 | controller | ok: [instance] 2026-02-25 15:42:14.348128 | controller | 2026-02-25 15:42:14.348148 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2026-02-25 15:42:14.348155 | controller | Wednesday 25 February 2026 15:42:14 +0000 (0:00:00.053) 0:00:45.205 **** 2026-02-25 15:42:14.348180 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-25 15:42:14.404126 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-25 15:42:14.404191 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-25 15:42:14.404212 | controller | 2026-02-25 15:42:14.404223 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2026-02-25 15:42:14.404233 | controller | Wednesday 25 February 2026 15:42:14 +0000 (0:00:00.125) 0:00:45.330 **** 2026-02-25 15:42:14.404258 | controller | skipping: [instance] 2026-02-25 15:42:14.404519 | controller | 2026-02-25 15:42:14.404788 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2026-02-25 15:42:14.404928 | controller | Wednesday 25 February 2026 15:42:14 +0000 (0:00:00.056) 0:00:45.386 **** 2026-02-25 15:42:14.783428 | controller | changed: [instance] 2026-02-25 15:42:14.783760 | controller | 2026-02-25 15:42:14.783798 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2026-02-25 15:42:14.877980 | controller | Wednesday 25 February 2026 15:42:14 +0000 (0:00:00.378) 0:00:45.765 **** 2026-02-25 15:42:14.878022 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2026-02-25 15:42:14.935927 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2026-02-25 15:42:14.935944 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2026-02-25 15:42:14.935951 | controller | 2026-02-25 15:42:14.935956 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-25 15:42:14.935961 | controller | Wednesday 25 February 2026 15:42:14 +0000 (0:00:00.094) 0:00:45.859 **** 2026-02-25 15:42:14.935969 | controller | changed: [instance] 2026-02-25 15:42:15.241833 | controller | 2026-02-25 15:42:15.241873 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-25 15:42:15.241882 | controller | Wednesday 25 February 2026 15:42:14 +0000 (0:00:00.058) 0:00:45.917 **** 2026-02-25 15:42:15.241892 | controller | changed: [instance] 2026-02-25 15:42:15.469720 | controller | 2026-02-25 15:42:15.469744 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-25 15:42:15.469754 | controller | Wednesday 25 February 2026 15:42:15 +0000 (0:00:00.305) 0:00:46.223 **** 2026-02-25 15:42:15.469763 | controller | changed: [instance] 2026-02-25 15:42:15.532935 | controller | 2026-02-25 15:42:15.532968 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-25 15:42:15.532981 | controller | Wednesday 25 February 2026 15:42:15 +0000 (0:00:00.228) 0:00:46.452 **** 2026-02-25 15:42:15.532997 | controller | changed: [instance] 2026-02-25 15:42:15.748861 | controller | 2026-02-25 15:42:15.748891 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-25 15:42:15.748901 | controller | Wednesday 25 February 2026 15:42:15 +0000 (0:00:00.062) 0:00:46.514 **** 2026-02-25 15:42:15.748913 | controller | changed: [instance] 2026-02-25 15:42:15.986366 | controller | 2026-02-25 15:42:15.986387 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-25 15:42:15.986395 | controller | Wednesday 25 February 2026 15:42:15 +0000 (0:00:00.216) 0:00:46.731 **** 2026-02-25 15:42:15.986404 | controller | changed: [instance] 2026-02-25 15:42:16.048081 | controller | 2026-02-25 15:42:16.048101 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-25 15:42:16.048108 | controller | Wednesday 25 February 2026 15:42:15 +0000 (0:00:00.237) 0:00:46.968 **** 2026-02-25 15:42:16.048117 | controller | changed: [instance] 2026-02-25 15:42:16.267350 | controller | 2026-02-25 15:42:16.267386 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-25 15:42:16.267394 | controller | Wednesday 25 February 2026 15:42:16 +0000 (0:00:00.062) 0:00:47.030 **** 2026-02-25 15:42:16.267406 | controller | changed: [instance] 2026-02-25 15:42:16.500970 | controller | 2026-02-25 15:42:16.500994 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-25 15:42:16.501002 | controller | Wednesday 25 February 2026 15:42:16 +0000 (0:00:00.219) 0:00:47.249 **** 2026-02-25 15:42:16.501011 | controller | changed: [instance] 2026-02-25 15:42:16.723287 | controller | 2026-02-25 15:42:16.723333 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2026-02-25 15:42:16.723352 | controller | Wednesday 25 February 2026 15:42:16 +0000 (0:00:00.233) 0:00:47.483 **** 2026-02-25 15:42:16.723366 | controller | ok: [instance] 2026-02-25 15:42:17.242777 | controller | 2026-02-25 15:42:17.242830 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2026-02-25 15:42:17.242845 | controller | Wednesday 25 February 2026 15:42:16 +0000 (0:00:00.221) 0:00:47.705 **** 2026-02-25 15:42:17.242864 | controller | changed: [instance] 2026-02-25 15:42:17.430390 | controller | 2026-02-25 15:42:17.430424 | controller | TASK [libvirt_manager : Remove ini file after conversion] ********************** 2026-02-25 15:42:17.430433 | controller | Wednesday 25 February 2026 15:42:17 +0000 (0:00:00.520) 0:00:48.225 **** 2026-02-25 15:42:17.430449 | controller | changed: [instance] 2026-02-25 15:42:17.460943 | controller | 2026-02-25 15:42:17.460961 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-25 15:42:17.460969 | controller | Wednesday 25 February 2026 15:42:17 +0000 (0:00:00.187) 0:00:48.412 **** 2026-02-25 15:42:17.460977 | controller | skipping: [instance] 2026-02-25 15:42:17.490353 | controller | 2026-02-25 15:42:17.490397 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-25 15:42:17.490418 | controller | Wednesday 25 February 2026 15:42:17 +0000 (0:00:00.030) 0:00:48.443 **** 2026-02-25 15:42:17.490432 | controller | skipping: [instance] 2026-02-25 15:42:17.490468 | controller | 2026-02-25 15:42:17.490480 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-25 15:42:17.490680 | controller | Wednesday 25 February 2026 15:42:17 +0000 (0:00:00.029) 0:00:48.472 **** 2026-02-25 15:42:17.521305 | controller | skipping: [instance] 2026-02-25 15:42:17.521349 | controller | 2026-02-25 15:42:17.521752 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-25 15:42:17.546897 | controller | Wednesday 25 February 2026 15:42:17 +0000 (0:00:00.030) 0:00:48.503 **** 2026-02-25 15:42:17.546918 | controller | skipping: [instance] 2026-02-25 15:42:17.567286 | controller | 2026-02-25 15:42:17.567322 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-25 15:42:17.567330 | controller | Wednesday 25 February 2026 15:42:17 +0000 (0:00:00.025) 0:00:48.529 **** 2026-02-25 15:42:17.567340 | controller | ok: [instance] 2026-02-25 15:42:17.567400 | controller | 2026-02-25 15:42:17.567629 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-25 15:42:17.567853 | controller | Wednesday 25 February 2026 15:42:17 +0000 (0:00:00.021) 0:00:48.550 **** 2026-02-25 15:42:17.654006 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-25 15:42:17.654148 | controller | 2026-02-25 15:42:17.654320 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-25 15:42:17.654439 | controller | Wednesday 25 February 2026 15:42:17 +0000 (0:00:00.086) 0:00:48.636 **** 2026-02-25 15:42:17.677147 | controller | skipping: [instance] 2026-02-25 15:42:17.677391 | controller | 2026-02-25 15:42:17.677607 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-25 15:42:17.677826 | controller | Wednesday 25 February 2026 15:42:17 +0000 (0:00:00.023) 0:00:48.659 **** 2026-02-25 15:42:17.903805 | controller | changed: [instance] 2026-02-25 15:42:18.317381 | controller | 2026-02-25 15:42:18.317427 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-25 15:42:18.317441 | controller | Wednesday 25 February 2026 15:42:17 +0000 (0:00:00.226) 0:00:48.886 **** 2026-02-25 15:42:18.317457 | controller | changed: [instance] 2026-02-25 15:42:18.381336 | controller | 2026-02-25 15:42:18.381377 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-25 15:42:18.381387 | controller | Wednesday 25 February 2026 15:42:18 +0000 (0:00:00.413) 0:00:49.299 **** 2026-02-25 15:42:18.381401 | controller | ok: [instance] 2026-02-25 15:42:18.424324 | controller | 2026-02-25 15:42:18.424361 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-25 15:42:18.424375 | controller | Wednesday 25 February 2026 15:42:18 +0000 (0:00:00.064) 0:00:49.363 **** 2026-02-25 15:42:18.424391 | controller | ok: [instance] 2026-02-25 15:42:18.833299 | controller | 2026-02-25 15:42:18.833341 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-25 15:42:18.833352 | controller | Wednesday 25 February 2026 15:42:18 +0000 (0:00:00.042) 0:00:49.406 **** 2026-02-25 15:42:18.833367 | controller | changed: [instance] 2026-02-25 15:42:18.833403 | controller | 2026-02-25 15:42:18.833414 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2026-02-25 15:42:18.917400 | controller | Wednesday 25 February 2026 15:42:18 +0000 (0:00:00.409) 0:00:49.816 **** 2026-02-25 15:42:18.917490 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2026-02-25 15:42:18.966442 | controller | 2026-02-25 15:42:18.966496 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2026-02-25 15:42:18.966511 | controller | Wednesday 25 February 2026 15:42:18 +0000 (0:00:00.083) 0:00:49.899 **** 2026-02-25 15:42:18.966531 | controller | ok: [instance] => (item=public) 2026-02-25 15:42:18.966598 | controller | ok: [instance] => (item=osp_trunk) 2026-02-25 15:42:18.966632 | controller | 2026-02-25 15:42:18.966640 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2026-02-25 15:42:18.966651 | controller | Wednesday 25 February 2026 15:42:18 +0000 (0:00:00.048) 0:00:49.948 **** 2026-02-25 15:42:19.436113 | controller | changed: [instance] => (item=cifmw-public) 2026-02-25 15:42:20.088043 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-25 15:42:20.088086 | controller | 2026-02-25 15:42:20.088095 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2026-02-25 15:42:20.088101 | controller | Wednesday 25 February 2026 15:42:19 +0000 (0:00:00.469) 0:00:50.418 **** 2026-02-25 15:42:20.088113 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 15:42:20.546804 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 15:42:20.546833 | controller | 2026-02-25 15:42:20.546841 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2026-02-25 15:42:20.546847 | controller | Wednesday 25 February 2026 15:42:20 +0000 (0:00:00.652) 0:00:51.070 **** 2026-02-25 15:42:20.546866 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 15:42:21.042638 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 15:42:21.042666 | controller | 2026-02-25 15:42:21.042674 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2026-02-25 15:42:21.042681 | controller | Wednesday 25 February 2026 15:42:20 +0000 (0:00:00.458) 0:00:51.529 **** 2026-02-25 15:42:21.042692 | controller | changed: [instance] => (item=cifmw-public) 2026-02-25 15:42:21.107032 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-25 15:42:21.107067 | controller | 2026-02-25 15:42:21.107080 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2026-02-25 15:42:21.107091 | controller | Wednesday 25 February 2026 15:42:21 +0000 (0:00:00.495) 0:00:52.025 **** 2026-02-25 15:42:21.107106 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2026-02-25 15:42:21.315063 | controller | 2026-02-25 15:42:21.315083 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2026-02-25 15:42:21.315090 | controller | Wednesday 25 February 2026 15:42:21 +0000 (0:00:00.064) 0:00:52.089 **** 2026-02-25 15:42:21.315100 | controller | ok: [instance] 2026-02-25 15:42:21.735039 | controller | 2026-02-25 15:42:21.735103 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2026-02-25 15:42:21.735113 | controller | Wednesday 25 February 2026 15:42:21 +0000 (0:00:00.208) 0:00:52.297 **** 2026-02-25 15:42:21.735128 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 15:42:21.822289 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 15:42:21.822357 | controller | 2026-02-25 15:42:21.822369 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2026-02-25 15:42:21.822378 | controller | Wednesday 25 February 2026 15:42:21 +0000 (0:00:00.419) 0:00:52.716 **** 2026-02-25 15:42:21.822396 | controller | 2026-02-25 15:42:21.872365 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-25 15:42:21.872420 | controller | Wednesday 25 February 2026 15:42:21 +0000 (0:00:00.086) 0:00:52.803 **** 2026-02-25 15:42:21.872439 | controller | skipping: [instance] 2026-02-25 15:42:23.206309 | controller | 2026-02-25 15:42:23.206357 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2026-02-25 15:42:23.206367 | controller | Wednesday 25 February 2026 15:42:21 +0000 (0:00:00.051) 0:00:52.855 **** 2026-02-25 15:42:23.206380 | controller | ok: [instance] 2026-02-25 15:42:23.206412 | controller | 2026-02-25 15:42:23.206631 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-25 15:42:23.206703 | controller | Wednesday 25 February 2026 15:42:23 +0000 (0:00:01.333) 0:00:54.188 **** 2026-02-25 15:42:23.422736 | controller | ok: [instance] 2026-02-25 15:42:23.831144 | controller | 2026-02-25 15:42:23.831211 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2026-02-25 15:42:23.831221 | controller | Wednesday 25 February 2026 15:42:23 +0000 (0:00:00.216) 0:00:54.405 **** 2026-02-25 15:42:23.831234 | controller | changed: [instance] 2026-02-25 15:42:25.594256 | controller | 2026-02-25 15:42:25.594312 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2026-02-25 15:42:25.594321 | controller | Wednesday 25 February 2026 15:42:23 +0000 (0:00:00.407) 0:00:54.813 **** 2026-02-25 15:42:25.594333 | controller | changed: [instance] 2026-02-25 15:42:25.987562 | controller | 2026-02-25 15:42:25.987592 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2026-02-25 15:42:25.987613 | controller | Wednesday 25 February 2026 15:42:25 +0000 (0:00:01.763) 0:00:56.576 **** 2026-02-25 15:42:25.987623 | controller | changed: [instance] 2026-02-25 15:42:26.023790 | controller | 2026-02-25 15:42:26.023807 | controller | TASK [Create extra network configuration] ************************************** 2026-02-25 15:42:26.023814 | controller | Wednesday 25 February 2026 15:42:25 +0000 (0:00:00.393) 0:00:56.970 **** 2026-02-25 15:42:26.023823 | controller | skipping: [instance] 2026-02-25 15:42:26.055404 | controller | 2026-02-25 15:42:26.055459 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2026-02-25 15:42:26.055471 | controller | Wednesday 25 February 2026 15:42:26 +0000 (0:00:00.036) 0:00:57.006 **** 2026-02-25 15:42:26.055486 | controller | skipping: [instance] 2026-02-25 15:42:26.538312 | controller | 2026-02-25 15:42:26.538367 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2026-02-25 15:42:26.538377 | controller | Wednesday 25 February 2026 15:42:26 +0000 (0:00:00.031) 0:00:57.038 **** 2026-02-25 15:42:26.538389 | controller | ok: [instance] 2026-02-25 15:42:26.702111 | controller | 2026-02-25 15:42:26.702194 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2026-02-25 15:42:26.702206 | controller | Wednesday 25 February 2026 15:42:26 +0000 (0:00:00.482) 0:00:57.520 **** 2026-02-25 15:42:26.702220 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 15:42:27.963909 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 15:42:27.963947 | controller | 2026-02-25 15:42:27.963956 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2026-02-25 15:42:27.963972 | controller | Wednesday 25 February 2026 15:42:26 +0000 (0:00:00.163) 0:00:57.684 **** 2026-02-25 15:42:27.963983 | controller | ok: [instance] 2026-02-25 15:42:32.010427 | controller | 2026-02-25 15:42:32.010491 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2026-02-25 15:42:32.010501 | controller | Wednesday 25 February 2026 15:42:27 +0000 (0:00:01.261) 0:00:58.946 **** 2026-02-25 15:42:32.010514 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2026-02-25 15:42:32.263334 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2026-02-25 15:42:32.263378 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2026-02-25 15:42:32.263386 | controller | 2026-02-25 15:42:32.263393 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2026-02-25 15:42:32.263399 | controller | Wednesday 25 February 2026 15:42:32 +0000 (0:00:04.045) 0:01:02.991 **** 2026-02-25 15:42:32.263411 | controller | changed: [instance] 2026-02-25 15:42:32.664767 | controller | 2026-02-25 15:42:32.664802 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2026-02-25 15:42:32.664811 | controller | Wednesday 25 February 2026 15:42:32 +0000 (0:00:00.253) 0:01:03.245 **** 2026-02-25 15:42:32.664821 | controller | changed: [instance] 2026-02-25 15:42:33.090694 | controller | 2026-02-25 15:42:33.090725 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2026-02-25 15:42:33.090733 | controller | Wednesday 25 February 2026 15:42:32 +0000 (0:00:00.400) 0:01:03.646 **** 2026-02-25 15:42:33.090742 | controller | changed: [instance] 2026-02-25 15:42:33.128355 | controller | 2026-02-25 15:42:33.128420 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2026-02-25 15:42:33.128430 | controller | Wednesday 25 February 2026 15:42:33 +0000 (0:00:00.426) 0:01:04.073 **** 2026-02-25 15:42:33.128444 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2026-02-25 15:42:33.128478 | controller | 2026-02-25 15:42:33.128488 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2026-02-25 15:42:33.577677 | controller | Wednesday 25 February 2026 15:42:33 +0000 (0:00:00.037) 0:01:04.111 **** 2026-02-25 15:42:33.577739 | controller | changed: [instance] 2026-02-25 15:42:33.603073 | controller | 2026-02-25 15:42:33.603092 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2026-02-25 15:42:33.603099 | controller | Wednesday 25 February 2026 15:42:33 +0000 (0:00:00.448) 0:01:04.559 **** 2026-02-25 15:42:33.603108 | controller | skipping: [instance] 2026-02-25 15:42:33.641807 | controller | 2026-02-25 15:42:33.641833 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2026-02-25 15:42:33.641841 | controller | Wednesday 25 February 2026 15:42:33 +0000 (0:00:00.026) 0:01:04.585 **** 2026-02-25 15:42:33.641852 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2026-02-25 15:42:34.066197 | controller | 2026-02-25 15:42:34.066254 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2026-02-25 15:42:34.066264 | controller | Wednesday 25 February 2026 15:42:33 +0000 (0:00:00.038) 0:01:04.624 **** 2026-02-25 15:42:34.066275 | controller | changed: [instance] 2026-02-25 15:42:34.091318 | controller | 2026-02-25 15:42:34.091368 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2026-02-25 15:42:34.091378 | controller | Wednesday 25 February 2026 15:42:34 +0000 (0:00:00.423) 0:01:05.048 **** 2026-02-25 15:42:34.091394 | controller | skipping: [instance] 2026-02-25 15:42:34.091496 | controller | 2026-02-25 15:42:34.091530 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2026-02-25 15:42:34.091544 | controller | Wednesday 25 February 2026 15:42:34 +0000 (0:00:00.025) 0:01:05.073 **** 2026-02-25 15:42:34.328788 | controller | ok: [instance] => (item=127.0.0.2) 2026-02-25 15:42:35.033349 | controller | 2026-02-25 15:42:35.033420 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2026-02-25 15:42:35.033430 | controller | Wednesday 25 February 2026 15:42:34 +0000 (0:00:00.237) 0:01:05.311 **** 2026-02-25 15:42:35.033446 | controller | changed: [instance] 2026-02-25 15:42:35.058262 | controller | 2026-02-25 15:42:35.058293 | controller | TASK [dnsmasq : Stop service] ************************************************** 2026-02-25 15:42:35.058302 | controller | Wednesday 25 February 2026 15:42:35 +0000 (0:00:00.703) 0:01:06.015 **** 2026-02-25 15:42:35.058314 | controller | skipping: [instance] 2026-02-25 15:42:35.084821 | controller | 2026-02-25 15:42:35.084848 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2026-02-25 15:42:35.084858 | controller | Wednesday 25 February 2026 15:42:35 +0000 (0:00:00.025) 0:01:06.040 **** 2026-02-25 15:42:35.084868 | controller | skipping: [instance] 2026-02-25 15:42:35.120915 | controller | 2026-02-25 15:42:35.120933 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2026-02-25 15:42:35.120940 | controller | Wednesday 25 February 2026 15:42:35 +0000 (0:00:00.026) 0:01:06.067 **** 2026-02-25 15:42:35.120955 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-25 15:42:35.239144 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2026-02-25 15:42:35.239183 | controller | skipping: [instance] 2026-02-25 15:42:35.239192 | controller | 2026-02-25 15:42:35.239197 | controller | TASK [Create dnsmasq networks] ************************************************* 2026-02-25 15:42:35.239203 | controller | Wednesday 25 February 2026 15:42:35 +0000 (0:00:00.036) 0:01:06.103 **** 2026-02-25 15:42:35.239211 | controller | 2026-02-25 15:42:35.277366 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-25 15:42:35.277421 | controller | Wednesday 25 February 2026 15:42:35 +0000 (0:00:00.118) 0:01:06.221 **** 2026-02-25 15:42:35.277438 | controller | ok: [instance] => changed=false 2026-02-25 15:42:35.277472 | controller | msg: All assertions passed 2026-02-25 15:42:35.277482 | controller | 2026-02-25 15:42:35.277561 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-25 15:42:35.277599 | controller | Wednesday 25 February 2026 15:42:35 +0000 (0:00:00.038) 0:01:06.259 **** 2026-02-25 15:42:35.321469 | controller | ok: [instance] => changed=false 2026-02-25 15:42:35.321742 | controller | msg: All assertions passed 2026-02-25 15:42:35.321948 | controller | 2026-02-25 15:42:35.322156 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-25 15:42:35.322389 | controller | Wednesday 25 February 2026 15:42:35 +0000 (0:00:00.044) 0:01:06.304 **** 2026-02-25 15:42:35.827318 | controller | changed: [instance] 2026-02-25 15:42:35.827388 | controller | 2026-02-25 15:42:35.827402 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-25 15:42:35.827574 | controller | Wednesday 25 February 2026 15:42:35 +0000 (0:00:00.504) 0:01:06.809 **** 2026-02-25 15:42:35.854263 | controller | skipping: [instance] 2026-02-25 15:42:35.854317 | controller | 2026-02-25 15:42:35.854539 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-25 15:42:35.887553 | controller | Wednesday 25 February 2026 15:42:35 +0000 (0:00:00.027) 0:01:06.837 **** 2026-02-25 15:42:35.887592 | controller | skipping: [instance] 2026-02-25 15:42:35.927302 | controller | 2026-02-25 15:42:35.927332 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-25 15:42:35.927346 | controller | Wednesday 25 February 2026 15:42:35 +0000 (0:00:00.033) 0:01:06.870 **** 2026-02-25 15:42:35.927357 | controller | ok: [instance] => changed=false 2026-02-25 15:42:35.927379 | controller | msg: All assertions passed 2026-02-25 15:42:35.927412 | controller | 2026-02-25 15:42:35.927637 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-25 15:42:35.972018 | controller | Wednesday 25 February 2026 15:42:35 +0000 (0:00:00.039) 0:01:06.910 **** 2026-02-25 15:42:35.972056 | controller | ok: [instance] => changed=false 2026-02-25 15:42:36.466335 | controller | msg: All assertions passed 2026-02-25 15:42:36.466375 | controller | 2026-02-25 15:42:36.466384 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-25 15:42:36.466391 | controller | Wednesday 25 February 2026 15:42:35 +0000 (0:00:00.044) 0:01:06.954 **** 2026-02-25 15:42:36.466403 | controller | changed: [instance] 2026-02-25 15:42:36.466435 | controller | 2026-02-25 15:42:36.466445 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-25 15:42:36.466473 | controller | Wednesday 25 February 2026 15:42:36 +0000 (0:00:00.494) 0:01:07.448 **** 2026-02-25 15:42:36.493004 | controller | skipping: [instance] 2026-02-25 15:42:36.521696 | controller | 2026-02-25 15:42:36.521719 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-25 15:42:36.521728 | controller | Wednesday 25 February 2026 15:42:36 +0000 (0:00:00.027) 0:01:07.475 **** 2026-02-25 15:42:36.521737 | controller | skipping: [instance] 2026-02-25 15:42:36.560692 | controller | 2026-02-25 15:42:36.560713 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2026-02-25 15:42:36.560720 | controller | Wednesday 25 February 2026 15:42:36 +0000 (0:00:00.028) 0:01:07.504 **** 2026-02-25 15:42:36.560729 | controller | skipping: [instance] 2026-02-25 15:42:37.124982 | controller | 2026-02-25 15:42:37.125037 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2026-02-25 15:42:37.125047 | controller | Wednesday 25 February 2026 15:42:36 +0000 (0:00:00.038) 0:01:07.543 **** 2026-02-25 15:42:37.125059 | controller | changed: [instance] => (item=cifmw-public) 2026-02-25 15:42:37.166147 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-25 15:42:37.166185 | controller | 2026-02-25 15:42:37.166194 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-25 15:42:37.166200 | controller | Wednesday 25 February 2026 15:42:37 +0000 (0:00:00.563) 0:01:08.106 **** 2026-02-25 15:42:37.166211 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2026-02-25 15:42:37.530145 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2026-02-25 15:42:37.530219 | controller | 2026-02-25 15:42:37.530229 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-25 15:42:37.530237 | controller | Wednesday 25 February 2026 15:42:37 +0000 (0:00:00.041) 0:01:08.148 **** 2026-02-25 15:42:37.530251 | controller | ok: [instance] 2026-02-25 15:42:37.570237 | controller | 2026-02-25 15:42:37.570267 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-25 15:42:37.570288 | controller | Wednesday 25 February 2026 15:42:37 +0000 (0:00:00.362) 0:01:08.511 **** 2026-02-25 15:42:37.570301 | controller | ok: [instance] 2026-02-25 15:42:37.823410 | controller | 2026-02-25 15:42:37.823484 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-25 15:42:37.823497 | controller | Wednesday 25 February 2026 15:42:37 +0000 (0:00:00.041) 0:01:08.552 **** 2026-02-25 15:42:37.823514 | controller | ok: [instance] 2026-02-25 15:42:37.870970 | controller | 2026-02-25 15:42:37.871027 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-25 15:42:37.871039 | controller | Wednesday 25 February 2026 15:42:37 +0000 (0:00:00.252) 0:01:08.805 **** 2026-02-25 15:42:37.871055 | controller | ok: [instance] 2026-02-25 15:42:38.250231 | controller | 2026-02-25 15:42:38.250292 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2026-02-25 15:42:38.250301 | controller | Wednesday 25 February 2026 15:42:37 +0000 (0:00:00.048) 0:01:08.853 **** 2026-02-25 15:42:38.250317 | controller | changed: [instance] 2026-02-25 15:42:38.619310 | controller | 2026-02-25 15:42:38.619356 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2026-02-25 15:42:38.619374 | controller | Wednesday 25 February 2026 15:42:38 +0000 (0:00:00.378) 0:01:09.232 **** 2026-02-25 15:42:38.619389 | controller | changed: [instance] 2026-02-25 15:42:38.982530 | controller | 2026-02-25 15:42:38.982569 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2026-02-25 15:42:38.982591 | controller | Wednesday 25 February 2026 15:42:38 +0000 (0:00:00.369) 0:01:09.601 **** 2026-02-25 15:42:38.982605 | controller | changed: [instance] 2026-02-25 15:42:39.077565 | controller | 2026-02-25 15:42:39.077637 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2026-02-25 15:42:39.077646 | controller | Wednesday 25 February 2026 15:42:38 +0000 (0:00:00.363) 0:01:09.964 **** 2026-02-25 15:42:39.077659 | controller | ok: [instance] 2026-02-25 15:42:39.453288 | controller | 2026-02-25 15:42:39.453368 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2026-02-25 15:42:39.453380 | controller | Wednesday 25 February 2026 15:42:39 +0000 (0:00:00.095) 0:01:10.060 **** 2026-02-25 15:42:39.453396 | controller | changed: [instance] 2026-02-25 15:42:39.481014 | controller | 2026-02-25 15:42:39.481036 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-25 15:42:39.481044 | controller | Wednesday 25 February 2026 15:42:39 +0000 (0:00:00.375) 0:01:10.435 **** 2026-02-25 15:42:39.481056 | controller | skipping: [instance] 2026-02-25 15:42:39.481157 | controller | 2026-02-25 15:42:39.481292 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-25 15:42:39.481414 | controller | Wednesday 25 February 2026 15:42:39 +0000 (0:00:00.028) 0:01:10.463 **** 2026-02-25 15:42:39.508325 | controller | skipping: [instance] 2026-02-25 15:42:39.508396 | controller | 2026-02-25 15:42:39.508536 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-25 15:42:39.508624 | controller | Wednesday 25 February 2026 15:42:39 +0000 (0:00:00.027) 0:01:10.491 **** 2026-02-25 15:42:39.537459 | controller | skipping: [instance] 2026-02-25 15:42:39.537613 | controller | 2026-02-25 15:42:39.537718 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-25 15:42:39.537879 | controller | Wednesday 25 February 2026 15:42:39 +0000 (0:00:00.029) 0:01:10.520 **** 2026-02-25 15:42:39.563987 | controller | skipping: [instance] 2026-02-25 15:42:39.564145 | controller | 2026-02-25 15:42:39.564406 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-25 15:42:39.564490 | controller | Wednesday 25 February 2026 15:42:39 +0000 (0:00:00.026) 0:01:10.546 **** 2026-02-25 15:42:39.584453 | controller | ok: [instance] 2026-02-25 15:42:39.584538 | controller | 2026-02-25 15:42:39.584704 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-25 15:42:39.584766 | controller | Wednesday 25 February 2026 15:42:39 +0000 (0:00:00.020) 0:01:10.567 **** 2026-02-25 15:42:39.677642 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-25 15:42:39.677791 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-25 15:42:39.677927 | controller | 2026-02-25 15:42:39.678058 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-25 15:42:39.678208 | controller | Wednesday 25 February 2026 15:42:39 +0000 (0:00:00.093) 0:01:10.660 **** 2026-02-25 15:42:39.697268 | controller | skipping: [instance] 2026-02-25 15:42:39.697418 | controller | 2026-02-25 15:42:39.697516 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-25 15:42:39.697638 | controller | Wednesday 25 February 2026 15:42:39 +0000 (0:00:00.019) 0:01:10.680 **** 2026-02-25 15:42:39.927321 | controller | ok: [instance] 2026-02-25 15:42:39.927424 | controller | 2026-02-25 15:42:39.927445 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-25 15:42:40.362017 | controller | Wednesday 25 February 2026 15:42:39 +0000 (0:00:00.229) 0:01:10.909 **** 2026-02-25 15:42:40.362082 | controller | changed: [instance] 2026-02-25 15:42:40.434795 | controller | 2026-02-25 15:42:40.434838 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-25 15:42:40.434847 | controller | Wednesday 25 February 2026 15:42:40 +0000 (0:00:00.434) 0:01:11.343 **** 2026-02-25 15:42:40.434858 | controller | ok: [instance] 2026-02-25 15:42:40.477379 | controller | 2026-02-25 15:42:40.477437 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-25 15:42:40.477451 | controller | Wednesday 25 February 2026 15:42:40 +0000 (0:00:00.073) 0:01:11.417 **** 2026-02-25 15:42:40.477469 | controller | ok: [instance] 2026-02-25 15:42:40.949902 | controller | 2026-02-25 15:42:40.950231 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-25 15:42:40.950293 | controller | Wednesday 25 February 2026 15:42:40 +0000 (0:00:00.042) 0:01:11.459 **** 2026-02-25 15:42:40.950313 | controller | changed: [instance] 2026-02-25 15:42:40.987352 | controller | 2026-02-25 15:42:40.987409 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2026-02-25 15:42:40.987423 | controller | Wednesday 25 February 2026 15:42:40 +0000 (0:00:00.471) 0:01:11.931 **** 2026-02-25 15:42:40.987442 | controller | ok: [instance] 2026-02-25 15:42:41.013861 | controller | 2026-02-25 15:42:41.013896 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2026-02-25 15:42:41.013906 | controller | Wednesday 25 February 2026 15:42:40 +0000 (0:00:00.037) 0:01:11.969 **** 2026-02-25 15:42:41.013919 | controller | ok: [instance] 2026-02-25 15:42:41.040262 | controller | 2026-02-25 15:42:41.040295 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2026-02-25 15:42:41.040304 | controller | Wednesday 25 February 2026 15:42:41 +0000 (0:00:00.026) 0:01:11.996 **** 2026-02-25 15:42:41.040314 | controller | ok: [instance] 2026-02-25 15:42:41.040344 | controller | 2026-02-25 15:42:41.040352 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2026-02-25 15:42:41.040386 | controller | Wednesday 25 February 2026 15:42:41 +0000 (0:00:00.026) 0:01:12.022 **** 2026-02-25 15:42:41.126327 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2026-02-25 15:42:41.276939 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2026-02-25 15:42:41.276979 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2026-02-25 15:42:41.276987 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2026-02-25 15:42:41.276992 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2026-02-25 15:42:41.276997 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2026-02-25 15:42:41.277002 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2026-02-25 15:42:41.277006 | controller | 2026-02-25 15:42:41.277012 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 15:42:41.277017 | controller | Wednesday 25 February 2026 15:42:41 +0000 (0:00:00.085) 0:01:12.108 **** 2026-02-25 15:42:41.277029 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2026-02-25 15:42:41.277085 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2026-02-25 15:42:41.277244 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2026-02-25 15:42:41.277386 | controller | 2026-02-25 15:42:41.277508 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 15:42:41.277630 | controller | Wednesday 25 February 2026 15:42:41 +0000 (0:00:00.151) 0:01:12.259 **** 2026-02-25 15:42:41.369114 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2026-02-25 15:42:41.369283 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2026-02-25 15:42:41.369388 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2026-02-25 15:42:41.369508 | controller | skipping: [instance] 2026-02-25 15:42:41.369637 | controller | 2026-02-25 15:42:41.369769 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 15:42:41.369860 | controller | Wednesday 25 February 2026 15:42:41 +0000 (0:00:00.092) 0:01:12.351 **** 2026-02-25 15:42:41.459497 | controller | skipping: [instance] => (item=compute-0 - storage) 2026-02-25 15:42:41.459658 | controller | skipping: [instance] => (item=controller-0 - storage) 2026-02-25 15:42:41.459767 | controller | skipping: [instance] => (item=crc-0 - storage) 2026-02-25 15:42:41.459898 | controller | skipping: [instance] 2026-02-25 15:42:41.460021 | controller | 2026-02-25 15:42:41.460174 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 15:42:41.460320 | controller | Wednesday 25 February 2026 15:42:41 +0000 (0:00:00.090) 0:01:12.442 **** 2026-02-25 15:42:41.554845 | controller | skipping: [instance] => (item=compute-0 - tenant) 2026-02-25 15:42:41.554967 | controller | skipping: [instance] => (item=controller-0 - tenant) 2026-02-25 15:42:41.555111 | controller | skipping: [instance] => (item=crc-0 - tenant) 2026-02-25 15:42:41.555263 | controller | skipping: [instance] 2026-02-25 15:42:41.555390 | controller | 2026-02-25 15:42:41.555490 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 15:42:41.555623 | controller | Wednesday 25 February 2026 15:42:41 +0000 (0:00:00.095) 0:01:12.537 **** 2026-02-25 15:42:41.651528 | controller | skipping: [instance] => (item=compute-0 - external) 2026-02-25 15:42:41.651631 | controller | skipping: [instance] => (item=controller-0 - external) 2026-02-25 15:42:41.651778 | controller | skipping: [instance] => (item=crc-0 - external) 2026-02-25 15:42:41.651878 | controller | skipping: [instance] 2026-02-25 15:42:41.651983 | controller | 2026-02-25 15:42:41.652088 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 15:42:41.652209 | controller | Wednesday 25 February 2026 15:42:41 +0000 (0:00:00.096) 0:01:12.633 **** 2026-02-25 15:42:41.756665 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2026-02-25 15:42:41.756873 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2026-02-25 15:42:41.756984 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2026-02-25 15:42:41.757114 | controller | skipping: [instance] 2026-02-25 15:42:41.757258 | controller | 2026-02-25 15:42:41.757400 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 15:42:41.757485 | controller | Wednesday 25 February 2026 15:42:41 +0000 (0:00:00.105) 0:01:12.739 **** 2026-02-25 15:42:41.919219 | controller | ok: [instance] => (item=compute-0 - public) 2026-02-25 15:42:41.919378 | controller | ok: [instance] => (item=controller-0 - public) 2026-02-25 15:42:41.919509 | controller | ok: [instance] => (item=crc-0 - public) 2026-02-25 15:42:41.919649 | controller | 2026-02-25 15:42:41.919789 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2026-02-25 15:42:41.919899 | controller | Wednesday 25 February 2026 15:42:41 +0000 (0:00:00.162) 0:01:12.901 **** 2026-02-25 15:42:42.031137 | controller | 2026-02-25 15:42:42.031258 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2026-02-25 15:42:42.031461 | controller | Wednesday 25 February 2026 15:42:42 +0000 (0:00:00.112) 0:01:13.014 **** 2026-02-25 15:42:42.080414 | controller | ok: [instance] 2026-02-25 15:42:42.080524 | controller | 2026-02-25 15:42:42.080710 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2026-02-25 15:42:42.080817 | controller | Wednesday 25 February 2026 15:42:42 +0000 (0:00:00.048) 0:01:13.063 **** 2026-02-25 15:42:42.191240 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:9b:93:10', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-25 15:42:42.191395 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:87:d9:82', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-25 15:42:42.191497 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:69:30:52', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-25 15:42:42.191602 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:c4:f0:2e', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-25 15:42:42.191721 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:d3:7d:60', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-25 15:42:42.191815 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:fa:fe:05', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-25 15:42:42.191908 | controller | 2026-02-25 15:42:42.192008 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2026-02-25 15:42:42.192118 | controller | Wednesday 25 February 2026 15:42:42 +0000 (0:00:00.110) 0:01:13.173 **** 2026-02-25 15:42:42.252349 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2026-02-25 15:42:42.252463 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2026-02-25 15:42:42.252563 | controller | 2026-02-25 15:42:42.252680 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-25 15:42:42.252765 | controller | Wednesday 25 February 2026 15:42:42 +0000 (0:00:00.061) 0:01:13.235 **** 2026-02-25 15:42:42.442026 | controller | ok: [instance] 2026-02-25 15:42:42.470783 | controller | 2026-02-25 15:42:42.470806 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-25 15:42:42.470814 | controller | Wednesday 25 February 2026 15:42:42 +0000 (0:00:00.189) 0:01:13.424 **** 2026-02-25 15:42:42.470825 | controller | ok: [instance] 2026-02-25 15:42:42.671288 | controller | 2026-02-25 15:42:42.671311 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-25 15:42:42.671320 | controller | Wednesday 25 February 2026 15:42:42 +0000 (0:00:00.028) 0:01:13.453 **** 2026-02-25 15:42:42.671329 | controller | ok: [instance] 2026-02-25 15:42:42.697741 | controller | 2026-02-25 15:42:42.697783 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-25 15:42:42.697798 | controller | Wednesday 25 February 2026 15:42:42 +0000 (0:00:00.200) 0:01:13.653 **** 2026-02-25 15:42:42.697815 | controller | ok: [instance] 2026-02-25 15:42:42.697922 | controller | 2026-02-25 15:42:42.697938 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2026-02-25 15:42:42.697952 | controller | Wednesday 25 February 2026 15:42:42 +0000 (0:00:00.026) 0:01:13.680 **** 2026-02-25 15:42:42.718717 | controller | ok: [instance] 2026-02-25 15:42:42.718785 | controller | 2026-02-25 15:42:42.718806 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2026-02-25 15:42:42.718903 | controller | Wednesday 25 February 2026 15:42:42 +0000 (0:00:00.021) 0:01:13.701 **** 2026-02-25 15:42:42.907937 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:9b:93:10', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-25 15:42:42.908035 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:87:d9:82', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-25 15:42:42.908059 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:69:30:52', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-25 15:42:42.908098 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:c4:f0:2e', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-25 15:42:42.908225 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:d3:7d:60', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-25 15:42:42.908284 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:fa:fe:05', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-25 15:42:42.908390 | controller | 2026-02-25 15:42:42.908448 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2026-02-25 15:42:42.908544 | controller | Wednesday 25 February 2026 15:42:42 +0000 (0:00:00.188) 0:01:13.890 **** 2026-02-25 15:42:42.951143 | controller | ok: [instance] 2026-02-25 15:42:42.951193 | controller | 2026-02-25 15:42:42.951350 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2026-02-25 15:42:42.951418 | controller | Wednesday 25 February 2026 15:42:42 +0000 (0:00:00.043) 0:01:13.934 **** 2026-02-25 15:42:45.215468 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:9b:93:10', 'entry': 'set:compute,52:54:00:9b:93:10,192.168.140.100,compute-0', 'state': 'present'}) 2026-02-25 15:42:45.215527 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:87:d9:82', 'entry': 'set:controller,52:54:01:87:d9:82,192.168.140.9,controller-0', 'state': 'present'}) 2026-02-25 15:42:45.215665 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:69:30:52', 'entry': 'set:ocp,52:54:02:69:30:52,192.168.140.10,crc-0', 'state': 'present'}) 2026-02-25 15:42:45.215776 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:c4:f0:2e', 'entry': 'set:compute,52:54:00:c4:f0:2e,192.168.101.100,compute-0', 'state': 'present'}) 2026-02-25 15:42:45.215865 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:d3:7d:60', 'entry': 'set:controller,52:54:01:d3:7d:60,192.168.101.9,controller-0', 'state': 'present'}) 2026-02-25 15:42:45.215953 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:fa:fe:05', 'entry': 'set:ocp,52:54:02:fa:fe:05,192.168.101.10,crc-0', 'state': 'present'}) 2026-02-25 15:42:45.216043 | controller | 2026-02-25 15:42:45.216150 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2026-02-25 15:42:45.216278 | controller | Wednesday 25 February 2026 15:42:45 +0000 (0:00:02.263) 0:01:16.197 **** 2026-02-25 15:42:45.241686 | controller | skipping: [instance] 2026-02-25 15:42:45.241759 | controller | 2026-02-25 15:42:45.241846 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2026-02-25 15:42:45.241934 | controller | Wednesday 25 February 2026 15:42:45 +0000 (0:00:00.026) 0:01:16.224 **** 2026-02-25 15:42:45.455451 | controller | ok: [instance] => (item=compute-0) 2026-02-25 15:42:45.455528 | controller | ok: [instance] => (item=controller-0) 2026-02-25 15:42:45.455627 | controller | ok: [instance] => (item=crc-0) 2026-02-25 15:42:45.455706 | controller | 2026-02-25 15:42:45.455794 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2026-02-25 15:42:45.455878 | controller | Wednesday 25 February 2026 15:42:45 +0000 (0:00:00.213) 0:01:16.438 **** 2026-02-25 15:42:45.571350 | controller | 2026-02-25 15:42:45.571460 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-25 15:42:45.571618 | controller | Wednesday 25 February 2026 15:42:45 +0000 (0:00:00.115) 0:01:16.554 **** 2026-02-25 15:42:45.614656 | controller | ok: [instance] 2026-02-25 15:42:45.614722 | controller | 2026-02-25 15:42:45.614799 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-25 15:42:45.614893 | controller | Wednesday 25 February 2026 15:42:45 +0000 (0:00:00.043) 0:01:16.597 **** 2026-02-25 15:42:45.846914 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 15:42:45.846955 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 15:42:45.847040 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-25 15:42:45.847122 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-25 15:42:45.847242 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-25 15:42:45.847411 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-25 15:42:45.847480 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-25 15:42:45.847571 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 15:42:45.847675 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 15:42:45.847765 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-25 15:42:45.847847 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 15:42:45.847929 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 15:42:45.848012 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-25 15:42:45.848089 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-25 15:42:45.848184 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-25 15:42:45.848407 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-25 15:42:45.848477 | controller | 2026-02-25 15:42:45.848563 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-25 15:42:45.848669 | controller | Wednesday 25 February 2026 15:42:45 +0000 (0:00:00.232) 0:01:16.829 **** 2026-02-25 15:42:49.091994 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 15:42:49.092103 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 15:42:49.092227 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-25 15:42:49.092246 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-25 15:42:49.093421 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-25 15:42:49.093505 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-25 15:42:49.093515 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-25 15:42:49.093522 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 15:42:49.093530 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 15:42:49.093536 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-25 15:42:49.093543 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 15:42:49.093549 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 15:42:49.093556 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-25 15:42:49.093561 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-25 15:42:49.093568 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-25 15:42:49.093585 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-25 15:42:49.093591 | controller | 2026-02-25 15:42:49.093599 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-25 15:42:49.455376 | controller | Wednesday 25 February 2026 15:42:49 +0000 (0:00:03.244) 0:01:20.074 **** 2026-02-25 15:42:49.455440 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 15:42:49.455478 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 15:42:49.455500 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-25 15:42:49.455525 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-25 15:42:49.456319 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-25 15:42:49.456398 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-25 15:42:49.456408 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-25 15:42:49.456416 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 15:42:49.456423 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 15:42:49.456430 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-25 15:42:49.456438 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 15:42:49.456444 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 15:42:49.456455 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-25 15:42:49.456484 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-25 15:42:49.456975 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-25 15:42:49.478587 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-25 15:42:49.478619 | controller | 2026-02-25 15:42:49.478628 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2026-02-25 15:42:49.478635 | controller | Wednesday 25 February 2026 15:42:49 +0000 (0:00:00.363) 0:01:20.437 **** 2026-02-25 15:42:49.478643 | controller | ok: [instance] 2026-02-25 15:42:49.523923 | controller | 2026-02-25 15:42:49.523946 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2026-02-25 15:42:49.523955 | controller | Wednesday 25 February 2026 15:42:49 +0000 (0:00:00.023) 0:01:20.461 **** 2026-02-25 15:42:49.523966 | controller | skipping: [instance] => (item=compute) 2026-02-25 15:42:49.556726 | controller | skipping: [instance] => (item=controller) 2026-02-25 15:42:49.556745 | controller | skipping: [instance] => (item=crc) 2026-02-25 15:42:49.556753 | controller | skipping: [instance] 2026-02-25 15:42:49.556761 | controller | 2026-02-25 15:42:49.556767 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2026-02-25 15:42:49.556774 | controller | Wednesday 25 February 2026 15:42:49 +0000 (0:00:00.044) 0:01:20.506 **** 2026-02-25 15:42:49.556783 | controller | skipping: [instance] 2026-02-25 15:42:49.950921 | controller | 2026-02-25 15:42:49.950953 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2026-02-25 15:42:49.950963 | controller | Wednesday 25 February 2026 15:42:49 +0000 (0:00:00.033) 0:01:20.539 **** 2026-02-25 15:42:49.950977 | controller | changed: [instance] 2026-02-25 15:42:50.643152 | controller | 2026-02-25 15:42:50.643225 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2026-02-25 15:42:50.643236 | controller | Wednesday 25 February 2026 15:42:49 +0000 (0:00:00.382) 0:01:20.921 **** 2026-02-25 15:42:50.643243 | controller | 2026-02-25 15:42:50.643249 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-25 15:42:50.643255 | controller | Wednesday 25 February 2026 15:42:49 +0000 (0:00:00.011) 0:01:20.933 **** 2026-02-25 15:42:50.643268 | controller | changed: [instance] 2026-02-25 15:42:51.018179 | controller | 2026-02-25 15:42:51.018232 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-25 15:42:51.018241 | controller | Wednesday 25 February 2026 15:42:50 +0000 (0:00:00.692) 0:01:21.625 **** 2026-02-25 15:42:51.018253 | controller | changed: [instance] 2026-02-25 15:42:51.420119 | controller | 2026-02-25 15:42:51.420197 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2026-02-25 15:42:51.420211 | controller | Wednesday 25 February 2026 15:42:51 +0000 (0:00:00.375) 0:01:22.000 **** 2026-02-25 15:42:51.420225 | controller | changed: [instance] 2026-02-25 15:42:51.813624 | controller | 2026-02-25 15:42:51.813659 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2026-02-25 15:42:51.813669 | controller | Wednesday 25 February 2026 15:42:51 +0000 (0:00:00.401) 0:01:22.402 **** 2026-02-25 15:42:51.813681 | controller | changed: [instance] 2026-02-25 15:42:52.219335 | controller | 2026-02-25 15:42:52.219374 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2026-02-25 15:42:52.219383 | controller | Wednesday 25 February 2026 15:42:51 +0000 (0:00:00.393) 0:01:22.795 **** 2026-02-25 15:42:52.219396 | controller | changed: [instance] 2026-02-25 15:42:52.255897 | controller | 2026-02-25 15:42:52.255919 | controller | TASK [Build utility records dataset] ******************************************* 2026-02-25 15:42:52.255929 | controller | Wednesday 25 February 2026 15:42:52 +0000 (0:00:00.405) 0:01:23.201 **** 2026-02-25 15:42:52.255940 | controller | 2026-02-25 15:42:52.352089 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-25 15:42:52.352112 | controller | Wednesday 25 February 2026 15:42:52 +0000 (0:00:00.036) 0:01:23.238 **** 2026-02-25 15:42:52.352125 | controller | ok: [instance] 2026-02-25 15:42:52.454906 | controller | 2026-02-25 15:42:52.454927 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-25 15:42:52.454935 | controller | Wednesday 25 February 2026 15:42:52 +0000 (0:00:00.095) 0:01:23.334 **** 2026-02-25 15:42:52.454951 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-25 15:42:52.963385 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 15:42:52.963446 | controller | 2026-02-25 15:42:52.963455 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-25 15:42:52.963462 | controller | Wednesday 25 February 2026 15:42:52 +0000 (0:00:00.103) 0:01:23.437 **** 2026-02-25 15:42:52.963475 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-25 15:42:53.279128 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 15:42:53.279196 | controller | 2026-02-25 15:42:53.279207 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-25 15:42:53.279213 | controller | Wednesday 25 February 2026 15:42:52 +0000 (0:00:00.507) 0:01:23.945 **** 2026-02-25 15:42:53.279227 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-25 15:42:53.805004 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 15:42:53.805066 | controller | 2026-02-25 15:42:53.805077 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-25 15:42:53.805084 | controller | Wednesday 25 February 2026 15:42:53 +0000 (0:00:00.305) 0:01:24.250 **** 2026-02-25 15:42:53.805090 | controller | 2026-02-25 15:42:53.805096 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-25 15:42:53.805101 | controller | Wednesday 25 February 2026 15:42:53 +0000 (0:00:00.010) 0:01:24.260 **** 2026-02-25 15:42:53.805114 | controller | changed: [instance] 2026-02-25 15:42:54.208494 | controller | 2026-02-25 15:42:54.208556 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-25 15:42:54.208584 | controller | Wednesday 25 February 2026 15:42:53 +0000 (0:00:00.526) 0:01:24.786 **** 2026-02-25 15:42:54.208600 | controller | changed: [instance] 2026-02-25 15:42:54.252365 | controller | 2026-02-25 15:42:54.252420 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2026-02-25 15:42:54.252432 | controller | Wednesday 25 February 2026 15:42:54 +0000 (0:00:00.402) 0:01:25.189 **** 2026-02-25 15:42:54.252448 | controller | skipping: [instance] 2026-02-25 15:42:54.252471 | controller | 2026-02-25 15:42:54.252479 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2026-02-25 15:42:54.252488 | controller | Wednesday 25 February 2026 15:42:54 +0000 (0:00:00.045) 0:01:25.235 **** 2026-02-25 15:42:54.340883 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2026-02-25 15:42:54.341007 | controller | 2026-02-25 15:42:54.341028 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2026-02-25 15:42:54.341142 | controller | Wednesday 25 February 2026 15:42:54 +0000 (0:00:00.088) 0:01:25.323 **** 2026-02-25 15:42:54.554722 | controller | ok: [instance] 2026-02-25 15:42:54.579322 | controller | 2026-02-25 15:42:54.579432 | controller | TASK [Deploy CRC if needed] **************************************************** 2026-02-25 15:42:54.579448 | controller | Wednesday 25 February 2026 15:42:54 +0000 (0:00:00.213) 0:01:25.537 **** 2026-02-25 15:42:54.579473 | controller | skipping: [instance] 2026-02-25 15:42:54.579643 | controller | 2026-02-25 15:42:54.579683 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2026-02-25 15:42:54.983286 | controller | Wednesday 25 February 2026 15:42:54 +0000 (0:00:00.024) 0:01:25.561 **** 2026-02-25 15:42:54.983369 | controller | ok: [instance] 2026-02-25 15:42:55.243153 | controller | 2026-02-25 15:42:55.243204 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2026-02-25 15:42:55.243213 | controller | Wednesday 25 February 2026 15:42:54 +0000 (0:00:00.403) 0:01:25.965 **** 2026-02-25 15:42:55.243223 | controller | ok: [instance] 2026-02-25 15:42:55.491371 | controller | 2026-02-25 15:42:55.491429 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2026-02-25 15:42:55.491441 | controller | Wednesday 25 February 2026 15:42:55 +0000 (0:00:00.259) 0:01:26.225 **** 2026-02-25 15:42:55.491456 | controller | ok: [instance] 2026-02-25 15:42:55.491496 | controller | 2026-02-25 15:42:55.491703 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2026-02-25 15:42:55.731078 | controller | Wednesday 25 February 2026 15:42:55 +0000 (0:00:00.248) 0:01:26.473 **** 2026-02-25 15:42:55.731103 | controller | ok: [instance] 2026-02-25 15:42:55.980100 | controller | 2026-02-25 15:42:55.980137 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2026-02-25 15:42:55.980144 | controller | Wednesday 25 February 2026 15:42:55 +0000 (0:00:00.239) 0:01:26.713 **** 2026-02-25 15:42:55.980152 | controller | ok: [instance] 2026-02-25 15:42:56.022396 | controller | 2026-02-25 15:42:56.022458 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-25 15:42:56.022469 | controller | Wednesday 25 February 2026 15:42:55 +0000 (0:00:00.249) 0:01:26.962 **** 2026-02-25 15:42:56.022484 | controller | 2026-02-25 15:42:56.022636 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-25 15:42:56.022693 | controller | Wednesday 25 February 2026 15:42:56 +0000 (0:00:00.042) 0:01:27.005 **** 2026-02-25 15:42:56.235537 | controller | ok: [instance] 2026-02-25 15:42:56.235636 | controller | 2026-02-25 15:42:56.235650 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-25 15:42:56.235800 | controller | Wednesday 25 February 2026 15:42:56 +0000 (0:00:00.212) 0:01:27.217 **** 2026-02-25 15:42:56.274375 | controller | ok: [instance] 2026-02-25 15:42:56.274466 | controller | 2026-02-25 15:42:56.274760 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-25 15:42:56.307283 | controller | Wednesday 25 February 2026 15:42:56 +0000 (0:00:00.038) 0:01:27.256 **** 2026-02-25 15:42:56.307321 | controller | skipping: [instance] 2026-02-25 15:42:56.667868 | controller | 2026-02-25 15:42:56.667904 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2026-02-25 15:42:56.667914 | controller | Wednesday 25 February 2026 15:42:56 +0000 (0:00:00.032) 0:01:27.289 **** 2026-02-25 15:42:56.667925 | controller | ok: [instance] 2026-02-25 15:42:56.911065 | controller | 2026-02-25 15:42:56.911092 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2026-02-25 15:42:56.911101 | controller | Wednesday 25 February 2026 15:42:56 +0000 (0:00:00.360) 0:01:27.650 **** 2026-02-25 15:42:56.911111 | controller | ok: [instance] 2026-02-25 15:42:57.106142 | controller | 2026-02-25 15:42:57.106189 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2026-02-25 15:42:57.106197 | controller | Wednesday 25 February 2026 15:42:56 +0000 (0:00:00.243) 0:01:27.893 **** 2026-02-25 15:42:57.106207 | controller | ok: [instance] 2026-02-25 15:42:57.166057 | controller | 2026-02-25 15:42:57.166090 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2026-02-25 15:42:57.166104 | controller | Wednesday 25 February 2026 15:42:57 +0000 (0:00:00.194) 0:01:28.088 **** 2026-02-25 15:42:57.166120 | controller | 2026-02-25 15:42:57.213046 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-25 15:42:57.213065 | controller | Wednesday 25 February 2026 15:42:57 +0000 (0:00:00.059) 0:01:28.148 **** 2026-02-25 15:42:57.213075 | controller | ok: [instance] => changed=false 2026-02-25 15:42:57.406468 | controller | msg: All assertions passed 2026-02-25 15:42:57.406487 | controller | 2026-02-25 15:42:57.406494 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-25 15:42:57.406499 | controller | Wednesday 25 February 2026 15:42:57 +0000 (0:00:00.046) 0:01:28.195 **** 2026-02-25 15:42:57.406507 | controller | ok: [instance] 2026-02-25 15:42:57.618542 | controller | 2026-02-25 15:42:57.618579 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-25 15:42:57.618587 | controller | Wednesday 25 February 2026 15:42:57 +0000 (0:00:00.193) 0:01:28.389 **** 2026-02-25 15:42:57.618597 | controller | ok: [instance] 2026-02-25 15:42:57.647151 | controller | 2026-02-25 15:42:57.647195 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-25 15:42:57.647204 | controller | Wednesday 25 February 2026 15:42:57 +0000 (0:00:00.211) 0:01:28.600 **** 2026-02-25 15:42:57.647216 | controller | ok: [instance] => changed=false 2026-02-25 15:42:57.873441 | controller | msg: All assertions passed 2026-02-25 15:42:57.873519 | controller | 2026-02-25 15:42:57.873534 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-25 15:42:57.873546 | controller | Wednesday 25 February 2026 15:42:57 +0000 (0:00:00.028) 0:01:28.629 **** 2026-02-25 15:42:57.873583 | controller | ok: [instance] 2026-02-25 15:42:58.064390 | controller | 2026-02-25 15:42:58.064423 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-25 15:42:58.064431 | controller | Wednesday 25 February 2026 15:42:57 +0000 (0:00:00.226) 0:01:28.855 **** 2026-02-25 15:42:58.064441 | controller | ok: [instance] 2026-02-25 15:42:58.117491 | controller | 2026-02-25 15:42:58.117541 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-25 15:42:58.117552 | controller | Wednesday 25 February 2026 15:42:58 +0000 (0:00:00.191) 0:01:29.047 **** 2026-02-25 15:42:58.117580 | controller | ok: [instance] 2026-02-25 15:42:58.539971 | controller | 2026-02-25 15:42:58.540002 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2026-02-25 15:42:58.540010 | controller | Wednesday 25 February 2026 15:42:58 +0000 (0:00:00.052) 0:01:29.099 **** 2026-02-25 15:42:58.540020 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2026-02-25 15:42:58.564346 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2026-02-25 15:42:58.564404 | controller | 2026-02-25 15:42:58.564415 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2026-02-25 15:42:58.564425 | controller | Wednesday 25 February 2026 15:42:58 +0000 (0:00:00.422) 0:01:29.522 **** 2026-02-25 15:42:58.564442 | controller | skipping: [instance] 2026-02-25 15:42:58.591308 | controller | 2026-02-25 15:42:58.591346 | controller | TASK [Load the architecture local kustomize patches] *************************** 2026-02-25 15:42:58.591362 | controller | Wednesday 25 February 2026 15:42:58 +0000 (0:00:00.024) 0:01:29.546 **** 2026-02-25 15:42:58.591376 | controller | skipping: [instance] 2026-02-25 15:42:58.591542 | controller | 2026-02-25 15:42:58.591575 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2026-02-25 15:42:58.591587 | controller | Wednesday 25 February 2026 15:42:58 +0000 (0:00:00.026) 0:01:29.573 **** 2026-02-25 15:42:58.724248 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2026-02-25 15:42:58.724334 | controller | 2026-02-25 15:42:58.724346 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2026-02-25 15:42:58.724355 | controller | Wednesday 25 February 2026 15:42:58 +0000 (0:00:00.132) 0:01:29.706 **** 2026-02-25 15:42:58.754348 | controller | skipping: [instance] 2026-02-25 15:42:58.754424 | controller | 2026-02-25 15:42:58.754437 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2026-02-25 15:42:58.754449 | controller | Wednesday 25 February 2026 15:42:58 +0000 (0:00:00.030) 0:01:29.737 **** 2026-02-25 15:42:59.197559 | controller | changed: [instance] 2026-02-25 15:42:59.749423 | controller | 2026-02-25 15:42:59.749461 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2026-02-25 15:42:59.749471 | controller | Wednesday 25 February 2026 15:42:59 +0000 (0:00:00.442) 0:01:30.179 **** 2026-02-25 15:42:59.749483 | controller | changed: [instance] 2026-02-25 15:43:00.216512 | controller | 2026-02-25 15:43:00.216577 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2026-02-25 15:43:00.216587 | controller | Wednesday 25 February 2026 15:42:59 +0000 (0:00:00.540) 0:01:30.720 **** 2026-02-25 15:43:00.216593 | controller | 2026-02-25 15:43:00.216599 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-25 15:43:00.216605 | controller | Wednesday 25 February 2026 15:42:59 +0000 (0:00:00.011) 0:01:30.731 **** 2026-02-25 15:43:00.216617 | controller | changed: [instance] 2026-02-25 15:43:00.975223 | controller | 2026-02-25 15:43:00.975260 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-25 15:43:00.975269 | controller | Wednesday 25 February 2026 15:43:00 +0000 (0:00:00.466) 0:01:31.198 **** 2026-02-25 15:43:00.975281 | controller | changed: [instance] 2026-02-25 15:43:01.019095 | controller | 2026-02-25 15:43:01.019113 | controller | TASK [Deploy virtualbmc] ******************************************************* 2026-02-25 15:43:01.019121 | controller | Wednesday 25 February 2026 15:43:00 +0000 (0:00:00.759) 0:01:31.957 **** 2026-02-25 15:43:01.019130 | controller | skipping: [instance] 2026-02-25 15:43:01.113677 | controller | 2026-02-25 15:43:01.113696 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2026-02-25 15:43:01.113704 | controller | Wednesday 25 February 2026 15:43:01 +0000 (0:00:00.044) 0:01:32.001 **** 2026-02-25 15:43:01.113713 | controller | skipping: [instance] 2026-02-25 15:43:01.738326 | controller | 2026-02-25 15:43:01.738374 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2026-02-25 15:43:01.738386 | controller | Wednesday 25 February 2026 15:43:01 +0000 (0:00:00.094) 0:01:32.096 **** 2026-02-25 15:43:01.738401 | controller | changed: [instance] => (item=workload) 2026-02-25 15:43:01.738444 | controller | changed: [instance] => (item=reproducer-inventory) 2026-02-25 15:43:01.738460 | controller | ok: [instance] => (item=volumes) 2026-02-25 15:43:01.738474 | controller | 2026-02-25 15:43:01.738643 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2026-02-25 15:43:01.738702 | controller | Wednesday 25 February 2026 15:43:01 +0000 (0:00:00.623) 0:01:32.720 **** 2026-02-25 15:43:02.234285 | controller | changed: [instance] => (item=workload) 2026-02-25 15:43:02.264649 | controller | changed: [instance] => (item=volumes) 2026-02-25 15:43:02.264686 | controller | 2026-02-25 15:43:02.264694 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2026-02-25 15:43:02.264700 | controller | Wednesday 25 February 2026 15:43:02 +0000 (0:00:00.495) 0:01:33.215 **** 2026-02-25 15:43:02.264710 | controller | skipping: [instance] 2026-02-25 15:43:03.434348 | controller | 2026-02-25 15:43:03.434410 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2026-02-25 15:43:03.434421 | controller | Wednesday 25 February 2026 15:43:02 +0000 (0:00:00.031) 0:01:33.247 **** 2026-02-25 15:43:03.434435 | controller | changed: [instance] => (item=compute) 2026-02-25 15:43:03.434466 | controller | changed: [instance] => (item=controller) 2026-02-25 15:43:03.434474 | controller | changed: [instance] => (item=crc) 2026-02-25 15:43:03.434480 | controller | 2026-02-25 15:43:03.434489 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2026-02-25 15:43:03.434576 | controller | Wednesday 25 February 2026 15:43:03 +0000 (0:00:01.168) 0:01:34.416 **** 2026-02-25 15:43:03.472959 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance 2026-02-25 15:43:03.675610 | controller | 2026-02-25 15:43:03.675635 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] ***************** 2026-02-25 15:43:03.675644 | controller | Wednesday 25 February 2026 15:43:03 +0000 (0:00:00.039) 0:01:34.455 **** 2026-02-25 15:43:03.675654 | controller | ok: [instance] 2026-02-25 15:43:03.701036 | controller | 2026-02-25 15:43:03.701070 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* 2026-02-25 15:43:03.701083 | controller | Wednesday 25 February 2026 15:43:03 +0000 (0:00:00.202) 0:01:34.658 **** 2026-02-25 15:43:03.701099 | controller | skipping: [instance] 2026-02-25 15:43:04.100244 | controller | 2026-02-25 15:43:04.100317 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] *** 2026-02-25 15:43:04.100333 | controller | Wednesday 25 February 2026 15:43:03 +0000 (0:00:00.025) 0:01:34.683 **** 2026-02-25 15:43:04.100349 | controller | changed: [instance] 2026-02-25 15:43:04.124285 | controller | 2026-02-25 15:43:04.124305 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* 2026-02-25 15:43:04.124312 | controller | Wednesday 25 February 2026 15:43:04 +0000 (0:00:00.399) 0:01:35.082 **** 2026-02-25 15:43:04.124320 | controller | skipping: [instance] 2026-02-25 15:43:04.124327 | controller | 2026-02-25 15:43:04.124332 | controller | TASK [libvirt_manager : Write merged all-group.yml] **************************** 2026-02-25 15:43:04.124340 | controller | Wednesday 25 February 2026 15:43:04 +0000 (0:00:00.024) 0:01:35.106 **** 2026-02-25 15:43:04.146749 | controller | skipping: [instance] 2026-02-25 15:43:04.196618 | controller | 2026-02-25 15:43:04.196640 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2026-02-25 15:43:04.196649 | controller | Wednesday 25 February 2026 15:43:04 +0000 (0:00:00.022) 0:01:35.129 **** 2026-02-25 15:43:04.196660 | controller | skipping: [instance] 2026-02-25 15:43:04.266312 | controller | 2026-02-25 15:43:04.266344 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2026-02-25 15:43:04.266354 | controller | Wednesday 25 February 2026 15:43:04 +0000 (0:00:00.049) 0:01:35.179 **** 2026-02-25 15:43:04.266366 | controller | skipping: [instance] => (item=crc) 2026-02-25 15:43:04.266967 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2026-02-25 15:43:04.267009 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2026-02-25 15:43:04.493872 | controller | 2026-02-25 15:43:04.493914 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-25 15:43:04.493922 | controller | Wednesday 25 February 2026 15:43:04 +0000 (0:00:00.069) 0:01:35.249 **** 2026-02-25 15:43:04.493934 | controller | changed: [instance] 2026-02-25 15:43:04.689113 | controller | 2026-02-25 15:43:04.689137 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-25 15:43:04.689144 | controller | Wednesday 25 February 2026 15:43:04 +0000 (0:00:00.226) 0:01:35.475 **** 2026-02-25 15:43:04.689153 | controller | ok: [instance] 2026-02-25 15:43:45.872819 | controller | 2026-02-25 15:43:45.872862 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-25 15:43:45.872873 | controller | Wednesday 25 February 2026 15:43:04 +0000 (0:00:00.195) 0:01:35.671 **** 2026-02-25 15:43:45.872885 | controller | changed: [instance] 2026-02-25 15:43:46.085028 | controller | 2026-02-25 15:43:46.085064 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-25 15:43:46.085073 | controller | Wednesday 25 February 2026 15:43:45 +0000 (0:00:41.183) 0:02:16.854 **** 2026-02-25 15:43:46.085082 | controller | ok: [instance] 2026-02-25 15:43:46.125316 | controller | 2026-02-25 15:43:46.125359 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-25 15:43:46.125370 | controller | Wednesday 25 February 2026 15:43:46 +0000 (0:00:00.212) 0:02:17.067 **** 2026-02-25 15:43:46.125383 | controller | ok: [instance] => changed=false 2026-02-25 15:43:46.125423 | controller | msg: All assertions passed 2026-02-25 15:43:46.125670 | controller | 2026-02-25 15:43:46.125699 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-25 15:43:46.338881 | controller | Wednesday 25 February 2026 15:43:46 +0000 (0:00:00.040) 0:02:17.108 **** 2026-02-25 15:43:46.338916 | controller | changed: [instance] 2026-02-25 15:43:46.551246 | controller | 2026-02-25 15:43:46.551279 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-25 15:43:46.551287 | controller | Wednesday 25 February 2026 15:43:46 +0000 (0:00:00.213) 0:02:17.321 **** 2026-02-25 15:43:46.551297 | controller | ok: [instance] 2026-02-25 15:43:46.551611 | controller | 2026-02-25 15:43:46.756046 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-25 15:43:46.756079 | controller | Wednesday 25 February 2026 15:43:46 +0000 (0:00:00.212) 0:02:17.533 **** 2026-02-25 15:43:46.756091 | controller | ok: [instance] 2026-02-25 15:43:46.779321 | controller | 2026-02-25 15:43:46.779355 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-25 15:43:46.779363 | controller | Wednesday 25 February 2026 15:43:46 +0000 (0:00:00.204) 0:02:17.738 **** 2026-02-25 15:43:46.779374 | controller | skipping: [instance] 2026-02-25 15:43:46.779427 | controller | 2026-02-25 15:43:46.779446 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-25 15:43:46.779462 | controller | Wednesday 25 February 2026 15:43:46 +0000 (0:00:00.023) 0:02:17.762 **** 2026-02-25 15:43:46.982866 | controller | ok: [instance] 2026-02-25 15:43:47.025012 | controller | 2026-02-25 15:43:47.025033 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-25 15:43:47.025042 | controller | Wednesday 25 February 2026 15:43:46 +0000 (0:00:00.203) 0:02:17.965 **** 2026-02-25 15:43:47.025052 | controller | ok: [instance] => changed=false 2026-02-25 15:43:47.231143 | controller | msg: All assertions passed 2026-02-25 15:43:47.231189 | controller | 2026-02-25 15:43:47.231202 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-25 15:43:47.231210 | controller | Wednesday 25 February 2026 15:43:47 +0000 (0:00:00.042) 0:02:18.007 **** 2026-02-25 15:43:47.231220 | controller | ok: [instance] 2026-02-25 15:43:47.405626 | controller | 2026-02-25 15:43:47.405651 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2026-02-25 15:43:47.405658 | controller | Wednesday 25 February 2026 15:43:47 +0000 (0:00:00.206) 0:02:18.213 **** 2026-02-25 15:43:47.405667 | controller | ok: [instance] 2026-02-25 15:43:47.787622 | controller | 2026-02-25 15:43:47.787650 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2026-02-25 15:43:47.787662 | controller | Wednesday 25 February 2026 15:43:47 +0000 (0:00:00.174) 0:02:18.388 **** 2026-02-25 15:43:47.787672 | controller | changed: [instance] 2026-02-25 15:43:47.958304 | controller | 2026-02-25 15:43:47.958339 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2026-02-25 15:43:47.958348 | controller | Wednesday 25 February 2026 15:43:47 +0000 (0:00:00.381) 0:02:18.770 **** 2026-02-25 15:43:47.958359 | controller | ok: [instance] 2026-02-25 15:43:47.958421 | controller | 2026-02-25 15:43:47.958450 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2026-02-25 15:43:47.958464 | controller | Wednesday 25 February 2026 15:43:47 +0000 (0:00:00.170) 0:02:18.940 **** 2026-02-25 15:43:48.137250 | controller | ok: [instance] 2026-02-25 15:43:48.529917 | controller | 2026-02-25 15:43:48.529950 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2026-02-25 15:43:48.529958 | controller | Wednesday 25 February 2026 15:43:48 +0000 (0:00:00.178) 0:02:19.119 **** 2026-02-25 15:43:48.529969 | controller | changed: [instance] 2026-02-25 15:43:48.551644 | controller | 2026-02-25 15:43:48.551666 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2026-02-25 15:43:48.551674 | controller | Wednesday 25 February 2026 15:43:48 +0000 (0:00:00.392) 0:02:19.512 **** 2026-02-25 15:43:48.551685 | controller | ok: [instance] 2026-02-25 15:43:48.780689 | controller | 2026-02-25 15:43:48.780711 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2026-02-25 15:43:48.780719 | controller | Wednesday 25 February 2026 15:43:48 +0000 (0:00:00.021) 0:02:19.534 **** 2026-02-25 15:43:48.780728 | controller | ok: [instance] 2026-02-25 15:43:49.236242 | controller | 2026-02-25 15:43:49.236275 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2026-02-25 15:43:49.236283 | controller | Wednesday 25 February 2026 15:43:48 +0000 (0:00:00.228) 0:02:19.763 **** 2026-02-25 15:43:49.236293 | controller | ok: [instance] 2026-02-25 15:43:49.391394 | controller | 2026-02-25 15:43:49.391416 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2026-02-25 15:43:49.391424 | controller | Wednesday 25 February 2026 15:43:49 +0000 (0:00:00.455) 0:02:20.218 **** 2026-02-25 15:43:49.391434 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-25 15:43:49.656679 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-25 15:43:49.656708 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-25 15:43:49.656717 | controller | 2026-02-25 15:43:49.656724 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2026-02-25 15:43:49.656731 | controller | Wednesday 25 February 2026 15:43:49 +0000 (0:00:00.155) 0:02:20.373 **** 2026-02-25 15:43:49.656741 | controller | changed: [instance] 2026-02-25 15:43:49.883251 | controller | 2026-02-25 15:43:49.883297 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2026-02-25 15:43:49.883308 | controller | Wednesday 25 February 2026 15:43:49 +0000 (0:00:00.265) 0:02:20.639 **** 2026-02-25 15:43:49.883322 | controller | changed: [instance] 2026-02-25 15:43:50.172783 | controller | 2026-02-25 15:43:50.172812 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2026-02-25 15:43:50.172820 | controller | Wednesday 25 February 2026 15:43:49 +0000 (0:00:00.226) 0:02:20.865 **** 2026-02-25 15:43:50.172829 | controller | changed: [instance] 2026-02-25 15:43:50.203765 | controller | 2026-02-25 15:43:50.203790 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2026-02-25 15:43:50.203799 | controller | Wednesday 25 February 2026 15:43:50 +0000 (0:00:00.289) 0:02:21.155 **** 2026-02-25 15:43:50.203816 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-25 15:43:50.249004 | controller | 2026-02-25 15:43:50.249025 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-25 15:43:50.249033 | controller | Wednesday 25 February 2026 15:43:50 +0000 (0:00:00.031) 0:02:21.186 **** 2026-02-25 15:43:50.249043 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-25 15:43:50.479289 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-25 15:43:50.479333 | controller | 2026-02-25 15:43:50.479343 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 15:43:50.479351 | controller | Wednesday 25 February 2026 15:43:50 +0000 (0:00:00.045) 0:02:21.231 **** 2026-02-25 15:43:50.479362 | controller | ok: [instance] 2026-02-25 15:43:50.479396 | controller | 2026-02-25 15:43:50.479405 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 15:43:50.526956 | controller | Wednesday 25 February 2026 15:43:50 +0000 (0:00:00.230) 0:02:21.461 **** 2026-02-25 15:43:50.526998 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 15:43:50.759740 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 15:43:50.759769 | controller | 2026-02-25 15:43:50.759778 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 15:43:50.759785 | controller | Wednesday 25 February 2026 15:43:50 +0000 (0:00:00.047) 0:02:21.509 **** 2026-02-25 15:43:50.759795 | controller | ok: [instance] 2026-02-25 15:43:50.956295 | controller | 2026-02-25 15:43:50.956334 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 15:43:50.956343 | controller | Wednesday 25 February 2026 15:43:50 +0000 (0:00:00.232) 0:02:21.742 **** 2026-02-25 15:43:50.956352 | controller | ok: [instance] 2026-02-25 15:43:50.956382 | controller | 2026-02-25 15:43:50.956390 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2026-02-25 15:43:50.956416 | controller | Wednesday 25 February 2026 15:43:50 +0000 (0:00:00.196) 0:02:21.939 **** 2026-02-25 15:43:51.237812 | controller | changed: [instance] 2026-02-25 15:43:51.467267 | controller | 2026-02-25 15:43:51.467304 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 15:43:51.467315 | controller | Wednesday 25 February 2026 15:43:51 +0000 (0:00:00.281) 0:02:22.220 **** 2026-02-25 15:43:51.467328 | controller | ok: [instance] 2026-02-25 15:43:51.467436 | controller | 2026-02-25 15:43:51.467450 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 15:43:51.467460 | controller | Wednesday 25 February 2026 15:43:51 +0000 (0:00:00.229) 0:02:22.450 **** 2026-02-25 15:43:51.513705 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 15:43:51.744834 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 15:43:51.744859 | controller | 2026-02-25 15:43:51.744868 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 15:43:51.744875 | controller | Wednesday 25 February 2026 15:43:51 +0000 (0:00:00.046) 0:02:22.496 **** 2026-02-25 15:43:51.744886 | controller | ok: [instance] 2026-02-25 15:43:51.949252 | controller | 2026-02-25 15:43:51.949286 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 15:43:51.949295 | controller | Wednesday 25 February 2026 15:43:51 +0000 (0:00:00.231) 0:02:22.727 **** 2026-02-25 15:43:51.949308 | controller | ok: [instance] 2026-02-25 15:43:51.949342 | controller | 2026-02-25 15:43:51.949351 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2026-02-25 15:43:51.949426 | controller | Wednesday 25 February 2026 15:43:51 +0000 (0:00:00.204) 0:02:22.931 **** 2026-02-25 15:43:53.232672 | controller | changed: [instance] 2026-02-25 15:43:53.256115 | controller | 2026-02-25 15:43:53.256133 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2026-02-25 15:43:53.256140 | controller | Wednesday 25 February 2026 15:43:53 +0000 (0:00:01.283) 0:02:24.215 **** 2026-02-25 15:43:53.256149 | controller | skipping: [instance] 2026-02-25 15:43:53.285343 | controller | 2026-02-25 15:43:53.285379 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2026-02-25 15:43:53.285388 | controller | Wednesday 25 February 2026 15:43:53 +0000 (0:00:00.023) 0:02:24.238 **** 2026-02-25 15:43:53.285400 | controller | skipping: [instance] 2026-02-25 15:43:53.285433 | controller | 2026-02-25 15:43:53.285442 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2026-02-25 15:43:53.285468 | controller | Wednesday 25 February 2026 15:43:53 +0000 (0:00:00.029) 0:02:24.268 **** 2026-02-25 15:43:53.313698 | controller | skipping: [instance] 2026-02-25 15:43:53.340343 | controller | 2026-02-25 15:43:53.340378 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2026-02-25 15:43:53.340388 | controller | Wednesday 25 February 2026 15:43:53 +0000 (0:00:00.028) 0:02:24.296 **** 2026-02-25 15:43:53.340399 | controller | skipping: [instance] 2026-02-25 15:43:53.340430 | controller | 2026-02-25 15:43:53.340440 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-25 15:43:53.340560 | controller | Wednesday 25 February 2026 15:43:53 +0000 (0:00:00.026) 0:02:24.323 **** 2026-02-25 15:43:53.548930 | controller | changed: [instance] 2026-02-25 15:43:53.587253 | controller | 2026-02-25 15:43:53.587276 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-25 15:43:53.587285 | controller | Wednesday 25 February 2026 15:43:53 +0000 (0:00:00.208) 0:02:24.531 **** 2026-02-25 15:43:53.587295 | controller | ok: [instance] 2026-02-25 15:43:53.587322 | controller | 2026-02-25 15:43:53.587561 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-25 15:43:53.642299 | controller | Wednesday 25 February 2026 15:43:53 +0000 (0:00:00.038) 0:02:24.570 **** 2026-02-25 15:43:53.642355 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-25 15:43:53.840046 | controller | 2026-02-25 15:43:53.840082 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-25 15:43:53.840092 | controller | Wednesday 25 February 2026 15:43:53 +0000 (0:00:00.054) 0:02:24.624 **** 2026-02-25 15:43:53.840105 | controller | ok: [instance] 2026-02-25 15:43:53.900045 | controller | 2026-02-25 15:43:53.900068 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-25 15:43:53.900076 | controller | Wednesday 25 February 2026 15:43:53 +0000 (0:00:00.197) 0:02:24.822 **** 2026-02-25 15:43:53.900086 | controller | ok: [instance] 2026-02-25 15:43:53.947210 | controller | 2026-02-25 15:43:53.947232 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-25 15:43:53.947243 | controller | Wednesday 25 February 2026 15:43:53 +0000 (0:00:00.060) 0:02:24.882 **** 2026-02-25 15:43:53.947252 | controller | ok: [instance] 2026-02-25 15:43:53.990133 | controller | 2026-02-25 15:43:53.990176 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-25 15:43:53.990189 | controller | Wednesday 25 February 2026 15:43:53 +0000 (0:00:00.047) 0:02:24.929 **** 2026-02-25 15:43:53.990200 | controller | skipping: [instance] 2026-02-25 15:43:54.035063 | controller | 2026-02-25 15:43:54.035084 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-25 15:43:54.035092 | controller | Wednesday 25 February 2026 15:43:53 +0000 (0:00:00.042) 0:02:24.972 **** 2026-02-25 15:43:54.035102 | controller | skipping: [instance] 2026-02-25 15:43:54.094042 | controller | 2026-02-25 15:43:54.094068 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-25 15:43:54.094077 | controller | Wednesday 25 February 2026 15:43:54 +0000 (0:00:00.044) 0:02:25.017 **** 2026-02-25 15:43:54.094087 | controller | 2026-02-25 15:43:54.475338 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-25 15:43:54.475386 | controller | Wednesday 25 February 2026 15:43:54 +0000 (0:00:00.059) 0:02:25.076 **** 2026-02-25 15:43:54.475406 | controller | ok: [instance] => (item=artifacts) 2026-02-25 15:43:55.694334 | controller | ok: [instance] => (item=logs) 2026-02-25 15:43:55.694379 | controller | 2026-02-25 15:43:55.694393 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-25 15:43:55.694412 | controller | Wednesday 25 February 2026 15:43:54 +0000 (0:00:00.380) 0:02:25.457 **** 2026-02-25 15:43:55.694429 | controller | ok: [instance] 2026-02-25 15:43:55.914762 | controller | 2026-02-25 15:43:55.914795 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-25 15:43:55.914803 | controller | Wednesday 25 February 2026 15:43:55 +0000 (0:00:01.219) 0:02:26.676 **** 2026-02-25 15:43:55.914814 | controller | changed: [instance] 2026-02-25 15:43:56.287275 | controller | 2026-02-25 15:43:56.287300 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-25 15:43:56.287308 | controller | Wednesday 25 February 2026 15:43:55 +0000 (0:00:00.220) 0:02:26.897 **** 2026-02-25 15:43:56.287318 | controller | changed: [instance] 2026-02-25 15:43:56.668659 | controller | 2026-02-25 15:43:56.668691 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-25 15:43:56.668700 | controller | Wednesday 25 February 2026 15:43:56 +0000 (0:00:00.372) 0:02:27.269 **** 2026-02-25 15:43:56.668711 | controller | changed: [instance] 2026-02-25 15:43:56.714085 | controller | 2026-02-25 15:43:56.714116 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-25 15:43:56.714128 | controller | Wednesday 25 February 2026 15:43:56 +0000 (0:00:00.381) 0:02:27.651 **** 2026-02-25 15:43:56.714143 | controller | skipping: [instance] 2026-02-25 15:43:56.913236 | controller | 2026-02-25 15:43:56.913255 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-25 15:43:56.913262 | controller | Wednesday 25 February 2026 15:43:56 +0000 (0:00:00.045) 0:02:27.696 **** 2026-02-25 15:43:56.913274 | controller | ok: [instance] 2026-02-25 15:43:56.913574 | controller | 2026-02-25 15:43:56.954280 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-25 15:43:56.954303 | controller | Wednesday 25 February 2026 15:43:56 +0000 (0:00:00.199) 0:02:27.896 **** 2026-02-25 15:43:56.954316 | controller | skipping: [instance] 2026-02-25 15:43:56.954351 | controller | 2026-02-25 15:43:56.954570 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-25 15:43:57.196354 | controller | Wednesday 25 February 2026 15:43:56 +0000 (0:00:00.040) 0:02:27.937 **** 2026-02-25 15:43:57.196382 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2026-02-25 15:43:57.470135 | controller | changed: [instance] 2026-02-25 15:43:57.470177 | controller | 2026-02-25 15:43:57.470188 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-25 15:43:57.470194 | controller | Wednesday 25 February 2026 15:43:57 +0000 (0:00:00.241) 0:02:28.178 **** 2026-02-25 15:43:57.470203 | controller | changed: [instance] 2026-02-25 15:43:57.513622 | controller | 2026-02-25 15:43:57.513642 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-25 15:43:57.513651 | controller | Wednesday 25 February 2026 15:43:57 +0000 (0:00:00.273) 0:02:28.452 **** 2026-02-25 15:43:57.513660 | controller | skipping: [instance] 2026-02-25 15:43:57.585748 | controller | 2026-02-25 15:43:57.585782 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2026-02-25 15:43:57.585792 | controller | Wednesday 25 February 2026 15:43:57 +0000 (0:00:00.043) 0:02:28.496 **** 2026-02-25 15:43:57.585803 | controller | skipping: [instance] 2026-02-25 15:43:57.833719 | controller | 2026-02-25 15:43:57.833747 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2026-02-25 15:43:57.833755 | controller | Wednesday 25 February 2026 15:43:57 +0000 (0:00:00.071) 0:02:28.568 **** 2026-02-25 15:43:57.833765 | controller | changed: [instance] 2026-02-25 15:43:58.069209 | controller | 2026-02-25 15:43:58.069245 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2026-02-25 15:43:58.069254 | controller | Wednesday 25 February 2026 15:43:57 +0000 (0:00:00.247) 0:02:28.816 **** 2026-02-25 15:43:58.069265 | controller | changed: [instance] 2026-02-25 15:43:58.368313 | controller | 2026-02-25 15:43:58.368350 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2026-02-25 15:43:58.368359 | controller | Wednesday 25 February 2026 15:43:58 +0000 (0:00:00.235) 0:02:29.051 **** 2026-02-25 15:43:58.368376 | controller | changed: [instance] 2026-02-25 15:43:58.399904 | controller | 2026-02-25 15:43:58.399921 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2026-02-25 15:43:58.399928 | controller | Wednesday 25 February 2026 15:43:58 +0000 (0:00:00.299) 0:02:29.350 **** 2026-02-25 15:43:58.399936 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-25 15:43:58.445997 | controller | 2026-02-25 15:43:58.446015 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-25 15:43:58.446022 | controller | Wednesday 25 February 2026 15:43:58 +0000 (0:00:00.031) 0:02:29.382 **** 2026-02-25 15:43:58.446030 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-25 15:43:58.686080 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-25 15:43:58.686103 | controller | 2026-02-25 15:43:58.686112 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 15:43:58.686118 | controller | Wednesday 25 February 2026 15:43:58 +0000 (0:00:00.045) 0:02:29.428 **** 2026-02-25 15:43:58.686128 | controller | ok: [instance] 2026-02-25 15:43:58.733130 | controller | 2026-02-25 15:43:58.733153 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 15:43:58.733186 | controller | Wednesday 25 February 2026 15:43:58 +0000 (0:00:00.240) 0:02:29.668 **** 2026-02-25 15:43:58.733197 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 15:43:58.970023 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 15:43:58.970053 | controller | 2026-02-25 15:43:58.970061 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 15:43:58.970067 | controller | Wednesday 25 February 2026 15:43:58 +0000 (0:00:00.047) 0:02:29.715 **** 2026-02-25 15:43:58.970076 | controller | ok: [instance] 2026-02-25 15:43:59.170954 | controller | 2026-02-25 15:43:59.170972 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 15:43:59.170979 | controller | Wednesday 25 February 2026 15:43:58 +0000 (0:00:00.236) 0:02:29.952 **** 2026-02-25 15:43:59.170986 | controller | ok: [instance] 2026-02-25 15:43:59.458916 | controller | 2026-02-25 15:43:59.458936 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2026-02-25 15:43:59.458943 | controller | Wednesday 25 February 2026 15:43:59 +0000 (0:00:00.201) 0:02:30.153 **** 2026-02-25 15:43:59.458955 | controller | changed: [instance] 2026-02-25 15:43:59.682098 | controller | 2026-02-25 15:43:59.682132 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 15:43:59.682145 | controller | Wednesday 25 February 2026 15:43:59 +0000 (0:00:00.287) 0:02:30.441 **** 2026-02-25 15:43:59.682200 | controller | ok: [instance] 2026-02-25 15:43:59.724345 | controller | 2026-02-25 15:43:59.724389 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 15:43:59.724400 | controller | Wednesday 25 February 2026 15:43:59 +0000 (0:00:00.222) 0:02:30.664 **** 2026-02-25 15:43:59.724415 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 15:43:59.947371 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 15:43:59.947419 | controller | 2026-02-25 15:43:59.947433 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 15:43:59.947444 | controller | Wednesday 25 February 2026 15:43:59 +0000 (0:00:00.042) 0:02:30.706 **** 2026-02-25 15:43:59.947461 | controller | ok: [instance] 2026-02-25 15:43:59.947472 | controller | 2026-02-25 15:43:59.947485 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 15:44:00.163254 | controller | Wednesday 25 February 2026 15:43:59 +0000 (0:00:00.223) 0:02:30.930 **** 2026-02-25 15:44:00.163283 | controller | ok: [instance] 2026-02-25 15:44:00.448919 | controller | 2026-02-25 15:44:00.448947 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2026-02-25 15:44:00.448955 | controller | Wednesday 25 February 2026 15:44:00 +0000 (0:00:00.215) 0:02:31.145 **** 2026-02-25 15:44:00.448968 | controller | changed: [instance] 2026-02-25 15:44:00.469308 | controller | 2026-02-25 15:44:00.469351 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2026-02-25 15:44:00.469363 | controller | Wednesday 25 February 2026 15:44:00 +0000 (0:00:00.285) 0:02:31.431 **** 2026-02-25 15:44:00.469377 | controller | skipping: [instance] 2026-02-25 15:44:00.469430 | controller | 2026-02-25 15:44:00.469653 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2026-02-25 15:44:00.494494 | controller | Wednesday 25 February 2026 15:44:00 +0000 (0:00:00.020) 0:02:31.452 **** 2026-02-25 15:44:00.494514 | controller | skipping: [instance] 2026-02-25 15:44:00.520797 | controller | 2026-02-25 15:44:00.520813 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2026-02-25 15:44:00.520820 | controller | Wednesday 25 February 2026 15:44:00 +0000 (0:00:00.025) 0:02:31.477 **** 2026-02-25 15:44:00.520828 | controller | skipping: [instance] 2026-02-25 15:44:00.548315 | controller | 2026-02-25 15:44:00.548355 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2026-02-25 15:44:00.548365 | controller | Wednesday 25 February 2026 15:44:00 +0000 (0:00:00.026) 0:02:31.503 **** 2026-02-25 15:44:00.548379 | controller | skipping: [instance] 2026-02-25 15:44:00.773964 | controller | 2026-02-25 15:44:00.773987 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-25 15:44:00.773995 | controller | Wednesday 25 February 2026 15:44:00 +0000 (0:00:00.027) 0:02:31.530 **** 2026-02-25 15:44:00.774004 | controller | changed: [instance] 2026-02-25 15:44:00.812317 | controller | 2026-02-25 15:44:00.812352 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-25 15:44:00.812362 | controller | Wednesday 25 February 2026 15:44:00 +0000 (0:00:00.225) 0:02:31.756 **** 2026-02-25 15:44:00.812375 | controller | ok: [instance] 2026-02-25 15:44:00.812410 | controller | 2026-02-25 15:44:00.812420 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-25 15:44:00.812487 | controller | Wednesday 25 February 2026 15:44:00 +0000 (0:00:00.038) 0:02:31.795 **** 2026-02-25 15:44:00.868573 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-25 15:44:01.069279 | controller | 2026-02-25 15:44:01.069310 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-25 15:44:01.069319 | controller | Wednesday 25 February 2026 15:44:00 +0000 (0:00:00.056) 0:02:31.851 **** 2026-02-25 15:44:01.069329 | controller | ok: [instance] 2026-02-25 15:44:01.069356 | controller | 2026-02-25 15:44:01.069519 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-25 15:44:01.136842 | controller | Wednesday 25 February 2026 15:44:01 +0000 (0:00:00.201) 0:02:32.052 **** 2026-02-25 15:44:01.136871 | controller | ok: [instance] 2026-02-25 15:44:01.185153 | controller | 2026-02-25 15:44:01.185191 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-25 15:44:01.185199 | controller | Wednesday 25 February 2026 15:44:01 +0000 (0:00:00.067) 0:02:32.119 **** 2026-02-25 15:44:01.185208 | controller | ok: [instance] 2026-02-25 15:44:01.232150 | controller | 2026-02-25 15:44:01.232185 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-25 15:44:01.232197 | controller | Wednesday 25 February 2026 15:44:01 +0000 (0:00:00.048) 0:02:32.167 **** 2026-02-25 15:44:01.232206 | controller | skipping: [instance] 2026-02-25 15:44:01.278322 | controller | 2026-02-25 15:44:01.278358 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-25 15:44:01.278368 | controller | Wednesday 25 February 2026 15:44:01 +0000 (0:00:00.046) 0:02:32.214 **** 2026-02-25 15:44:01.278380 | controller | skipping: [instance] 2026-02-25 15:44:01.278414 | controller | 2026-02-25 15:44:01.278425 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-25 15:44:01.278511 | controller | Wednesday 25 February 2026 15:44:01 +0000 (0:00:00.046) 0:02:32.261 **** 2026-02-25 15:44:01.339335 | controller | 2026-02-25 15:44:01.339408 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-25 15:44:01.339499 | controller | Wednesday 25 February 2026 15:44:01 +0000 (0:00:00.060) 0:02:32.322 **** 2026-02-25 15:44:01.747037 | controller | ok: [instance] => (item=artifacts) 2026-02-25 15:44:02.928714 | controller | ok: [instance] => (item=logs) 2026-02-25 15:44:02.928739 | controller | 2026-02-25 15:44:02.928747 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-25 15:44:02.928753 | controller | Wednesday 25 February 2026 15:44:01 +0000 (0:00:00.406) 0:02:32.728 **** 2026-02-25 15:44:02.928761 | controller | ok: [instance] 2026-02-25 15:44:03.140024 | controller | 2026-02-25 15:44:03.140042 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-25 15:44:03.140049 | controller | Wednesday 25 February 2026 15:44:02 +0000 (0:00:01.182) 0:02:33.910 **** 2026-02-25 15:44:03.140057 | controller | changed: [instance] 2026-02-25 15:44:03.508493 | controller | 2026-02-25 15:44:03.508511 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-25 15:44:03.508519 | controller | Wednesday 25 February 2026 15:44:03 +0000 (0:00:00.211) 0:02:34.122 **** 2026-02-25 15:44:03.508527 | controller | changed: [instance] 2026-02-25 15:44:03.885247 | controller | 2026-02-25 15:44:03.885286 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-25 15:44:03.885295 | controller | Wednesday 25 February 2026 15:44:03 +0000 (0:00:00.368) 0:02:34.491 **** 2026-02-25 15:44:03.885306 | controller | changed: [instance] 2026-02-25 15:44:03.930718 | controller | 2026-02-25 15:44:03.930751 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-25 15:44:03.930762 | controller | Wednesday 25 February 2026 15:44:03 +0000 (0:00:00.376) 0:02:34.867 **** 2026-02-25 15:44:03.930775 | controller | skipping: [instance] 2026-02-25 15:44:04.133297 | controller | 2026-02-25 15:44:04.133335 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-25 15:44:04.133345 | controller | Wednesday 25 February 2026 15:44:03 +0000 (0:00:00.045) 0:02:34.913 **** 2026-02-25 15:44:04.133357 | controller | ok: [instance] 2026-02-25 15:44:04.133387 | controller | 2026-02-25 15:44:04.133397 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-25 15:44:04.133536 | controller | Wednesday 25 February 2026 15:44:04 +0000 (0:00:00.202) 0:02:35.115 **** 2026-02-25 15:44:04.174850 | controller | skipping: [instance] 2026-02-25 15:44:04.413751 | controller | 2026-02-25 15:44:04.413778 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-25 15:44:04.413789 | controller | Wednesday 25 February 2026 15:44:04 +0000 (0:00:00.041) 0:02:35.157 **** 2026-02-25 15:44:04.413801 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2026-02-25 15:44:04.693814 | controller | changed: [instance] 2026-02-25 15:44:04.693832 | controller | 2026-02-25 15:44:04.693840 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-25 15:44:04.693845 | controller | Wednesday 25 February 2026 15:44:04 +0000 (0:00:00.238) 0:02:35.396 **** 2026-02-25 15:44:04.693853 | controller | changed: [instance] 2026-02-25 15:44:04.739874 | controller | 2026-02-25 15:44:04.739891 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-25 15:44:04.739898 | controller | Wednesday 25 February 2026 15:44:04 +0000 (0:00:00.280) 0:02:35.676 **** 2026-02-25 15:44:04.739906 | controller | skipping: [instance] 2026-02-25 15:44:04.770961 | controller | 2026-02-25 15:44:04.770979 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2026-02-25 15:44:04.770987 | controller | Wednesday 25 February 2026 15:44:04 +0000 (0:00:00.045) 0:02:35.722 **** 2026-02-25 15:44:04.770995 | controller | skipping: [instance] 2026-02-25 15:44:05.009897 | controller | 2026-02-25 15:44:05.009915 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2026-02-25 15:44:05.009927 | controller | Wednesday 25 February 2026 15:44:04 +0000 (0:00:00.031) 0:02:35.753 **** 2026-02-25 15:44:05.009936 | controller | changed: [instance] 2026-02-25 15:44:05.233319 | controller | 2026-02-25 15:44:05.233361 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2026-02-25 15:44:05.233377 | controller | Wednesday 25 February 2026 15:44:05 +0000 (0:00:00.239) 0:02:35.992 **** 2026-02-25 15:44:05.233390 | controller | changed: [instance] 2026-02-25 15:44:05.233419 | controller | 2026-02-25 15:44:05.233427 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2026-02-25 15:44:05.233595 | controller | Wednesday 25 February 2026 15:44:05 +0000 (0:00:00.223) 0:02:36.215 **** 2026-02-25 15:44:05.568116 | controller | changed: [instance] 2026-02-25 15:44:05.597347 | controller | 2026-02-25 15:44:05.597389 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2026-02-25 15:44:05.597401 | controller | Wednesday 25 February 2026 15:44:05 +0000 (0:00:00.335) 0:02:36.550 **** 2026-02-25 15:44:05.597416 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-25 15:44:05.597453 | controller | 2026-02-25 15:44:05.597464 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-25 15:44:05.597543 | controller | Wednesday 25 February 2026 15:44:05 +0000 (0:00:00.029) 0:02:36.579 **** 2026-02-25 15:44:05.641312 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-25 15:44:05.641747 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-25 15:44:05.860946 | controller | 2026-02-25 15:44:05.860965 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 15:44:05.860973 | controller | Wednesday 25 February 2026 15:44:05 +0000 (0:00:00.044) 0:02:36.624 **** 2026-02-25 15:44:05.860981 | controller | ok: [instance] 2026-02-25 15:44:05.905916 | controller | 2026-02-25 15:44:05.905939 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 15:44:05.905948 | controller | Wednesday 25 February 2026 15:44:05 +0000 (0:00:00.219) 0:02:36.843 **** 2026-02-25 15:44:05.905959 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 15:44:06.140112 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 15:44:06.140146 | controller | 2026-02-25 15:44:06.140187 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 15:44:06.140205 | controller | Wednesday 25 February 2026 15:44:05 +0000 (0:00:00.045) 0:02:36.888 **** 2026-02-25 15:44:06.140221 | controller | ok: [instance] 2026-02-25 15:44:06.345542 | controller | 2026-02-25 15:44:06.345594 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 15:44:06.345608 | controller | Wednesday 25 February 2026 15:44:06 +0000 (0:00:00.233) 0:02:37.122 **** 2026-02-25 15:44:06.345624 | controller | ok: [instance] 2026-02-25 15:44:06.345849 | controller | 2026-02-25 15:44:06.345973 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2026-02-25 15:44:06.346090 | controller | Wednesday 25 February 2026 15:44:06 +0000 (0:00:00.205) 0:02:37.328 **** 2026-02-25 15:44:06.671703 | controller | changed: [instance] 2026-02-25 15:44:06.671967 | controller | 2026-02-25 15:44:06.672257 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 15:44:06.672457 | controller | Wednesday 25 February 2026 15:44:06 +0000 (0:00:00.326) 0:02:37.654 **** 2026-02-25 15:44:06.905271 | controller | ok: [instance] 2026-02-25 15:44:06.905607 | controller | 2026-02-25 15:44:06.905644 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 15:44:06.951324 | controller | Wednesday 25 February 2026 15:44:06 +0000 (0:00:00.233) 0:02:37.887 **** 2026-02-25 15:44:06.951369 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 15:44:06.951404 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 15:44:06.951413 | controller | 2026-02-25 15:44:06.951785 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 15:44:07.185218 | controller | Wednesday 25 February 2026 15:44:06 +0000 (0:00:00.046) 0:02:37.933 **** 2026-02-25 15:44:07.185246 | controller | ok: [instance] 2026-02-25 15:44:07.389278 | controller | 2026-02-25 15:44:07.389316 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 15:44:07.389325 | controller | Wednesday 25 February 2026 15:44:07 +0000 (0:00:00.233) 0:02:38.167 **** 2026-02-25 15:44:07.389337 | controller | ok: [instance] 2026-02-25 15:44:07.389369 | controller | 2026-02-25 15:44:07.389710 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2026-02-25 15:44:07.682947 | controller | Wednesday 25 February 2026 15:44:07 +0000 (0:00:00.204) 0:02:38.371 **** 2026-02-25 15:44:07.682982 | controller | changed: [instance] 2026-02-25 15:44:07.705245 | controller | 2026-02-25 15:44:07.705266 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2026-02-25 15:44:07.705273 | controller | Wednesday 25 February 2026 15:44:07 +0000 (0:00:00.293) 0:02:38.665 **** 2026-02-25 15:44:07.705295 | controller | skipping: [instance] 2026-02-25 15:44:07.705312 | controller | 2026-02-25 15:44:07.705320 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2026-02-25 15:44:07.705397 | controller | Wednesday 25 February 2026 15:44:07 +0000 (0:00:00.022) 0:02:38.688 **** 2026-02-25 15:44:07.734177 | controller | skipping: [instance] 2026-02-25 15:44:07.763291 | controller | 2026-02-25 15:44:07.763313 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2026-02-25 15:44:07.763321 | controller | Wednesday 25 February 2026 15:44:07 +0000 (0:00:00.028) 0:02:38.716 **** 2026-02-25 15:44:07.763339 | controller | skipping: [instance] 2026-02-25 15:44:07.763365 | controller | 2026-02-25 15:44:07.763372 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2026-02-25 15:44:07.763380 | controller | Wednesday 25 February 2026 15:44:07 +0000 (0:00:00.029) 0:02:38.746 **** 2026-02-25 15:44:07.790382 | controller | skipping: [instance] 2026-02-25 15:44:07.790795 | controller | 2026-02-25 15:44:07.790829 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-25 15:44:08.003229 | controller | Wednesday 25 February 2026 15:44:07 +0000 (0:00:00.026) 0:02:38.773 **** 2026-02-25 15:44:08.003259 | controller | changed: [instance] 2026-02-25 15:44:08.040614 | controller | 2026-02-25 15:44:08.040640 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-25 15:44:08.040650 | controller | Wednesday 25 February 2026 15:44:08 +0000 (0:00:00.212) 0:02:38.985 **** 2026-02-25 15:44:08.040661 | controller | ok: [instance] 2026-02-25 15:44:08.040731 | controller | 2026-02-25 15:44:08.040896 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-25 15:44:08.040989 | controller | Wednesday 25 February 2026 15:44:08 +0000 (0:00:00.037) 0:02:39.023 **** 2026-02-25 15:44:08.069769 | controller | skipping: [instance] 2026-02-25 15:44:08.069874 | controller | 2026-02-25 15:44:08.070038 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-25 15:44:08.070126 | controller | Wednesday 25 February 2026 15:44:08 +0000 (0:00:00.029) 0:02:39.052 **** 2026-02-25 15:44:08.099403 | controller | skipping: [instance] 2026-02-25 15:44:08.099523 | controller | 2026-02-25 15:44:08.099676 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-25 15:44:08.099805 | controller | Wednesday 25 February 2026 15:44:08 +0000 (0:00:00.029) 0:02:39.082 **** 2026-02-25 15:44:08.147104 | controller | skipping: [instance] 2026-02-25 15:44:08.147242 | controller | 2026-02-25 15:44:08.147365 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2026-02-25 15:44:08.147478 | controller | Wednesday 25 February 2026 15:44:08 +0000 (0:00:00.047) 0:02:39.130 **** 2026-02-25 15:44:08.175613 | controller | skipping: [instance] 2026-02-25 15:44:08.175728 | controller | 2026-02-25 15:44:08.175836 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2026-02-25 15:44:08.175943 | controller | Wednesday 25 February 2026 15:44:08 +0000 (0:00:00.028) 0:02:39.158 **** 2026-02-25 15:44:08.241046 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2026-02-25 15:44:08.241191 | controller | 2026-02-25 15:44:08.241351 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2026-02-25 15:44:08.241448 | controller | Wednesday 25 February 2026 15:44:08 +0000 (0:00:00.065) 0:02:39.224 **** 2026-02-25 15:44:08.489301 | controller | ok: [instance] => (item=crc) 2026-02-25 15:44:08.489357 | controller | 2026-02-25 15:44:08.489627 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2026-02-25 15:44:10.561930 | controller | Wednesday 25 February 2026 15:44:08 +0000 (0:00:00.247) 0:02:39.471 **** 2026-02-25 15:44:10.561967 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-25 15:44:11.429598 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-25 15:44:11.429632 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-25 15:44:11.429640 | controller | 2026-02-25 15:44:11.429646 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-25 15:44:11.429651 | controller | Wednesday 25 February 2026 15:44:10 +0000 (0:00:02.071) 0:02:41.543 **** 2026-02-25 15:44:11.429660 | controller | changed: [instance] 2026-02-25 15:44:12.198347 | controller | 2026-02-25 15:44:12.198385 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-25 15:44:12.198394 | controller | Wednesday 25 February 2026 15:44:11 +0000 (0:00:00.868) 0:02:42.412 **** 2026-02-25 15:44:12.198405 | controller | changed: [instance] 2026-02-25 15:44:13.055652 | controller | 2026-02-25 15:44:13.055684 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-25 15:44:13.055692 | controller | Wednesday 25 February 2026 15:44:12 +0000 (0:00:00.768) 0:02:43.180 **** 2026-02-25 15:44:13.055702 | controller | changed: [instance] 2026-02-25 15:44:13.868432 | controller | 2026-02-25 15:44:13.868462 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2026-02-25 15:44:13.868473 | controller | Wednesday 25 February 2026 15:44:13 +0000 (0:00:00.857) 0:02:44.037 **** 2026-02-25 15:44:13.868483 | controller | changed: [instance] => (item=compute-0.utility) 2026-02-25 15:44:36.847101 | controller | changed: [instance] => (item=controller-0.utility) 2026-02-25 15:44:36.847134 | controller | changed: [instance] => (item=crc-0.utility) 2026-02-25 15:44:36.847143 | controller | 2026-02-25 15:44:36.847149 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2026-02-25 15:44:36.847155 | controller | Wednesday 25 February 2026 15:44:13 +0000 (0:00:00.812) 0:02:44.850 **** 2026-02-25 15:44:36.847183 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-02-25 15:44:36.958293 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2026-02-25 15:44:36.958337 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2026-02-25 15:44:36.958344 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2026-02-25 15:44:36.958349 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2026-02-25 15:44:36.958354 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2026-02-25 15:44:36.958359 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). 2026-02-25 15:44:36.958364 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j34007273691.24411', 'results_file': '/home/zuul/.ansible_async/j34007273691.24411', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2026-02-25 15:44:36.958377 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j766351009003.24429', 'results_file': '/home/zuul/.ansible_async/j766351009003.24429', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2026-02-25 15:44:36.958382 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j65622391931.24445', 'results_file': '/home/zuul/.ansible_async/j65622391931.24445', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2026-02-25 15:44:36.958393 | controller | 2026-02-25 15:44:36.958398 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2026-02-25 15:44:36.958403 | controller | Wednesday 25 February 2026 15:44:36 +0000 (0:00:22.978) 0:03:07.828 **** 2026-02-25 15:44:36.958414 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-25 15:44:36.958444 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-25 15:44:36.958451 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-25 15:44:36.958456 | controller | 2026-02-25 15:44:36.958463 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-25 15:44:36.980672 | controller | Wednesday 25 February 2026 15:44:36 +0000 (0:00:00.112) 0:03:07.940 **** 2026-02-25 15:44:36.980700 | controller | skipping: [instance] 2026-02-25 15:44:36.980719 | controller | 2026-02-25 15:44:36.980807 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2026-02-25 15:44:36.980906 | controller | Wednesday 25 February 2026 15:44:36 +0000 (0:00:00.022) 0:03:07.963 **** 2026-02-25 15:44:37.018074 | controller | 2026-02-25 15:44:37.018194 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-25 15:44:37.018287 | controller | Wednesday 25 February 2026 15:44:37 +0000 (0:00:00.037) 0:03:08.001 **** 2026-02-25 15:44:37.099023 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-25 15:44:37.099106 | controller | 2026-02-25 15:44:37.099231 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-25 15:44:37.099328 | controller | Wednesday 25 February 2026 15:44:37 +0000 (0:00:00.080) 0:03:08.081 **** 2026-02-25 15:44:37.328395 | controller | changed: [instance] 2026-02-25 15:44:37.328447 | controller | 2026-02-25 15:44:37.328560 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-25 15:44:37.328670 | controller | Wednesday 25 February 2026 15:44:37 +0000 (0:00:00.229) 0:03:08.311 **** 2026-02-25 15:44:37.538986 | controller | changed: [instance] 2026-02-25 15:44:37.539052 | controller | 2026-02-25 15:44:37.539189 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2026-02-25 15:44:37.539294 | controller | Wednesday 25 February 2026 15:44:37 +0000 (0:00:00.210) 0:03:08.521 **** 2026-02-25 15:44:37.927657 | controller | changed: [instance] 2026-02-25 15:44:37.927717 | controller | 2026-02-25 15:44:37.927781 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2026-02-25 15:44:37.927882 | controller | Wednesday 25 February 2026 15:44:37 +0000 (0:00:00.388) 0:03:08.910 **** 2026-02-25 15:44:37.954964 | controller | skipping: [instance] 2026-02-25 15:44:37.955049 | controller | 2026-02-25 15:44:37.955177 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-25 15:44:37.955287 | controller | Wednesday 25 February 2026 15:44:37 +0000 (0:00:00.027) 0:03:08.937 **** 2026-02-25 15:44:37.983545 | controller | skipping: [instance] 2026-02-25 15:44:37.983640 | controller | 2026-02-25 15:44:37.983736 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2026-02-25 15:44:37.983826 | controller | Wednesday 25 February 2026 15:44:37 +0000 (0:00:00.028) 0:03:08.966 **** 2026-02-25 15:44:38.028729 | controller | skipping: [instance] 2026-02-25 15:44:38.028819 | controller | 2026-02-25 15:44:38.028923 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2026-02-25 15:44:38.029033 | controller | Wednesday 25 February 2026 15:44:38 +0000 (0:00:00.044) 0:03:09.011 **** 2026-02-25 15:44:38.074109 | controller | skipping: [instance] 2026-02-25 15:44:38.074211 | controller | 2026-02-25 15:44:38.074306 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-25 15:44:38.074396 | controller | Wednesday 25 February 2026 15:44:38 +0000 (0:00:00.045) 0:03:09.057 **** 2026-02-25 15:44:38.098410 | controller | skipping: [instance] 2026-02-25 15:44:38.098503 | controller | 2026-02-25 15:44:38.098627 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2026-02-25 15:44:38.098719 | controller | Wednesday 25 February 2026 15:44:38 +0000 (0:00:00.024) 0:03:09.081 **** 2026-02-25 15:44:38.172314 | controller | 2026-02-25 15:44:38.172408 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-25 15:44:38.172526 | controller | Wednesday 25 February 2026 15:44:38 +0000 (0:00:00.073) 0:03:09.155 **** 2026-02-25 15:44:38.258456 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-25 15:44:38.258506 | controller | 2026-02-25 15:44:38.258629 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-25 15:44:38.258732 | controller | Wednesday 25 February 2026 15:44:38 +0000 (0:00:00.086) 0:03:09.241 **** 2026-02-25 15:44:38.485853 | controller | ok: [instance] 2026-02-25 15:44:38.485903 | controller | 2026-02-25 15:44:38.486017 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-25 15:44:38.486101 | controller | Wednesday 25 February 2026 15:44:38 +0000 (0:00:00.227) 0:03:09.468 **** 2026-02-25 15:44:38.700538 | controller | ok: [instance] 2026-02-25 15:44:38.700645 | controller | 2026-02-25 15:44:38.700743 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2026-02-25 15:44:38.700830 | controller | Wednesday 25 February 2026 15:44:38 +0000 (0:00:00.214) 0:03:09.683 **** 2026-02-25 15:44:39.096786 | controller | changed: [instance] 2026-02-25 15:44:39.096843 | controller | 2026-02-25 15:44:39.097112 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2026-02-25 15:44:39.127806 | controller | Wednesday 25 February 2026 15:44:39 +0000 (0:00:00.396) 0:03:10.079 **** 2026-02-25 15:44:39.127854 | controller | skipping: [instance] 2026-02-25 15:44:39.127875 | controller | 2026-02-25 15:44:39.127884 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-25 15:44:39.127997 | controller | Wednesday 25 February 2026 15:44:39 +0000 (0:00:00.031) 0:03:10.110 **** 2026-02-25 15:44:39.157134 | controller | skipping: [instance] 2026-02-25 15:44:39.157219 | controller | 2026-02-25 15:44:39.157231 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2026-02-25 15:44:39.157316 | controller | Wednesday 25 February 2026 15:44:39 +0000 (0:00:00.029) 0:03:10.139 **** 2026-02-25 15:44:40.666404 | controller | changed: [instance -> controller-0.instance] 2026-02-25 15:44:41.721975 | controller | 2026-02-25 15:44:41.722008 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2026-02-25 15:44:41.722016 | controller | Wednesday 25 February 2026 15:44:40 +0000 (0:00:01.508) 0:03:11.648 **** 2026-02-25 15:44:41.722025 | controller | changed: [instance -> controller-0.instance] 2026-02-25 15:44:41.762111 | controller | 2026-02-25 15:44:41.762129 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-25 15:44:41.762136 | controller | Wednesday 25 February 2026 15:44:41 +0000 (0:00:01.055) 0:03:12.704 **** 2026-02-25 15:44:41.762145 | controller | 2026-02-25 15:44:41.968266 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-25 15:44:41.968291 | controller | Wednesday 25 February 2026 15:44:41 +0000 (0:00:00.040) 0:03:12.744 **** 2026-02-25 15:44:41.968302 | controller | ok: [instance] 2026-02-25 15:44:41.995130 | controller | 2026-02-25 15:44:41.995148 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-25 15:44:41.995178 | controller | Wednesday 25 February 2026 15:44:41 +0000 (0:00:00.205) 0:03:12.950 **** 2026-02-25 15:44:41.995191 | controller | ok: [instance] 2026-02-25 15:44:42.026288 | controller | 2026-02-25 15:44:42.026306 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-25 15:44:42.026314 | controller | Wednesday 25 February 2026 15:44:41 +0000 (0:00:00.027) 0:03:12.977 **** 2026-02-25 15:44:42.026322 | controller | skipping: [instance] 2026-02-25 15:44:42.071886 | controller | 2026-02-25 15:44:42.071911 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2026-02-25 15:44:42.071920 | controller | Wednesday 25 February 2026 15:44:42 +0000 (0:00:00.031) 0:03:13.008 **** 2026-02-25 15:44:42.071932 | controller | 2026-02-25 15:44:42.151716 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-25 15:44:42.151735 | controller | Wednesday 25 February 2026 15:44:42 +0000 (0:00:00.045) 0:03:13.054 **** 2026-02-25 15:44:42.151746 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2026-02-25 15:44:42.376378 | controller | 2026-02-25 15:44:42.376403 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-25 15:44:42.376411 | controller | Wednesday 25 February 2026 15:44:42 +0000 (0:00:00.079) 0:03:13.134 **** 2026-02-25 15:44:42.376421 | controller | ok: [instance] 2026-02-25 15:44:42.592213 | controller | 2026-02-25 15:44:42.592240 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-25 15:44:42.592248 | controller | Wednesday 25 February 2026 15:44:42 +0000 (0:00:00.224) 0:03:13.358 **** 2026-02-25 15:44:42.592258 | controller | ok: [instance] 2026-02-25 15:44:42.980774 | controller | 2026-02-25 15:44:42.980808 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2026-02-25 15:44:42.980821 | controller | Wednesday 25 February 2026 15:44:42 +0000 (0:00:00.215) 0:03:13.574 **** 2026-02-25 15:44:42.980831 | controller | changed: [instance] 2026-02-25 15:44:43.721379 | controller | 2026-02-25 15:44:43.721412 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2026-02-25 15:44:43.721421 | controller | Wednesday 25 February 2026 15:44:42 +0000 (0:00:00.388) 0:03:13.963 **** 2026-02-25 15:44:43.721430 | controller | changed: [instance] 2026-02-25 15:44:43.749125 | controller | 2026-02-25 15:44:43.749148 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-25 15:44:43.749174 | controller | Wednesday 25 February 2026 15:44:43 +0000 (0:00:00.737) 0:03:14.701 **** 2026-02-25 15:44:43.749189 | controller | skipping: [instance] 2026-02-25 15:44:43.793293 | controller | 2026-02-25 15:44:43.793318 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2026-02-25 15:44:43.793327 | controller | Wednesday 25 February 2026 15:44:43 +0000 (0:00:00.030) 0:03:14.731 **** 2026-02-25 15:44:43.793339 | controller | skipping: [instance] 2026-02-25 15:44:43.840154 | controller | 2026-02-25 15:44:43.840195 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2026-02-25 15:44:43.840202 | controller | Wednesday 25 February 2026 15:44:43 +0000 (0:00:00.043) 0:03:14.775 **** 2026-02-25 15:44:43.840211 | controller | skipping: [instance] 2026-02-25 15:44:43.896325 | controller | 2026-02-25 15:44:43.896367 | controller | TASK [Create VBMC entity] ****************************************************** 2026-02-25 15:44:43.896376 | controller | Wednesday 25 February 2026 15:44:43 +0000 (0:00:00.043) 0:03:14.819 **** 2026-02-25 15:44:43.896392 | controller | skipping: [instance] => (item=compute-0) 2026-02-25 15:44:43.896418 | controller | skipping: [instance] => (item=controller-0) 2026-02-25 15:44:43.896425 | controller | skipping: [instance] => (item=crc-0) 2026-02-25 15:44:43.896430 | controller | skipping: [instance] 2026-02-25 15:44:43.896436 | controller | 2026-02-25 15:44:43.896441 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2026-02-25 15:44:43.896448 | controller | Wednesday 25 February 2026 15:44:43 +0000 (0:00:00.059) 0:03:14.878 **** 2026-02-25 15:44:44.140811 | controller | ok: [instance] 2026-02-25 15:44:44.515320 | controller | 2026-02-25 15:44:44.515348 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2026-02-25 15:44:44.515356 | controller | Wednesday 25 February 2026 15:44:44 +0000 (0:00:00.244) 0:03:15.123 **** 2026-02-25 15:44:44.515366 | controller | changed: [instance] 2026-02-25 15:44:44.548760 | controller | 2026-02-25 15:44:44.548778 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2026-02-25 15:44:44.548786 | controller | Wednesday 25 February 2026 15:44:44 +0000 (0:00:00.370) 0:03:15.493 **** 2026-02-25 15:44:44.548794 | controller | skipping: [instance] 2026-02-25 15:44:44.583157 | controller | 2026-02-25 15:44:44.583197 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2026-02-25 15:44:44.583205 | controller | Wednesday 25 February 2026 15:44:44 +0000 (0:00:00.037) 0:03:15.531 **** 2026-02-25 15:44:44.583214 | controller | skipping: [instance] 2026-02-25 15:44:44.617505 | controller | 2026-02-25 15:44:44.617522 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2026-02-25 15:44:44.617529 | controller | Wednesday 25 February 2026 15:44:44 +0000 (0:00:00.034) 0:03:15.565 **** 2026-02-25 15:44:44.617537 | controller | skipping: [instance] 2026-02-25 15:44:45.353706 | controller | 2026-02-25 15:44:45.353738 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2026-02-25 15:44:45.353745 | controller | Wednesday 25 February 2026 15:44:44 +0000 (0:00:00.034) 0:03:15.600 **** 2026-02-25 15:44:45.353755 | controller | changed: [instance] 2026-02-25 15:44:46.009721 | controller | 2026-02-25 15:44:46.009754 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2026-02-25 15:44:46.009763 | controller | Wednesday 25 February 2026 15:44:45 +0000 (0:00:00.735) 0:03:16.336 **** 2026-02-25 15:44:46.009773 | controller | changed: [instance] 2026-02-25 15:44:46.047292 | controller | 2026-02-25 15:44:46.047316 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2026-02-25 15:44:46.047323 | controller | Wednesday 25 February 2026 15:44:46 +0000 (0:00:00.655) 0:03:16.992 **** 2026-02-25 15:44:46.047332 | controller | skipping: [instance] 2026-02-25 15:44:46.047535 | controller | 2026-02-25 15:44:46.047697 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2026-02-25 15:44:46.047857 | controller | Wednesday 25 February 2026 15:44:46 +0000 (0:00:00.038) 0:03:17.030 **** 2026-02-25 15:44:46.110856 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2026-02-25 15:44:46.156918 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2026-02-25 15:44:46.156941 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2026-02-25 15:44:46.156948 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2026-02-25 15:44:46.156954 | controller | 2026-02-25 15:44:46.156960 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2026-02-25 15:44:46.156965 | controller | Wednesday 25 February 2026 15:44:46 +0000 (0:00:00.062) 0:03:17.093 **** 2026-02-25 15:44:46.156980 | controller | skipping: [instance] 2026-02-25 15:44:46.204442 | controller | 2026-02-25 15:44:46.204478 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2026-02-25 15:44:46.204486 | controller | Wednesday 25 February 2026 15:44:46 +0000 (0:00:00.046) 0:03:17.139 **** 2026-02-25 15:44:46.204502 | controller | skipping: [instance] 2026-02-25 15:44:46.243731 | controller | 2026-02-25 15:44:46.243757 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2026-02-25 15:44:46.243767 | controller | Wednesday 25 February 2026 15:44:46 +0000 (0:00:00.047) 0:03:17.186 **** 2026-02-25 15:44:46.243778 | controller | skipping: [instance] 2026-02-25 15:44:46.293850 | controller | 2026-02-25 15:44:46.293872 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2026-02-25 15:44:46.293880 | controller | Wednesday 25 February 2026 15:44:46 +0000 (0:00:00.039) 0:03:17.226 **** 2026-02-25 15:44:46.293890 | controller | skipping: [instance] 2026-02-25 15:44:46.294030 | controller | 2026-02-25 15:44:46.294206 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2026-02-25 15:44:46.294350 | controller | Wednesday 25 February 2026 15:44:46 +0000 (0:00:00.050) 0:03:17.276 **** 2026-02-25 15:44:46.940476 | controller | changed: [instance] 2026-02-25 15:44:46.978632 | controller | 2026-02-25 15:44:46.978664 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2026-02-25 15:44:46.978672 | controller | Wednesday 25 February 2026 15:44:46 +0000 (0:00:00.646) 0:03:17.922 **** 2026-02-25 15:44:46.978681 | controller | skipping: [instance] 2026-02-25 15:44:47.018977 | controller | 2026-02-25 15:44:47.019011 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2026-02-25 15:44:47.019019 | controller | Wednesday 25 February 2026 15:44:46 +0000 (0:00:00.038) 0:03:17.960 **** 2026-02-25 15:44:47.019028 | controller | skipping: [instance] 2026-02-25 15:44:47.061565 | controller | 2026-02-25 15:44:47.061607 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2026-02-25 15:44:47.061616 | controller | Wednesday 25 February 2026 15:44:47 +0000 (0:00:00.040) 0:03:18.001 **** 2026-02-25 15:44:47.061627 | controller | skipping: [instance] 2026-02-25 15:44:47.061656 | controller | 2026-02-25 15:44:47.061913 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-25 15:44:47.104090 | controller | Wednesday 25 February 2026 15:44:47 +0000 (0:00:00.042) 0:03:18.044 **** 2026-02-25 15:44:47.104127 | controller | skipping: [instance] 2026-02-25 15:44:47.144309 | controller | 2026-02-25 15:44:47.144337 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-25 15:44:47.144345 | controller | Wednesday 25 February 2026 15:44:47 +0000 (0:00:00.042) 0:03:18.086 **** 2026-02-25 15:44:47.144361 | controller | skipping: [instance] 2026-02-25 15:44:47.144379 | controller | 2026-02-25 15:44:47.144476 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-25 15:44:47.144568 | controller | Wednesday 25 February 2026 15:44:47 +0000 (0:00:00.040) 0:03:18.127 **** 2026-02-25 15:44:47.182945 | controller | skipping: [instance] 2026-02-25 15:44:47.183022 | controller | 2026-02-25 15:44:47.183124 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-25 15:44:47.183248 | controller | Wednesday 25 February 2026 15:44:47 +0000 (0:00:00.038) 0:03:18.165 **** 2026-02-25 15:44:47.222357 | controller | skipping: [instance] 2026-02-25 15:44:47.222433 | controller | 2026-02-25 15:44:47.222554 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-25 15:44:47.222699 | controller | Wednesday 25 February 2026 15:44:47 +0000 (0:00:00.039) 0:03:18.205 **** 2026-02-25 15:44:47.260361 | controller | skipping: [instance] 2026-02-25 15:44:47.302448 | controller | 2026-02-25 15:44:47.302473 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-25 15:44:47.302481 | controller | Wednesday 25 February 2026 15:44:47 +0000 (0:00:00.037) 0:03:18.243 **** 2026-02-25 15:44:47.302490 | controller | skipping: [instance] 2026-02-25 15:44:47.302655 | controller | 2026-02-25 15:44:47.302797 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-25 15:44:47.302931 | controller | Wednesday 25 February 2026 15:44:47 +0000 (0:00:00.042) 0:03:18.285 **** 2026-02-25 15:44:47.352331 | controller | skipping: [instance] 2026-02-25 15:44:47.352497 | controller | 2026-02-25 15:44:47.352657 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2026-02-25 15:44:47.352801 | controller | Wednesday 25 February 2026 15:44:47 +0000 (0:00:00.049) 0:03:18.335 **** 2026-02-25 15:44:47.391221 | controller | skipping: [instance] 2026-02-25 15:44:47.391434 | controller | 2026-02-25 15:44:47.391605 | controller | TASK [reproducer : Configure Controller node] ********************************** 2026-02-25 15:44:47.391765 | controller | Wednesday 25 February 2026 15:44:47 +0000 (0:00:00.038) 0:03:18.373 **** 2026-02-25 15:44:47.620208 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2026-02-25 15:44:47.620403 | controller | 2026-02-25 15:44:47.620554 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-25 15:44:47.620709 | controller | Wednesday 25 February 2026 15:44:47 +0000 (0:00:00.228) 0:03:18.602 **** 2026-02-25 15:44:48.968799 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-25 15:44:48.968859 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-25 15:44:48.969177 | controller | 2026-02-25 15:44:48.990997 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-25 15:44:48.991023 | controller | Wednesday 25 February 2026 15:44:48 +0000 (0:00:01.348) 0:03:19.951 **** 2026-02-25 15:44:48.991036 | controller | skipping: [instance] 2026-02-25 15:44:49.610608 | controller | 2026-02-25 15:44:49.610641 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-25 15:44:49.610649 | controller | Wednesday 25 February 2026 15:44:48 +0000 (0:00:00.022) 0:03:19.973 **** 2026-02-25 15:44:49.610664 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:44:49.610763 | controller | 2026-02-25 15:44:49.611021 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-25 15:44:49.611104 | controller | Wednesday 25 February 2026 15:44:49 +0000 (0:00:00.619) 0:03:20.593 **** 2026-02-25 15:44:49.652693 | controller | skipping: [instance] 2026-02-25 15:44:49.693067 | controller | 2026-02-25 15:44:49.693102 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-25 15:44:49.693111 | controller | Wednesday 25 February 2026 15:44:49 +0000 (0:00:00.039) 0:03:20.632 **** 2026-02-25 15:44:49.693121 | controller | skipping: [instance] 2026-02-25 15:44:49.693149 | controller | 2026-02-25 15:44:49.693157 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-25 15:44:49.693238 | controller | Wednesday 25 February 2026 15:44:49 +0000 (0:00:00.043) 0:03:20.675 **** 2026-02-25 15:44:49.730655 | controller | skipping: [instance] 2026-02-25 15:44:49.774293 | controller | 2026-02-25 15:44:49.774321 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-25 15:44:49.774330 | controller | Wednesday 25 February 2026 15:44:49 +0000 (0:00:00.037) 0:03:20.713 **** 2026-02-25 15:44:49.774340 | controller | skipping: [instance] 2026-02-25 15:44:49.774376 | controller | 2026-02-25 15:44:49.774624 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2026-02-25 15:44:49.808606 | controller | Wednesday 25 February 2026 15:44:49 +0000 (0:00:00.043) 0:03:20.756 **** 2026-02-25 15:44:49.808631 | controller | skipping: [instance] 2026-02-25 15:44:49.843100 | controller | 2026-02-25 15:44:49.843135 | controller | TASK [reproducer : Install repos] ********************************************** 2026-02-25 15:44:49.843143 | controller | Wednesday 25 February 2026 15:44:49 +0000 (0:00:00.034) 0:03:20.791 **** 2026-02-25 15:44:49.843154 | controller | skipping: [instance] 2026-02-25 15:44:49.843330 | controller | 2026-02-25 15:44:49.843355 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2026-02-25 15:44:49.881023 | controller | Wednesday 25 February 2026 15:44:49 +0000 (0:00:00.034) 0:03:20.826 **** 2026-02-25 15:44:49.881054 | controller | skipping: [instance] 2026-02-25 15:44:49.914531 | controller | 2026-02-25 15:44:49.914550 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2026-02-25 15:44:49.914557 | controller | Wednesday 25 February 2026 15:44:49 +0000 (0:00:00.037) 0:03:20.863 **** 2026-02-25 15:44:49.914565 | controller | skipping: [instance] 2026-02-25 15:44:50.945731 | controller | 2026-02-25 15:44:50.945757 | controller | TASK [reproducer : Install some tools] ***************************************** 2026-02-25 15:44:50.945765 | controller | Wednesday 25 February 2026 15:44:49 +0000 (0:00:00.033) 0:03:20.897 **** 2026-02-25 15:44:50.945774 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:44:51.951032 | controller | 2026-02-25 15:44:51.951066 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2026-02-25 15:44:51.951074 | controller | Wednesday 25 February 2026 15:44:50 +0000 (0:00:01.031) 0:03:21.928 **** 2026-02-25 15:44:51.951084 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:44:51.951113 | controller | 2026-02-25 15:44:51.951120 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2026-02-25 15:44:51.951128 | controller | Wednesday 25 February 2026 15:44:51 +0000 (0:00:01.005) 0:03:22.933 **** 2026-02-25 15:44:52.483933 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:44:52.484094 | controller | 2026-02-25 15:44:52.484132 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2026-02-25 15:44:53.495080 | controller | Wednesday 25 February 2026 15:44:52 +0000 (0:00:00.532) 0:03:23.466 **** 2026-02-25 15:44:53.495123 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:44:53.495144 | controller | 2026-02-25 15:44:53.495288 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2026-02-25 15:44:53.495387 | controller | Wednesday 25 February 2026 15:44:53 +0000 (0:00:01.011) 0:03:24.477 **** 2026-02-25 15:44:54.509356 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-25 15:44:54.509408 | controller | skipping: [instance] => (item=compute-0) 2026-02-25 15:44:54.509417 | controller | skipping: [instance] => (item=controller-0) 2026-02-25 15:44:54.509422 | controller | skipping: [instance] => (item=crc-0) 2026-02-25 15:44:54.509427 | controller | 2026-02-25 15:44:54.509441 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2026-02-25 15:44:54.509448 | controller | Wednesday 25 February 2026 15:44:54 +0000 (0:00:01.013) 0:03:25.491 **** 2026-02-25 15:44:55.145099 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-25 15:44:55.145155 | controller | skipping: [instance] => (item=compute-0) 2026-02-25 15:44:55.145192 | controller | skipping: [instance] => (item=controller-0) 2026-02-25 15:44:55.145589 | controller | skipping: [instance] => (item=crc-0) 2026-02-25 15:44:56.813820 | controller | 2026-02-25 15:44:56.813854 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2026-02-25 15:44:56.813862 | controller | Wednesday 25 February 2026 15:44:55 +0000 (0:00:00.636) 0:03:26.127 **** 2026-02-25 15:44:56.813872 | controller | skipping: [instance] => (item=instance) 2026-02-25 15:44:57.391083 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2026-02-25 15:44:57.391117 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-25 15:44:57.391125 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2026-02-25 15:44:57.391131 | controller | 2026-02-25 15:44:57.391137 | controller | TASK [reproducer : Create kube directory] ************************************** 2026-02-25 15:44:57.391143 | controller | Wednesday 25 February 2026 15:44:56 +0000 (0:00:01.668) 0:03:27.796 **** 2026-02-25 15:44:57.391153 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:44:58.336805 | controller | 2026-02-25 15:44:58.336840 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2026-02-25 15:44:58.336848 | controller | Wednesday 25 February 2026 15:44:57 +0000 (0:00:00.577) 0:03:28.373 **** 2026-02-25 15:44:58.336858 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:44:59.280922 | controller | 2026-02-25 15:44:59.280956 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2026-02-25 15:44:59.280964 | controller | Wednesday 25 February 2026 15:44:58 +0000 (0:00:00.945) 0:03:29.319 **** 2026-02-25 15:44:59.280975 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:44:59.314251 | controller | 2026-02-25 15:44:59.314287 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2026-02-25 15:44:59.314297 | controller | Wednesday 25 February 2026 15:44:59 +0000 (0:00:00.944) 0:03:30.263 **** 2026-02-25 15:44:59.314309 | controller | skipping: [instance] 2026-02-25 15:44:59.314330 | controller | 2026-02-25 15:44:59.314340 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2026-02-25 15:44:59.314399 | controller | Wednesday 25 February 2026 15:44:59 +0000 (0:00:00.033) 0:03:30.297 **** 2026-02-25 15:44:59.915654 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:45:00.488769 | controller | 2026-02-25 15:45:00.488801 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2026-02-25 15:45:00.488809 | controller | Wednesday 25 February 2026 15:44:59 +0000 (0:00:00.600) 0:03:30.898 **** 2026-02-25 15:45:00.488818 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:45:00.528025 | controller | 2026-02-25 15:45:00.528054 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2026-02-25 15:45:00.528064 | controller | Wednesday 25 February 2026 15:45:00 +0000 (0:00:00.573) 0:03:31.471 **** 2026-02-25 15:45:00.528076 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:45:00.595064 | controller | 2026-02-25 15:45:00.595091 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2026-02-25 15:45:00.595100 | controller | Wednesday 25 February 2026 15:45:00 +0000 (0:00:00.039) 0:03:31.510 **** 2026-02-25 15:45:00.595113 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2026-02-25 15:45:00.646538 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2026-02-25 15:45:00.646570 | controller | 2026-02-25 15:45:00.646578 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-25 15:45:00.646584 | controller | Wednesday 25 February 2026 15:45:00 +0000 (0:00:00.066) 0:03:31.577 **** 2026-02-25 15:45:00.646593 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 15:45:00.690976 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2026-02-25 15:45:00.691001 | controller | 2026-02-25 15:45:00.691008 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-25 15:45:00.691014 | controller | Wednesday 25 February 2026 15:45:00 +0000 (0:00:00.051) 0:03:31.629 **** 2026-02-25 15:45:00.691023 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 15:45:00.736467 | controller | _secret_file: '' 2026-02-25 15:45:00.736493 | controller | 2026-02-25 15:45:00.736503 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-25 15:45:00.736511 | controller | Wednesday 25 February 2026 15:45:00 +0000 (0:00:00.044) 0:03:31.673 **** 2026-02-25 15:45:00.736522 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 15:45:00.736713 | controller | _secret_content: my-default-location-place 2026-02-25 15:45:00.736865 | controller | 2026-02-25 15:45:00.736999 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-25 15:45:00.737131 | controller | Wednesday 25 February 2026 15:45:00 +0000 (0:00:00.045) 0:03:31.719 **** 2026-02-25 15:45:00.791320 | controller | skipping: [instance] 2026-02-25 15:45:00.791463 | controller | 2026-02-25 15:45:00.791610 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-25 15:45:00.791744 | controller | Wednesday 25 February 2026 15:45:00 +0000 (0:00:00.054) 0:03:31.774 **** 2026-02-25 15:45:00.836251 | controller | skipping: [instance] 2026-02-25 15:45:00.836445 | controller | 2026-02-25 15:45:00.836613 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-25 15:45:00.836761 | controller | Wednesday 25 February 2026 15:45:00 +0000 (0:00:00.044) 0:03:31.819 **** 2026-02-25 15:45:00.881912 | controller | skipping: [instance] 2026-02-25 15:45:00.882062 | controller | 2026-02-25 15:45:00.882223 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-25 15:45:00.882363 | controller | Wednesday 25 February 2026 15:45:00 +0000 (0:00:00.045) 0:03:31.864 **** 2026-02-25 15:45:01.805333 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:45:01.805511 | controller | 2026-02-25 15:45:01.805658 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-25 15:45:01.805784 | controller | Wednesday 25 February 2026 15:45:01 +0000 (0:00:00.923) 0:03:32.787 **** 2026-02-25 15:45:01.855944 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 15:45:01.856133 | controller | _secret_dest: /home/zuul/ipmi-things 2026-02-25 15:45:01.856307 | controller | 2026-02-25 15:45:01.856463 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-25 15:45:01.856612 | controller | Wednesday 25 February 2026 15:45:01 +0000 (0:00:00.050) 0:03:32.838 **** 2026-02-25 15:45:01.901486 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 15:45:01.901681 | controller | _secret_file: /tmp/ipmi-things 2026-02-25 15:45:01.901832 | controller | 2026-02-25 15:45:01.901988 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-25 15:45:01.902115 | controller | Wednesday 25 February 2026 15:45:01 +0000 (0:00:00.045) 0:03:32.884 **** 2026-02-25 15:45:01.947254 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 15:45:01.947415 | controller | _secret_content: '' 2026-02-25 15:45:01.947565 | controller | 2026-02-25 15:45:01.947730 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-25 15:45:01.947879 | controller | Wednesday 25 February 2026 15:45:01 +0000 (0:00:00.045) 0:03:32.930 **** 2026-02-25 15:45:01.997072 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2026-02-25 15:45:01.997288 | controller | msg: All assertions passed 2026-02-25 15:45:01.997431 | controller | 2026-02-25 15:45:01.997593 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-25 15:45:01.997752 | controller | Wednesday 25 February 2026 15:45:01 +0000 (0:00:00.049) 0:03:32.980 **** 2026-02-25 15:45:02.525271 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:45:02.525462 | controller | 2026-02-25 15:45:02.525614 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-25 15:45:02.525742 | controller | Wednesday 25 February 2026 15:45:02 +0000 (0:00:00.524) 0:03:33.504 **** 2026-02-25 15:45:03.453399 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:45:03.453570 | controller | 2026-02-25 15:45:03.453705 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-25 15:45:03.453830 | controller | Wednesday 25 February 2026 15:45:03 +0000 (0:00:00.931) 0:03:34.436 **** 2026-02-25 15:45:03.507749 | controller | skipping: [instance] 2026-02-25 15:45:03.507894 | controller | 2026-02-25 15:45:03.508030 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2026-02-25 15:45:03.508179 | controller | Wednesday 25 February 2026 15:45:03 +0000 (0:00:00.054) 0:03:34.490 **** 2026-02-25 15:45:04.033370 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:45:04.033559 | controller | 2026-02-25 15:45:04.033702 | controller | TASK [reproducer : Check if async file is still available] ********************* 2026-02-25 15:45:04.033827 | controller | Wednesday 25 February 2026 15:45:04 +0000 (0:00:00.525) 0:03:35.015 **** 2026-02-25 15:45:04.559113 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:45:04.559333 | controller | 2026-02-25 15:45:04.559495 | controller | TASK [reproducer : Check package install status] ******************************* 2026-02-25 15:45:04.559648 | controller | Wednesday 25 February 2026 15:45:04 +0000 (0:00:00.525) 0:03:35.541 **** 2026-02-25 15:45:54.535683 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2026-02-25 15:45:55.214419 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2026-02-25 15:45:55.214453 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2026-02-25 15:45:55.214461 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2026-02-25 15:45:55.214466 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2026-02-25 15:45:55.214488 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2026-02-25 15:45:55.214494 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2026-02-25 15:45:55.214499 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2026-02-25 15:45:55.214504 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2026-02-25 15:45:55.214509 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:45:55.214514 | controller | 2026-02-25 15:45:55.214519 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2026-02-25 15:45:55.214525 | controller | Wednesday 25 February 2026 15:45:54 +0000 (0:00:49.975) 0:04:25.517 **** 2026-02-25 15:45:55.214534 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:45:57.892803 | controller | 2026-02-25 15:45:57.892845 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2026-02-25 15:45:57.892854 | controller | Wednesday 25 February 2026 15:45:55 +0000 (0:00:00.679) 0:04:26.196 **** 2026-02-25 15:45:57.892865 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:45:57.943912 | controller | 2026-02-25 15:45:57.943936 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2026-02-25 15:45:57.943944 | controller | Wednesday 25 February 2026 15:45:57 +0000 (0:00:02.678) 0:04:28.874 **** 2026-02-25 15:45:57.943954 | controller | skipping: [instance] 2026-02-25 15:45:57.989405 | controller | 2026-02-25 15:45:57.989429 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2026-02-25 15:45:57.989437 | controller | Wednesday 25 February 2026 15:45:57 +0000 (0:00:00.051) 0:04:28.926 **** 2026-02-25 15:45:57.989446 | controller | skipping: [instance] 2026-02-25 15:45:58.664774 | controller | 2026-02-25 15:45:58.664807 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2026-02-25 15:45:58.664815 | controller | Wednesday 25 February 2026 15:45:57 +0000 (0:00:00.045) 0:04:28.972 **** 2026-02-25 15:45:58.664825 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:45:59.219426 | controller | 2026-02-25 15:45:59.219452 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2026-02-25 15:45:59.219459 | controller | Wednesday 25 February 2026 15:45:58 +0000 (0:00:00.675) 0:04:29.647 **** 2026-02-25 15:45:59.219479 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:45:59.527767 | controller | 2026-02-25 15:45:59.527792 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2026-02-25 15:45:59.527801 | controller | Wednesday 25 February 2026 15:45:59 +0000 (0:00:00.554) 0:04:30.202 **** 2026-02-25 15:45:59.527810 | controller | changed: [instance] 2026-02-25 15:46:00.150234 | controller | 2026-02-25 15:46:00.150270 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2026-02-25 15:46:00.150278 | controller | Wednesday 25 February 2026 15:45:59 +0000 (0:00:00.308) 0:04:30.510 **** 2026-02-25 15:46:00.150293 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:00.150593 | controller | 2026-02-25 15:46:01.079564 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2026-02-25 15:46:01.079595 | controller | Wednesday 25 February 2026 15:46:00 +0000 (0:00:00.622) 0:04:31.132 **** 2026-02-25 15:46:01.079607 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:01.127553 | controller | 2026-02-25 15:46:01.127586 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-25 15:46:01.127600 | controller | Wednesday 25 February 2026 15:46:01 +0000 (0:00:00.929) 0:04:32.061 **** 2026-02-25 15:46:01.127611 | controller | skipping: [instance] 2026-02-25 15:46:01.170208 | controller | 2026-02-25 15:46:01.170229 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-25 15:46:01.170237 | controller | Wednesday 25 February 2026 15:46:01 +0000 (0:00:00.048) 0:04:32.109 **** 2026-02-25 15:46:01.170246 | controller | skipping: [instance] 2026-02-25 15:46:01.170593 | controller | 2026-02-25 15:46:01.210037 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-25 15:46:01.210056 | controller | Wednesday 25 February 2026 15:46:01 +0000 (0:00:00.043) 0:04:32.153 **** 2026-02-25 15:46:01.210066 | controller | skipping: [instance] 2026-02-25 15:46:01.258574 | controller | 2026-02-25 15:46:01.258592 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2026-02-25 15:46:01.258600 | controller | Wednesday 25 February 2026 15:46:01 +0000 (0:00:00.039) 0:04:32.192 **** 2026-02-25 15:46:01.258608 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:01.297682 | controller | 2026-02-25 15:46:01.297700 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2026-02-25 15:46:01.297708 | controller | Wednesday 25 February 2026 15:46:01 +0000 (0:00:00.048) 0:04:32.241 **** 2026-02-25 15:46:01.297716 | controller | skipping: [instance] 2026-02-25 15:46:01.335842 | controller | 2026-02-25 15:46:01.335875 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2026-02-25 15:46:01.335884 | controller | Wednesday 25 February 2026 15:46:01 +0000 (0:00:00.039) 0:04:32.280 **** 2026-02-25 15:46:01.335898 | controller | skipping: [instance] 2026-02-25 15:46:01.373009 | controller | 2026-02-25 15:46:01.373031 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2026-02-25 15:46:01.373039 | controller | Wednesday 25 February 2026 15:46:01 +0000 (0:00:00.037) 0:04:32.318 **** 2026-02-25 15:46:01.373048 | controller | skipping: [instance] 2026-02-25 15:46:01.934977 | controller | 2026-02-25 15:46:01.935011 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2026-02-25 15:46:01.935019 | controller | Wednesday 25 February 2026 15:46:01 +0000 (0:00:00.037) 0:04:32.355 **** 2026-02-25 15:46:01.935030 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:02.034224 | controller | 2026-02-25 15:46:02.034250 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2026-02-25 15:46:02.034259 | controller | Wednesday 25 February 2026 15:46:01 +0000 (0:00:00.561) 0:04:32.917 **** 2026-02-25 15:46:02.034269 | controller | skipping: [instance] => (item=secret) 2026-02-25 15:46:02.034489 | controller | skipping: [instance] => (item=configmap) 2026-02-25 15:46:02.034501 | controller | skipping: [instance] => (item=pod) 2026-02-25 15:46:02.034508 | controller | skipping: [instance] => (item=service) 2026-02-25 15:46:02.034514 | controller | skipping: [instance] => (item=route) 2026-02-25 15:46:02.034519 | controller | skipping: [instance] 2026-02-25 15:46:02.034525 | controller | 2026-02-25 15:46:02.034534 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2026-02-25 15:46:03.052438 | controller | Wednesday 25 February 2026 15:46:02 +0000 (0:00:00.099) 0:04:33.016 **** 2026-02-25 15:46:03.052483 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:04.002110 | controller | 2026-02-25 15:46:04.002153 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2026-02-25 15:46:04.002180 | controller | Wednesday 25 February 2026 15:46:03 +0000 (0:00:01.018) 0:04:34.034 **** 2026-02-25 15:46:04.002191 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:04.034990 | controller | 2026-02-25 15:46:04.035012 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2026-02-25 15:46:04.035020 | controller | Wednesday 25 February 2026 15:46:03 +0000 (0:00:00.949) 0:04:34.984 **** 2026-02-25 15:46:04.035031 | controller | skipping: [instance] 2026-02-25 15:46:04.067318 | controller | 2026-02-25 15:46:04.067339 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2026-02-25 15:46:04.067354 | controller | Wednesday 25 February 2026 15:46:04 +0000 (0:00:00.033) 0:04:35.017 **** 2026-02-25 15:46:04.067365 | controller | skipping: [instance] 2026-02-25 15:46:04.144328 | controller | 2026-02-25 15:46:04.144347 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2026-02-25 15:46:04.144354 | controller | Wednesday 25 February 2026 15:46:04 +0000 (0:00:00.032) 0:04:35.049 **** 2026-02-25 15:46:04.144363 | controller | skipping: [instance] => (item=secret) 2026-02-25 15:46:04.178840 | controller | skipping: [instance] => (item=configmap) 2026-02-25 15:46:04.178863 | controller | skipping: [instance] => (item=service) 2026-02-25 15:46:04.178870 | controller | skipping: [instance] => (item=route) 2026-02-25 15:46:04.178876 | controller | skipping: [instance] 2026-02-25 15:46:04.178882 | controller | 2026-02-25 15:46:04.178887 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2026-02-25 15:46:04.178893 | controller | Wednesday 25 February 2026 15:46:04 +0000 (0:00:00.076) 0:04:35.126 **** 2026-02-25 15:46:04.178901 | controller | skipping: [instance] 2026-02-25 15:46:05.646697 | controller | 2026-02-25 15:46:05.646731 | controller | TASK [podman : Ensure podman is installed] ************************************* 2026-02-25 15:46:05.646739 | controller | Wednesday 25 February 2026 15:46:04 +0000 (0:00:00.034) 0:04:35.161 **** 2026-02-25 15:46:05.646750 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:06.349514 | controller | 2026-02-25 15:46:06.349553 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2026-02-25 15:46:06.349582 | controller | Wednesday 25 February 2026 15:46:05 +0000 (0:00:01.467) 0:04:36.629 **** 2026-02-25 15:46:06.349597 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:06.397372 | controller | 2026-02-25 15:46:06.397393 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2026-02-25 15:46:06.397401 | controller | Wednesday 25 February 2026 15:46:06 +0000 (0:00:00.702) 0:04:37.331 **** 2026-02-25 15:46:06.397410 | controller | skipping: [instance] 2026-02-25 15:46:06.438551 | controller | 2026-02-25 15:46:06.438570 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2026-02-25 15:46:06.438578 | controller | Wednesday 25 February 2026 15:46:06 +0000 (0:00:00.048) 0:04:37.380 **** 2026-02-25 15:46:06.438586 | controller | skipping: [instance] 2026-02-25 15:46:06.485004 | controller | 2026-02-25 15:46:06.485022 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2026-02-25 15:46:06.485029 | controller | Wednesday 25 February 2026 15:46:06 +0000 (0:00:00.041) 0:04:37.421 **** 2026-02-25 15:46:06.485038 | controller | skipping: [instance] 2026-02-25 15:46:16.655079 | controller | 2026-02-25 15:46:16.655109 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2026-02-25 15:46:16.655117 | controller | Wednesday 25 February 2026 15:46:06 +0000 (0:00:00.046) 0:04:37.467 **** 2026-02-25 15:46:16.655127 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:17.984518 | controller | 2026-02-25 15:46:17.984550 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2026-02-25 15:46:17.984562 | controller | Wednesday 25 February 2026 15:46:16 +0000 (0:00:10.169) 0:04:47.637 **** 2026-02-25 15:46:17.984572 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:19.097200 | controller | 2026-02-25 15:46:19.097238 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-25 15:46:19.097246 | controller | Wednesday 25 February 2026 15:46:17 +0000 (0:00:01.329) 0:04:48.966 **** 2026-02-25 15:46:19.097257 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-25 15:46:19.135477 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-25 15:46:19.135505 | controller | 2026-02-25 15:46:19.135512 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2026-02-25 15:46:19.135517 | controller | Wednesday 25 February 2026 15:46:19 +0000 (0:00:01.112) 0:04:50.079 **** 2026-02-25 15:46:19.135525 | controller | skipping: [instance] 2026-02-25 15:46:19.654137 | controller | 2026-02-25 15:46:19.654190 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2026-02-25 15:46:19.654201 | controller | Wednesday 25 February 2026 15:46:19 +0000 (0:00:00.038) 0:04:50.118 **** 2026-02-25 15:46:19.654212 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:19.702767 | controller | 2026-02-25 15:46:19.702787 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2026-02-25 15:46:19.702795 | controller | Wednesday 25 February 2026 15:46:19 +0000 (0:00:00.518) 0:04:50.636 **** 2026-02-25 15:46:19.702805 | controller | skipping: [instance] 2026-02-25 15:46:19.753435 | controller | 2026-02-25 15:46:19.753452 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2026-02-25 15:46:19.753459 | controller | Wednesday 25 February 2026 15:46:19 +0000 (0:00:00.048) 0:04:50.685 **** 2026-02-25 15:46:19.753468 | controller | skipping: [instance] 2026-02-25 15:46:19.802874 | controller | 2026-02-25 15:46:19.802893 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-25 15:46:19.802900 | controller | Wednesday 25 February 2026 15:46:19 +0000 (0:00:00.050) 0:04:50.735 **** 2026-02-25 15:46:19.802909 | controller | skipping: [instance] 2026-02-25 15:46:19.839522 | controller | 2026-02-25 15:46:19.839541 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-25 15:46:19.839548 | controller | Wednesday 25 February 2026 15:46:19 +0000 (0:00:00.049) 0:04:50.785 **** 2026-02-25 15:46:19.839556 | controller | skipping: [instance] 2026-02-25 15:46:19.973015 | controller | 2026-02-25 15:46:19.973046 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2026-02-25 15:46:19.973054 | controller | Wednesday 25 February 2026 15:46:19 +0000 (0:00:00.036) 0:04:50.822 **** 2026-02-25 15:46:19.973065 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) 2026-02-25 15:46:20.950839 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) 2026-02-25 15:46:20.950868 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) 2026-02-25 15:46:20.950876 | controller | 2026-02-25 15:46:20.950882 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2026-02-25 15:46:20.950888 | controller | Wednesday 25 February 2026 15:46:19 +0000 (0:00:00.132) 0:04:50.955 **** 2026-02-25 15:46:20.950906 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:20.988939 | controller | 2026-02-25 15:46:20.988967 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2026-02-25 15:46:20.988976 | controller | Wednesday 25 February 2026 15:46:20 +0000 (0:00:00.978) 0:04:51.933 **** 2026-02-25 15:46:20.988986 | controller | skipping: [instance] 2026-02-25 15:46:21.128446 | controller | 2026-02-25 15:46:21.128491 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2026-02-25 15:46:21.128500 | controller | Wednesday 25 February 2026 15:46:20 +0000 (0:00:00.037) 0:04:51.971 **** 2026-02-25 15:46:21.128510 | controller | 2026-02-25 15:46:21.246746 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2026-02-25 15:46:21.246780 | controller | Wednesday 25 February 2026 15:46:21 +0000 (0:00:00.138) 0:04:52.109 **** 2026-02-25 15:46:21.246793 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:21.292239 | controller | 2026-02-25 15:46:21.292266 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-25 15:46:21.292275 | controller | Wednesday 25 February 2026 15:46:21 +0000 (0:00:00.119) 0:04:52.229 **** 2026-02-25 15:46:21.292285 | controller | skipping: [instance] 2026-02-25 15:46:21.341128 | controller | 2026-02-25 15:46:21.341174 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-25 15:46:21.341186 | controller | Wednesday 25 February 2026 15:46:21 +0000 (0:00:00.045) 0:04:52.274 **** 2026-02-25 15:46:21.341203 | controller | skipping: [instance] 2026-02-25 15:46:22.573278 | controller | 2026-02-25 15:46:22.573315 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2026-02-25 15:46:22.573325 | controller | Wednesday 25 February 2026 15:46:21 +0000 (0:00:00.048) 0:04:52.323 **** 2026-02-25 15:46:22.573339 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:22.573539 | controller | 2026-02-25 15:46:22.573554 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2026-02-25 15:46:22.573564 | controller | Wednesday 25 February 2026 15:46:22 +0000 (0:00:01.232) 0:04:53.555 **** 2026-02-25 15:46:29.928938 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1) 2026-02-25 15:46:30.025802 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b) 2026-02-25 15:46:30.025842 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282) 2026-02-25 15:46:30.025850 | controller | 2026-02-25 15:46:30.025856 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2026-02-25 15:46:30.025862 | controller | Wednesday 25 February 2026 15:46:29 +0000 (0:00:07.355) 0:05:00.910 **** 2026-02-25 15:46:30.025876 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2026-02-25 15:46:30.260774 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2026-02-25 15:46:30.260800 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2026-02-25 15:46:30.260809 | controller | 2026-02-25 15:46:30.260816 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2026-02-25 15:46:30.260822 | controller | Wednesday 25 February 2026 15:46:30 +0000 (0:00:00.097) 0:05:01.008 **** 2026-02-25 15:46:30.260833 | controller | ok: [instance -> localhost] 2026-02-25 15:46:32.370625 | controller | 2026-02-25 15:46:32.370658 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2026-02-25 15:46:32.370666 | controller | Wednesday 25 February 2026 15:46:30 +0000 (0:00:00.230) 0:05:01.239 **** 2026-02-25 15:46:32.370677 | controller | changed: [instance -> localhost] => (item=controller-0) 2026-02-25 15:46:33.022891 | controller | 2026-02-25 15:46:33.022923 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2026-02-25 15:46:33.022930 | controller | Wednesday 25 February 2026 15:46:32 +0000 (0:00:02.113) 0:05:03.352 **** 2026-02-25 15:46:33.022940 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:33.894051 | controller | 2026-02-25 15:46:33.894088 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2026-02-25 15:46:33.894097 | controller | Wednesday 25 February 2026 15:46:33 +0000 (0:00:00.652) 0:05:04.005 **** 2026-02-25 15:46:33.894107 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:35.134188 | controller | 2026-02-25 15:46:35.134221 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2026-02-25 15:46:35.134228 | controller | Wednesday 25 February 2026 15:46:33 +0000 (0:00:00.871) 0:05:04.876 **** 2026-02-25 15:46:35.134238 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:35.818982 | controller | 2026-02-25 15:46:35.819014 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2026-02-25 15:46:35.819023 | controller | Wednesday 25 February 2026 15:46:35 +0000 (0:00:01.239) 0:05:06.116 **** 2026-02-25 15:46:35.819033 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:36.880854 | controller | 2026-02-25 15:46:36.880887 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2026-02-25 15:46:36.880894 | controller | Wednesday 25 February 2026 15:46:35 +0000 (0:00:00.685) 0:05:06.801 **** 2026-02-25 15:46:36.880904 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:37.483952 | controller | 2026-02-25 15:46:37.483984 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2026-02-25 15:46:37.483996 | controller | Wednesday 25 February 2026 15:46:36 +0000 (0:00:01.061) 0:05:07.863 **** 2026-02-25 15:46:37.484007 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:38.112778 | controller | 2026-02-25 15:46:38.112815 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2026-02-25 15:46:38.112823 | controller | Wednesday 25 February 2026 15:46:37 +0000 (0:00:00.602) 0:05:08.466 **** 2026-02-25 15:46:38.112834 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:39.590967 | controller | 2026-02-25 15:46:39.590999 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2026-02-25 15:46:39.591007 | controller | Wednesday 25 February 2026 15:46:38 +0000 (0:00:00.628) 0:05:09.094 **** 2026-02-25 15:46:39.591017 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-25 15:46:39.625631 | controller | 2026-02-25 15:46:39.625656 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-25 15:46:39.625664 | controller | Wednesday 25 February 2026 15:46:39 +0000 (0:00:01.478) 0:05:10.573 **** 2026-02-25 15:46:39.625674 | controller | skipping: [instance] 2026-02-25 15:46:39.661956 | controller | 2026-02-25 15:46:39.661977 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-25 15:46:39.661984 | controller | Wednesday 25 February 2026 15:46:39 +0000 (0:00:00.034) 0:05:10.608 **** 2026-02-25 15:46:39.661993 | controller | skipping: [instance] 2026-02-25 15:46:39.700201 | controller | 2026-02-25 15:46:39.700221 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-25 15:46:39.700229 | controller | Wednesday 25 February 2026 15:46:39 +0000 (0:00:00.036) 0:05:10.644 **** 2026-02-25 15:46:39.700238 | controller | skipping: [instance] 2026-02-25 15:46:39.735748 | controller | 2026-02-25 15:46:39.735768 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-25 15:46:39.735775 | controller | Wednesday 25 February 2026 15:46:39 +0000 (0:00:00.038) 0:05:10.682 **** 2026-02-25 15:46:39.735784 | controller | skipping: [instance] 2026-02-25 15:46:39.772288 | controller | 2026-02-25 15:46:39.772306 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-25 15:46:39.772317 | controller | Wednesday 25 February 2026 15:46:39 +0000 (0:00:00.035) 0:05:10.718 **** 2026-02-25 15:46:39.772326 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:39.884852 | controller | 2026-02-25 15:46:39.884878 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-25 15:46:39.884886 | controller | Wednesday 25 February 2026 15:46:39 +0000 (0:00:00.036) 0:05:10.755 **** 2026-02-25 15:46:39.884904 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-25 15:46:39.929385 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2026-02-25 15:46:39.929404 | controller | 2026-02-25 15:46:39.929411 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-25 15:46:39.929417 | controller | Wednesday 25 February 2026 15:46:39 +0000 (0:00:00.112) 0:05:10.867 **** 2026-02-25 15:46:39.929425 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2026-02-25 15:46:43.411087 | controller | 2026-02-25 15:46:43.411126 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2026-02-25 15:46:43.411137 | controller | Wednesday 25 February 2026 15:46:39 +0000 (0:00:00.044) 0:05:10.912 **** 2026-02-25 15:46:43.411151 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-25 15:46:44.503547 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2026-02-25 15:46:44.503580 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-25 15:46:44.503587 | controller | 2026-02-25 15:46:44.503593 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2026-02-25 15:46:44.503599 | controller | Wednesday 25 February 2026 15:46:43 +0000 (0:00:03.480) 0:05:14.393 **** 2026-02-25 15:46:44.503608 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:45.002178 | controller | 2026-02-25 15:46:45.002214 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-25 15:46:45.002222 | controller | Wednesday 25 February 2026 15:46:44 +0000 (0:00:01.092) 0:05:15.485 **** 2026-02-25 15:46:45.002244 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:45.002265 | controller | 2026-02-25 15:46:45.002270 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-25 15:46:45.002277 | controller | Wednesday 25 February 2026 15:46:44 +0000 (0:00:00.498) 0:05:15.984 **** 2026-02-25 15:46:45.963486 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:45.963545 | controller | 2026-02-25 15:46:45.963650 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-25 15:46:45.963739 | controller | Wednesday 25 February 2026 15:46:45 +0000 (0:00:00.961) 0:05:16.946 **** 2026-02-25 15:46:46.069237 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:46.125286 | controller | 2026-02-25 15:46:46.125319 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-25 15:46:46.125328 | controller | Wednesday 25 February 2026 15:46:46 +0000 (0:00:00.105) 0:05:17.051 **** 2026-02-25 15:46:46.125338 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:46.125609 | controller | 2026-02-25 15:46:46.125624 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-25 15:46:47.105716 | controller | Wednesday 25 February 2026 15:46:46 +0000 (0:00:00.056) 0:05:17.107 **** 2026-02-25 15:46:47.105758 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:48.052175 | controller | 2026-02-25 15:46:48.052208 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2026-02-25 15:46:48.052223 | controller | Wednesday 25 February 2026 15:46:47 +0000 (0:00:00.980) 0:05:18.087 **** 2026-02-25 15:46:48.052233 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:54.347995 | controller | 2026-02-25 15:46:54.348033 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2026-02-25 15:46:54.348041 | controller | Wednesday 25 February 2026 15:46:48 +0000 (0:00:00.946) 0:05:19.034 **** 2026-02-25 15:46:54.348051 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2026-02-25 15:46:54.547914 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:54.547945 | controller | 2026-02-25 15:46:54.547954 | controller | TASK [Configure ntp service] *************************************************** 2026-02-25 15:46:54.547960 | controller | Wednesday 25 February 2026 15:46:54 +0000 (0:00:06.295) 0:05:25.330 **** 2026-02-25 15:46:54.547970 | controller | 2026-02-25 15:46:55.641818 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2026-02-25 15:46:55.641850 | controller | Wednesday 25 February 2026 15:46:54 +0000 (0:00:00.200) 0:05:25.530 **** 2026-02-25 15:46:55.641862 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:56.655048 | controller | 2026-02-25 15:46:56.655077 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2026-02-25 15:46:56.655085 | controller | Wednesday 25 February 2026 15:46:55 +0000 (0:00:01.093) 0:05:26.624 **** 2026-02-25 15:46:56.655095 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2026-02-25 15:46:57.609880 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2026-02-25 15:46:57.609918 | controller | 2026-02-25 15:46:57.609926 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2026-02-25 15:46:57.609932 | controller | Wednesday 25 February 2026 15:46:56 +0000 (0:00:01.013) 0:05:27.637 **** 2026-02-25 15:46:57.609947 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:58.248689 | controller | 2026-02-25 15:46:58.248723 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2026-02-25 15:46:58.248731 | controller | Wednesday 25 February 2026 15:46:57 +0000 (0:00:00.954) 0:05:28.592 **** 2026-02-25 15:46:58.248741 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:58.391263 | controller | 2026-02-25 15:46:58.391294 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2026-02-25 15:46:58.391305 | controller | Wednesday 25 February 2026 15:46:58 +0000 (0:00:00.638) 0:05:29.231 **** 2026-02-25 15:46:58.391318 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2026-02-25 15:46:58.836460 | controller | 2026-02-25 15:46:58.836502 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2026-02-25 15:46:58.836511 | controller | Wednesday 25 February 2026 15:46:58 +0000 (0:00:00.142) 0:05:29.373 **** 2026-02-25 15:46:58.836523 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:46:59.355149 | controller | 2026-02-25 15:46:59.355194 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2026-02-25 15:46:59.355202 | controller | Wednesday 25 February 2026 15:46:58 +0000 (0:00:00.445) 0:05:29.818 **** 2026-02-25 15:46:59.355221 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-25 15:47:00.116033 | controller | 2026-02-25 15:47:00.116065 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2026-02-25 15:47:00.116073 | controller | Wednesday 25 February 2026 15:46:59 +0000 (0:00:00.518) 0:05:30.337 **** 2026-02-25 15:47:00.116082 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-25 15:47:00.693674 | controller | 2026-02-25 15:47:00.693722 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2026-02-25 15:47:00.693745 | controller | Wednesday 25 February 2026 15:47:00 +0000 (0:00:00.760) 0:05:31.098 **** 2026-02-25 15:47:00.693756 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-25 15:47:00.748815 | controller | 2026-02-25 15:47:00.748838 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2026-02-25 15:47:00.748846 | controller | Wednesday 25 February 2026 15:47:00 +0000 (0:00:00.577) 0:05:31.675 **** 2026-02-25 15:47:00.748856 | controller | 2026-02-25 15:47:01.219567 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2026-02-25 15:47:01.219605 | controller | Wednesday 25 February 2026 15:47:00 +0000 (0:00:00.055) 0:05:31.731 **** 2026-02-25 15:47:01.219617 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-25 15:47:01.962943 | controller | 2026-02-25 15:47:01.962973 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2026-02-25 15:47:01.962980 | controller | Wednesday 25 February 2026 15:47:01 +0000 (0:00:00.470) 0:05:32.201 **** 2026-02-25 15:47:01.962990 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-25 15:47:01.994089 | controller | 2026-02-25 15:47:01.994110 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2026-02-25 15:47:01.994117 | controller | Wednesday 25 February 2026 15:47:01 +0000 (0:00:00.743) 0:05:32.945 **** 2026-02-25 15:47:01.994126 | controller | skipping: [instance] 2026-02-25 15:47:02.033093 | controller | 2026-02-25 15:47:02.033116 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2026-02-25 15:47:02.033124 | controller | Wednesday 25 February 2026 15:47:01 +0000 (0:00:00.031) 0:05:32.976 **** 2026-02-25 15:47:02.033133 | controller | skipping: [instance] 2026-02-25 15:47:02.289125 | controller | 2026-02-25 15:47:02.289176 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2026-02-25 15:47:02.289188 | controller | Wednesday 25 February 2026 15:47:02 +0000 (0:00:00.038) 0:05:33.015 **** 2026-02-25 15:47:02.289199 | controller | changed: [instance] 2026-02-25 15:47:02.364808 | controller | 2026-02-25 15:47:02.364829 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2026-02-25 15:47:02.364837 | controller | Wednesday 25 February 2026 15:47:02 +0000 (0:00:00.255) 0:05:33.271 **** 2026-02-25 15:47:02.364845 | controller | skipping: [instance] => (item=) 2026-02-25 15:47:02.399270 | controller | 2026-02-25 15:47:02.399290 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2026-02-25 15:47:02.399297 | controller | Wednesday 25 February 2026 15:47:02 +0000 (0:00:00.075) 0:05:33.347 **** 2026-02-25 15:47:02.399306 | controller | ok: [instance] 2026-02-25 15:47:02.489899 | controller | 2026-02-25 15:47:02.489919 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-25 15:47:02.489927 | controller | Wednesday 25 February 2026 15:47:02 +0000 (0:00:00.034) 0:05:33.381 **** 2026-02-25 15:47:02.489936 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-25 15:47:02.773017 | controller | 2026-02-25 15:47:02.773050 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-25 15:47:02.773063 | controller | Wednesday 25 February 2026 15:47:02 +0000 (0:00:00.090) 0:05:33.472 **** 2026-02-25 15:47:02.773074 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-25 15:47:02.826732 | controller | 2026-02-25 15:47:02.826756 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2026-02-25 15:47:02.826764 | controller | Wednesday 25 February 2026 15:47:02 +0000 (0:00:00.282) 0:05:33.755 **** 2026-02-25 15:47:02.826774 | controller | 2026-02-25 15:47:02.897686 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-25 15:47:02.897713 | controller | Wednesday 25 February 2026 15:47:02 +0000 (0:00:00.053) 0:05:33.809 **** 2026-02-25 15:47:02.897726 | controller | ok: [instance] 2026-02-25 15:47:02.967071 | controller | 2026-02-25 15:47:02.967096 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-25 15:47:02.967104 | controller | Wednesday 25 February 2026 15:47:02 +0000 (0:00:00.070) 0:05:33.880 **** 2026-02-25 15:47:02.967120 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-25 15:47:03.249797 | controller | 2026-02-25 15:47:03.249832 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-25 15:47:03.249840 | controller | Wednesday 25 February 2026 15:47:02 +0000 (0:00:00.069) 0:05:33.949 **** 2026-02-25 15:47:03.249851 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-25 15:47:03.327657 | controller | 2026-02-25 15:47:03.327684 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-25 15:47:03.327692 | controller | Wednesday 25 February 2026 15:47:03 +0000 (0:00:00.281) 0:05:34.231 **** 2026-02-25 15:47:03.327710 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-25 15:47:03.751639 | controller | skipping: [instance] 2026-02-25 15:47:03.751672 | controller | 2026-02-25 15:47:03.751680 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2026-02-25 15:47:03.751687 | controller | Wednesday 25 February 2026 15:47:03 +0000 (0:00:00.077) 0:05:34.309 **** 2026-02-25 15:47:03.751697 | controller | changed: [instance] 2026-02-25 15:47:03.751939 | controller | 2026-02-25 15:47:03.751953 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-25 15:47:03.752228 | controller | Wednesday 25 February 2026 15:47:03 +0000 (0:00:00.402) 0:05:34.712 **** 2026-02-25 15:47:03.752244 | controller | 2026-02-25 15:47:04.492877 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2026-02-25 15:47:04.492909 | controller | Wednesday 25 February 2026 15:47:03 +0000 (0:00:00.021) 0:05:34.733 **** 2026-02-25 15:47:04.492921 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:04.913896 | controller | 2026-02-25 15:47:04.913936 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-25 15:47:04.913945 | controller | Wednesday 25 February 2026 15:47:04 +0000 (0:00:00.741) 0:05:35.475 **** 2026-02-25 15:47:04.913956 | controller | changed: [instance] 2026-02-25 15:47:04.913974 | controller | 2026-02-25 15:47:04.913982 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2026-02-25 15:47:04.914055 | controller | Wednesday 25 February 2026 15:47:04 +0000 (0:00:00.420) 0:05:35.896 **** 2026-02-25 15:47:05.107725 | controller | skipping: [instance] => (item=controller-0) 2026-02-25 15:47:05.107834 | controller | skipping: [instance] => (item=crc-0) 2026-02-25 15:47:05.107940 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2026-02-25 15:47:05.108011 | controller | 2026-02-25 15:47:05.108107 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2026-02-25 15:47:05.108221 | controller | Wednesday 25 February 2026 15:47:05 +0000 (0:00:00.194) 0:05:36.090 **** 2026-02-25 15:47:06.607351 | controller | changed: [instance -> compute-0(compute-0.instance)] 2026-02-25 15:47:06.607404 | controller | 2026-02-25 15:47:06.607482 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-25 15:47:06.607584 | controller | Wednesday 25 February 2026 15:47:06 +0000 (0:00:01.499) 0:05:37.589 **** 2026-02-25 15:47:06.628133 | controller | skipping: [instance] 2026-02-25 15:47:06.628257 | controller | 2026-02-25 15:47:06.628369 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-25 15:47:06.628474 | controller | Wednesday 25 February 2026 15:47:06 +0000 (0:00:00.021) 0:05:37.611 **** 2026-02-25 15:47:07.179411 | controller | ok: [instance -> compute-0(compute-0.instance)] 2026-02-25 15:47:07.179460 | controller | 2026-02-25 15:47:07.179561 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-25 15:47:07.179660 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.550) 0:05:38.162 **** 2026-02-25 15:47:07.227001 | controller | skipping: [instance] 2026-02-25 15:47:07.227072 | controller | 2026-02-25 15:47:07.227184 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-25 15:47:07.227281 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.047) 0:05:38.209 **** 2026-02-25 15:47:07.266710 | controller | skipping: [instance] 2026-02-25 15:47:07.266846 | controller | 2026-02-25 15:47:07.266960 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-25 15:47:07.267075 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.039) 0:05:38.249 **** 2026-02-25 15:47:07.304035 | controller | skipping: [instance] 2026-02-25 15:47:07.304114 | controller | 2026-02-25 15:47:07.304244 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-25 15:47:07.304338 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.037) 0:05:38.287 **** 2026-02-25 15:47:07.348890 | controller | skipping: [instance] 2026-02-25 15:47:07.348983 | controller | 2026-02-25 15:47:07.349098 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2026-02-25 15:47:07.349229 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.044) 0:05:38.331 **** 2026-02-25 15:47:07.383296 | controller | skipping: [instance] 2026-02-25 15:47:07.383382 | controller | 2026-02-25 15:47:07.383491 | controller | TASK [reproducer : Create repositories on computes] **************************** 2026-02-25 15:47:07.383603 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.034) 0:05:38.366 **** 2026-02-25 15:47:07.402734 | controller | skipping: [instance] 2026-02-25 15:47:07.403331 | controller | 2026-02-25 15:47:07.433223 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2026-02-25 15:47:07.433256 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.019) 0:05:38.385 **** 2026-02-25 15:47:07.433271 | controller | skipping: [instance] 2026-02-25 15:47:07.433297 | controller | 2026-02-25 15:47:07.433387 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2026-02-25 15:47:07.433475 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.030) 0:05:38.416 **** 2026-02-25 15:47:07.488617 | controller | ok: [instance] 2026-02-25 15:47:07.488697 | controller | 2026-02-25 15:47:07.488812 | controller | TASK [reproducer : Push local code] ******************************************** 2026-02-25 15:47:07.488923 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.055) 0:05:38.471 **** 2026-02-25 15:47:07.583059 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2026-02-25 15:47:07.583195 | controller | 2026-02-25 15:47:07.583376 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2026-02-25 15:47:07.583516 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.094) 0:05:38.566 **** 2026-02-25 15:47:07.623121 | controller | skipping: [instance] 2026-02-25 15:47:07.623358 | controller | 2026-02-25 15:47:07.623403 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2026-02-25 15:47:07.623417 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.040) 0:05:38.606 **** 2026-02-25 15:47:07.664279 | controller | skipping: [instance] 2026-02-25 15:47:07.664518 | controller | 2026-02-25 15:47:07.664559 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2026-02-25 15:47:07.704734 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.040) 0:05:38.647 **** 2026-02-25 15:47:07.704755 | controller | skipping: [instance] 2026-02-25 15:47:07.740561 | controller | 2026-02-25 15:47:07.740630 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2026-02-25 15:47:07.740640 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.039) 0:05:38.686 **** 2026-02-25 15:47:07.740654 | controller | skipping: [instance] 2026-02-25 15:47:07.740696 | controller | 2026-02-25 15:47:07.740709 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2026-02-25 15:47:07.773516 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.036) 0:05:38.723 **** 2026-02-25 15:47:07.773551 | controller | skipping: [instance] 2026-02-25 15:47:08.263309 | controller | 2026-02-25 15:47:08.263392 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2026-02-25 15:47:08.263417 | controller | Wednesday 25 February 2026 15:47:07 +0000 (0:00:00.032) 0:05:38.756 **** 2026-02-25 15:47:08.263437 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2026-02-25 15:47:08.840542 | controller | 2026-02-25 15:47:08.840579 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2026-02-25 15:47:08.840587 | controller | Wednesday 25 February 2026 15:47:08 +0000 (0:00:00.489) 0:05:39.245 **** 2026-02-25 15:47:08.840597 | controller | ok: [instance -> localhost] => (item=ci-framework) 2026-02-25 15:47:08.840622 | controller | 2026-02-25 15:47:08.840870 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2026-02-25 15:47:08.907759 | controller | Wednesday 25 February 2026 15:47:08 +0000 (0:00:00.575) 0:05:39.821 **** 2026-02-25 15:47:08.907782 | controller | skipping: [instance] => (item=ci-framework) 2026-02-25 15:47:08.994917 | controller | skipping: [instance] 2026-02-25 15:47:08.994938 | controller | 2026-02-25 15:47:08.994945 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2026-02-25 15:47:08.994951 | controller | Wednesday 25 February 2026 15:47:08 +0000 (0:00:00.068) 0:05:39.889 **** 2026-02-25 15:47:08.994960 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2026-02-25 15:47:09.468900 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2026-02-25 15:47:09.468950 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2026-02-25 15:47:09.468958 | controller | 2026-02-25 15:47:09.468964 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2026-02-25 15:47:09.468977 | controller | Wednesday 25 February 2026 15:47:08 +0000 (0:00:00.087) 0:05:39.977 **** 2026-02-25 15:47:09.468988 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:09.469006 | controller | 2026-02-25 15:47:09.469013 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2026-02-25 15:47:09.469020 | controller | Wednesday 25 February 2026 15:47:09 +0000 (0:00:00.473) 0:05:40.451 **** 2026-02-25 15:47:09.521296 | controller | skipping: [instance] 2026-02-25 15:47:09.521394 | controller | 2026-02-25 15:47:09.521423 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2026-02-25 15:47:09.521435 | controller | Wednesday 25 February 2026 15:47:09 +0000 (0:00:00.052) 0:05:40.503 **** 2026-02-25 15:47:10.027508 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:10.027566 | controller | 2026-02-25 15:47:10.027578 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2026-02-25 15:47:10.027651 | controller | Wednesday 25 February 2026 15:47:10 +0000 (0:00:00.505) 0:05:41.009 **** 2026-02-25 15:47:10.073536 | controller | skipping: [instance] 2026-02-25 15:47:10.073618 | controller | 2026-02-25 15:47:10.073711 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2026-02-25 15:47:10.073800 | controller | Wednesday 25 February 2026 15:47:10 +0000 (0:00:00.046) 0:05:41.056 **** 2026-02-25 15:47:10.531055 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:10.531107 | controller | 2026-02-25 15:47:10.531216 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2026-02-25 15:47:10.531305 | controller | Wednesday 25 February 2026 15:47:10 +0000 (0:00:00.457) 0:05:41.513 **** 2026-02-25 15:47:12.826834 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:12.826884 | controller | 2026-02-25 15:47:12.826977 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2026-02-25 15:47:12.827063 | controller | Wednesday 25 February 2026 15:47:12 +0000 (0:00:02.295) 0:05:43.809 **** 2026-02-25 15:47:32.713592 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:32.713721 | controller | 2026-02-25 15:47:32.713730 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2026-02-25 15:47:32.713743 | controller | Wednesday 25 February 2026 15:47:32 +0000 (0:00:19.886) 0:06:03.695 **** 2026-02-25 15:47:33.641710 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:33.737810 | controller | 2026-02-25 15:47:33.737845 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2026-02-25 15:47:33.737854 | controller | Wednesday 25 February 2026 15:47:33 +0000 (0:00:00.928) 0:06:04.624 **** 2026-02-25 15:47:33.737866 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2026-02-25 15:47:33.738068 | controller | 2026-02-25 15:47:33.738088 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2026-02-25 15:47:34.172190 | controller | Wednesday 25 February 2026 15:47:33 +0000 (0:00:00.096) 0:06:04.720 **** 2026-02-25 15:47:34.172232 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:34.172308 | controller | 2026-02-25 15:47:34.172318 | controller | TASK [reproducer : Rotate log if present] ************************************** 2026-02-25 15:47:34.172406 | controller | Wednesday 25 February 2026 15:47:34 +0000 (0:00:00.434) 0:06:05.154 **** 2026-02-25 15:47:34.207705 | controller | skipping: [instance] 2026-02-25 15:47:34.207790 | controller | 2026-02-25 15:47:34.207899 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2026-02-25 15:47:34.208005 | controller | Wednesday 25 February 2026 15:47:34 +0000 (0:00:00.035) 0:06:05.190 **** 2026-02-25 15:47:34.249843 | controller | skipping: [instance] 2026-02-25 15:47:34.249939 | controller | 2026-02-25 15:47:34.250056 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2026-02-25 15:47:34.250193 | controller | Wednesday 25 February 2026 15:47:34 +0000 (0:00:00.042) 0:06:05.232 **** 2026-02-25 15:47:34.341638 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:34.341737 | controller | 2026-02-25 15:47:34.341849 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-25 15:47:34.341960 | controller | Wednesday 25 February 2026 15:47:34 +0000 (0:00:00.091) 0:06:05.324 **** 2026-02-25 15:47:34.787675 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:34.787732 | controller | 2026-02-25 15:47:34.787842 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-25 15:47:34.787950 | controller | Wednesday 25 February 2026 15:47:34 +0000 (0:00:00.445) 0:06:05.770 **** 2026-02-25 15:47:34.827977 | controller | skipping: [instance] 2026-02-25 15:47:34.828048 | controller | 2026-02-25 15:47:34.828147 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-25 15:47:34.828268 | controller | Wednesday 25 February 2026 15:47:34 +0000 (0:00:00.040) 0:06:05.810 **** 2026-02-25 15:47:34.863871 | controller | skipping: [instance] 2026-02-25 15:47:34.863936 | controller | 2026-02-25 15:47:34.864036 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-25 15:47:34.864133 | controller | Wednesday 25 February 2026 15:47:34 +0000 (0:00:00.036) 0:06:05.846 **** 2026-02-25 15:47:34.901379 | controller | skipping: [instance] 2026-02-25 15:47:34.901471 | controller | 2026-02-25 15:47:34.901589 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-25 15:47:34.901725 | controller | Wednesday 25 February 2026 15:47:34 +0000 (0:00:00.037) 0:06:05.884 **** 2026-02-25 15:47:34.942697 | controller | skipping: [instance] 2026-02-25 15:47:34.942767 | controller | 2026-02-25 15:47:34.942861 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-25 15:47:34.942946 | controller | Wednesday 25 February 2026 15:47:34 +0000 (0:00:00.041) 0:06:05.925 **** 2026-02-25 15:47:36.214320 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:47:37.112851 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:47:37.112890 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:47:37.112903 | controller | changed: [instance -> controller-0] 2026-02-25 15:47:37.112910 | controller | 2026-02-25 15:47:37.112916 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-25 15:47:37.112922 | controller | Wednesday 25 February 2026 15:47:36 +0000 (0:00:01.270) 0:06:07.196 **** 2026-02-25 15:47:37.112933 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:38.391474 | controller | 2026-02-25 15:47:38.391532 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-25 15:47:38.391543 | controller | Wednesday 25 February 2026 15:47:37 +0000 (0:00:00.898) 0:06:08.095 **** 2026-02-25 15:47:38.391558 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:38.391596 | controller | 2026-02-25 15:47:38.391785 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-25 15:47:45.746149 | controller | Wednesday 25 February 2026 15:47:38 +0000 (0:00:01.278) 0:06:09.374 **** 2026-02-25 15:47:45.746221 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:46.671636 | controller | 2026-02-25 15:47:46.671681 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-25 15:47:46.671690 | controller | Wednesday 25 February 2026 15:47:45 +0000 (0:00:07.354) 0:06:16.728 **** 2026-02-25 15:47:46.671703 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:46.671726 | controller | 2026-02-25 15:47:46.671733 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-25 15:47:46.671740 | controller | Wednesday 25 February 2026 15:47:46 +0000 (0:00:00.925) 0:06:17.654 **** 2026-02-25 15:47:46.708583 | controller | skipping: [instance] 2026-02-25 15:47:47.786759 | controller | 2026-02-25 15:47:47.786796 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-25 15:47:47.786805 | controller | Wednesday 25 February 2026 15:47:46 +0000 (0:00:00.037) 0:06:17.691 **** 2026-02-25 15:47:47.786815 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:47.834656 | controller | 2026-02-25 15:47:47.834690 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-25 15:47:47.834698 | controller | Wednesday 25 February 2026 15:47:47 +0000 (0:00:01.077) 0:06:18.769 **** 2026-02-25 15:47:47.834708 | controller | skipping: [instance] 2026-02-25 15:47:47.884801 | controller | 2026-02-25 15:47:47.884828 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-25 15:47:47.884836 | controller | Wednesday 25 February 2026 15:47:47 +0000 (0:00:00.048) 0:06:18.817 **** 2026-02-25 15:47:47.884852 | controller | skipping: [instance] 2026-02-25 15:47:47.884870 | controller | 2026-02-25 15:47:47.884878 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-25 15:47:47.884967 | controller | Wednesday 25 February 2026 15:47:47 +0000 (0:00:00.050) 0:06:18.867 **** 2026-02-25 15:47:47.935070 | controller | skipping: [instance] 2026-02-25 15:47:47.935134 | controller | 2026-02-25 15:47:47.935267 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-25 15:47:47.935384 | controller | Wednesday 25 February 2026 15:47:47 +0000 (0:00:00.050) 0:06:18.917 **** 2026-02-25 15:47:48.751304 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:48.751355 | controller | 2026-02-25 15:47:48.751447 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-25 15:47:48.751540 | controller | Wednesday 25 February 2026 15:47:48 +0000 (0:00:00.816) 0:06:19.733 **** 2026-02-25 15:47:49.567153 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:49.567294 | controller | 2026-02-25 15:47:49.567350 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-25 15:47:49.567443 | controller | Wednesday 25 February 2026 15:47:49 +0000 (0:00:00.815) 0:06:20.549 **** 2026-02-25 15:47:49.606129 | controller | skipping: [instance] 2026-02-25 15:47:49.649140 | controller | 2026-02-25 15:47:49.649182 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-25 15:47:49.649204 | controller | Wednesday 25 February 2026 15:47:49 +0000 (0:00:00.039) 0:06:20.588 **** 2026-02-25 15:47:49.649216 | controller | skipping: [instance] 2026-02-25 15:47:49.649244 | controller | 2026-02-25 15:47:49.649251 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-25 15:47:49.649258 | controller | Wednesday 25 February 2026 15:47:49 +0000 (0:00:00.042) 0:06:20.631 **** 2026-02-25 15:47:49.686249 | controller | skipping: [instance] 2026-02-25 15:47:49.686291 | controller | 2026-02-25 15:47:49.686487 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-25 15:47:49.686576 | controller | Wednesday 25 February 2026 15:47:49 +0000 (0:00:00.037) 0:06:20.669 **** 2026-02-25 15:47:49.736968 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:49.773222 | controller | 2026-02-25 15:47:49.773262 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-25 15:47:49.773271 | controller | Wednesday 25 February 2026 15:47:49 +0000 (0:00:00.050) 0:06:20.719 **** 2026-02-25 15:47:49.773282 | controller | skipping: [instance] 2026-02-25 15:47:49.773312 | controller | 2026-02-25 15:47:49.773319 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-25 15:47:49.773326 | controller | Wednesday 25 February 2026 15:47:49 +0000 (0:00:00.036) 0:06:20.755 **** 2026-02-25 15:47:49.809717 | controller | skipping: [instance] 2026-02-25 15:47:49.845627 | controller | 2026-02-25 15:47:49.845645 | controller | TASK [Download the RPM] ******************************************************** 2026-02-25 15:47:49.845652 | controller | Wednesday 25 February 2026 15:47:49 +0000 (0:00:00.036) 0:06:20.792 **** 2026-02-25 15:47:49.845661 | controller | skipping: [instance] 2026-02-25 15:47:49.881369 | controller | 2026-02-25 15:47:49.881387 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-25 15:47:49.881395 | controller | Wednesday 25 February 2026 15:47:49 +0000 (0:00:00.036) 0:06:20.828 **** 2026-02-25 15:47:49.881403 | controller | skipping: [instance] 2026-02-25 15:47:49.881552 | controller | 2026-02-25 15:47:49.881690 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-25 15:47:49.881820 | controller | Wednesday 25 February 2026 15:47:49 +0000 (0:00:00.036) 0:06:20.864 **** 2026-02-25 15:47:49.919381 | controller | skipping: [instance] 2026-02-25 15:47:49.919545 | controller | 2026-02-25 15:47:49.919696 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-25 15:47:49.919826 | controller | Wednesday 25 February 2026 15:47:49 +0000 (0:00:00.037) 0:06:20.902 **** 2026-02-25 15:47:49.958773 | controller | skipping: [instance] 2026-02-25 15:47:49.958903 | controller | 2026-02-25 15:47:49.959029 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-25 15:47:49.959151 | controller | Wednesday 25 February 2026 15:47:49 +0000 (0:00:00.039) 0:06:20.941 **** 2026-02-25 15:47:49.993936 | controller | skipping: [instance] 2026-02-25 15:47:49.994129 | controller | 2026-02-25 15:47:49.994329 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-25 15:47:49.994483 | controller | Wednesday 25 February 2026 15:47:49 +0000 (0:00:00.035) 0:06:20.976 **** 2026-02-25 15:47:50.434130 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:50.434329 | controller | 2026-02-25 15:47:50.434466 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-25 15:47:50.434616 | controller | Wednesday 25 February 2026 15:47:50 +0000 (0:00:00.439) 0:06:21.416 **** 2026-02-25 15:47:50.481242 | controller | skipping: [instance] 2026-02-25 15:47:50.529670 | controller | 2026-02-25 15:47:50.529704 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-25 15:47:50.529713 | controller | Wednesday 25 February 2026 15:47:50 +0000 (0:00:00.047) 0:06:21.463 **** 2026-02-25 15:47:50.529724 | controller | skipping: [instance] 2026-02-25 15:47:50.529749 | controller | 2026-02-25 15:47:50.529757 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-25 15:47:50.529882 | controller | Wednesday 25 February 2026 15:47:50 +0000 (0:00:00.048) 0:06:21.512 **** 2026-02-25 15:47:50.566953 | controller | skipping: [instance] 2026-02-25 15:47:50.614410 | controller | 2026-02-25 15:47:50.614432 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-25 15:47:50.614442 | controller | Wednesday 25 February 2026 15:47:50 +0000 (0:00:00.037) 0:06:21.549 **** 2026-02-25 15:47:50.614454 | controller | skipping: [instance] 2026-02-25 15:47:50.664605 | controller | 2026-02-25 15:47:50.664625 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-25 15:47:50.664633 | controller | Wednesday 25 February 2026 15:47:50 +0000 (0:00:00.047) 0:06:21.596 **** 2026-02-25 15:47:50.664641 | controller | skipping: [instance] 2026-02-25 15:47:50.710832 | controller | 2026-02-25 15:47:50.710885 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-25 15:47:50.710898 | controller | Wednesday 25 February 2026 15:47:50 +0000 (0:00:00.050) 0:06:21.647 **** 2026-02-25 15:47:50.710913 | controller | skipping: [instance] 2026-02-25 15:47:50.711023 | controller | 2026-02-25 15:47:50.711036 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-25 15:47:50.711056 | controller | Wednesday 25 February 2026 15:47:50 +0000 (0:00:00.046) 0:06:21.693 **** 2026-02-25 15:47:50.753992 | controller | skipping: [instance] 2026-02-25 15:47:50.754111 | controller | 2026-02-25 15:47:50.754363 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-25 15:47:50.800945 | controller | Wednesday 25 February 2026 15:47:50 +0000 (0:00:00.043) 0:06:21.736 **** 2026-02-25 15:47:50.800970 | controller | skipping: [instance] 2026-02-25 15:47:50.801034 | controller | 2026-02-25 15:47:50.801130 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-25 15:47:50.801249 | controller | Wednesday 25 February 2026 15:47:50 +0000 (0:00:00.046) 0:06:21.783 **** 2026-02-25 15:47:51.374137 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:51.374381 | controller | 2026-02-25 15:47:51.374397 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-25 15:47:51.374406 | controller | Wednesday 25 February 2026 15:47:51 +0000 (0:00:00.572) 0:06:22.356 **** 2026-02-25 15:47:52.398493 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:47:52.398560 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:47:52.398658 | controller | changed: [instance -> controller-0] 2026-02-25 15:47:52.398772 | controller | 2026-02-25 15:47:52.398871 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-25 15:47:52.398970 | controller | Wednesday 25 February 2026 15:47:52 +0000 (0:00:01.024) 0:06:23.381 **** 2026-02-25 15:47:53.096204 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:53.096285 | controller | 2026-02-25 15:47:53.096389 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-25 15:47:53.096482 | controller | Wednesday 25 February 2026 15:47:53 +0000 (0:00:00.697) 0:06:24.078 **** 2026-02-25 15:47:53.589430 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:47:53.589492 | controller | 2026-02-25 15:47:53.589747 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-25 15:47:53.653276 | controller | Wednesday 25 February 2026 15:47:53 +0000 (0:00:00.493) 0:06:24.572 **** 2026-02-25 15:47:53.653320 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:47:53.653347 | controller | ok: [instance -> controller-0] 2026-02-25 15:47:53.653382 | controller | 2026-02-25 15:47:53.653622 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-25 15:47:53.695175 | controller | Wednesday 25 February 2026 15:47:53 +0000 (0:00:00.063) 0:06:24.635 **** 2026-02-25 15:47:53.695206 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:23.681363 | controller | 2026-02-25 15:48:23.682360 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-25 15:48:23.682375 | controller | Wednesday 25 February 2026 15:47:53 +0000 (0:00:00.041) 0:06:24.677 **** 2026-02-25 15:48:23.683107 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:24.160349 | controller | 2026-02-25 15:48:24.160382 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-25 15:48:24.160391 | controller | Wednesday 25 February 2026 15:48:23 +0000 (0:00:29.982) 0:06:54.660 **** 2026-02-25 15:48:24.160402 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:24.630839 | controller | 2026-02-25 15:48:24.630871 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-25 15:48:24.630879 | controller | Wednesday 25 February 2026 15:48:24 +0000 (0:00:00.482) 0:06:55.142 **** 2026-02-25 15:48:24.630890 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:30.532472 | controller | 2026-02-25 15:48:30.532526 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-25 15:48:30.532535 | controller | Wednesday 25 February 2026 15:48:24 +0000 (0:00:00.470) 0:06:55.613 **** 2026-02-25 15:48:30.532545 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:30.598588 | controller | 2026-02-25 15:48:30.598613 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-25 15:48:30.598621 | controller | Wednesday 25 February 2026 15:48:30 +0000 (0:00:05.901) 0:07:01.514 **** 2026-02-25 15:48:30.598630 | controller | skipping: [instance] 2026-02-25 15:48:31.229922 | controller | 2026-02-25 15:48:31.229955 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-25 15:48:31.229964 | controller | Wednesday 25 February 2026 15:48:30 +0000 (0:00:00.066) 0:07:01.581 **** 2026-02-25 15:48:31.229975 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:31.230003 | controller | 2026-02-25 15:48:31.230026 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-25 15:48:31.230198 | controller | Wednesday 25 February 2026 15:48:31 +0000 (0:00:00.631) 0:07:02.212 **** 2026-02-25 15:48:31.739532 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:31.780145 | controller | 2026-02-25 15:48:31.780187 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-25 15:48:31.780196 | controller | Wednesday 25 February 2026 15:48:31 +0000 (0:00:00.509) 0:07:02.721 **** 2026-02-25 15:48:31.780206 | controller | skipping: [instance] 2026-02-25 15:48:31.817306 | controller | 2026-02-25 15:48:31.817347 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-25 15:48:31.817368 | controller | Wednesday 25 February 2026 15:48:31 +0000 (0:00:00.041) 0:07:02.762 **** 2026-02-25 15:48:31.817381 | controller | skipping: [instance] 2026-02-25 15:48:31.817427 | controller | 2026-02-25 15:48:31.817521 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-25 15:48:31.817665 | controller | Wednesday 25 February 2026 15:48:31 +0000 (0:00:00.037) 0:07:02.800 **** 2026-02-25 15:48:31.856693 | controller | skipping: [instance] 2026-02-25 15:48:31.894175 | controller | 2026-02-25 15:48:31.894203 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-25 15:48:31.894215 | controller | Wednesday 25 February 2026 15:48:31 +0000 (0:00:00.039) 0:07:02.839 **** 2026-02-25 15:48:31.894227 | controller | skipping: [instance] 2026-02-25 15:48:31.938282 | controller | 2026-02-25 15:48:31.938318 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-25 15:48:31.938328 | controller | Wednesday 25 February 2026 15:48:31 +0000 (0:00:00.037) 0:07:02.876 **** 2026-02-25 15:48:31.938340 | controller | skipping: [instance] 2026-02-25 15:48:31.938371 | controller | 2026-02-25 15:48:31.938380 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-25 15:48:31.938460 | controller | Wednesday 25 February 2026 15:48:31 +0000 (0:00:00.043) 0:07:02.920 **** 2026-02-25 15:48:31.987332 | controller | skipping: [instance] 2026-02-25 15:48:31.987642 | controller | 2026-02-25 15:48:31.987664 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-25 15:48:34.553422 | controller | Wednesday 25 February 2026 15:48:31 +0000 (0:00:00.049) 0:07:02.970 **** 2026-02-25 15:48:34.553476 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:48:34.553524 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:48:34.553533 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:48:34.553540 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:48:34.553546 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:48:34.553552 | controller | changed: [instance -> controller-0] 2026-02-25 15:48:34.553566 | controller | 2026-02-25 15:48:34.553643 | controller | TASK [Prepare install_yamls make targets] ************************************** 2026-02-25 15:48:34.553656 | controller | Wednesday 25 February 2026 15:48:34 +0000 (0:00:02.565) 0:07:05.535 **** 2026-02-25 15:48:34.699583 | controller | 2026-02-25 15:48:36.153780 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2026-02-25 15:48:36.153814 | controller | Wednesday 25 February 2026 15:48:34 +0000 (0:00:00.146) 0:07:05.682 **** 2026-02-25 15:48:36.153827 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:48:36.153974 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:48:36.153989 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:48:36.153996 | controller | changed: [instance -> controller-0] 2026-02-25 15:48:36.154006 | controller | 2026-02-25 15:48:36.154012 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2026-02-25 15:48:36.154019 | controller | Wednesday 25 February 2026 15:48:36 +0000 (0:00:01.453) 0:07:07.136 **** 2026-02-25 15:48:36.211959 | controller | 2026-02-25 15:48:36.250734 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2026-02-25 15:48:36.250756 | controller | Wednesday 25 February 2026 15:48:36 +0000 (0:00:00.058) 0:07:07.194 **** 2026-02-25 15:48:36.250769 | controller | skipping: [instance] 2026-02-25 15:48:36.250819 | controller | 2026-02-25 15:48:36.250827 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2026-02-25 15:48:36.250835 | controller | Wednesday 25 February 2026 15:48:36 +0000 (0:00:00.038) 0:07:07.233 **** 2026-02-25 15:48:36.294885 | controller | skipping: [instance] 2026-02-25 15:48:36.358124 | controller | 2026-02-25 15:48:36.358184 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2026-02-25 15:48:36.358200 | controller | Wednesday 25 February 2026 15:48:36 +0000 (0:00:00.044) 0:07:07.277 **** 2026-02-25 15:48:36.358215 | controller | 2026-02-25 15:48:36.418036 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-25 15:48:36.418061 | controller | Wednesday 25 February 2026 15:48:36 +0000 (0:00:00.063) 0:07:07.340 **** 2026-02-25 15:48:36.418075 | controller | skipping: [instance] 2026-02-25 15:48:36.471993 | controller | 2026-02-25 15:48:36.472035 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-25 15:48:36.472046 | controller | Wednesday 25 February 2026 15:48:36 +0000 (0:00:00.059) 0:07:07.400 **** 2026-02-25 15:48:36.472060 | controller | skipping: [instance] 2026-02-25 15:48:36.521260 | controller | 2026-02-25 15:48:36.521287 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-25 15:48:36.521295 | controller | Wednesday 25 February 2026 15:48:36 +0000 (0:00:00.053) 0:07:07.454 **** 2026-02-25 15:48:36.521306 | controller | skipping: [instance] 2026-02-25 15:48:36.521547 | controller | 2026-02-25 15:48:36.521557 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-25 15:48:36.577075 | controller | Wednesday 25 February 2026 15:48:36 +0000 (0:00:00.049) 0:07:07.503 **** 2026-02-25 15:48:36.577106 | controller | skipping: [instance] 2026-02-25 15:48:36.689574 | controller | 2026-02-25 15:48:36.689601 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2026-02-25 15:48:36.689619 | controller | Wednesday 25 February 2026 15:48:36 +0000 (0:00:00.055) 0:07:07.559 **** 2026-02-25 15:48:36.689631 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 15:48:36.689673 | controller | ok: [instance -> controller-0] 2026-02-25 15:48:36.689680 | controller | 2026-02-25 15:48:36.689688 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2026-02-25 15:48:36.689713 | controller | Wednesday 25 February 2026 15:48:36 +0000 (0:00:00.112) 0:07:07.672 **** 2026-02-25 15:48:36.765109 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:36.765185 | controller | 2026-02-25 15:48:36.765386 | controller | TASK [install_yamls : Get environment structure] ******************************* 2026-02-25 15:48:37.636276 | controller | Wednesday 25 February 2026 15:48:36 +0000 (0:00:00.075) 0:07:07.747 **** 2026-02-25 15:48:37.636337 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:37.675380 | controller | 2026-02-25 15:48:37.675406 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2026-02-25 15:48:37.675414 | controller | Wednesday 25 February 2026 15:48:37 +0000 (0:00:00.870) 0:07:08.618 **** 2026-02-25 15:48:37.675426 | controller | skipping: [instance] 2026-02-25 15:48:37.722768 | controller | 2026-02-25 15:48:37.722808 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2026-02-25 15:48:37.722819 | controller | Wednesday 25 February 2026 15:48:37 +0000 (0:00:00.038) 0:07:08.657 **** 2026-02-25 15:48:37.722832 | controller | skipping: [instance] 2026-02-25 15:48:37.764274 | controller | 2026-02-25 15:48:37.764306 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2026-02-25 15:48:37.764314 | controller | Wednesday 25 February 2026 15:48:37 +0000 (0:00:00.047) 0:07:08.705 **** 2026-02-25 15:48:37.764325 | controller | skipping: [instance] 2026-02-25 15:48:37.827241 | controller | 2026-02-25 15:48:37.827269 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2026-02-25 15:48:37.827277 | controller | Wednesday 25 February 2026 15:48:37 +0000 (0:00:00.041) 0:07:08.746 **** 2026-02-25 15:48:37.827287 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:37.872147 | controller | 2026-02-25 15:48:37.872186 | controller | TASK [install_yamls : Show the env structure] ********************************** 2026-02-25 15:48:37.872194 | controller | Wednesday 25 February 2026 15:48:37 +0000 (0:00:00.063) 0:07:08.809 **** 2026-02-25 15:48:37.872205 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:37.872259 | controller | 2026-02-25 15:48:37.872363 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2026-02-25 15:48:37.872459 | controller | Wednesday 25 February 2026 15:48:37 +0000 (0:00:00.045) 0:07:08.854 **** 2026-02-25 15:48:37.926979 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:37.927053 | controller | 2026-02-25 15:48:37.927153 | controller | TASK [install_yamls : Generate make targets] *********************************** 2026-02-25 15:48:37.927281 | controller | Wednesday 25 February 2026 15:48:37 +0000 (0:00:00.054) 0:07:08.909 **** 2026-02-25 15:48:38.579635 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:38.579679 | controller | 2026-02-25 15:48:38.579734 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2026-02-25 15:48:38.579824 | controller | Wednesday 25 February 2026 15:48:38 +0000 (0:00:00.652) 0:07:09.562 **** 2026-02-25 15:48:38.626032 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:38.626097 | controller | 2026-02-25 15:48:38.626196 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2026-02-25 15:48:38.626314 | controller | Wednesday 25 February 2026 15:48:38 +0000 (0:00:00.046) 0:07:09.608 **** 2026-02-25 15:48:39.702696 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:39.702748 | controller | 2026-02-25 15:48:39.702860 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2026-02-25 15:48:39.702951 | controller | Wednesday 25 February 2026 15:48:39 +0000 (0:00:01.075) 0:07:10.684 **** 2026-02-25 15:48:39.760006 | controller | skipping: [instance] 2026-02-25 15:48:39.760062 | controller | 2026-02-25 15:48:39.760186 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-25 15:48:39.760283 | controller | Wednesday 25 February 2026 15:48:39 +0000 (0:00:00.058) 0:07:10.742 **** 2026-02-25 15:48:40.575398 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:40.575453 | controller | 2026-02-25 15:48:40.575527 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-25 15:48:40.575611 | controller | Wednesday 25 February 2026 15:48:40 +0000 (0:00:00.815) 0:07:11.557 **** 2026-02-25 15:48:40.634823 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:40.634901 | controller | 2026-02-25 15:48:40.635021 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2026-02-25 15:48:40.635131 | controller | Wednesday 25 February 2026 15:48:40 +0000 (0:00:00.058) 0:07:11.616 **** 2026-02-25 15:48:41.584091 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:42.125882 | controller | 2026-02-25 15:48:42.125967 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2026-02-25 15:48:42.125983 | controller | Wednesday 25 February 2026 15:48:41 +0000 (0:00:00.949) 0:07:12.566 **** 2026-02-25 15:48:42.125995 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 15:48:42.279410 | controller | 2026-02-25 15:48:42.279459 | controller | TASK [Configure CRC network if needed] ***************************************** 2026-02-25 15:48:42.279467 | controller | Wednesday 25 February 2026 15:48:42 +0000 (0:00:00.541) 0:07:13.108 **** 2026-02-25 15:48:42.279488 | controller | 2026-02-25 15:48:43.450635 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2026-02-25 15:48:43.450675 | controller | Wednesday 25 February 2026 15:48:42 +0000 (0:00:00.153) 0:07:13.261 **** 2026-02-25 15:48:43.450688 | controller | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-25 15:48:43.454661 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false 2026-02-25 15:48:43.454729 | controller | module_stderr: |- 2026-02-25 15:48:43.454741 | controller | Shared connection to controller-0.utility closed. 2026-02-25 15:48:43.454749 | controller | module_stdout: |- 2026-02-25 15:48:43.454756 | controller | Traceback (most recent call last): 2026-02-25 15:48:43.454764 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 700, in urlopen 2026-02-25 15:48:43.454771 | controller | httplib_response = self._make_request( 2026-02-25 15:48:43.454778 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 383, in _make_request 2026-02-25 15:48:43.454785 | controller | self._validate_conn(conn) 2026-02-25 15:48:43.454792 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1015, in _validate_conn 2026-02-25 15:48:43.454798 | controller | conn.connect() 2026-02-25 15:48:43.454805 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connection.py", line 411, in connect 2026-02-25 15:48:43.454812 | controller | self.sock = ssl_wrap_socket( 2026-02-25 15:48:43.454818 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket 2026-02-25 15:48:43.454825 | controller | ssl_sock = _ssl_wrap_socket_impl( 2026-02-25 15:48:43.454832 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl 2026-02-25 15:48:43.454838 | controller | return ssl_context.wrap_socket(sock, server_hostname=server_hostname) 2026-02-25 15:48:43.454845 | controller | File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket 2026-02-25 15:48:43.454852 | controller | return self.sslsocket_class._create( 2026-02-25 15:48:43.454858 | controller | File "/usr/lib64/python3.9/ssl.py", line 1076, in _create 2026-02-25 15:48:43.454865 | controller | self.do_handshake() 2026-02-25 15:48:43.454872 | controller | File "/usr/lib64/python3.9/ssl.py", line 1345, in do_handshake 2026-02-25 15:48:43.454883 | controller | self._sslobj.do_handshake() 2026-02-25 15:48:43.454890 | controller | ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147) 2026-02-25 15:48:43.454897 | controller | 2026-02-25 15:48:43.454904 | controller | During handling of the above exception, another exception occurred: 2026-02-25 15:48:43.454911 | controller | 2026-02-25 15:48:43.454921 | controller | Traceback (most recent call last): 2026-02-25 15:48:43.454942 | controller | File "/tmp/ansible-tmp-1772034522.3165734-28219-164017825009295/AnsiballZ_k8s_info.py", line 107, in 2026-02-25 15:48:43.455144 | controller | _ansiballz_main() 2026-02-25 15:48:43.455213 | controller | File "/tmp/ansible-tmp-1772034522.3165734-28219-164017825009295/AnsiballZ_k8s_info.py", line 99, in _ansiballz_main 2026-02-25 15:48:43.455227 | controller | invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS) 2026-02-25 15:48:43.455663 | controller | File "/tmp/ansible-tmp-1772034522.3165734-28219-164017825009295/AnsiballZ_k8s_info.py", line 47, in invoke_module 2026-02-25 15:48:43.455682 | controller | runpy.run_module(mod_name='ansible_collections.kubernetes.core.plugins.modules.k8s_info', init_globals=dict(_module_fqn='ansible_collections.kubernetes.core.plugins.modules.k8s_info', _modlib_path=modlib_path), 2026-02-25 15:48:43.455703 | controller | File "/usr/lib64/python3.9/runpy.py", line 225, in run_module 2026-02-25 15:48:43.455709 | controller | return _run_module_code(code, init_globals, run_name, mod_spec) 2026-02-25 15:48:43.455715 | controller | File "/usr/lib64/python3.9/runpy.py", line 97, in _run_module_code 2026-02-25 15:48:43.455720 | controller | _run_code(code, mod_globals, init_globals, 2026-02-25 15:48:43.455726 | controller | File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-25 15:48:43.455733 | controller | exec(code, run_globals) 2026-02-25 15:48:43.456237 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tgrfiiz9/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 229, in 2026-02-25 15:48:43.456326 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tgrfiiz9/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 221, in main 2026-02-25 15:48:43.456338 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tgrfiiz9/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 352, in get_api_client 2026-02-25 15:48:43.456345 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tgrfiiz9/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 246, in wrapper 2026-02-25 15:48:43.456351 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tgrfiiz9/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 259, in create_api_client 2026-02-25 15:48:43.456357 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 84, in __init__ 2026-02-25 15:48:43.456365 | controller | self.__discoverer = discoverer(self, cache_file) 2026-02-25 15:48:43.456393 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tgrfiiz9/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 190, in __init__ 2026-02-25 15:48:43.456509 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tgrfiiz9/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 45, in __init__ 2026-02-25 15:48:43.456594 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tgrfiiz9/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 92, in __init_cache 2026-02-25 15:48:43.456680 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/discovery.py", line 146, in _load_server_info 2026-02-25 15:48:43.456764 | controller | 'kubernetes': self.client.request('get', '/version', serializer=just_json) 2026-02-25 15:48:43.456849 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-25 15:48:43.456930 | controller | resp = func(self, *args, **kwargs) 2026-02-25 15:48:43.457015 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 277, in request 2026-02-25 15:48:43.457106 | controller | api_response = self.client.call_api( 2026-02-25 15:48:43.457229 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-25 15:48:43.457320 | controller | return self.__call_api(resource_path, method, 2026-02-25 15:48:43.457396 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-25 15:48:43.457489 | controller | response_data = self.request( 2026-02-25 15:48:43.457591 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-25 15:48:43.457664 | controller | return self.rest_client.GET(url, 2026-02-25 15:48:43.457754 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-25 15:48:43.457826 | controller | return self.request("GET", url, 2026-02-25 15:48:43.457914 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 217, in request 2026-02-25 15:48:43.458003 | controller | r = self.pool_manager.request(method, url, 2026-02-25 15:48:43.458092 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 74, in request 2026-02-25 15:48:43.458192 | controller | return self.request_encode_url( 2026-02-25 15:48:43.458280 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 96, in request_encode_url 2026-02-25 15:48:43.458368 | controller | return self.urlopen(method, url, **extra_kw) 2026-02-25 15:48:43.458448 | controller | File "/usr/lib/python3.9/site-packages/urllib3/poolmanager.py", line 376, in urlopen 2026-02-25 15:48:43.458574 | controller | response = conn.urlopen(method, u.request_uri, **kw) 2026-02-25 15:48:43.458642 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-25 15:48:43.458726 | controller | return self.urlopen( 2026-02-25 15:48:43.458815 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-25 15:48:43.458916 | controller | return self.urlopen( 2026-02-25 15:48:43.458987 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-25 15:48:43.459060 | controller | return self.urlopen( 2026-02-25 15:48:43.459235 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 756, in urlopen 2026-02-25 15:48:43.459309 | controller | retries = retries.increment( 2026-02-25 15:48:43.459404 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 576, in increment 2026-02-25 15:48:43.459516 | controller | raise MaxRetryError(_pool, url, error or ResponseError(cause)) 2026-02-25 15:48:43.459614 | controller | urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-25 15:48:43.459697 | controller | msg: |- 2026-02-25 15:48:43.459785 | controller | MODULE FAILURE 2026-02-25 15:48:43.459877 | controller | See stdout/stderr for the exact error 2026-02-25 15:48:43.459961 | controller | rc: 1 2026-02-25 15:48:43.461992 | controller | 2026-02-25 15:48:43.462088 | controller | TASK [Create dnsmasq dir] ****************************************************** 2026-02-25 15:48:43.462196 | controller | Wednesday 25 February 2026 15:48:43 +0000 (0:00:01.183) 0:07:14.444 **** 2026-02-25 15:48:43.681843 | controller | changed: [instance] 2026-02-25 15:48:43.681897 | controller | 2026-02-25 15:48:43.682023 | controller | TASK [Get journalctl in a file] ************************************************ 2026-02-25 15:48:43.682118 | controller | Wednesday 25 February 2026 15:48:43 +0000 (0:00:00.219) 0:07:14.664 **** 2026-02-25 15:48:43.907233 | controller | changed: [instance] 2026-02-25 15:48:43.907304 | controller | 2026-02-25 15:48:43.907394 | controller | TASK [Dump journalctl output] ************************************************** 2026-02-25 15:48:43.907492 | controller | Wednesday 25 February 2026 15:48:43 +0000 (0:00:00.225) 0:07:14.889 **** 2026-02-25 15:48:44.305036 | controller | changed: [instance] 2026-02-25 15:48:44.305223 | controller | 2026-02-25 15:48:44.305312 | controller | TASK [Copy all dnsmasq config] ************************************************* 2026-02-25 15:48:44.305325 | controller | Wednesday 25 February 2026 15:48:44 +0000 (0:00:00.396) 0:07:15.286 **** 2026-02-25 15:48:44.851060 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-25 15:48:44.851111 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2026-02-25 15:48:44.851212 | controller | 2026-02-25 15:48:44.851299 | controller | TASK [Create log directory] **************************************************** 2026-02-25 15:48:44.851385 | controller | Wednesday 25 February 2026 15:48:44 +0000 (0:00:00.547) 0:07:15.833 **** 2026-02-25 15:48:45.074073 | controller | changed: [instance] 2026-02-25 15:48:45.074124 | controller | 2026-02-25 15:48:45.074238 | controller | TASK [Sync logs from controller-0] ********************************************* 2026-02-25 15:48:45.074326 | controller | Wednesday 25 February 2026 15:48:45 +0000 (0:00:00.223) 0:07:16.056 **** 2026-02-25 15:48:45.953254 | controller | changed: [instance] 2026-02-25 15:48:45.954011 | controller | 2026-02-25 15:48:45.954064 | controller | PLAY RECAP ********************************************************************* 2026-02-25 15:48:45.954073 | controller | instance : ok=541 changed=208 unreachable=0 failed=1 skipped=229 rescued=0 ignored=0 2026-02-25 15:48:45.954079 | controller | 2026-02-25 15:48:45.954084 | controller | Wednesday 25 February 2026 15:48:45 +0000 (0:00:00.877) 0:07:16.934 **** 2026-02-25 15:48:45.954090 | controller | =============================================================================== 2026-02-25 15:48:45.954095 | controller | reproducer : Check package install status ------------------------------ 49.98s 2026-02-25 15:48:45.954100 | controller | libvirt_manager : Download base image ---------------------------------- 41.18s 2026-02-25 15:48:45.954105 | controller | ci_setup : Install needed packages ------------------------------------- 29.98s 2026-02-25 15:48:45.954112 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 22.98s 2026-02-25 15:48:45.954149 | controller | reproducer : Install collections on controller-0 ----------------------- 19.89s 2026-02-25 15:48:45.954487 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.17s 2026-02-25 15:48:45.955194 | controller | libvirt_manager : Install packages required for using KVM --------------- 8.59s 2026-02-25 15:48:45.955240 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 7.36s 2026-02-25 15:48:45.955257 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.35s 2026-02-25 15:48:45.955293 | controller | ci_nmstate : Install required packages on localhost --------------------- 6.66s 2026-02-25 15:48:45.955301 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.30s 2026-02-25 15:48:45.955308 | controller | ci_setup : Install openshift client ------------------------------------- 5.90s 2026-02-25 15:48:45.955314 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 4.05s 2026-02-25 15:48:45.955320 | controller | networking_mapper : Gather the facts ------------------------------------ 3.48s 2026-02-25 15:48:45.955326 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.24s 2026-02-25 15:48:45.955332 | controller | sushy_emulator : Install required packages ------------------------------ 2.68s 2026-02-25 15:48:45.955341 | controller | ci_setup : Manage directories ------------------------------------------- 2.57s 2026-02-25 15:48:45.955365 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.30s 2026-02-25 15:48:45.955374 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.26s 2026-02-25 15:48:45.955501 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.11s 2026-02-25 15:48:46.084626 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2026-02-25 15:48:46.085044 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2026-02-25 15:48:46.093047 | controller | INFO Running crc_layout > cleanup 2026-02-25 15:48:46.093502 | controller | WARNING Skipping, cleanup playbook not configured. 2026-02-25 15:48:46.100288 | controller | INFO Running crc_layout > destroy 2026-02-25 15:48:46.100609 | controller | WARNING Skipping, instances are delegated. 2026-02-25 15:48:46.101073 | controller | INFO Pruning extra files from scenario ephemeral directory 2026-02-25 15:48:46.103083 | controller | INFO Writing /tmp/report.html report. 2026-02-25 15:48:46.492270 | [controller] Waiting on logger 2026-02-25 15:48:51.643716 | [controller] Waiting on logger 2026-02-25 15:49:02.076847 | [controller] Waiting on logger 2026-02-25 15:49:12.507837 | [controller] Waiting on logger 2026-02-25 15:49:16.208753 | [Zuul] Log Stream did not terminate 2026-02-25 15:49:16.209003 | controller | ERROR 2026-02-25 15:49:16.209097 | controller | { 2026-02-25 15:49:16.209135 | controller | "delta": "0:09:18.005785", 2026-02-25 15:49:16.209159 | controller | "end": "2026-02-25 15:48:46.167519", 2026-02-25 15:49:16.209182 | controller | "msg": "non-zero return code", 2026-02-25 15:49:16.209202 | controller | "rc": 1, 2026-02-25 15:49:16.209221 | controller | "start": "2026-02-25 15:39:28.161734" 2026-02-25 15:49:16.209239 | controller | } failure 2026-02-25 15:49:16.259197 | 2026-02-25 15:49:16.259252 | PLAY RECAP 2026-02-25 15:49:16.259321 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2026-02-25 15:49:16.259354 | 2026-02-25 15:49:16.321127 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-25 15:49:16.321877 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-25 15:49:16.838234 | 2026-02-25 15:49:16.838382 | PLAY [Run ci/playbooks/collect-logs.yml] 2026-02-25 15:49:16.858315 | 2026-02-25 15:49:16.858390 | TASK [Filter out host if needed] 2026-02-25 15:49:16.866825 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2026-02-25 15:49:16.871265 | 2026-02-25 15:49:16.871361 | TASK [Ensure file is present] 2026-02-25 15:49:17.235680 | controller | ok 2026-02-25 15:49:17.241092 | 2026-02-25 15:49:17.241158 | TASK [Manage molecule report file] 2026-02-25 15:49:17.264450 | [controller] Waiting on logger 2026-02-25 15:49:26.624635 | [controller] Waiting on logger 2026-02-25 15:49:37.020154 | [controller] Waiting on logger 2026-02-25 15:49:47.451945 | [controller] Waiting on logger 2026-02-25 15:49:47.625577 | [Zuul] Log Stream did not terminate 2026-02-25 15:49:47.625760 | controller | changed 2026-02-25 15:49:47.630865 | 2026-02-25 15:49:47.630940 | TASK [Check if we get ci-framework-data basedir] 2026-02-25 15:49:47.871594 | controller | ok 2026-02-25 15:49:47.876739 | 2026-02-25 15:49:47.876826 | TASK [Create ci-framework-data log directory for zuul] 2026-02-25 15:49:48.230052 | controller | changed 2026-02-25 15:49:48.235028 | 2026-02-25 15:49:48.235095 | TASK [Copy ci-framework interesting files] 2026-02-25 15:49:53.260443 | controller | changed 2026-02-25 15:49:53.265802 | 2026-02-25 15:49:53.265868 | TASK [Get SELinux listing] 2026-02-25 15:49:54.299684 | [controller] Waiting on logger 2026-02-25 15:50:03.643797 | [controller] Waiting on logger 2026-02-25 15:50:14.075964 | [controller] Waiting on logger 2026-02-25 15:50:23.537578 | [Zuul] Log Stream did not terminate 2026-02-25 15:50:23.537793 | controller | changed 2026-02-25 15:50:23.543814 | 2026-02-25 15:50:23.543897 | TASK [Generate log index] 2026-02-25 15:50:24.507718 | [controller] Waiting on logger 2026-02-25 15:50:24.595977 | controller | changed 2026-02-25 15:50:24.600779 | 2026-02-25 15:50:24.600844 | TASK [Get some env related data] 2026-02-25 15:50:25.659723 | [controller] Waiting on logger 2026-02-25 15:50:40.187721 | [controller] Waiting on logger 2026-02-25 15:50:49.568399 | [controller] Waiting on logger 2026-02-25 15:50:55.772399 | [Zuul] Log Stream did not terminate 2026-02-25 15:50:55.772647 | controller | changed 2026-02-25 15:50:55.777553 | 2026-02-25 15:50:55.777615 | TASK [Generate list of logs to collect in home directory] 2026-02-25 15:50:56.130186 | controller | ok: All paths examined 2026-02-25 15:50:56.135356 | 2026-02-25 15:50:56.135419 | LOOP [Copy logs from home directory] 2026-02-25 15:50:56.667728 | controller | changed: 2026-02-25 15:50:56.667985 | controller | { 2026-02-25 15:50:56.668023 | controller | "atime": 1743544925.4788878, 2026-02-25 15:50:56.668050 | controller | "ctime": 1743545329.1409318, 2026-02-25 15:50:56.668073 | controller | "dev": 64513, 2026-02-25 15:50:56.668096 | controller | "gid": 1000, 2026-02-25 15:50:56.669050 | controller | "gr_name": "zuul", 2026-02-25 15:50:56.669098 | controller | "inode": 4518807, 2026-02-25 15:50:56.669121 | controller | "isblk": false, 2026-02-25 15:50:56.669148 | controller | "ischr": false, 2026-02-25 15:50:56.669167 | controller | "isdir": false, 2026-02-25 15:50:56.669183 | controller | "isfifo": false, 2026-02-25 15:50:56.669200 | controller | "isgid": false, 2026-02-25 15:50:56.669216 | controller | "islnk": false, 2026-02-25 15:50:56.669231 | controller | "isreg": true, 2026-02-25 15:50:56.669245 | controller | "issock": false, 2026-02-25 15:50:56.669261 | controller | "isuid": false, 2026-02-25 15:50:56.669278 | controller | "mode": "0644", 2026-02-25 15:50:56.669310 | controller | "mtime": 1743545329.1409318, 2026-02-25 15:50:56.669333 | controller | "nlink": 1, 2026-02-25 15:50:56.669360 | controller | "path": "/home/zuul/crc-setup.log", 2026-02-25 15:50:56.669377 | controller | "pw_name": "zuul", 2026-02-25 15:50:56.669392 | controller | "rgrp": true, 2026-02-25 15:50:56.669406 | controller | "roth": true, 2026-02-25 15:50:56.669419 | controller | "rusr": true, 2026-02-25 15:50:56.669433 | controller | "size": 4108, 2026-02-25 15:50:56.669447 | controller | "uid": 1000, 2026-02-25 15:50:56.669461 | controller | "wgrp": false, 2026-02-25 15:50:56.669474 | controller | "woth": false, 2026-02-25 15:50:56.669488 | controller | "wusr": true, 2026-02-25 15:50:56.669502 | controller | "xgrp": false, 2026-02-25 15:50:56.669515 | controller | "xoth": false, 2026-02-25 15:50:56.669529 | controller | "xusr": false 2026-02-25 15:50:56.669542 | controller | } 2026-02-25 15:50:57.177882 | controller | changed: 2026-02-25 15:50:57.178065 | controller | { 2026-02-25 15:50:57.178103 | controller | "atime": 1743545331.0429637, 2026-02-25 15:50:57.178126 | controller | "ctime": 1743545842.0111232, 2026-02-25 15:50:57.178149 | controller | "dev": 64513, 2026-02-25 15:50:57.178167 | controller | "gid": 1000, 2026-02-25 15:50:57.178183 | controller | "gr_name": "zuul", 2026-02-25 15:50:57.178198 | controller | "inode": 4194437, 2026-02-25 15:50:57.178213 | controller | "isblk": false, 2026-02-25 15:50:57.178228 | controller | "ischr": false, 2026-02-25 15:50:57.178243 | controller | "isdir": false, 2026-02-25 15:50:57.178380 | controller | "isfifo": false, 2026-02-25 15:50:57.178479 | controller | "isgid": false, 2026-02-25 15:50:57.178504 | controller | "islnk": false, 2026-02-25 15:50:57.178523 | controller | "isreg": true, 2026-02-25 15:50:57.178543 | controller | "issock": false, 2026-02-25 15:50:57.178573 | controller | "isuid": false, 2026-02-25 15:50:57.178590 | controller | "mode": "0644", 2026-02-25 15:50:57.178605 | controller | "mtime": 1743545842.0111232, 2026-02-25 15:50:57.178619 | controller | "nlink": 1, 2026-02-25 15:50:57.178634 | controller | "path": "/home/zuul/crc-start.log", 2026-02-25 15:50:57.178648 | controller | "pw_name": "zuul", 2026-02-25 15:50:57.178662 | controller | "rgrp": true, 2026-02-25 15:50:57.178744 | controller | "roth": true, 2026-02-25 15:50:57.178770 | controller | "rusr": true, 2026-02-25 15:50:57.178789 | controller | "size": 4023, 2026-02-25 15:50:57.178805 | controller | "uid": 1000, 2026-02-25 15:50:57.178820 | controller | "wgrp": false, 2026-02-25 15:50:57.178834 | controller | "woth": false, 2026-02-25 15:50:57.178848 | controller | "wusr": true, 2026-02-25 15:50:57.178866 | controller | "xgrp": false, 2026-02-25 15:50:57.178884 | controller | "xoth": false, 2026-02-25 15:50:57.178899 | controller | "xusr": false 2026-02-25 15:50:57.178913 | controller | } 2026-02-25 15:50:57.700428 | controller | changed: 2026-02-25 15:50:57.700496 | controller | { 2026-02-25 15:50:57.700521 | controller | "atime": 1772033949.1570964, 2026-02-25 15:50:57.700541 | controller | "ctime": 1772033965.7853076, 2026-02-25 15:50:57.700572 | controller | "dev": 64513, 2026-02-25 15:50:57.700590 | controller | "gid": 1000, 2026-02-25 15:50:57.700606 | controller | "gr_name": "zuul", 2026-02-25 15:50:57.700620 | controller | "inode": 4233410, 2026-02-25 15:50:57.700635 | controller | "isblk": false, 2026-02-25 15:50:57.700649 | controller | "ischr": false, 2026-02-25 15:50:57.700664 | controller | "isdir": false, 2026-02-25 15:50:57.700679 | controller | "isfifo": false, 2026-02-25 15:50:57.700696 | controller | "isgid": false, 2026-02-25 15:50:57.700711 | controller | "islnk": false, 2026-02-25 15:50:57.700725 | controller | "isreg": true, 2026-02-25 15:50:57.700738 | controller | "issock": false, 2026-02-25 15:50:57.700752 | controller | "isuid": false, 2026-02-25 15:50:57.700765 | controller | "mode": "0644", 2026-02-25 15:50:57.700777 | controller | "mtime": 1772033965.7853076, 2026-02-25 15:50:57.700791 | controller | "nlink": 1, 2026-02-25 15:50:57.700804 | controller | "path": "/home/zuul/ansible.log", 2026-02-25 15:50:57.700817 | controller | "pw_name": "zuul", 2026-02-25 15:50:57.700829 | controller | "rgrp": true, 2026-02-25 15:50:57.700842 | controller | "roth": true, 2026-02-25 15:50:57.700855 | controller | "rusr": true, 2026-02-25 15:50:57.700868 | controller | "size": 6749, 2026-02-25 15:50:57.700881 | controller | "uid": 1000, 2026-02-25 15:50:57.700895 | controller | "wgrp": false, 2026-02-25 15:50:57.700908 | controller | "woth": false, 2026-02-25 15:50:57.700921 | controller | "wusr": true, 2026-02-25 15:50:57.700934 | controller | "xgrp": false, 2026-02-25 15:50:57.700946 | controller | "xoth": false, 2026-02-25 15:50:57.700959 | controller | "xusr": false 2026-02-25 15:50:57.700971 | controller | } 2026-02-25 15:50:57.716109 | 2026-02-25 15:50:57.716204 | TASK [Copy crio stats log file] 2026-02-25 15:50:57.740162 | controller | skipping: Conditional result was False 2026-02-25 15:50:57.745854 | 2026-02-25 15:50:57.745923 | TASK [Get SELinux related data] 2026-02-25 15:50:58.812165 | [controller] Waiting on logger 2026-02-25 15:51:02.012159 | [controller] Waiting on logger 2026-02-25 15:51:18.624941 | [controller] Waiting on logger 2026-02-25 15:51:21.329571 | controller | ERROR 2026-02-25 15:51:21.329872 | controller | { 2026-02-25 15:51:21.329906 | controller | "delta": "0:00:00.008027", 2026-02-25 15:51:21.329927 | controller | "end": "2026-02-25 15:50:58.017907", 2026-02-25 15:51:21.329944 | controller | "msg": "non-zero return code", 2026-02-25 15:51:21.329960 | controller | "rc": 1, 2026-02-25 15:51:21.329975 | controller | "start": "2026-02-25 15:50:58.009880" 2026-02-25 15:51:21.329991 | controller | } 2026-02-25 15:51:21.330827 | controller | ERROR: Ignoring Errors 2026-02-25 15:51:21.343758 | 2026-02-25 15:51:21.343854 | TASK [Create system configuration directory] 2026-02-25 15:51:21.588716 | controller | changed 2026-02-25 15:51:21.594160 | 2026-02-25 15:51:21.594237 | TASK [Get some of the system configurations] 2026-02-25 15:51:21.617349 | [controller] Waiting on logger 2026-02-25 15:51:32.027980 | [controller] Waiting on logger 2026-02-25 15:51:42.459784 | [controller] Waiting on logger 2026-02-25 15:51:51.804055 | [controller] Waiting on logger 2026-02-25 15:51:51.912547 | [Zuul] Log Stream did not terminate 2026-02-25 15:51:51.912685 | controller | changed 2026-02-25 15:51:51.917575 | 2026-02-25 15:51:51.917632 | TASK [Copy generated documentation if available] 2026-02-25 15:51:51.930891 | controller | skipping: Conditional result was False 2026-02-25 15:51:51.935989 | 2026-02-25 15:51:51.936050 | TASK [Copy generated AsciiDoc documentation if available] 2026-02-25 15:51:51.948787 | controller | skipping: Conditional result was False 2026-02-25 15:51:51.954062 | 2026-02-25 15:51:51.954146 | TASK [Compress logs bigger than 2MB] 2026-02-25 15:51:55.067776 | [controller] Waiting on logger 2026-02-25 15:52:01.324849 | controller | changed 2026-02-25 15:52:01.330100 | 2026-02-25 15:52:01.330164 | TASK [Copy files from workspace on node] 2026-02-25 15:52:01.348273 | controller | ok 2026-02-25 15:52:01.369859 | 2026-02-25 15:52:01.369926 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-25 15:52:01.383453 | controller | skipping: Conditional result was False 2026-02-25 15:52:01.389919 | 2026-02-25 15:52:01.389995 | TASK [fetch-output : Set log path for single node] 2026-02-25 15:52:01.417640 | controller | ok 2026-02-25 15:52:01.422511 | 2026-02-25 15:52:01.422588 | LOOP [fetch-output : Ensure local output dirs] 2026-02-25 15:52:01.614029 | controller -> localhost | ok: "/var/lib/zuul/builds/b37114dec2754585958f470bb78dd97b/work/logs" 2026-02-25 15:52:01.614261 | controller -> localhost | changed: All items complete 2026-02-25 15:52:01.614291 | 2026-02-25 15:52:01.788267 | controller -> localhost | changed: "/var/lib/zuul/builds/b37114dec2754585958f470bb78dd97b/work/artifacts" 2026-02-25 15:52:01.954692 | controller -> localhost | changed: "/var/lib/zuul/builds/b37114dec2754585958f470bb78dd97b/work/docs" 2026-02-25 15:52:01.968261 | 2026-02-25 15:52:01.968377 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-25 15:52:02.593015 | controller | changed: 2026-02-25 15:52:02.593202 | controller | .d..t...... ./ 2026-02-25 15:52:02.593233 | controller | >f+++++++++ README.html 2026-02-25 15:52:02.593257 | controller | >f+++++++++ ansible-execution.log 2026-02-25 15:52:02.593278 | controller | >f+++++++++ ansible.log 2026-02-25 15:52:02.593314 | controller | >f+++++++++ crc-setup.log 2026-02-25 15:52:02.593341 | controller | >f+++++++++ crc-start.log 2026-02-25 15:52:02.593360 | controller | >f+++++++++ dmesg.log 2026-02-25 15:52:02.593378 | controller | >f+++++++++ installed-pkgs.log 2026-02-25 15:52:02.593394 | controller | >f+++++++++ python.log 2026-02-25 15:52:02.593411 | controller | >f+++++++++ registries.conf 2026-02-25 15:52:02.593427 | controller | >f+++++++++ report.html 2026-02-25 15:52:02.593443 | controller | >f+++++++++ selinux-denials.log 2026-02-25 15:52:02.593458 | controller | >f+++++++++ selinux-listing.log 2026-02-25 15:52:02.593479 | controller | cd+++++++++ ci-framework-data/ 2026-02-25 15:52:02.593496 | controller | cd+++++++++ ci-framework-data/artifacts/ 2026-02-25 15:52:02.593512 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2026-02-25 15:52:02.593529 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2026-02-25 15:52:02.593556 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2026-02-25 15:52:02.593574 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2026-02-25 15:52:02.593590 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2026-02-25 15:52:02.593608 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2026-02-25 15:52:02.593625 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2026-02-25 15:52:02.593640 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2026-02-25 15:52:02.593656 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2026-02-25 15:52:02.593672 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2026-02-25 15:52:02.593688 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2026-02-25 15:52:02.593704 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2026-02-25 15:52:02.593720 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2026-02-25 15:52:02.593735 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:9b:93:10 2026-02-25 15:52:02.593751 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:87:d9:82 2026-02-25 15:52:02.593768 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:69:30:52 2026-02-25 15:52:02.593784 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:c4:f0:2e 2026-02-25 15:52:02.593800 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:d3:7d:60 2026-02-25 15:52:02.593816 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:fa:fe:05 2026-02-25 15:52:02.593832 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2026-02-25 15:52:02.593848 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2026-02-25 15:52:02.593864 | controller | cd+++++++++ ci-framework-data/logs/ 2026-02-25 15:52:02.593880 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2026-02-25 15:52:02.593896 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2026-02-25 15:52:02.593911 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2026-02-25 15:52:02.593927 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2026-02-25 15:52:02.593943 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2026-02-25 15:52:02.593959 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2026-02-25 15:52:02.593975 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2026-02-25 15:52:02.593990 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2026-02-25 15:52:02.594006 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2026-02-25 15:52:02.594021 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2026-02-25 15:52:02.594037 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2026-02-25 15:52:02.594056 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2026-02-25 15:52:02.594076 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2026-02-25 15:52:02.594094 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2026-02-25 15:52:02.594111 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2026-02-25 15:52:02.594127 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2026-02-25 15:52:02.594144 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2026-02-25 15:52:02.594160 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2026-02-25 15:52:02.594176 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2026-02-25 15:52:02.594192 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2026-02-25 15:52:02.594208 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2026-02-25 15:52:02.594224 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2026-02-25 15:52:02.594240 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2026-02-25 15:52:02.594256 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2026-02-25 15:52:02.594272 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2026-02-25 15:52:02.594288 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2026-02-25 15:52:02.594326 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2026-02-25 15:52:02.594345 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2026-02-25 15:52:02.594362 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2026-02-25 15:52:02.594379 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2026-02-25 15:52:02.594394 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2026-02-25 15:52:02.594411 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2026-02-25 15:52:02.594426 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2026-02-25 15:52:02.594441 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2026-02-25 15:52:02.594457 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2026-02-25 15:52:02.594473 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2026-02-25 15:52:02.594489 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2026-02-25 15:52:02.594504 | controller | cd+++++++++ registries.conf.d/ 2026-02-25 15:52:02.594520 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2026-02-25 15:52:02.594545 | controller | cd+++++++++ system-config/ 2026-02-25 15:52:02.594564 | controller | cd+++++++++ system-config/libvirt/ 2026-02-25 15:52:02.594580 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2026-02-25 15:52:02.594596 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2026-02-25 15:52:02.594611 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2026-02-25 15:52:02.594633 | controller | >f+++++++++ system-config/libvirt/network.conf 2026-02-25 15:52:02.594650 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2026-02-25 15:52:02.594667 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2026-02-25 15:52:02.594682 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2026-02-25 15:52:02.594699 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2026-02-25 15:52:02.594715 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2026-02-25 15:52:02.594731 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2026-02-25 15:52:02.594748 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2026-02-25 15:52:02.594764 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2026-02-25 15:52:02.594780 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2026-02-25 15:52:02.594796 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2026-02-25 15:52:02.594812 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2026-02-25 15:52:02.594827 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2026-02-25 15:52:03.011452 | controller | changed: .d..t...... ./ 2026-02-25 15:52:03.456229 | controller | changed: .d..t...... ./ 2026-02-25 15:52:03.470981 | 2026-02-25 15:52:03.471068 | TASK [Return artifact to Zuul] 2026-02-25 15:52:03.499321 | controller | ok 2026-02-25 15:52:03.517434 | 2026-02-25 15:52:03.517496 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2026-02-25 15:52:03.517609 | 2026-02-25 15:52:03.517638 | PLAY RECAP 2026-02-25 15:52:03.517674 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2026-02-25 15:52:03.517696 | 2026-02-25 15:52:03.597416 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-25 15:52:03.598134 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-25 15:52:04.111354 | 2026-02-25 15:52:04.111455 | PLAY [all] 2026-02-25 15:52:04.129595 | 2026-02-25 15:52:04.129668 | TASK [include_role : fetch-output] 2026-02-25 15:52:04.157984 | controller | ok 2026-02-25 15:52:04.174150 | 2026-02-25 15:52:04.174229 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-25 15:52:04.218226 | controller | skipping: Conditional result was False 2026-02-25 15:52:04.223793 | 2026-02-25 15:52:04.223861 | TASK [fetch-output : Set log path for single node] 2026-02-25 15:52:04.252003 | controller | ok 2026-02-25 15:52:04.256805 | 2026-02-25 15:52:04.256872 | LOOP [fetch-output : Ensure local output dirs] 2026-02-25 15:52:04.574293 | controller -> localhost | ok: "/var/lib/zuul/builds/b37114dec2754585958f470bb78dd97b/work/logs" 2026-02-25 15:52:04.754652 | controller -> localhost | ok: "/var/lib/zuul/builds/b37114dec2754585958f470bb78dd97b/work/artifacts" 2026-02-25 15:52:04.934801 | controller -> localhost | ok: "/var/lib/zuul/builds/b37114dec2754585958f470bb78dd97b/work/docs" 2026-02-25 15:52:04.948194 | 2026-02-25 15:52:04.948315 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-25 15:52:05.531085 | controller | ok 2026-02-25 15:52:05.532396 | controller | ok: All items complete 2026-02-25 15:52:05.532520 | 2026-02-25 15:52:05.970331 | controller | ok 2026-02-25 15:52:06.398399 | controller | ok 2026-02-25 15:52:06.411192 | 2026-02-25 15:52:06.411465 | TASK [include_role : fetch-output-openshift] 2026-02-25 15:52:06.425364 | controller | skipping: Conditional result was False 2026-02-25 15:52:06.431080 | 2026-02-25 15:52:06.431150 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-02-25 15:52:06.762401 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006299 2026-02-25 15:52:06.944916 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006039 2026-02-25 15:52:06.976603 | 2026-02-25 15:52:06.976704 | PLAY [all] 2026-02-25 15:52:06.990353 | 2026-02-25 15:52:06.990436 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-02-25 15:52:07.466200 | controller | changed 2026-02-25 15:52:07.487328 | 2026-02-25 15:52:07.487380 | PLAY RECAP 2026-02-25 15:52:07.487425 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-02-25 15:52:07.487448 | 2026-02-25 15:52:07.559547 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-25 15:52:07.560272 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2026-02-25 15:52:08.086648 | 2026-02-25 15:52:08.086759 | PLAY [localhost] 2026-02-25 15:52:08.103278 | 2026-02-25 15:52:08.103376 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-02-25 15:52:08.404646 | localhost | changed 2026-02-25 15:52:08.408743 | 2026-02-25 15:52:08.408818 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-02-25 15:52:08.426899 | localhost | ok 2026-02-25 15:52:08.434425 | 2026-02-25 15:52:08.434499 | TASK [add-fileserver : Create SSH private key tempfile] 2026-02-25 15:52:08.705758 | localhost | changed 2026-02-25 15:52:08.710931 | 2026-02-25 15:52:08.711012 | TASK [add-fileserver : Create SSH private key from secret] 2026-02-25 15:52:09.224825 | localhost | changed 2026-02-25 15:52:09.229604 | 2026-02-25 15:52:09.229674 | TASK [add-fileserver : Add fileserver ssh key] 2026-02-25 15:52:09.561097 | localhost | Identity added: /var/lib/zuul/builds/b37114dec2754585958f470bb78dd97b/work/tmp/ansible.4r_e6kl6 (/var/lib/zuul/builds/b37114dec2754585958f470bb78dd97b/work/tmp/ansible.4r_e6kl6) 2026-02-25 15:52:09.561267 | localhost | ok: Runtime: 0:00:00.006025 2026-02-25 15:52:09.565552 | 2026-02-25 15:52:09.565625 | TASK [add-fileserver : Remove SSH private key from disk] 2026-02-25 15:52:09.775155 | localhost | ok: Runtime: 0:00:00.004353 2026-02-25 15:52:09.779808 | 2026-02-25 15:52:09.779883 | TASK [add-fileserver : Add fileserver to inventory] 2026-02-25 15:52:09.827693 | localhost | changed 2026-02-25 15:52:09.832730 | 2026-02-25 15:52:09.832799 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-02-25 15:52:10.153696 | localhost | changed 2026-02-25 15:52:10.172999 | 2026-02-25 15:52:10.173083 | PLAY [localhost] 2026-02-25 15:52:10.184288 | 2026-02-25 15:52:10.184375 | TASK [Generate bulk log download script] 2026-02-25 15:52:10.202183 | localhost | ok 2026-02-25 15:52:10.213329 | 2026-02-25 15:52:10.213402 | TASK [local-log-download : Check API endpoint is defined] 2026-02-25 15:52:10.240474 | localhost | ok: All assertions passed 2026-02-25 15:52:10.244799 | 2026-02-25 15:52:10.244863 | TASK [local-log-download : Create download script] 2026-02-25 15:52:10.602052 | localhost -> localhost | changed 2026-02-25 15:52:10.610505 | 2026-02-25 15:52:10.610593 | TASK [Register quick-download link] 2026-02-25 15:52:10.639270 | localhost | ok 2026-02-25 15:52:10.680731 | 2026-02-25 15:52:10.680799 | PLAY [logserver.rdoproject.org] 2026-02-25 15:52:10.690286 | 2026-02-25 15:52:10.690368 | TASK [Set zuul-log-path fact] 2026-02-25 15:52:10.708078 | logserver.rdoproject.org | ok 2026-02-25 15:52:10.717264 | 2026-02-25 15:52:10.717352 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-25 15:52:10.743635 | logserver.rdoproject.org | ok 2026-02-25 15:52:10.748878 | 2026-02-25 15:52:10.748945 | TASK [upload-logs : Create log directories] 2026-02-25 15:52:12.517155 | logserver.rdoproject.org | changed 2026-02-25 15:52:12.521113 | 2026-02-25 15:52:12.521183 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-02-25 15:52:12.739841 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005036 2026-02-25 15:52:12.745098 | 2026-02-25 15:52:12.745189 | TASK [upload-logs : Upload logs to log server] 2026-02-25 15:52:14.292862 | logserver.rdoproject.org | Output suppressed because no_log was given 2026-02-25 15:52:14.295979 | 2026-02-25 15:52:14.296064 | LOOP [upload-logs : Compress console log and json output] 2026-02-25 15:52:14.337036 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-25 15:52:14.345116 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-25 15:52:14.354370 | 2026-02-25 15:52:14.354467 | LOOP [upload-logs : Upload compressed console log and json output] 2026-02-25 15:52:14.394178 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-25 15:52:14.394490 | 2026-02-25 15:52:14.396699 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-25 15:52:14.402395 | 2026-02-25 15:52:14.402489 | LOOP [upload-logs : Upload console log and json output]