2026-02-24 09:56:00.606220 | Job console starting... 2026-02-24 09:56:00.827373 | Updating repositories 2026-02-24 09:56:01.585487 | Preparing job workspace 2026-02-24 09:56:09.941587 | Running Ansible setup... 2026-02-24 09:56:13.629923 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-24 09:56:14.160913 | 2026-02-24 09:56:14.161031 | PLAY [localhost] 2026-02-24 09:56:14.169235 | 2026-02-24 09:56:14.169324 | TASK [Gathering Facts] 2026-02-24 09:56:15.059267 | localhost | ok 2026-02-24 09:56:15.072537 | 2026-02-24 09:56:15.072619 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-02-24 09:56:15.453599 | localhost -> localhost | changed 2026-02-24 09:56:15.462563 | 2026-02-24 09:56:15.462689 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-02-24 09:56:16.221024 | localhost -> localhost | changed 2026-02-24 09:56:16.229568 | 2026-02-24 09:56:16.229660 | TASK [Setup log path fact] 2026-02-24 09:56:16.252866 | localhost | ok 2026-02-24 09:56:16.268900 | 2026-02-24 09:56:16.269166 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-24 09:56:16.298524 | localhost | ok 2026-02-24 09:56:16.305899 | 2026-02-24 09:56:16.305972 | TASK [emit-job-header : Print job information] 2026-02-24 09:56:16.335032 | # Job Information 2026-02-24 09:56:16.335173 | Ansible Version: 2.15.12 2026-02-24 09:56:16.335201 | Job: cifmw-molecule-reproducer 2026-02-24 09:56:16.335222 | Pipeline: github-check 2026-02-24 09:56:16.335240 | Executor: ibm-bm4-ze.softwarefactory-project.io 2026-02-24 09:56:16.335257 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3704 2026-02-24 09:56:16.335275 | Log URL (when completed): https://logserver.rdoproject.org/422/rdoproject.org/422af7b92dbd4d6b8a8ec07cb165d671/ 2026-02-24 09:56:16.335320 | Event ID: e34a26a0-1166-11f1-9383-cedcd9d89322 2026-02-24 09:56:16.339035 | 2026-02-24 09:56:16.339103 | LOOP [emit-job-header : Print node information] 2026-02-24 09:56:16.424507 | localhost | ok: 2026-02-24 09:56:16.424792 | localhost | # Node Information 2026-02-24 09:56:16.424836 | localhost | Inventory Hostname: controller 2026-02-24 09:56:16.424894 | localhost | Hostname: np0005627808 2026-02-24 09:56:16.424927 | localhost | Username: zuul 2026-02-24 09:56:16.424957 | localhost | Distro: CentOS 9 2026-02-24 09:56:16.424982 | localhost | Provider: ibm-bm4-nodepool 2026-02-24 09:56:16.425008 | localhost | Region: regionOne 2026-02-24 09:56:16.425032 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2026-02-24 09:56:16.425057 | localhost | Product Name: OpenStack Compute 2026-02-24 09:56:16.425082 | localhost | Interface IP: 192.168.26.241 2026-02-24 09:56:16.454900 | 2026-02-24 09:56:16.455018 | PLAY [all] 2026-02-24 09:56:16.461574 | 2026-02-24 09:56:16.461646 | TASK [Gather network facts] 2026-02-24 09:56:16.908888 | controller | ok 2026-02-24 09:56:16.923530 | 2026-02-24 09:56:16.923597 | TASK [include_role : start-zuul-console] 2026-02-24 09:56:16.942195 | controller | ok 2026-02-24 09:56:16.953282 | 2026-02-24 09:56:16.953362 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-02-24 09:56:17.337798 | controller | ok 2026-02-24 09:56:17.346397 | 2026-02-24 09:56:17.346471 | TASK [include_role : add-build-sshkey] 2026-02-24 09:56:17.377026 | controller | ok 2026-02-24 09:56:17.389859 | 2026-02-24 09:56:17.389925 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-02-24 09:56:17.591679 | controller -> localhost | ok 2026-02-24 09:56:17.598930 | 2026-02-24 09:56:17.599001 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-02-24 09:56:17.620364 | controller | ok 2026-02-24 09:56:17.633682 | controller | included: /var/lib/zuul/builds/422af7b92dbd4d6b8a8ec07cb165d671/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-24 09:56:17.639644 | 2026-02-24 09:56:17.639714 | TASK [add-build-sshkey : Create Temp SSH key] 2026-02-24 09:56:18.252030 | controller -> localhost | Generating public/private rsa key pair. 2026-02-24 09:56:18.252320 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/422af7b92dbd4d6b8a8ec07cb165d671/work/422af7b92dbd4d6b8a8ec07cb165d671_id_rsa. 2026-02-24 09:56:18.252366 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/422af7b92dbd4d6b8a8ec07cb165d671/work/422af7b92dbd4d6b8a8ec07cb165d671_id_rsa.pub. 2026-02-24 09:56:18.252391 | controller -> localhost | The key fingerprint is: 2026-02-24 09:56:18.252411 | controller -> localhost | SHA256:/4pA2iDBhi2ViISuSQUc9+rnabMz1aMm5kfIRxgBEOA zuul-build-sshkey 2026-02-24 09:56:18.252430 | controller -> localhost | The key's randomart image is: 2026-02-24 09:56:18.252448 | controller -> localhost | +---[RSA 3072]----+ 2026-02-24 09:56:18.252474 | controller -> localhost | |BB*+... | 2026-02-24 09:56:18.252493 | controller -> localhost | |=*o... | 2026-02-24 09:56:18.252510 | controller -> localhost | |+E* .o | 2026-02-24 09:56:18.252528 | controller -> localhost | | = ... . | 2026-02-24 09:56:18.252546 | controller -> localhost | |o...o + S | 2026-02-24 09:56:18.252562 | controller -> localhost | |o .. B + + | 2026-02-24 09:56:18.252578 | controller -> localhost | | ...* . o | 2026-02-24 09:56:18.252594 | controller -> localhost | | oB.= . . | 2026-02-24 09:56:18.252610 | controller -> localhost | | +=O . ... | 2026-02-24 09:56:18.252625 | controller -> localhost | +----[SHA256]-----+ 2026-02-24 09:56:18.252677 | controller -> localhost | ok: Runtime: 0:00:00.255643 2026-02-24 09:56:18.259830 | 2026-02-24 09:56:18.259905 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-02-24 09:56:18.290001 | controller | ok 2026-02-24 09:56:18.299767 | controller | included: /var/lib/zuul/builds/422af7b92dbd4d6b8a8ec07cb165d671/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-24 09:56:18.307312 | 2026-02-24 09:56:18.307383 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-02-24 09:56:18.332359 | controller | skipping: Conditional result was False 2026-02-24 09:56:18.339661 | 2026-02-24 09:56:18.339733 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-02-24 09:56:18.816974 | controller | changed 2026-02-24 09:56:18.822151 | 2026-02-24 09:56:18.822222 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-02-24 09:56:19.086703 | controller | ok 2026-02-24 09:56:19.091478 | 2026-02-24 09:56:19.091541 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-02-24 09:56:20.267637 | controller | changed 2026-02-24 09:56:20.273217 | 2026-02-24 09:56:20.273285 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-02-24 09:56:21.458787 | controller | changed 2026-02-24 09:56:21.463577 | 2026-02-24 09:56:21.463644 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-02-24 09:56:21.488263 | controller | skipping: Conditional result was False 2026-02-24 09:56:21.493486 | 2026-02-24 09:56:21.493556 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-02-24 09:56:21.790129 | controller -> localhost | changed 2026-02-24 09:56:21.799993 | 2026-02-24 09:56:21.800081 | TASK [add-build-sshkey : Add back temp key] 2026-02-24 09:56:22.016900 | controller -> localhost | Identity added: /var/lib/zuul/builds/422af7b92dbd4d6b8a8ec07cb165d671/work/422af7b92dbd4d6b8a8ec07cb165d671_id_rsa (zuul-build-sshkey) 2026-02-24 09:56:22.017109 | controller -> localhost | ok: Runtime: 0:00:00.007877 2026-02-24 09:56:22.023587 | 2026-02-24 09:56:22.023659 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-02-24 09:56:22.387415 | controller | ok 2026-02-24 09:56:22.391831 | 2026-02-24 09:56:22.391908 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-02-24 09:56:22.417503 | controller | skipping: Conditional result was False 2026-02-24 09:56:22.426680 | 2026-02-24 09:56:22.426763 | TASK [include_role : validate-host] 2026-02-24 09:56:22.446261 | controller | ok 2026-02-24 09:56:22.463590 | 2026-02-24 09:56:22.463663 | TASK [validate-host : Define zuul_info_dir fact] 2026-02-24 09:56:22.492633 | controller | ok 2026-02-24 09:56:22.497169 | 2026-02-24 09:56:22.497231 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-02-24 09:56:22.696721 | controller -> localhost | ok 2026-02-24 09:56:22.730011 | 2026-02-24 09:56:22.730099 | TASK [validate-host : Collect information about the host] 2026-02-24 09:56:23.432401 | controller | ok 2026-02-24 09:56:23.440102 | 2026-02-24 09:56:23.440167 | TASK [validate-host : Sanitize hostname] 2026-02-24 09:56:23.489859 | controller | ok 2026-02-24 09:56:23.494837 | 2026-02-24 09:56:23.494915 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-02-24 09:56:23.854926 | controller -> localhost | changed 2026-02-24 09:56:23.861281 | 2026-02-24 09:56:23.861368 | TASK [validate-host : Collect information about zuul worker] 2026-02-24 09:56:24.269476 | controller | ok 2026-02-24 09:56:24.274378 | 2026-02-24 09:56:24.274476 | TASK [validate-host : Write out all zuul information for each host] 2026-02-24 09:56:24.624164 | controller -> localhost | changed 2026-02-24 09:56:24.633587 | 2026-02-24 09:56:24.633653 | TASK [include_role : prepare-workspace-openshift] 2026-02-24 09:56:24.649122 | controller | skipping: Conditional result was False 2026-02-24 09:56:24.654866 | 2026-02-24 09:56:24.654941 | TASK [include_role : remove-zuul-sshkey] 2026-02-24 09:56:24.671408 | controller | skipping: Conditional result was False 2026-02-24 09:56:24.678274 | 2026-02-24 09:56:24.678386 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-02-24 09:56:24.946231 | controller | ok: "logs" 2026-02-24 09:56:24.946540 | controller | ok: All items complete 2026-02-24 09:56:24.946575 | 2026-02-24 09:56:25.193573 | controller | ok: "artifacts" 2026-02-24 09:56:25.452908 | controller | ok: "docs" 2026-02-24 09:56:25.459837 | 2026-02-24 09:56:25.459965 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-02-24 09:56:25.735782 | controller | changed: "logs" 2026-02-24 09:56:25.985874 | controller | changed: "artifacts" 2026-02-24 09:56:26.233348 | controller | changed: "docs" 2026-02-24 09:56:26.255743 | 2026-02-24 09:56:26.255826 | PLAY RECAP 2026-02-24 09:56:26.255874 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-24 09:56:26.255900 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-24 09:56:26.255918 | 2026-02-24 09:56:26.341904 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-24 09:56:26.342687 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-24 09:56:26.857036 | 2026-02-24 09:56:26.857147 | PLAY [all] 2026-02-24 09:56:26.874936 | 2026-02-24 09:56:26.875002 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-24 09:56:26.925534 | controller | ok 2026-02-24 09:56:26.930043 | 2026-02-24 09:56:26.930115 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-24 09:56:27.355515 | controller | changed 2026-02-24 09:56:27.360890 | 2026-02-24 09:56:27.360961 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-24 09:56:28.710830 | controller | changed 2026-02-24 09:56:28.720143 | 2026-02-24 09:56:28.720209 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2026-02-24 09:56:29.202697 | controller | changed: 2026-02-24 09:56:29.203244 | controller | { 2026-02-24 09:56:29.203395 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2026-02-24 09:56:29.203432 | controller | } 2026-02-24 09:56:29.509413 | controller | changed: 2026-02-24 09:56:29.509467 | controller | { 2026-02-24 09:56:29.509493 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2026-02-24 09:56:29.509513 | controller | } 2026-02-24 09:56:29.810420 | controller | changed: 2026-02-24 09:56:29.810551 | controller | { 2026-02-24 09:56:29.810576 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2026-02-24 09:56:29.810595 | controller | } 2026-02-24 09:56:30.105978 | controller | changed: 2026-02-24 09:56:30.106096 | controller | { 2026-02-24 09:56:30.106124 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2026-02-24 09:56:30.106145 | controller | } 2026-02-24 09:56:30.406797 | controller | changed: 2026-02-24 09:56:30.406867 | controller | { 2026-02-24 09:56:30.406891 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2026-02-24 09:56:30.406911 | controller | } 2026-02-24 09:56:30.707095 | controller | changed: 2026-02-24 09:56:30.707147 | controller | { 2026-02-24 09:56:30.707172 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2026-02-24 09:56:30.707190 | controller | } 2026-02-24 09:56:31.008823 | controller | changed: 2026-02-24 09:56:31.008877 | controller | { 2026-02-24 09:56:31.008902 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2026-02-24 09:56:31.008921 | controller | } 2026-02-24 09:56:31.310809 | controller | changed: 2026-02-24 09:56:31.310909 | controller | { 2026-02-24 09:56:31.310934 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2026-02-24 09:56:31.310953 | controller | } 2026-02-24 09:56:31.617543 | controller | changed: 2026-02-24 09:56:31.617608 | controller | { 2026-02-24 09:56:31.617634 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2026-02-24 09:56:31.617653 | controller | } 2026-02-24 09:56:31.921368 | controller | changed: 2026-02-24 09:56:31.921438 | controller | { 2026-02-24 09:56:31.921463 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2026-02-24 09:56:31.921483 | controller | } 2026-02-24 09:56:32.219246 | controller | changed: 2026-02-24 09:56:32.219549 | controller | { 2026-02-24 09:56:32.219579 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2026-02-24 09:56:32.219599 | controller | } 2026-02-24 09:56:32.535480 | controller | changed: 2026-02-24 09:56:32.535564 | controller | { 2026-02-24 09:56:32.535600 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2026-02-24 09:56:32.535620 | controller | } 2026-02-24 09:56:32.865241 | controller | changed: 2026-02-24 09:56:32.865349 | controller | { 2026-02-24 09:56:32.865377 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com" 2026-02-24 09:56:32.865399 | controller | } 2026-02-24 09:56:33.176966 | controller | changed: 2026-02-24 09:56:33.177032 | controller | { 2026-02-24 09:56:33.177058 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2026-02-24 09:56:33.177077 | controller | } 2026-02-24 09:56:33.482800 | controller | changed: 2026-02-24 09:56:33.482871 | controller | { 2026-02-24 09:56:33.482947 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2026-02-24 09:56:33.482971 | controller | } 2026-02-24 09:56:33.805984 | controller | changed: 2026-02-24 09:56:33.806099 | controller | { 2026-02-24 09:56:33.806126 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2026-02-24 09:56:33.806145 | controller | } 2026-02-24 09:56:34.121776 | controller | changed: 2026-02-24 09:56:34.121858 | controller | { 2026-02-24 09:56:34.121881 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2026-02-24 09:56:34.121901 | controller | } 2026-02-24 09:56:34.428804 | controller | changed: 2026-02-24 09:56:34.428875 | controller | { 2026-02-24 09:56:34.428899 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2026-02-24 09:56:34.428928 | controller | } 2026-02-24 09:56:34.724278 | controller | changed: 2026-02-24 09:56:34.724359 | controller | { 2026-02-24 09:56:34.724384 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2026-02-24 09:56:34.724402 | controller | } 2026-02-24 09:56:35.024401 | controller | changed: 2026-02-24 09:56:35.024459 | controller | { 2026-02-24 09:56:35.024485 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2026-02-24 09:56:35.024507 | controller | } 2026-02-24 09:56:35.326048 | controller | changed: 2026-02-24 09:56:35.326136 | controller | { 2026-02-24 09:56:35.326170 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2026-02-24 09:56:35.326189 | controller | } 2026-02-24 09:56:35.619937 | controller | changed: 2026-02-24 09:56:35.620007 | controller | { 2026-02-24 09:56:35.620039 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2026-02-24 09:56:35.620065 | controller | } 2026-02-24 09:56:35.929504 | controller | changed: 2026-02-24 09:56:35.929637 | controller | { 2026-02-24 09:56:35.929664 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2026-02-24 09:56:35.929685 | controller | } 2026-02-24 09:56:36.232701 | controller | changed: 2026-02-24 09:56:36.232752 | controller | { 2026-02-24 09:56:36.232775 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2026-02-24 09:56:36.232792 | controller | } 2026-02-24 09:56:36.537071 | controller | changed: 2026-02-24 09:56:36.537135 | controller | { 2026-02-24 09:56:36.537161 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2026-02-24 09:56:36.537180 | controller | } 2026-02-24 09:56:36.857324 | controller | changed: 2026-02-24 09:56:36.857626 | controller | { 2026-02-24 09:56:36.857650 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2026-02-24 09:56:36.857668 | controller | } 2026-02-24 09:56:36.872747 | 2026-02-24 09:56:36.872858 | TASK [Set timezone to UTC] 2026-02-24 09:56:37.401577 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2026-02-24 09:56:37.405924 | 2026-02-24 09:56:37.405987 | TASK [Create nodepool directory] 2026-02-24 09:56:37.701585 | controller | changed 2026-02-24 09:56:37.706617 | 2026-02-24 09:56:37.706677 | TASK [Create nodepool sub_nodes file] 2026-02-24 09:56:38.783644 | controller | changed 2026-02-24 09:56:38.788547 | 2026-02-24 09:56:38.788615 | TASK [Create nodepool sub_nodes_private file] 2026-02-24 09:56:39.880574 | controller | changed 2026-02-24 09:56:39.885638 | 2026-02-24 09:56:39.885714 | LOOP [Populate nodepool sub_nodes file] 2026-02-24 09:56:39.917173 | 2026-02-24 09:56:39.917338 | LOOP [Populate nodepool sub_nodes_private file] 2026-02-24 09:56:39.948066 | 2026-02-24 09:56:39.948210 | TASK [Create nodepool primary file] 2026-02-24 09:56:39.973338 | controller | skipping: Conditional result was False 2026-02-24 09:56:39.979140 | 2026-02-24 09:56:39.979214 | TASK [Create nodepool node_private for this node] 2026-02-24 09:56:41.096369 | controller | changed 2026-02-24 09:56:41.101981 | 2026-02-24 09:56:41.102044 | LOOP [Copy ssh keys to nodepool directory] 2026-02-24 09:56:41.514990 | controller | ok: Item: id_rsa Runtime: 0:00:00.005781 2026-02-24 09:56:41.515225 | 2026-02-24 09:56:41.757942 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.005264 2026-02-24 09:56:41.774194 | 2026-02-24 09:56:41.774341 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2026-02-24 09:56:42.909735 | controller | changed 2026-02-24 09:56:42.914821 | 2026-02-24 09:56:42.914914 | TASK [Validate sudoers config after edits] 2026-02-24 09:56:43.202481 | controller | /etc/sudoers: parsed OK 2026-02-24 09:56:43.202579 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2026-02-24 09:56:43.202590 | controller | /etc/sudoers.d/zuul: parsed OK 2026-02-24 09:56:43.202597 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2026-02-24 09:56:43.443788 | controller | ok: Runtime: 0:00:00.006255 2026-02-24 09:56:43.449906 | 2026-02-24 09:56:43.449978 | TASK [Show the environment passed in to job shell scripts] 2026-02-24 09:56:43.722496 | controller | SHELL=/bin/bash 2026-02-24 09:56:43.722561 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2026-02-24 09:56:43.722576 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2026-02-24 09:56:43.722649 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/06/3706/c8624b7468d2ae8916f1fc7427f6643fbf0ac01c^openstack-k8s-operators/ci-framework:main:refs/changes/04/3704/37dfd862c334dda801964f6b3c71086ecff5a352 2026-02-24 09:56:43.722664 | controller | PWD=/home/zuul 2026-02-24 09:56:43.722670 | controller | ZUUL_PIPELINE=github-check 2026-02-24 09:56:43.722676 | controller | LOGNAME=zuul 2026-02-24 09:56:43.722682 | controller | XDG_SESSION_TYPE=tty 2026-02-24 09:56:43.722687 | controller | _=/usr/bin/env 2026-02-24 09:56:43.722692 | controller | MOTD_SHOWN=pam 2026-02-24 09:56:43.722698 | controller | HOME=/home/zuul 2026-02-24 09:56:43.722703 | controller | LANG=en_US.UTF-8 2026-02-24 09:56:43.722708 | controller | SSH_CONNECTION=192.168.26.12 60262 192.168.26.241 22 2026-02-24 09:56:43.722714 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2026-02-24 09:56:43.722721 | controller | ZUUL_CHANGE_IDS=3706,c8624b7468d2ae8916f1fc7427f6643fbf0ac01c 3704,37dfd862c334dda801964f6b3c71086ecff5a352 2026-02-24 09:56:43.722726 | controller | WORKSPACE=/home/zuul/workspace 2026-02-24 09:56:43.722732 | controller | XDG_SESSION_CLASS=user 2026-02-24 09:56:43.722738 | controller | SELINUX_ROLE_REQUESTED= 2026-02-24 09:56:43.722743 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2026-02-24 09:56:43.722748 | controller | USER=zuul 2026-02-24 09:56:43.722754 | controller | ZUUL_VOTING=True 2026-02-24 09:56:43.722759 | controller | BUILD_TIMEOUT=5400000 2026-02-24 09:56:43.722764 | controller | SELINUX_USE_CURRENT_RANGE= 2026-02-24 09:56:43.722769 | controller | SHLVL=1 2026-02-24 09:56:43.722774 | controller | ZUUL_PATCHSET=37dfd862c334dda801964f6b3c71086ecff5a352 2026-02-24 09:56:43.722780 | controller | XDG_SESSION_ID=1 2026-02-24 09:56:43.722785 | controller | ZUUL_BRANCH=main 2026-02-24 09:56:43.722791 | controller | XDG_RUNTIME_DIR=/run/user/1000 2026-02-24 09:56:43.722796 | controller | SSH_CLIENT=192.168.26.12 60262 22 2026-02-24 09:56:43.722802 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2026-02-24 09:56:43.722807 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2026-02-24 09:56:43.722813 | controller | which_declare=declare -f 2026-02-24 09:56:43.722819 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2026-02-24 09:56:43.722825 | controller | SELINUX_LEVEL_REQUESTED= 2026-02-24 09:56:43.722830 | controller | ZUUL_CHANGE=3704 2026-02-24 09:56:43.722835 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2026-02-24 09:56:43.722840 | controller | ZUUL_UUID=422af7b92dbd4d6b8a8ec07cb165d671 2026-02-24 09:56:43.722846 | controller | BASH_FUNC_which%%=() { ( alias; 2026-02-24 09:56:43.722851 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2026-02-24 09:56:43.722857 | controller | } 2026-02-24 09:56:43.973826 | controller | ok: Runtime: 0:00:00.006433 2026-02-24 09:56:43.979601 | 2026-02-24 09:56:43.979668 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2026-02-24 09:56:44.005225 | controller | skipping: Conditional result was False 2026-02-24 09:56:44.010546 | 2026-02-24 09:56:44.010614 | TASK [Symlink /home/zuul-worker/workspace] 2026-02-24 09:56:44.565721 | controller | skipping: Conditional result was False 2026-02-24 09:56:44.571636 | 2026-02-24 09:56:44.571712 | TASK [Ensure legacy workspace directory] 2026-02-24 09:56:44.886351 | controller | changed 2026-02-24 09:56:44.905392 | 2026-02-24 09:56:44.905460 | PLAY RECAP 2026-02-24 09:56:44.905510 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-24 09:56:44.905534 | 2026-02-24 09:56:44.991836 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-24 09:56:44.992656 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-24 09:56:45.506103 | 2026-02-24 09:56:45.506213 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2026-02-24 09:56:45.526009 | 2026-02-24 09:56:45.526085 | TASK [Create zuul-output directory] 2026-02-24 09:56:45.911868 | controller | changed 2026-02-24 09:56:45.916921 | 2026-02-24 09:56:45.917011 | TASK [Slurp Zuul inventory test] 2026-02-24 09:56:46.174411 | controller -> localhost | ok 2026-02-24 09:56:46.180432 | 2026-02-24 09:56:46.180503 | TASK [Save zuul inventory] 2026-02-24 09:56:47.542896 | controller | changed 2026-02-24 09:56:47.548514 | 2026-02-24 09:56:47.548579 | TASK [Save zuul vars without the change_message] 2026-02-24 09:56:48.748004 | controller | changed 2026-02-24 09:56:48.767863 | 2026-02-24 09:56:48.767916 | PLAY RECAP 2026-02-24 09:56:48.767962 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-24 09:56:48.767985 | 2026-02-24 09:56:48.845912 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-24 09:56:48.846715 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-24 09:56:49.380741 | 2026-02-24 09:56:49.380857 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2026-02-24 09:56:49.401862 | 2026-02-24 09:56:49.401938 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2026-02-24 09:56:49.422733 | controller | ok 2026-02-24 09:56:49.438521 | 2026-02-24 09:56:49.438604 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-24 09:56:49.463537 | controller | skipping: Conditional result was False 2026-02-24 09:56:49.468671 | 2026-02-24 09:56:49.468741 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-24 09:56:49.862876 | controller | ok 2026-02-24 09:56:49.868456 | 2026-02-24 09:56:49.868526 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-24 09:56:50.886090 | controller | ok 2026-02-24 09:56:50.895383 | 2026-02-24 09:56:50.895447 | TASK [Prepare workspace] 2026-02-24 09:56:50.916287 | controller | ok 2026-02-24 09:56:50.933192 | 2026-02-24 09:56:50.933277 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-02-24 09:56:51.319691 | controller | ok 2026-02-24 09:56:51.325477 | 2026-02-24 09:56:51.325547 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-02-24 09:56:53.731740 | controller | Output suppressed because no_log was given 2026-02-24 09:56:53.740506 | 2026-02-24 09:56:53.740572 | LOOP [Create zuul-output directory] 2026-02-24 09:56:54.003037 | controller | changed: "/home/zuul/ci-framework-data/logs" 2026-02-24 09:56:54.234911 | controller | ok: "/home/zuul/zuul-output/logs" 2026-02-24 09:56:54.242002 | 2026-02-24 09:56:54.242158 | TASK [Install required packages] 2026-02-24 09:57:12.635926 | controller | ok: Nothing to do 2026-02-24 09:57:12.640454 | 2026-02-24 09:57:12.640511 | TASK [Install venv] 2026-02-24 09:58:10.344835 | controller | changed 2026-02-24 09:58:10.398195 | 2026-02-24 09:58:10.398352 | PLAY RECAP 2026-02-24 09:58:10.398409 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-24 09:58:10.398445 | 2026-02-24 09:58:10.473881 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-24 09:58:10.474737 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-24 09:58:11.003772 | 2026-02-24 09:58:11.003914 | PLAY [Run ci/playbooks/molecule-test.yml] 2026-02-24 09:58:11.025163 | 2026-02-24 09:58:11.025236 | TASK [Gather required facts] 2026-02-24 09:58:11.577185 | controller | ok 2026-02-24 09:58:11.582852 | 2026-02-24 09:58:11.582934 | TASK [Load environment var if instructed to] 2026-02-24 09:58:11.609899 | controller | skipping: Conditional result was False 2026-02-24 09:58:11.615702 | 2026-02-24 09:58:11.615771 | TASK [Ensure group_vars dir exists] 2026-02-24 09:58:12.006626 | controller | ok 2026-02-24 09:58:12.012178 | 2026-02-24 09:58:12.012257 | TASK [Print related variables] 2026-02-24 09:58:12.041164 | controller | ok: 2026-02-24 09:58:12.041279 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2026-02-24 09:58:12.041326 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2026-02-24 09:58:12.045774 | 2026-02-24 09:58:12.045834 | TASK [Run molecule] 2026-02-24 09:58:13.036692 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2026-02-24 09:58:13.301897 | controller | INFO Performing prerun with role_name_check=0... 2026-02-24 09:58:29.817512 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.817909 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.818329 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.818727 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.819146 | controller | WARNING Another version of 'cifmw.general' 1.0.0+3ff841ba was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+3ff841ba (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.819547 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.819937 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.820342 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.820731 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.821119 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.821525 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.821921 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.822306 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.822701 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.823092 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 09:58:29.832052 | controller | INFO Running crc_layout > prepare 2026-02-24 09:58:30.471537 | controller | 2026-02-24 09:58:30.471734 | controller | PLAY [Prepare] ***************************************************************** 2026-02-24 09:58:30.471816 | controller | 2026-02-24 09:58:30.471908 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-24 09:58:30.472002 | controller | Tuesday 24 February 2026 09:58:30 +0000 (0:00:00.019) 0:00:00.019 ****** 2026-02-24 09:58:31.294034 | controller | ok: [instance] 2026-02-24 09:58:31.294087 | controller | 2026-02-24 09:58:31.294171 | controller | TASK [Create custom basedir] *************************************************** 2026-02-24 09:58:31.294257 | controller | Tuesday 24 February 2026 09:58:31 +0000 (0:00:00.823) 0:00:00.842 ****** 2026-02-24 09:58:31.606317 | controller | changed: [instance] 2026-02-24 09:58:31.606426 | controller | 2026-02-24 09:58:31.606550 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2026-02-24 09:58:31.606674 | controller | Tuesday 24 February 2026 09:58:31 +0000 (0:00:00.312) 0:00:01.155 ****** 2026-02-24 09:58:31.626025 | controller | skipping: [instance] 2026-02-24 09:58:31.626199 | controller | 2026-02-24 09:58:31.626411 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2026-02-24 09:58:31.626595 | controller | Tuesday 24 February 2026 09:58:31 +0000 (0:00:00.019) 0:00:01.174 ****** 2026-02-24 09:58:31.668972 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2026-02-24 09:58:31.669064 | controller | 2026-02-24 09:58:31.669159 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2026-02-24 09:58:31.669254 | controller | Tuesday 24 February 2026 09:58:31 +0000 (0:00:00.042) 0:00:01.217 ****** 2026-02-24 09:58:31.961822 | controller | ok: [instance] 2026-02-24 09:58:31.961882 | controller | 2026-02-24 09:58:31.961980 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2026-02-24 09:58:31.962067 | controller | Tuesday 24 February 2026 09:58:31 +0000 (0:00:00.291) 0:00:01.509 ****** 2026-02-24 09:58:32.157048 | controller | ok: [instance] 2026-02-24 09:58:32.157126 | controller | 2026-02-24 09:58:32.157220 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2026-02-24 09:58:32.157331 | controller | Tuesday 24 February 2026 09:58:32 +0000 (0:00:00.196) 0:00:01.705 ****** 2026-02-24 09:58:32.824199 | controller | ok: [instance] => (item=ubi-9-appstream) 2026-02-24 09:58:32.824293 | controller | ok: [instance] => (item=ubi-9-baseos) 2026-02-24 09:58:32.824404 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2026-02-24 09:58:32.824499 | controller | 2026-02-24 09:58:32.824594 | controller | TASK [Deploy repo-setup] ******************************************************* 2026-02-24 09:58:32.824686 | controller | Tuesday 24 February 2026 09:58:32 +0000 (0:00:00.666) 0:00:02.372 ****** 2026-02-24 09:58:32.881205 | controller | 2026-02-24 09:58:32.881296 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-24 09:58:32.881404 | controller | Tuesday 24 February 2026 09:58:32 +0000 (0:00:00.057) 0:00:02.430 ****** 2026-02-24 09:58:33.387530 | controller | changed: [instance] => (item=tmp) 2026-02-24 09:58:33.387590 | controller | changed: [instance] => (item=artifacts/repositories) 2026-02-24 09:58:33.387684 | controller | changed: [instance] => (item=venv/repo_setup) 2026-02-24 09:58:33.387764 | controller | 2026-02-24 09:58:33.387864 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-24 09:58:33.387956 | controller | Tuesday 24 February 2026 09:58:33 +0000 (0:00:00.506) 0:00:02.936 ****** 2026-02-24 09:58:34.237492 | controller | ok: [instance] 2026-02-24 09:58:34.237566 | controller | 2026-02-24 09:58:34.237859 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-24 09:58:35.261351 | controller | Tuesday 24 February 2026 09:58:34 +0000 (0:00:00.849) 0:00:03.786 ****** 2026-02-24 09:58:35.261385 | controller | changed: [instance] 2026-02-24 09:58:35.261412 | controller | 2026-02-24 09:58:35.261663 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-24 09:58:42.545965 | controller | Tuesday 24 February 2026 09:58:35 +0000 (0:00:01.023) 0:00:04.810 ****** 2026-02-24 09:58:42.545998 | controller | changed: [instance] 2026-02-24 09:58:43.230146 | controller | 2026-02-24 09:58:43.230175 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-24 09:58:43.230183 | controller | Tuesday 24 February 2026 09:58:42 +0000 (0:00:07.284) 0:00:12.094 ****** 2026-02-24 09:58:43.230193 | controller | changed: [instance] 2026-02-24 09:58:43.253124 | controller | 2026-02-24 09:58:43.253142 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-24 09:58:43.253149 | controller | Tuesday 24 February 2026 09:58:43 +0000 (0:00:00.684) 0:00:12.778 ****** 2026-02-24 09:58:43.253158 | controller | skipping: [instance] 2026-02-24 09:58:44.051393 | controller | 2026-02-24 09:58:44.051430 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-24 09:58:44.051440 | controller | Tuesday 24 February 2026 09:58:43 +0000 (0:00:00.023) 0:00:12.801 ****** 2026-02-24 09:58:44.051453 | controller | changed: [instance] 2026-02-24 09:58:44.051484 | controller | 2026-02-24 09:58:44.051510 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-24 09:58:44.051630 | controller | Tuesday 24 February 2026 09:58:44 +0000 (0:00:00.798) 0:00:13.600 ****** 2026-02-24 09:58:44.088177 | controller | skipping: [instance] 2026-02-24 09:58:44.123375 | controller | 2026-02-24 09:58:44.123412 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-24 09:58:44.123420 | controller | Tuesday 24 February 2026 09:58:44 +0000 (0:00:00.036) 0:00:13.636 ****** 2026-02-24 09:58:44.123430 | controller | skipping: [instance] 2026-02-24 09:58:44.123748 | controller | 2026-02-24 09:58:44.158366 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-24 09:58:44.158393 | controller | Tuesday 24 February 2026 09:58:44 +0000 (0:00:00.035) 0:00:13.671 ****** 2026-02-24 09:58:44.158406 | controller | skipping: [instance] 2026-02-24 09:58:44.158441 | controller | 2026-02-24 09:58:44.158695 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-24 09:58:44.680164 | controller | Tuesday 24 February 2026 09:58:44 +0000 (0:00:00.035) 0:00:13.707 ****** 2026-02-24 09:58:44.680205 | controller | changed: [instance] 2026-02-24 09:58:45.113411 | controller | 2026-02-24 09:58:45.113445 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-24 09:58:45.113455 | controller | Tuesday 24 February 2026 09:58:44 +0000 (0:00:00.521) 0:00:14.228 ****** 2026-02-24 09:58:45.113467 | controller | changed: [instance] 2026-02-24 09:58:45.113526 | controller | 2026-02-24 09:58:45.113554 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-24 09:58:45.113565 | controller | Tuesday 24 February 2026 09:58:45 +0000 (0:00:00.433) 0:00:14.662 ****** 2026-02-24 09:58:45.142438 | controller | skipping: [instance] 2026-02-24 09:58:45.171310 | controller | 2026-02-24 09:58:45.171334 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-24 09:58:45.171343 | controller | Tuesday 24 February 2026 09:58:45 +0000 (0:00:00.028) 0:00:14.691 ****** 2026-02-24 09:58:45.171355 | controller | skipping: [instance] 2026-02-24 09:58:45.199031 | controller | 2026-02-24 09:58:45.199057 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-24 09:58:45.199067 | controller | Tuesday 24 February 2026 09:58:45 +0000 (0:00:00.028) 0:00:14.719 ****** 2026-02-24 09:58:45.199077 | controller | skipping: [instance] 2026-02-24 09:58:45.236116 | controller | 2026-02-24 09:58:45.236138 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-24 09:58:45.236147 | controller | Tuesday 24 February 2026 09:58:45 +0000 (0:00:00.027) 0:00:14.747 ****** 2026-02-24 09:58:45.236158 | controller | ok: [instance] 2026-02-24 09:58:45.236238 | controller | 2026-02-24 09:58:45.236249 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-24 09:58:45.236259 | controller | Tuesday 24 February 2026 09:58:45 +0000 (0:00:00.037) 0:00:14.784 ****** 2026-02-24 09:58:45.262330 | controller | skipping: [instance] 2026-02-24 09:58:45.289024 | controller | 2026-02-24 09:58:45.289062 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-24 09:58:45.289076 | controller | Tuesday 24 February 2026 09:58:45 +0000 (0:00:00.026) 0:00:14.810 ****** 2026-02-24 09:58:45.289093 | controller | skipping: [instance] 2026-02-24 09:58:45.289198 | controller | 2026-02-24 09:58:45.289422 | controller | TASK [Download the RPM] ******************************************************** 2026-02-24 09:58:45.289503 | controller | Tuesday 24 February 2026 09:58:45 +0000 (0:00:00.026) 0:00:14.837 ****** 2026-02-24 09:58:45.314492 | controller | skipping: [instance] 2026-02-24 09:58:45.314617 | controller | 2026-02-24 09:58:45.314776 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-24 09:58:45.314857 | controller | Tuesday 24 February 2026 09:58:45 +0000 (0:00:00.026) 0:00:14.863 ****** 2026-02-24 09:58:45.340629 | controller | skipping: [instance] 2026-02-24 09:58:45.340772 | controller | 2026-02-24 09:58:45.340892 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-24 09:58:45.341001 | controller | Tuesday 24 February 2026 09:58:45 +0000 (0:00:00.026) 0:00:14.889 ****** 2026-02-24 09:58:45.366679 | controller | skipping: [instance] 2026-02-24 09:58:45.366820 | controller | 2026-02-24 09:58:45.366937 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-24 09:58:45.367049 | controller | Tuesday 24 February 2026 09:58:45 +0000 (0:00:00.026) 0:00:14.915 ****** 2026-02-24 09:58:45.395448 | controller | skipping: [instance] 2026-02-24 09:58:45.395574 | controller | 2026-02-24 09:58:45.395745 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-24 09:58:45.395861 | controller | Tuesday 24 February 2026 09:58:45 +0000 (0:00:00.028) 0:00:14.944 ****** 2026-02-24 09:58:45.435629 | controller | skipping: [instance] 2026-02-24 09:58:45.435735 | controller | 2026-02-24 09:58:45.435895 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-24 09:58:45.435997 | controller | Tuesday 24 February 2026 09:58:45 +0000 (0:00:00.039) 0:00:14.984 ****** 2026-02-24 09:58:45.622850 | controller | ok: [instance] 2026-02-24 09:58:45.828067 | controller | 2026-02-24 09:58:45.828090 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-24 09:58:45.828099 | controller | Tuesday 24 February 2026 09:58:45 +0000 (0:00:00.186) 0:00:15.171 ****** 2026-02-24 09:58:45.828110 | controller | changed: [instance] 2026-02-24 09:58:46.044897 | controller | 2026-02-24 09:58:46.044916 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-24 09:58:46.044924 | controller | Tuesday 24 February 2026 09:58:45 +0000 (0:00:00.205) 0:00:15.376 ****** 2026-02-24 09:58:46.044934 | controller | changed: [instance] 2026-02-24 09:58:46.067947 | controller | 2026-02-24 09:58:46.067966 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-24 09:58:46.067973 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.216) 0:00:15.593 ****** 2026-02-24 09:58:46.067982 | controller | skipping: [instance] 2026-02-24 09:58:46.089668 | controller | 2026-02-24 09:58:46.089686 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-24 09:58:46.089693 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.023) 0:00:15.616 ****** 2026-02-24 09:58:46.089707 | controller | skipping: [instance] 2026-02-24 09:58:46.112066 | controller | 2026-02-24 09:58:46.112084 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-24 09:58:46.112092 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.021) 0:00:15.638 ****** 2026-02-24 09:58:46.112101 | controller | skipping: [instance] 2026-02-24 09:58:46.133074 | controller | 2026-02-24 09:58:46.133091 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-24 09:58:46.133098 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.022) 0:00:15.660 ****** 2026-02-24 09:58:46.133106 | controller | skipping: [instance] 2026-02-24 09:58:46.153651 | controller | 2026-02-24 09:58:46.153668 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-24 09:58:46.153680 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.021) 0:00:15.681 ****** 2026-02-24 09:58:46.153688 | controller | skipping: [instance] 2026-02-24 09:58:46.175950 | controller | 2026-02-24 09:58:46.175969 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-24 09:58:46.175976 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.020) 0:00:15.702 ****** 2026-02-24 09:58:46.175987 | controller | skipping: [instance] 2026-02-24 09:58:46.192923 | controller | 2026-02-24 09:58:46.192941 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-24 09:58:46.192948 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.022) 0:00:15.724 ****** 2026-02-24 09:58:46.192957 | controller | skipping: [instance] 2026-02-24 09:58:46.221342 | controller | 2026-02-24 09:58:46.221360 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-24 09:58:46.221367 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.017) 0:00:15.741 ****** 2026-02-24 09:58:46.221376 | controller | skipping: [instance] 2026-02-24 09:58:46.239166 | controller | 2026-02-24 09:58:46.239182 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-24 09:58:46.239189 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.028) 0:00:15.770 ****** 2026-02-24 09:58:46.239198 | controller | skipping: [instance] 2026-02-24 09:58:46.259567 | controller | 2026-02-24 09:58:46.259584 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-24 09:58:46.259591 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.017) 0:00:15.787 ****** 2026-02-24 09:58:46.259599 | controller | skipping: [instance] 2026-02-24 09:58:46.288930 | controller | 2026-02-24 09:58:46.288949 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2026-02-24 09:58:46.288957 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.020) 0:00:15.808 ****** 2026-02-24 09:58:46.288967 | controller | skipping: [instance] 2026-02-24 09:58:46.319021 | controller | 2026-02-24 09:58:46.319042 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2026-02-24 09:58:46.319051 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.029) 0:00:15.837 ****** 2026-02-24 09:58:46.319062 | controller | skipping: [instance] 2026-02-24 09:58:46.345922 | controller | 2026-02-24 09:58:46.345943 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2026-02-24 09:58:46.345952 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.030) 0:00:15.867 ****** 2026-02-24 09:58:46.345963 | controller | skipping: [instance] 2026-02-24 09:58:46.373806 | controller | 2026-02-24 09:58:46.373820 | controller | TASK [test_deps : Install additional packages] ********************************* 2026-02-24 09:58:46.373827 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.026) 0:00:15.894 ****** 2026-02-24 09:58:46.373834 | controller | skipping: [instance] 2026-02-24 09:59:31.413349 | controller | 2026-02-24 09:59:31.413381 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2026-02-24 09:59:31.413389 | controller | Tuesday 24 February 2026 09:58:46 +0000 (0:00:00.027) 0:00:15.922 ****** 2026-02-24 09:59:31.413399 | controller | ok: [instance] 2026-02-24 09:59:32.582747 | controller | 2026-02-24 09:59:32.582773 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2026-02-24 09:59:32.582783 | controller | Tuesday 24 February 2026 09:59:31 +0000 (0:00:45.039) 0:01:00.961 ****** 2026-02-24 09:59:32.582794 | controller | ok: [instance] 2026-02-24 09:59:32.614417 | controller | 2026-02-24 09:59:32.614459 | controller | TASK [test_deps : Install extra packages] ************************************** 2026-02-24 09:59:32.614474 | controller | Tuesday 24 February 2026 09:59:32 +0000 (0:00:01.169) 0:01:02.131 ****** 2026-02-24 09:59:32.614489 | controller | skipping: [instance] 2026-02-24 09:59:32.654420 | controller | 2026-02-24 09:59:32.654458 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-24 09:59:32.654469 | controller | Tuesday 24 February 2026 09:59:32 +0000 (0:00:00.031) 0:01:02.162 ****** 2026-02-24 09:59:32.654483 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2026-02-24 09:59:32.654499 | controller | 2026-02-24 09:59:32.654507 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-24 09:59:32.654523 | controller | Tuesday 24 February 2026 09:59:32 +0000 (0:00:00.040) 0:01:02.202 ****** 2026-02-24 09:59:32.674405 | controller | ok: [instance] => 2026-02-24 09:59:32.674833 | controller | cifmw_ci_setup_packages: 2026-02-24 09:59:32.674848 | controller | - bash-completion 2026-02-24 09:59:32.674855 | controller | - ca-certificates 2026-02-24 09:59:32.674861 | controller | - git-core 2026-02-24 09:59:32.674866 | controller | - make 2026-02-24 09:59:32.674871 | controller | - tar 2026-02-24 09:59:32.674879 | controller | - tmux 2026-02-24 09:59:44.179435 | controller | - python3-pip 2026-02-24 09:59:44.179466 | controller | 2026-02-24 09:59:44.179474 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-24 09:59:44.179490 | controller | Tuesday 24 February 2026 09:59:32 +0000 (0:00:00.019) 0:01:02.222 ****** 2026-02-24 09:59:44.179500 | controller | changed: [instance] 2026-02-24 09:59:44.179581 | controller | 2026-02-24 09:59:44.179710 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-24 09:59:44.179743 | controller | Tuesday 24 February 2026 09:59:44 +0000 (0:00:11.505) 0:01:13.728 ****** 2026-02-24 09:59:44.753800 | controller | ok: [instance] 2026-02-24 09:59:44.753954 | controller | 2026-02-24 09:59:44.753987 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-24 09:59:44.753997 | controller | Tuesday 24 February 2026 09:59:44 +0000 (0:00:00.574) 0:01:14.302 ****** 2026-02-24 09:59:44.966719 | controller | changed: [instance] 2026-02-24 09:59:44.966785 | controller | 2026-02-24 09:59:44.967044 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-24 09:59:50.866145 | controller | Tuesday 24 February 2026 09:59:44 +0000 (0:00:00.212) 0:01:14.515 ****** 2026-02-24 09:59:50.866183 | controller | changed: [instance] 2026-02-24 09:59:50.901155 | controller | 2026-02-24 09:59:50.901172 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-24 09:59:50.901179 | controller | Tuesday 24 February 2026 09:59:50 +0000 (0:00:05.899) 0:01:20.414 ****** 2026-02-24 09:59:50.901187 | controller | ok: [instance] 2026-02-24 09:59:51.171785 | controller | 2026-02-24 09:59:51.171806 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-24 09:59:51.171814 | controller | Tuesday 24 February 2026 09:59:50 +0000 (0:00:00.035) 0:01:20.449 ****** 2026-02-24 09:59:51.171823 | controller | changed: [instance] 2026-02-24 09:59:51.443662 | controller | 2026-02-24 09:59:51.443683 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-24 09:59:51.443691 | controller | Tuesday 24 February 2026 09:59:51 +0000 (0:00:00.270) 0:01:20.720 ****** 2026-02-24 09:59:51.443700 | controller | changed: [instance] 2026-02-24 09:59:51.461464 | controller | 2026-02-24 09:59:51.461505 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-24 09:59:51.461516 | controller | Tuesday 24 February 2026 09:59:51 +0000 (0:00:00.272) 0:01:20.992 ****** 2026-02-24 09:59:51.461529 | controller | skipping: [instance] 2026-02-24 09:59:51.478355 | controller | 2026-02-24 09:59:51.478376 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-24 09:59:51.478385 | controller | Tuesday 24 February 2026 09:59:51 +0000 (0:00:00.017) 0:01:21.010 ****** 2026-02-24 09:59:51.478395 | controller | skipping: [instance] 2026-02-24 09:59:51.478432 | controller | 2026-02-24 09:59:51.478546 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-24 09:59:51.478642 | controller | Tuesday 24 February 2026 09:59:51 +0000 (0:00:00.017) 0:01:21.027 ****** 2026-02-24 09:59:51.496753 | controller | skipping: [instance] 2026-02-24 09:59:51.496813 | controller | 2026-02-24 09:59:51.496968 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-24 09:59:51.497049 | controller | Tuesday 24 February 2026 09:59:51 +0000 (0:00:00.018) 0:01:21.045 ****** 2026-02-24 09:59:51.516223 | controller | skipping: [instance] 2026-02-24 09:59:51.533965 | controller | 2026-02-24 09:59:51.533987 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-24 09:59:51.534005 | controller | Tuesday 24 February 2026 09:59:51 +0000 (0:00:00.019) 0:01:21.064 ****** 2026-02-24 09:59:51.534017 | controller | skipping: [instance] 2026-02-24 09:59:51.584478 | controller | 2026-02-24 09:59:51.584608 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-24 09:59:51.584626 | controller | Tuesday 24 February 2026 09:59:51 +0000 (0:00:00.017) 0:01:21.082 ****** 2026-02-24 09:59:51.584650 | controller | skipping: [instance] 2026-02-24 09:59:52.558413 | controller | 2026-02-24 09:59:52.558450 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-24 09:59:52.558459 | controller | Tuesday 24 February 2026 09:59:51 +0000 (0:00:00.050) 0:01:21.133 ****** 2026-02-24 09:59:52.558470 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2026-02-24 09:59:52.558501 | controller | changed: [instance] => (item=/opt/basedir/logs) 2026-02-24 09:59:52.558508 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2026-02-24 09:59:52.558514 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2026-02-24 09:59:52.558522 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2026-02-24 09:59:52.558777 | controller | 2026-02-24 09:59:52.558841 | controller | TASK [Create secret file] ****************************************************** 2026-02-24 09:59:52.891450 | controller | Tuesday 24 February 2026 09:59:52 +0000 (0:00:00.973) 0:01:22.106 ****** 2026-02-24 09:59:52.891522 | controller | changed: [instance] 2026-02-24 09:59:52.891563 | controller | 2026-02-24 09:59:52.891576 | controller | PLAY RECAP ********************************************************************* 2026-02-24 09:59:52.893347 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2026-02-24 09:59:52.893364 | controller | 2026-02-24 09:59:52.893491 | controller | Tuesday 24 February 2026 09:59:52 +0000 (0:00:00.333) 0:01:22.439 ****** 2026-02-24 09:59:52.893525 | controller | =============================================================================== 2026-02-24 09:59:52.893532 | controller | test_deps : Install selinux python libs -------------------------------- 45.04s 2026-02-24 09:59:52.893538 | controller | ci_setup : Install needed packages ------------------------------------- 11.51s 2026-02-24 09:59:52.893543 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.28s 2026-02-24 09:59:52.893548 | controller | ci_setup : Install openshift client ------------------------------------- 5.90s 2026-02-24 09:59:52.893553 | controller | test_deps : Install python yaml libs ------------------------------------ 1.17s 2026-02-24 09:59:52.893558 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.02s 2026-02-24 09:59:52.893563 | controller | ci_setup : Manage directories ------------------------------------------- 0.97s 2026-02-24 09:59:52.893568 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.85s 2026-02-24 09:59:52.893573 | controller | Gathering Facts --------------------------------------------------------- 0.82s 2026-02-24 09:59:52.893578 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.80s 2026-02-24 09:59:52.893583 | controller | repo_setup : Install repo-setup package --------------------------------- 0.68s 2026-02-24 09:59:52.893587 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.67s 2026-02-24 09:59:52.893592 | controller | ci_setup : Gather version of openshift client --------------------------- 0.57s 2026-02-24 09:59:52.893597 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.52s 2026-02-24 09:59:52.893601 | controller | repo_setup : Ensure directories are present ----------------------------- 0.51s 2026-02-24 09:59:52.893606 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.43s 2026-02-24 09:59:52.893611 | controller | Create secret file ------------------------------------------------------ 0.33s 2026-02-24 09:59:52.893616 | controller | Create custom basedir --------------------------------------------------- 0.31s 2026-02-24 09:59:52.893621 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.29s 2026-02-24 09:59:52.893639 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.27s 2026-02-24 09:59:52.952654 | controller | INFO Running crc_layout > converge 2026-02-24 09:59:53.508696 | controller | 2026-02-24 09:59:53.508908 | controller | PLAY [Converge] **************************************************************** 2026-02-24 09:59:53.509043 | controller | 2026-02-24 09:59:53.509180 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-24 09:59:53.509358 | controller | Tuesday 24 February 2026 09:59:53 +0000 (0:00:00.026) 0:00:00.026 ****** 2026-02-24 09:59:54.324439 | controller | ok: [instance] 2026-02-24 09:59:54.324496 | controller | 2026-02-24 09:59:54.324506 | controller | TASK [Load networking definition from scenario file] *************************** 2026-02-24 09:59:54.324515 | controller | Tuesday 24 February 2026 09:59:54 +0000 (0:00:00.815) 0:00:00.841 ****** 2026-02-24 09:59:54.344975 | controller | ok: [instance] 2026-02-24 09:59:56.091462 | controller | 2026-02-24 09:59:56.091494 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-24 09:59:56.091502 | controller | Tuesday 24 February 2026 09:59:54 +0000 (0:00:00.021) 0:00:00.862 ****** 2026-02-24 09:59:56.091512 | controller | changed: [instance] 2026-02-24 09:59:56.117329 | controller | 2026-02-24 09:59:56.117348 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-24 09:59:56.117360 | controller | Tuesday 24 February 2026 09:59:56 +0000 (0:00:01.746) 0:00:02.608 ****** 2026-02-24 09:59:56.117369 | controller | ok: [instance] 2026-02-24 09:59:56.117530 | controller | 2026-02-24 09:59:56.117544 | controller | TASK [reproducer : Load CI job environment] ************************************ 2026-02-24 09:59:56.136527 | controller | Tuesday 24 February 2026 09:59:56 +0000 (0:00:00.026) 0:00:02.634 ****** 2026-02-24 09:59:56.136580 | controller | skipping: [instance] 2026-02-24 09:59:56.181091 | controller | 2026-02-24 09:59:56.181113 | controller | TASK [Build final libvirt layout] ********************************************** 2026-02-24 09:59:56.181122 | controller | Tuesday 24 February 2026 09:59:56 +0000 (0:00:00.018) 0:00:02.653 ****** 2026-02-24 09:59:56.181132 | controller | 2026-02-24 09:59:56.256347 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2026-02-24 09:59:56.256367 | controller | Tuesday 24 February 2026 09:59:56 +0000 (0:00:00.044) 0:00:02.698 ****** 2026-02-24 09:59:56.256378 | controller | ok: [instance] 2026-02-24 09:59:56.318275 | controller | 2026-02-24 09:59:56.318308 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2026-02-24 09:59:56.318316 | controller | Tuesday 24 February 2026 09:59:56 +0000 (0:00:00.075) 0:00:02.773 ****** 2026-02-24 09:59:56.318325 | controller | skipping: [instance] 2026-02-24 09:59:56.341810 | controller | 2026-02-24 09:59:56.341830 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2026-02-24 09:59:56.341839 | controller | Tuesday 24 February 2026 09:59:56 +0000 (0:00:00.061) 0:00:02.835 ****** 2026-02-24 09:59:56.341849 | controller | ok: [instance] 2026-02-24 09:59:56.342016 | controller | 2026-02-24 09:59:56.342187 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2026-02-24 09:59:56.342378 | controller | Tuesday 24 February 2026 09:59:56 +0000 (0:00:00.024) 0:00:02.859 ****** 2026-02-24 09:59:56.363966 | controller | ok: [instance] => changed=false 2026-02-24 09:59:56.364139 | controller | msg: All assertions passed 2026-02-24 09:59:56.364298 | controller | 2026-02-24 09:59:56.364436 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2026-02-24 09:59:56.364559 | controller | Tuesday 24 February 2026 09:59:56 +0000 (0:00:00.022) 0:00:02.881 ****** 2026-02-24 09:59:56.404811 | controller | ok: [instance] 2026-02-24 09:59:56.404960 | controller | 2026-02-24 09:59:56.405099 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2026-02-24 09:59:56.405230 | controller | Tuesday 24 February 2026 09:59:56 +0000 (0:00:00.040) 0:00:02.922 ****** 2026-02-24 09:59:56.858471 | controller | ok: [instance] => (item=artifacts) 2026-02-24 09:59:56.858504 | controller | ok: [instance] => (item=logs) 2026-02-24 09:59:56.858514 | controller | 2026-02-24 09:59:56.858521 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2026-02-24 09:59:56.858539 | controller | Tuesday 24 February 2026 09:59:56 +0000 (0:00:00.453) 0:00:03.375 ****** 2026-02-24 09:59:56.933458 | controller | 2026-02-24 09:59:56.933528 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2026-02-24 09:59:56.933551 | controller | Tuesday 24 February 2026 09:59:56 +0000 (0:00:00.075) 0:00:03.451 ****** 2026-02-24 09:59:57.114222 | controller | ok: [instance] 2026-02-24 09:59:57.384405 | controller | 2026-02-24 09:59:57.384437 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2026-02-24 09:59:57.384446 | controller | Tuesday 24 February 2026 09:59:57 +0000 (0:00:00.180) 0:00:03.631 ****** 2026-02-24 09:59:57.384456 | controller | changed: [instance] 2026-02-24 09:59:57.384481 | controller | 2026-02-24 09:59:57.384488 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2026-02-24 09:59:57.384588 | controller | Tuesday 24 February 2026 09:59:57 +0000 (0:00:00.269) 0:00:03.901 ****** 2026-02-24 09:59:57.655367 | controller | ok: [instance] 2026-02-24 09:59:57.683208 | controller | 2026-02-24 09:59:57.683242 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2026-02-24 09:59:57.683252 | controller | Tuesday 24 February 2026 09:59:57 +0000 (0:00:00.271) 0:00:04.172 ****** 2026-02-24 09:59:57.683264 | controller | skipping: [instance] 2026-02-24 09:59:57.701262 | controller | 2026-02-24 09:59:57.701299 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2026-02-24 09:59:57.701308 | controller | Tuesday 24 February 2026 09:59:57 +0000 (0:00:00.028) 0:00:04.200 ****** 2026-02-24 09:59:57.701317 | controller | skipping: [instance] 2026-02-24 09:59:57.722145 | controller | 2026-02-24 09:59:57.722164 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2026-02-24 09:59:57.722173 | controller | Tuesday 24 February 2026 09:59:57 +0000 (0:00:00.018) 0:00:04.218 ****** 2026-02-24 09:59:57.722184 | controller | ok: [instance] 2026-02-24 09:59:57.750440 | controller | 2026-02-24 09:59:57.750474 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2026-02-24 09:59:57.750491 | controller | Tuesday 24 February 2026 09:59:57 +0000 (0:00:00.020) 0:00:04.239 ****** 2026-02-24 09:59:57.750503 | controller | skipping: [instance] 2026-02-24 09:59:57.750534 | controller | 2026-02-24 09:59:57.750545 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2026-02-24 09:59:57.750572 | controller | Tuesday 24 February 2026 09:59:57 +0000 (0:00:00.028) 0:00:04.268 ****** 2026-02-24 10:00:05.547736 | controller | changed: [instance] 2026-02-24 10:00:05.548021 | controller | 2026-02-24 10:00:05.757355 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2026-02-24 10:00:05.757388 | controller | Tuesday 24 February 2026 10:00:05 +0000 (0:00:07.797) 0:00:12.065 ****** 2026-02-24 10:00:05.757400 | controller | changed: [instance] 2026-02-24 10:00:05.757423 | controller | 2026-02-24 10:00:05.757432 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2026-02-24 10:00:05.757519 | controller | Tuesday 24 February 2026 10:00:05 +0000 (0:00:00.209) 0:00:12.274 ****** 2026-02-24 10:00:06.240940 | controller | changed: [instance] 2026-02-24 10:00:06.818380 | controller | 2026-02-24 10:00:06.818423 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2026-02-24 10:00:06.818434 | controller | Tuesday 24 February 2026 10:00:06 +0000 (0:00:00.483) 0:00:12.757 ****** 2026-02-24 10:00:06.818447 | controller | changed: [instance] 2026-02-24 10:00:06.818471 | controller | 2026-02-24 10:00:06.818666 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2026-02-24 10:00:07.011732 | controller | Tuesday 24 February 2026 10:00:06 +0000 (0:00:00.578) 0:00:13.336 ****** 2026-02-24 10:00:07.011767 | controller | ok: [instance] 2026-02-24 10:00:07.663010 | controller | 2026-02-24 10:00:07.663039 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2026-02-24 10:00:07.663047 | controller | Tuesday 24 February 2026 10:00:07 +0000 (0:00:00.192) 0:00:13.528 ****** 2026-02-24 10:00:07.663057 | controller | ok: [instance] 2026-02-24 10:00:08.424726 | controller | 2026-02-24 10:00:08.424755 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2026-02-24 10:00:08.424770 | controller | Tuesday 24 February 2026 10:00:07 +0000 (0:00:00.651) 0:00:14.180 ****** 2026-02-24 10:00:08.424780 | controller | changed: [instance] 2026-02-24 10:00:08.510412 | controller | 2026-02-24 10:00:08.510443 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2026-02-24 10:00:08.510453 | controller | Tuesday 24 February 2026 10:00:08 +0000 (0:00:00.761) 0:00:14.941 ****** 2026-02-24 10:00:08.510466 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2026-02-24 10:00:08.510495 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2026-02-24 10:00:08.510503 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2026-02-24 10:00:08.510512 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2026-02-24 10:00:08.510537 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2026-02-24 10:00:08.511082 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2026-02-24 10:00:08.835881 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2026-02-24 10:00:08.835910 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2026-02-24 10:00:08.835918 | controller | 2026-02-24 10:00:08.835924 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2026-02-24 10:00:08.835930 | controller | Tuesday 24 February 2026 10:00:08 +0000 (0:00:00.085) 0:00:15.027 ****** 2026-02-24 10:00:08.835939 | controller | ok: [instance] 2026-02-24 10:00:09.147384 | controller | 2026-02-24 10:00:09.147420 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2026-02-24 10:00:09.147430 | controller | Tuesday 24 February 2026 10:00:08 +0000 (0:00:00.325) 0:00:15.353 ****** 2026-02-24 10:00:09.147442 | controller | ok: [instance] 2026-02-24 10:00:09.147470 | controller | 2026-02-24 10:00:09.147480 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2026-02-24 10:00:09.147583 | controller | Tuesday 24 February 2026 10:00:09 +0000 (0:00:00.311) 0:00:15.664 ****** 2026-02-24 10:00:09.457899 | controller | ok: [instance] 2026-02-24 10:00:09.764733 | controller | 2026-02-24 10:00:09.764759 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2026-02-24 10:00:09.764766 | controller | Tuesday 24 February 2026 10:00:09 +0000 (0:00:00.310) 0:00:15.975 ****** 2026-02-24 10:00:09.764776 | controller | ok: [instance] 2026-02-24 10:00:10.077623 | controller | 2026-02-24 10:00:10.077648 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2026-02-24 10:00:10.077656 | controller | Tuesday 24 February 2026 10:00:09 +0000 (0:00:00.307) 0:00:16.282 ****** 2026-02-24 10:00:10.077666 | controller | ok: [instance] 2026-02-24 10:00:10.386119 | controller | 2026-02-24 10:00:10.386148 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2026-02-24 10:00:10.386156 | controller | Tuesday 24 February 2026 10:00:10 +0000 (0:00:00.312) 0:00:16.595 ****** 2026-02-24 10:00:10.386166 | controller | ok: [instance] 2026-02-24 10:00:10.704462 | controller | 2026-02-24 10:00:10.704512 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2026-02-24 10:00:10.704526 | controller | Tuesday 24 February 2026 10:00:10 +0000 (0:00:00.308) 0:00:16.903 ****** 2026-02-24 10:00:10.704554 | controller | ok: [instance] 2026-02-24 10:00:10.704596 | controller | 2026-02-24 10:00:10.704611 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2026-02-24 10:00:10.704671 | controller | Tuesday 24 February 2026 10:00:10 +0000 (0:00:00.318) 0:00:17.222 ****** 2026-02-24 10:00:11.023795 | controller | ok: [instance] 2026-02-24 10:00:11.343216 | controller | 2026-02-24 10:00:11.343251 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2026-02-24 10:00:11.343261 | controller | Tuesday 24 February 2026 10:00:11 +0000 (0:00:00.318) 0:00:17.541 ****** 2026-02-24 10:00:11.343273 | controller | ok: [instance] 2026-02-24 10:00:11.655667 | controller | 2026-02-24 10:00:11.655697 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2026-02-24 10:00:11.655705 | controller | Tuesday 24 February 2026 10:00:11 +0000 (0:00:00.319) 0:00:17.860 ****** 2026-02-24 10:00:11.655715 | controller | ok: [instance] 2026-02-24 10:00:11.968455 | controller | 2026-02-24 10:00:11.968498 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2026-02-24 10:00:11.968511 | controller | Tuesday 24 February 2026 10:00:11 +0000 (0:00:00.312) 0:00:18.173 ****** 2026-02-24 10:00:11.968528 | controller | ok: [instance] 2026-02-24 10:00:12.284265 | controller | 2026-02-24 10:00:12.284319 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2026-02-24 10:00:12.284330 | controller | Tuesday 24 February 2026 10:00:11 +0000 (0:00:00.312) 0:00:18.485 ****** 2026-02-24 10:00:12.284342 | controller | ok: [instance] 2026-02-24 10:00:12.602760 | controller | 2026-02-24 10:00:12.602792 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2026-02-24 10:00:12.602800 | controller | Tuesday 24 February 2026 10:00:12 +0000 (0:00:00.315) 0:00:18.801 ****** 2026-02-24 10:00:12.602810 | controller | ok: [instance] 2026-02-24 10:00:12.915386 | controller | 2026-02-24 10:00:12.915420 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2026-02-24 10:00:12.915430 | controller | Tuesday 24 February 2026 10:00:12 +0000 (0:00:00.318) 0:00:19.120 ****** 2026-02-24 10:00:12.915443 | controller | ok: [instance] 2026-02-24 10:00:12.915497 | controller | 2026-02-24 10:00:12.915523 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2026-02-24 10:00:12.915535 | controller | Tuesday 24 February 2026 10:00:12 +0000 (0:00:00.312) 0:00:19.432 ****** 2026-02-24 10:00:13.232116 | controller | ok: [instance] 2026-02-24 10:00:13.551224 | controller | 2026-02-24 10:00:13.551256 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2026-02-24 10:00:13.551265 | controller | Tuesday 24 February 2026 10:00:13 +0000 (0:00:00.316) 0:00:19.749 ****** 2026-02-24 10:00:13.551275 | controller | ok: [instance] 2026-02-24 10:00:13.872795 | controller | 2026-02-24 10:00:13.872839 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2026-02-24 10:00:13.872851 | controller | Tuesday 24 February 2026 10:00:13 +0000 (0:00:00.318) 0:00:20.068 ****** 2026-02-24 10:00:13.872862 | controller | ok: [instance] 2026-02-24 10:00:14.194202 | controller | 2026-02-24 10:00:14.194227 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2026-02-24 10:00:14.194235 | controller | Tuesday 24 February 2026 10:00:13 +0000 (0:00:00.321) 0:00:20.390 ****** 2026-02-24 10:00:14.194245 | controller | ok: [instance] 2026-02-24 10:00:14.516107 | controller | 2026-02-24 10:00:14.516136 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2026-02-24 10:00:14.516146 | controller | Tuesday 24 February 2026 10:00:14 +0000 (0:00:00.321) 0:00:20.711 ****** 2026-02-24 10:00:14.516157 | controller | ok: [instance] 2026-02-24 10:00:14.832398 | controller | 2026-02-24 10:00:14.832430 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2026-02-24 10:00:14.832440 | controller | Tuesday 24 February 2026 10:00:14 +0000 (0:00:00.321) 0:00:21.033 ****** 2026-02-24 10:00:14.832452 | controller | ok: [instance] 2026-02-24 10:00:14.832482 | controller | 2026-02-24 10:00:14.832708 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2026-02-24 10:00:15.146445 | controller | Tuesday 24 February 2026 10:00:14 +0000 (0:00:00.316) 0:00:21.349 ****** 2026-02-24 10:00:15.146485 | controller | ok: [instance] 2026-02-24 10:00:15.146650 | controller | 2026-02-24 10:00:15.146674 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2026-02-24 10:00:15.464392 | controller | Tuesday 24 February 2026 10:00:15 +0000 (0:00:00.314) 0:00:21.664 ****** 2026-02-24 10:00:15.464442 | controller | ok: [instance] 2026-02-24 10:00:15.777442 | controller | 2026-02-24 10:00:15.777475 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2026-02-24 10:00:15.777492 | controller | Tuesday 24 February 2026 10:00:15 +0000 (0:00:00.317) 0:00:21.981 ****** 2026-02-24 10:00:15.777505 | controller | ok: [instance] 2026-02-24 10:00:16.091353 | controller | 2026-02-24 10:00:16.091383 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2026-02-24 10:00:16.091391 | controller | Tuesday 24 February 2026 10:00:15 +0000 (0:00:00.313) 0:00:22.294 ****** 2026-02-24 10:00:16.091402 | controller | ok: [instance] 2026-02-24 10:00:16.109193 | controller | 2026-02-24 10:00:16.109219 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2026-02-24 10:00:16.109229 | controller | Tuesday 24 February 2026 10:00:16 +0000 (0:00:00.314) 0:00:22.608 ****** 2026-02-24 10:00:16.109240 | controller | skipping: [instance] 2026-02-24 10:00:16.386790 | controller | 2026-02-24 10:00:16.386822 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2026-02-24 10:00:16.386841 | controller | Tuesday 24 February 2026 10:00:16 +0000 (0:00:00.017) 0:00:22.626 ****** 2026-02-24 10:00:16.386852 | controller | ok: [instance] 2026-02-24 10:00:16.761384 | controller | 2026-02-24 10:00:16.761408 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2026-02-24 10:00:16.761419 | controller | Tuesday 24 February 2026 10:00:16 +0000 (0:00:00.277) 0:00:22.904 ****** 2026-02-24 10:00:16.761431 | controller | ok: [instance] 2026-02-24 10:00:17.065204 | controller | 2026-02-24 10:00:17.065227 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2026-02-24 10:00:17.065236 | controller | Tuesday 24 February 2026 10:00:16 +0000 (0:00:00.374) 0:00:23.278 ****** 2026-02-24 10:00:17.065247 | controller | changed: [instance] 2026-02-24 10:00:17.347092 | controller | 2026-02-24 10:00:17.347111 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2026-02-24 10:00:17.347119 | controller | Tuesday 24 February 2026 10:00:17 +0000 (0:00:00.303) 0:00:23.582 ****** 2026-02-24 10:00:17.347128 | controller | [WARNING]: Reset is not implemented for this connection 2026-02-24 10:00:17.357459 | controller | changed: [instance] 2026-02-24 10:00:17.357519 | controller | 2026-02-24 10:00:17.357530 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2026-02-24 10:00:17.357538 | controller | Tuesday 24 February 2026 10:00:17 +0000 (0:00:00.276) 0:00:23.858 ****** 2026-02-24 10:00:17.357547 | controller | 2026-02-24 10:00:17.357573 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2026-02-24 10:00:17.357664 | controller | Tuesday 24 February 2026 10:00:17 +0000 (0:00:00.015) 0:00:23.874 ****** 2026-02-24 10:00:17.431431 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2026-02-24 10:00:17.431482 | controller | 2026-02-24 10:00:17.431492 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2026-02-24 10:00:17.431503 | controller | Tuesday 24 February 2026 10:00:17 +0000 (0:00:00.073) 0:00:23.948 ****** 2026-02-24 10:00:17.471966 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2026-02-24 10:00:17.517398 | controller | 2026-02-24 10:00:17.517422 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-02-24 10:00:17.517432 | controller | Tuesday 24 February 2026 10:00:17 +0000 (0:00:00.040) 0:00:23.989 ****** 2026-02-24 10:00:17.517443 | controller | ok: [instance] => (item=compute) 2026-02-24 10:00:17.517473 | controller | ok: [instance] => (item=controller) 2026-02-24 10:00:17.517489 | controller | ok: [instance] => (item=crc) 2026-02-24 10:00:17.517498 | controller | 2026-02-24 10:00:17.517675 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-02-24 10:00:17.556454 | controller | Tuesday 24 February 2026 10:00:17 +0000 (0:00:00.045) 0:00:24.034 ****** 2026-02-24 10:00:17.556511 | controller | ok: [instance] 2026-02-24 10:00:17.556802 | controller | 2026-02-24 10:00:17.595201 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-02-24 10:00:17.595230 | controller | Tuesday 24 February 2026 10:00:17 +0000 (0:00:00.039) 0:00:24.073 ****** 2026-02-24 10:00:17.595242 | controller | ok: [instance] => changed=false 2026-02-24 10:00:17.595434 | controller | msg: All assertions passed 2026-02-24 10:00:17.595578 | controller | 2026-02-24 10:00:17.595700 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2026-02-24 10:00:17.595819 | controller | Tuesday 24 February 2026 10:00:17 +0000 (0:00:00.039) 0:00:24.113 ****** 2026-02-24 10:00:17.657860 | controller | 2026-02-24 10:00:17.658167 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2026-02-24 10:00:17.658467 | controller | Tuesday 24 February 2026 10:00:17 +0000 (0:00:00.062) 0:00:24.175 ****** 2026-02-24 10:00:17.734928 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.49', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2026-02-24 10:00:17.735186 | controller | ok: [instance] => (item={}) 2026-02-24 10:00:17.735442 | controller | 2026-02-24 10:00:17.735667 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2026-02-24 10:00:17.735852 | controller | Tuesday 24 February 2026 10:00:17 +0000 (0:00:00.076) 0:00:24.252 ****** 2026-02-24 10:00:17.751848 | controller | skipping: [instance] 2026-02-24 10:00:17.752028 | controller | 2026-02-24 10:00:17.752202 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2026-02-24 10:00:17.752396 | controller | Tuesday 24 February 2026 10:00:17 +0000 (0:00:00.016) 0:00:24.269 ****** 2026-02-24 10:00:17.964840 | controller | ok: [instance] 2026-02-24 10:00:18.307371 | controller | 2026-02-24 10:00:18.307395 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2026-02-24 10:00:18.307403 | controller | Tuesday 24 February 2026 10:00:17 +0000 (0:00:00.212) 0:00:24.482 ****** 2026-02-24 10:00:18.307413 | controller | changed: [instance] 2026-02-24 10:00:19.042315 | controller | 2026-02-24 10:00:19.042347 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2026-02-24 10:00:19.042355 | controller | Tuesday 24 February 2026 10:00:18 +0000 (0:00:00.342) 0:00:24.824 ****** 2026-02-24 10:00:19.042365 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2026-02-24 10:00:19.067391 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2026-02-24 10:00:19.067413 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2026-02-24 10:00:19.067420 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2026-02-24 10:00:19.067426 | controller | 2026-02-24 10:00:19.067431 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2026-02-24 10:00:19.067436 | controller | Tuesday 24 February 2026 10:00:19 +0000 (0:00:00.734) 0:00:25.559 ****** 2026-02-24 10:00:19.067445 | controller | skipping: [instance] 2026-02-24 10:00:19.432401 | controller | 2026-02-24 10:00:19.432430 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2026-02-24 10:00:19.432438 | controller | Tuesday 24 February 2026 10:00:19 +0000 (0:00:00.025) 0:00:25.584 ****** 2026-02-24 10:00:19.432448 | controller | changed: [instance] 2026-02-24 10:00:19.432471 | controller | 2026-02-24 10:00:19.432478 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2026-02-24 10:00:19.432483 | controller | Tuesday 24 February 2026 10:00:19 +0000 (0:00:00.355) 0:00:25.940 ****** 2026-02-24 10:00:19.432488 | controller | 2026-02-24 10:00:19.432495 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 10:00:19.432515 | controller | Tuesday 24 February 2026 10:00:19 +0000 (0:00:00.008) 0:00:25.949 ****** 2026-02-24 10:00:19.848735 | controller | changed: [instance] 2026-02-24 10:00:19.923060 | controller | 2026-02-24 10:00:19.923092 | controller | TASK [Ensure no default networks exists] *************************************** 2026-02-24 10:00:19.923101 | controller | Tuesday 24 February 2026 10:00:19 +0000 (0:00:00.416) 0:00:26.366 ****** 2026-02-24 10:00:19.923111 | controller | 2026-02-24 10:00:21.049371 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2026-02-24 10:00:21.049402 | controller | Tuesday 24 February 2026 10:00:19 +0000 (0:00:00.074) 0:00:26.440 ****** 2026-02-24 10:00:21.049414 | controller | ok: [instance] 2026-02-24 10:00:21.049440 | controller | 2026-02-24 10:00:21.049744 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2026-02-24 10:00:21.277706 | controller | Tuesday 24 February 2026 10:00:21 +0000 (0:00:01.126) 0:00:27.566 ****** 2026-02-24 10:00:21.277738 | controller | ok: [instance] 2026-02-24 10:00:21.781294 | controller | 2026-02-24 10:00:21.781326 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2026-02-24 10:00:21.781334 | controller | Tuesday 24 February 2026 10:00:21 +0000 (0:00:00.228) 0:00:27.795 ****** 2026-02-24 10:00:21.781344 | controller | ok: [instance] 2026-02-24 10:00:22.002997 | controller | 2026-02-24 10:00:22.003026 | controller | TASK [libvirt_manager : Removing default] ************************************** 2026-02-24 10:00:22.003034 | controller | Tuesday 24 February 2026 10:00:21 +0000 (0:00:00.503) 0:00:28.298 ****** 2026-02-24 10:00:22.003044 | controller | ok: [instance] 2026-02-24 10:00:23.161241 | controller | 2026-02-24 10:00:23.161272 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2026-02-24 10:00:23.161298 | controller | Tuesday 24 February 2026 10:00:22 +0000 (0:00:00.221) 0:00:28.520 ****** 2026-02-24 10:00:23.161312 | controller | ok: [instance] 2026-02-24 10:00:23.463956 | controller | 2026-02-24 10:00:23.463984 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2026-02-24 10:00:23.463991 | controller | Tuesday 24 February 2026 10:00:23 +0000 (0:00:01.158) 0:00:29.678 ****** 2026-02-24 10:00:23.464001 | controller | ok: [instance] 2026-02-24 10:00:23.765385 | controller | 2026-02-24 10:00:23.765428 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2026-02-24 10:00:23.765439 | controller | Tuesday 24 February 2026 10:00:23 +0000 (0:00:00.302) 0:00:29.981 ****** 2026-02-24 10:00:23.765452 | controller | changed: [instance] 2026-02-24 10:00:23.765484 | controller | 2026-02-24 10:00:23.765659 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2026-02-24 10:00:24.061905 | controller | Tuesday 24 February 2026 10:00:23 +0000 (0:00:00.301) 0:00:30.282 ****** 2026-02-24 10:00:24.061937 | controller | changed: [instance] 2026-02-24 10:00:24.625994 | controller | 2026-02-24 10:00:24.626023 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2026-02-24 10:00:24.626031 | controller | Tuesday 24 February 2026 10:00:24 +0000 (0:00:00.296) 0:00:30.579 ****** 2026-02-24 10:00:24.626041 | controller | changed: [instance] => (item=arptables) 2026-02-24 10:00:26.943412 | controller | changed: [instance] => (item=iptables) 2026-02-24 10:00:26.943446 | controller | changed: [instance] => (item=ip6tables) 2026-02-24 10:00:26.943455 | controller | 2026-02-24 10:00:26.943463 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2026-02-24 10:00:26.943470 | controller | Tuesday 24 February 2026 10:00:24 +0000 (0:00:00.563) 0:00:31.143 ****** 2026-02-24 10:00:26.943482 | controller | ok: [instance] 2026-02-24 10:00:26.943515 | controller | 2026-02-24 10:00:26.943525 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2026-02-24 10:00:27.054782 | controller | Tuesday 24 February 2026 10:00:26 +0000 (0:00:02.317) 0:00:33.460 ****** 2026-02-24 10:00:27.054821 | controller | ok: [instance] 2026-02-24 10:00:27.094382 | controller | 2026-02-24 10:00:27.094403 | controller | TASK [Ensure the required network configurations are applied] ****************** 2026-02-24 10:00:27.094412 | controller | Tuesday 24 February 2026 10:00:27 +0000 (0:00:00.111) 0:00:33.572 ****** 2026-02-24 10:00:27.094421 | controller | 2026-02-24 10:00:27.115708 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2026-02-24 10:00:27.115733 | controller | Tuesday 24 February 2026 10:00:27 +0000 (0:00:00.039) 0:00:33.612 ****** 2026-02-24 10:00:27.115744 | controller | skipping: [instance] 2026-02-24 10:00:27.136433 | controller | 2026-02-24 10:00:27.136468 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2026-02-24 10:00:27.136477 | controller | Tuesday 24 February 2026 10:00:27 +0000 (0:00:00.021) 0:00:33.633 ****** 2026-02-24 10:00:27.136490 | controller | skipping: [instance] 2026-02-24 10:00:27.136520 | controller | 2026-02-24 10:00:27.136530 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 10:00:27.136629 | controller | Tuesday 24 February 2026 10:00:27 +0000 (0:00:00.020) 0:00:33.653 ****** 2026-02-24 10:00:27.158710 | controller | skipping: [instance] 2026-02-24 10:00:27.185880 | controller | 2026-02-24 10:00:27.185901 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2026-02-24 10:00:27.185909 | controller | Tuesday 24 February 2026 10:00:27 +0000 (0:00:00.022) 0:00:33.676 ****** 2026-02-24 10:00:27.185917 | controller | skipping: [instance] 2026-02-24 10:00:27.244579 | controller | 2026-02-24 10:00:27.244600 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2026-02-24 10:00:27.244610 | controller | Tuesday 24 February 2026 10:00:27 +0000 (0:00:00.027) 0:00:33.703 ****** 2026-02-24 10:00:27.244620 | controller | ok: [instance] 2026-02-24 10:00:27.244785 | controller | 2026-02-24 10:00:27.244938 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2026-02-24 10:00:27.245068 | controller | Tuesday 24 February 2026 10:00:27 +0000 (0:00:00.058) 0:00:33.762 ****** 2026-02-24 10:00:27.277501 | controller | skipping: [instance] 2026-02-24 10:00:27.277678 | controller | 2026-02-24 10:00:27.277843 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2026-02-24 10:00:27.277996 | controller | Tuesday 24 February 2026 10:00:27 +0000 (0:00:00.032) 0:00:33.795 ****** 2026-02-24 10:00:27.299389 | controller | skipping: [instance] 2026-02-24 10:00:27.299567 | controller | 2026-02-24 10:00:27.299734 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2026-02-24 10:00:27.299907 | controller | Tuesday 24 February 2026 10:00:27 +0000 (0:00:00.021) 0:00:33.817 ****** 2026-02-24 10:00:27.355761 | controller | ok: [instance] 2026-02-24 10:00:27.355955 | controller | 2026-02-24 10:00:27.356093 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2026-02-24 10:00:27.356221 | controller | Tuesday 24 February 2026 10:00:27 +0000 (0:00:00.056) 0:00:33.873 ****** 2026-02-24 10:00:27.377738 | controller | skipping: [instance] 2026-02-24 10:00:27.377897 | controller | 2026-02-24 10:00:27.378034 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2026-02-24 10:00:27.378170 | controller | Tuesday 24 February 2026 10:00:27 +0000 (0:00:00.022) 0:00:33.895 ****** 2026-02-24 10:00:27.427564 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2026-02-24 10:00:27.427740 | controller | 2026-02-24 10:00:27.427926 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-24 10:00:27.428086 | controller | Tuesday 24 February 2026 10:00:27 +0000 (0:00:00.049) 0:00:33.944 ****** 2026-02-24 10:00:27.747021 | controller | ok: [instance -> localhost] 2026-02-24 10:00:32.985448 | controller | 2026-02-24 10:00:32.985483 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2026-02-24 10:00:32.985491 | controller | Tuesday 24 February 2026 10:00:27 +0000 (0:00:00.319) 0:00:34.264 ****** 2026-02-24 10:00:32.985502 | controller | changed: [instance -> localhost] 2026-02-24 10:00:33.179087 | controller | 2026-02-24 10:00:33.179120 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-24 10:00:33.179128 | controller | Tuesday 24 February 2026 10:00:32 +0000 (0:00:05.238) 0:00:39.502 ****** 2026-02-24 10:00:33.179139 | controller | changed: [instance] 2026-02-24 10:00:33.515131 | controller | 2026-02-24 10:00:33.515158 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2026-02-24 10:00:33.515165 | controller | Tuesday 24 February 2026 10:00:33 +0000 (0:00:00.193) 0:00:39.696 ****** 2026-02-24 10:00:33.515182 | controller | changed: [instance] 2026-02-24 10:00:35.099828 | controller | 2026-02-24 10:00:35.099871 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2026-02-24 10:00:35.099880 | controller | Tuesday 24 February 2026 10:00:33 +0000 (0:00:00.336) 0:00:40.032 ****** 2026-02-24 10:00:35.099891 | controller | changed: [instance -> localhost] 2026-02-24 10:00:35.448390 | controller | 2026-02-24 10:00:35.448427 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2026-02-24 10:00:35.448438 | controller | Tuesday 24 February 2026 10:00:35 +0000 (0:00:01.584) 0:00:41.616 ****** 2026-02-24 10:00:35.448451 | controller | changed: [instance] 2026-02-24 10:00:35.448459 | controller | 2026-02-24 10:00:35.448467 | controller | TASK [reproducer : Select right domain] **************************************** 2026-02-24 10:00:35.448477 | controller | Tuesday 24 February 2026 10:00:35 +0000 (0:00:00.348) 0:00:41.965 ****** 2026-02-24 10:00:35.479674 | controller | ok: [instance] 2026-02-24 10:00:35.591185 | controller | 2026-02-24 10:00:35.591217 | controller | TASK [Create the virtual networks] ********************************************* 2026-02-24 10:00:35.591229 | controller | Tuesday 24 February 2026 10:00:35 +0000 (0:00:00.031) 0:00:41.997 ****** 2026-02-24 10:00:35.591244 | controller | 2026-02-24 10:00:35.608821 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2026-02-24 10:00:35.608839 | controller | Tuesday 24 February 2026 10:00:35 +0000 (0:00:00.111) 0:00:42.108 ****** 2026-02-24 10:00:35.608849 | controller | ok: [instance] 2026-02-24 10:00:35.797359 | controller | 2026-02-24 10:00:35.797391 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2026-02-24 10:00:35.797399 | controller | Tuesday 24 February 2026 10:00:35 +0000 (0:00:00.017) 0:00:42.126 ****** 2026-02-24 10:00:35.797410 | controller | ok: [instance] 2026-02-24 10:00:35.797435 | controller | 2026-02-24 10:00:35.797647 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2026-02-24 10:00:35.826426 | controller | Tuesday 24 February 2026 10:00:35 +0000 (0:00:00.188) 0:00:42.314 ****** 2026-02-24 10:00:35.826477 | controller | skipping: [instance] 2026-02-24 10:00:35.826512 | controller | 2026-02-24 10:00:35.826704 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2026-02-24 10:00:35.856189 | controller | Tuesday 24 February 2026 10:00:35 +0000 (0:00:00.029) 0:00:42.343 ****** 2026-02-24 10:00:35.856218 | controller | skipping: [instance] 2026-02-24 10:00:35.908912 | controller | 2026-02-24 10:00:35.908942 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2026-02-24 10:00:35.908954 | controller | Tuesday 24 February 2026 10:00:35 +0000 (0:00:00.029) 0:00:42.373 ****** 2026-02-24 10:00:35.908969 | controller | ok: [instance] 2026-02-24 10:00:36.032608 | controller | 2026-02-24 10:00:36.032626 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2026-02-24 10:00:36.032633 | controller | Tuesday 24 February 2026 10:00:35 +0000 (0:00:00.052) 0:00:42.426 ****** 2026-02-24 10:00:36.032642 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 10:00:36.064752 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 10:00:36.064770 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 10:00:36.064778 | controller | 2026-02-24 10:00:36.064783 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2026-02-24 10:00:36.064789 | controller | Tuesday 24 February 2026 10:00:36 +0000 (0:00:00.123) 0:00:42.549 ****** 2026-02-24 10:00:36.064803 | controller | skipping: [instance] 2026-02-24 10:00:36.393696 | controller | 2026-02-24 10:00:36.393715 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2026-02-24 10:00:36.393723 | controller | Tuesday 24 February 2026 10:00:36 +0000 (0:00:00.032) 0:00:42.582 ****** 2026-02-24 10:00:36.393731 | controller | changed: [instance] 2026-02-24 10:00:36.479440 | controller | 2026-02-24 10:00:36.479466 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2026-02-24 10:00:36.479476 | controller | Tuesday 24 February 2026 10:00:36 +0000 (0:00:00.329) 0:00:42.911 ****** 2026-02-24 10:00:36.479500 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2026-02-24 10:00:36.479550 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2026-02-24 10:00:36.479566 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2026-02-24 10:00:36.479573 | controller | 2026-02-24 10:00:36.479578 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 10:00:36.479585 | controller | Tuesday 24 February 2026 10:00:36 +0000 (0:00:00.085) 0:00:42.996 ****** 2026-02-24 10:00:36.565456 | controller | changed: [instance] 2026-02-24 10:00:36.839345 | controller | 2026-02-24 10:00:36.839373 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 10:00:36.839380 | controller | Tuesday 24 February 2026 10:00:36 +0000 (0:00:00.086) 0:00:43.082 ****** 2026-02-24 10:00:36.839390 | controller | changed: [instance] 2026-02-24 10:00:37.046490 | controller | 2026-02-24 10:00:37.046530 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 10:00:37.046544 | controller | Tuesday 24 February 2026 10:00:36 +0000 (0:00:00.274) 0:00:43.356 ****** 2026-02-24 10:00:37.046560 | controller | changed: [instance] 2026-02-24 10:00:37.101374 | controller | 2026-02-24 10:00:37.101403 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 10:00:37.101411 | controller | Tuesday 24 February 2026 10:00:37 +0000 (0:00:00.207) 0:00:43.564 ****** 2026-02-24 10:00:37.101421 | controller | changed: [instance] 2026-02-24 10:00:37.101443 | controller | 2026-02-24 10:00:37.101451 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 10:00:37.101551 | controller | Tuesday 24 February 2026 10:00:37 +0000 (0:00:00.054) 0:00:43.619 ****** 2026-02-24 10:00:37.305102 | controller | changed: [instance] 2026-02-24 10:00:37.520367 | controller | 2026-02-24 10:00:37.520397 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 10:00:37.520405 | controller | Tuesday 24 February 2026 10:00:37 +0000 (0:00:00.203) 0:00:43.822 ****** 2026-02-24 10:00:37.520415 | controller | changed: [instance] 2026-02-24 10:00:37.520438 | controller | 2026-02-24 10:00:37.520445 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 10:00:37.520536 | controller | Tuesday 24 February 2026 10:00:37 +0000 (0:00:00.215) 0:00:44.037 ****** 2026-02-24 10:00:37.575427 | controller | changed: [instance] 2026-02-24 10:00:37.575472 | controller | 2026-02-24 10:00:37.575484 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 10:00:37.575552 | controller | Tuesday 24 February 2026 10:00:37 +0000 (0:00:00.055) 0:00:44.093 ****** 2026-02-24 10:00:37.773143 | controller | changed: [instance] 2026-02-24 10:00:37.987363 | controller | 2026-02-24 10:00:37.987394 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 10:00:37.987403 | controller | Tuesday 24 February 2026 10:00:37 +0000 (0:00:00.197) 0:00:44.290 ****** 2026-02-24 10:00:37.987413 | controller | changed: [instance] 2026-02-24 10:00:37.987437 | controller | 2026-02-24 10:00:37.987445 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2026-02-24 10:00:37.987543 | controller | Tuesday 24 February 2026 10:00:37 +0000 (0:00:00.214) 0:00:44.504 ****** 2026-02-24 10:00:38.181671 | controller | ok: [instance] 2026-02-24 10:00:38.670379 | controller | 2026-02-24 10:00:38.670416 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2026-02-24 10:00:38.670427 | controller | Tuesday 24 February 2026 10:00:38 +0000 (0:00:00.193) 0:00:44.698 ****** 2026-02-24 10:00:38.670439 | controller | changed: [instance] 2026-02-24 10:00:38.850451 | controller | 2026-02-24 10:00:38.850484 | controller | TASK [libvirt_manager : Remove ini file after conversion] ********************** 2026-02-24 10:00:38.850494 | controller | Tuesday 24 February 2026 10:00:38 +0000 (0:00:00.488) 0:00:45.187 ****** 2026-02-24 10:00:38.850513 | controller | changed: [instance] 2026-02-24 10:00:38.875179 | controller | 2026-02-24 10:00:38.875202 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 10:00:38.875211 | controller | Tuesday 24 February 2026 10:00:38 +0000 (0:00:00.180) 0:00:45.367 ****** 2026-02-24 10:00:38.875223 | controller | skipping: [instance] 2026-02-24 10:00:38.900112 | controller | 2026-02-24 10:00:38.900129 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 10:00:38.900142 | controller | Tuesday 24 February 2026 10:00:38 +0000 (0:00:00.024) 0:00:45.392 ****** 2026-02-24 10:00:38.900151 | controller | skipping: [instance] 2026-02-24 10:00:38.925270 | controller | 2026-02-24 10:00:38.925307 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 10:00:38.925316 | controller | Tuesday 24 February 2026 10:00:38 +0000 (0:00:00.024) 0:00:45.417 ****** 2026-02-24 10:00:38.925324 | controller | skipping: [instance] 2026-02-24 10:00:38.949805 | controller | 2026-02-24 10:00:38.949825 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 10:00:38.949833 | controller | Tuesday 24 February 2026 10:00:38 +0000 (0:00:00.024) 0:00:45.442 ****** 2026-02-24 10:00:38.949843 | controller | skipping: [instance] 2026-02-24 10:00:38.967748 | controller | 2026-02-24 10:00:38.967795 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 10:00:38.967810 | controller | Tuesday 24 February 2026 10:00:38 +0000 (0:00:00.024) 0:00:45.467 ****** 2026-02-24 10:00:38.967828 | controller | ok: [instance] 2026-02-24 10:00:39.046793 | controller | 2026-02-24 10:00:39.046835 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 10:00:39.046850 | controller | Tuesday 24 February 2026 10:00:38 +0000 (0:00:00.017) 0:00:45.485 ****** 2026-02-24 10:00:39.046892 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-24 10:00:39.047048 | controller | 2026-02-24 10:00:39.047071 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 10:00:39.047172 | controller | Tuesday 24 February 2026 10:00:39 +0000 (0:00:00.079) 0:00:45.564 ****** 2026-02-24 10:00:39.063710 | controller | skipping: [instance] 2026-02-24 10:00:39.063789 | controller | 2026-02-24 10:00:39.064239 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 10:00:39.269392 | controller | Tuesday 24 February 2026 10:00:39 +0000 (0:00:00.016) 0:00:45.581 ****** 2026-02-24 10:00:39.269432 | controller | changed: [instance] 2026-02-24 10:00:39.269465 | controller | 2026-02-24 10:00:39.269703 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 10:00:39.666518 | controller | Tuesday 24 February 2026 10:00:39 +0000 (0:00:00.205) 0:00:45.787 ****** 2026-02-24 10:00:39.666561 | controller | changed: [instance] 2026-02-24 10:00:39.723748 | controller | 2026-02-24 10:00:39.723767 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 10:00:39.723775 | controller | Tuesday 24 February 2026 10:00:39 +0000 (0:00:00.396) 0:00:46.183 ****** 2026-02-24 10:00:39.723783 | controller | ok: [instance] 2026-02-24 10:00:39.723844 | controller | 2026-02-24 10:00:39.723958 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 10:00:39.724054 | controller | Tuesday 24 February 2026 10:00:39 +0000 (0:00:00.057) 0:00:46.241 ****** 2026-02-24 10:00:39.754269 | controller | ok: [instance] 2026-02-24 10:00:39.754328 | controller | 2026-02-24 10:00:39.754489 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 10:00:39.754550 | controller | Tuesday 24 February 2026 10:00:39 +0000 (0:00:00.030) 0:00:46.272 ****** 2026-02-24 10:00:40.133802 | controller | changed: [instance] 2026-02-24 10:00:40.219154 | controller | 2026-02-24 10:00:40.219182 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2026-02-24 10:00:40.219191 | controller | Tuesday 24 February 2026 10:00:40 +0000 (0:00:00.378) 0:00:46.651 ****** 2026-02-24 10:00:40.219203 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2026-02-24 10:00:40.269424 | controller | 2026-02-24 10:00:40.269447 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2026-02-24 10:00:40.269457 | controller | Tuesday 24 February 2026 10:00:40 +0000 (0:00:00.085) 0:00:46.736 ****** 2026-02-24 10:00:40.269467 | controller | ok: [instance] => (item=public) 2026-02-24 10:00:40.269497 | controller | ok: [instance] => (item=osp_trunk) 2026-02-24 10:00:40.269507 | controller | 2026-02-24 10:00:40.269686 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2026-02-24 10:00:40.708901 | controller | Tuesday 24 February 2026 10:00:40 +0000 (0:00:00.050) 0:00:46.787 ****** 2026-02-24 10:00:40.708936 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 10:00:41.286314 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 10:00:41.286345 | controller | 2026-02-24 10:00:41.286353 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2026-02-24 10:00:41.286359 | controller | Tuesday 24 February 2026 10:00:40 +0000 (0:00:00.438) 0:00:47.226 ****** 2026-02-24 10:00:41.286369 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 10:00:41.720249 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 10:00:41.720301 | controller | 2026-02-24 10:00:41.720312 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2026-02-24 10:00:41.720319 | controller | Tuesday 24 February 2026 10:00:41 +0000 (0:00:00.577) 0:00:47.803 ****** 2026-02-24 10:00:41.720334 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 10:00:42.154769 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 10:00:42.154798 | controller | 2026-02-24 10:00:42.154806 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2026-02-24 10:00:42.154812 | controller | Tuesday 24 February 2026 10:00:41 +0000 (0:00:00.433) 0:00:48.237 ****** 2026-02-24 10:00:42.154822 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 10:00:42.212109 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 10:00:42.212139 | controller | 2026-02-24 10:00:42.212152 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2026-02-24 10:00:42.212162 | controller | Tuesday 24 February 2026 10:00:42 +0000 (0:00:00.434) 0:00:48.671 ****** 2026-02-24 10:00:42.212176 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2026-02-24 10:00:42.388380 | controller | 2026-02-24 10:00:42.388415 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2026-02-24 10:00:42.388423 | controller | Tuesday 24 February 2026 10:00:42 +0000 (0:00:00.057) 0:00:48.729 ****** 2026-02-24 10:00:42.388433 | controller | ok: [instance] 2026-02-24 10:00:42.388457 | controller | 2026-02-24 10:00:42.388465 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2026-02-24 10:00:42.388594 | controller | Tuesday 24 February 2026 10:00:42 +0000 (0:00:00.176) 0:00:48.906 ****** 2026-02-24 10:00:42.779258 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 10:00:42.846040 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 10:00:42.846073 | controller | 2026-02-24 10:00:42.846087 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2026-02-24 10:00:42.846097 | controller | Tuesday 24 February 2026 10:00:42 +0000 (0:00:00.390) 0:00:49.296 ****** 2026-02-24 10:00:42.846112 | controller | 2026-02-24 10:00:42.882043 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-24 10:00:42.882065 | controller | Tuesday 24 February 2026 10:00:42 +0000 (0:00:00.066) 0:00:49.363 ****** 2026-02-24 10:00:42.882078 | controller | skipping: [instance] 2026-02-24 10:00:44.090010 | controller | 2026-02-24 10:00:44.090039 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2026-02-24 10:00:44.090047 | controller | Tuesday 24 February 2026 10:00:42 +0000 (0:00:00.035) 0:00:49.399 ****** 2026-02-24 10:00:44.090056 | controller | ok: [instance] 2026-02-24 10:00:44.271436 | controller | 2026-02-24 10:00:44.271475 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-24 10:00:44.271485 | controller | Tuesday 24 February 2026 10:00:44 +0000 (0:00:01.207) 0:00:50.607 ****** 2026-02-24 10:00:44.271497 | controller | ok: [instance] 2026-02-24 10:00:44.271524 | controller | 2026-02-24 10:00:44.271534 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2026-02-24 10:00:44.271652 | controller | Tuesday 24 February 2026 10:00:44 +0000 (0:00:00.181) 0:00:50.788 ****** 2026-02-24 10:00:44.627379 | controller | changed: [instance] 2026-02-24 10:00:44.627412 | controller | 2026-02-24 10:00:44.627419 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2026-02-24 10:00:44.627427 | controller | Tuesday 24 February 2026 10:00:44 +0000 (0:00:00.355) 0:00:51.144 ****** 2026-02-24 10:00:46.259211 | controller | changed: [instance] 2026-02-24 10:00:46.606223 | controller | 2026-02-24 10:00:46.606250 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2026-02-24 10:00:46.606258 | controller | Tuesday 24 February 2026 10:00:46 +0000 (0:00:01.632) 0:00:52.776 ****** 2026-02-24 10:00:46.606267 | controller | changed: [instance] 2026-02-24 10:00:46.639956 | controller | 2026-02-24 10:00:46.639978 | controller | TASK [Create extra network configuration] ************************************** 2026-02-24 10:00:46.639987 | controller | Tuesday 24 February 2026 10:00:46 +0000 (0:00:00.347) 0:00:53.123 ****** 2026-02-24 10:00:46.639998 | controller | skipping: [instance] 2026-02-24 10:00:46.671753 | controller | 2026-02-24 10:00:46.671770 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2026-02-24 10:00:46.671777 | controller | Tuesday 24 February 2026 10:00:46 +0000 (0:00:00.033) 0:00:53.157 ****** 2026-02-24 10:00:46.671785 | controller | skipping: [instance] 2026-02-24 10:00:47.103702 | controller | 2026-02-24 10:00:47.103732 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2026-02-24 10:00:47.103740 | controller | Tuesday 24 February 2026 10:00:46 +0000 (0:00:00.031) 0:00:53.189 ****** 2026-02-24 10:00:47.103750 | controller | ok: [instance] 2026-02-24 10:00:47.243954 | controller | 2026-02-24 10:00:47.243975 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2026-02-24 10:00:47.243982 | controller | Tuesday 24 February 2026 10:00:47 +0000 (0:00:00.431) 0:00:53.621 ****** 2026-02-24 10:00:47.243992 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 10:00:48.408378 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 10:00:48.408415 | controller | 2026-02-24 10:00:48.408423 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2026-02-24 10:00:48.408436 | controller | Tuesday 24 February 2026 10:00:47 +0000 (0:00:00.140) 0:00:53.761 ****** 2026-02-24 10:00:48.408448 | controller | ok: [instance] 2026-02-24 10:00:48.408472 | controller | 2026-02-24 10:00:48.408480 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2026-02-24 10:00:52.060911 | controller | Tuesday 24 February 2026 10:00:48 +0000 (0:00:01.164) 0:00:54.925 ****** 2026-02-24 10:00:52.060947 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2026-02-24 10:00:52.276236 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2026-02-24 10:00:52.276255 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2026-02-24 10:00:52.276263 | controller | 2026-02-24 10:00:52.276270 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2026-02-24 10:00:52.276275 | controller | Tuesday 24 February 2026 10:00:52 +0000 (0:00:03.652) 0:00:58.577 ****** 2026-02-24 10:00:52.276303 | controller | changed: [instance] 2026-02-24 10:00:52.627368 | controller | 2026-02-24 10:00:52.627399 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2026-02-24 10:00:52.627407 | controller | Tuesday 24 February 2026 10:00:52 +0000 (0:00:00.215) 0:00:58.793 ****** 2026-02-24 10:00:52.627417 | controller | changed: [instance] 2026-02-24 10:00:52.627924 | controller | 2026-02-24 10:00:53.017441 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2026-02-24 10:00:53.017478 | controller | Tuesday 24 February 2026 10:00:52 +0000 (0:00:00.351) 0:00:59.144 ****** 2026-02-24 10:00:53.017491 | controller | changed: [instance] 2026-02-24 10:00:53.017517 | controller | 2026-02-24 10:00:53.017526 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2026-02-24 10:00:53.017549 | controller | Tuesday 24 February 2026 10:00:53 +0000 (0:00:00.389) 0:00:59.534 ****** 2026-02-24 10:00:53.050428 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2026-02-24 10:00:53.050633 | controller | 2026-02-24 10:00:53.050656 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2026-02-24 10:00:53.438963 | controller | Tuesday 24 February 2026 10:00:53 +0000 (0:00:00.033) 0:00:59.568 ****** 2026-02-24 10:00:53.439000 | controller | changed: [instance] 2026-02-24 10:00:53.459240 | controller | 2026-02-24 10:00:53.459266 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2026-02-24 10:00:53.459274 | controller | Tuesday 24 February 2026 10:00:53 +0000 (0:00:00.388) 0:00:59.956 ****** 2026-02-24 10:00:53.459308 | controller | skipping: [instance] 2026-02-24 10:00:53.495426 | controller | 2026-02-24 10:00:53.495463 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2026-02-24 10:00:53.495473 | controller | Tuesday 24 February 2026 10:00:53 +0000 (0:00:00.020) 0:00:59.976 ****** 2026-02-24 10:00:53.495485 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2026-02-24 10:00:53.495516 | controller | 2026-02-24 10:00:53.495531 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2026-02-24 10:00:53.495571 | controller | Tuesday 24 February 2026 10:00:53 +0000 (0:00:00.036) 0:01:00.013 ****** 2026-02-24 10:00:53.867076 | controller | changed: [instance] 2026-02-24 10:00:53.886198 | controller | 2026-02-24 10:00:53.886218 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2026-02-24 10:00:53.886228 | controller | Tuesday 24 February 2026 10:00:53 +0000 (0:00:00.371) 0:01:00.384 ****** 2026-02-24 10:00:53.886246 | controller | skipping: [instance] 2026-02-24 10:00:54.095417 | controller | 2026-02-24 10:00:54.095445 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2026-02-24 10:00:54.095453 | controller | Tuesday 24 February 2026 10:00:53 +0000 (0:00:00.019) 0:01:00.403 ****** 2026-02-24 10:00:54.095463 | controller | ok: [instance] => (item=127.0.0.2) 2026-02-24 10:00:54.750131 | controller | 2026-02-24 10:00:54.750160 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2026-02-24 10:00:54.750168 | controller | Tuesday 24 February 2026 10:00:54 +0000 (0:00:00.209) 0:01:00.612 ****** 2026-02-24 10:00:54.750178 | controller | changed: [instance] 2026-02-24 10:00:54.769403 | controller | 2026-02-24 10:00:54.769439 | controller | TASK [dnsmasq : Stop service] ************************************************** 2026-02-24 10:00:54.769449 | controller | Tuesday 24 February 2026 10:00:54 +0000 (0:00:00.654) 0:01:01.267 ****** 2026-02-24 10:00:54.769462 | controller | skipping: [instance] 2026-02-24 10:00:54.787927 | controller | 2026-02-24 10:00:54.787959 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2026-02-24 10:00:54.787970 | controller | Tuesday 24 February 2026 10:00:54 +0000 (0:00:00.019) 0:01:01.286 ****** 2026-02-24 10:00:54.787981 | controller | skipping: [instance] 2026-02-24 10:00:54.817370 | controller | 2026-02-24 10:00:54.817398 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2026-02-24 10:00:54.817408 | controller | Tuesday 24 February 2026 10:00:54 +0000 (0:00:00.018) 0:01:01.305 ****** 2026-02-24 10:00:54.817427 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-24 10:00:54.817941 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2026-02-24 10:00:54.933441 | controller | skipping: [instance] 2026-02-24 10:00:54.933476 | controller | 2026-02-24 10:00:54.933486 | controller | TASK [Create dnsmasq networks] ************************************************* 2026-02-24 10:00:54.933494 | controller | Tuesday 24 February 2026 10:00:54 +0000 (0:00:00.029) 0:01:01.335 ****** 2026-02-24 10:00:54.933505 | controller | 2026-02-24 10:00:54.987366 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-24 10:00:54.987400 | controller | Tuesday 24 February 2026 10:00:54 +0000 (0:00:00.115) 0:01:01.451 ****** 2026-02-24 10:00:54.987420 | controller | ok: [instance] => changed=false 2026-02-24 10:00:55.022204 | controller | msg: All assertions passed 2026-02-24 10:00:55.022233 | controller | 2026-02-24 10:00:55.022241 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-24 10:00:55.022247 | controller | Tuesday 24 February 2026 10:00:54 +0000 (0:00:00.053) 0:01:01.504 ****** 2026-02-24 10:00:55.022256 | controller | ok: [instance] => changed=false 2026-02-24 10:00:55.022414 | controller | msg: All assertions passed 2026-02-24 10:00:55.022536 | controller | 2026-02-24 10:00:55.022656 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-24 10:00:55.022771 | controller | Tuesday 24 February 2026 10:00:55 +0000 (0:00:00.035) 0:01:01.540 ****** 2026-02-24 10:00:55.460338 | controller | changed: [instance] 2026-02-24 10:00:55.480086 | controller | 2026-02-24 10:00:55.480107 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-24 10:00:55.480116 | controller | Tuesday 24 February 2026 10:00:55 +0000 (0:00:00.437) 0:01:01.977 ****** 2026-02-24 10:00:55.480126 | controller | skipping: [instance] 2026-02-24 10:00:55.504998 | controller | 2026-02-24 10:00:55.505028 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-24 10:00:55.505041 | controller | Tuesday 24 February 2026 10:00:55 +0000 (0:00:00.020) 0:01:01.997 ****** 2026-02-24 10:00:55.505055 | controller | skipping: [instance] 2026-02-24 10:00:55.535428 | controller | 2026-02-24 10:00:55.535452 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-24 10:00:55.535461 | controller | Tuesday 24 February 2026 10:00:55 +0000 (0:00:00.024) 0:01:02.022 ****** 2026-02-24 10:00:55.535472 | controller | ok: [instance] => changed=false 2026-02-24 10:00:55.535496 | controller | msg: All assertions passed 2026-02-24 10:00:55.535504 | controller | 2026-02-24 10:00:55.535510 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-24 10:00:55.535525 | controller | Tuesday 24 February 2026 10:00:55 +0000 (0:00:00.030) 0:01:02.052 ****** 2026-02-24 10:00:55.576969 | controller | ok: [instance] => changed=false 2026-02-24 10:00:56.011433 | controller | msg: All assertions passed 2026-02-24 10:00:56.011465 | controller | 2026-02-24 10:00:56.011476 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-24 10:00:56.011483 | controller | Tuesday 24 February 2026 10:00:55 +0000 (0:00:00.041) 0:01:02.094 ****** 2026-02-24 10:00:56.011494 | controller | changed: [instance] 2026-02-24 10:00:56.031312 | controller | 2026-02-24 10:00:56.031347 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-24 10:00:56.031356 | controller | Tuesday 24 February 2026 10:00:56 +0000 (0:00:00.434) 0:01:02.528 ****** 2026-02-24 10:00:56.031366 | controller | skipping: [instance] 2026-02-24 10:00:56.057118 | controller | 2026-02-24 10:00:56.057159 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-24 10:00:56.057170 | controller | Tuesday 24 February 2026 10:00:56 +0000 (0:00:00.020) 0:01:02.548 ****** 2026-02-24 10:00:56.057182 | controller | skipping: [instance] 2026-02-24 10:00:56.088778 | controller | 2026-02-24 10:00:56.088798 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2026-02-24 10:00:56.088807 | controller | Tuesday 24 February 2026 10:00:56 +0000 (0:00:00.025) 0:01:02.574 ****** 2026-02-24 10:00:56.088818 | controller | skipping: [instance] 2026-02-24 10:00:56.562629 | controller | 2026-02-24 10:00:56.562658 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2026-02-24 10:00:56.562666 | controller | Tuesday 24 February 2026 10:00:56 +0000 (0:00:00.031) 0:01:02.606 ****** 2026-02-24 10:00:56.562676 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 10:00:56.597366 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 10:00:56.597396 | controller | 2026-02-24 10:00:56.597406 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 10:00:56.597414 | controller | Tuesday 24 February 2026 10:00:56 +0000 (0:00:00.473) 0:01:03.079 ****** 2026-02-24 10:00:56.597426 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2026-02-24 10:00:56.597867 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2026-02-24 10:00:56.923360 | controller | 2026-02-24 10:00:56.923398 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 10:00:56.923409 | controller | Tuesday 24 February 2026 10:00:56 +0000 (0:00:00.035) 0:01:03.114 ****** 2026-02-24 10:00:56.923423 | controller | ok: [instance] 2026-02-24 10:00:56.923464 | controller | 2026-02-24 10:00:56.923680 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-24 10:00:56.958385 | controller | Tuesday 24 February 2026 10:00:56 +0000 (0:00:00.325) 0:01:03.440 ****** 2026-02-24 10:00:56.958405 | controller | ok: [instance] 2026-02-24 10:00:56.958530 | controller | 2026-02-24 10:00:56.958560 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 10:00:56.958575 | controller | Tuesday 24 February 2026 10:00:56 +0000 (0:00:00.034) 0:01:03.475 ****** 2026-02-24 10:00:57.156134 | controller | ok: [instance] 2026-02-24 10:00:57.193072 | controller | 2026-02-24 10:00:57.193104 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-24 10:00:57.193113 | controller | Tuesday 24 February 2026 10:00:57 +0000 (0:00:00.197) 0:01:03.673 ****** 2026-02-24 10:00:57.193125 | controller | ok: [instance] 2026-02-24 10:00:57.518395 | controller | 2026-02-24 10:00:57.518437 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2026-02-24 10:00:57.518448 | controller | Tuesday 24 February 2026 10:00:57 +0000 (0:00:00.037) 0:01:03.710 ****** 2026-02-24 10:00:57.518463 | controller | changed: [instance] 2026-02-24 10:00:57.852205 | controller | 2026-02-24 10:00:57.852236 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2026-02-24 10:00:57.852249 | controller | Tuesday 24 February 2026 10:00:57 +0000 (0:00:00.325) 0:01:04.035 ****** 2026-02-24 10:00:57.852259 | controller | changed: [instance] 2026-02-24 10:00:58.189000 | controller | 2026-02-24 10:00:58.189031 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2026-02-24 10:00:58.189039 | controller | Tuesday 24 February 2026 10:00:57 +0000 (0:00:00.333) 0:01:04.369 ****** 2026-02-24 10:00:58.189049 | controller | changed: [instance] 2026-02-24 10:00:58.286709 | controller | 2026-02-24 10:00:58.286732 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2026-02-24 10:00:58.286741 | controller | Tuesday 24 February 2026 10:00:58 +0000 (0:00:00.336) 0:01:04.706 ****** 2026-02-24 10:00:58.286752 | controller | ok: [instance] 2026-02-24 10:00:58.629462 | controller | 2026-02-24 10:00:58.629506 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2026-02-24 10:00:58.629520 | controller | Tuesday 24 February 2026 10:00:58 +0000 (0:00:00.097) 0:01:04.804 ****** 2026-02-24 10:00:58.629537 | controller | changed: [instance] 2026-02-24 10:00:58.654372 | controller | 2026-02-24 10:00:58.654406 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 10:00:58.654415 | controller | Tuesday 24 February 2026 10:00:58 +0000 (0:00:00.342) 0:01:05.146 ****** 2026-02-24 10:00:58.654425 | controller | skipping: [instance] 2026-02-24 10:00:58.680326 | controller | 2026-02-24 10:00:58.680361 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 10:00:58.680371 | controller | Tuesday 24 February 2026 10:00:58 +0000 (0:00:00.025) 0:01:05.172 ****** 2026-02-24 10:00:58.680383 | controller | skipping: [instance] 2026-02-24 10:00:58.704847 | controller | 2026-02-24 10:00:58.704873 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 10:00:58.704880 | controller | Tuesday 24 February 2026 10:00:58 +0000 (0:00:00.025) 0:01:05.197 ****** 2026-02-24 10:00:58.704889 | controller | skipping: [instance] 2026-02-24 10:00:58.727668 | controller | 2026-02-24 10:00:58.727686 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 10:00:58.727694 | controller | Tuesday 24 February 2026 10:00:58 +0000 (0:00:00.023) 0:01:05.221 ****** 2026-02-24 10:00:58.727702 | controller | skipping: [instance] 2026-02-24 10:00:58.746416 | controller | 2026-02-24 10:00:58.746445 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 10:00:58.746454 | controller | Tuesday 24 February 2026 10:00:58 +0000 (0:00:00.023) 0:01:05.245 ****** 2026-02-24 10:00:58.746466 | controller | ok: [instance] 2026-02-24 10:00:58.835364 | controller | 2026-02-24 10:00:58.835396 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 10:00:58.835406 | controller | Tuesday 24 February 2026 10:00:58 +0000 (0:00:00.018) 0:01:05.263 ****** 2026-02-24 10:00:58.835421 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-24 10:00:58.853404 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-24 10:00:58.853433 | controller | 2026-02-24 10:00:58.853442 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 10:00:58.853447 | controller | Tuesday 24 February 2026 10:00:58 +0000 (0:00:00.088) 0:01:05.352 ****** 2026-02-24 10:00:58.853457 | controller | skipping: [instance] 2026-02-24 10:00:58.853556 | controller | 2026-02-24 10:00:58.853694 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 10:00:58.853816 | controller | Tuesday 24 February 2026 10:00:58 +0000 (0:00:00.018) 0:01:05.371 ****** 2026-02-24 10:00:59.055406 | controller | ok: [instance] 2026-02-24 10:00:59.055455 | controller | 2026-02-24 10:00:59.055685 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 10:00:59.442982 | controller | Tuesday 24 February 2026 10:00:59 +0000 (0:00:00.201) 0:01:05.572 ****** 2026-02-24 10:00:59.443025 | controller | changed: [instance] 2026-02-24 10:00:59.506613 | controller | 2026-02-24 10:00:59.506636 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 10:00:59.506643 | controller | Tuesday 24 February 2026 10:00:59 +0000 (0:00:00.387) 0:01:05.960 ****** 2026-02-24 10:00:59.506652 | controller | ok: [instance] 2026-02-24 10:00:59.539139 | controller | 2026-02-24 10:00:59.539158 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 10:00:59.539166 | controller | Tuesday 24 February 2026 10:00:59 +0000 (0:00:00.063) 0:01:06.024 ****** 2026-02-24 10:00:59.539175 | controller | ok: [instance] 2026-02-24 10:00:59.941038 | controller | 2026-02-24 10:00:59.941073 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 10:00:59.941082 | controller | Tuesday 24 February 2026 10:00:59 +0000 (0:00:00.032) 0:01:06.056 ****** 2026-02-24 10:00:59.941093 | controller | changed: [instance] 2026-02-24 10:00:59.969240 | controller | 2026-02-24 10:00:59.969262 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2026-02-24 10:00:59.969271 | controller | Tuesday 24 February 2026 10:00:59 +0000 (0:00:00.401) 0:01:06.458 ****** 2026-02-24 10:00:59.969302 | controller | ok: [instance] 2026-02-24 10:00:59.989160 | controller | 2026-02-24 10:00:59.989181 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2026-02-24 10:00:59.989189 | controller | Tuesday 24 February 2026 10:00:59 +0000 (0:00:00.028) 0:01:06.486 ****** 2026-02-24 10:00:59.989200 | controller | ok: [instance] 2026-02-24 10:01:00.009891 | controller | 2026-02-24 10:01:00.009928 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2026-02-24 10:01:00.009938 | controller | Tuesday 24 February 2026 10:00:59 +0000 (0:00:00.019) 0:01:06.506 ****** 2026-02-24 10:01:00.009949 | controller | ok: [instance] 2026-02-24 10:01:00.084397 | controller | 2026-02-24 10:01:00.084420 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2026-02-24 10:01:00.084435 | controller | Tuesday 24 February 2026 10:01:00 +0000 (0:00:00.020) 0:01:06.527 ****** 2026-02-24 10:01:00.084446 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2026-02-24 10:01:00.084475 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2026-02-24 10:01:00.084483 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2026-02-24 10:01:00.084490 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2026-02-24 10:01:00.084496 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2026-02-24 10:01:00.084505 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2026-02-24 10:01:00.084837 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2026-02-24 10:01:00.213403 | controller | 2026-02-24 10:01:00.213425 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 10:01:00.213433 | controller | Tuesday 24 February 2026 10:01:00 +0000 (0:00:00.074) 0:01:06.601 ****** 2026-02-24 10:01:00.213444 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2026-02-24 10:01:00.213579 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2026-02-24 10:01:00.213600 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2026-02-24 10:01:00.213609 | controller | 2026-02-24 10:01:00.213620 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 10:01:00.213647 | controller | Tuesday 24 February 2026 10:01:00 +0000 (0:00:00.129) 0:01:06.731 ****** 2026-02-24 10:01:00.291252 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2026-02-24 10:01:00.291278 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2026-02-24 10:01:00.291313 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2026-02-24 10:01:00.291402 | controller | skipping: [instance] 2026-02-24 10:01:00.291550 | controller | 2026-02-24 10:01:00.291633 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 10:01:00.291739 | controller | Tuesday 24 February 2026 10:01:00 +0000 (0:00:00.077) 0:01:06.808 ****** 2026-02-24 10:01:00.368540 | controller | skipping: [instance] => (item=compute-0 - storage) 2026-02-24 10:01:00.368763 | controller | skipping: [instance] => (item=controller-0 - storage) 2026-02-24 10:01:00.368841 | controller | skipping: [instance] => (item=crc-0 - storage) 2026-02-24 10:01:00.368952 | controller | skipping: [instance] 2026-02-24 10:01:00.369046 | controller | 2026-02-24 10:01:00.369142 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 10:01:00.369249 | controller | Tuesday 24 February 2026 10:01:00 +0000 (0:00:00.077) 0:01:06.886 ****** 2026-02-24 10:01:00.446806 | controller | skipping: [instance] => (item=compute-0 - tenant) 2026-02-24 10:01:00.446897 | controller | skipping: [instance] => (item=controller-0 - tenant) 2026-02-24 10:01:00.447057 | controller | skipping: [instance] => (item=crc-0 - tenant) 2026-02-24 10:01:00.447118 | controller | skipping: [instance] 2026-02-24 10:01:00.447217 | controller | 2026-02-24 10:01:00.447328 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 10:01:00.447428 | controller | Tuesday 24 February 2026 10:01:00 +0000 (0:00:00.078) 0:01:06.964 ****** 2026-02-24 10:01:00.524172 | controller | skipping: [instance] => (item=compute-0 - external) 2026-02-24 10:01:00.524465 | controller | skipping: [instance] => (item=controller-0 - external) 2026-02-24 10:01:00.524701 | controller | skipping: [instance] => (item=crc-0 - external) 2026-02-24 10:01:00.524854 | controller | skipping: [instance] 2026-02-24 10:01:00.525064 | controller | 2026-02-24 10:01:00.525130 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 10:01:00.525223 | controller | Tuesday 24 February 2026 10:01:00 +0000 (0:00:00.077) 0:01:07.041 ****** 2026-02-24 10:01:00.601820 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2026-02-24 10:01:00.601929 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2026-02-24 10:01:00.602297 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2026-02-24 10:01:00.602386 | controller | skipping: [instance] 2026-02-24 10:01:00.602399 | controller | 2026-02-24 10:01:00.602410 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 10:01:00.602548 | controller | Tuesday 24 February 2026 10:01:00 +0000 (0:00:00.077) 0:01:07.119 ****** 2026-02-24 10:01:00.732517 | controller | ok: [instance] => (item=compute-0 - public) 2026-02-24 10:01:00.732769 | controller | ok: [instance] => (item=controller-0 - public) 2026-02-24 10:01:00.733010 | controller | ok: [instance] => (item=crc-0 - public) 2026-02-24 10:01:00.733160 | controller | 2026-02-24 10:01:00.733382 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2026-02-24 10:01:00.733488 | controller | Tuesday 24 February 2026 10:01:00 +0000 (0:00:00.130) 0:01:07.250 ****** 2026-02-24 10:01:00.838243 | controller | 2026-02-24 10:01:00.838537 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2026-02-24 10:01:00.838658 | controller | Tuesday 24 February 2026 10:01:00 +0000 (0:00:00.105) 0:01:07.355 ****** 2026-02-24 10:01:00.910765 | controller | ok: [instance] 2026-02-24 10:01:00.910816 | controller | 2026-02-24 10:01:00.910973 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2026-02-24 10:01:00.911047 | controller | Tuesday 24 February 2026 10:01:00 +0000 (0:00:00.072) 0:01:07.428 ****** 2026-02-24 10:01:01.004225 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:b2:e7:2c', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-24 10:01:01.004417 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:b0:80:ba', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-24 10:01:01.004524 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:4b:6f:8b', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-24 10:01:01.004685 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:17:3a:dd', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-24 10:01:01.004768 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:82:fa:dc', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-24 10:01:01.004881 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:74:18:31', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-24 10:01:01.004975 | controller | 2026-02-24 10:01:01.005077 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2026-02-24 10:01:01.005173 | controller | Tuesday 24 February 2026 10:01:01 +0000 (0:00:00.093) 0:01:07.522 ****** 2026-02-24 10:01:01.055747 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2026-02-24 10:01:01.055855 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2026-02-24 10:01:01.055973 | controller | 2026-02-24 10:01:01.056082 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-24 10:01:01.056189 | controller | Tuesday 24 February 2026 10:01:01 +0000 (0:00:00.051) 0:01:07.573 ****** 2026-02-24 10:01:01.229371 | controller | ok: [instance] 2026-02-24 10:01:01.229671 | controller | 2026-02-24 10:01:01.252861 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-24 10:01:01.252880 | controller | Tuesday 24 February 2026 10:01:01 +0000 (0:00:00.173) 0:01:07.747 ****** 2026-02-24 10:01:01.252891 | controller | ok: [instance] 2026-02-24 10:01:01.428467 | controller | 2026-02-24 10:01:01.428494 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-24 10:01:01.428504 | controller | Tuesday 24 February 2026 10:01:01 +0000 (0:00:00.023) 0:01:07.770 ****** 2026-02-24 10:01:01.428515 | controller | ok: [instance] 2026-02-24 10:01:01.451344 | controller | 2026-02-24 10:01:01.451365 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-24 10:01:01.451373 | controller | Tuesday 24 February 2026 10:01:01 +0000 (0:00:00.175) 0:01:07.945 ****** 2026-02-24 10:01:01.451382 | controller | ok: [instance] 2026-02-24 10:01:01.470490 | controller | 2026-02-24 10:01:01.470536 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2026-02-24 10:01:01.470550 | controller | Tuesday 24 February 2026 10:01:01 +0000 (0:00:00.023) 0:01:07.968 ****** 2026-02-24 10:01:01.470567 | controller | ok: [instance] 2026-02-24 10:01:01.470578 | controller | 2026-02-24 10:01:01.470588 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2026-02-24 10:01:01.470600 | controller | Tuesday 24 February 2026 10:01:01 +0000 (0:00:00.019) 0:01:07.988 ****** 2026-02-24 10:01:01.646449 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:b2:e7:2c', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-24 10:01:01.685776 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:b0:80:ba', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-24 10:01:01.685808 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:4b:6f:8b', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-24 10:01:01.685817 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:17:3a:dd', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-24 10:01:01.685824 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:82:fa:dc', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-24 10:01:01.685831 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:74:18:31', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-24 10:01:01.685837 | controller | 2026-02-24 10:01:01.685845 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2026-02-24 10:01:01.685852 | controller | Tuesday 24 February 2026 10:01:01 +0000 (0:00:00.175) 0:01:08.163 ****** 2026-02-24 10:01:01.685864 | controller | ok: [instance] 2026-02-24 10:01:03.715426 | controller | 2026-02-24 10:01:03.715471 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2026-02-24 10:01:03.715485 | controller | Tuesday 24 February 2026 10:01:01 +0000 (0:00:00.039) 0:01:08.203 ****** 2026-02-24 10:01:03.715502 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:b2:e7:2c', 'entry': 'set:compute,52:54:00:b2:e7:2c,192.168.140.100,compute-0', 'state': 'present'}) 2026-02-24 10:01:03.715547 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:b0:80:ba', 'entry': 'set:controller,52:54:01:b0:80:ba,192.168.140.9,controller-0', 'state': 'present'}) 2026-02-24 10:01:03.715560 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:4b:6f:8b', 'entry': 'set:ocp,52:54:02:4b:6f:8b,192.168.140.10,crc-0', 'state': 'present'}) 2026-02-24 10:01:03.715598 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:17:3a:dd', 'entry': 'set:compute,52:54:00:17:3a:dd,192.168.101.100,compute-0', 'state': 'present'}) 2026-02-24 10:01:03.716079 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:82:fa:dc', 'entry': 'set:controller,52:54:01:82:fa:dc,192.168.101.9,controller-0', 'state': 'present'}) 2026-02-24 10:01:03.739292 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:74:18:31', 'entry': 'set:ocp,52:54:02:74:18:31,192.168.101.10,crc-0', 'state': 'present'}) 2026-02-24 10:01:03.739313 | controller | 2026-02-24 10:01:03.739320 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2026-02-24 10:01:03.739331 | controller | Tuesday 24 February 2026 10:01:03 +0000 (0:00:02.029) 0:01:10.232 ****** 2026-02-24 10:01:03.739340 | controller | skipping: [instance] 2026-02-24 10:01:03.954864 | controller | 2026-02-24 10:01:03.954886 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2026-02-24 10:01:03.954893 | controller | Tuesday 24 February 2026 10:01:03 +0000 (0:00:00.023) 0:01:10.256 ****** 2026-02-24 10:01:03.954902 | controller | ok: [instance] => (item=compute-0) 2026-02-24 10:01:04.075791 | controller | ok: [instance] => (item=controller-0) 2026-02-24 10:01:04.075813 | controller | ok: [instance] => (item=crc-0) 2026-02-24 10:01:04.075822 | controller | 2026-02-24 10:01:04.075829 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2026-02-24 10:01:04.075836 | controller | Tuesday 24 February 2026 10:01:03 +0000 (0:00:00.215) 0:01:10.472 ****** 2026-02-24 10:01:04.075846 | controller | 2026-02-24 10:01:04.115577 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 10:01:04.115601 | controller | Tuesday 24 February 2026 10:01:04 +0000 (0:00:00.121) 0:01:10.593 ****** 2026-02-24 10:01:04.115621 | controller | ok: [instance] 2026-02-24 10:01:04.115788 | controller | 2026-02-24 10:01:04.115806 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 10:01:04.309422 | controller | Tuesday 24 February 2026 10:01:04 +0000 (0:00:00.039) 0:01:10.633 ****** 2026-02-24 10:01:04.309453 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 10:01:04.309484 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 10:01:04.309492 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 10:01:04.309500 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 10:01:04.310943 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.372472 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.372521 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.372549 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 10:01:07.372559 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 10:01:07.372569 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 10:01:07.372579 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.372588 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.372598 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.372607 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.372617 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.372633 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.372643 | controller | 2026-02-24 10:01:07.372653 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 10:01:07.372663 | controller | Tuesday 24 February 2026 10:01:04 +0000 (0:00:00.193) 0:01:10.827 ****** 2026-02-24 10:01:07.372680 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.372729 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.372746 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.372756 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.372766 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.372775 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.372785 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.372794 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 10:01:07.372804 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 10:01:07.372813 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 10:01:07.372823 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.372836 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.372877 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.372888 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.372900 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.373234 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.373267 | controller | 2026-02-24 10:01:07.721443 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 10:01:07.721490 | controller | Tuesday 24 February 2026 10:01:07 +0000 (0:00:03.062) 0:01:13.889 ****** 2026-02-24 10:01:07.721507 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.721542 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.721559 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.721570 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.722862 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.741909 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.741951 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 10:01:07.741961 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 10:01:07.741969 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 10:01:07.741975 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 10:01:07.741982 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.741989 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.741995 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.742002 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.742009 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.742016 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 10:01:07.742031 | controller | 2026-02-24 10:01:07.742038 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2026-02-24 10:01:07.742045 | controller | Tuesday 24 February 2026 10:01:07 +0000 (0:00:00.349) 0:01:14.238 ****** 2026-02-24 10:01:07.742056 | controller | ok: [instance] 2026-02-24 10:01:07.786314 | controller | 2026-02-24 10:01:07.786340 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2026-02-24 10:01:07.786349 | controller | Tuesday 24 February 2026 10:01:07 +0000 (0:00:00.020) 0:01:14.259 ****** 2026-02-24 10:01:07.786360 | controller | skipping: [instance] => (item=compute) 2026-02-24 10:01:07.817205 | controller | skipping: [instance] => (item=controller) 2026-02-24 10:01:07.817225 | controller | skipping: [instance] => (item=crc) 2026-02-24 10:01:07.817234 | controller | skipping: [instance] 2026-02-24 10:01:07.817241 | controller | 2026-02-24 10:01:07.817248 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2026-02-24 10:01:07.817254 | controller | Tuesday 24 February 2026 10:01:07 +0000 (0:00:00.044) 0:01:14.303 ****** 2026-02-24 10:01:07.817263 | controller | skipping: [instance] 2026-02-24 10:01:08.184449 | controller | 2026-02-24 10:01:08.184491 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2026-02-24 10:01:08.184502 | controller | Tuesday 24 February 2026 10:01:07 +0000 (0:00:00.031) 0:01:14.334 ****** 2026-02-24 10:01:08.184518 | controller | changed: [instance] 2026-02-24 10:01:08.184552 | controller | 2026-02-24 10:01:08.184560 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2026-02-24 10:01:08.184567 | controller | Tuesday 24 February 2026 10:01:08 +0000 (0:00:00.355) 0:01:14.690 ****** 2026-02-24 10:01:08.184573 | controller | 2026-02-24 10:01:08.184582 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-24 10:01:08.806735 | controller | Tuesday 24 February 2026 10:01:08 +0000 (0:00:00.011) 0:01:14.701 ****** 2026-02-24 10:01:08.806769 | controller | changed: [instance] 2026-02-24 10:01:09.156072 | controller | 2026-02-24 10:01:09.156101 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 10:01:09.156110 | controller | Tuesday 24 February 2026 10:01:08 +0000 (0:00:00.622) 0:01:15.323 ****** 2026-02-24 10:01:09.156120 | controller | changed: [instance] 2026-02-24 10:01:09.502293 | controller | 2026-02-24 10:01:09.502326 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2026-02-24 10:01:09.502334 | controller | Tuesday 24 February 2026 10:01:09 +0000 (0:00:00.349) 0:01:15.673 ****** 2026-02-24 10:01:09.502344 | controller | changed: [instance] 2026-02-24 10:01:09.855665 | controller | 2026-02-24 10:01:09.855693 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2026-02-24 10:01:09.855701 | controller | Tuesday 24 February 2026 10:01:09 +0000 (0:00:00.346) 0:01:16.019 ****** 2026-02-24 10:01:09.855711 | controller | changed: [instance] 2026-02-24 10:01:10.223377 | controller | 2026-02-24 10:01:10.223410 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2026-02-24 10:01:10.223419 | controller | Tuesday 24 February 2026 10:01:09 +0000 (0:00:00.353) 0:01:16.373 ****** 2026-02-24 10:01:10.223430 | controller | changed: [instance] 2026-02-24 10:01:10.255718 | controller | 2026-02-24 10:01:10.255737 | controller | TASK [Build utility records dataset] ******************************************* 2026-02-24 10:01:10.255744 | controller | Tuesday 24 February 2026 10:01:10 +0000 (0:00:00.367) 0:01:16.740 ****** 2026-02-24 10:01:10.255753 | controller | 2026-02-24 10:01:10.344529 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 10:01:10.344562 | controller | Tuesday 24 February 2026 10:01:10 +0000 (0:00:00.032) 0:01:16.773 ****** 2026-02-24 10:01:10.344575 | controller | ok: [instance] 2026-02-24 10:01:10.344604 | controller | 2026-02-24 10:01:10.344612 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 10:01:10.344620 | controller | Tuesday 24 February 2026 10:01:10 +0000 (0:00:00.088) 0:01:16.861 ****** 2026-02-24 10:01:10.439397 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 10:01:10.894983 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 10:01:10.895019 | controller | 2026-02-24 10:01:10.895027 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 10:01:10.895033 | controller | Tuesday 24 February 2026 10:01:10 +0000 (0:00:00.094) 0:01:16.956 ****** 2026-02-24 10:01:10.895044 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 10:01:11.186422 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 10:01:11.186470 | controller | 2026-02-24 10:01:11.186485 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 10:01:11.186496 | controller | Tuesday 24 February 2026 10:01:10 +0000 (0:00:00.455) 0:01:17.412 ****** 2026-02-24 10:01:11.186515 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 10:01:11.186674 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 10:01:11.186709 | controller | 2026-02-24 10:01:11.186717 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-24 10:01:11.186724 | controller | Tuesday 24 February 2026 10:01:11 +0000 (0:00:00.280) 0:01:17.692 ****** 2026-02-24 10:01:11.186733 | controller | 2026-02-24 10:01:11.647110 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 10:01:11.647141 | controller | Tuesday 24 February 2026 10:01:11 +0000 (0:00:00.011) 0:01:17.703 ****** 2026-02-24 10:01:11.647153 | controller | changed: [instance] 2026-02-24 10:01:11.647172 | controller | 2026-02-24 10:01:11.647309 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 10:01:11.647345 | controller | Tuesday 24 February 2026 10:01:11 +0000 (0:00:00.461) 0:01:18.164 ****** 2026-02-24 10:01:11.997034 | controller | changed: [instance] 2026-02-24 10:01:12.029395 | controller | 2026-02-24 10:01:12.029451 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2026-02-24 10:01:12.029463 | controller | Tuesday 24 February 2026 10:01:11 +0000 (0:00:00.349) 0:01:18.514 ****** 2026-02-24 10:01:12.029478 | controller | skipping: [instance] 2026-02-24 10:01:12.105422 | controller | 2026-02-24 10:01:12.105457 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2026-02-24 10:01:12.105467 | controller | Tuesday 24 February 2026 10:01:12 +0000 (0:00:00.032) 0:01:18.546 ****** 2026-02-24 10:01:12.105479 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2026-02-24 10:01:12.105510 | controller | 2026-02-24 10:01:12.105699 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2026-02-24 10:01:12.293611 | controller | Tuesday 24 February 2026 10:01:12 +0000 (0:00:00.076) 0:01:18.623 ****** 2026-02-24 10:01:12.293639 | controller | ok: [instance] 2026-02-24 10:01:12.314478 | controller | 2026-02-24 10:01:12.314523 | controller | TASK [Deploy CRC if needed] **************************************************** 2026-02-24 10:01:12.314534 | controller | Tuesday 24 February 2026 10:01:12 +0000 (0:00:00.187) 0:01:18.811 ****** 2026-02-24 10:01:12.314547 | controller | skipping: [instance] 2026-02-24 10:01:12.314581 | controller | 2026-02-24 10:01:12.314591 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2026-02-24 10:01:12.314654 | controller | Tuesday 24 February 2026 10:01:12 +0000 (0:00:00.020) 0:01:18.832 ****** 2026-02-24 10:01:12.653823 | controller | ok: [instance] 2026-02-24 10:01:12.654624 | controller | 2026-02-24 10:01:12.883749 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2026-02-24 10:01:12.883782 | controller | Tuesday 24 February 2026 10:01:12 +0000 (0:00:00.339) 0:01:19.171 ****** 2026-02-24 10:01:12.883794 | controller | ok: [instance] 2026-02-24 10:01:13.099390 | controller | 2026-02-24 10:01:13.099423 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2026-02-24 10:01:13.099431 | controller | Tuesday 24 February 2026 10:01:12 +0000 (0:00:00.229) 0:01:19.400 ****** 2026-02-24 10:01:13.099441 | controller | ok: [instance] 2026-02-24 10:01:13.099464 | controller | 2026-02-24 10:01:13.099471 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2026-02-24 10:01:13.099479 | controller | Tuesday 24 February 2026 10:01:13 +0000 (0:00:00.216) 0:01:19.616 ****** 2026-02-24 10:01:13.317349 | controller | ok: [instance] 2026-02-24 10:01:13.534929 | controller | 2026-02-24 10:01:13.534963 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2026-02-24 10:01:13.534971 | controller | Tuesday 24 February 2026 10:01:13 +0000 (0:00:00.217) 0:01:19.834 ****** 2026-02-24 10:01:13.534980 | controller | ok: [instance] 2026-02-24 10:01:13.574195 | controller | 2026-02-24 10:01:13.574219 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 10:01:13.574228 | controller | Tuesday 24 February 2026 10:01:13 +0000 (0:00:00.217) 0:01:20.052 ****** 2026-02-24 10:01:13.574239 | controller | 2026-02-24 10:01:13.765400 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-24 10:01:13.765444 | controller | Tuesday 24 February 2026 10:01:13 +0000 (0:00:00.039) 0:01:20.091 ****** 2026-02-24 10:01:13.765463 | controller | ok: [instance] 2026-02-24 10:01:13.788851 | controller | 2026-02-24 10:01:13.788877 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-24 10:01:13.788886 | controller | Tuesday 24 February 2026 10:01:13 +0000 (0:00:00.190) 0:01:20.282 ****** 2026-02-24 10:01:13.788897 | controller | ok: [instance] 2026-02-24 10:01:13.812790 | controller | 2026-02-24 10:01:13.812812 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-24 10:01:13.812821 | controller | Tuesday 24 February 2026 10:01:13 +0000 (0:00:00.023) 0:01:20.306 ****** 2026-02-24 10:01:13.812832 | controller | skipping: [instance] 2026-02-24 10:01:14.095800 | controller | 2026-02-24 10:01:14.095830 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2026-02-24 10:01:14.095837 | controller | Tuesday 24 February 2026 10:01:13 +0000 (0:00:00.023) 0:01:20.330 ****** 2026-02-24 10:01:14.095847 | controller | ok: [instance] 2026-02-24 10:01:14.314010 | controller | 2026-02-24 10:01:14.314040 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2026-02-24 10:01:14.314048 | controller | Tuesday 24 February 2026 10:01:14 +0000 (0:00:00.282) 0:01:20.613 ****** 2026-02-24 10:01:14.314058 | controller | ok: [instance] 2026-02-24 10:01:14.490784 | controller | 2026-02-24 10:01:14.490808 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2026-02-24 10:01:14.490815 | controller | Tuesday 24 February 2026 10:01:14 +0000 (0:00:00.218) 0:01:20.831 ****** 2026-02-24 10:01:14.490825 | controller | ok: [instance] 2026-02-24 10:01:14.549435 | controller | 2026-02-24 10:01:14.549469 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2026-02-24 10:01:14.549479 | controller | Tuesday 24 February 2026 10:01:14 +0000 (0:00:00.177) 0:01:21.008 ****** 2026-02-24 10:01:14.549493 | controller | 2026-02-24 10:01:14.549504 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-24 10:01:14.549517 | controller | Tuesday 24 February 2026 10:01:14 +0000 (0:00:00.058) 0:01:21.067 ****** 2026-02-24 10:01:14.593262 | controller | ok: [instance] => changed=false 2026-02-24 10:01:14.775422 | controller | msg: All assertions passed 2026-02-24 10:01:14.775456 | controller | 2026-02-24 10:01:14.775466 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-24 10:01:14.775474 | controller | Tuesday 24 February 2026 10:01:14 +0000 (0:00:00.043) 0:01:21.110 ****** 2026-02-24 10:01:14.775486 | controller | ok: [instance] 2026-02-24 10:01:14.961545 | controller | 2026-02-24 10:01:14.961567 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-24 10:01:14.961575 | controller | Tuesday 24 February 2026 10:01:14 +0000 (0:00:00.182) 0:01:21.292 ****** 2026-02-24 10:01:14.961584 | controller | ok: [instance] 2026-02-24 10:01:14.984437 | controller | 2026-02-24 10:01:14.984473 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-24 10:01:14.984484 | controller | Tuesday 24 February 2026 10:01:14 +0000 (0:00:00.186) 0:01:21.479 ****** 2026-02-24 10:01:14.984496 | controller | ok: [instance] => changed=false 2026-02-24 10:01:14.984527 | controller | msg: All assertions passed 2026-02-24 10:01:14.984536 | controller | 2026-02-24 10:01:14.984734 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-24 10:01:15.164921 | controller | Tuesday 24 February 2026 10:01:14 +0000 (0:00:00.022) 0:01:21.502 ****** 2026-02-24 10:01:15.164964 | controller | ok: [instance] 2026-02-24 10:01:15.338986 | controller | 2026-02-24 10:01:15.339010 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-24 10:01:15.339019 | controller | Tuesday 24 February 2026 10:01:15 +0000 (0:00:00.180) 0:01:21.682 ****** 2026-02-24 10:01:15.339028 | controller | ok: [instance] 2026-02-24 10:01:15.386236 | controller | 2026-02-24 10:01:15.386254 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-24 10:01:15.386261 | controller | Tuesday 24 February 2026 10:01:15 +0000 (0:00:00.174) 0:01:21.856 ****** 2026-02-24 10:01:15.386270 | controller | ok: [instance] 2026-02-24 10:01:15.770415 | controller | 2026-02-24 10:01:15.770448 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2026-02-24 10:01:15.770458 | controller | Tuesday 24 February 2026 10:01:15 +0000 (0:00:00.047) 0:01:21.903 ****** 2026-02-24 10:01:15.770470 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2026-02-24 10:01:15.770500 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2026-02-24 10:01:15.770510 | controller | 2026-02-24 10:01:15.770676 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2026-02-24 10:01:15.789950 | controller | Tuesday 24 February 2026 10:01:15 +0000 (0:00:00.384) 0:01:22.287 ****** 2026-02-24 10:01:15.789980 | controller | skipping: [instance] 2026-02-24 10:01:15.813740 | controller | 2026-02-24 10:01:15.813763 | controller | TASK [Load the architecture local kustomize patches] *************************** 2026-02-24 10:01:15.813775 | controller | Tuesday 24 February 2026 10:01:15 +0000 (0:00:00.019) 0:01:22.307 ****** 2026-02-24 10:01:15.813787 | controller | skipping: [instance] 2026-02-24 10:01:15.946151 | controller | 2026-02-24 10:01:15.946169 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2026-02-24 10:01:15.946176 | controller | Tuesday 24 February 2026 10:01:15 +0000 (0:00:00.023) 0:01:22.331 ****** 2026-02-24 10:01:15.946184 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2026-02-24 10:01:15.971221 | controller | 2026-02-24 10:01:15.971239 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2026-02-24 10:01:15.971247 | controller | Tuesday 24 February 2026 10:01:15 +0000 (0:00:00.132) 0:01:22.463 ****** 2026-02-24 10:01:15.971256 | controller | skipping: [instance] 2026-02-24 10:01:16.383899 | controller | 2026-02-24 10:01:16.383928 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2026-02-24 10:01:16.383948 | controller | Tuesday 24 February 2026 10:01:15 +0000 (0:00:00.024) 0:01:22.488 ****** 2026-02-24 10:01:16.383959 | controller | changed: [instance] 2026-02-24 10:01:16.896428 | controller | 2026-02-24 10:01:16.896466 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2026-02-24 10:01:16.896477 | controller | Tuesday 24 February 2026 10:01:16 +0000 (0:00:00.412) 0:01:22.901 ****** 2026-02-24 10:01:16.896489 | controller | changed: [instance] 2026-02-24 10:01:16.896524 | controller | 2026-02-24 10:01:16.896532 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2026-02-24 10:01:16.896541 | controller | Tuesday 24 February 2026 10:01:16 +0000 (0:00:00.501) 0:01:23.402 ****** 2026-02-24 10:01:16.896748 | controller | 2026-02-24 10:01:16.896776 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 10:01:17.316410 | controller | Tuesday 24 February 2026 10:01:16 +0000 (0:00:00.011) 0:01:23.413 ****** 2026-02-24 10:01:17.316443 | controller | changed: [instance] 2026-02-24 10:01:17.316518 | controller | 2026-02-24 10:01:17.316546 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-24 10:01:17.316558 | controller | Tuesday 24 February 2026 10:01:17 +0000 (0:00:00.419) 0:01:23.833 ****** 2026-02-24 10:01:18.967452 | controller | changed: [instance] 2026-02-24 10:01:18.999091 | controller | 2026-02-24 10:01:18.999119 | controller | TASK [Deploy virtualbmc] ******************************************************* 2026-02-24 10:01:18.999127 | controller | Tuesday 24 February 2026 10:01:18 +0000 (0:00:01.651) 0:01:25.484 ****** 2026-02-24 10:01:18.999137 | controller | skipping: [instance] 2026-02-24 10:01:19.033357 | controller | 2026-02-24 10:01:19.033397 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2026-02-24 10:01:19.033408 | controller | Tuesday 24 February 2026 10:01:18 +0000 (0:00:00.031) 0:01:25.516 ****** 2026-02-24 10:01:19.033423 | controller | skipping: [instance] 2026-02-24 10:01:19.033432 | controller | 2026-02-24 10:01:19.033439 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2026-02-24 10:01:19.033449 | controller | Tuesday 24 February 2026 10:01:19 +0000 (0:00:00.034) 0:01:25.550 ****** 2026-02-24 10:01:19.588386 | controller | changed: [instance] => (item=workload) 2026-02-24 10:01:19.588459 | controller | changed: [instance] => (item=reproducer-inventory) 2026-02-24 10:01:19.588481 | controller | ok: [instance] => (item=volumes) 2026-02-24 10:01:19.588493 | controller | 2026-02-24 10:01:19.588500 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2026-02-24 10:01:19.588508 | controller | Tuesday 24 February 2026 10:01:19 +0000 (0:00:00.554) 0:01:26.105 ****** 2026-02-24 10:01:19.999232 | controller | changed: [instance] => (item=workload) 2026-02-24 10:01:20.022973 | controller | changed: [instance] => (item=volumes) 2026-02-24 10:01:20.022990 | controller | 2026-02-24 10:01:20.022998 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2026-02-24 10:01:20.023004 | controller | Tuesday 24 February 2026 10:01:19 +0000 (0:00:00.411) 0:01:26.516 ****** 2026-02-24 10:01:20.023012 | controller | skipping: [instance] 2026-02-24 10:01:21.034412 | controller | 2026-02-24 10:01:21.034442 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2026-02-24 10:01:21.034450 | controller | Tuesday 24 February 2026 10:01:20 +0000 (0:00:00.024) 0:01:26.540 ****** 2026-02-24 10:01:21.034460 | controller | changed: [instance] => (item=compute) 2026-02-24 10:01:21.034484 | controller | changed: [instance] => (item=controller) 2026-02-24 10:01:21.034491 | controller | changed: [instance] => (item=crc) 2026-02-24 10:01:21.034497 | controller | 2026-02-24 10:01:21.034502 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2026-02-24 10:01:21.034509 | controller | Tuesday 24 February 2026 10:01:21 +0000 (0:00:01.011) 0:01:27.551 ****** 2026-02-24 10:01:21.066861 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance 2026-02-24 10:01:21.248423 | controller | 2026-02-24 10:01:21.248450 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] ***************** 2026-02-24 10:01:21.248458 | controller | Tuesday 24 February 2026 10:01:21 +0000 (0:00:00.032) 0:01:27.584 ****** 2026-02-24 10:01:21.248471 | controller | ok: [instance] 2026-02-24 10:01:21.248551 | controller | 2026-02-24 10:01:21.248578 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* 2026-02-24 10:01:21.248590 | controller | Tuesday 24 February 2026 10:01:21 +0000 (0:00:00.181) 0:01:27.765 ****** 2026-02-24 10:01:21.267857 | controller | skipping: [instance] 2026-02-24 10:01:21.637785 | controller | 2026-02-24 10:01:21.637804 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] *** 2026-02-24 10:01:21.637812 | controller | Tuesday 24 February 2026 10:01:21 +0000 (0:00:00.019) 0:01:27.785 ****** 2026-02-24 10:01:21.637821 | controller | changed: [instance] 2026-02-24 10:01:21.656987 | controller | 2026-02-24 10:01:21.657004 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* 2026-02-24 10:01:21.657011 | controller | Tuesday 24 February 2026 10:01:21 +0000 (0:00:00.370) 0:01:28.155 ****** 2026-02-24 10:01:21.657020 | controller | skipping: [instance] 2026-02-24 10:01:21.676090 | controller | 2026-02-24 10:01:21.676109 | controller | TASK [libvirt_manager : Write merged all-group.yml] **************************** 2026-02-24 10:01:21.676116 | controller | Tuesday 24 February 2026 10:01:21 +0000 (0:00:00.019) 0:01:28.174 ****** 2026-02-24 10:01:21.676125 | controller | skipping: [instance] 2026-02-24 10:01:21.714694 | controller | 2026-02-24 10:01:21.714716 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2026-02-24 10:01:21.714725 | controller | Tuesday 24 February 2026 10:01:21 +0000 (0:00:00.019) 0:01:28.193 ****** 2026-02-24 10:01:21.714736 | controller | skipping: [instance] 2026-02-24 10:01:21.780446 | controller | 2026-02-24 10:01:21.780462 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2026-02-24 10:01:21.780469 | controller | Tuesday 24 February 2026 10:01:21 +0000 (0:00:00.038) 0:01:28.232 ****** 2026-02-24 10:01:21.780477 | controller | skipping: [instance] => (item=crc) 2026-02-24 10:01:21.983126 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2026-02-24 10:01:21.983149 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2026-02-24 10:01:21.983165 | controller | 2026-02-24 10:01:21.983173 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-24 10:01:21.983180 | controller | Tuesday 24 February 2026 10:01:21 +0000 (0:00:00.065) 0:01:28.297 ****** 2026-02-24 10:01:21.983190 | controller | changed: [instance] 2026-02-24 10:01:22.163211 | controller | 2026-02-24 10:01:22.163235 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-24 10:01:22.163243 | controller | Tuesday 24 February 2026 10:01:21 +0000 (0:00:00.202) 0:01:28.500 ****** 2026-02-24 10:01:22.163252 | controller | ok: [instance] 2026-02-24 10:01:52.954132 | controller | 2026-02-24 10:01:52.954168 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-24 10:01:52.954178 | controller | Tuesday 24 February 2026 10:01:22 +0000 (0:00:00.180) 0:01:28.680 ****** 2026-02-24 10:01:52.954190 | controller | changed: [instance] 2026-02-24 10:01:53.151745 | controller | 2026-02-24 10:01:53.151771 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-24 10:01:53.151779 | controller | Tuesday 24 February 2026 10:01:52 +0000 (0:00:30.790) 0:01:59.471 ****** 2026-02-24 10:01:53.151788 | controller | ok: [instance] 2026-02-24 10:01:53.195050 | controller | 2026-02-24 10:01:53.195067 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-24 10:01:53.195074 | controller | Tuesday 24 February 2026 10:01:53 +0000 (0:00:00.197) 0:01:59.669 ****** 2026-02-24 10:01:53.195083 | controller | ok: [instance] => changed=false 2026-02-24 10:01:53.404086 | controller | msg: All assertions passed 2026-02-24 10:01:53.404109 | controller | 2026-02-24 10:01:53.404118 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-24 10:01:53.404125 | controller | Tuesday 24 February 2026 10:01:53 +0000 (0:00:00.043) 0:01:59.712 ****** 2026-02-24 10:01:53.404136 | controller | changed: [instance] 2026-02-24 10:01:53.615388 | controller | 2026-02-24 10:01:53.615425 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-24 10:01:53.615435 | controller | Tuesday 24 February 2026 10:01:53 +0000 (0:00:00.209) 0:01:59.921 ****** 2026-02-24 10:01:53.615447 | controller | ok: [instance] 2026-02-24 10:01:53.615478 | controller | 2026-02-24 10:01:53.615665 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-24 10:01:53.808448 | controller | Tuesday 24 February 2026 10:01:53 +0000 (0:00:00.211) 0:02:00.133 ****** 2026-02-24 10:01:53.808494 | controller | ok: [instance] 2026-02-24 10:01:53.808528 | controller | 2026-02-24 10:01:53.808539 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-24 10:01:53.808622 | controller | Tuesday 24 February 2026 10:01:53 +0000 (0:00:00.192) 0:02:00.326 ****** 2026-02-24 10:01:53.832142 | controller | skipping: [instance] 2026-02-24 10:01:54.020197 | controller | 2026-02-24 10:01:54.020220 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-24 10:01:54.020229 | controller | Tuesday 24 February 2026 10:01:53 +0000 (0:00:00.023) 0:02:00.349 ****** 2026-02-24 10:01:54.020244 | controller | ok: [instance] 2026-02-24 10:01:54.060363 | controller | 2026-02-24 10:01:54.060391 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-24 10:01:54.060401 | controller | Tuesday 24 February 2026 10:01:54 +0000 (0:00:00.187) 0:02:00.537 ****** 2026-02-24 10:01:54.060413 | controller | ok: [instance] => changed=false 2026-02-24 10:01:54.060666 | controller | msg: All assertions passed 2026-02-24 10:01:54.265970 | controller | 2026-02-24 10:01:54.265997 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-24 10:01:54.266004 | controller | Tuesday 24 February 2026 10:01:54 +0000 (0:00:00.040) 0:02:00.578 ****** 2026-02-24 10:01:54.266025 | controller | ok: [instance] 2026-02-24 10:01:54.442216 | controller | 2026-02-24 10:01:54.442239 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2026-02-24 10:01:54.442246 | controller | Tuesday 24 February 2026 10:01:54 +0000 (0:00:00.205) 0:02:00.783 ****** 2026-02-24 10:01:54.442255 | controller | ok: [instance] 2026-02-24 10:01:54.828002 | controller | 2026-02-24 10:01:54.828043 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2026-02-24 10:01:54.828061 | controller | Tuesday 24 February 2026 10:01:54 +0000 (0:00:00.176) 0:02:00.959 ****** 2026-02-24 10:01:54.828071 | controller | changed: [instance] 2026-02-24 10:01:55.004746 | controller | 2026-02-24 10:01:55.004773 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2026-02-24 10:01:55.004786 | controller | Tuesday 24 February 2026 10:01:54 +0000 (0:00:00.385) 0:02:01.345 ****** 2026-02-24 10:01:55.004796 | controller | ok: [instance] 2026-02-24 10:01:55.182757 | controller | 2026-02-24 10:01:55.182792 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2026-02-24 10:01:55.182800 | controller | Tuesday 24 February 2026 10:01:55 +0000 (0:00:00.176) 0:02:01.522 ****** 2026-02-24 10:01:55.182810 | controller | ok: [instance] 2026-02-24 10:01:55.588100 | controller | 2026-02-24 10:01:55.588131 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2026-02-24 10:01:55.588140 | controller | Tuesday 24 February 2026 10:01:55 +0000 (0:00:00.177) 0:02:01.699 ****** 2026-02-24 10:01:55.588151 | controller | changed: [instance] 2026-02-24 10:01:55.609426 | controller | 2026-02-24 10:01:55.609450 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2026-02-24 10:01:55.609456 | controller | Tuesday 24 February 2026 10:01:55 +0000 (0:00:00.405) 0:02:02.105 ****** 2026-02-24 10:01:55.609465 | controller | ok: [instance] 2026-02-24 10:01:55.831444 | controller | 2026-02-24 10:01:55.831471 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2026-02-24 10:01:55.831479 | controller | Tuesday 24 February 2026 10:01:55 +0000 (0:00:00.021) 0:02:02.126 ****** 2026-02-24 10:01:55.831489 | controller | ok: [instance] 2026-02-24 10:01:56.299784 | controller | 2026-02-24 10:01:56.299810 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2026-02-24 10:01:56.299818 | controller | Tuesday 24 February 2026 10:01:55 +0000 (0:00:00.221) 0:02:02.348 ****** 2026-02-24 10:01:56.299828 | controller | ok: [instance] 2026-02-24 10:01:56.417208 | controller | 2026-02-24 10:01:56.417231 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2026-02-24 10:01:56.417239 | controller | Tuesday 24 February 2026 10:01:56 +0000 (0:00:00.468) 0:02:02.817 ****** 2026-02-24 10:01:56.417248 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 10:01:56.667371 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 10:01:56.667400 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 10:01:56.667409 | controller | 2026-02-24 10:01:56.667415 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2026-02-24 10:01:56.667421 | controller | Tuesday 24 February 2026 10:01:56 +0000 (0:00:00.117) 0:02:02.934 ****** 2026-02-24 10:01:56.667430 | controller | changed: [instance] 2026-02-24 10:01:56.893141 | controller | 2026-02-24 10:01:56.893167 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2026-02-24 10:01:56.893175 | controller | Tuesday 24 February 2026 10:01:56 +0000 (0:00:00.250) 0:02:03.184 ****** 2026-02-24 10:01:56.893184 | controller | changed: [instance] 2026-02-24 10:01:57.171817 | controller | 2026-02-24 10:01:57.171839 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2026-02-24 10:01:57.171847 | controller | Tuesday 24 February 2026 10:01:56 +0000 (0:00:00.225) 0:02:03.410 ****** 2026-02-24 10:01:57.171856 | controller | changed: [instance] 2026-02-24 10:01:57.200450 | controller | 2026-02-24 10:01:57.200500 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2026-02-24 10:01:57.200511 | controller | Tuesday 24 February 2026 10:01:57 +0000 (0:00:00.279) 0:02:03.689 ****** 2026-02-24 10:01:57.200525 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 10:01:57.243165 | controller | 2026-02-24 10:01:57.243193 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 10:01:57.243202 | controller | Tuesday 24 February 2026 10:01:57 +0000 (0:00:00.028) 0:02:03.717 ****** 2026-02-24 10:01:57.243213 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 10:01:57.474427 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 10:01:57.474482 | controller | 2026-02-24 10:01:57.474496 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 10:01:57.474506 | controller | Tuesday 24 February 2026 10:01:57 +0000 (0:00:00.042) 0:02:03.760 ****** 2026-02-24 10:01:57.474520 | controller | ok: [instance] 2026-02-24 10:01:57.474561 | controller | 2026-02-24 10:01:57.474574 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 10:01:57.474718 | controller | Tuesday 24 February 2026 10:01:57 +0000 (0:00:00.231) 0:02:03.992 ****** 2026-02-24 10:01:57.518510 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 10:01:57.746740 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 10:01:57.746762 | controller | 2026-02-24 10:01:57.746770 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 10:01:57.746776 | controller | Tuesday 24 February 2026 10:01:57 +0000 (0:00:00.043) 0:02:04.035 ****** 2026-02-24 10:01:57.746785 | controller | ok: [instance] 2026-02-24 10:01:57.940751 | controller | 2026-02-24 10:01:57.940770 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 10:01:57.940778 | controller | Tuesday 24 February 2026 10:01:57 +0000 (0:00:00.228) 0:02:04.264 ****** 2026-02-24 10:01:57.940787 | controller | ok: [instance] 2026-02-24 10:01:58.219128 | controller | 2026-02-24 10:01:58.219150 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2026-02-24 10:01:58.219159 | controller | Tuesday 24 February 2026 10:01:57 +0000 (0:00:00.194) 0:02:04.458 ****** 2026-02-24 10:01:58.219169 | controller | changed: [instance] 2026-02-24 10:01:58.439990 | controller | 2026-02-24 10:01:58.440008 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 10:01:58.440015 | controller | Tuesday 24 February 2026 10:01:58 +0000 (0:00:00.278) 0:02:04.736 ****** 2026-02-24 10:01:58.440036 | controller | ok: [instance] 2026-02-24 10:01:58.482181 | controller | 2026-02-24 10:01:58.482198 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 10:01:58.482205 | controller | Tuesday 24 February 2026 10:01:58 +0000 (0:00:00.220) 0:02:04.957 ****** 2026-02-24 10:01:58.482213 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 10:01:58.700444 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 10:01:58.700480 | controller | 2026-02-24 10:01:58.700490 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 10:01:58.700498 | controller | Tuesday 24 February 2026 10:01:58 +0000 (0:00:00.042) 0:02:04.999 ****** 2026-02-24 10:01:58.700510 | controller | ok: [instance] 2026-02-24 10:01:58.700540 | controller | 2026-02-24 10:01:58.700551 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 10:01:58.700667 | controller | Tuesday 24 February 2026 10:01:58 +0000 (0:00:00.218) 0:02:05.217 ****** 2026-02-24 10:01:58.895463 | controller | ok: [instance] 2026-02-24 10:01:58.895614 | controller | 2026-02-24 10:01:58.895631 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2026-02-24 10:01:58.895641 | controller | Tuesday 24 February 2026 10:01:58 +0000 (0:00:00.194) 0:02:05.412 ****** 2026-02-24 10:02:00.172188 | controller | changed: [instance] 2026-02-24 10:02:00.192519 | controller | 2026-02-24 10:02:00.192555 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2026-02-24 10:02:00.192565 | controller | Tuesday 24 February 2026 10:02:00 +0000 (0:00:01.277) 0:02:06.689 ****** 2026-02-24 10:02:00.192578 | controller | skipping: [instance] 2026-02-24 10:02:00.192616 | controller | 2026-02-24 10:02:00.192626 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2026-02-24 10:02:00.192804 | controller | Tuesday 24 February 2026 10:02:00 +0000 (0:00:00.020) 0:02:06.710 ****** 2026-02-24 10:02:00.219432 | controller | skipping: [instance] 2026-02-24 10:02:00.245130 | controller | 2026-02-24 10:02:00.245151 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2026-02-24 10:02:00.245158 | controller | Tuesday 24 February 2026 10:02:00 +0000 (0:00:00.026) 0:02:06.736 ****** 2026-02-24 10:02:00.245167 | controller | skipping: [instance] 2026-02-24 10:02:00.269834 | controller | 2026-02-24 10:02:00.269853 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2026-02-24 10:02:00.269860 | controller | Tuesday 24 February 2026 10:02:00 +0000 (0:00:00.025) 0:02:06.762 ****** 2026-02-24 10:02:00.269868 | controller | skipping: [instance] 2026-02-24 10:02:00.480374 | controller | 2026-02-24 10:02:00.480404 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 10:02:00.480415 | controller | Tuesday 24 February 2026 10:02:00 +0000 (0:00:00.024) 0:02:06.787 ****** 2026-02-24 10:02:00.480426 | controller | changed: [instance] 2026-02-24 10:02:00.480479 | controller | 2026-02-24 10:02:00.480506 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 10:02:00.480520 | controller | Tuesday 24 February 2026 10:02:00 +0000 (0:00:00.210) 0:02:06.997 ****** 2026-02-24 10:02:00.516895 | controller | ok: [instance] 2026-02-24 10:02:00.568874 | controller | 2026-02-24 10:02:00.568891 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 10:02:00.568899 | controller | Tuesday 24 February 2026 10:02:00 +0000 (0:00:00.036) 0:02:07.034 ****** 2026-02-24 10:02:00.568910 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-24 10:02:00.797995 | controller | 2026-02-24 10:02:00.798018 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-24 10:02:00.798036 | controller | Tuesday 24 February 2026 10:02:00 +0000 (0:00:00.051) 0:02:07.086 ****** 2026-02-24 10:02:00.798046 | controller | ok: [instance] 2026-02-24 10:02:00.859374 | controller | 2026-02-24 10:02:00.859409 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-24 10:02:00.859420 | controller | Tuesday 24 February 2026 10:02:00 +0000 (0:00:00.229) 0:02:07.315 ****** 2026-02-24 10:02:00.859432 | controller | ok: [instance] 2026-02-24 10:02:00.859461 | controller | 2026-02-24 10:02:00.859471 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-24 10:02:00.859546 | controller | Tuesday 24 February 2026 10:02:00 +0000 (0:00:00.061) 0:02:07.376 ****** 2026-02-24 10:02:00.903973 | controller | ok: [instance] 2026-02-24 10:02:00.982354 | controller | 2026-02-24 10:02:00.982384 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-24 10:02:00.982393 | controller | Tuesday 24 February 2026 10:02:00 +0000 (0:00:00.044) 0:02:07.421 ****** 2026-02-24 10:02:00.982405 | controller | skipping: [instance] 2026-02-24 10:02:00.982434 | controller | 2026-02-24 10:02:00.982444 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-24 10:02:00.982624 | controller | Tuesday 24 February 2026 10:02:00 +0000 (0:00:00.078) 0:02:07.499 ****** 2026-02-24 10:02:01.024534 | controller | skipping: [instance] 2026-02-24 10:02:01.082735 | controller | 2026-02-24 10:02:01.082768 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-24 10:02:01.082782 | controller | Tuesday 24 February 2026 10:02:01 +0000 (0:00:00.041) 0:02:07.541 ****** 2026-02-24 10:02:01.082797 | controller | 2026-02-24 10:02:01.475091 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-24 10:02:01.475121 | controller | Tuesday 24 February 2026 10:02:01 +0000 (0:00:00.058) 0:02:07.600 ****** 2026-02-24 10:02:01.475133 | controller | ok: [instance] => (item=artifacts) 2026-02-24 10:02:02.630373 | controller | ok: [instance] => (item=logs) 2026-02-24 10:02:02.630414 | controller | 2026-02-24 10:02:02.630422 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-24 10:02:02.630432 | controller | Tuesday 24 February 2026 10:02:01 +0000 (0:00:00.392) 0:02:07.992 ****** 2026-02-24 10:02:02.630442 | controller | ok: [instance] 2026-02-24 10:02:02.630459 | controller | 2026-02-24 10:02:02.630493 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-24 10:02:02.630621 | controller | Tuesday 24 February 2026 10:02:02 +0000 (0:00:01.155) 0:02:09.148 ****** 2026-02-24 10:02:02.838344 | controller | changed: [instance] 2026-02-24 10:02:03.197982 | controller | 2026-02-24 10:02:03.198014 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-24 10:02:03.198022 | controller | Tuesday 24 February 2026 10:02:02 +0000 (0:00:00.207) 0:02:09.355 ****** 2026-02-24 10:02:03.198041 | controller | changed: [instance] 2026-02-24 10:02:03.580137 | controller | 2026-02-24 10:02:03.580167 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-24 10:02:03.580175 | controller | Tuesday 24 February 2026 10:02:03 +0000 (0:00:00.359) 0:02:09.715 ****** 2026-02-24 10:02:03.580185 | controller | changed: [instance] 2026-02-24 10:02:03.626716 | controller | 2026-02-24 10:02:03.626741 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-24 10:02:03.626749 | controller | Tuesday 24 February 2026 10:02:03 +0000 (0:00:00.382) 0:02:10.097 ****** 2026-02-24 10:02:03.626758 | controller | skipping: [instance] 2026-02-24 10:02:03.826261 | controller | 2026-02-24 10:02:03.826309 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-24 10:02:03.826322 | controller | Tuesday 24 February 2026 10:02:03 +0000 (0:00:00.046) 0:02:10.144 ****** 2026-02-24 10:02:03.826339 | controller | ok: [instance] 2026-02-24 10:02:03.868069 | controller | 2026-02-24 10:02:03.868091 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-24 10:02:03.868098 | controller | Tuesday 24 February 2026 10:02:03 +0000 (0:00:00.199) 0:02:10.343 ****** 2026-02-24 10:02:03.868108 | controller | skipping: [instance] 2026-02-24 10:02:04.104387 | controller | 2026-02-24 10:02:04.104424 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-24 10:02:04.104434 | controller | Tuesday 24 February 2026 10:02:03 +0000 (0:00:00.041) 0:02:10.385 ****** 2026-02-24 10:02:04.104448 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2026-02-24 10:02:04.379795 | controller | changed: [instance] 2026-02-24 10:02:04.379827 | controller | 2026-02-24 10:02:04.379837 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 10:02:04.379845 | controller | Tuesday 24 February 2026 10:02:04 +0000 (0:00:00.236) 0:02:10.621 ****** 2026-02-24 10:02:04.379857 | controller | changed: [instance] 2026-02-24 10:02:04.426780 | controller | 2026-02-24 10:02:04.426822 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 10:02:04.426836 | controller | Tuesday 24 February 2026 10:02:04 +0000 (0:00:00.275) 0:02:10.897 ****** 2026-02-24 10:02:04.426852 | controller | skipping: [instance] 2026-02-24 10:02:04.426901 | controller | 2026-02-24 10:02:04.426915 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2026-02-24 10:02:04.454121 | controller | Tuesday 24 February 2026 10:02:04 +0000 (0:00:00.046) 0:02:10.943 ****** 2026-02-24 10:02:04.454201 | controller | skipping: [instance] 2026-02-24 10:02:04.700232 | controller | 2026-02-24 10:02:04.700316 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2026-02-24 10:02:04.700326 | controller | Tuesday 24 February 2026 10:02:04 +0000 (0:00:00.027) 0:02:10.971 ****** 2026-02-24 10:02:04.700340 | controller | changed: [instance] 2026-02-24 10:02:04.924422 | controller | 2026-02-24 10:02:04.924471 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2026-02-24 10:02:04.924480 | controller | Tuesday 24 February 2026 10:02:04 +0000 (0:00:00.245) 0:02:11.216 ****** 2026-02-24 10:02:04.924493 | controller | changed: [instance] 2026-02-24 10:02:05.221491 | controller | 2026-02-24 10:02:05.221541 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2026-02-24 10:02:05.221550 | controller | Tuesday 24 February 2026 10:02:04 +0000 (0:00:00.224) 0:02:11.441 ****** 2026-02-24 10:02:05.221568 | controller | changed: [instance] 2026-02-24 10:02:05.249434 | controller | 2026-02-24 10:02:05.249488 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2026-02-24 10:02:05.249499 | controller | Tuesday 24 February 2026 10:02:05 +0000 (0:00:00.296) 0:02:11.738 ****** 2026-02-24 10:02:05.249514 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 10:02:05.249562 | controller | 2026-02-24 10:02:05.249572 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 10:02:05.294416 | controller | Tuesday 24 February 2026 10:02:05 +0000 (0:00:00.028) 0:02:11.766 ****** 2026-02-24 10:02:05.294469 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 10:02:05.294516 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 10:02:05.294526 | controller | 2026-02-24 10:02:05.294533 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 10:02:05.294543 | controller | Tuesday 24 February 2026 10:02:05 +0000 (0:00:00.044) 0:02:11.811 ****** 2026-02-24 10:02:05.528229 | controller | ok: [instance] 2026-02-24 10:02:05.573505 | controller | 2026-02-24 10:02:05.573560 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 10:02:05.573571 | controller | Tuesday 24 February 2026 10:02:05 +0000 (0:00:00.233) 0:02:12.045 ****** 2026-02-24 10:02:05.573585 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 10:02:05.573628 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 10:02:05.573637 | controller | 2026-02-24 10:02:05.573646 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 10:02:05.806479 | controller | Tuesday 24 February 2026 10:02:05 +0000 (0:00:00.045) 0:02:12.090 ****** 2026-02-24 10:02:05.806552 | controller | ok: [instance] 2026-02-24 10:02:06.000319 | controller | 2026-02-24 10:02:06.000392 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 10:02:06.000401 | controller | Tuesday 24 February 2026 10:02:05 +0000 (0:00:00.232) 0:02:12.323 ****** 2026-02-24 10:02:06.000414 | controller | ok: [instance] 2026-02-24 10:02:06.273461 | controller | 2026-02-24 10:02:06.273505 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2026-02-24 10:02:06.273515 | controller | Tuesday 24 February 2026 10:02:05 +0000 (0:00:00.193) 0:02:12.516 ****** 2026-02-24 10:02:06.273533 | controller | changed: [instance] 2026-02-24 10:02:06.273570 | controller | 2026-02-24 10:02:06.273580 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 10:02:06.273612 | controller | Tuesday 24 February 2026 10:02:06 +0000 (0:00:00.273) 0:02:12.790 ****** 2026-02-24 10:02:06.499969 | controller | ok: [instance] 2026-02-24 10:02:06.540464 | controller | 2026-02-24 10:02:06.540498 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 10:02:06.540509 | controller | Tuesday 24 February 2026 10:02:06 +0000 (0:00:00.226) 0:02:13.017 ****** 2026-02-24 10:02:06.540521 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 10:02:06.765836 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 10:02:06.765864 | controller | 2026-02-24 10:02:06.765874 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 10:02:06.765882 | controller | Tuesday 24 February 2026 10:02:06 +0000 (0:00:00.040) 0:02:13.057 ****** 2026-02-24 10:02:06.765893 | controller | ok: [instance] 2026-02-24 10:02:06.967760 | controller | 2026-02-24 10:02:06.967780 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 10:02:06.967787 | controller | Tuesday 24 February 2026 10:02:06 +0000 (0:00:00.225) 0:02:13.283 ****** 2026-02-24 10:02:06.967795 | controller | ok: [instance] 2026-02-24 10:02:07.250754 | controller | 2026-02-24 10:02:07.250774 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2026-02-24 10:02:07.250782 | controller | Tuesday 24 February 2026 10:02:06 +0000 (0:00:00.202) 0:02:13.485 ****** 2026-02-24 10:02:07.250793 | controller | changed: [instance] 2026-02-24 10:02:07.271107 | controller | 2026-02-24 10:02:07.271141 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2026-02-24 10:02:07.271155 | controller | Tuesday 24 February 2026 10:02:07 +0000 (0:00:00.282) 0:02:13.768 ****** 2026-02-24 10:02:07.271170 | controller | skipping: [instance] 2026-02-24 10:02:07.296541 | controller | 2026-02-24 10:02:07.296611 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2026-02-24 10:02:07.296627 | controller | Tuesday 24 February 2026 10:02:07 +0000 (0:00:00.020) 0:02:13.788 ****** 2026-02-24 10:02:07.296647 | controller | skipping: [instance] 2026-02-24 10:02:07.321254 | controller | 2026-02-24 10:02:07.321336 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2026-02-24 10:02:07.321358 | controller | Tuesday 24 February 2026 10:02:07 +0000 (0:00:00.025) 0:02:13.813 ****** 2026-02-24 10:02:07.321377 | controller | skipping: [instance] 2026-02-24 10:02:07.346452 | controller | 2026-02-24 10:02:07.346504 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2026-02-24 10:02:07.346513 | controller | Tuesday 24 February 2026 10:02:07 +0000 (0:00:00.024) 0:02:13.838 ****** 2026-02-24 10:02:07.346527 | controller | skipping: [instance] 2026-02-24 10:02:07.565773 | controller | 2026-02-24 10:02:07.565811 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 10:02:07.565822 | controller | Tuesday 24 February 2026 10:02:07 +0000 (0:00:00.025) 0:02:13.863 ****** 2026-02-24 10:02:07.565835 | controller | changed: [instance] 2026-02-24 10:02:07.603215 | controller | 2026-02-24 10:02:07.603238 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 10:02:07.603246 | controller | Tuesday 24 February 2026 10:02:07 +0000 (0:00:00.219) 0:02:14.083 ****** 2026-02-24 10:02:07.603255 | controller | ok: [instance] 2026-02-24 10:02:07.659475 | controller | 2026-02-24 10:02:07.659528 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 10:02:07.659540 | controller | Tuesday 24 February 2026 10:02:07 +0000 (0:00:00.037) 0:02:14.120 ****** 2026-02-24 10:02:07.659555 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-24 10:02:07.866430 | controller | 2026-02-24 10:02:07.866495 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-24 10:02:07.866505 | controller | Tuesday 24 February 2026 10:02:07 +0000 (0:00:00.056) 0:02:14.176 ****** 2026-02-24 10:02:07.866520 | controller | ok: [instance] 2026-02-24 10:02:07.930448 | controller | 2026-02-24 10:02:07.930502 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-24 10:02:07.930513 | controller | Tuesday 24 February 2026 10:02:07 +0000 (0:00:00.206) 0:02:14.383 ****** 2026-02-24 10:02:07.930527 | controller | ok: [instance] 2026-02-24 10:02:07.930562 | controller | 2026-02-24 10:02:07.930571 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-24 10:02:07.930743 | controller | Tuesday 24 February 2026 10:02:07 +0000 (0:00:00.064) 0:02:14.447 ****** 2026-02-24 10:02:07.976993 | controller | ok: [instance] 2026-02-24 10:02:08.019073 | controller | 2026-02-24 10:02:08.019099 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-24 10:02:08.019117 | controller | Tuesday 24 February 2026 10:02:07 +0000 (0:00:00.046) 0:02:14.494 ****** 2026-02-24 10:02:08.019128 | controller | skipping: [instance] 2026-02-24 10:02:08.062523 | controller | 2026-02-24 10:02:08.062573 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-24 10:02:08.062584 | controller | Tuesday 24 February 2026 10:02:08 +0000 (0:00:00.042) 0:02:14.536 ****** 2026-02-24 10:02:08.062597 | controller | skipping: [instance] 2026-02-24 10:02:08.122767 | controller | 2026-02-24 10:02:08.122801 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-24 10:02:08.122811 | controller | Tuesday 24 February 2026 10:02:08 +0000 (0:00:00.043) 0:02:14.579 ****** 2026-02-24 10:02:08.122823 | controller | 2026-02-24 10:02:08.530323 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-24 10:02:08.530388 | controller | Tuesday 24 February 2026 10:02:08 +0000 (0:00:00.060) 0:02:14.640 ****** 2026-02-24 10:02:08.530403 | controller | ok: [instance] => (item=artifacts) 2026-02-24 10:02:09.747435 | controller | ok: [instance] => (item=logs) 2026-02-24 10:02:09.747465 | controller | 2026-02-24 10:02:09.747472 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-24 10:02:09.747478 | controller | Tuesday 24 February 2026 10:02:08 +0000 (0:00:00.406) 0:02:15.046 ****** 2026-02-24 10:02:09.747486 | controller | ok: [instance] 2026-02-24 10:02:09.994019 | controller | 2026-02-24 10:02:09.994063 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-24 10:02:09.994072 | controller | Tuesday 24 February 2026 10:02:09 +0000 (0:00:01.217) 0:02:16.264 ****** 2026-02-24 10:02:09.994084 | controller | changed: [instance] 2026-02-24 10:02:10.359381 | controller | 2026-02-24 10:02:10.359412 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-24 10:02:10.359422 | controller | Tuesday 24 February 2026 10:02:09 +0000 (0:00:00.246) 0:02:16.511 ****** 2026-02-24 10:02:10.359434 | controller | changed: [instance] 2026-02-24 10:02:10.359464 | controller | 2026-02-24 10:02:10.359662 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-24 10:02:10.729098 | controller | Tuesday 24 February 2026 10:02:10 +0000 (0:00:00.365) 0:02:16.876 ****** 2026-02-24 10:02:10.729128 | controller | changed: [instance] 2026-02-24 10:02:10.773407 | controller | 2026-02-24 10:02:10.773442 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-24 10:02:10.773452 | controller | Tuesday 24 February 2026 10:02:10 +0000 (0:00:00.369) 0:02:17.246 ****** 2026-02-24 10:02:10.773463 | controller | skipping: [instance] 2026-02-24 10:02:10.773494 | controller | 2026-02-24 10:02:10.773694 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-24 10:02:10.971149 | controller | Tuesday 24 February 2026 10:02:10 +0000 (0:00:00.044) 0:02:17.291 ****** 2026-02-24 10:02:10.971173 | controller | ok: [instance] 2026-02-24 10:02:11.014383 | controller | 2026-02-24 10:02:11.014408 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-24 10:02:11.014419 | controller | Tuesday 24 February 2026 10:02:10 +0000 (0:00:00.197) 0:02:17.488 ****** 2026-02-24 10:02:11.014431 | controller | skipping: [instance] 2026-02-24 10:02:11.014464 | controller | 2026-02-24 10:02:11.014710 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-24 10:02:11.241097 | controller | Tuesday 24 February 2026 10:02:11 +0000 (0:00:00.043) 0:02:17.531 ****** 2026-02-24 10:02:11.241118 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2026-02-24 10:02:11.519010 | controller | changed: [instance] 2026-02-24 10:02:11.519032 | controller | 2026-02-24 10:02:11.519049 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 10:02:11.519056 | controller | Tuesday 24 February 2026 10:02:11 +0000 (0:00:00.226) 0:02:17.758 ****** 2026-02-24 10:02:11.519065 | controller | changed: [instance] 2026-02-24 10:02:11.565176 | controller | 2026-02-24 10:02:11.565200 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 10:02:11.565209 | controller | Tuesday 24 February 2026 10:02:11 +0000 (0:00:00.278) 0:02:18.036 ****** 2026-02-24 10:02:11.565220 | controller | skipping: [instance] 2026-02-24 10:02:11.592237 | controller | 2026-02-24 10:02:11.592258 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2026-02-24 10:02:11.592266 | controller | Tuesday 24 February 2026 10:02:11 +0000 (0:00:00.046) 0:02:18.082 ****** 2026-02-24 10:02:11.592276 | controller | skipping: [instance] 2026-02-24 10:02:11.831020 | controller | 2026-02-24 10:02:11.831068 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2026-02-24 10:02:11.831078 | controller | Tuesday 24 February 2026 10:02:11 +0000 (0:00:00.027) 0:02:18.109 ****** 2026-02-24 10:02:11.831089 | controller | changed: [instance] 2026-02-24 10:02:12.046197 | controller | 2026-02-24 10:02:12.046226 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2026-02-24 10:02:12.046240 | controller | Tuesday 24 February 2026 10:02:11 +0000 (0:00:00.238) 0:02:18.348 ****** 2026-02-24 10:02:12.046251 | controller | changed: [instance] 2026-02-24 10:02:12.330963 | controller | 2026-02-24 10:02:12.330990 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2026-02-24 10:02:12.330997 | controller | Tuesday 24 February 2026 10:02:12 +0000 (0:00:00.215) 0:02:18.563 ****** 2026-02-24 10:02:12.331006 | controller | changed: [instance] 2026-02-24 10:02:12.359771 | controller | 2026-02-24 10:02:12.359789 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2026-02-24 10:02:12.359797 | controller | Tuesday 24 February 2026 10:02:12 +0000 (0:00:00.284) 0:02:18.848 ****** 2026-02-24 10:02:12.359807 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 10:02:12.404823 | controller | 2026-02-24 10:02:12.404843 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 10:02:12.404851 | controller | Tuesday 24 February 2026 10:02:12 +0000 (0:00:00.028) 0:02:18.877 ****** 2026-02-24 10:02:12.404861 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 10:02:12.629329 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 10:02:12.629348 | controller | 2026-02-24 10:02:12.629356 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 10:02:12.629362 | controller | Tuesday 24 February 2026 10:02:12 +0000 (0:00:00.044) 0:02:18.922 ****** 2026-02-24 10:02:12.629370 | controller | ok: [instance] 2026-02-24 10:02:12.629649 | controller | 2026-02-24 10:02:12.674408 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 10:02:12.674442 | controller | Tuesday 24 February 2026 10:02:12 +0000 (0:00:00.224) 0:02:19.147 ****** 2026-02-24 10:02:12.674456 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 10:02:12.898207 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 10:02:12.898235 | controller | 2026-02-24 10:02:12.898243 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 10:02:12.898249 | controller | Tuesday 24 February 2026 10:02:12 +0000 (0:00:00.044) 0:02:19.191 ****** 2026-02-24 10:02:12.898259 | controller | ok: [instance] 2026-02-24 10:02:13.089092 | controller | 2026-02-24 10:02:13.089115 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 10:02:13.089123 | controller | Tuesday 24 February 2026 10:02:12 +0000 (0:00:00.223) 0:02:19.415 ****** 2026-02-24 10:02:13.089132 | controller | ok: [instance] 2026-02-24 10:02:13.362841 | controller | 2026-02-24 10:02:13.362863 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2026-02-24 10:02:13.362871 | controller | Tuesday 24 February 2026 10:02:13 +0000 (0:00:00.190) 0:02:19.606 ****** 2026-02-24 10:02:13.362881 | controller | changed: [instance] 2026-02-24 10:02:13.585992 | controller | 2026-02-24 10:02:13.586015 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 10:02:13.586023 | controller | Tuesday 24 February 2026 10:02:13 +0000 (0:00:00.273) 0:02:19.880 ****** 2026-02-24 10:02:13.586033 | controller | ok: [instance] 2026-02-24 10:02:13.631452 | controller | 2026-02-24 10:02:13.631578 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 10:02:13.631588 | controller | Tuesday 24 February 2026 10:02:13 +0000 (0:00:00.223) 0:02:20.103 ****** 2026-02-24 10:02:13.631600 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 10:02:13.631632 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 10:02:13.631752 | controller | 2026-02-24 10:02:13.631774 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 10:02:13.631786 | controller | Tuesday 24 February 2026 10:02:13 +0000 (0:00:00.045) 0:02:20.148 ****** 2026-02-24 10:02:13.861722 | controller | ok: [instance] 2026-02-24 10:02:14.060846 | controller | 2026-02-24 10:02:14.060869 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 10:02:14.060876 | controller | Tuesday 24 February 2026 10:02:13 +0000 (0:00:00.230) 0:02:20.379 ****** 2026-02-24 10:02:14.060885 | controller | ok: [instance] 2026-02-24 10:02:14.336827 | controller | 2026-02-24 10:02:14.336858 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2026-02-24 10:02:14.336866 | controller | Tuesday 24 February 2026 10:02:14 +0000 (0:00:00.199) 0:02:20.578 ****** 2026-02-24 10:02:14.336877 | controller | changed: [instance] 2026-02-24 10:02:14.360411 | controller | 2026-02-24 10:02:14.360446 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2026-02-24 10:02:14.360455 | controller | Tuesday 24 February 2026 10:02:14 +0000 (0:00:00.275) 0:02:20.854 ****** 2026-02-24 10:02:14.360469 | controller | skipping: [instance] 2026-02-24 10:02:14.360476 | controller | 2026-02-24 10:02:14.360482 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2026-02-24 10:02:14.360490 | controller | Tuesday 24 February 2026 10:02:14 +0000 (0:00:00.023) 0:02:20.877 ****** 2026-02-24 10:02:14.388429 | controller | skipping: [instance] 2026-02-24 10:02:14.388642 | controller | 2026-02-24 10:02:14.388672 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2026-02-24 10:02:14.416387 | controller | Tuesday 24 February 2026 10:02:14 +0000 (0:00:00.028) 0:02:20.906 ****** 2026-02-24 10:02:14.416417 | controller | skipping: [instance] 2026-02-24 10:02:14.442467 | controller | 2026-02-24 10:02:14.442494 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2026-02-24 10:02:14.442503 | controller | Tuesday 24 February 2026 10:02:14 +0000 (0:00:00.027) 0:02:20.933 ****** 2026-02-24 10:02:14.442514 | controller | skipping: [instance] 2026-02-24 10:02:14.442763 | controller | 2026-02-24 10:02:14.442798 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 10:02:15.656079 | controller | Tuesday 24 February 2026 10:02:14 +0000 (0:00:00.025) 0:02:20.959 ****** 2026-02-24 10:02:15.656114 | controller | changed: [instance] 2026-02-24 10:02:15.692040 | controller | 2026-02-24 10:02:15.692091 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 10:02:15.692105 | controller | Tuesday 24 February 2026 10:02:15 +0000 (0:00:01.213) 0:02:22.173 ****** 2026-02-24 10:02:15.692121 | controller | ok: [instance] 2026-02-24 10:02:15.718776 | controller | 2026-02-24 10:02:15.718792 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 10:02:15.718799 | controller | Tuesday 24 February 2026 10:02:15 +0000 (0:00:00.035) 0:02:22.209 ****** 2026-02-24 10:02:15.718807 | controller | skipping: [instance] 2026-02-24 10:02:15.746148 | controller | 2026-02-24 10:02:15.746171 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 10:02:15.746179 | controller | Tuesday 24 February 2026 10:02:15 +0000 (0:00:00.026) 0:02:22.236 ****** 2026-02-24 10:02:15.746189 | controller | skipping: [instance] 2026-02-24 10:02:15.789442 | controller | 2026-02-24 10:02:15.789476 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 10:02:15.789490 | controller | Tuesday 24 February 2026 10:02:15 +0000 (0:00:00.027) 0:02:22.263 ****** 2026-02-24 10:02:15.789506 | controller | skipping: [instance] 2026-02-24 10:02:15.789549 | controller | 2026-02-24 10:02:15.789563 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2026-02-24 10:02:15.789716 | controller | Tuesday 24 February 2026 10:02:15 +0000 (0:00:00.043) 0:02:22.306 ****** 2026-02-24 10:02:15.815377 | controller | skipping: [instance] 2026-02-24 10:02:15.815430 | controller | 2026-02-24 10:02:15.815440 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2026-02-24 10:02:15.815452 | controller | Tuesday 24 February 2026 10:02:15 +0000 (0:00:00.026) 0:02:22.333 ****** 2026-02-24 10:02:15.876519 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2026-02-24 10:02:15.876742 | controller | 2026-02-24 10:02:15.876919 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2026-02-24 10:02:15.877023 | controller | Tuesday 24 February 2026 10:02:15 +0000 (0:00:00.061) 0:02:22.394 ****** 2026-02-24 10:02:16.110349 | controller | ok: [instance] => (item=crc) 2026-02-24 10:02:16.110485 | controller | 2026-02-24 10:02:16.110629 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2026-02-24 10:02:16.110781 | controller | Tuesday 24 February 2026 10:02:16 +0000 (0:00:00.233) 0:02:22.628 ****** 2026-02-24 10:02:18.178115 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 10:02:18.178314 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 10:02:18.178436 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 10:02:18.178535 | controller | 2026-02-24 10:02:18.178624 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 10:02:18.178739 | controller | Tuesday 24 February 2026 10:02:18 +0000 (0:00:02.067) 0:02:24.695 ****** 2026-02-24 10:02:19.004481 | controller | changed: [instance] 2026-02-24 10:02:19.004556 | controller | 2026-02-24 10:02:19.004655 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 10:02:19.004686 | controller | Tuesday 24 February 2026 10:02:19 +0000 (0:00:00.826) 0:02:25.522 ****** 2026-02-24 10:02:19.780833 | controller | changed: [instance] 2026-02-24 10:02:20.618084 | controller | 2026-02-24 10:02:20.618117 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 10:02:20.618125 | controller | Tuesday 24 February 2026 10:02:19 +0000 (0:00:00.775) 0:02:26.297 ****** 2026-02-24 10:02:20.618135 | controller | changed: [instance] 2026-02-24 10:02:21.380386 | controller | 2026-02-24 10:02:21.380418 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2026-02-24 10:02:21.380431 | controller | Tuesday 24 February 2026 10:02:20 +0000 (0:00:00.837) 0:02:27.135 ****** 2026-02-24 10:02:21.380442 | controller | changed: [instance] => (item=compute-0.utility) 2026-02-24 10:02:47.558400 | controller | changed: [instance] => (item=controller-0.utility) 2026-02-24 10:02:47.558438 | controller | changed: [instance] => (item=crc-0.utility) 2026-02-24 10:02:47.558447 | controller | 2026-02-24 10:02:47.558453 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2026-02-24 10:02:47.558458 | controller | Tuesday 24 February 2026 10:02:21 +0000 (0:00:00.762) 0:02:27.897 ****** 2026-02-24 10:02:47.558469 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-02-24 10:02:47.689130 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2026-02-24 10:02:47.689167 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2026-02-24 10:02:47.689175 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2026-02-24 10:02:47.689180 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2026-02-24 10:02:47.689186 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2026-02-24 10:02:47.689198 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). 2026-02-24 10:02:47.689203 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j522441787156.24462', 'results_file': '/home/zuul/.ansible_async/j522441787156.24462', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2026-02-24 10:02:47.689215 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-02-24 10:02:47.689220 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j205527494445.24479', 'results_file': '/home/zuul/.ansible_async/j205527494445.24479', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2026-02-24 10:02:47.689236 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j521053727777.24495', 'results_file': '/home/zuul/.ansible_async/j521053727777.24495', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2026-02-24 10:02:47.689241 | controller | 2026-02-24 10:02:47.689247 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2026-02-24 10:02:47.689253 | controller | Tuesday 24 February 2026 10:02:47 +0000 (0:00:26.176) 0:02:54.074 ****** 2026-02-24 10:02:47.689263 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 10:02:47.718029 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 10:02:47.718051 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 10:02:47.718059 | controller | 2026-02-24 10:02:47.718065 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 10:02:47.718070 | controller | Tuesday 24 February 2026 10:02:47 +0000 (0:00:00.131) 0:02:54.206 ****** 2026-02-24 10:02:47.718079 | controller | skipping: [instance] 2026-02-24 10:02:47.718114 | controller | 2026-02-24 10:02:47.718952 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2026-02-24 10:02:47.719061 | controller | Tuesday 24 February 2026 10:02:47 +0000 (0:00:00.029) 0:02:54.235 ****** 2026-02-24 10:02:47.761265 | controller | 2026-02-24 10:02:47.761387 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 10:02:47.761484 | controller | Tuesday 24 February 2026 10:02:47 +0000 (0:00:00.043) 0:02:54.279 ****** 2026-02-24 10:02:47.848707 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-24 10:02:47.848770 | controller | 2026-02-24 10:02:47.848921 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 10:02:47.849080 | controller | Tuesday 24 February 2026 10:02:47 +0000 (0:00:00.087) 0:02:54.366 ****** 2026-02-24 10:02:48.079347 | controller | changed: [instance] 2026-02-24 10:02:48.312012 | controller | 2026-02-24 10:02:48.312048 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 10:02:48.312056 | controller | Tuesday 24 February 2026 10:02:48 +0000 (0:00:00.230) 0:02:54.596 ****** 2026-02-24 10:02:48.312067 | controller | changed: [instance] 2026-02-24 10:02:48.733593 | controller | 2026-02-24 10:02:48.733628 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2026-02-24 10:02:48.733636 | controller | Tuesday 24 February 2026 10:02:48 +0000 (0:00:00.232) 0:02:54.829 ****** 2026-02-24 10:02:48.733653 | controller | changed: [instance] 2026-02-24 10:02:48.768839 | controller | 2026-02-24 10:02:48.768863 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2026-02-24 10:02:48.768872 | controller | Tuesday 24 February 2026 10:02:48 +0000 (0:00:00.421) 0:02:55.250 ****** 2026-02-24 10:02:48.768884 | controller | skipping: [instance] 2026-02-24 10:02:48.801779 | controller | 2026-02-24 10:02:48.801797 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 10:02:48.801805 | controller | Tuesday 24 February 2026 10:02:48 +0000 (0:00:00.035) 0:02:55.286 ****** 2026-02-24 10:02:48.801813 | controller | skipping: [instance] 2026-02-24 10:02:48.855761 | controller | 2026-02-24 10:02:48.855797 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2026-02-24 10:02:48.855810 | controller | Tuesday 24 February 2026 10:02:48 +0000 (0:00:00.033) 0:02:55.319 ****** 2026-02-24 10:02:48.855821 | controller | skipping: [instance] 2026-02-24 10:02:48.855845 | controller | 2026-02-24 10:02:48.855853 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2026-02-24 10:02:48.855942 | controller | Tuesday 24 February 2026 10:02:48 +0000 (0:00:00.053) 0:02:55.373 ****** 2026-02-24 10:02:48.907143 | controller | skipping: [instance] 2026-02-24 10:02:48.932426 | controller | 2026-02-24 10:02:48.932468 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 10:02:48.932476 | controller | Tuesday 24 February 2026 10:02:48 +0000 (0:00:00.051) 0:02:55.424 ****** 2026-02-24 10:02:48.932488 | controller | skipping: [instance] 2026-02-24 10:02:48.972152 | controller | 2026-02-24 10:02:48.972175 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2026-02-24 10:02:48.972183 | controller | Tuesday 24 February 2026 10:02:48 +0000 (0:00:00.025) 0:02:55.450 ****** 2026-02-24 10:02:48.972192 | controller | 2026-02-24 10:02:49.059916 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 10:02:49.059939 | controller | Tuesday 24 February 2026 10:02:48 +0000 (0:00:00.039) 0:02:55.489 ****** 2026-02-24 10:02:49.059958 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-24 10:02:49.299147 | controller | 2026-02-24 10:02:49.299169 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 10:02:49.299176 | controller | Tuesday 24 February 2026 10:02:49 +0000 (0:00:00.087) 0:02:55.577 ****** 2026-02-24 10:02:49.299185 | controller | ok: [instance] 2026-02-24 10:02:49.521581 | controller | 2026-02-24 10:02:49.521607 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 10:02:49.521615 | controller | Tuesday 24 February 2026 10:02:49 +0000 (0:00:00.234) 0:02:55.811 ****** 2026-02-24 10:02:49.521624 | controller | ok: [instance] 2026-02-24 10:02:49.941140 | controller | 2026-02-24 10:02:49.941172 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2026-02-24 10:02:49.941179 | controller | Tuesday 24 February 2026 10:02:49 +0000 (0:00:00.226) 0:02:56.038 ****** 2026-02-24 10:02:49.941189 | controller | changed: [instance] 2026-02-24 10:02:49.973820 | controller | 2026-02-24 10:02:49.973841 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2026-02-24 10:02:49.973849 | controller | Tuesday 24 February 2026 10:02:49 +0000 (0:00:00.419) 0:02:56.458 ****** 2026-02-24 10:02:49.973858 | controller | skipping: [instance] 2026-02-24 10:02:50.004243 | controller | 2026-02-24 10:02:50.004261 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 10:02:50.004268 | controller | Tuesday 24 February 2026 10:02:49 +0000 (0:00:00.032) 0:02:56.491 ****** 2026-02-24 10:02:50.004276 | controller | skipping: [instance] 2026-02-24 10:02:51.697272 | controller | 2026-02-24 10:02:51.697320 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2026-02-24 10:02:51.697330 | controller | Tuesday 24 February 2026 10:02:50 +0000 (0:00:00.030) 0:02:56.521 ****** 2026-02-24 10:02:51.697340 | controller | changed: [instance -> controller-0.instance] 2026-02-24 10:02:52.948029 | controller | 2026-02-24 10:02:52.948065 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2026-02-24 10:02:52.948074 | controller | Tuesday 24 February 2026 10:02:51 +0000 (0:00:01.692) 0:02:58.214 ****** 2026-02-24 10:02:52.948084 | controller | changed: [instance -> controller-0.instance] 2026-02-24 10:02:52.990018 | controller | 2026-02-24 10:02:52.990057 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 10:02:52.990066 | controller | Tuesday 24 February 2026 10:02:52 +0000 (0:00:01.250) 0:02:59.465 ****** 2026-02-24 10:02:52.990084 | controller | 2026-02-24 10:02:53.194193 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-24 10:02:53.194222 | controller | Tuesday 24 February 2026 10:02:52 +0000 (0:00:00.042) 0:02:59.507 ****** 2026-02-24 10:02:53.194233 | controller | ok: [instance] 2026-02-24 10:02:53.219306 | controller | 2026-02-24 10:02:53.219334 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-24 10:02:53.219342 | controller | Tuesday 24 February 2026 10:02:53 +0000 (0:00:00.204) 0:02:59.711 ****** 2026-02-24 10:02:53.219352 | controller | ok: [instance] 2026-02-24 10:02:53.250305 | controller | 2026-02-24 10:02:53.250329 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-24 10:02:53.250337 | controller | Tuesday 24 February 2026 10:02:53 +0000 (0:00:00.025) 0:02:59.736 ****** 2026-02-24 10:02:53.250347 | controller | skipping: [instance] 2026-02-24 10:02:53.299018 | controller | 2026-02-24 10:02:53.299043 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2026-02-24 10:02:53.299051 | controller | Tuesday 24 February 2026 10:02:53 +0000 (0:00:00.031) 0:02:59.767 ****** 2026-02-24 10:02:53.299060 | controller | 2026-02-24 10:02:53.391529 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 10:02:53.391562 | controller | Tuesday 24 February 2026 10:02:53 +0000 (0:00:00.048) 0:02:59.816 ****** 2026-02-24 10:02:53.391582 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2026-02-24 10:02:53.391601 | controller | 2026-02-24 10:02:53.391609 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 10:02:53.391694 | controller | Tuesday 24 February 2026 10:02:53 +0000 (0:00:00.092) 0:02:59.908 ****** 2026-02-24 10:02:53.604070 | controller | ok: [instance] 2026-02-24 10:02:53.817366 | controller | 2026-02-24 10:02:53.817397 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 10:02:53.817406 | controller | Tuesday 24 February 2026 10:02:53 +0000 (0:00:00.212) 0:03:00.121 ****** 2026-02-24 10:02:53.817417 | controller | ok: [instance] 2026-02-24 10:02:53.817594 | controller | 2026-02-24 10:02:53.817645 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2026-02-24 10:02:54.252059 | controller | Tuesday 24 February 2026 10:02:53 +0000 (0:00:00.213) 0:03:00.334 ****** 2026-02-24 10:02:54.252101 | controller | changed: [instance] 2026-02-24 10:02:55.267158 | controller | 2026-02-24 10:02:55.267187 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2026-02-24 10:02:55.267196 | controller | Tuesday 24 February 2026 10:02:54 +0000 (0:00:00.434) 0:03:00.769 ****** 2026-02-24 10:02:55.267206 | controller | changed: [instance] 2026-02-24 10:02:55.296165 | controller | 2026-02-24 10:02:55.296189 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 10:02:55.296197 | controller | Tuesday 24 February 2026 10:02:55 +0000 (0:00:01.014) 0:03:01.783 ****** 2026-02-24 10:02:55.296207 | controller | skipping: [instance] 2026-02-24 10:02:55.350762 | controller | 2026-02-24 10:02:55.350781 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2026-02-24 10:02:55.350788 | controller | Tuesday 24 February 2026 10:02:55 +0000 (0:00:00.029) 0:03:01.813 ****** 2026-02-24 10:02:55.350797 | controller | skipping: [instance] 2026-02-24 10:02:55.406673 | controller | 2026-02-24 10:02:55.406692 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2026-02-24 10:02:55.406699 | controller | Tuesday 24 February 2026 10:02:55 +0000 (0:00:00.049) 0:03:01.862 ****** 2026-02-24 10:02:55.406707 | controller | skipping: [instance] 2026-02-24 10:02:55.464883 | controller | 2026-02-24 10:02:55.464901 | controller | TASK [Create VBMC entity] ****************************************************** 2026-02-24 10:02:55.464915 | controller | Tuesday 24 February 2026 10:02:55 +0000 (0:00:00.061) 0:03:01.924 ****** 2026-02-24 10:02:55.464924 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 10:02:55.740818 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 10:02:55.740851 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 10:02:55.740860 | controller | skipping: [instance] 2026-02-24 10:02:55.740868 | controller | 2026-02-24 10:02:55.740875 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2026-02-24 10:02:55.740883 | controller | Tuesday 24 February 2026 10:02:55 +0000 (0:00:00.057) 0:03:01.981 ****** 2026-02-24 10:02:55.740894 | controller | ok: [instance] 2026-02-24 10:02:56.135361 | controller | 2026-02-24 10:02:56.135388 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2026-02-24 10:02:56.135396 | controller | Tuesday 24 February 2026 10:02:55 +0000 (0:00:00.276) 0:03:02.257 ****** 2026-02-24 10:02:56.135406 | controller | changed: [instance] 2026-02-24 10:02:56.135549 | controller | 2026-02-24 10:02:56.135559 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2026-02-24 10:02:56.135567 | controller | Tuesday 24 February 2026 10:02:56 +0000 (0:00:00.394) 0:03:02.652 ****** 2026-02-24 10:02:56.169743 | controller | skipping: [instance] 2026-02-24 10:02:56.203270 | controller | 2026-02-24 10:02:56.203301 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2026-02-24 10:02:56.203308 | controller | Tuesday 24 February 2026 10:02:56 +0000 (0:00:00.034) 0:03:02.687 ****** 2026-02-24 10:02:56.203317 | controller | skipping: [instance] 2026-02-24 10:02:56.237929 | controller | 2026-02-24 10:02:56.237948 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2026-02-24 10:02:56.237956 | controller | Tuesday 24 February 2026 10:02:56 +0000 (0:00:00.033) 0:03:02.720 ****** 2026-02-24 10:02:56.237965 | controller | skipping: [instance] 2026-02-24 10:02:56.930033 | controller | 2026-02-24 10:02:56.930070 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2026-02-24 10:02:56.930079 | controller | Tuesday 24 February 2026 10:02:56 +0000 (0:00:00.034) 0:03:02.755 ****** 2026-02-24 10:02:56.930090 | controller | changed: [instance] 2026-02-24 10:02:56.930127 | controller | 2026-02-24 10:02:56.930146 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2026-02-24 10:02:56.930259 | controller | Tuesday 24 February 2026 10:02:56 +0000 (0:00:00.691) 0:03:03.447 ****** 2026-02-24 10:02:57.574991 | controller | changed: [instance] 2026-02-24 10:02:57.627955 | controller | 2026-02-24 10:02:57.627977 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2026-02-24 10:02:57.627985 | controller | Tuesday 24 February 2026 10:02:57 +0000 (0:00:00.644) 0:03:04.092 ****** 2026-02-24 10:02:57.627994 | controller | skipping: [instance] 2026-02-24 10:02:57.698428 | controller | 2026-02-24 10:02:57.698465 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2026-02-24 10:02:57.698475 | controller | Tuesday 24 February 2026 10:02:57 +0000 (0:00:00.053) 0:03:04.145 ****** 2026-02-24 10:02:57.698488 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2026-02-24 10:02:57.812424 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2026-02-24 10:02:57.812465 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2026-02-24 10:02:57.812474 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2026-02-24 10:02:57.812481 | controller | 2026-02-24 10:02:57.812486 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2026-02-24 10:02:57.812492 | controller | Tuesday 24 February 2026 10:02:57 +0000 (0:00:00.070) 0:03:04.215 ****** 2026-02-24 10:02:57.812510 | controller | skipping: [instance] 2026-02-24 10:02:57.852533 | controller | 2026-02-24 10:02:57.852610 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2026-02-24 10:02:57.852637 | controller | Tuesday 24 February 2026 10:02:57 +0000 (0:00:00.114) 0:03:04.329 ****** 2026-02-24 10:02:57.852655 | controller | skipping: [instance] 2026-02-24 10:02:57.909684 | controller | 2026-02-24 10:02:57.909717 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2026-02-24 10:02:57.909726 | controller | Tuesday 24 February 2026 10:02:57 +0000 (0:00:00.040) 0:03:04.370 ****** 2026-02-24 10:02:57.909737 | controller | skipping: [instance] 2026-02-24 10:02:57.949071 | controller | 2026-02-24 10:02:57.949094 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2026-02-24 10:02:57.949103 | controller | Tuesday 24 February 2026 10:02:57 +0000 (0:00:00.056) 0:03:04.426 ****** 2026-02-24 10:02:57.949128 | controller | skipping: [instance] 2026-02-24 10:02:58.581932 | controller | 2026-02-24 10:02:58.581966 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2026-02-24 10:02:58.581974 | controller | Tuesday 24 February 2026 10:02:57 +0000 (0:00:00.039) 0:03:04.466 ****** 2026-02-24 10:02:58.581984 | controller | changed: [instance] 2026-02-24 10:02:58.615468 | controller | 2026-02-24 10:02:58.615610 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2026-02-24 10:02:58.615624 | controller | Tuesday 24 February 2026 10:02:58 +0000 (0:00:00.632) 0:03:05.099 ****** 2026-02-24 10:02:58.615654 | controller | skipping: [instance] 2026-02-24 10:02:58.648751 | controller | 2026-02-24 10:02:58.648818 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2026-02-24 10:02:58.648832 | controller | Tuesday 24 February 2026 10:02:58 +0000 (0:00:00.033) 0:03:05.132 ****** 2026-02-24 10:02:58.648850 | controller | skipping: [instance] 2026-02-24 10:02:58.683365 | controller | 2026-02-24 10:02:58.683392 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2026-02-24 10:02:58.683402 | controller | Tuesday 24 February 2026 10:02:58 +0000 (0:00:00.033) 0:03:05.166 ****** 2026-02-24 10:02:58.683414 | controller | skipping: [instance] 2026-02-24 10:02:58.683437 | controller | 2026-02-24 10:02:58.683444 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-24 10:02:58.683455 | controller | Tuesday 24 February 2026 10:02:58 +0000 (0:00:00.034) 0:03:05.200 ****** 2026-02-24 10:02:58.720964 | controller | skipping: [instance] 2026-02-24 10:02:58.766714 | controller | 2026-02-24 10:02:58.766736 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-24 10:02:58.766746 | controller | Tuesday 24 February 2026 10:02:58 +0000 (0:00:00.037) 0:03:05.238 ****** 2026-02-24 10:02:58.766757 | controller | skipping: [instance] 2026-02-24 10:02:58.805434 | controller | 2026-02-24 10:02:58.805457 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-24 10:02:58.805465 | controller | Tuesday 24 February 2026 10:02:58 +0000 (0:00:00.045) 0:03:05.283 ****** 2026-02-24 10:02:58.805475 | controller | skipping: [instance] 2026-02-24 10:02:58.839504 | controller | 2026-02-24 10:02:58.839549 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-24 10:02:58.839563 | controller | Tuesday 24 February 2026 10:02:58 +0000 (0:00:00.039) 0:03:05.322 ****** 2026-02-24 10:02:58.839580 | controller | skipping: [instance] 2026-02-24 10:02:58.839631 | controller | 2026-02-24 10:02:58.839647 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-24 10:02:58.839739 | controller | Tuesday 24 February 2026 10:02:58 +0000 (0:00:00.034) 0:03:05.357 ****** 2026-02-24 10:02:58.883525 | controller | skipping: [instance] 2026-02-24 10:02:58.920427 | controller | 2026-02-24 10:02:58.920462 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-24 10:02:58.920476 | controller | Tuesday 24 February 2026 10:02:58 +0000 (0:00:00.043) 0:03:05.400 ****** 2026-02-24 10:02:58.920492 | controller | skipping: [instance] 2026-02-24 10:02:58.920539 | controller | 2026-02-24 10:02:58.920550 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-24 10:02:58.920563 | controller | Tuesday 24 February 2026 10:02:58 +0000 (0:00:00.036) 0:03:05.437 ****** 2026-02-24 10:02:58.969131 | controller | skipping: [instance] 2026-02-24 10:02:59.002008 | controller | 2026-02-24 10:02:59.002030 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2026-02-24 10:02:59.002039 | controller | Tuesday 24 February 2026 10:02:58 +0000 (0:00:00.048) 0:03:05.486 ****** 2026-02-24 10:02:59.002048 | controller | skipping: [instance] 2026-02-24 10:02:59.171062 | controller | 2026-02-24 10:02:59.171083 | controller | TASK [reproducer : Configure Controller node] ********************************** 2026-02-24 10:02:59.171097 | controller | Tuesday 24 February 2026 10:02:58 +0000 (0:00:00.032) 0:03:05.519 ****** 2026-02-24 10:02:59.171107 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2026-02-24 10:02:59.171323 | controller | 2026-02-24 10:02:59.171476 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-24 10:02:59.171645 | controller | Tuesday 24 February 2026 10:02:59 +0000 (0:00:00.169) 0:03:05.688 ****** 2026-02-24 10:03:00.570268 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-24 10:03:00.597935 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-24 10:03:00.597960 | controller | 2026-02-24 10:03:00.597968 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-24 10:03:00.597973 | controller | Tuesday 24 February 2026 10:03:00 +0000 (0:00:01.398) 0:03:07.087 ****** 2026-02-24 10:03:00.597982 | controller | skipping: [instance] 2026-02-24 10:03:01.227854 | controller | 2026-02-24 10:03:01.227884 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-24 10:03:01.227891 | controller | Tuesday 24 February 2026 10:03:00 +0000 (0:00:00.028) 0:03:07.115 ****** 2026-02-24 10:03:01.227900 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:01.263398 | controller | 2026-02-24 10:03:01.263433 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-24 10:03:01.263442 | controller | Tuesday 24 February 2026 10:03:01 +0000 (0:00:00.629) 0:03:07.745 ****** 2026-02-24 10:03:01.263452 | controller | skipping: [instance] 2026-02-24 10:03:01.298537 | controller | 2026-02-24 10:03:01.298557 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-24 10:03:01.298564 | controller | Tuesday 24 February 2026 10:03:01 +0000 (0:00:00.035) 0:03:07.780 ****** 2026-02-24 10:03:01.298572 | controller | skipping: [instance] 2026-02-24 10:03:01.298607 | controller | 2026-02-24 10:03:01.298708 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-24 10:03:01.298798 | controller | Tuesday 24 February 2026 10:03:01 +0000 (0:00:00.035) 0:03:07.816 ****** 2026-02-24 10:03:01.332213 | controller | skipping: [instance] 2026-02-24 10:03:01.332303 | controller | 2026-02-24 10:03:01.332422 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-24 10:03:01.332519 | controller | Tuesday 24 February 2026 10:03:01 +0000 (0:00:00.033) 0:03:07.850 ****** 2026-02-24 10:03:01.371663 | controller | skipping: [instance] 2026-02-24 10:03:01.371747 | controller | 2026-02-24 10:03:01.371840 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2026-02-24 10:03:01.371941 | controller | Tuesday 24 February 2026 10:03:01 +0000 (0:00:00.039) 0:03:07.889 ****** 2026-02-24 10:03:01.409736 | controller | skipping: [instance] 2026-02-24 10:03:01.451461 | controller | 2026-02-24 10:03:01.451491 | controller | TASK [reproducer : Install repos] ********************************************** 2026-02-24 10:03:01.451499 | controller | Tuesday 24 February 2026 10:03:01 +0000 (0:00:00.037) 0:03:07.927 ****** 2026-02-24 10:03:01.451509 | controller | skipping: [instance] 2026-02-24 10:03:01.489461 | controller | 2026-02-24 10:03:01.489502 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2026-02-24 10:03:01.489513 | controller | Tuesday 24 February 2026 10:03:01 +0000 (0:00:00.041) 0:03:07.968 ****** 2026-02-24 10:03:01.489526 | controller | skipping: [instance] 2026-02-24 10:03:01.526938 | controller | 2026-02-24 10:03:01.526958 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2026-02-24 10:03:01.526966 | controller | Tuesday 24 February 2026 10:03:01 +0000 (0:00:00.037) 0:03:08.006 ****** 2026-02-24 10:03:01.526979 | controller | skipping: [instance] 2026-02-24 10:03:02.716716 | controller | 2026-02-24 10:03:02.716750 | controller | TASK [reproducer : Install some tools] ***************************************** 2026-02-24 10:03:02.716758 | controller | Tuesday 24 February 2026 10:03:01 +0000 (0:00:00.037) 0:03:08.044 ****** 2026-02-24 10:03:02.716768 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:03.901916 | controller | 2026-02-24 10:03:03.901946 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2026-02-24 10:03:03.901953 | controller | Tuesday 24 February 2026 10:03:02 +0000 (0:00:01.189) 0:03:09.233 ****** 2026-02-24 10:03:03.901962 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:04.580142 | controller | 2026-02-24 10:03:04.580173 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2026-02-24 10:03:04.580181 | controller | Tuesday 24 February 2026 10:03:03 +0000 (0:00:01.185) 0:03:10.419 ****** 2026-02-24 10:03:04.580191 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:05.594315 | controller | 2026-02-24 10:03:05.594349 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2026-02-24 10:03:05.594362 | controller | Tuesday 24 February 2026 10:03:04 +0000 (0:00:00.678) 0:03:11.097 ****** 2026-02-24 10:03:05.594372 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:06.868937 | controller | 2026-02-24 10:03:06.868970 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2026-02-24 10:03:06.868978 | controller | Tuesday 24 February 2026 10:03:05 +0000 (0:00:01.013) 0:03:12.111 ****** 2026-02-24 10:03:06.868989 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-24 10:03:07.568458 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 10:03:07.568493 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 10:03:07.568501 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 10:03:07.568514 | controller | 2026-02-24 10:03:07.568520 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2026-02-24 10:03:07.568526 | controller | Tuesday 24 February 2026 10:03:06 +0000 (0:00:01.274) 0:03:13.385 ****** 2026-02-24 10:03:07.568536 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-24 10:03:09.492439 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 10:03:09.492470 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 10:03:09.492477 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 10:03:09.492482 | controller | 2026-02-24 10:03:09.492488 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2026-02-24 10:03:09.492493 | controller | Tuesday 24 February 2026 10:03:07 +0000 (0:00:00.699) 0:03:14.085 ****** 2026-02-24 10:03:09.492502 | controller | skipping: [instance] => (item=instance) 2026-02-24 10:03:10.086775 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2026-02-24 10:03:10.086806 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-24 10:03:10.086813 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2026-02-24 10:03:10.086818 | controller | 2026-02-24 10:03:10.086823 | controller | TASK [reproducer : Create kube directory] ************************************** 2026-02-24 10:03:10.086828 | controller | Tuesday 24 February 2026 10:03:09 +0000 (0:00:01.921) 0:03:16.006 ****** 2026-02-24 10:03:10.086837 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:11.129984 | controller | 2026-02-24 10:03:11.130015 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2026-02-24 10:03:11.130023 | controller | Tuesday 24 February 2026 10:03:10 +0000 (0:00:00.597) 0:03:16.604 ****** 2026-02-24 10:03:11.130033 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:12.178717 | controller | 2026-02-24 10:03:12.178749 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2026-02-24 10:03:12.178756 | controller | Tuesday 24 February 2026 10:03:11 +0000 (0:00:01.042) 0:03:17.647 ****** 2026-02-24 10:03:12.178771 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:12.219237 | controller | 2026-02-24 10:03:12.219264 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2026-02-24 10:03:12.219272 | controller | Tuesday 24 February 2026 10:03:12 +0000 (0:00:01.048) 0:03:18.695 ****** 2026-02-24 10:03:12.219297 | controller | skipping: [instance] 2026-02-24 10:03:12.819987 | controller | 2026-02-24 10:03:12.820017 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2026-02-24 10:03:12.820025 | controller | Tuesday 24 February 2026 10:03:12 +0000 (0:00:00.041) 0:03:18.736 ****** 2026-02-24 10:03:12.820035 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:13.447496 | controller | 2026-02-24 10:03:13.447528 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2026-02-24 10:03:13.447536 | controller | Tuesday 24 February 2026 10:03:12 +0000 (0:00:00.600) 0:03:19.337 ****** 2026-02-24 10:03:13.447546 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:13.491202 | controller | 2026-02-24 10:03:13.491228 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2026-02-24 10:03:13.491236 | controller | Tuesday 24 February 2026 10:03:13 +0000 (0:00:00.627) 0:03:19.964 ****** 2026-02-24 10:03:13.491244 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:13.575933 | controller | 2026-02-24 10:03:13.575965 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2026-02-24 10:03:13.575974 | controller | Tuesday 24 February 2026 10:03:13 +0000 (0:00:00.044) 0:03:20.008 ****** 2026-02-24 10:03:13.575987 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2026-02-24 10:03:13.642816 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2026-02-24 10:03:13.642841 | controller | 2026-02-24 10:03:13.642849 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-24 10:03:13.642855 | controller | Tuesday 24 February 2026 10:03:13 +0000 (0:00:00.084) 0:03:20.092 ****** 2026-02-24 10:03:13.642864 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 10:03:13.699522 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2026-02-24 10:03:13.699547 | controller | 2026-02-24 10:03:13.699555 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-24 10:03:13.699560 | controller | Tuesday 24 February 2026 10:03:13 +0000 (0:00:00.067) 0:03:20.160 ****** 2026-02-24 10:03:13.699569 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 10:03:13.758789 | controller | _secret_file: '' 2026-02-24 10:03:13.758823 | controller | 2026-02-24 10:03:13.758831 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-24 10:03:13.758837 | controller | Tuesday 24 February 2026 10:03:13 +0000 (0:00:00.056) 0:03:20.216 ****** 2026-02-24 10:03:13.758847 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 10:03:13.826327 | controller | _secret_content: my-default-location-place 2026-02-24 10:03:13.826352 | controller | 2026-02-24 10:03:13.826363 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-24 10:03:13.826376 | controller | Tuesday 24 February 2026 10:03:13 +0000 (0:00:00.058) 0:03:20.275 ****** 2026-02-24 10:03:13.826388 | controller | skipping: [instance] 2026-02-24 10:03:13.882385 | controller | 2026-02-24 10:03:13.882405 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-24 10:03:13.882412 | controller | Tuesday 24 February 2026 10:03:13 +0000 (0:00:00.068) 0:03:20.343 ****** 2026-02-24 10:03:13.882420 | controller | skipping: [instance] 2026-02-24 10:03:13.938262 | controller | 2026-02-24 10:03:13.938301 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-24 10:03:13.938320 | controller | Tuesday 24 February 2026 10:03:13 +0000 (0:00:00.056) 0:03:20.399 ****** 2026-02-24 10:03:13.938330 | controller | skipping: [instance] 2026-02-24 10:03:15.247325 | controller | 2026-02-24 10:03:15.247384 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-24 10:03:15.247393 | controller | Tuesday 24 February 2026 10:03:13 +0000 (0:00:00.055) 0:03:20.455 ****** 2026-02-24 10:03:15.247406 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:15.321709 | controller | 2026-02-24 10:03:15.321754 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-24 10:03:15.321762 | controller | Tuesday 24 February 2026 10:03:15 +0000 (0:00:01.302) 0:03:21.758 ****** 2026-02-24 10:03:15.321776 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 10:03:15.389163 | controller | _secret_dest: /home/zuul/ipmi-things 2026-02-24 10:03:15.389189 | controller | 2026-02-24 10:03:15.389196 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-24 10:03:15.389202 | controller | Tuesday 24 February 2026 10:03:15 +0000 (0:00:00.080) 0:03:21.838 ****** 2026-02-24 10:03:15.389210 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 10:03:15.442651 | controller | _secret_file: /tmp/ipmi-things 2026-02-24 10:03:15.442671 | controller | 2026-02-24 10:03:15.442679 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-24 10:03:15.442685 | controller | Tuesday 24 February 2026 10:03:15 +0000 (0:00:00.067) 0:03:21.906 ****** 2026-02-24 10:03:15.442694 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 10:03:15.509573 | controller | _secret_content: '' 2026-02-24 10:03:15.509600 | controller | 2026-02-24 10:03:15.509607 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-24 10:03:15.509614 | controller | Tuesday 24 February 2026 10:03:15 +0000 (0:00:00.053) 0:03:21.959 ****** 2026-02-24 10:03:15.509623 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2026-02-24 10:03:16.129525 | controller | msg: All assertions passed 2026-02-24 10:03:16.129584 | controller | 2026-02-24 10:03:16.129593 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-24 10:03:16.129600 | controller | Tuesday 24 February 2026 10:03:15 +0000 (0:00:00.066) 0:03:22.026 ****** 2026-02-24 10:03:16.129614 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:17.290525 | controller | 2026-02-24 10:03:17.290593 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-24 10:03:17.290603 | controller | Tuesday 24 February 2026 10:03:16 +0000 (0:00:00.619) 0:03:22.646 ****** 2026-02-24 10:03:17.290618 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:17.344116 | controller | 2026-02-24 10:03:17.344161 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-24 10:03:17.344172 | controller | Tuesday 24 February 2026 10:03:17 +0000 (0:00:01.161) 0:03:23.807 ****** 2026-02-24 10:03:17.344185 | controller | skipping: [instance] 2026-02-24 10:03:18.163786 | controller | 2026-02-24 10:03:18.163849 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2026-02-24 10:03:18.163858 | controller | Tuesday 24 February 2026 10:03:17 +0000 (0:00:00.054) 0:03:23.861 ****** 2026-02-24 10:03:18.163871 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:18.854580 | controller | 2026-02-24 10:03:18.854617 | controller | TASK [reproducer : Check if async file is still available] ********************* 2026-02-24 10:03:18.854625 | controller | Tuesday 24 February 2026 10:03:18 +0000 (0:00:00.816) 0:03:24.677 ****** 2026-02-24 10:03:18.854635 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:18.854922 | controller | 2026-02-24 10:03:58.511259 | controller | TASK [reproducer : Check package install status] ******************************* 2026-02-24 10:03:58.511336 | controller | Tuesday 24 February 2026 10:03:18 +0000 (0:00:00.693) 0:03:25.371 ****** 2026-02-24 10:03:58.511351 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2026-02-24 10:03:58.511679 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2026-02-24 10:03:58.511855 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2026-02-24 10:03:58.512001 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2026-02-24 10:03:58.512137 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2026-02-24 10:03:58.512312 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2026-02-24 10:03:58.513494 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2026-02-24 10:03:58.513954 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:58.514131 | controller | 2026-02-24 10:03:58.514931 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2026-02-24 10:03:58.515110 | controller | Tuesday 24 February 2026 10:03:58 +0000 (0:00:39.649) 0:04:05.020 ****** 2026-02-24 10:03:59.284420 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:03:59.284497 | controller | 2026-02-24 10:03:59.284507 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2026-02-24 10:03:59.284516 | controller | Tuesday 24 February 2026 10:03:59 +0000 (0:00:00.780) 0:04:05.801 ****** 2026-02-24 10:04:02.692473 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:02.747660 | controller | 2026-02-24 10:04:02.747708 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2026-02-24 10:04:02.747718 | controller | Tuesday 24 February 2026 10:04:02 +0000 (0:00:03.406) 0:04:09.208 ****** 2026-02-24 10:04:02.747732 | controller | skipping: [instance] 2026-02-24 10:04:02.809115 | controller | 2026-02-24 10:04:02.809152 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2026-02-24 10:04:02.809173 | controller | Tuesday 24 February 2026 10:04:02 +0000 (0:00:00.056) 0:04:09.264 ****** 2026-02-24 10:04:02.809188 | controller | skipping: [instance] 2026-02-24 10:04:03.528419 | controller | 2026-02-24 10:04:03.528475 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2026-02-24 10:04:03.528483 | controller | Tuesday 24 February 2026 10:04:02 +0000 (0:00:00.061) 0:04:09.326 ****** 2026-02-24 10:04:03.528496 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:04.141204 | controller | 2026-02-24 10:04:04.141264 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2026-02-24 10:04:04.141273 | controller | Tuesday 24 February 2026 10:04:03 +0000 (0:00:00.718) 0:04:10.045 ****** 2026-02-24 10:04:04.141302 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:04.472821 | controller | 2026-02-24 10:04:04.472868 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2026-02-24 10:04:04.472876 | controller | Tuesday 24 February 2026 10:04:04 +0000 (0:00:00.612) 0:04:10.657 ****** 2026-02-24 10:04:04.472889 | controller | changed: [instance] 2026-02-24 10:04:05.215872 | controller | 2026-02-24 10:04:05.215912 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2026-02-24 10:04:05.215921 | controller | Tuesday 24 February 2026 10:04:04 +0000 (0:00:00.331) 0:04:10.989 ****** 2026-02-24 10:04:05.215932 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:06.370396 | controller | 2026-02-24 10:04:06.370442 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2026-02-24 10:04:06.370451 | controller | Tuesday 24 February 2026 10:04:05 +0000 (0:00:00.737) 0:04:11.727 ****** 2026-02-24 10:04:06.370463 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:06.370626 | controller | 2026-02-24 10:04:06.370771 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 10:04:06.370906 | controller | Tuesday 24 February 2026 10:04:06 +0000 (0:00:01.155) 0:04:12.883 ****** 2026-02-24 10:04:06.417296 | controller | skipping: [instance] 2026-02-24 10:04:06.465898 | controller | 2026-02-24 10:04:06.465919 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 10:04:06.465927 | controller | Tuesday 24 February 2026 10:04:06 +0000 (0:00:00.051) 0:04:12.934 ****** 2026-02-24 10:04:06.465936 | controller | skipping: [instance] 2026-02-24 10:04:06.510529 | controller | 2026-02-24 10:04:06.510551 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 10:04:06.510559 | controller | Tuesday 24 February 2026 10:04:06 +0000 (0:00:00.048) 0:04:12.982 ****** 2026-02-24 10:04:06.510569 | controller | skipping: [instance] 2026-02-24 10:04:06.565550 | controller | 2026-02-24 10:04:06.565571 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2026-02-24 10:04:06.565579 | controller | Tuesday 24 February 2026 10:04:06 +0000 (0:00:00.045) 0:04:13.027 ****** 2026-02-24 10:04:06.565587 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:06.612816 | controller | 2026-02-24 10:04:06.612838 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2026-02-24 10:04:06.612846 | controller | Tuesday 24 February 2026 10:04:06 +0000 (0:00:00.055) 0:04:13.083 ****** 2026-02-24 10:04:06.612855 | controller | skipping: [instance] 2026-02-24 10:04:06.655109 | controller | 2026-02-24 10:04:06.655130 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2026-02-24 10:04:06.655138 | controller | Tuesday 24 February 2026 10:04:06 +0000 (0:00:00.047) 0:04:13.130 ****** 2026-02-24 10:04:06.655148 | controller | skipping: [instance] 2026-02-24 10:04:06.698689 | controller | 2026-02-24 10:04:06.698713 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2026-02-24 10:04:06.698721 | controller | Tuesday 24 February 2026 10:04:06 +0000 (0:00:00.042) 0:04:13.172 ****** 2026-02-24 10:04:06.698736 | controller | skipping: [instance] 2026-02-24 10:04:07.385835 | controller | 2026-02-24 10:04:07.385886 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2026-02-24 10:04:07.385896 | controller | Tuesday 24 February 2026 10:04:06 +0000 (0:00:00.043) 0:04:13.215 ****** 2026-02-24 10:04:07.385908 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:07.487778 | controller | 2026-02-24 10:04:07.487838 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2026-02-24 10:04:07.487847 | controller | Tuesday 24 February 2026 10:04:07 +0000 (0:00:00.682) 0:04:13.899 ****** 2026-02-24 10:04:07.487861 | controller | skipping: [instance] => (item=secret) 2026-02-24 10:04:07.487882 | controller | skipping: [instance] => (item=configmap) 2026-02-24 10:04:07.487890 | controller | skipping: [instance] => (item=pod) 2026-02-24 10:04:07.487972 | controller | skipping: [instance] => (item=service) 2026-02-24 10:04:07.487985 | controller | skipping: [instance] => (item=route) 2026-02-24 10:04:07.488072 | controller | skipping: [instance] 2026-02-24 10:04:07.488169 | controller | 2026-02-24 10:04:07.488297 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2026-02-24 10:04:07.488460 | controller | Tuesday 24 February 2026 10:04:07 +0000 (0:00:00.105) 0:04:14.004 ****** 2026-02-24 10:04:08.638710 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:08.639301 | controller | 2026-02-24 10:04:08.639322 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2026-02-24 10:04:09.677438 | controller | Tuesday 24 February 2026 10:04:08 +0000 (0:00:01.147) 0:04:15.151 ****** 2026-02-24 10:04:09.677503 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:09.734319 | controller | 2026-02-24 10:04:09.734347 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2026-02-24 10:04:09.734355 | controller | Tuesday 24 February 2026 10:04:09 +0000 (0:00:01.042) 0:04:16.194 ****** 2026-02-24 10:04:09.734365 | controller | skipping: [instance] 2026-02-24 10:04:09.734506 | controller | 2026-02-24 10:04:09.734654 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2026-02-24 10:04:09.734784 | controller | Tuesday 24 February 2026 10:04:09 +0000 (0:00:00.057) 0:04:16.251 ****** 2026-02-24 10:04:09.777443 | controller | skipping: [instance] 2026-02-24 10:04:09.777652 | controller | 2026-02-24 10:04:09.777848 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2026-02-24 10:04:09.778032 | controller | Tuesday 24 February 2026 10:04:09 +0000 (0:00:00.043) 0:04:16.295 ****** 2026-02-24 10:04:09.943762 | controller | skipping: [instance] => (item=secret) 2026-02-24 10:04:09.990752 | controller | skipping: [instance] => (item=configmap) 2026-02-24 10:04:09.990774 | controller | skipping: [instance] => (item=service) 2026-02-24 10:04:09.990782 | controller | skipping: [instance] => (item=route) 2026-02-24 10:04:09.990789 | controller | skipping: [instance] 2026-02-24 10:04:09.990797 | controller | 2026-02-24 10:04:09.990803 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2026-02-24 10:04:09.990810 | controller | Tuesday 24 February 2026 10:04:09 +0000 (0:00:00.165) 0:04:16.460 ****** 2026-02-24 10:04:09.990820 | controller | skipping: [instance] 2026-02-24 10:04:11.755843 | controller | 2026-02-24 10:04:11.755883 | controller | TASK [podman : Ensure podman is installed] ************************************* 2026-02-24 10:04:11.755891 | controller | Tuesday 24 February 2026 10:04:09 +0000 (0:00:00.047) 0:04:16.507 ****** 2026-02-24 10:04:11.755903 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:12.640297 | controller | 2026-02-24 10:04:12.640352 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2026-02-24 10:04:12.640361 | controller | Tuesday 24 February 2026 10:04:11 +0000 (0:00:01.764) 0:04:18.272 ****** 2026-02-24 10:04:12.640374 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:12.698189 | controller | 2026-02-24 10:04:12.698253 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2026-02-24 10:04:12.698262 | controller | Tuesday 24 February 2026 10:04:12 +0000 (0:00:00.884) 0:04:19.156 ****** 2026-02-24 10:04:12.698275 | controller | skipping: [instance] 2026-02-24 10:04:12.749048 | controller | 2026-02-24 10:04:12.749081 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2026-02-24 10:04:12.749089 | controller | Tuesday 24 February 2026 10:04:12 +0000 (0:00:00.058) 0:04:19.215 ****** 2026-02-24 10:04:12.749100 | controller | skipping: [instance] 2026-02-24 10:04:12.804124 | controller | 2026-02-24 10:04:12.804149 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2026-02-24 10:04:12.804157 | controller | Tuesday 24 February 2026 10:04:12 +0000 (0:00:00.051) 0:04:19.266 ****** 2026-02-24 10:04:12.804179 | controller | skipping: [instance] 2026-02-24 10:04:24.166920 | controller | 2026-02-24 10:04:24.166963 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2026-02-24 10:04:24.166972 | controller | Tuesday 24 February 2026 10:04:12 +0000 (0:00:00.053) 0:04:19.320 ****** 2026-02-24 10:04:24.166984 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:25.688336 | controller | 2026-02-24 10:04:25.688382 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2026-02-24 10:04:25.688390 | controller | Tuesday 24 February 2026 10:04:24 +0000 (0:00:11.363) 0:04:30.683 ****** 2026-02-24 10:04:25.688403 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:26.973193 | controller | 2026-02-24 10:04:26.973237 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-24 10:04:26.973252 | controller | Tuesday 24 February 2026 10:04:25 +0000 (0:00:01.521) 0:04:32.205 ****** 2026-02-24 10:04:26.973263 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-24 10:04:27.016896 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-24 10:04:27.016926 | controller | 2026-02-24 10:04:27.016934 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2026-02-24 10:04:27.016940 | controller | Tuesday 24 February 2026 10:04:26 +0000 (0:00:01.284) 0:04:33.490 ****** 2026-02-24 10:04:27.016950 | controller | skipping: [instance] 2026-02-24 10:04:27.671979 | controller | 2026-02-24 10:04:27.672023 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2026-02-24 10:04:27.672032 | controller | Tuesday 24 February 2026 10:04:27 +0000 (0:00:00.044) 0:04:33.534 ****** 2026-02-24 10:04:27.672054 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:27.712691 | controller | 2026-02-24 10:04:27.712708 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2026-02-24 10:04:27.712715 | controller | Tuesday 24 February 2026 10:04:27 +0000 (0:00:00.654) 0:04:34.188 ****** 2026-02-24 10:04:27.712723 | controller | skipping: [instance] 2026-02-24 10:04:27.759102 | controller | 2026-02-24 10:04:27.759119 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2026-02-24 10:04:27.759127 | controller | Tuesday 24 February 2026 10:04:27 +0000 (0:00:00.041) 0:04:34.229 ****** 2026-02-24 10:04:27.759135 | controller | skipping: [instance] 2026-02-24 10:04:27.806989 | controller | 2026-02-24 10:04:27.807007 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-24 10:04:27.807015 | controller | Tuesday 24 February 2026 10:04:27 +0000 (0:00:00.046) 0:04:34.276 ****** 2026-02-24 10:04:27.807024 | controller | skipping: [instance] 2026-02-24 10:04:27.848401 | controller | 2026-02-24 10:04:27.848425 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-24 10:04:27.848436 | controller | Tuesday 24 February 2026 10:04:27 +0000 (0:00:00.047) 0:04:34.324 ****** 2026-02-24 10:04:27.848447 | controller | skipping: [instance] 2026-02-24 10:04:27.848633 | controller | 2026-02-24 10:04:27.848822 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2026-02-24 10:04:27.848968 | controller | Tuesday 24 February 2026 10:04:27 +0000 (0:00:00.041) 0:04:34.366 ****** 2026-02-24 10:04:27.998472 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) 2026-02-24 10:04:29.099721 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) 2026-02-24 10:04:29.099765 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) 2026-02-24 10:04:29.099773 | controller | 2026-02-24 10:04:29.099779 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2026-02-24 10:04:29.099786 | controller | Tuesday 24 February 2026 10:04:27 +0000 (0:00:00.149) 0:04:34.515 ****** 2026-02-24 10:04:29.099797 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:29.142363 | controller | 2026-02-24 10:04:29.142397 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2026-02-24 10:04:29.142405 | controller | Tuesday 24 February 2026 10:04:29 +0000 (0:00:01.100) 0:04:35.616 ****** 2026-02-24 10:04:29.142415 | controller | skipping: [instance] 2026-02-24 10:04:29.283492 | controller | 2026-02-24 10:04:29.283516 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2026-02-24 10:04:29.283523 | controller | Tuesday 24 February 2026 10:04:29 +0000 (0:00:00.043) 0:04:35.659 ****** 2026-02-24 10:04:29.283532 | controller | 2026-02-24 10:04:29.343833 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2026-02-24 10:04:29.343854 | controller | Tuesday 24 February 2026 10:04:29 +0000 (0:00:00.141) 0:04:35.800 ****** 2026-02-24 10:04:29.343864 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:29.391877 | controller | 2026-02-24 10:04:29.391897 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-24 10:04:29.391904 | controller | Tuesday 24 February 2026 10:04:29 +0000 (0:00:00.060) 0:04:35.861 ****** 2026-02-24 10:04:29.391913 | controller | skipping: [instance] 2026-02-24 10:04:29.431945 | controller | 2026-02-24 10:04:29.431962 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-24 10:04:29.431969 | controller | Tuesday 24 February 2026 10:04:29 +0000 (0:00:00.048) 0:04:35.909 ****** 2026-02-24 10:04:29.431977 | controller | skipping: [instance] 2026-02-24 10:04:30.868546 | controller | 2026-02-24 10:04:30.868596 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2026-02-24 10:04:30.868605 | controller | Tuesday 24 February 2026 10:04:29 +0000 (0:00:00.039) 0:04:35.949 ****** 2026-02-24 10:04:30.868617 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:38.716178 | controller | 2026-02-24 10:04:38.716217 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2026-02-24 10:04:38.716226 | controller | Tuesday 24 February 2026 10:04:30 +0000 (0:00:01.436) 0:04:37.385 ****** 2026-02-24 10:04:38.716237 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1) 2026-02-24 10:04:38.826215 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b) 2026-02-24 10:04:38.826250 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282) 2026-02-24 10:04:38.826258 | controller | 2026-02-24 10:04:38.826264 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2026-02-24 10:04:38.826270 | controller | Tuesday 24 February 2026 10:04:38 +0000 (0:00:07.847) 0:04:45.232 ****** 2026-02-24 10:04:38.826297 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2026-02-24 10:04:39.079005 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2026-02-24 10:04:39.079047 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2026-02-24 10:04:39.079056 | controller | 2026-02-24 10:04:39.079068 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2026-02-24 10:04:39.079074 | controller | Tuesday 24 February 2026 10:04:38 +0000 (0:00:00.110) 0:04:45.343 ****** 2026-02-24 10:04:39.079085 | controller | ok: [instance -> localhost] 2026-02-24 10:04:41.244427 | controller | 2026-02-24 10:04:41.244474 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2026-02-24 10:04:41.244483 | controller | Tuesday 24 February 2026 10:04:39 +0000 (0:00:00.252) 0:04:45.595 ****** 2026-02-24 10:04:41.244495 | controller | changed: [instance -> localhost] => (item=controller-0) 2026-02-24 10:04:41.901363 | controller | 2026-02-24 10:04:41.901409 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2026-02-24 10:04:41.901417 | controller | Tuesday 24 February 2026 10:04:41 +0000 (0:00:02.165) 0:04:47.761 ****** 2026-02-24 10:04:41.901429 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:42.662460 | controller | 2026-02-24 10:04:42.662502 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2026-02-24 10:04:42.662510 | controller | Tuesday 24 February 2026 10:04:41 +0000 (0:00:00.656) 0:04:48.418 ****** 2026-02-24 10:04:42.662521 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:43.830002 | controller | 2026-02-24 10:04:43.830785 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2026-02-24 10:04:43.830830 | controller | Tuesday 24 February 2026 10:04:42 +0000 (0:00:00.761) 0:04:49.179 ****** 2026-02-24 10:04:43.830854 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:44.476538 | controller | 2026-02-24 10:04:44.476573 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2026-02-24 10:04:44.476581 | controller | Tuesday 24 February 2026 10:04:43 +0000 (0:00:01.166) 0:04:50.345 ****** 2026-02-24 10:04:44.476591 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:45.605607 | controller | 2026-02-24 10:04:45.605648 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2026-02-24 10:04:45.605657 | controller | Tuesday 24 February 2026 10:04:44 +0000 (0:00:00.647) 0:04:50.993 ****** 2026-02-24 10:04:45.605668 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:46.251448 | controller | 2026-02-24 10:04:46.251509 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2026-02-24 10:04:46.251518 | controller | Tuesday 24 February 2026 10:04:45 +0000 (0:00:01.128) 0:04:52.122 ****** 2026-02-24 10:04:46.251541 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:46.251562 | controller | 2026-02-24 10:04:46.251568 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2026-02-24 10:04:46.251576 | controller | Tuesday 24 February 2026 10:04:46 +0000 (0:00:00.646) 0:04:52.768 ****** 2026-02-24 10:04:46.949966 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:48.458564 | controller | 2026-02-24 10:04:48.458600 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2026-02-24 10:04:48.458609 | controller | Tuesday 24 February 2026 10:04:46 +0000 (0:00:00.698) 0:04:53.466 ****** 2026-02-24 10:04:48.458620 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-24 10:04:48.498761 | controller | 2026-02-24 10:04:48.498798 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 10:04:48.498806 | controller | Tuesday 24 February 2026 10:04:48 +0000 (0:00:01.508) 0:04:54.974 ****** 2026-02-24 10:04:48.498817 | controller | skipping: [instance] 2026-02-24 10:04:48.536551 | controller | 2026-02-24 10:04:48.536581 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 10:04:48.536590 | controller | Tuesday 24 February 2026 10:04:48 +0000 (0:00:00.041) 0:04:55.016 ****** 2026-02-24 10:04:48.536601 | controller | skipping: [instance] 2026-02-24 10:04:48.586382 | controller | 2026-02-24 10:04:48.586405 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 10:04:48.586413 | controller | Tuesday 24 February 2026 10:04:48 +0000 (0:00:00.036) 0:04:55.053 ****** 2026-02-24 10:04:48.586423 | controller | skipping: [instance] 2026-02-24 10:04:48.642019 | controller | 2026-02-24 10:04:48.642041 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 10:04:48.642048 | controller | Tuesday 24 February 2026 10:04:48 +0000 (0:00:00.050) 0:04:55.103 ****** 2026-02-24 10:04:48.642058 | controller | skipping: [instance] 2026-02-24 10:04:48.684179 | controller | 2026-02-24 10:04:48.684199 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 10:04:48.684206 | controller | Tuesday 24 February 2026 10:04:48 +0000 (0:00:00.055) 0:04:55.159 ****** 2026-02-24 10:04:48.684215 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:48.803599 | controller | 2026-02-24 10:04:48.803622 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 10:04:48.803635 | controller | Tuesday 24 February 2026 10:04:48 +0000 (0:00:00.042) 0:04:55.201 ****** 2026-02-24 10:04:48.803652 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-24 10:04:48.855180 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2026-02-24 10:04:48.855202 | controller | 2026-02-24 10:04:48.855210 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 10:04:48.855216 | controller | Tuesday 24 February 2026 10:04:48 +0000 (0:00:00.118) 0:04:55.320 ****** 2026-02-24 10:04:48.855226 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2026-02-24 10:04:52.726231 | controller | 2026-02-24 10:04:52.726318 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2026-02-24 10:04:52.726329 | controller | Tuesday 24 February 2026 10:04:48 +0000 (0:00:00.051) 0:04:55.372 ****** 2026-02-24 10:04:52.726346 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-24 10:04:53.806319 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2026-02-24 10:04:53.806403 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-24 10:04:53.806411 | controller | 2026-02-24 10:04:53.806419 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2026-02-24 10:04:53.806425 | controller | Tuesday 24 February 2026 10:04:52 +0000 (0:00:03.869) 0:04:59.242 ****** 2026-02-24 10:04:53.806445 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:53.806471 | controller | 2026-02-24 10:04:53.806534 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 10:04:53.806545 | controller | Tuesday 24 February 2026 10:04:53 +0000 (0:00:01.080) 0:05:00.323 ****** 2026-02-24 10:04:54.390507 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:55.441300 | controller | 2026-02-24 10:04:55.441346 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 10:04:55.441354 | controller | Tuesday 24 February 2026 10:04:54 +0000 (0:00:00.582) 0:05:00.906 ****** 2026-02-24 10:04:55.441366 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:55.525583 | controller | 2026-02-24 10:04:55.525609 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 10:04:55.525617 | controller | Tuesday 24 February 2026 10:04:55 +0000 (0:00:01.051) 0:05:01.958 ****** 2026-02-24 10:04:55.525628 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:55.579465 | controller | 2026-02-24 10:04:55.579529 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 10:04:55.579538 | controller | Tuesday 24 February 2026 10:04:55 +0000 (0:00:00.084) 0:05:02.042 ****** 2026-02-24 10:04:55.579552 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:55.579571 | controller | 2026-02-24 10:04:55.579577 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 10:04:55.579585 | controller | Tuesday 24 February 2026 10:04:55 +0000 (0:00:00.053) 0:05:02.096 ****** 2026-02-24 10:04:56.635050 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:56.635319 | controller | 2026-02-24 10:04:57.666657 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2026-02-24 10:04:57.666703 | controller | Tuesday 24 February 2026 10:04:56 +0000 (0:00:01.055) 0:05:03.152 ****** 2026-02-24 10:04:57.666737 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:04:57.666759 | controller | 2026-02-24 10:04:57.666851 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2026-02-24 10:04:57.666955 | controller | Tuesday 24 February 2026 10:04:57 +0000 (0:00:01.030) 0:05:04.183 ****** 2026-02-24 10:05:03.830494 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2026-02-24 10:05:03.830559 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:03.830673 | controller | 2026-02-24 10:05:03.830798 | controller | TASK [Configure ntp service] *************************************************** 2026-02-24 10:05:03.830937 | controller | Tuesday 24 February 2026 10:05:03 +0000 (0:00:06.164) 0:05:10.347 ****** 2026-02-24 10:05:04.055589 | controller | 2026-02-24 10:05:05.051170 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2026-02-24 10:05:05.051213 | controller | Tuesday 24 February 2026 10:05:04 +0000 (0:00:00.224) 0:05:10.572 ****** 2026-02-24 10:05:05.051225 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:06.027688 | controller | 2026-02-24 10:05:06.027727 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2026-02-24 10:05:06.027736 | controller | Tuesday 24 February 2026 10:05:05 +0000 (0:00:00.995) 0:05:11.568 ****** 2026-02-24 10:05:06.027748 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2026-02-24 10:05:06.981890 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2026-02-24 10:05:06.981930 | controller | 2026-02-24 10:05:06.981938 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2026-02-24 10:05:06.981945 | controller | Tuesday 24 February 2026 10:05:06 +0000 (0:00:00.976) 0:05:12.544 ****** 2026-02-24 10:05:06.981956 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:07.605192 | controller | 2026-02-24 10:05:07.605232 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2026-02-24 10:05:07.605241 | controller | Tuesday 24 February 2026 10:05:06 +0000 (0:00:00.954) 0:05:13.498 ****** 2026-02-24 10:05:07.605257 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:07.750006 | controller | 2026-02-24 10:05:07.750048 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2026-02-24 10:05:07.750058 | controller | Tuesday 24 February 2026 10:05:07 +0000 (0:00:00.623) 0:05:14.122 ****** 2026-02-24 10:05:07.750070 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2026-02-24 10:05:08.262584 | controller | 2026-02-24 10:05:08.262628 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2026-02-24 10:05:08.262637 | controller | Tuesday 24 February 2026 10:05:07 +0000 (0:00:00.144) 0:05:14.266 ****** 2026-02-24 10:05:08.262649 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:08.765655 | controller | 2026-02-24 10:05:08.765696 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2026-02-24 10:05:08.765704 | controller | Tuesday 24 February 2026 10:05:08 +0000 (0:00:00.512) 0:05:14.779 ****** 2026-02-24 10:05:08.765715 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-24 10:05:09.431674 | controller | 2026-02-24 10:05:09.431715 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2026-02-24 10:05:09.431724 | controller | Tuesday 24 February 2026 10:05:08 +0000 (0:00:00.503) 0:05:15.282 ****** 2026-02-24 10:05:09.431736 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-24 10:05:10.017333 | controller | 2026-02-24 10:05:10.017382 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2026-02-24 10:05:10.017391 | controller | Tuesday 24 February 2026 10:05:09 +0000 (0:00:00.666) 0:05:15.948 ****** 2026-02-24 10:05:10.017403 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-24 10:05:10.017440 | controller | 2026-02-24 10:05:10.017449 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2026-02-24 10:05:10.017475 | controller | Tuesday 24 February 2026 10:05:10 +0000 (0:00:00.585) 0:05:16.534 ****** 2026-02-24 10:05:10.073990 | controller | 2026-02-24 10:05:10.576571 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2026-02-24 10:05:10.576609 | controller | Tuesday 24 February 2026 10:05:10 +0000 (0:00:00.057) 0:05:16.591 ****** 2026-02-24 10:05:10.576622 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-24 10:05:11.352705 | controller | 2026-02-24 10:05:11.352745 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2026-02-24 10:05:11.352753 | controller | Tuesday 24 February 2026 10:05:10 +0000 (0:00:00.501) 0:05:17.093 ****** 2026-02-24 10:05:11.352765 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-24 10:05:11.384507 | controller | 2026-02-24 10:05:11.384540 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2026-02-24 10:05:11.384555 | controller | Tuesday 24 February 2026 10:05:11 +0000 (0:00:00.776) 0:05:17.869 ****** 2026-02-24 10:05:11.384567 | controller | skipping: [instance] 2026-02-24 10:05:11.421583 | controller | 2026-02-24 10:05:11.421612 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2026-02-24 10:05:11.421621 | controller | Tuesday 24 February 2026 10:05:11 +0000 (0:00:00.032) 0:05:17.901 ****** 2026-02-24 10:05:11.421632 | controller | skipping: [instance] 2026-02-24 10:05:11.686600 | controller | 2026-02-24 10:05:11.686629 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2026-02-24 10:05:11.686637 | controller | Tuesday 24 February 2026 10:05:11 +0000 (0:00:00.037) 0:05:17.938 ****** 2026-02-24 10:05:11.686647 | controller | changed: [instance] 2026-02-24 10:05:11.758692 | controller | 2026-02-24 10:05:11.758726 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2026-02-24 10:05:11.758736 | controller | Tuesday 24 February 2026 10:05:11 +0000 (0:00:00.265) 0:05:18.203 ****** 2026-02-24 10:05:11.758748 | controller | skipping: [instance] => (item=) 2026-02-24 10:05:11.797358 | controller | 2026-02-24 10:05:11.797377 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2026-02-24 10:05:11.797384 | controller | Tuesday 24 February 2026 10:05:11 +0000 (0:00:00.071) 0:05:18.275 ****** 2026-02-24 10:05:11.797393 | controller | ok: [instance] 2026-02-24 10:05:11.871774 | controller | 2026-02-24 10:05:11.871796 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 10:05:11.871803 | controller | Tuesday 24 February 2026 10:05:11 +0000 (0:00:00.036) 0:05:18.312 ****** 2026-02-24 10:05:11.871812 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-24 10:05:12.143202 | controller | 2026-02-24 10:05:12.143244 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 10:05:12.143253 | controller | Tuesday 24 February 2026 10:05:11 +0000 (0:00:00.076) 0:05:18.388 ****** 2026-02-24 10:05:12.143264 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-24 10:05:12.192535 | controller | 2026-02-24 10:05:12.192568 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2026-02-24 10:05:12.192588 | controller | Tuesday 24 February 2026 10:05:12 +0000 (0:00:00.271) 0:05:18.660 ****** 2026-02-24 10:05:12.192605 | controller | 2026-02-24 10:05:12.252551 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 10:05:12.252576 | controller | Tuesday 24 February 2026 10:05:12 +0000 (0:00:00.049) 0:05:18.709 ****** 2026-02-24 10:05:12.252590 | controller | ok: [instance] 2026-02-24 10:05:12.310020 | controller | 2026-02-24 10:05:12.310037 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 10:05:12.310044 | controller | Tuesday 24 February 2026 10:05:12 +0000 (0:00:00.060) 0:05:18.769 ****** 2026-02-24 10:05:12.310053 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-24 10:05:12.592740 | controller | 2026-02-24 10:05:12.592762 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 10:05:12.592770 | controller | Tuesday 24 February 2026 10:05:12 +0000 (0:00:00.057) 0:05:18.827 ****** 2026-02-24 10:05:12.592779 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-24 10:05:12.650768 | controller | 2026-02-24 10:05:12.650785 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 10:05:12.650793 | controller | Tuesday 24 February 2026 10:05:12 +0000 (0:00:00.282) 0:05:19.110 ****** 2026-02-24 10:05:12.650804 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-24 10:05:13.092830 | controller | skipping: [instance] 2026-02-24 10:05:13.092860 | controller | 2026-02-24 10:05:13.092868 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2026-02-24 10:05:13.092875 | controller | Tuesday 24 February 2026 10:05:12 +0000 (0:00:00.057) 0:05:19.167 ****** 2026-02-24 10:05:13.092886 | controller | changed: [instance] 2026-02-24 10:05:13.805447 | controller | 2026-02-24 10:05:13.805473 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-24 10:05:13.805480 | controller | Tuesday 24 February 2026 10:05:13 +0000 (0:00:00.428) 0:05:19.595 ****** 2026-02-24 10:05:13.805486 | controller | 2026-02-24 10:05:13.805491 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2026-02-24 10:05:13.805496 | controller | Tuesday 24 February 2026 10:05:13 +0000 (0:00:00.013) 0:05:19.609 ****** 2026-02-24 10:05:13.805505 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:14.207013 | controller | 2026-02-24 10:05:14.207055 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 10:05:14.207064 | controller | Tuesday 24 February 2026 10:05:13 +0000 (0:00:00.713) 0:05:20.322 ****** 2026-02-24 10:05:14.207075 | controller | changed: [instance] 2026-02-24 10:05:14.430382 | controller | 2026-02-24 10:05:14.430420 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2026-02-24 10:05:14.430429 | controller | Tuesday 24 February 2026 10:05:14 +0000 (0:00:00.401) 0:05:20.724 ****** 2026-02-24 10:05:14.430440 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 10:05:15.988991 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 10:05:15.989032 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2026-02-24 10:05:15.989041 | controller | 2026-02-24 10:05:15.989047 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2026-02-24 10:05:15.989054 | controller | Tuesday 24 February 2026 10:05:14 +0000 (0:00:00.223) 0:05:20.947 ****** 2026-02-24 10:05:15.989065 | controller | changed: [instance -> compute-0(compute-0.instance)] 2026-02-24 10:05:16.017649 | controller | 2026-02-24 10:05:16.017668 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-24 10:05:16.017676 | controller | Tuesday 24 February 2026 10:05:15 +0000 (0:00:01.558) 0:05:22.505 ****** 2026-02-24 10:05:16.017685 | controller | skipping: [instance] 2026-02-24 10:05:16.632110 | controller | 2026-02-24 10:05:16.632175 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-24 10:05:16.632186 | controller | Tuesday 24 February 2026 10:05:16 +0000 (0:00:00.029) 0:05:22.535 ****** 2026-02-24 10:05:16.632200 | controller | ok: [instance -> compute-0(compute-0.instance)] 2026-02-24 10:05:16.632220 | controller | 2026-02-24 10:05:16.632229 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-24 10:05:16.671446 | controller | Tuesday 24 February 2026 10:05:16 +0000 (0:00:00.614) 0:05:23.149 ****** 2026-02-24 10:05:16.671495 | controller | skipping: [instance] 2026-02-24 10:05:16.671723 | controller | 2026-02-24 10:05:16.671785 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-24 10:05:16.722429 | controller | Tuesday 24 February 2026 10:05:16 +0000 (0:00:00.039) 0:05:23.188 ****** 2026-02-24 10:05:16.722464 | controller | skipping: [instance] 2026-02-24 10:05:16.767471 | controller | 2026-02-24 10:05:16.767536 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-24 10:05:16.767546 | controller | Tuesday 24 February 2026 10:05:16 +0000 (0:00:00.050) 0:05:23.239 ****** 2026-02-24 10:05:16.767560 | controller | skipping: [instance] 2026-02-24 10:05:16.767598 | controller | 2026-02-24 10:05:16.767704 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-24 10:05:16.767744 | controller | Tuesday 24 February 2026 10:05:16 +0000 (0:00:00.045) 0:05:23.284 ****** 2026-02-24 10:05:16.819021 | controller | skipping: [instance] 2026-02-24 10:05:16.819238 | controller | 2026-02-24 10:05:16.819470 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2026-02-24 10:05:16.819627 | controller | Tuesday 24 February 2026 10:05:16 +0000 (0:00:00.051) 0:05:23.336 ****** 2026-02-24 10:05:16.866599 | controller | skipping: [instance] 2026-02-24 10:05:16.866747 | controller | 2026-02-24 10:05:16.866882 | controller | TASK [reproducer : Create repositories on computes] **************************** 2026-02-24 10:05:16.867023 | controller | Tuesday 24 February 2026 10:05:16 +0000 (0:00:00.047) 0:05:23.384 ****** 2026-02-24 10:05:16.893428 | controller | skipping: [instance] 2026-02-24 10:05:16.893568 | controller | 2026-02-24 10:05:16.893701 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2026-02-24 10:05:16.893830 | controller | Tuesday 24 February 2026 10:05:16 +0000 (0:00:00.026) 0:05:23.411 ****** 2026-02-24 10:05:16.936268 | controller | skipping: [instance] 2026-02-24 10:05:17.005885 | controller | 2026-02-24 10:05:17.005922 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2026-02-24 10:05:17.005931 | controller | Tuesday 24 February 2026 10:05:16 +0000 (0:00:00.042) 0:05:23.453 ****** 2026-02-24 10:05:17.005943 | controller | ok: [instance] 2026-02-24 10:05:17.115591 | controller | 2026-02-24 10:05:17.115625 | controller | TASK [reproducer : Push local code] ******************************************** 2026-02-24 10:05:17.115635 | controller | Tuesday 24 February 2026 10:05:17 +0000 (0:00:00.069) 0:05:23.523 ****** 2026-02-24 10:05:17.115649 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2026-02-24 10:05:17.162154 | controller | 2026-02-24 10:05:17.162183 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2026-02-24 10:05:17.162192 | controller | Tuesday 24 February 2026 10:05:17 +0000 (0:00:00.109) 0:05:23.632 ****** 2026-02-24 10:05:17.162204 | controller | skipping: [instance] 2026-02-24 10:05:17.162442 | controller | 2026-02-24 10:05:17.162461 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2026-02-24 10:05:17.207004 | controller | Tuesday 24 February 2026 10:05:17 +0000 (0:00:00.046) 0:05:23.679 ****** 2026-02-24 10:05:17.207031 | controller | skipping: [instance] 2026-02-24 10:05:17.249474 | controller | 2026-02-24 10:05:17.249526 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2026-02-24 10:05:17.249537 | controller | Tuesday 24 February 2026 10:05:17 +0000 (0:00:00.044) 0:05:23.724 ****** 2026-02-24 10:05:17.249551 | controller | skipping: [instance] 2026-02-24 10:05:17.249760 | controller | 2026-02-24 10:05:17.290107 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2026-02-24 10:05:17.290159 | controller | Tuesday 24 February 2026 10:05:17 +0000 (0:00:00.042) 0:05:23.766 ****** 2026-02-24 10:05:17.290173 | controller | skipping: [instance] 2026-02-24 10:05:17.326918 | controller | 2026-02-24 10:05:17.326950 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2026-02-24 10:05:17.326961 | controller | Tuesday 24 February 2026 10:05:17 +0000 (0:00:00.040) 0:05:23.807 ****** 2026-02-24 10:05:17.326975 | controller | skipping: [instance] 2026-02-24 10:05:17.800860 | controller | 2026-02-24 10:05:17.800914 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2026-02-24 10:05:17.800924 | controller | Tuesday 24 February 2026 10:05:17 +0000 (0:00:00.036) 0:05:23.844 ****** 2026-02-24 10:05:17.800944 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2026-02-24 10:05:18.391878 | controller | 2026-02-24 10:05:18.391923 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2026-02-24 10:05:18.391933 | controller | Tuesday 24 February 2026 10:05:17 +0000 (0:00:00.473) 0:05:24.317 ****** 2026-02-24 10:05:18.391944 | controller | ok: [instance -> localhost] => (item=ci-framework) 2026-02-24 10:05:18.391973 | controller | 2026-02-24 10:05:18.392085 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2026-02-24 10:05:18.392104 | controller | Tuesday 24 February 2026 10:05:18 +0000 (0:00:00.591) 0:05:24.908 ****** 2026-02-24 10:05:18.436464 | controller | skipping: [instance] => (item=ci-framework) 2026-02-24 10:05:18.436552 | controller | skipping: [instance] 2026-02-24 10:05:18.436570 | controller | 2026-02-24 10:05:18.436585 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2026-02-24 10:05:18.515416 | controller | Tuesday 24 February 2026 10:05:18 +0000 (0:00:00.044) 0:05:24.953 ****** 2026-02-24 10:05:18.515456 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2026-02-24 10:05:18.515495 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2026-02-24 10:05:18.515549 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2026-02-24 10:05:18.515900 | controller | 2026-02-24 10:05:18.983456 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2026-02-24 10:05:18.983507 | controller | Tuesday 24 February 2026 10:05:18 +0000 (0:00:00.079) 0:05:25.032 ****** 2026-02-24 10:05:18.983529 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:18.983561 | controller | 2026-02-24 10:05:18.983573 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2026-02-24 10:05:18.983586 | controller | Tuesday 24 February 2026 10:05:18 +0000 (0:00:00.467) 0:05:25.500 ****** 2026-02-24 10:05:19.024240 | controller | skipping: [instance] 2026-02-24 10:05:19.024327 | controller | 2026-02-24 10:05:19.024468 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2026-02-24 10:05:19.024506 | controller | Tuesday 24 February 2026 10:05:19 +0000 (0:00:00.041) 0:05:25.541 ****** 2026-02-24 10:05:19.480834 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:19.522779 | controller | 2026-02-24 10:05:19.522814 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2026-02-24 10:05:19.522823 | controller | Tuesday 24 February 2026 10:05:19 +0000 (0:00:00.455) 0:05:25.997 ****** 2026-02-24 10:05:19.522835 | controller | skipping: [instance] 2026-02-24 10:05:19.965571 | controller | 2026-02-24 10:05:19.965619 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2026-02-24 10:05:19.965628 | controller | Tuesday 24 February 2026 10:05:19 +0000 (0:00:00.042) 0:05:26.040 ****** 2026-02-24 10:05:19.965641 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:22.215993 | controller | 2026-02-24 10:05:22.216061 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2026-02-24 10:05:22.216070 | controller | Tuesday 24 February 2026 10:05:19 +0000 (0:00:00.442) 0:05:26.482 ****** 2026-02-24 10:05:22.216084 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:22.216178 | controller | 2026-02-24 10:05:22.216192 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2026-02-24 10:05:22.216201 | controller | Tuesday 24 February 2026 10:05:22 +0000 (0:00:02.250) 0:05:28.733 ****** 2026-02-24 10:05:42.476394 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:42.476690 | controller | 2026-02-24 10:05:42.476804 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2026-02-24 10:05:42.476919 | controller | Tuesday 24 February 2026 10:05:42 +0000 (0:00:20.254) 0:05:48.987 ****** 2026-02-24 10:05:43.480009 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:43.480066 | controller | 2026-02-24 10:05:43.480199 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2026-02-24 10:05:43.480397 | controller | Tuesday 24 February 2026 10:05:43 +0000 (0:00:01.009) 0:05:49.997 ****** 2026-02-24 10:05:43.586955 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2026-02-24 10:05:43.587164 | controller | 2026-02-24 10:05:43.587222 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2026-02-24 10:05:43.587391 | controller | Tuesday 24 February 2026 10:05:43 +0000 (0:00:00.106) 0:05:50.104 ****** 2026-02-24 10:05:44.052456 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:44.052499 | controller | 2026-02-24 10:05:44.052654 | controller | TASK [reproducer : Rotate log if present] ************************************** 2026-02-24 10:05:44.052736 | controller | Tuesday 24 February 2026 10:05:44 +0000 (0:00:00.465) 0:05:50.569 ****** 2026-02-24 10:05:44.089716 | controller | skipping: [instance] 2026-02-24 10:05:44.089861 | controller | 2026-02-24 10:05:44.090039 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2026-02-24 10:05:44.090236 | controller | Tuesday 24 February 2026 10:05:44 +0000 (0:00:00.037) 0:05:50.607 ****** 2026-02-24 10:05:44.133951 | controller | skipping: [instance] 2026-02-24 10:05:44.134032 | controller | 2026-02-24 10:05:44.134139 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2026-02-24 10:05:44.134247 | controller | Tuesday 24 February 2026 10:05:44 +0000 (0:00:00.044) 0:05:50.651 ****** 2026-02-24 10:05:44.234965 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:44.235010 | controller | 2026-02-24 10:05:44.235137 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-24 10:05:44.235241 | controller | Tuesday 24 February 2026 10:05:44 +0000 (0:00:00.100) 0:05:50.752 ****** 2026-02-24 10:05:44.727925 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:44.727997 | controller | 2026-02-24 10:05:44.728095 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-24 10:05:44.728215 | controller | Tuesday 24 February 2026 10:05:44 +0000 (0:00:00.492) 0:05:51.245 ****** 2026-02-24 10:05:44.768900 | controller | skipping: [instance] 2026-02-24 10:05:44.768965 | controller | 2026-02-24 10:05:44.769064 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-24 10:05:44.769179 | controller | Tuesday 24 February 2026 10:05:44 +0000 (0:00:00.040) 0:05:51.286 ****** 2026-02-24 10:05:44.808618 | controller | skipping: [instance] 2026-02-24 10:05:44.808696 | controller | 2026-02-24 10:05:44.808794 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-24 10:05:44.808892 | controller | Tuesday 24 February 2026 10:05:44 +0000 (0:00:00.039) 0:05:51.326 ****** 2026-02-24 10:05:44.849242 | controller | skipping: [instance] 2026-02-24 10:05:44.849366 | controller | 2026-02-24 10:05:44.849504 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-24 10:05:44.849645 | controller | Tuesday 24 February 2026 10:05:44 +0000 (0:00:00.040) 0:05:51.366 ****** 2026-02-24 10:05:44.899050 | controller | skipping: [instance] 2026-02-24 10:05:44.899180 | controller | 2026-02-24 10:05:44.899315 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-24 10:05:44.899483 | controller | Tuesday 24 February 2026 10:05:44 +0000 (0:00:00.049) 0:05:51.416 ****** 2026-02-24 10:05:46.237432 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:05:46.237478 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:05:46.237589 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:05:46.237687 | controller | changed: [instance -> controller-0] 2026-02-24 10:05:46.237767 | controller | 2026-02-24 10:05:46.237862 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-24 10:05:46.237958 | controller | Tuesday 24 February 2026 10:05:46 +0000 (0:00:01.337) 0:05:52.754 ****** 2026-02-24 10:05:47.177813 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:47.177879 | controller | 2026-02-24 10:05:47.177979 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-24 10:05:47.178077 | controller | Tuesday 24 February 2026 10:05:47 +0000 (0:00:00.940) 0:05:53.695 ****** 2026-02-24 10:05:48.459563 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:48.459604 | controller | 2026-02-24 10:05:48.459859 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-24 10:05:55.862668 | controller | Tuesday 24 February 2026 10:05:48 +0000 (0:00:01.281) 0:05:54.976 ****** 2026-02-24 10:05:55.862727 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:55.862824 | controller | 2026-02-24 10:05:55.862907 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-24 10:05:55.862926 | controller | Tuesday 24 February 2026 10:05:55 +0000 (0:00:07.403) 0:06:02.379 ****** 2026-02-24 10:05:56.758440 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:56.758543 | controller | 2026-02-24 10:05:56.758578 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-24 10:05:56.758592 | controller | Tuesday 24 February 2026 10:05:56 +0000 (0:00:00.895) 0:06:03.275 ****** 2026-02-24 10:05:56.811376 | controller | skipping: [instance] 2026-02-24 10:05:56.811592 | controller | 2026-02-24 10:05:56.811611 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-24 10:05:57.959323 | controller | Tuesday 24 February 2026 10:05:56 +0000 (0:00:00.053) 0:06:03.328 ****** 2026-02-24 10:05:57.959367 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:05:58.009369 | controller | 2026-02-24 10:05:58.009407 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-24 10:05:58.009417 | controller | Tuesday 24 February 2026 10:05:57 +0000 (0:00:01.147) 0:06:04.476 ****** 2026-02-24 10:05:58.009429 | controller | skipping: [instance] 2026-02-24 10:05:58.058474 | controller | 2026-02-24 10:05:58.058508 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-24 10:05:58.058517 | controller | Tuesday 24 February 2026 10:05:58 +0000 (0:00:00.050) 0:06:04.526 ****** 2026-02-24 10:05:58.058528 | controller | skipping: [instance] 2026-02-24 10:05:58.110380 | controller | 2026-02-24 10:05:58.110417 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-24 10:05:58.110426 | controller | Tuesday 24 February 2026 10:05:58 +0000 (0:00:00.048) 0:06:04.575 ****** 2026-02-24 10:05:58.110438 | controller | skipping: [instance] 2026-02-24 10:05:59.005534 | controller | 2026-02-24 10:05:59.005573 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-24 10:05:59.005582 | controller | Tuesday 24 February 2026 10:05:58 +0000 (0:00:00.051) 0:06:04.627 ****** 2026-02-24 10:05:59.005593 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:00.018684 | controller | 2026-02-24 10:06:00.018727 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-24 10:06:00.018736 | controller | Tuesday 24 February 2026 10:05:59 +0000 (0:00:00.894) 0:06:05.522 ****** 2026-02-24 10:06:00.018756 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:00.062751 | controller | 2026-02-24 10:06:00.062770 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-24 10:06:00.062778 | controller | Tuesday 24 February 2026 10:06:00 +0000 (0:00:01.013) 0:06:06.535 ****** 2026-02-24 10:06:00.062787 | controller | skipping: [instance] 2026-02-24 10:06:00.105829 | controller | 2026-02-24 10:06:00.105855 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-24 10:06:00.105863 | controller | Tuesday 24 February 2026 10:06:00 +0000 (0:00:00.044) 0:06:06.580 ****** 2026-02-24 10:06:00.105873 | controller | skipping: [instance] 2026-02-24 10:06:00.146638 | controller | 2026-02-24 10:06:00.146689 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-24 10:06:00.146698 | controller | Tuesday 24 February 2026 10:06:00 +0000 (0:00:00.042) 0:06:06.623 ****** 2026-02-24 10:06:00.146738 | controller | skipping: [instance] 2026-02-24 10:06:00.146786 | controller | 2026-02-24 10:06:00.146816 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-24 10:06:00.198317 | controller | Tuesday 24 February 2026 10:06:00 +0000 (0:00:00.041) 0:06:06.664 ****** 2026-02-24 10:06:00.198347 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:00.239631 | controller | 2026-02-24 10:06:00.239704 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-24 10:06:00.239713 | controller | Tuesday 24 February 2026 10:06:00 +0000 (0:00:00.051) 0:06:06.715 ****** 2026-02-24 10:06:00.239727 | controller | skipping: [instance] 2026-02-24 10:06:00.279470 | controller | 2026-02-24 10:06:00.279530 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-24 10:06:00.279542 | controller | Tuesday 24 February 2026 10:06:00 +0000 (0:00:00.041) 0:06:06.756 ****** 2026-02-24 10:06:00.279557 | controller | skipping: [instance] 2026-02-24 10:06:00.319705 | controller | 2026-02-24 10:06:00.319739 | controller | TASK [Download the RPM] ******************************************************** 2026-02-24 10:06:00.319748 | controller | Tuesday 24 February 2026 10:06:00 +0000 (0:00:00.040) 0:06:06.796 ****** 2026-02-24 10:06:00.319759 | controller | skipping: [instance] 2026-02-24 10:06:00.360486 | controller | 2026-02-24 10:06:00.360524 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-24 10:06:00.360533 | controller | Tuesday 24 February 2026 10:06:00 +0000 (0:00:00.040) 0:06:06.837 ****** 2026-02-24 10:06:00.360545 | controller | skipping: [instance] 2026-02-24 10:06:00.360621 | controller | 2026-02-24 10:06:00.360758 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-24 10:06:00.360862 | controller | Tuesday 24 February 2026 10:06:00 +0000 (0:00:00.040) 0:06:06.878 ****** 2026-02-24 10:06:00.399895 | controller | skipping: [instance] 2026-02-24 10:06:00.399971 | controller | 2026-02-24 10:06:00.400071 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-24 10:06:00.400186 | controller | Tuesday 24 February 2026 10:06:00 +0000 (0:00:00.039) 0:06:06.917 ****** 2026-02-24 10:06:00.440160 | controller | skipping: [instance] 2026-02-24 10:06:00.440233 | controller | 2026-02-24 10:06:00.440346 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-24 10:06:00.440439 | controller | Tuesday 24 February 2026 10:06:00 +0000 (0:00:00.040) 0:06:06.958 ****** 2026-02-24 10:06:00.481903 | controller | skipping: [instance] 2026-02-24 10:06:00.482003 | controller | 2026-02-24 10:06:00.482100 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-24 10:06:00.482222 | controller | Tuesday 24 February 2026 10:06:00 +0000 (0:00:00.041) 0:06:06.999 ****** 2026-02-24 10:06:00.952590 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:00.952646 | controller | 2026-02-24 10:06:00.952714 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-24 10:06:00.952820 | controller | Tuesday 24 February 2026 10:06:00 +0000 (0:00:00.470) 0:06:07.469 ****** 2026-02-24 10:06:01.011147 | controller | skipping: [instance] 2026-02-24 10:06:01.011216 | controller | 2026-02-24 10:06:01.011341 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-24 10:06:01.011420 | controller | Tuesday 24 February 2026 10:06:01 +0000 (0:00:00.058) 0:06:07.528 ****** 2026-02-24 10:06:01.060613 | controller | skipping: [instance] 2026-02-24 10:06:01.060697 | controller | 2026-02-24 10:06:01.060794 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-24 10:06:01.060887 | controller | Tuesday 24 February 2026 10:06:01 +0000 (0:00:00.049) 0:06:07.578 ****** 2026-02-24 10:06:01.111877 | controller | skipping: [instance] 2026-02-24 10:06:01.111967 | controller | 2026-02-24 10:06:01.112088 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-24 10:06:01.112207 | controller | Tuesday 24 February 2026 10:06:01 +0000 (0:00:00.051) 0:06:07.629 ****** 2026-02-24 10:06:01.166410 | controller | skipping: [instance] 2026-02-24 10:06:01.166491 | controller | 2026-02-24 10:06:01.166591 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-24 10:06:01.166687 | controller | Tuesday 24 February 2026 10:06:01 +0000 (0:00:00.054) 0:06:07.684 ****** 2026-02-24 10:06:01.219012 | controller | skipping: [instance] 2026-02-24 10:06:01.219085 | controller | 2026-02-24 10:06:01.219192 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-24 10:06:01.219295 | controller | Tuesday 24 February 2026 10:06:01 +0000 (0:00:00.052) 0:06:07.736 ****** 2026-02-24 10:06:01.271276 | controller | skipping: [instance] 2026-02-24 10:06:01.271348 | controller | 2026-02-24 10:06:01.271626 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-24 10:06:01.271714 | controller | Tuesday 24 February 2026 10:06:01 +0000 (0:00:00.052) 0:06:07.789 ****** 2026-02-24 10:06:01.324974 | controller | skipping: [instance] 2026-02-24 10:06:01.325043 | controller | 2026-02-24 10:06:01.325146 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-24 10:06:01.325238 | controller | Tuesday 24 February 2026 10:06:01 +0000 (0:00:00.053) 0:06:07.842 ****** 2026-02-24 10:06:01.384829 | controller | skipping: [instance] 2026-02-24 10:06:01.384915 | controller | 2026-02-24 10:06:01.385019 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-24 10:06:01.385127 | controller | Tuesday 24 February 2026 10:06:01 +0000 (0:00:00.059) 0:06:07.901 ****** 2026-02-24 10:06:02.010224 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:02.010313 | controller | 2026-02-24 10:06:02.010401 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-24 10:06:02.010490 | controller | Tuesday 24 February 2026 10:06:02 +0000 (0:00:00.625) 0:06:08.527 ****** 2026-02-24 10:06:03.067326 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:06:03.067482 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:06:03.067497 | controller | changed: [instance -> controller-0] 2026-02-24 10:06:03.067656 | controller | 2026-02-24 10:06:03.067678 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-24 10:06:03.785541 | controller | Tuesday 24 February 2026 10:06:03 +0000 (0:00:01.056) 0:06:09.584 ****** 2026-02-24 10:06:03.785576 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:03.785733 | controller | 2026-02-24 10:06:03.785743 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-24 10:06:04.332739 | controller | Tuesday 24 February 2026 10:06:03 +0000 (0:00:00.718) 0:06:10.302 ****** 2026-02-24 10:06:04.332786 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:04.332822 | controller | 2026-02-24 10:06:04.332834 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-24 10:06:04.394844 | controller | Tuesday 24 February 2026 10:06:04 +0000 (0:00:00.547) 0:06:10.849 ****** 2026-02-24 10:06:04.394873 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:06:04.394986 | controller | ok: [instance -> controller-0] 2026-02-24 10:06:04.395190 | controller | 2026-02-24 10:06:04.395329 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-24 10:06:04.395346 | controller | Tuesday 24 February 2026 10:06:04 +0000 (0:00:00.062) 0:06:10.912 ****** 2026-02-24 10:06:04.451837 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:34.182736 | controller | 2026-02-24 10:06:34.182792 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-24 10:06:34.182802 | controller | Tuesday 24 February 2026 10:06:04 +0000 (0:00:00.056) 0:06:10.969 ****** 2026-02-24 10:06:34.182815 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:34.182890 | controller | 2026-02-24 10:06:34.182932 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-24 10:06:34.182947 | controller | Tuesday 24 February 2026 10:06:34 +0000 (0:00:29.730) 0:06:40.699 ****** 2026-02-24 10:06:34.706439 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:34.706495 | controller | 2026-02-24 10:06:34.706531 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-24 10:06:34.706704 | controller | Tuesday 24 February 2026 10:06:34 +0000 (0:00:00.524) 0:06:41.223 ****** 2026-02-24 10:06:35.215216 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:35.215296 | controller | 2026-02-24 10:06:35.215347 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-24 10:06:35.215445 | controller | Tuesday 24 February 2026 10:06:35 +0000 (0:00:00.508) 0:06:41.732 ****** 2026-02-24 10:06:41.236603 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:41.236666 | controller | 2026-02-24 10:06:41.236844 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-24 10:06:41.294211 | controller | Tuesday 24 February 2026 10:06:41 +0000 (0:00:06.021) 0:06:47.753 ****** 2026-02-24 10:06:41.294250 | controller | skipping: [instance] 2026-02-24 10:06:41.903251 | controller | 2026-02-24 10:06:41.903305 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-24 10:06:41.903317 | controller | Tuesday 24 February 2026 10:06:41 +0000 (0:00:00.057) 0:06:47.811 ****** 2026-02-24 10:06:41.903329 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:42.434193 | controller | 2026-02-24 10:06:42.434230 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-24 10:06:42.434238 | controller | Tuesday 24 February 2026 10:06:41 +0000 (0:00:00.608) 0:06:48.420 ****** 2026-02-24 10:06:42.434258 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:42.474891 | controller | 2026-02-24 10:06:42.474923 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-24 10:06:42.474932 | controller | Tuesday 24 February 2026 10:06:42 +0000 (0:00:00.531) 0:06:48.951 ****** 2026-02-24 10:06:42.474944 | controller | skipping: [instance] 2026-02-24 10:06:42.516702 | controller | 2026-02-24 10:06:42.516729 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-24 10:06:42.516737 | controller | Tuesday 24 February 2026 10:06:42 +0000 (0:00:00.040) 0:06:48.992 ****** 2026-02-24 10:06:42.516747 | controller | skipping: [instance] 2026-02-24 10:06:42.516789 | controller | 2026-02-24 10:06:42.516798 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-24 10:06:42.516905 | controller | Tuesday 24 February 2026 10:06:42 +0000 (0:00:00.042) 0:06:49.034 ****** 2026-02-24 10:06:42.554088 | controller | skipping: [instance] 2026-02-24 10:06:42.554173 | controller | 2026-02-24 10:06:42.554325 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-24 10:06:42.554435 | controller | Tuesday 24 February 2026 10:06:42 +0000 (0:00:00.037) 0:06:49.071 ****** 2026-02-24 10:06:42.599167 | controller | skipping: [instance] 2026-02-24 10:06:42.599233 | controller | 2026-02-24 10:06:42.599245 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-24 10:06:42.599380 | controller | Tuesday 24 February 2026 10:06:42 +0000 (0:00:00.043) 0:06:49.115 ****** 2026-02-24 10:06:42.651243 | controller | skipping: [instance] 2026-02-24 10:06:42.700022 | controller | 2026-02-24 10:06:42.700066 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-24 10:06:42.700080 | controller | Tuesday 24 February 2026 10:06:42 +0000 (0:00:00.052) 0:06:49.168 ****** 2026-02-24 10:06:42.700098 | controller | skipping: [instance] 2026-02-24 10:06:42.700126 | controller | 2026-02-24 10:06:42.700136 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-24 10:06:42.700171 | controller | Tuesday 24 February 2026 10:06:42 +0000 (0:00:00.048) 0:06:49.217 ****** 2026-02-24 10:06:45.452399 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:06:45.615675 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:06:45.615727 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:06:45.615736 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:06:45.615743 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:06:45.615749 | controller | changed: [instance -> controller-0] 2026-02-24 10:06:45.615756 | controller | 2026-02-24 10:06:45.615764 | controller | TASK [Prepare install_yamls make targets] ************************************** 2026-02-24 10:06:45.615770 | controller | Tuesday 24 February 2026 10:06:45 +0000 (0:00:02.751) 0:06:51.968 ****** 2026-02-24 10:06:45.615782 | controller | 2026-02-24 10:06:47.131657 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2026-02-24 10:06:47.131699 | controller | Tuesday 24 February 2026 10:06:45 +0000 (0:00:00.163) 0:06:52.132 ****** 2026-02-24 10:06:47.131714 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:06:47.131740 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:06:47.131748 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:06:47.131871 | controller | changed: [instance -> controller-0] 2026-02-24 10:06:47.131924 | controller | 2026-02-24 10:06:47.132175 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2026-02-24 10:06:47.206035 | controller | Tuesday 24 February 2026 10:06:47 +0000 (0:00:01.515) 0:06:53.648 ****** 2026-02-24 10:06:47.206098 | controller | 2026-02-24 10:06:47.253942 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2026-02-24 10:06:47.253966 | controller | Tuesday 24 February 2026 10:06:47 +0000 (0:00:00.074) 0:06:53.722 ****** 2026-02-24 10:06:47.253977 | controller | skipping: [instance] 2026-02-24 10:06:47.303423 | controller | 2026-02-24 10:06:47.303456 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2026-02-24 10:06:47.303464 | controller | Tuesday 24 February 2026 10:06:47 +0000 (0:00:00.048) 0:06:53.771 ****** 2026-02-24 10:06:47.303475 | controller | skipping: [instance] 2026-02-24 10:06:47.303505 | controller | 2026-02-24 10:06:47.303513 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2026-02-24 10:06:47.303681 | controller | Tuesday 24 February 2026 10:06:47 +0000 (0:00:00.049) 0:06:53.820 ****** 2026-02-24 10:06:47.376534 | controller | 2026-02-24 10:06:47.376667 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 10:06:47.376706 | controller | Tuesday 24 February 2026 10:06:47 +0000 (0:00:00.072) 0:06:53.893 ****** 2026-02-24 10:06:47.418534 | controller | skipping: [instance] 2026-02-24 10:06:47.418705 | controller | 2026-02-24 10:06:47.418876 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 10:06:47.419030 | controller | Tuesday 24 February 2026 10:06:47 +0000 (0:00:00.042) 0:06:53.936 ****** 2026-02-24 10:06:47.458787 | controller | skipping: [instance] 2026-02-24 10:06:47.497436 | controller | 2026-02-24 10:06:47.497502 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 10:06:47.497512 | controller | Tuesday 24 February 2026 10:06:47 +0000 (0:00:00.040) 0:06:53.976 ****** 2026-02-24 10:06:47.497530 | controller | skipping: [instance] 2026-02-24 10:06:47.497584 | controller | 2026-02-24 10:06:47.497593 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 10:06:47.542307 | controller | Tuesday 24 February 2026 10:06:47 +0000 (0:00:00.038) 0:06:54.015 ****** 2026-02-24 10:06:47.542349 | controller | skipping: [instance] 2026-02-24 10:06:47.765848 | controller | 2026-02-24 10:06:47.765898 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2026-02-24 10:06:47.765907 | controller | Tuesday 24 February 2026 10:06:47 +0000 (0:00:00.044) 0:06:54.059 ****** 2026-02-24 10:06:47.765920 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 10:06:47.840913 | controller | ok: [instance -> controller-0] 2026-02-24 10:06:47.840941 | controller | 2026-02-24 10:06:47.840950 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2026-02-24 10:06:47.840962 | controller | Tuesday 24 February 2026 10:06:47 +0000 (0:00:00.222) 0:06:54.282 ****** 2026-02-24 10:06:47.840980 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:47.841176 | controller | 2026-02-24 10:06:47.841204 | controller | TASK [install_yamls : Get environment structure] ******************************* 2026-02-24 10:06:48.767221 | controller | Tuesday 24 February 2026 10:06:47 +0000 (0:00:00.076) 0:06:54.358 ****** 2026-02-24 10:06:48.767264 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:48.810530 | controller | 2026-02-24 10:06:48.810613 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2026-02-24 10:06:48.810622 | controller | Tuesday 24 February 2026 10:06:48 +0000 (0:00:00.925) 0:06:55.284 ****** 2026-02-24 10:06:48.810640 | controller | skipping: [instance] 2026-02-24 10:06:48.857071 | controller | 2026-02-24 10:06:48.857120 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2026-02-24 10:06:48.857130 | controller | Tuesday 24 February 2026 10:06:48 +0000 (0:00:00.043) 0:06:55.327 ****** 2026-02-24 10:06:48.857155 | controller | skipping: [instance] 2026-02-24 10:06:48.857183 | controller | 2026-02-24 10:06:48.857299 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2026-02-24 10:06:48.857437 | controller | Tuesday 24 February 2026 10:06:48 +0000 (0:00:00.047) 0:06:55.374 ****** 2026-02-24 10:06:48.898723 | controller | skipping: [instance] 2026-02-24 10:06:48.975117 | controller | 2026-02-24 10:06:48.975171 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2026-02-24 10:06:48.975180 | controller | Tuesday 24 February 2026 10:06:48 +0000 (0:00:00.041) 0:06:55.416 ****** 2026-02-24 10:06:48.975193 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:49.034946 | controller | 2026-02-24 10:06:49.034966 | controller | TASK [install_yamls : Show the env structure] ********************************** 2026-02-24 10:06:49.034973 | controller | Tuesday 24 February 2026 10:06:48 +0000 (0:00:00.076) 0:06:55.492 ****** 2026-02-24 10:06:49.034982 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:49.104792 | controller | 2026-02-24 10:06:49.104937 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2026-02-24 10:06:49.104946 | controller | Tuesday 24 February 2026 10:06:49 +0000 (0:00:00.059) 0:06:55.552 ****** 2026-02-24 10:06:49.104958 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:49.104974 | controller | 2026-02-24 10:06:49.104981 | controller | TASK [install_yamls : Generate make targets] *********************************** 2026-02-24 10:06:49.105044 | controller | Tuesday 24 February 2026 10:06:49 +0000 (0:00:00.070) 0:06:55.622 ****** 2026-02-24 10:06:49.796862 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:49.796921 | controller | 2026-02-24 10:06:49.797010 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2026-02-24 10:06:49.797118 | controller | Tuesday 24 February 2026 10:06:49 +0000 (0:00:00.691) 0:06:56.314 ****** 2026-02-24 10:06:49.850881 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:49.850956 | controller | 2026-02-24 10:06:49.851050 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2026-02-24 10:06:49.851152 | controller | Tuesday 24 February 2026 10:06:49 +0000 (0:00:00.054) 0:06:56.368 ****** 2026-02-24 10:06:50.825881 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:50.825935 | controller | 2026-02-24 10:06:50.826024 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2026-02-24 10:06:50.826113 | controller | Tuesday 24 February 2026 10:06:50 +0000 (0:00:00.974) 0:06:57.343 ****** 2026-02-24 10:06:50.876254 | controller | skipping: [instance] 2026-02-24 10:06:50.876403 | controller | 2026-02-24 10:06:50.876529 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-24 10:06:50.876635 | controller | Tuesday 24 February 2026 10:06:50 +0000 (0:00:00.050) 0:06:57.393 ****** 2026-02-24 10:06:51.673025 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:51.673089 | controller | 2026-02-24 10:06:51.673197 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-24 10:06:51.673312 | controller | Tuesday 24 February 2026 10:06:51 +0000 (0:00:00.796) 0:06:58.190 ****** 2026-02-24 10:06:51.730717 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:51.730768 | controller | 2026-02-24 10:06:51.730879 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2026-02-24 10:06:51.730972 | controller | Tuesday 24 February 2026 10:06:51 +0000 (0:00:00.057) 0:06:58.248 ****** 2026-02-24 10:06:52.729096 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:52.729161 | controller | 2026-02-24 10:06:52.729245 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2026-02-24 10:06:52.729366 | controller | Tuesday 24 February 2026 10:06:52 +0000 (0:00:00.997) 0:06:59.245 ****** 2026-02-24 10:06:53.238903 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 10:06:53.238967 | controller | 2026-02-24 10:06:53.239012 | controller | TASK [Configure CRC network if needed] ***************************************** 2026-02-24 10:06:53.239146 | controller | Tuesday 24 February 2026 10:06:53 +0000 (0:00:00.510) 0:06:59.756 ****** 2026-02-24 10:06:53.404397 | controller | 2026-02-24 10:06:53.404457 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2026-02-24 10:06:53.404531 | controller | Tuesday 24 February 2026 10:06:53 +0000 (0:00:00.165) 0:06:59.921 ****** 2026-02-24 10:06:54.697312 | controller | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-24 10:06:54.699170 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false 2026-02-24 10:06:54.699233 | controller | module_stderr: |- 2026-02-24 10:06:54.699315 | controller | Shared connection to controller-0.utility closed. 2026-02-24 10:06:54.699413 | controller | module_stdout: |- 2026-02-24 10:06:54.699535 | controller | Traceback (most recent call last): 2026-02-24 10:06:54.699633 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 700, in urlopen 2026-02-24 10:06:54.699749 | controller | httplib_response = self._make_request( 2026-02-24 10:06:54.699840 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 383, in _make_request 2026-02-24 10:06:54.699925 | controller | self._validate_conn(conn) 2026-02-24 10:06:54.700015 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1015, in _validate_conn 2026-02-24 10:06:54.700103 | controller | conn.connect() 2026-02-24 10:06:54.700223 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connection.py", line 411, in connect 2026-02-24 10:06:54.700345 | controller | self.sock = ssl_wrap_socket( 2026-02-24 10:06:54.700434 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket 2026-02-24 10:06:54.700523 | controller | ssl_sock = _ssl_wrap_socket_impl( 2026-02-24 10:06:54.700624 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl 2026-02-24 10:06:54.700715 | controller | return ssl_context.wrap_socket(sock, server_hostname=server_hostname) 2026-02-24 10:06:54.700808 | controller | File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket 2026-02-24 10:06:54.700901 | controller | return self.sslsocket_class._create( 2026-02-24 10:06:54.701004 | controller | File "/usr/lib64/python3.9/ssl.py", line 1076, in _create 2026-02-24 10:06:54.701082 | controller | self.do_handshake() 2026-02-24 10:06:54.701187 | controller | File "/usr/lib64/python3.9/ssl.py", line 1345, in do_handshake 2026-02-24 10:06:54.701293 | controller | self._sslobj.do_handshake() 2026-02-24 10:06:54.701398 | controller | ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147) 2026-02-24 10:06:54.701487 | controller | 2026-02-24 10:06:54.701578 | controller | During handling of the above exception, another exception occurred: 2026-02-24 10:06:54.701658 | controller | 2026-02-24 10:06:54.701758 | controller | Traceback (most recent call last): 2026-02-24 10:06:54.701849 | controller | File "/tmp/ansible-tmp-1771927613.4511588-28267-223980820410335/AnsiballZ_k8s_info.py", line 107, in 2026-02-24 10:06:54.701925 | controller | _ansiballz_main() 2026-02-24 10:06:54.702021 | controller | File "/tmp/ansible-tmp-1771927613.4511588-28267-223980820410335/AnsiballZ_k8s_info.py", line 99, in _ansiballz_main 2026-02-24 10:06:54.702116 | controller | invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS) 2026-02-24 10:06:54.702223 | controller | File "/tmp/ansible-tmp-1771927613.4511588-28267-223980820410335/AnsiballZ_k8s_info.py", line 47, in invoke_module 2026-02-24 10:06:54.702329 | controller | runpy.run_module(mod_name='ansible_collections.kubernetes.core.plugins.modules.k8s_info', init_globals=dict(_module_fqn='ansible_collections.kubernetes.core.plugins.modules.k8s_info', _modlib_path=modlib_path), 2026-02-24 10:06:54.702422 | controller | File "/usr/lib64/python3.9/runpy.py", line 225, in run_module 2026-02-24 10:06:54.702510 | controller | return _run_module_code(code, init_globals, run_name, mod_spec) 2026-02-24 10:06:54.702599 | controller | File "/usr/lib64/python3.9/runpy.py", line 97, in _run_module_code 2026-02-24 10:06:54.702686 | controller | _run_code(code, mod_globals, init_globals, 2026-02-24 10:06:54.702781 | controller | File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-24 10:06:54.702875 | controller | exec(code, run_globals) 2026-02-24 10:06:54.702969 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tjsml19c/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 229, in 2026-02-24 10:06:54.703061 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tjsml19c/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 221, in main 2026-02-24 10:06:54.703170 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tjsml19c/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 352, in get_api_client 2026-02-24 10:06:54.703260 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tjsml19c/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 246, in wrapper 2026-02-24 10:06:54.703389 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tjsml19c/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 259, in create_api_client 2026-02-24 10:06:54.703483 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 84, in __init__ 2026-02-24 10:06:54.703570 | controller | self.__discoverer = discoverer(self, cache_file) 2026-02-24 10:06:54.703657 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tjsml19c/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 190, in __init__ 2026-02-24 10:06:54.703744 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tjsml19c/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 45, in __init__ 2026-02-24 10:06:54.703835 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_tjsml19c/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 92, in __init_cache 2026-02-24 10:06:54.703919 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/discovery.py", line 146, in _load_server_info 2026-02-24 10:06:54.704007 | controller | 'kubernetes': self.client.request('get', '/version', serializer=just_json) 2026-02-24 10:06:54.704095 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-24 10:06:54.704199 | controller | resp = func(self, *args, **kwargs) 2026-02-24 10:06:54.704303 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 277, in request 2026-02-24 10:06:54.704398 | controller | api_response = self.client.call_api( 2026-02-24 10:06:54.704488 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-24 10:06:54.704574 | controller | return self.__call_api(resource_path, method, 2026-02-24 10:06:54.704662 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-24 10:06:54.704749 | controller | response_data = self.request( 2026-02-24 10:06:54.704839 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-24 10:06:54.704926 | controller | return self.rest_client.GET(url, 2026-02-24 10:06:54.705017 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-24 10:06:54.705102 | controller | return self.request("GET", url, 2026-02-24 10:06:54.705202 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 217, in request 2026-02-24 10:06:54.705305 | controller | r = self.pool_manager.request(method, url, 2026-02-24 10:06:54.705415 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 74, in request 2026-02-24 10:06:54.705565 | controller | return self.request_encode_url( 2026-02-24 10:06:54.705668 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 96, in request_encode_url 2026-02-24 10:06:54.705775 | controller | return self.urlopen(method, url, **extra_kw) 2026-02-24 10:06:54.705883 | controller | File "/usr/lib/python3.9/site-packages/urllib3/poolmanager.py", line 376, in urlopen 2026-02-24 10:06:54.705989 | controller | response = conn.urlopen(method, u.request_uri, **kw) 2026-02-24 10:06:54.706093 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-24 10:06:54.706215 | controller | return self.urlopen( 2026-02-24 10:06:54.706340 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-24 10:06:54.706479 | controller | return self.urlopen( 2026-02-24 10:06:54.706627 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-24 10:06:54.706756 | controller | return self.urlopen( 2026-02-24 10:06:54.706883 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 756, in urlopen 2026-02-24 10:06:54.707009 | controller | retries = retries.increment( 2026-02-24 10:06:54.707150 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 576, in increment 2026-02-24 10:06:54.707365 | controller | raise MaxRetryError(_pool, url, error or ResponseError(cause)) 2026-02-24 10:06:54.707524 | controller | urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-24 10:06:54.707655 | controller | msg: |- 2026-02-24 10:06:54.707782 | controller | MODULE FAILURE 2026-02-24 10:06:54.707920 | controller | See stdout/stderr for the exact error 2026-02-24 10:06:54.708048 | controller | rc: 1 2026-02-24 10:06:54.708583 | controller | 2026-02-24 10:06:54.708722 | controller | TASK [Create dnsmasq dir] ****************************************************** 2026-02-24 10:06:54.708852 | controller | Tuesday 24 February 2026 10:06:54 +0000 (0:00:01.304) 0:07:01.226 ****** 2026-02-24 10:06:54.963886 | controller | changed: [instance] 2026-02-24 10:06:54.963927 | controller | 2026-02-24 10:06:54.964165 | controller | TASK [Get journalctl in a file] ************************************************ 2026-02-24 10:06:55.218878 | controller | Tuesday 24 February 2026 10:06:54 +0000 (0:00:00.254) 0:07:01.480 ****** 2026-02-24 10:06:55.218930 | controller | changed: [instance] 2026-02-24 10:06:55.658154 | controller | 2026-02-24 10:06:55.658197 | controller | TASK [Dump journalctl output] ************************************************** 2026-02-24 10:06:55.658205 | controller | Tuesday 24 February 2026 10:06:55 +0000 (0:00:00.254) 0:07:01.735 ****** 2026-02-24 10:06:55.658217 | controller | changed: [instance] 2026-02-24 10:06:55.658243 | controller | 2026-02-24 10:06:55.658559 | controller | TASK [Copy all dnsmasq config] ************************************************* 2026-02-24 10:06:55.658598 | controller | Tuesday 24 February 2026 10:06:55 +0000 (0:00:00.439) 0:07:02.174 ****** 2026-02-24 10:06:56.235982 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-24 10:06:56.472897 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2026-02-24 10:06:56.472931 | controller | 2026-02-24 10:06:56.472939 | controller | TASK [Create log directory] **************************************************** 2026-02-24 10:06:56.472945 | controller | Tuesday 24 February 2026 10:06:56 +0000 (0:00:00.578) 0:07:02.752 ****** 2026-02-24 10:06:56.472956 | controller | changed: [instance] 2026-02-24 10:06:57.415098 | controller | 2026-02-24 10:06:57.415169 | controller | TASK [Sync logs from controller-0] ********************************************* 2026-02-24 10:06:57.415181 | controller | Tuesday 24 February 2026 10:06:56 +0000 (0:00:00.236) 0:07:02.989 ****** 2026-02-24 10:06:57.415197 | controller | changed: [instance] 2026-02-24 10:06:57.415222 | controller | 2026-02-24 10:06:57.415231 | controller | PLAY RECAP ********************************************************************* 2026-02-24 10:06:57.415239 | controller | instance : ok=541 changed=208 unreachable=0 failed=1 skipped=229 rescued=0 ignored=0 2026-02-24 10:06:57.415247 | controller | 2026-02-24 10:06:57.415254 | controller | Tuesday 24 February 2026 10:06:57 +0000 (0:00:00.938) 0:07:03.928 ****** 2026-02-24 10:06:57.415262 | controller | =============================================================================== 2026-02-24 10:06:57.415269 | controller | reproducer : Check package install status ------------------------------ 39.65s 2026-02-24 10:06:57.415295 | controller | libvirt_manager : Download base image ---------------------------------- 30.79s 2026-02-24 10:06:57.415309 | controller | ci_setup : Install needed packages ------------------------------------- 29.73s 2026-02-24 10:06:57.415327 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 26.18s 2026-02-24 10:06:57.415335 | controller | reproducer : Install collections on controller-0 ----------------------- 20.25s 2026-02-24 10:06:57.415342 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 11.36s 2026-02-24 10:06:57.415349 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 7.85s 2026-02-24 10:06:57.415356 | controller | libvirt_manager : Install packages required for using KVM --------------- 7.80s 2026-02-24 10:06:57.415363 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.40s 2026-02-24 10:06:57.415370 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.16s 2026-02-24 10:06:57.415378 | controller | ci_setup : Install openshift client ------------------------------------- 6.02s 2026-02-24 10:06:57.415385 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.24s 2026-02-24 10:06:57.415392 | controller | networking_mapper : Gather the facts ------------------------------------ 3.87s 2026-02-24 10:06:57.415399 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.65s 2026-02-24 10:06:57.415407 | controller | sushy_emulator : Install required packages ------------------------------ 3.41s 2026-02-24 10:06:57.415414 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.06s 2026-02-24 10:06:57.415421 | controller | ci_setup : Manage directories ------------------------------------------- 2.75s 2026-02-24 10:06:57.415432 | controller | reproducer : Ensure firewall service is enabled and started ------------- 2.32s 2026-02-24 10:06:57.590470 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.25s 2026-02-24 10:06:57.590505 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.17s 2026-02-24 10:06:57.590523 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2026-02-24 10:06:57.590878 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2026-02-24 10:06:57.599735 | controller | INFO Running crc_layout > cleanup 2026-02-24 10:06:57.600120 | controller | WARNING Skipping, cleanup playbook not configured. 2026-02-24 10:06:57.607563 | controller | INFO Running crc_layout > destroy 2026-02-24 10:06:57.607841 | controller | WARNING Skipping, instances are delegated. 2026-02-24 10:06:57.608136 | controller | INFO Pruning extra files from scenario ephemeral directory 2026-02-24 10:06:57.609685 | controller | INFO Writing /tmp/report.html report. 2026-02-24 10:06:57.699254 | [controller] Waiting on logger 2026-02-24 10:07:02.846231 | [controller] Waiting on logger 2026-02-24 10:07:13.275781 | [controller] Waiting on logger 2026-02-24 10:07:23.707953 | [controller] Waiting on logger 2026-02-24 10:07:27.747841 | [Zuul] Log Stream did not terminate 2026-02-24 10:07:27.749021 | controller | ERROR 2026-02-24 10:07:27.749142 | controller | { 2026-02-24 10:07:27.749177 | controller | "delta": "0:08:45.257627", 2026-02-24 10:07:27.749198 | controller | "end": "2026-02-24 10:06:57.680372", 2026-02-24 10:07:27.749217 | controller | "msg": "non-zero return code", 2026-02-24 10:07:27.749235 | controller | "rc": 1, 2026-02-24 10:07:27.749251 | controller | "start": "2026-02-24 09:58:12.422745" 2026-02-24 10:07:27.749266 | controller | } failure 2026-02-24 10:07:27.805949 | 2026-02-24 10:07:27.806050 | PLAY RECAP 2026-02-24 10:07:27.806099 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2026-02-24 10:07:27.806122 | 2026-02-24 10:07:27.904618 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-24 10:07:27.905470 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-24 10:07:28.464664 | 2026-02-24 10:07:28.464790 | PLAY [Run ci/playbooks/collect-logs.yml] 2026-02-24 10:07:28.485482 | 2026-02-24 10:07:28.485557 | TASK [Filter out host if needed] 2026-02-24 10:07:28.493624 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2026-02-24 10:07:28.497729 | 2026-02-24 10:07:28.497791 | TASK [Ensure file is present] 2026-02-24 10:07:28.946267 | controller | ok 2026-02-24 10:07:28.951905 | 2026-02-24 10:07:28.951975 | TASK [Manage molecule report file] 2026-02-24 10:07:28.972271 | [controller] Waiting on logger 2026-02-24 10:07:38.363880 | [controller] Waiting on logger 2026-02-24 10:07:47.746047 | [controller] Waiting on logger 2026-02-24 10:07:58.139997 | [controller] Waiting on logger 2026-02-24 10:07:59.400548 | [Zuul] Log Stream did not terminate 2026-02-24 10:07:59.400953 | controller | changed 2026-02-24 10:07:59.409958 | 2026-02-24 10:07:59.410026 | TASK [Check if we get ci-framework-data basedir] 2026-02-24 10:07:59.695996 | controller | ok 2026-02-24 10:07:59.701406 | 2026-02-24 10:07:59.701476 | TASK [Create ci-framework-data log directory for zuul] 2026-02-24 10:08:00.098952 | controller | changed 2026-02-24 10:08:00.105397 | 2026-02-24 10:08:00.105508 | TASK [Copy ci-framework interesting files] 2026-02-24 10:08:00.125279 | [controller] Waiting on logger 2026-02-24 10:08:10.556015 | [controller] Waiting on logger 2026-02-24 10:08:19.900668 | [controller] Waiting on logger 2026-02-24 10:08:30.332607 | [controller] Waiting on logger 2026-02-24 10:08:30.428744 | [Zuul] Log Stream did not terminate 2026-02-24 10:08:30.431850 | controller | changed 2026-02-24 10:08:30.443761 | 2026-02-24 10:08:30.443857 | TASK [Get SELinux listing] 2026-02-24 10:08:35.473553 | controller | changed 2026-02-24 10:08:35.483288 | 2026-02-24 10:08:35.483398 | TASK [Generate log index] 2026-02-24 10:08:36.807433 | controller | changed 2026-02-24 10:08:36.812397 | 2026-02-24 10:08:36.812467 | TASK [Get some env related data] 2026-02-24 10:08:36.833509 | [controller] Waiting on logger 2026-02-24 10:08:47.227892 | [controller] Waiting on logger 2026-02-24 10:08:57.660256 | [controller] Waiting on logger 2026-02-24 10:09:07.003852 | [controller] Waiting on logger 2026-02-24 10:09:08.076671 | [Zuul] Log Stream did not terminate 2026-02-24 10:09:08.077016 | controller | changed 2026-02-24 10:09:08.113686 | 2026-02-24 10:09:08.113791 | TASK [Generate list of logs to collect in home directory] 2026-02-24 10:09:08.457366 | controller | ok: All paths examined 2026-02-24 10:09:08.462757 | 2026-02-24 10:09:08.462837 | LOOP [Copy logs from home directory] 2026-02-24 10:09:09.048658 | controller | changed: 2026-02-24 10:09:09.049164 | controller | { 2026-02-24 10:09:09.049208 | controller | "atime": 1743544925.4788878, 2026-02-24 10:09:09.049230 | controller | "ctime": 1743545329.1409318, 2026-02-24 10:09:09.049247 | controller | "dev": 64513, 2026-02-24 10:09:09.049264 | controller | "gid": 1000, 2026-02-24 10:09:09.049279 | controller | "gr_name": "zuul", 2026-02-24 10:09:09.049319 | controller | "inode": 4518807, 2026-02-24 10:09:09.049352 | controller | "isblk": false, 2026-02-24 10:09:09.049370 | controller | "ischr": false, 2026-02-24 10:09:09.049386 | controller | "isdir": false, 2026-02-24 10:09:09.049401 | controller | "isfifo": false, 2026-02-24 10:09:09.049416 | controller | "isgid": false, 2026-02-24 10:09:09.049430 | controller | "islnk": false, 2026-02-24 10:09:09.049444 | controller | "isreg": true, 2026-02-24 10:09:09.049459 | controller | "issock": false, 2026-02-24 10:09:09.049475 | controller | "isuid": false, 2026-02-24 10:09:09.049490 | controller | "mode": "0644", 2026-02-24 10:09:09.049504 | controller | "mtime": 1743545329.1409318, 2026-02-24 10:09:09.049517 | controller | "nlink": 1, 2026-02-24 10:09:09.049531 | controller | "path": "/home/zuul/crc-setup.log", 2026-02-24 10:09:09.049545 | controller | "pw_name": "zuul", 2026-02-24 10:09:09.049559 | controller | "rgrp": true, 2026-02-24 10:09:09.049574 | controller | "roth": true, 2026-02-24 10:09:09.049588 | controller | "rusr": true, 2026-02-24 10:09:09.049601 | controller | "size": 4108, 2026-02-24 10:09:09.049615 | controller | "uid": 1000, 2026-02-24 10:09:09.049629 | controller | "wgrp": false, 2026-02-24 10:09:09.049642 | controller | "woth": false, 2026-02-24 10:09:09.049655 | controller | "wusr": true, 2026-02-24 10:09:09.049668 | controller | "xgrp": false, 2026-02-24 10:09:09.049681 | controller | "xoth": false, 2026-02-24 10:09:09.049694 | controller | "xusr": false 2026-02-24 10:09:09.049706 | controller | } 2026-02-24 10:09:09.625192 | controller | changed: 2026-02-24 10:09:09.625351 | controller | { 2026-02-24 10:09:09.625381 | controller | "atime": 1743545331.0429637, 2026-02-24 10:09:09.625400 | controller | "ctime": 1743545842.0111232, 2026-02-24 10:09:09.625416 | controller | "dev": 64513, 2026-02-24 10:09:09.625439 | controller | "gid": 1000, 2026-02-24 10:09:09.625568 | controller | "gr_name": "zuul", 2026-02-24 10:09:09.625593 | controller | "inode": 4194437, 2026-02-24 10:09:09.625609 | controller | "isblk": false, 2026-02-24 10:09:09.625625 | controller | "ischr": false, 2026-02-24 10:09:09.625641 | controller | "isdir": false, 2026-02-24 10:09:09.625656 | controller | "isfifo": false, 2026-02-24 10:09:09.625671 | controller | "isgid": false, 2026-02-24 10:09:09.625686 | controller | "islnk": false, 2026-02-24 10:09:09.625701 | controller | "isreg": true, 2026-02-24 10:09:09.625715 | controller | "issock": false, 2026-02-24 10:09:09.625729 | controller | "isuid": false, 2026-02-24 10:09:09.625742 | controller | "mode": "0644", 2026-02-24 10:09:09.625756 | controller | "mtime": 1743545842.0111232, 2026-02-24 10:09:09.625771 | controller | "nlink": 1, 2026-02-24 10:09:09.625786 | controller | "path": "/home/zuul/crc-start.log", 2026-02-24 10:09:09.625799 | controller | "pw_name": "zuul", 2026-02-24 10:09:09.625812 | controller | "rgrp": true, 2026-02-24 10:09:09.625841 | controller | "roth": true, 2026-02-24 10:09:09.625855 | controller | "rusr": true, 2026-02-24 10:09:09.625869 | controller | "size": 4023, 2026-02-24 10:09:09.628082 | controller | "uid": 1000, 2026-02-24 10:09:09.628125 | controller | "wgrp": false, 2026-02-24 10:09:09.628146 | controller | "woth": false, 2026-02-24 10:09:09.628162 | controller | "wusr": true, 2026-02-24 10:09:09.628177 | controller | "xgrp": false, 2026-02-24 10:09:09.628193 | controller | "xoth": false, 2026-02-24 10:09:09.628208 | controller | "xusr": false 2026-02-24 10:09:09.628223 | controller | } 2026-02-24 10:09:10.180665 | controller | changed: 2026-02-24 10:09:10.180798 | controller | { 2026-02-24 10:09:10.180835 | controller | "atime": 1771927073.953547, 2026-02-24 10:09:10.180855 | controller | "ctime": 1771927089.905655, 2026-02-24 10:09:10.180873 | controller | "dev": 64513, 2026-02-24 10:09:10.180889 | controller | "gid": 1000, 2026-02-24 10:09:10.180905 | controller | "gr_name": "zuul", 2026-02-24 10:09:10.180922 | controller | "inode": 4340275, 2026-02-24 10:09:10.180938 | controller | "isblk": false, 2026-02-24 10:09:10.180953 | controller | "ischr": false, 2026-02-24 10:09:10.180968 | controller | "isdir": false, 2026-02-24 10:09:10.180984 | controller | "isfifo": false, 2026-02-24 10:09:10.180999 | controller | "isgid": false, 2026-02-24 10:09:10.181015 | controller | "islnk": false, 2026-02-24 10:09:10.181031 | controller | "isreg": true, 2026-02-24 10:09:10.181046 | controller | "issock": false, 2026-02-24 10:09:10.181061 | controller | "isuid": false, 2026-02-24 10:09:10.181076 | controller | "mode": "0644", 2026-02-24 10:09:10.181090 | controller | "mtime": 1771927089.905655, 2026-02-24 10:09:10.181104 | controller | "nlink": 1, 2026-02-24 10:09:10.181117 | controller | "path": "/home/zuul/ansible.log", 2026-02-24 10:09:10.181131 | controller | "pw_name": "zuul", 2026-02-24 10:09:10.181145 | controller | "rgrp": true, 2026-02-24 10:09:10.181160 | controller | "roth": true, 2026-02-24 10:09:10.181175 | controller | "rusr": true, 2026-02-24 10:09:10.181191 | controller | "size": 6749, 2026-02-24 10:09:10.181205 | controller | "uid": 1000, 2026-02-24 10:09:10.181219 | controller | "wgrp": false, 2026-02-24 10:09:10.181233 | controller | "woth": false, 2026-02-24 10:09:10.181247 | controller | "wusr": true, 2026-02-24 10:09:10.181260 | controller | "xgrp": false, 2026-02-24 10:09:10.181274 | controller | "xoth": false, 2026-02-24 10:09:10.181288 | controller | "xusr": false 2026-02-24 10:09:10.181386 | controller | } 2026-02-24 10:09:10.193869 | 2026-02-24 10:09:10.194023 | TASK [Copy crio stats log file] 2026-02-24 10:09:10.220925 | controller | skipping: Conditional result was False 2026-02-24 10:09:10.226678 | 2026-02-24 10:09:10.226747 | TASK [Get SELinux related data] 2026-02-24 10:09:10.247992 | [controller] Waiting on logger 2026-02-24 10:09:20.636107 | [controller] Waiting on logger 2026-02-24 10:09:29.980569 | [controller] Waiting on logger 2026-02-24 10:09:40.412089 | [controller] Waiting on logger 2026-02-24 10:09:40.532554 | [Zuul] Log Stream did not terminate 2026-02-24 10:09:40.533065 | controller | ERROR 2026-02-24 10:09:40.533241 | controller | { 2026-02-24 10:09:40.533290 | controller | "delta": "0:00:00.010684", 2026-02-24 10:09:40.533375 | controller | "end": "2026-02-24 10:09:10.506278", 2026-02-24 10:09:40.533408 | controller | "msg": "non-zero return code", 2026-02-24 10:09:40.533434 | controller | "rc": 1, 2026-02-24 10:09:40.533462 | controller | "start": "2026-02-24 10:09:10.495594" 2026-02-24 10:09:40.533489 | controller | } 2026-02-24 10:09:40.533525 | controller | ERROR: Ignoring Errors 2026-02-24 10:09:40.539246 | 2026-02-24 10:09:40.539329 | TASK [Create system configuration directory] 2026-02-24 10:09:40.806056 | controller | changed 2026-02-24 10:09:40.811072 | 2026-02-24 10:09:40.811144 | TASK [Get some of the system configurations] 2026-02-24 10:09:40.831388 | [controller] Waiting on logger 2026-02-24 10:09:51.228135 | [controller] Waiting on logger 2026-02-24 10:10:01.660012 | [controller] Waiting on logger 2026-02-24 10:10:11.004751 | [controller] Waiting on logger 2026-02-24 10:10:11.126378 | [Zuul] Log Stream did not terminate 2026-02-24 10:10:11.126509 | controller | changed 2026-02-24 10:10:11.132006 | 2026-02-24 10:10:11.132073 | TASK [Copy generated documentation if available] 2026-02-24 10:10:11.157035 | controller | skipping: Conditional result was False 2026-02-24 10:10:11.162723 | 2026-02-24 10:10:11.162790 | TASK [Copy generated AsciiDoc documentation if available] 2026-02-24 10:10:11.186502 | controller | skipping: Conditional result was False 2026-02-24 10:10:11.192001 | 2026-02-24 10:10:11.192063 | TASK [Compress logs bigger than 2MB] 2026-02-24 10:10:14.267900 | [controller] Waiting on logger 2026-02-24 10:10:20.529571 | controller | changed 2026-02-24 10:10:20.537082 | 2026-02-24 10:10:20.537148 | TASK [Copy files from workspace on node] 2026-02-24 10:10:20.559820 | controller | ok 2026-02-24 10:10:20.581155 | 2026-02-24 10:10:20.581225 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-24 10:10:20.595504 | controller | skipping: Conditional result was False 2026-02-24 10:10:20.600643 | 2026-02-24 10:10:20.600718 | TASK [fetch-output : Set log path for single node] 2026-02-24 10:10:20.628527 | controller | ok 2026-02-24 10:10:20.632919 | 2026-02-24 10:10:20.632983 | LOOP [fetch-output : Ensure local output dirs] 2026-02-24 10:10:20.841274 | controller -> localhost | ok: "/var/lib/zuul/builds/422af7b92dbd4d6b8a8ec07cb165d671/work/logs" 2026-02-24 10:10:20.841625 | controller -> localhost | changed: All items complete 2026-02-24 10:10:20.841655 | 2026-02-24 10:10:21.025258 | controller -> localhost | changed: "/var/lib/zuul/builds/422af7b92dbd4d6b8a8ec07cb165d671/work/artifacts" 2026-02-24 10:10:21.208320 | controller -> localhost | changed: "/var/lib/zuul/builds/422af7b92dbd4d6b8a8ec07cb165d671/work/docs" 2026-02-24 10:10:21.222781 | 2026-02-24 10:10:21.222919 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-24 10:10:21.943071 | controller | changed: 2026-02-24 10:10:21.943340 | controller | .d..t...... ./ 2026-02-24 10:10:21.943376 | controller | >f+++++++++ README.html 2026-02-24 10:10:21.943399 | controller | >f+++++++++ ansible-execution.log 2026-02-24 10:10:21.943419 | controller | >f+++++++++ ansible.log 2026-02-24 10:10:21.943436 | controller | >f+++++++++ crc-setup.log 2026-02-24 10:10:21.943452 | controller | >f+++++++++ crc-start.log 2026-02-24 10:10:21.943467 | controller | >f+++++++++ dmesg.log 2026-02-24 10:10:21.943482 | controller | >f+++++++++ installed-pkgs.log 2026-02-24 10:10:21.943496 | controller | >f+++++++++ python.log 2026-02-24 10:10:21.943510 | controller | >f+++++++++ registries.conf 2026-02-24 10:10:21.943524 | controller | >f+++++++++ report.html 2026-02-24 10:10:21.943538 | controller | >f+++++++++ selinux-denials.log 2026-02-24 10:10:21.943557 | controller | >f+++++++++ selinux-listing.log 2026-02-24 10:10:21.943571 | controller | cd+++++++++ ci-framework-data/ 2026-02-24 10:10:21.943586 | controller | cd+++++++++ ci-framework-data/artifacts/ 2026-02-24 10:10:21.943600 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2026-02-24 10:10:21.943613 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2026-02-24 10:10:21.943627 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2026-02-24 10:10:21.943640 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2026-02-24 10:10:21.943654 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2026-02-24 10:10:21.943669 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2026-02-24 10:10:21.943683 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2026-02-24 10:10:21.943710 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2026-02-24 10:10:21.943727 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2026-02-24 10:10:21.943742 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2026-02-24 10:10:21.943757 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2026-02-24 10:10:21.943771 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2026-02-24 10:10:21.943786 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2026-02-24 10:10:21.943800 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:b2:e7:2c 2026-02-24 10:10:21.943814 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:b0:80:ba 2026-02-24 10:10:21.943828 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:4b:6f:8b 2026-02-24 10:10:21.943842 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:17:3a:dd 2026-02-24 10:10:21.943857 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:82:fa:dc 2026-02-24 10:10:21.943872 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:74:18:31 2026-02-24 10:10:21.943886 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2026-02-24 10:10:21.943901 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2026-02-24 10:10:21.943915 | controller | cd+++++++++ ci-framework-data/logs/ 2026-02-24 10:10:21.943930 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2026-02-24 10:10:21.943944 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2026-02-24 10:10:21.943958 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2026-02-24 10:10:21.943972 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2026-02-24 10:10:21.943987 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2026-02-24 10:10:21.944002 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2026-02-24 10:10:21.944018 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2026-02-24 10:10:21.944034 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2026-02-24 10:10:21.944052 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2026-02-24 10:10:21.944069 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2026-02-24 10:10:21.944084 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2026-02-24 10:10:21.944099 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2026-02-24 10:10:21.944118 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2026-02-24 10:10:21.944135 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2026-02-24 10:10:21.944150 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2026-02-24 10:10:21.944166 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2026-02-24 10:10:21.944181 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2026-02-24 10:10:21.944195 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2026-02-24 10:10:21.944210 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2026-02-24 10:10:21.944225 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2026-02-24 10:10:21.944239 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2026-02-24 10:10:21.944254 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2026-02-24 10:10:21.944269 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2026-02-24 10:10:21.944284 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2026-02-24 10:10:21.944335 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2026-02-24 10:10:21.944358 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2026-02-24 10:10:21.944376 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2026-02-24 10:10:21.944393 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2026-02-24 10:10:21.944409 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2026-02-24 10:10:21.944425 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2026-02-24 10:10:21.944442 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2026-02-24 10:10:21.944457 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2026-02-24 10:10:21.944473 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2026-02-24 10:10:21.944488 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2026-02-24 10:10:21.944503 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2026-02-24 10:10:21.944518 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2026-02-24 10:10:21.944533 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2026-02-24 10:10:21.944548 | controller | cd+++++++++ registries.conf.d/ 2026-02-24 10:10:21.944563 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2026-02-24 10:10:21.944578 | controller | cd+++++++++ system-config/ 2026-02-24 10:10:21.944593 | controller | cd+++++++++ system-config/libvirt/ 2026-02-24 10:10:21.944607 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2026-02-24 10:10:21.944622 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2026-02-24 10:10:21.944637 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2026-02-24 10:10:21.944655 | controller | >f+++++++++ system-config/libvirt/network.conf 2026-02-24 10:10:21.944671 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2026-02-24 10:10:21.944687 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2026-02-24 10:10:21.944715 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2026-02-24 10:10:21.944732 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2026-02-24 10:10:21.944747 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2026-02-24 10:10:21.944762 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2026-02-24 10:10:21.944777 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2026-02-24 10:10:21.944791 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2026-02-24 10:10:21.944805 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2026-02-24 10:10:21.944819 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2026-02-24 10:10:21.944833 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2026-02-24 10:10:21.944847 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2026-02-24 10:10:22.438584 | controller | changed: .d..t...... ./ 2026-02-24 10:10:22.917228 | controller | changed: .d..t...... ./ 2026-02-24 10:10:22.931562 | 2026-02-24 10:10:22.931717 | TASK [Return artifact to Zuul] 2026-02-24 10:10:22.961184 | controller | ok 2026-02-24 10:10:22.980222 | 2026-02-24 10:10:22.980290 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2026-02-24 10:10:22.980463 | 2026-02-24 10:10:22.980494 | PLAY RECAP 2026-02-24 10:10:22.980543 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2026-02-24 10:10:22.980565 | 2026-02-24 10:10:23.085223 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-24 10:10:23.086450 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-24 10:10:23.593134 | 2026-02-24 10:10:23.593286 | PLAY [all] 2026-02-24 10:10:23.612265 | 2026-02-24 10:10:23.612362 | TASK [include_role : fetch-output] 2026-02-24 10:10:23.641712 | controller | ok 2026-02-24 10:10:23.658003 | 2026-02-24 10:10:23.658088 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-24 10:10:23.703008 | controller | skipping: Conditional result was False 2026-02-24 10:10:23.708498 | 2026-02-24 10:10:23.708565 | TASK [fetch-output : Set log path for single node] 2026-02-24 10:10:23.736616 | controller | ok 2026-02-24 10:10:23.741228 | 2026-02-24 10:10:23.741309 | LOOP [fetch-output : Ensure local output dirs] 2026-02-24 10:10:24.090242 | controller -> localhost | ok: "/var/lib/zuul/builds/422af7b92dbd4d6b8a8ec07cb165d671/work/logs" 2026-02-24 10:10:24.272133 | controller -> localhost | ok: "/var/lib/zuul/builds/422af7b92dbd4d6b8a8ec07cb165d671/work/artifacts" 2026-02-24 10:10:24.454782 | controller -> localhost | ok: "/var/lib/zuul/builds/422af7b92dbd4d6b8a8ec07cb165d671/work/docs" 2026-02-24 10:10:24.464426 | 2026-02-24 10:10:24.464567 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-24 10:10:25.119123 | controller | ok 2026-02-24 10:10:25.119411 | controller | ok: All items complete 2026-02-24 10:10:25.119447 | 2026-02-24 10:10:25.588285 | controller | ok 2026-02-24 10:10:26.071898 | controller | ok 2026-02-24 10:10:26.083518 | 2026-02-24 10:10:26.083651 | TASK [include_role : fetch-output-openshift] 2026-02-24 10:10:26.097570 | controller | skipping: Conditional result was False 2026-02-24 10:10:26.103410 | 2026-02-24 10:10:26.103478 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-02-24 10:10:26.458830 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.008867 2026-02-24 10:10:26.646842 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.007163 2026-02-24 10:10:26.680874 | 2026-02-24 10:10:26.680988 | PLAY [all] 2026-02-24 10:10:26.695069 | 2026-02-24 10:10:26.695142 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-02-24 10:10:27.214573 | controller | changed 2026-02-24 10:10:27.235823 | 2026-02-24 10:10:27.235877 | PLAY RECAP 2026-02-24 10:10:27.235925 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-02-24 10:10:27.235946 | 2026-02-24 10:10:27.323854 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-24 10:10:27.324729 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2026-02-24 10:10:27.904990 | 2026-02-24 10:10:27.905130 | PLAY [localhost] 2026-02-24 10:10:27.922805 | 2026-02-24 10:10:27.922887 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-02-24 10:10:28.248274 | localhost | changed 2026-02-24 10:10:28.252601 | 2026-02-24 10:10:28.252674 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-02-24 10:10:28.281312 | localhost | ok 2026-02-24 10:10:28.288720 | 2026-02-24 10:10:28.288789 | TASK [add-fileserver : Create SSH private key tempfile] 2026-02-24 10:10:28.590469 | localhost | changed 2026-02-24 10:10:28.603506 | 2026-02-24 10:10:28.604043 | TASK [add-fileserver : Create SSH private key from secret] 2026-02-24 10:10:29.139366 | localhost | changed 2026-02-24 10:10:29.144349 | 2026-02-24 10:10:29.144438 | TASK [add-fileserver : Add fileserver ssh key] 2026-02-24 10:10:29.476662 | localhost | Identity added: /var/lib/zuul/builds/422af7b92dbd4d6b8a8ec07cb165d671/work/tmp/ansible.zamdudvj (/var/lib/zuul/builds/422af7b92dbd4d6b8a8ec07cb165d671/work/tmp/ansible.zamdudvj) 2026-02-24 10:10:29.476862 | localhost | ok: Runtime: 0:00:00.006578 2026-02-24 10:10:29.480799 | 2026-02-24 10:10:29.480863 | TASK [add-fileserver : Remove SSH private key from disk] 2026-02-24 10:10:29.711790 | localhost | ok: Runtime: 0:00:00.005436 2026-02-24 10:10:29.716834 | 2026-02-24 10:10:29.716920 | TASK [add-fileserver : Add fileserver to inventory] 2026-02-24 10:10:29.766207 | localhost | changed 2026-02-24 10:10:29.771105 | 2026-02-24 10:10:29.771175 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-02-24 10:10:30.093230 | localhost | changed 2026-02-24 10:10:30.112241 | 2026-02-24 10:10:30.112355 | PLAY [localhost] 2026-02-24 10:10:30.123721 | 2026-02-24 10:10:30.123789 | TASK [Generate bulk log download script] 2026-02-24 10:10:30.143023 | localhost | ok 2026-02-24 10:10:30.154521 | 2026-02-24 10:10:30.154597 | TASK [local-log-download : Check API endpoint is defined] 2026-02-24 10:10:30.183276 | localhost | ok: All assertions passed 2026-02-24 10:10:30.187902 | 2026-02-24 10:10:30.187971 | TASK [local-log-download : Create download script] 2026-02-24 10:10:30.531164 | localhost -> localhost | changed 2026-02-24 10:10:30.540158 | 2026-02-24 10:10:30.540218 | TASK [Register quick-download link] 2026-02-24 10:10:30.568233 | localhost | ok 2026-02-24 10:10:30.612116 | 2026-02-24 10:10:30.612202 | PLAY [logserver.rdoproject.org] 2026-02-24 10:10:30.620623 | 2026-02-24 10:10:30.620688 | TASK [Set zuul-log-path fact] 2026-02-24 10:10:30.637425 | logserver.rdoproject.org | ok 2026-02-24 10:10:30.646043 | 2026-02-24 10:10:30.646104 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-24 10:10:30.672708 | logserver.rdoproject.org | ok 2026-02-24 10:10:30.678019 | 2026-02-24 10:10:30.678080 | TASK [upload-logs : Create log directories] 2026-02-24 10:10:32.444954 | logserver.rdoproject.org | changed 2026-02-24 10:10:32.447927 | 2026-02-24 10:10:32.447990 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-02-24 10:10:32.675847 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.006849 2026-02-24 10:10:32.680870 | 2026-02-24 10:10:32.680935 | TASK [upload-logs : Upload logs to log server] 2026-02-24 10:10:34.298892 | logserver.rdoproject.org | Output suppressed because no_log was given 2026-02-24 10:10:34.301877 | 2026-02-24 10:10:34.301941 | LOOP [upload-logs : Compress console log and json output] 2026-02-24 10:10:34.338449 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 10:10:34.346192 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 10:10:34.360154 | 2026-02-24 10:10:34.360276 | LOOP [upload-logs : Upload compressed console log and json output] 2026-02-24 10:10:34.399716 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 10:10:34.399969 | 2026-02-24 10:10:34.402496 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 10:10:34.407784 | 2026-02-24 10:10:34.407896 | LOOP [upload-logs : Upload console log and json output]