2026-03-19 12:41:48.342137 | Job console starting... 2026-03-19 12:41:48.548173 | Updating repositories 2026-03-19 12:41:49.275590 | Preparing job workspace 2026-03-19 12:41:56.056202 | Running Ansible setup... 2026-03-19 12:41:59.618442 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-03-19 12:42:00.105103 | 2026-03-19 12:42:00.105196 | PLAY [localhost] 2026-03-19 12:42:00.113479 | 2026-03-19 12:42:00.113548 | TASK [Gathering Facts] 2026-03-19 12:42:00.909060 | localhost | ok 2026-03-19 12:42:00.921888 | 2026-03-19 12:42:00.921973 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-19 12:42:01.234541 | localhost -> localhost | changed 2026-03-19 12:42:01.240646 | 2026-03-19 12:42:01.240720 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-19 12:42:01.923161 | localhost -> localhost | changed 2026-03-19 12:42:01.930806 | 2026-03-19 12:42:01.930872 | TASK [Setup log path fact] 2026-03-19 12:42:01.947692 | localhost | ok 2026-03-19 12:42:01.958459 | 2026-03-19 12:42:01.958525 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-19 12:42:01.975106 | localhost | ok 2026-03-19 12:42:01.981724 | 2026-03-19 12:42:01.981784 | TASK [emit-job-header : Print job information] 2026-03-19 12:42:02.008208 | # Job Information 2026-03-19 12:42:02.008394 | Ansible Version: 2.15.12 2026-03-19 12:42:02.008426 | Job: cifmw-molecule-reproducer 2026-03-19 12:42:02.008448 | Pipeline: github-check 2026-03-19 12:42:02.008468 | Executor: ibm-bm3-ze.softwarefactory-project.io 2026-03-19 12:42:02.008487 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3739 2026-03-19 12:42:02.008506 | Log URL (when completed): https://logserver.rdoproject.org/582/rdoproject.org/5820d139e9b0497ab73bcf6b4c79d223/ 2026-03-19 12:42:02.008525 | Event ID: d7daf5b0-2390-11f1-8b40-66c1dfe8887a 2026-03-19 12:42:02.012369 | 2026-03-19 12:42:02.012441 | LOOP [emit-job-header : Print node information] 2026-03-19 12:42:02.098823 | localhost | ok: 2026-03-19 12:42:02.098969 | localhost | # Node Information 2026-03-19 12:42:02.098998 | localhost | Inventory Hostname: controller 2026-03-19 12:42:02.099022 | localhost | Hostname: np0005651930 2026-03-19 12:42:02.099043 | localhost | Username: zuul 2026-03-19 12:42:02.099063 | localhost | Distro: CentOS 9 2026-03-19 12:42:02.099080 | localhost | Provider: ibm-bm3-nodepool 2026-03-19 12:42:02.099097 | localhost | Region: regionOne 2026-03-19 12:42:02.099113 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2026-03-19 12:42:02.099131 | localhost | Product Name: OpenStack Compute 2026-03-19 12:42:02.099149 | localhost | Interface IP: 192.168.25.191 2026-03-19 12:42:02.120215 | 2026-03-19 12:42:02.120290 | PLAY [all] 2026-03-19 12:42:02.126445 | 2026-03-19 12:42:02.126504 | TASK [Gather network facts] 2026-03-19 12:42:02.570014 | controller | ok 2026-03-19 12:42:02.583550 | 2026-03-19 12:42:02.583613 | TASK [include_role : start-zuul-console] 2026-03-19 12:42:02.601600 | controller | ok 2026-03-19 12:42:02.612696 | 2026-03-19 12:42:02.612758 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-03-19 12:42:03.004915 | controller | ok 2026-03-19 12:42:03.013240 | 2026-03-19 12:42:03.013317 | TASK [include_role : add-build-sshkey] 2026-03-19 12:42:03.042547 | controller | ok 2026-03-19 12:42:03.056702 | 2026-03-19 12:42:03.056763 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-19 12:42:03.251927 | controller -> localhost | ok 2026-03-19 12:42:03.257288 | 2026-03-19 12:42:03.257356 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-19 12:42:03.275809 | controller | ok 2026-03-19 12:42:03.287954 | controller | included: /var/lib/zuul/builds/5820d139e9b0497ab73bcf6b4c79d223/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-19 12:42:03.293346 | 2026-03-19 12:42:03.293471 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-19 12:42:03.771710 | controller -> localhost | Generating public/private rsa key pair. 2026-03-19 12:42:03.771885 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/5820d139e9b0497ab73bcf6b4c79d223/work/5820d139e9b0497ab73bcf6b4c79d223_id_rsa. 2026-03-19 12:42:03.771918 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/5820d139e9b0497ab73bcf6b4c79d223/work/5820d139e9b0497ab73bcf6b4c79d223_id_rsa.pub. 2026-03-19 12:42:03.771942 | controller -> localhost | The key fingerprint is: 2026-03-19 12:42:03.771962 | controller -> localhost | SHA256:4cD4eNcuKKuS2pFiCauTpRqbrMVGxlPB8tokkNrdM6A zuul-build-sshkey 2026-03-19 12:42:03.771980 | controller -> localhost | The key's randomart image is: 2026-03-19 12:42:03.771998 | controller -> localhost | +---[RSA 3072]----+ 2026-03-19 12:42:03.772016 | controller -> localhost | | . .. | 2026-03-19 12:42:03.772034 | controller -> localhost | |o . o+ | 2026-03-19 12:42:03.772052 | controller -> localhost | |.o =ooo . | 2026-03-19 12:42:03.772069 | controller -> localhost | |..E.+o+o o | 2026-03-19 12:42:03.772086 | controller -> localhost | |. ==. ooS . | 2026-03-19 12:42:03.772102 | controller -> localhost | |.=+o.. o . | 2026-03-19 12:42:03.772118 | controller -> localhost | |+B* . . . . | 2026-03-19 12:42:03.772135 | controller -> localhost | |XO . o . | 2026-03-19 12:42:03.772151 | controller -> localhost | |@+o.. | 2026-03-19 12:42:03.772167 | controller -> localhost | +----[SHA256]-----+ 2026-03-19 12:42:03.772212 | controller -> localhost | ok: Runtime: 0:00:00.162819 2026-03-19 12:42:03.777513 | 2026-03-19 12:42:03.777580 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-19 12:42:03.795564 | controller | ok 2026-03-19 12:42:03.804531 | controller | included: /var/lib/zuul/builds/5820d139e9b0497ab73bcf6b4c79d223/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-19 12:42:03.812010 | 2026-03-19 12:42:03.812076 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-19 12:42:03.826177 | controller | skipping: Conditional result was False 2026-03-19 12:42:03.831545 | 2026-03-19 12:42:03.831611 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-19 12:42:04.315832 | controller | changed 2026-03-19 12:42:04.320568 | 2026-03-19 12:42:04.320638 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-19 12:42:04.591368 | controller | ok 2026-03-19 12:42:04.596165 | 2026-03-19 12:42:04.596232 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-19 12:42:05.793925 | controller | changed 2026-03-19 12:42:05.818179 | 2026-03-19 12:42:05.818249 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-19 12:42:07.049661 | controller | changed 2026-03-19 12:42:07.054585 | 2026-03-19 12:42:07.054660 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-19 12:42:07.068188 | controller | skipping: Conditional result was False 2026-03-19 12:42:07.073671 | 2026-03-19 12:42:07.073743 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-19 12:42:07.359912 | controller -> localhost | changed 2026-03-19 12:42:07.368955 | 2026-03-19 12:42:07.369015 | TASK [add-build-sshkey : Add back temp key] 2026-03-19 12:42:07.584503 | controller -> localhost | Identity added: /var/lib/zuul/builds/5820d139e9b0497ab73bcf6b4c79d223/work/5820d139e9b0497ab73bcf6b4c79d223_id_rsa (zuul-build-sshkey) 2026-03-19 12:42:07.584642 | controller -> localhost | ok: Runtime: 0:00:00.006224 2026-03-19 12:42:07.589499 | 2026-03-19 12:42:07.589557 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-19 12:42:07.973579 | controller | ok 2026-03-19 12:42:07.977696 | 2026-03-19 12:42:07.977755 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-19 12:42:08.001558 | controller | skipping: Conditional result was False 2026-03-19 12:42:08.009384 | 2026-03-19 12:42:08.009442 | TASK [include_role : validate-host] 2026-03-19 12:42:08.026679 | controller | ok 2026-03-19 12:42:08.044914 | 2026-03-19 12:42:08.044980 | TASK [validate-host : Define zuul_info_dir fact] 2026-03-19 12:42:08.072260 | controller | ok 2026-03-19 12:42:08.076588 | 2026-03-19 12:42:08.076649 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-03-19 12:42:08.276597 | controller -> localhost | ok 2026-03-19 12:42:08.282215 | 2026-03-19 12:42:08.282294 | TASK [validate-host : Collect information about the host] 2026-03-19 12:42:09.024990 | controller | ok 2026-03-19 12:42:09.033932 | 2026-03-19 12:42:09.034046 | TASK [validate-host : Sanitize hostname] 2026-03-19 12:42:09.072231 | controller | ok 2026-03-19 12:42:09.077018 | 2026-03-19 12:42:09.077083 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-03-19 12:42:09.424751 | controller -> localhost | changed 2026-03-19 12:42:09.430380 | 2026-03-19 12:42:09.430462 | TASK [validate-host : Collect information about zuul worker] 2026-03-19 12:42:09.840219 | controller | ok 2026-03-19 12:42:09.844848 | 2026-03-19 12:42:09.844922 | TASK [validate-host : Write out all zuul information for each host] 2026-03-19 12:42:10.202082 | controller -> localhost | changed 2026-03-19 12:42:10.211047 | 2026-03-19 12:42:10.211113 | TASK [include_role : prepare-workspace-openshift] 2026-03-19 12:42:10.224336 | controller | skipping: Conditional result was False 2026-03-19 12:42:10.228916 | 2026-03-19 12:42:10.228975 | TASK [include_role : remove-zuul-sshkey] 2026-03-19 12:42:10.241848 | controller | skipping: Conditional result was False 2026-03-19 12:42:10.246554 | 2026-03-19 12:42:10.246616 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-19 12:42:10.532557 | controller | ok: "logs" 2026-03-19 12:42:10.532756 | controller | ok: All items complete 2026-03-19 12:42:10.532785 | 2026-03-19 12:42:10.789136 | controller | ok: "artifacts" 2026-03-19 12:42:11.037138 | controller | ok: "docs" 2026-03-19 12:42:11.052539 | 2026-03-19 12:42:11.052717 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-19 12:42:11.347599 | controller | changed: "logs" 2026-03-19 12:42:11.628566 | controller | changed: "artifacts" 2026-03-19 12:42:11.871939 | controller | changed: "docs" 2026-03-19 12:42:11.911944 | 2026-03-19 12:42:11.912043 | PLAY RECAP 2026-03-19 12:42:11.912092 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-03-19 12:42:11.912123 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-19 12:42:11.912144 | 2026-03-19 12:42:11.997084 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-03-19 12:42:11.997892 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-03-19 12:42:12.537785 | 2026-03-19 12:42:12.537878 | PLAY [all] 2026-03-19 12:42:12.556329 | 2026-03-19 12:42:12.556434 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-03-19 12:42:12.604716 | controller | ok 2026-03-19 12:42:12.609387 | 2026-03-19 12:42:12.609463 | TASK [mirror-info-fork : Create /etc/ci] 2026-03-19 12:42:13.054581 | controller | changed 2026-03-19 12:42:13.060423 | 2026-03-19 12:42:13.060498 | TASK [mirror-info-fork : Install ci_mirror script] 2026-03-19 12:42:14.434729 | controller | changed 2026-03-19 12:42:14.446182 | 2026-03-19 12:42:14.446304 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2026-03-19 12:42:14.913179 | controller | changed: 2026-03-19 12:42:14.913361 | controller | { 2026-03-19 12:42:14.913405 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2026-03-19 12:42:14.913435 | controller | } 2026-03-19 12:42:15.234207 | controller | changed: 2026-03-19 12:42:15.234304 | controller | { 2026-03-19 12:42:15.234335 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2026-03-19 12:42:15.234360 | controller | } 2026-03-19 12:42:15.545692 | controller | changed: 2026-03-19 12:42:15.545761 | controller | { 2026-03-19 12:42:15.545789 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2026-03-19 12:42:15.545811 | controller | } 2026-03-19 12:42:15.855474 | controller | changed: 2026-03-19 12:42:15.855525 | controller | { 2026-03-19 12:42:15.855551 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2026-03-19 12:42:15.855571 | controller | } 2026-03-19 12:42:16.166212 | controller | changed: 2026-03-19 12:42:16.166405 | controller | { 2026-03-19 12:42:16.166456 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2026-03-19 12:42:16.166483 | controller | } 2026-03-19 12:42:16.490029 | controller | changed: 2026-03-19 12:42:16.490116 | controller | { 2026-03-19 12:42:16.490145 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2026-03-19 12:42:16.490166 | controller | } 2026-03-19 12:42:16.795510 | controller | changed: 2026-03-19 12:42:16.795574 | controller | { 2026-03-19 12:42:16.795602 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2026-03-19 12:42:16.795624 | controller | } 2026-03-19 12:42:17.102933 | controller | changed: 2026-03-19 12:42:17.103009 | controller | { 2026-03-19 12:42:17.103037 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2026-03-19 12:42:17.103058 | controller | } 2026-03-19 12:42:17.412991 | controller | changed: 2026-03-19 12:42:17.413054 | controller | { 2026-03-19 12:42:17.413078 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2026-03-19 12:42:17.413096 | controller | } 2026-03-19 12:42:17.721071 | controller | changed: 2026-03-19 12:42:17.721145 | controller | { 2026-03-19 12:42:17.721171 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2026-03-19 12:42:17.721192 | controller | } 2026-03-19 12:42:18.042713 | controller | changed: 2026-03-19 12:42:18.042791 | controller | { 2026-03-19 12:42:18.042817 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2026-03-19 12:42:18.042837 | controller | } 2026-03-19 12:42:18.346091 | controller | changed: 2026-03-19 12:42:18.346215 | controller | { 2026-03-19 12:42:18.346335 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2026-03-19 12:42:18.346369 | controller | } 2026-03-19 12:42:18.651360 | controller | changed: 2026-03-19 12:42:18.651445 | controller | { 2026-03-19 12:42:18.651473 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com" 2026-03-19 12:42:18.651494 | controller | } 2026-03-19 12:42:18.964661 | controller | changed: 2026-03-19 12:42:18.964742 | controller | { 2026-03-19 12:42:18.964769 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2026-03-19 12:42:18.964790 | controller | } 2026-03-19 12:42:19.284811 | controller | changed: 2026-03-19 12:42:19.284909 | controller | { 2026-03-19 12:42:19.284959 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2026-03-19 12:42:19.284984 | controller | } 2026-03-19 12:42:19.590862 | controller | changed: 2026-03-19 12:42:19.590951 | controller | { 2026-03-19 12:42:19.590978 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2026-03-19 12:42:19.590999 | controller | } 2026-03-19 12:42:19.910657 | controller | changed: 2026-03-19 12:42:19.910737 | controller | { 2026-03-19 12:42:19.910766 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2026-03-19 12:42:19.910789 | controller | } 2026-03-19 12:42:20.225335 | controller | changed: 2026-03-19 12:42:20.225428 | controller | { 2026-03-19 12:42:20.225458 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2026-03-19 12:42:20.225488 | controller | } 2026-03-19 12:42:20.543244 | controller | changed: 2026-03-19 12:42:20.543340 | controller | { 2026-03-19 12:42:20.543368 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2026-03-19 12:42:20.543402 | controller | } 2026-03-19 12:42:20.855876 | controller | changed: 2026-03-19 12:42:20.855953 | controller | { 2026-03-19 12:42:20.855980 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2026-03-19 12:42:20.856002 | controller | } 2026-03-19 12:42:21.152413 | controller | changed: 2026-03-19 12:42:21.152554 | controller | { 2026-03-19 12:42:21.152588 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2026-03-19 12:42:21.152610 | controller | } 2026-03-19 12:42:21.459815 | controller | changed: 2026-03-19 12:42:21.459900 | controller | { 2026-03-19 12:42:21.459927 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2026-03-19 12:42:21.459948 | controller | } 2026-03-19 12:42:21.763283 | controller | changed: 2026-03-19 12:42:21.763365 | controller | { 2026-03-19 12:42:21.763403 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2026-03-19 12:42:21.763426 | controller | } 2026-03-19 12:42:22.067360 | controller | changed: 2026-03-19 12:42:22.067443 | controller | { 2026-03-19 12:42:22.067471 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2026-03-19 12:42:22.067493 | controller | } 2026-03-19 12:42:22.367706 | controller | changed: 2026-03-19 12:42:22.367782 | controller | { 2026-03-19 12:42:22.367809 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2026-03-19 12:42:22.367831 | controller | } 2026-03-19 12:42:22.669752 | controller | changed: 2026-03-19 12:42:22.669826 | controller | { 2026-03-19 12:42:22.669853 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2026-03-19 12:42:22.669875 | controller | } 2026-03-19 12:42:22.685882 | 2026-03-19 12:42:22.685991 | TASK [Set timezone to UTC] 2026-03-19 12:42:23.191123 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2026-03-19 12:42:23.195744 | 2026-03-19 12:42:23.195808 | TASK [Create nodepool directory] 2026-03-19 12:42:23.489190 | controller | changed 2026-03-19 12:42:23.494191 | 2026-03-19 12:42:23.494253 | TASK [Create nodepool sub_nodes file] 2026-03-19 12:42:24.513413 | controller | changed 2026-03-19 12:42:24.518191 | 2026-03-19 12:42:24.518254 | TASK [Create nodepool sub_nodes_private file] 2026-03-19 12:42:25.589458 | controller | changed 2026-03-19 12:42:25.594284 | 2026-03-19 12:42:25.594346 | LOOP [Populate nodepool sub_nodes file] 2026-03-19 12:42:25.623590 | 2026-03-19 12:42:25.623706 | LOOP [Populate nodepool sub_nodes_private file] 2026-03-19 12:42:25.652320 | 2026-03-19 12:42:25.652446 | TASK [Create nodepool primary file] 2026-03-19 12:42:25.686011 | controller | skipping: Conditional result was False 2026-03-19 12:42:25.691327 | 2026-03-19 12:42:25.691407 | TASK [Create nodepool node_private for this node] 2026-03-19 12:42:26.832505 | controller | changed 2026-03-19 12:42:26.837800 | 2026-03-19 12:42:26.837859 | LOOP [Copy ssh keys to nodepool directory] 2026-03-19 12:42:27.250484 | controller | ok: Item: id_rsa Runtime: 0:00:00.006066 2026-03-19 12:42:27.250754 | 2026-03-19 12:42:27.510452 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.005537 2026-03-19 12:42:27.517584 | 2026-03-19 12:42:27.517695 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2026-03-19 12:42:28.630357 | controller | changed 2026-03-19 12:42:28.635044 | 2026-03-19 12:42:28.635103 | TASK [Validate sudoers config after edits] 2026-03-19 12:42:28.938315 | controller | /etc/sudoers: parsed OK 2026-03-19 12:42:28.938592 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2026-03-19 12:42:28.938602 | controller | /etc/sudoers.d/zuul: parsed OK 2026-03-19 12:42:28.938609 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2026-03-19 12:42:29.160395 | controller | ok: Runtime: 0:00:00.006522 2026-03-19 12:42:29.165794 | 2026-03-19 12:42:29.165857 | TASK [Show the environment passed in to job shell scripts] 2026-03-19 12:42:29.447585 | controller | SHELL=/bin/bash 2026-03-19 12:42:29.447647 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2026-03-19 12:42:29.447657 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2026-03-19 12:42:29.447664 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/39/3739/aed42d59e83ffbd303ac5f5c196cfa920f63ed22 2026-03-19 12:42:29.447670 | controller | PWD=/home/zuul 2026-03-19 12:42:29.447676 | controller | ZUUL_PIPELINE=github-check 2026-03-19 12:42:29.447691 | controller | LOGNAME=zuul 2026-03-19 12:42:29.447703 | controller | XDG_SESSION_TYPE=tty 2026-03-19 12:42:29.447709 | controller | _=/usr/bin/env 2026-03-19 12:42:29.447720 | controller | MOTD_SHOWN=pam 2026-03-19 12:42:29.447731 | controller | HOME=/home/zuul 2026-03-19 12:42:29.447741 | controller | LANG=en_US.UTF-8 2026-03-19 12:42:29.447751 | controller | SSH_CONNECTION=192.168.25.12 52864 192.168.25.191 22 2026-03-19 12:42:29.447811 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2026-03-19 12:42:29.447825 | controller | ZUUL_CHANGE_IDS=3739,aed42d59e83ffbd303ac5f5c196cfa920f63ed22 2026-03-19 12:42:29.447832 | controller | WORKSPACE=/home/zuul/workspace 2026-03-19 12:42:29.447838 | controller | XDG_SESSION_CLASS=user 2026-03-19 12:42:29.447843 | controller | SELINUX_ROLE_REQUESTED= 2026-03-19 12:42:29.447849 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2026-03-19 12:42:29.447854 | controller | USER=zuul 2026-03-19 12:42:29.447860 | controller | ZUUL_VOTING=True 2026-03-19 12:42:29.447865 | controller | BUILD_TIMEOUT=5400000 2026-03-19 12:42:29.447870 | controller | SELINUX_USE_CURRENT_RANGE= 2026-03-19 12:42:29.447876 | controller | SHLVL=1 2026-03-19 12:42:29.447882 | controller | ZUUL_PATCHSET=aed42d59e83ffbd303ac5f5c196cfa920f63ed22 2026-03-19 12:42:29.447887 | controller | XDG_SESSION_ID=1 2026-03-19 12:42:29.447892 | controller | ZUUL_BRANCH=main 2026-03-19 12:42:29.447898 | controller | XDG_RUNTIME_DIR=/run/user/1000 2026-03-19 12:42:29.447903 | controller | SSH_CLIENT=192.168.25.12 52864 22 2026-03-19 12:42:29.447910 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2026-03-19 12:42:29.447916 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2026-03-19 12:42:29.447923 | controller | which_declare=declare -f 2026-03-19 12:42:29.447930 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2026-03-19 12:42:29.447935 | controller | SELINUX_LEVEL_REQUESTED= 2026-03-19 12:42:29.447941 | controller | ZUUL_CHANGE=3739 2026-03-19 12:42:29.447946 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2026-03-19 12:42:29.447951 | controller | ZUUL_UUID=5820d139e9b0497ab73bcf6b4c79d223 2026-03-19 12:42:29.447957 | controller | BASH_FUNC_which%%=() { ( alias; 2026-03-19 12:42:29.447963 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2026-03-19 12:42:29.447968 | controller | } 2026-03-19 12:42:29.692068 | controller | ok: Runtime: 0:00:00.007076 2026-03-19 12:42:29.697054 | 2026-03-19 12:42:29.697111 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2026-03-19 12:42:29.710021 | controller | skipping: Conditional result was False 2026-03-19 12:42:29.714799 | 2026-03-19 12:42:29.714862 | TASK [Symlink /home/zuul-worker/workspace] 2026-03-19 12:42:30.256121 | controller | skipping: Conditional result was False 2026-03-19 12:42:30.261505 | 2026-03-19 12:42:30.261568 | TASK [Ensure legacy workspace directory] 2026-03-19 12:42:30.532683 | controller | changed 2026-03-19 12:42:30.549962 | 2026-03-19 12:42:30.550016 | PLAY RECAP 2026-03-19 12:42:30.550058 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-03-19 12:42:30.550080 | 2026-03-19 12:42:30.617840 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-03-19 12:42:30.618595 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-03-19 12:42:31.096351 | 2026-03-19 12:42:31.096444 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2026-03-19 12:42:31.116532 | 2026-03-19 12:42:31.116602 | TASK [Create zuul-output directory] 2026-03-19 12:42:31.510080 | controller | changed 2026-03-19 12:42:31.515154 | 2026-03-19 12:42:31.515229 | TASK [Slurp Zuul inventory test] 2026-03-19 12:42:31.772007 | controller -> localhost | ok 2026-03-19 12:42:31.778086 | 2026-03-19 12:42:31.778148 | TASK [Save zuul inventory] 2026-03-19 12:42:33.030957 | controller | changed 2026-03-19 12:42:33.039409 | 2026-03-19 12:42:33.039479 | TASK [Save zuul vars without the change_message] 2026-03-19 12:42:34.099740 | controller | changed 2026-03-19 12:42:34.118090 | 2026-03-19 12:42:34.118140 | PLAY RECAP 2026-03-19 12:42:34.118184 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-19 12:42:34.118208 | 2026-03-19 12:42:34.180488 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-03-19 12:42:34.181177 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-03-19 12:42:34.704432 | 2026-03-19 12:42:34.704534 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2026-03-19 12:42:34.724834 | 2026-03-19 12:42:34.724909 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2026-03-19 12:42:34.743426 | controller | ok 2026-03-19 12:42:34.759828 | 2026-03-19 12:42:34.759909 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-03-19 12:42:34.783476 | controller | skipping: Conditional result was False 2026-03-19 12:42:34.788999 | 2026-03-19 12:42:34.789068 | TASK [mirror-info-fork : Create /etc/ci] 2026-03-19 12:42:35.191632 | controller | ok 2026-03-19 12:42:35.197317 | 2026-03-19 12:42:35.197402 | TASK [mirror-info-fork : Install ci_mirror script] 2026-03-19 12:42:36.259895 | controller | ok 2026-03-19 12:42:36.269028 | 2026-03-19 12:42:36.269090 | TASK [Prepare workspace] 2026-03-19 12:42:36.286519 | controller | ok 2026-03-19 12:42:36.302628 | 2026-03-19 12:42:36.302694 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-19 12:42:36.696661 | controller | ok 2026-03-19 12:42:36.702310 | 2026-03-19 12:42:36.702387 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-19 12:42:39.239006 | controller | Output suppressed because no_log was given 2026-03-19 12:42:39.247936 | 2026-03-19 12:42:39.247997 | LOOP [Create zuul-output directory] 2026-03-19 12:42:39.510999 | controller | changed: "/home/zuul/ci-framework-data/logs" 2026-03-19 12:42:39.745830 | controller | ok: "/home/zuul/zuul-output/logs" 2026-03-19 12:42:39.752136 | 2026-03-19 12:42:39.752201 | TASK [Install required packages] 2026-03-19 12:43:07.580839 | controller | ok: Nothing to do 2026-03-19 12:43:07.585702 | 2026-03-19 12:43:07.585761 | TASK [Install venv] 2026-03-19 12:44:05.208957 | controller | changed 2026-03-19 12:44:05.233153 | 2026-03-19 12:44:05.233251 | PLAY RECAP 2026-03-19 12:44:05.233318 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-19 12:44:05.233344 | 2026-03-19 12:44:05.312700 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-03-19 12:44:05.313566 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-03-19 12:44:05.817684 | 2026-03-19 12:44:05.817769 | PLAY [Run ci/playbooks/molecule-test.yml] 2026-03-19 12:44:05.837844 | 2026-03-19 12:44:05.837914 | TASK [Gather required facts] 2026-03-19 12:44:06.375604 | controller | ok 2026-03-19 12:44:06.381650 | 2026-03-19 12:44:06.381729 | TASK [Load environment var if instructed to] 2026-03-19 12:44:06.406578 | controller | skipping: Conditional result was False 2026-03-19 12:44:06.411811 | 2026-03-19 12:44:06.411875 | TASK [Ensure group_vars dir exists] 2026-03-19 12:44:06.785717 | controller | ok 2026-03-19 12:44:06.790864 | 2026-03-19 12:44:06.790930 | TASK [Print related variables] 2026-03-19 12:44:06.819348 | controller | ok: 2026-03-19 12:44:06.819469 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2026-03-19 12:44:06.819500 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2026-03-19 12:44:06.824153 | 2026-03-19 12:44:06.824215 | TASK [Run molecule] 2026-03-19 12:44:07.813437 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2026-03-19 12:44:08.074044 | controller | INFO Performing prerun with role_name_check=0... 2026-03-19 12:44:25.898068 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.898483 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.898896 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.899283 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.899725 | controller | WARNING Another version of 'cifmw.general' 1.0.0+08a56f32 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+08a56f32 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.900120 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.900513 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.900909 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.901290 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.901714 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.902080 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.902490 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.902890 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.903272 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.903674 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-19 12:44:25.912556 | controller | INFO Running crc_layout > prepare 2026-03-19 12:44:26.542692 | controller | 2026-03-19 12:44:26.542733 | controller | PLAY [Prepare] ***************************************************************** 2026-03-19 12:44:26.542934 | controller | 2026-03-19 12:44:26.542983 | controller | TASK [Gathering Facts] ********************************************************* 2026-03-19 12:44:26.543077 | controller | Thursday 19 March 2026 12:44:26 +0000 (0:00:00.018) 0:00:00.018 ******** 2026-03-19 12:44:27.365750 | controller | ok: [instance] 2026-03-19 12:44:27.365832 | controller | 2026-03-19 12:44:27.365937 | controller | TASK [Create custom basedir] *************************************************** 2026-03-19 12:44:27.366038 | controller | Thursday 19 March 2026 12:44:27 +0000 (0:00:00.823) 0:00:00.842 ******** 2026-03-19 12:44:27.669517 | controller | changed: [instance] 2026-03-19 12:44:27.669598 | controller | 2026-03-19 12:44:27.669726 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2026-03-19 12:44:27.669846 | controller | Thursday 19 March 2026 12:44:27 +0000 (0:00:00.303) 0:00:01.146 ******** 2026-03-19 12:44:27.687304 | controller | skipping: [instance] 2026-03-19 12:44:27.687399 | controller | 2026-03-19 12:44:27.687577 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2026-03-19 12:44:27.687671 | controller | Thursday 19 March 2026 12:44:27 +0000 (0:00:00.018) 0:00:01.164 ******** 2026-03-19 12:44:27.727742 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2026-03-19 12:44:27.999662 | controller | 2026-03-19 12:44:27.999702 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2026-03-19 12:44:27.999712 | controller | Thursday 19 March 2026 12:44:27 +0000 (0:00:00.039) 0:00:01.204 ******** 2026-03-19 12:44:27.999735 | controller | ok: [instance] 2026-03-19 12:44:27.999805 | controller | 2026-03-19 12:44:27.999819 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2026-03-19 12:44:27.999907 | controller | Thursday 19 March 2026 12:44:27 +0000 (0:00:00.272) 0:00:01.476 ******** 2026-03-19 12:44:28.200867 | controller | ok: [instance] 2026-03-19 12:44:28.200947 | controller | 2026-03-19 12:44:28.201050 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2026-03-19 12:44:28.201140 | controller | Thursday 19 March 2026 12:44:28 +0000 (0:00:00.201) 0:00:01.677 ******** 2026-03-19 12:44:28.859406 | controller | ok: [instance] => (item=ubi-9-appstream) 2026-03-19 12:44:28.859484 | controller | ok: [instance] => (item=ubi-9-baseos) 2026-03-19 12:44:28.859580 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2026-03-19 12:44:28.859671 | controller | 2026-03-19 12:44:28.859780 | controller | TASK [Deploy repo-setup] ******************************************************* 2026-03-19 12:44:28.859867 | controller | Thursday 19 March 2026 12:44:28 +0000 (0:00:00.658) 0:00:02.336 ******** 2026-03-19 12:44:28.916408 | controller | 2026-03-19 12:44:28.916447 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-03-19 12:44:28.916587 | controller | Thursday 19 March 2026 12:44:28 +0000 (0:00:00.057) 0:00:02.393 ******** 2026-03-19 12:44:29.426665 | controller | changed: [instance] => (item=tmp) 2026-03-19 12:44:29.426707 | controller | changed: [instance] => (item=artifacts/repositories) 2026-03-19 12:44:29.426842 | controller | changed: [instance] => (item=venv/repo_setup) 2026-03-19 12:44:29.426933 | controller | 2026-03-19 12:44:29.427020 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-03-19 12:44:29.427114 | controller | Thursday 19 March 2026 12:44:29 +0000 (0:00:00.509) 0:00:02.903 ******** 2026-03-19 12:44:30.256902 | controller | ok: [instance] 2026-03-19 12:44:30.256953 | controller | 2026-03-19 12:44:30.257148 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-03-19 12:44:31.255849 | controller | Thursday 19 March 2026 12:44:30 +0000 (0:00:00.830) 0:00:03.733 ******** 2026-03-19 12:44:31.255883 | controller | changed: [instance] 2026-03-19 12:44:38.756594 | controller | 2026-03-19 12:44:38.756661 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-03-19 12:44:38.756676 | controller | Thursday 19 March 2026 12:44:31 +0000 (0:00:00.998) 0:00:04.732 ******** 2026-03-19 12:44:38.756695 | controller | changed: [instance] 2026-03-19 12:44:39.423446 | controller | 2026-03-19 12:44:39.423477 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-03-19 12:44:39.423485 | controller | Thursday 19 March 2026 12:44:38 +0000 (0:00:07.500) 0:00:12.233 ******** 2026-03-19 12:44:39.423495 | controller | changed: [instance] 2026-03-19 12:44:39.444432 | controller | 2026-03-19 12:44:39.444458 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-03-19 12:44:39.444465 | controller | Thursday 19 March 2026 12:44:39 +0000 (0:00:00.666) 0:00:12.900 ******** 2026-03-19 12:44:39.444475 | controller | skipping: [instance] 2026-03-19 12:44:40.256492 | controller | 2026-03-19 12:44:40.256529 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-03-19 12:44:40.256540 | controller | Thursday 19 March 2026 12:44:39 +0000 (0:00:00.021) 0:00:12.921 ******** 2026-03-19 12:44:40.256553 | controller | changed: [instance] 2026-03-19 12:44:40.291534 | controller | 2026-03-19 12:44:40.291575 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-03-19 12:44:40.291586 | controller | Thursday 19 March 2026 12:44:40 +0000 (0:00:00.811) 0:00:13.733 ******** 2026-03-19 12:44:40.291599 | controller | skipping: [instance] 2026-03-19 12:44:40.291631 | controller | 2026-03-19 12:44:40.291642 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-03-19 12:44:40.291700 | controller | Thursday 19 March 2026 12:44:40 +0000 (0:00:00.035) 0:00:13.768 ******** 2026-03-19 12:44:40.327438 | controller | skipping: [instance] 2026-03-19 12:44:40.327857 | controller | 2026-03-19 12:44:40.362600 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-03-19 12:44:40.362618 | controller | Thursday 19 March 2026 12:44:40 +0000 (0:00:00.035) 0:00:13.804 ******** 2026-03-19 12:44:40.362627 | controller | skipping: [instance] 2026-03-19 12:44:40.893743 | controller | 2026-03-19 12:44:40.893775 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-03-19 12:44:40.893783 | controller | Thursday 19 March 2026 12:44:40 +0000 (0:00:00.034) 0:00:13.839 ******** 2026-03-19 12:44:40.893793 | controller | changed: [instance] 2026-03-19 12:44:41.325743 | controller | 2026-03-19 12:44:41.325774 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-03-19 12:44:41.325781 | controller | Thursday 19 March 2026 12:44:40 +0000 (0:00:00.531) 0:00:14.370 ******** 2026-03-19 12:44:41.325791 | controller | changed: [instance] 2026-03-19 12:44:41.325932 | controller | 2026-03-19 12:44:41.326070 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-03-19 12:44:41.326220 | controller | Thursday 19 March 2026 12:44:41 +0000 (0:00:00.432) 0:00:14.802 ******** 2026-03-19 12:44:41.353499 | controller | skipping: [instance] 2026-03-19 12:44:41.353645 | controller | 2026-03-19 12:44:41.353779 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-03-19 12:44:41.353907 | controller | Thursday 19 March 2026 12:44:41 +0000 (0:00:00.027) 0:00:14.830 ******** 2026-03-19 12:44:41.381275 | controller | skipping: [instance] 2026-03-19 12:44:41.381484 | controller | 2026-03-19 12:44:41.381628 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-03-19 12:44:41.381759 | controller | Thursday 19 March 2026 12:44:41 +0000 (0:00:00.027) 0:00:14.858 ******** 2026-03-19 12:44:41.409819 | controller | skipping: [instance] 2026-03-19 12:44:41.409966 | controller | 2026-03-19 12:44:41.410110 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-03-19 12:44:41.410256 | controller | Thursday 19 March 2026 12:44:41 +0000 (0:00:00.028) 0:00:14.887 ******** 2026-03-19 12:44:41.446861 | controller | ok: [instance] 2026-03-19 12:44:41.447039 | controller | 2026-03-19 12:44:41.447220 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-03-19 12:44:41.447403 | controller | Thursday 19 March 2026 12:44:41 +0000 (0:00:00.037) 0:00:14.924 ******** 2026-03-19 12:44:41.474583 | controller | skipping: [instance] 2026-03-19 12:44:41.474719 | controller | 2026-03-19 12:44:41.474834 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-03-19 12:44:41.474949 | controller | Thursday 19 March 2026 12:44:41 +0000 (0:00:00.027) 0:00:14.951 ******** 2026-03-19 12:44:41.499953 | controller | skipping: [instance] 2026-03-19 12:44:41.500084 | controller | 2026-03-19 12:44:41.500236 | controller | TASK [Download the RPM] ******************************************************** 2026-03-19 12:44:41.500404 | controller | Thursday 19 March 2026 12:44:41 +0000 (0:00:00.025) 0:00:14.977 ******** 2026-03-19 12:44:41.526684 | controller | skipping: [instance] 2026-03-19 12:44:41.526807 | controller | 2026-03-19 12:44:41.526955 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-03-19 12:44:41.527025 | controller | Thursday 19 March 2026 12:44:41 +0000 (0:00:00.026) 0:00:15.003 ******** 2026-03-19 12:44:41.553087 | controller | skipping: [instance] 2026-03-19 12:44:41.553224 | controller | 2026-03-19 12:44:41.553409 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-03-19 12:44:41.553523 | controller | Thursday 19 March 2026 12:44:41 +0000 (0:00:00.026) 0:00:15.030 ******** 2026-03-19 12:44:41.579408 | controller | skipping: [instance] 2026-03-19 12:44:41.579628 | controller | 2026-03-19 12:44:41.579832 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-03-19 12:44:41.579970 | controller | Thursday 19 March 2026 12:44:41 +0000 (0:00:00.026) 0:00:15.056 ******** 2026-03-19 12:44:41.607028 | controller | skipping: [instance] 2026-03-19 12:44:41.607201 | controller | 2026-03-19 12:44:41.607324 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-03-19 12:44:41.607483 | controller | Thursday 19 March 2026 12:44:41 +0000 (0:00:00.027) 0:00:15.084 ******** 2026-03-19 12:44:41.632655 | controller | skipping: [instance] 2026-03-19 12:44:41.632822 | controller | 2026-03-19 12:44:41.632976 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-03-19 12:44:41.633093 | controller | Thursday 19 March 2026 12:44:41 +0000 (0:00:00.025) 0:00:15.109 ******** 2026-03-19 12:44:41.807609 | controller | ok: [instance] 2026-03-19 12:44:41.807754 | controller | 2026-03-19 12:44:41.807895 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-03-19 12:44:41.808040 | controller | Thursday 19 March 2026 12:44:41 +0000 (0:00:00.174) 0:00:15.284 ******** 2026-03-19 12:44:42.013882 | controller | changed: [instance] 2026-03-19 12:44:42.248607 | controller | 2026-03-19 12:44:42.248639 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-03-19 12:44:42.248647 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.206) 0:00:15.490 ******** 2026-03-19 12:44:42.248657 | controller | changed: [instance] 2026-03-19 12:44:42.269907 | controller | 2026-03-19 12:44:42.269930 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-03-19 12:44:42.269939 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.234) 0:00:15.725 ******** 2026-03-19 12:44:42.269950 | controller | skipping: [instance] 2026-03-19 12:44:42.292517 | controller | 2026-03-19 12:44:42.292556 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-03-19 12:44:42.292566 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.021) 0:00:15.746 ******** 2026-03-19 12:44:42.292578 | controller | skipping: [instance] 2026-03-19 12:44:42.292622 | controller | 2026-03-19 12:44:42.292644 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-03-19 12:44:42.292657 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.022) 0:00:15.769 ******** 2026-03-19 12:44:42.313470 | controller | skipping: [instance] 2026-03-19 12:44:42.313961 | controller | 2026-03-19 12:44:42.335414 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-03-19 12:44:42.335437 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.021) 0:00:15.790 ******** 2026-03-19 12:44:42.335450 | controller | skipping: [instance] 2026-03-19 12:44:42.355427 | controller | 2026-03-19 12:44:42.355444 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-03-19 12:44:42.355458 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.021) 0:00:15.811 ******** 2026-03-19 12:44:42.355468 | controller | skipping: [instance] 2026-03-19 12:44:42.355494 | controller | 2026-03-19 12:44:42.355755 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-03-19 12:44:42.376122 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.020) 0:00:15.832 ******** 2026-03-19 12:44:42.376161 | controller | skipping: [instance] 2026-03-19 12:44:42.376473 | controller | 2026-03-19 12:44:42.376746 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-03-19 12:44:42.376882 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.020) 0:00:15.853 ******** 2026-03-19 12:44:42.394090 | controller | skipping: [instance] 2026-03-19 12:44:42.394287 | controller | 2026-03-19 12:44:42.394468 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-03-19 12:44:42.394604 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.018) 0:00:15.871 ******** 2026-03-19 12:44:42.422728 | controller | skipping: [instance] 2026-03-19 12:44:42.422971 | controller | 2026-03-19 12:44:42.423214 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-03-19 12:44:42.423495 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.028) 0:00:15.899 ******** 2026-03-19 12:44:42.439060 | controller | skipping: [instance] 2026-03-19 12:44:42.439263 | controller | 2026-03-19 12:44:42.439462 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-03-19 12:44:42.439603 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.016) 0:00:15.916 ******** 2026-03-19 12:44:42.459144 | controller | skipping: [instance] 2026-03-19 12:44:42.459441 | controller | 2026-03-19 12:44:42.459626 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2026-03-19 12:44:42.459760 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.019) 0:00:15.936 ******** 2026-03-19 12:44:42.488097 | controller | skipping: [instance] 2026-03-19 12:44:42.488293 | controller | 2026-03-19 12:44:42.488495 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2026-03-19 12:44:42.488648 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.029) 0:00:15.965 ******** 2026-03-19 12:44:42.516842 | controller | skipping: [instance] 2026-03-19 12:44:42.517095 | controller | 2026-03-19 12:44:42.517338 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2026-03-19 12:44:42.517604 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.028) 0:00:15.993 ******** 2026-03-19 12:44:42.546483 | controller | skipping: [instance] 2026-03-19 12:44:42.546620 | controller | 2026-03-19 12:44:42.546752 | controller | TASK [test_deps : Install additional packages] ********************************* 2026-03-19 12:44:42.546880 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.029) 0:00:16.023 ******** 2026-03-19 12:44:42.575213 | controller | skipping: [instance] 2026-03-19 12:44:42.575416 | controller | 2026-03-19 12:44:42.575591 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2026-03-19 12:44:42.575741 | controller | Thursday 19 March 2026 12:44:42 +0000 (0:00:00.028) 0:00:16.052 ******** 2026-03-19 12:45:31.592509 | controller | ok: [instance] 2026-03-19 12:45:31.592543 | controller | 2026-03-19 12:45:31.592553 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2026-03-19 12:45:31.592563 | controller | Thursday 19 March 2026 12:45:31 +0000 (0:00:49.016) 0:01:05.069 ******** 2026-03-19 12:45:32.826857 | controller | ok: [instance] 2026-03-19 12:45:32.857484 | controller | 2026-03-19 12:45:32.857528 | controller | TASK [test_deps : Install extra packages] ************************************** 2026-03-19 12:45:32.857536 | controller | Thursday 19 March 2026 12:45:32 +0000 (0:00:01.234) 0:01:06.303 ******** 2026-03-19 12:45:32.857547 | controller | skipping: [instance] 2026-03-19 12:45:32.857572 | controller | 2026-03-19 12:45:32.857738 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-03-19 12:45:32.899142 | controller | Thursday 19 March 2026 12:45:32 +0000 (0:00:00.031) 0:01:06.334 ******** 2026-03-19 12:45:32.899179 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2026-03-19 12:45:32.917528 | controller | 2026-03-19 12:45:32.917565 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-03-19 12:45:32.917574 | controller | Thursday 19 March 2026 12:45:32 +0000 (0:00:00.041) 0:01:06.375 ******** 2026-03-19 12:45:32.917597 | controller | ok: [instance] => 2026-03-19 12:45:32.917626 | controller | cifmw_ci_setup_packages: 2026-03-19 12:45:32.917635 | controller | - bash-completion 2026-03-19 12:45:32.917641 | controller | - ca-certificates 2026-03-19 12:45:32.917648 | controller | - git-core 2026-03-19 12:45:32.917655 | controller | - make 2026-03-19 12:45:32.917664 | controller | - tar 2026-03-19 12:45:32.918084 | controller | - tmux 2026-03-19 12:45:37.208543 | controller | - python3-pip 2026-03-19 12:45:37.208574 | controller | 2026-03-19 12:45:37.208582 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-03-19 12:45:37.208589 | controller | Thursday 19 March 2026 12:45:32 +0000 (0:00:00.018) 0:01:06.394 ******** 2026-03-19 12:45:37.208599 | controller | changed: [instance] 2026-03-19 12:45:37.782106 | controller | 2026-03-19 12:45:37.782143 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-03-19 12:45:37.782151 | controller | Thursday 19 March 2026 12:45:37 +0000 (0:00:04.291) 0:01:10.685 ******** 2026-03-19 12:45:37.782162 | controller | ok: [instance] 2026-03-19 12:45:37.981805 | controller | 2026-03-19 12:45:37.981838 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-03-19 12:45:37.981847 | controller | Thursday 19 March 2026 12:45:37 +0000 (0:00:00.573) 0:01:11.258 ******** 2026-03-19 12:45:37.981857 | controller | changed: [instance] 2026-03-19 12:45:42.829436 | controller | 2026-03-19 12:45:42.829484 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-03-19 12:45:42.829494 | controller | Thursday 19 March 2026 12:45:37 +0000 (0:00:00.199) 0:01:11.458 ******** 2026-03-19 12:45:42.829507 | controller | changed: [instance] 2026-03-19 12:45:42.866499 | controller | 2026-03-19 12:45:42.866538 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-03-19 12:45:42.866548 | controller | Thursday 19 March 2026 12:45:42 +0000 (0:00:04.847) 0:01:16.305 ******** 2026-03-19 12:45:42.866561 | controller | ok: [instance] 2026-03-19 12:45:43.133442 | controller | 2026-03-19 12:45:43.133468 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-03-19 12:45:43.133476 | controller | Thursday 19 March 2026 12:45:42 +0000 (0:00:00.037) 0:01:16.343 ******** 2026-03-19 12:45:43.133486 | controller | changed: [instance] 2026-03-19 12:45:43.133631 | controller | 2026-03-19 12:45:43.133666 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-03-19 12:45:43.400022 | controller | Thursday 19 March 2026 12:45:43 +0000 (0:00:00.266) 0:01:16.610 ******** 2026-03-19 12:45:43.400061 | controller | changed: [instance] 2026-03-19 12:45:43.417506 | controller | 2026-03-19 12:45:43.417532 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-03-19 12:45:43.417541 | controller | Thursday 19 March 2026 12:45:43 +0000 (0:00:00.266) 0:01:16.876 ******** 2026-03-19 12:45:43.417553 | controller | skipping: [instance] 2026-03-19 12:45:43.417743 | controller | 2026-03-19 12:45:43.417764 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-03-19 12:45:43.433773 | controller | Thursday 19 March 2026 12:45:43 +0000 (0:00:00.017) 0:01:16.894 ******** 2026-03-19 12:45:43.433795 | controller | skipping: [instance] 2026-03-19 12:45:43.449230 | controller | 2026-03-19 12:45:43.449253 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-03-19 12:45:43.449262 | controller | Thursday 19 March 2026 12:45:43 +0000 (0:00:00.015) 0:01:16.910 ******** 2026-03-19 12:45:43.449273 | controller | skipping: [instance] 2026-03-19 12:45:43.464799 | controller | 2026-03-19 12:45:43.464818 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-03-19 12:45:43.464826 | controller | Thursday 19 March 2026 12:45:43 +0000 (0:00:00.015) 0:01:16.926 ******** 2026-03-19 12:45:43.464834 | controller | skipping: [instance] 2026-03-19 12:45:43.482068 | controller | 2026-03-19 12:45:43.482090 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-03-19 12:45:43.482106 | controller | Thursday 19 March 2026 12:45:43 +0000 (0:00:00.015) 0:01:16.941 ******** 2026-03-19 12:45:43.482117 | controller | skipping: [instance] 2026-03-19 12:45:43.502846 | controller | 2026-03-19 12:45:43.502868 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-03-19 12:45:43.502875 | controller | Thursday 19 March 2026 12:45:43 +0000 (0:00:00.017) 0:01:16.958 ******** 2026-03-19 12:45:43.502884 | controller | skipping: [instance] 2026-03-19 12:45:44.439477 | controller | 2026-03-19 12:45:44.439513 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-03-19 12:45:44.439523 | controller | Thursday 19 March 2026 12:45:43 +0000 (0:00:00.020) 0:01:16.979 ******** 2026-03-19 12:45:44.439535 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2026-03-19 12:45:44.439564 | controller | changed: [instance] => (item=/opt/basedir/logs) 2026-03-19 12:45:44.439572 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2026-03-19 12:45:44.439579 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2026-03-19 12:45:44.439588 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2026-03-19 12:45:44.439791 | controller | 2026-03-19 12:45:44.439826 | controller | TASK [Create secret file] ****************************************************** 2026-03-19 12:45:44.782494 | controller | Thursday 19 March 2026 12:45:44 +0000 (0:00:00.936) 0:01:17.916 ******** 2026-03-19 12:45:44.782537 | controller | changed: [instance] 2026-03-19 12:45:44.782570 | controller | 2026-03-19 12:45:44.782579 | controller | PLAY RECAP ********************************************************************* 2026-03-19 12:45:44.782586 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2026-03-19 12:45:44.782593 | controller | 2026-03-19 12:45:44.782607 | controller | Thursday 19 March 2026 12:45:44 +0000 (0:00:00.342) 0:01:18.258 ******** 2026-03-19 12:45:44.782614 | controller | =============================================================================== 2026-03-19 12:45:44.782623 | controller | test_deps : Install selinux python libs -------------------------------- 49.02s 2026-03-19 12:45:44.782650 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.50s 2026-03-19 12:45:44.783452 | controller | ci_setup : Install openshift client ------------------------------------- 4.85s 2026-03-19 12:45:44.783499 | controller | ci_setup : Install needed packages -------------------------------------- 4.29s 2026-03-19 12:45:44.783507 | controller | test_deps : Install python yaml libs ------------------------------------ 1.23s 2026-03-19 12:45:44.783513 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.00s 2026-03-19 12:45:44.783518 | controller | ci_setup : Manage directories ------------------------------------------- 0.94s 2026-03-19 12:45:44.783524 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.83s 2026-03-19 12:45:44.783529 | controller | Gathering Facts --------------------------------------------------------- 0.82s 2026-03-19 12:45:44.783535 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.81s 2026-03-19 12:45:44.783540 | controller | repo_setup : Install repo-setup package --------------------------------- 0.67s 2026-03-19 12:45:44.783547 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.66s 2026-03-19 12:45:44.784165 | controller | ci_setup : Gather version of openshift client --------------------------- 0.57s 2026-03-19 12:45:44.835545 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.53s 2026-03-19 12:45:44.835567 | controller | repo_setup : Ensure directories are present ----------------------------- 0.51s 2026-03-19 12:45:44.835574 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.43s 2026-03-19 12:45:44.835580 | controller | Create secret file ------------------------------------------------------ 0.34s 2026-03-19 12:45:44.835585 | controller | Create custom basedir --------------------------------------------------- 0.30s 2026-03-19 12:45:44.835591 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.27s 2026-03-19 12:45:44.835601 | controller | ci_setup : Create completion file --------------------------------------- 0.27s 2026-03-19 12:45:44.835611 | controller | INFO Running crc_layout > converge 2026-03-19 12:45:45.422425 | controller | 2026-03-19 12:45:45.422636 | controller | PLAY [Converge] **************************************************************** 2026-03-19 12:45:45.422771 | controller | 2026-03-19 12:45:45.422906 | controller | TASK [Gathering Facts] ********************************************************* 2026-03-19 12:45:45.423040 | controller | Thursday 19 March 2026 12:45:45 +0000 (0:00:00.028) 0:00:00.028 ******** 2026-03-19 12:45:46.241281 | controller | ok: [instance] 2026-03-19 12:45:46.262171 | controller | 2026-03-19 12:45:46.262195 | controller | TASK [Load networking definition from scenario file] *************************** 2026-03-19 12:45:46.262203 | controller | Thursday 19 March 2026 12:45:46 +0000 (0:00:00.818) 0:00:00.847 ******** 2026-03-19 12:45:46.262212 | controller | ok: [instance] 2026-03-19 12:45:46.279210 | controller | 2026-03-19 12:45:46.279228 | controller | TASK [discover_latest_image : Set the discovered images dict to empty] ********* 2026-03-19 12:45:46.279236 | controller | Thursday 19 March 2026 12:45:46 +0000 (0:00:00.020) 0:00:00.868 ******** 2026-03-19 12:45:46.279244 | controller | ok: [instance] 2026-03-19 12:45:46.318233 | controller | 2026-03-19 12:45:46.318251 | controller | TASK [discover_latest_image : Discover images] ********************************* 2026-03-19 12:45:46.318258 | controller | Thursday 19 March 2026 12:45:46 +0000 (0:00:00.017) 0:00:00.885 ******** 2026-03-19 12:45:46.318270 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/discover_latest_image/tasks/per-image.yml for instance => (item={'key': 'default', 'value': {'base_url': 'https://cloud.centos.org/centos/9-stream/x86_64/images/', 'qcow_prefix': 'CentOS-Stream-GenericCloud-', 'images_file': 'CHECKSUM'}}) 2026-03-19 12:45:46.359587 | controller | 2026-03-19 12:45:46.359622 | controller | TASK [discover_latest_image : Ensure the current image dict entry has the expected data] *** 2026-03-19 12:45:46.359637 | controller | Thursday 19 March 2026 12:45:46 +0000 (0:00:00.038) 0:00:00.924 ******** 2026-03-19 12:45:46.359648 | controller | ok: [instance] => changed=false 2026-03-19 12:45:46.359691 | controller | msg: All assertions passed 2026-03-19 12:45:46.359699 | controller | 2026-03-19 12:45:46.359707 | controller | TASK [discover_latest_image : Get latest image for the current entry] ********** 2026-03-19 12:45:46.359714 | controller | Thursday 19 March 2026 12:45:46 +0000 (0:00:00.041) 0:00:00.965 ******** 2026-03-19 12:45:47.871290 | controller | changed: [instance] 2026-03-19 12:45:47.871423 | controller | 2026-03-19 12:45:47.871718 | controller | TASK [discover_latest_image : Append the current return value to the discovered images dict] *** 2026-03-19 12:45:47.902535 | controller | Thursday 19 March 2026 12:45:47 +0000 (0:00:01.510) 0:00:02.476 ******** 2026-03-19 12:45:47.902561 | controller | ok: [instance] 2026-03-19 12:45:47.933510 | controller | 2026-03-19 12:45:47.933541 | controller | TASK [discover_latest_image : Export single-image facts if an image with name 'default' was discovered] *** 2026-03-19 12:45:47.933551 | controller | Thursday 19 March 2026 12:45:47 +0000 (0:00:00.032) 0:00:02.508 ******** 2026-03-19 12:45:47.933561 | controller | ok: [instance] 2026-03-19 12:45:47.933770 | controller | 2026-03-19 12:45:47.933792 | controller | TASK [reproducer : Load CI job environment] ************************************ 2026-03-19 12:45:47.954894 | controller | Thursday 19 March 2026 12:45:47 +0000 (0:00:00.031) 0:00:02.540 ******** 2026-03-19 12:45:47.954915 | controller | skipping: [instance] 2026-03-19 12:45:48.002835 | controller | 2026-03-19 12:45:48.002857 | controller | TASK [Build final libvirt layout] ********************************************** 2026-03-19 12:45:48.002866 | controller | Thursday 19 March 2026 12:45:47 +0000 (0:00:00.021) 0:00:02.561 ******** 2026-03-19 12:45:48.002877 | controller | 2026-03-19 12:45:48.081775 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2026-03-19 12:45:48.081799 | controller | Thursday 19 March 2026 12:45:48 +0000 (0:00:00.047) 0:00:02.609 ******** 2026-03-19 12:45:48.081809 | controller | ok: [instance] 2026-03-19 12:45:48.145832 | controller | 2026-03-19 12:45:48.145855 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2026-03-19 12:45:48.145864 | controller | Thursday 19 March 2026 12:45:48 +0000 (0:00:00.078) 0:00:02.687 ******** 2026-03-19 12:45:48.145883 | controller | skipping: [instance] 2026-03-19 12:45:48.146053 | controller | 2026-03-19 12:45:48.146234 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2026-03-19 12:45:48.146419 | controller | Thursday 19 March 2026 12:45:48 +0000 (0:00:00.064) 0:00:02.752 ******** 2026-03-19 12:45:48.182162 | controller | ok: [instance] 2026-03-19 12:45:48.182321 | controller | 2026-03-19 12:45:48.182484 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2026-03-19 12:45:48.182623 | controller | Thursday 19 March 2026 12:45:48 +0000 (0:00:00.036) 0:00:02.789 ******** 2026-03-19 12:45:48.205556 | controller | ok: [instance] => changed=false 2026-03-19 12:45:48.205735 | controller | msg: All assertions passed 2026-03-19 12:45:48.205869 | controller | 2026-03-19 12:45:48.205989 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2026-03-19 12:45:48.206106 | controller | Thursday 19 March 2026 12:45:48 +0000 (0:00:00.023) 0:00:02.812 ******** 2026-03-19 12:45:48.249596 | controller | ok: [instance] 2026-03-19 12:45:48.249776 | controller | 2026-03-19 12:45:48.249934 | controller | TASK [reproducer : Register current host as controller-0] ********************** 2026-03-19 12:45:48.250065 | controller | Thursday 19 March 2026 12:45:48 +0000 (0:00:00.043) 0:00:02.856 ******** 2026-03-19 12:45:48.275083 | controller | skipping: [instance] 2026-03-19 12:45:48.275261 | controller | 2026-03-19 12:45:48.275469 | controller | TASK [reproducer : Set minimal libvirt layout for bare metal OCP] ************** 2026-03-19 12:45:48.275647 | controller | Thursday 19 March 2026 12:45:48 +0000 (0:00:00.025) 0:00:02.881 ******** 2026-03-19 12:45:48.300437 | controller | skipping: [instance] 2026-03-19 12:45:48.300602 | controller | 2026-03-19 12:45:48.300754 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2026-03-19 12:45:48.300899 | controller | Thursday 19 March 2026 12:45:48 +0000 (0:00:00.025) 0:00:02.907 ******** 2026-03-19 12:45:48.741493 | controller | ok: [instance] => (item=artifacts) 2026-03-19 12:45:48.741576 | controller | ok: [instance] => (item=logs) 2026-03-19 12:45:48.741589 | controller | 2026-03-19 12:45:48.741600 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2026-03-19 12:45:48.806923 | controller | Thursday 19 March 2026 12:45:48 +0000 (0:00:00.440) 0:00:03.347 ******** 2026-03-19 12:45:48.806964 | controller | 2026-03-19 12:45:48.988466 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2026-03-19 12:45:48.988515 | controller | Thursday 19 March 2026 12:45:48 +0000 (0:00:00.065) 0:00:03.413 ******** 2026-03-19 12:45:48.988530 | controller | ok: [instance] 2026-03-19 12:45:49.256004 | controller | 2026-03-19 12:45:49.256035 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2026-03-19 12:45:49.256043 | controller | Thursday 19 March 2026 12:45:48 +0000 (0:00:00.181) 0:00:03.594 ******** 2026-03-19 12:45:49.256059 | controller | changed: [instance] 2026-03-19 12:45:49.529814 | controller | 2026-03-19 12:45:49.529844 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2026-03-19 12:45:49.529852 | controller | Thursday 19 March 2026 12:45:49 +0000 (0:00:00.267) 0:00:03.862 ******** 2026-03-19 12:45:49.529862 | controller | ok: [instance] 2026-03-19 12:45:49.557870 | controller | 2026-03-19 12:45:49.557894 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2026-03-19 12:45:49.557901 | controller | Thursday 19 March 2026 12:45:49 +0000 (0:00:00.273) 0:00:04.136 ******** 2026-03-19 12:45:49.557910 | controller | skipping: [instance] 2026-03-19 12:45:49.574890 | controller | 2026-03-19 12:45:49.574910 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2026-03-19 12:45:49.574918 | controller | Thursday 19 March 2026 12:45:49 +0000 (0:00:00.028) 0:00:04.164 ******** 2026-03-19 12:45:49.574928 | controller | skipping: [instance] 2026-03-19 12:45:49.594810 | controller | 2026-03-19 12:45:49.594832 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2026-03-19 12:45:49.594841 | controller | Thursday 19 March 2026 12:45:49 +0000 (0:00:00.017) 0:00:04.181 ******** 2026-03-19 12:45:49.594852 | controller | ok: [instance] 2026-03-19 12:45:49.623800 | controller | 2026-03-19 12:45:49.623822 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2026-03-19 12:45:49.623831 | controller | Thursday 19 March 2026 12:45:49 +0000 (0:00:00.019) 0:00:04.201 ******** 2026-03-19 12:45:49.623842 | controller | skipping: [instance] 2026-03-19 12:46:03.221269 | controller | 2026-03-19 12:46:03.221334 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2026-03-19 12:46:03.221343 | controller | Thursday 19 March 2026 12:45:49 +0000 (0:00:00.028) 0:00:04.230 ******** 2026-03-19 12:46:03.221358 | controller | changed: [instance] 2026-03-19 12:46:03.469895 | controller | 2026-03-19 12:46:03.469962 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2026-03-19 12:46:03.469972 | controller | Thursday 19 March 2026 12:46:03 +0000 (0:00:13.597) 0:00:17.827 ******** 2026-03-19 12:46:03.469990 | controller | changed: [instance] 2026-03-19 12:46:04.017114 | controller | 2026-03-19 12:46:04.017146 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2026-03-19 12:46:04.017155 | controller | Thursday 19 March 2026 12:46:03 +0000 (0:00:00.248) 0:00:18.075 ******** 2026-03-19 12:46:04.017165 | controller | changed: [instance] 2026-03-19 12:46:04.620044 | controller | 2026-03-19 12:46:04.620075 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2026-03-19 12:46:04.620083 | controller | Thursday 19 March 2026 12:46:04 +0000 (0:00:00.547) 0:00:18.623 ******** 2026-03-19 12:46:04.620094 | controller | changed: [instance] 2026-03-19 12:46:04.820185 | controller | 2026-03-19 12:46:04.820221 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2026-03-19 12:46:04.820231 | controller | Thursday 19 March 2026 12:46:04 +0000 (0:00:00.603) 0:00:19.226 ******** 2026-03-19 12:46:04.820244 | controller | ok: [instance] 2026-03-19 12:46:05.491878 | controller | 2026-03-19 12:46:05.491912 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2026-03-19 12:46:05.491920 | controller | Thursday 19 March 2026 12:46:04 +0000 (0:00:00.199) 0:00:19.426 ******** 2026-03-19 12:46:05.491930 | controller | ok: [instance] 2026-03-19 12:46:06.267534 | controller | 2026-03-19 12:46:06.267567 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2026-03-19 12:46:06.267575 | controller | Thursday 19 March 2026 12:46:05 +0000 (0:00:00.671) 0:00:20.097 ******** 2026-03-19 12:46:06.267586 | controller | changed: [instance] 2026-03-19 12:46:06.267663 | controller | 2026-03-19 12:46:06.267691 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2026-03-19 12:46:06.267703 | controller | Thursday 19 March 2026 12:46:06 +0000 (0:00:00.775) 0:00:20.873 ******** 2026-03-19 12:46:06.350531 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2026-03-19 12:46:06.350587 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2026-03-19 12:46:06.350597 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2026-03-19 12:46:06.350604 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2026-03-19 12:46:06.350611 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2026-03-19 12:46:06.350620 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2026-03-19 12:46:06.351039 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2026-03-19 12:46:06.672448 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2026-03-19 12:46:06.672475 | controller | 2026-03-19 12:46:06.672483 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2026-03-19 12:46:06.672497 | controller | Thursday 19 March 2026 12:46:06 +0000 (0:00:00.082) 0:00:20.956 ******** 2026-03-19 12:46:06.672507 | controller | ok: [instance] 2026-03-19 12:46:06.672705 | controller | 2026-03-19 12:46:06.672743 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2026-03-19 12:46:06.988565 | controller | Thursday 19 March 2026 12:46:06 +0000 (0:00:00.322) 0:00:21.278 ******** 2026-03-19 12:46:06.988601 | controller | ok: [instance] 2026-03-19 12:46:07.303836 | controller | 2026-03-19 12:46:07.303867 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2026-03-19 12:46:07.303885 | controller | Thursday 19 March 2026 12:46:06 +0000 (0:00:00.315) 0:00:21.594 ******** 2026-03-19 12:46:07.303897 | controller | ok: [instance] 2026-03-19 12:46:07.618224 | controller | 2026-03-19 12:46:07.618253 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2026-03-19 12:46:07.618262 | controller | Thursday 19 March 2026 12:46:07 +0000 (0:00:00.315) 0:00:21.910 ******** 2026-03-19 12:46:07.618274 | controller | ok: [instance] 2026-03-19 12:46:07.928516 | controller | 2026-03-19 12:46:07.928560 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2026-03-19 12:46:07.928570 | controller | Thursday 19 March 2026 12:46:07 +0000 (0:00:00.314) 0:00:22.224 ******** 2026-03-19 12:46:07.928583 | controller | ok: [instance] 2026-03-19 12:46:07.928603 | controller | 2026-03-19 12:46:07.928611 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2026-03-19 12:46:07.928620 | controller | Thursday 19 March 2026 12:46:07 +0000 (0:00:00.310) 0:00:22.534 ******** 2026-03-19 12:46:08.245080 | controller | ok: [instance] 2026-03-19 12:46:08.245137 | controller | 2026-03-19 12:46:08.245335 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2026-03-19 12:46:08.559355 | controller | Thursday 19 March 2026 12:46:08 +0000 (0:00:00.316) 0:00:22.851 ******** 2026-03-19 12:46:08.559417 | controller | ok: [instance] 2026-03-19 12:46:08.872465 | controller | 2026-03-19 12:46:08.872501 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2026-03-19 12:46:08.872510 | controller | Thursday 19 March 2026 12:46:08 +0000 (0:00:00.314) 0:00:23.165 ******** 2026-03-19 12:46:08.872523 | controller | ok: [instance] 2026-03-19 12:46:08.872769 | controller | 2026-03-19 12:46:08.872787 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2026-03-19 12:46:09.188455 | controller | Thursday 19 March 2026 12:46:08 +0000 (0:00:00.312) 0:00:23.478 ******** 2026-03-19 12:46:09.188489 | controller | ok: [instance] 2026-03-19 12:46:09.188514 | controller | 2026-03-19 12:46:09.188710 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2026-03-19 12:46:09.508004 | controller | Thursday 19 March 2026 12:46:09 +0000 (0:00:00.316) 0:00:23.795 ******** 2026-03-19 12:46:09.508035 | controller | ok: [instance] 2026-03-19 12:46:09.821894 | controller | 2026-03-19 12:46:09.821917 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2026-03-19 12:46:09.821925 | controller | Thursday 19 March 2026 12:46:09 +0000 (0:00:00.319) 0:00:24.114 ******** 2026-03-19 12:46:09.821934 | controller | ok: [instance] 2026-03-19 12:46:10.141116 | controller | 2026-03-19 12:46:10.141147 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2026-03-19 12:46:10.141154 | controller | Thursday 19 March 2026 12:46:09 +0000 (0:00:00.313) 0:00:24.428 ******** 2026-03-19 12:46:10.141167 | controller | ok: [instance] 2026-03-19 12:46:10.460116 | controller | 2026-03-19 12:46:10.460158 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2026-03-19 12:46:10.460169 | controller | Thursday 19 March 2026 12:46:10 +0000 (0:00:00.319) 0:00:24.747 ******** 2026-03-19 12:46:10.460179 | controller | ok: [instance] 2026-03-19 12:46:10.775871 | controller | 2026-03-19 12:46:10.775901 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2026-03-19 12:46:10.775909 | controller | Thursday 19 March 2026 12:46:10 +0000 (0:00:00.318) 0:00:25.066 ******** 2026-03-19 12:46:10.775918 | controller | ok: [instance] 2026-03-19 12:46:11.087231 | controller | 2026-03-19 12:46:11.087262 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2026-03-19 12:46:11.087277 | controller | Thursday 19 March 2026 12:46:10 +0000 (0:00:00.316) 0:00:25.382 ******** 2026-03-19 12:46:11.087287 | controller | ok: [instance] 2026-03-19 12:46:11.402480 | controller | 2026-03-19 12:46:11.402534 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2026-03-19 12:46:11.402544 | controller | Thursday 19 March 2026 12:46:11 +0000 (0:00:00.311) 0:00:25.693 ******** 2026-03-19 12:46:11.402556 | controller | ok: [instance] 2026-03-19 12:46:11.721049 | controller | 2026-03-19 12:46:11.721073 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2026-03-19 12:46:11.721080 | controller | Thursday 19 March 2026 12:46:11 +0000 (0:00:00.315) 0:00:26.008 ******** 2026-03-19 12:46:11.721089 | controller | ok: [instance] 2026-03-19 12:46:12.031923 | controller | 2026-03-19 12:46:12.031947 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2026-03-19 12:46:12.031954 | controller | Thursday 19 March 2026 12:46:11 +0000 (0:00:00.318) 0:00:26.327 ******** 2026-03-19 12:46:12.031970 | controller | ok: [instance] 2026-03-19 12:46:12.345821 | controller | 2026-03-19 12:46:12.345840 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2026-03-19 12:46:12.345847 | controller | Thursday 19 March 2026 12:46:12 +0000 (0:00:00.310) 0:00:26.638 ******** 2026-03-19 12:46:12.345856 | controller | ok: [instance] 2026-03-19 12:46:12.660082 | controller | 2026-03-19 12:46:12.660100 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2026-03-19 12:46:12.660107 | controller | Thursday 19 March 2026 12:46:12 +0000 (0:00:00.313) 0:00:26.952 ******** 2026-03-19 12:46:12.660116 | controller | ok: [instance] 2026-03-19 12:46:12.973097 | controller | 2026-03-19 12:46:12.973116 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2026-03-19 12:46:12.973124 | controller | Thursday 19 March 2026 12:46:12 +0000 (0:00:00.314) 0:00:27.266 ******** 2026-03-19 12:46:12.973132 | controller | ok: [instance] 2026-03-19 12:46:13.284984 | controller | 2026-03-19 12:46:13.285004 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2026-03-19 12:46:13.285012 | controller | Thursday 19 March 2026 12:46:12 +0000 (0:00:00.312) 0:00:27.579 ******** 2026-03-19 12:46:13.285021 | controller | ok: [instance] 2026-03-19 12:46:13.603113 | controller | 2026-03-19 12:46:13.603140 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2026-03-19 12:46:13.603150 | controller | Thursday 19 March 2026 12:46:13 +0000 (0:00:00.311) 0:00:27.891 ******** 2026-03-19 12:46:13.603159 | controller | ok: [instance] 2026-03-19 12:46:13.914865 | controller | 2026-03-19 12:46:13.914889 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2026-03-19 12:46:13.914897 | controller | Thursday 19 March 2026 12:46:13 +0000 (0:00:00.317) 0:00:28.209 ******** 2026-03-19 12:46:13.914906 | controller | ok: [instance] 2026-03-19 12:46:13.952073 | controller | 2026-03-19 12:46:13.952095 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2026-03-19 12:46:13.952104 | controller | Thursday 19 March 2026 12:46:13 +0000 (0:00:00.311) 0:00:28.521 ******** 2026-03-19 12:46:13.952115 | controller | skipping: [instance] 2026-03-19 12:46:14.209450 | controller | 2026-03-19 12:46:14.209482 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2026-03-19 12:46:14.209490 | controller | Thursday 19 March 2026 12:46:13 +0000 (0:00:00.037) 0:00:28.558 ******** 2026-03-19 12:46:14.209500 | controller | ok: [instance] 2026-03-19 12:46:14.209524 | controller | 2026-03-19 12:46:14.209542 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2026-03-19 12:46:14.209679 | controller | Thursday 19 March 2026 12:46:14 +0000 (0:00:00.257) 0:00:28.815 ******** 2026-03-19 12:46:14.559035 | controller | ok: [instance] 2026-03-19 12:46:14.841849 | controller | 2026-03-19 12:46:14.841876 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2026-03-19 12:46:14.841885 | controller | Thursday 19 March 2026 12:46:14 +0000 (0:00:00.349) 0:00:29.165 ******** 2026-03-19 12:46:14.841897 | controller | changed: [instance] 2026-03-19 12:46:15.103097 | controller | 2026-03-19 12:46:15.103130 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2026-03-19 12:46:15.103146 | controller | Thursday 19 March 2026 12:46:14 +0000 (0:00:00.282) 0:00:29.448 ******** 2026-03-19 12:46:15.103156 | controller | [WARNING]: Reset is not implemented for this connection 2026-03-19 12:46:15.113258 | controller | changed: [instance] 2026-03-19 12:46:15.180922 | controller | 2026-03-19 12:46:15.180944 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2026-03-19 12:46:15.180953 | controller | Thursday 19 March 2026 12:46:15 +0000 (0:00:00.255) 0:00:29.703 ******** 2026-03-19 12:46:15.180961 | controller | 2026-03-19 12:46:15.180968 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2026-03-19 12:46:15.180975 | controller | Thursday 19 March 2026 12:46:15 +0000 (0:00:00.015) 0:00:29.719 ******** 2026-03-19 12:46:15.180985 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2026-03-19 12:46:15.222407 | controller | 2026-03-19 12:46:15.222426 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2026-03-19 12:46:15.222433 | controller | Thursday 19 March 2026 12:46:15 +0000 (0:00:00.068) 0:00:29.787 ******** 2026-03-19 12:46:15.222442 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2026-03-19 12:46:15.270422 | controller | 2026-03-19 12:46:15.270468 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-03-19 12:46:15.270477 | controller | Thursday 19 March 2026 12:46:15 +0000 (0:00:00.041) 0:00:29.828 ******** 2026-03-19 12:46:15.270491 | controller | ok: [instance] => (item=compute) 2026-03-19 12:46:15.310430 | controller | ok: [instance] => (item=controller) 2026-03-19 12:46:15.310484 | controller | ok: [instance] => (item=crc) 2026-03-19 12:46:15.310492 | controller | 2026-03-19 12:46:15.310499 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-03-19 12:46:15.310513 | controller | Thursday 19 March 2026 12:46:15 +0000 (0:00:00.047) 0:00:29.876 ******** 2026-03-19 12:46:15.310526 | controller | ok: [instance] 2026-03-19 12:46:15.350424 | controller | 2026-03-19 12:46:15.350440 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-03-19 12:46:15.350447 | controller | Thursday 19 March 2026 12:46:15 +0000 (0:00:00.040) 0:00:29.916 ******** 2026-03-19 12:46:15.350455 | controller | ok: [instance] => changed=false 2026-03-19 12:46:15.350501 | controller | msg: All assertions passed 2026-03-19 12:46:15.350508 | controller | 2026-03-19 12:46:15.350516 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2026-03-19 12:46:15.350632 | controller | Thursday 19 March 2026 12:46:15 +0000 (0:00:00.040) 0:00:29.957 ******** 2026-03-19 12:46:15.393418 | controller | 2026-03-19 12:46:15.393569 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2026-03-19 12:46:15.393700 | controller | Thursday 19 March 2026 12:46:15 +0000 (0:00:00.042) 0:00:29.999 ******** 2026-03-19 12:46:15.472674 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.54', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2026-03-19 12:46:15.472804 | controller | ok: [instance] => (item={}) 2026-03-19 12:46:15.472914 | controller | 2026-03-19 12:46:15.473027 | controller | TASK [devscripts : Check if num_masters is equal to 1 when cifmw_devscripts_sno] *** 2026-03-19 12:46:15.473136 | controller | Thursday 19 March 2026 12:46:15 +0000 (0:00:00.079) 0:00:30.079 ******** 2026-03-19 12:46:15.502494 | controller | skipping: [instance] 2026-03-19 12:46:15.502618 | controller | 2026-03-19 12:46:15.502782 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2026-03-19 12:46:15.502862 | controller | Thursday 19 March 2026 12:46:15 +0000 (0:00:00.029) 0:00:30.109 ******** 2026-03-19 12:46:15.521564 | controller | skipping: [instance] 2026-03-19 12:46:15.521687 | controller | 2026-03-19 12:46:15.521849 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2026-03-19 12:46:15.521934 | controller | Thursday 19 March 2026 12:46:15 +0000 (0:00:00.018) 0:00:30.128 ******** 2026-03-19 12:46:15.731444 | controller | ok: [instance] 2026-03-19 12:46:15.731591 | controller | 2026-03-19 12:46:15.731618 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2026-03-19 12:46:15.731630 | controller | Thursday 19 March 2026 12:46:15 +0000 (0:00:00.209) 0:00:30.337 ******** 2026-03-19 12:46:16.061835 | controller | changed: [instance] 2026-03-19 12:46:16.774444 | controller | 2026-03-19 12:46:16.774476 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2026-03-19 12:46:16.774484 | controller | Thursday 19 March 2026 12:46:16 +0000 (0:00:00.330) 0:00:30.668 ******** 2026-03-19 12:46:16.774494 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2026-03-19 12:46:16.774621 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2026-03-19 12:46:16.774632 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2026-03-19 12:46:16.774638 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2026-03-19 12:46:16.774644 | controller | 2026-03-19 12:46:16.774649 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2026-03-19 12:46:16.774657 | controller | Thursday 19 March 2026 12:46:16 +0000 (0:00:00.712) 0:00:31.380 ******** 2026-03-19 12:46:16.801014 | controller | skipping: [instance] 2026-03-19 12:46:17.157066 | controller | 2026-03-19 12:46:17.157092 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2026-03-19 12:46:17.157100 | controller | Thursday 19 March 2026 12:46:16 +0000 (0:00:00.027) 0:00:31.407 ******** 2026-03-19 12:46:17.157109 | controller | changed: [instance] 2026-03-19 12:46:17.569210 | controller | 2026-03-19 12:46:17.569240 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2026-03-19 12:46:17.569248 | controller | Thursday 19 March 2026 12:46:17 +0000 (0:00:00.347) 0:00:31.754 ******** 2026-03-19 12:46:17.569254 | controller | 2026-03-19 12:46:17.569260 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-03-19 12:46:17.569265 | controller | Thursday 19 March 2026 12:46:17 +0000 (0:00:00.008) 0:00:31.763 ******** 2026-03-19 12:46:17.569275 | controller | changed: [instance] 2026-03-19 12:46:17.641950 | controller | 2026-03-19 12:46:17.641976 | controller | TASK [Ensure no default networks exists] *************************************** 2026-03-19 12:46:17.641983 | controller | Thursday 19 March 2026 12:46:17 +0000 (0:00:00.412) 0:00:32.175 ******** 2026-03-19 12:46:17.641999 | controller | 2026-03-19 12:46:18.809933 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2026-03-19 12:46:18.809973 | controller | Thursday 19 March 2026 12:46:17 +0000 (0:00:00.072) 0:00:32.248 ******** 2026-03-19 12:46:18.809985 | controller | ok: [instance] 2026-03-19 12:46:19.033480 | controller | 2026-03-19 12:46:19.033510 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2026-03-19 12:46:19.033518 | controller | Thursday 19 March 2026 12:46:18 +0000 (0:00:01.167) 0:00:33.416 ******** 2026-03-19 12:46:19.033528 | controller | ok: [instance] 2026-03-19 12:46:19.532537 | controller | 2026-03-19 12:46:19.532578 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2026-03-19 12:46:19.532588 | controller | Thursday 19 March 2026 12:46:19 +0000 (0:00:00.223) 0:00:33.639 ******** 2026-03-19 12:46:19.532601 | controller | ok: [instance] 2026-03-19 12:46:19.532634 | controller | 2026-03-19 12:46:19.532643 | controller | TASK [libvirt_manager : Removing default] ************************************** 2026-03-19 12:46:19.532653 | controller | Thursday 19 March 2026 12:46:19 +0000 (0:00:00.499) 0:00:34.138 ******** 2026-03-19 12:46:19.743226 | controller | ok: [instance] 2026-03-19 12:46:20.963804 | controller | 2026-03-19 12:46:20.963835 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2026-03-19 12:46:20.963848 | controller | Thursday 19 March 2026 12:46:19 +0000 (0:00:00.210) 0:00:34.349 ******** 2026-03-19 12:46:20.963859 | controller | ok: [instance] 2026-03-19 12:46:21.256008 | controller | 2026-03-19 12:46:21.256040 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2026-03-19 12:46:21.256048 | controller | Thursday 19 March 2026 12:46:20 +0000 (0:00:01.220) 0:00:35.570 ******** 2026-03-19 12:46:21.256058 | controller | ok: [instance] 2026-03-19 12:46:21.557157 | controller | 2026-03-19 12:46:21.557186 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2026-03-19 12:46:21.557194 | controller | Thursday 19 March 2026 12:46:21 +0000 (0:00:00.292) 0:00:35.862 ******** 2026-03-19 12:46:21.557204 | controller | changed: [instance] 2026-03-19 12:46:21.849405 | controller | 2026-03-19 12:46:21.849436 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2026-03-19 12:46:21.849445 | controller | Thursday 19 March 2026 12:46:21 +0000 (0:00:00.300) 0:00:36.163 ******** 2026-03-19 12:46:21.849455 | controller | changed: [instance] 2026-03-19 12:46:23.403329 | controller | 2026-03-19 12:46:23.403362 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2026-03-19 12:46:23.403370 | controller | Thursday 19 March 2026 12:46:21 +0000 (0:00:00.292) 0:00:36.455 ******** 2026-03-19 12:46:23.403399 | controller | changed: [instance] => (item=arptables) 2026-03-19 12:46:23.712236 | controller | changed: [instance] => (item=iptables) 2026-03-19 12:46:23.712268 | controller | changed: [instance] => (item=ip6tables) 2026-03-19 12:46:23.712276 | controller | 2026-03-19 12:46:23.712283 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2026-03-19 12:46:23.712289 | controller | Thursday 19 March 2026 12:46:23 +0000 (0:00:01.553) 0:00:38.009 ******** 2026-03-19 12:46:23.712299 | controller | ok: [instance] 2026-03-19 12:46:23.801339 | controller | 2026-03-19 12:46:23.801367 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2026-03-19 12:46:23.801398 | controller | Thursday 19 March 2026 12:46:23 +0000 (0:00:00.309) 0:00:38.318 ******** 2026-03-19 12:46:23.801411 | controller | ok: [instance] 2026-03-19 12:46:23.844026 | controller | 2026-03-19 12:46:23.844048 | controller | TASK [Ensure the required network configurations are applied] ****************** 2026-03-19 12:46:23.844057 | controller | Thursday 19 March 2026 12:46:23 +0000 (0:00:00.089) 0:00:38.407 ******** 2026-03-19 12:46:23.844068 | controller | 2026-03-19 12:46:23.865924 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2026-03-19 12:46:23.865943 | controller | Thursday 19 March 2026 12:46:23 +0000 (0:00:00.042) 0:00:38.450 ******** 2026-03-19 12:46:23.865953 | controller | skipping: [instance] 2026-03-19 12:46:23.887448 | controller | 2026-03-19 12:46:23.887480 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2026-03-19 12:46:23.887488 | controller | Thursday 19 March 2026 12:46:23 +0000 (0:00:00.021) 0:00:38.472 ******** 2026-03-19 12:46:23.887498 | controller | skipping: [instance] 2026-03-19 12:46:23.887524 | controller | 2026-03-19 12:46:23.887763 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-03-19 12:46:23.910056 | controller | Thursday 19 March 2026 12:46:23 +0000 (0:00:00.021) 0:00:38.494 ******** 2026-03-19 12:46:23.910082 | controller | skipping: [instance] 2026-03-19 12:46:23.935916 | controller | 2026-03-19 12:46:23.935935 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2026-03-19 12:46:23.935943 | controller | Thursday 19 March 2026 12:46:23 +0000 (0:00:00.022) 0:00:38.516 ******** 2026-03-19 12:46:23.935957 | controller | skipping: [instance] 2026-03-19 12:46:23.974508 | controller | 2026-03-19 12:46:23.974529 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2026-03-19 12:46:23.974536 | controller | Thursday 19 March 2026 12:46:23 +0000 (0:00:00.026) 0:00:38.542 ******** 2026-03-19 12:46:23.974545 | controller | ok: [instance] 2026-03-19 12:46:23.974708 | controller | 2026-03-19 12:46:23.974855 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2026-03-19 12:46:23.974987 | controller | Thursday 19 March 2026 12:46:23 +0000 (0:00:00.038) 0:00:38.581 ******** 2026-03-19 12:46:24.008583 | controller | skipping: [instance] 2026-03-19 12:46:24.008773 | controller | 2026-03-19 12:46:24.008950 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2026-03-19 12:46:24.009080 | controller | Thursday 19 March 2026 12:46:24 +0000 (0:00:00.033) 0:00:38.615 ******** 2026-03-19 12:46:24.030737 | controller | skipping: [instance] 2026-03-19 12:46:24.030915 | controller | 2026-03-19 12:46:24.031061 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2026-03-19 12:46:24.031190 | controller | Thursday 19 March 2026 12:46:24 +0000 (0:00:00.022) 0:00:38.637 ******** 2026-03-19 12:46:24.085044 | controller | ok: [instance] 2026-03-19 12:46:24.085209 | controller | 2026-03-19 12:46:24.085406 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2026-03-19 12:46:24.085594 | controller | Thursday 19 March 2026 12:46:24 +0000 (0:00:00.054) 0:00:38.691 ******** 2026-03-19 12:46:24.107117 | controller | skipping: [instance] 2026-03-19 12:46:24.107269 | controller | 2026-03-19 12:46:24.107456 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2026-03-19 12:46:24.107619 | controller | Thursday 19 March 2026 12:46:24 +0000 (0:00:00.022) 0:00:38.714 ******** 2026-03-19 12:46:24.156087 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2026-03-19 12:46:24.156238 | controller | 2026-03-19 12:46:24.156397 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-03-19 12:46:24.156546 | controller | Thursday 19 March 2026 12:46:24 +0000 (0:00:00.048) 0:00:38.762 ******** 2026-03-19 12:46:24.473405 | controller | ok: [instance -> localhost] 2026-03-19 12:46:24.473612 | controller | 2026-03-19 12:46:24.473800 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2026-03-19 12:46:24.473940 | controller | Thursday 19 March 2026 12:46:24 +0000 (0:00:00.317) 0:00:39.079 ******** 2026-03-19 12:46:29.960506 | controller | changed: [instance -> localhost] 2026-03-19 12:46:30.147981 | controller | 2026-03-19 12:46:30.148016 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-03-19 12:46:30.148025 | controller | Thursday 19 March 2026 12:46:29 +0000 (0:00:05.486) 0:00:44.566 ******** 2026-03-19 12:46:30.148037 | controller | changed: [instance] 2026-03-19 12:46:30.486547 | controller | 2026-03-19 12:46:30.486578 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2026-03-19 12:46:30.486586 | controller | Thursday 19 March 2026 12:46:30 +0000 (0:00:00.187) 0:00:44.754 ******** 2026-03-19 12:46:30.486596 | controller | changed: [instance] 2026-03-19 12:46:32.073975 | controller | 2026-03-19 12:46:32.074012 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2026-03-19 12:46:32.074022 | controller | Thursday 19 March 2026 12:46:30 +0000 (0:00:00.338) 0:00:45.092 ******** 2026-03-19 12:46:32.074033 | controller | changed: [instance -> localhost] 2026-03-19 12:46:32.074060 | controller | 2026-03-19 12:46:32.074070 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2026-03-19 12:46:32.074094 | controller | Thursday 19 March 2026 12:46:32 +0000 (0:00:01.587) 0:00:46.680 ******** 2026-03-19 12:46:32.417456 | controller | changed: [instance] 2026-03-19 12:46:32.417505 | controller | 2026-03-19 12:46:32.417513 | controller | TASK [reproducer : Select right domain] **************************************** 2026-03-19 12:46:32.417522 | controller | Thursday 19 March 2026 12:46:32 +0000 (0:00:00.343) 0:00:47.023 ******** 2026-03-19 12:46:32.448471 | controller | ok: [instance] 2026-03-19 12:46:32.448793 | controller | 2026-03-19 12:46:32.448858 | controller | TASK [Create the virtual networks] ********************************************* 2026-03-19 12:46:32.589864 | controller | Thursday 19 March 2026 12:46:32 +0000 (0:00:00.031) 0:00:47.054 ******** 2026-03-19 12:46:32.589902 | controller | 2026-03-19 12:46:32.608000 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2026-03-19 12:46:32.608022 | controller | Thursday 19 March 2026 12:46:32 +0000 (0:00:00.141) 0:00:47.196 ******** 2026-03-19 12:46:32.608034 | controller | ok: [instance] 2026-03-19 12:46:32.789709 | controller | 2026-03-19 12:46:32.789727 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2026-03-19 12:46:32.789742 | controller | Thursday 19 March 2026 12:46:32 +0000 (0:00:00.018) 0:00:47.214 ******** 2026-03-19 12:46:32.789751 | controller | ok: [instance] 2026-03-19 12:46:32.818804 | controller | 2026-03-19 12:46:32.818837 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2026-03-19 12:46:32.818844 | controller | Thursday 19 March 2026 12:46:32 +0000 (0:00:00.181) 0:00:47.396 ******** 2026-03-19 12:46:32.818856 | controller | skipping: [instance] 2026-03-19 12:46:32.849005 | controller | 2026-03-19 12:46:32.849024 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2026-03-19 12:46:32.849031 | controller | Thursday 19 March 2026 12:46:32 +0000 (0:00:00.029) 0:00:47.425 ******** 2026-03-19 12:46:32.849040 | controller | skipping: [instance] 2026-03-19 12:46:32.904276 | controller | 2026-03-19 12:46:32.904310 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2026-03-19 12:46:32.904318 | controller | Thursday 19 March 2026 12:46:32 +0000 (0:00:00.030) 0:00:47.455 ******** 2026-03-19 12:46:32.904327 | controller | ok: [instance] 2026-03-19 12:46:33.028206 | controller | 2026-03-19 12:46:33.028236 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2026-03-19 12:46:33.028244 | controller | Thursday 19 March 2026 12:46:32 +0000 (0:00:00.054) 0:00:47.510 ******** 2026-03-19 12:46:33.028254 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2026-03-19 12:46:33.061489 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2026-03-19 12:46:33.061522 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2026-03-19 12:46:33.061530 | controller | 2026-03-19 12:46:33.061536 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2026-03-19 12:46:33.061541 | controller | Thursday 19 March 2026 12:46:33 +0000 (0:00:00.123) 0:00:47.634 ******** 2026-03-19 12:46:33.061552 | controller | skipping: [instance] 2026-03-19 12:46:33.399683 | controller | 2026-03-19 12:46:33.399722 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2026-03-19 12:46:33.399731 | controller | Thursday 19 March 2026 12:46:33 +0000 (0:00:00.033) 0:00:47.667 ******** 2026-03-19 12:46:33.399743 | controller | changed: [instance] 2026-03-19 12:46:33.399828 | controller | 2026-03-19 12:46:33.399958 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2026-03-19 12:46:33.400072 | controller | Thursday 19 March 2026 12:46:33 +0000 (0:00:00.338) 0:00:48.006 ******** 2026-03-19 12:46:33.489928 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2026-03-19 12:46:33.490056 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2026-03-19 12:46:33.490171 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2026-03-19 12:46:33.490277 | controller | 2026-03-19 12:46:33.490390 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-03-19 12:46:33.490519 | controller | Thursday 19 March 2026 12:46:33 +0000 (0:00:00.090) 0:00:48.096 ******** 2026-03-19 12:46:33.542525 | controller | changed: [instance] 2026-03-19 12:46:33.542641 | controller | 2026-03-19 12:46:33.542779 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-03-19 12:46:33.542923 | controller | Thursday 19 March 2026 12:46:33 +0000 (0:00:00.052) 0:00:48.149 ******** 2026-03-19 12:46:33.822256 | controller | changed: [instance] 2026-03-19 12:46:34.033981 | controller | 2026-03-19 12:46:34.034016 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-03-19 12:46:34.034025 | controller | Thursday 19 March 2026 12:46:33 +0000 (0:00:00.279) 0:00:48.428 ******** 2026-03-19 12:46:34.034037 | controller | changed: [instance] 2026-03-19 12:46:34.092100 | controller | 2026-03-19 12:46:34.092128 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-03-19 12:46:34.092137 | controller | Thursday 19 March 2026 12:46:34 +0000 (0:00:00.211) 0:00:48.640 ******** 2026-03-19 12:46:34.092148 | controller | changed: [instance] 2026-03-19 12:46:34.291135 | controller | 2026-03-19 12:46:34.291167 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-03-19 12:46:34.291175 | controller | Thursday 19 March 2026 12:46:34 +0000 (0:00:00.058) 0:00:48.698 ******** 2026-03-19 12:46:34.291185 | controller | changed: [instance] 2026-03-19 12:46:34.507246 | controller | 2026-03-19 12:46:34.507279 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-03-19 12:46:34.507287 | controller | Thursday 19 March 2026 12:46:34 +0000 (0:00:00.198) 0:00:48.897 ******** 2026-03-19 12:46:34.507297 | controller | changed: [instance] 2026-03-19 12:46:34.560328 | controller | 2026-03-19 12:46:34.560351 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-03-19 12:46:34.560360 | controller | Thursday 19 March 2026 12:46:34 +0000 (0:00:00.216) 0:00:49.113 ******** 2026-03-19 12:46:34.560371 | controller | changed: [instance] 2026-03-19 12:46:34.762959 | controller | 2026-03-19 12:46:34.762985 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-03-19 12:46:34.762993 | controller | Thursday 19 March 2026 12:46:34 +0000 (0:00:00.053) 0:00:49.166 ******** 2026-03-19 12:46:34.763009 | controller | changed: [instance] 2026-03-19 12:46:34.973494 | controller | 2026-03-19 12:46:34.973525 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-03-19 12:46:34.973533 | controller | Thursday 19 March 2026 12:46:34 +0000 (0:00:00.202) 0:00:49.369 ******** 2026-03-19 12:46:34.973543 | controller | changed: [instance] 2026-03-19 12:46:35.165516 | controller | 2026-03-19 12:46:35.165555 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2026-03-19 12:46:35.165565 | controller | Thursday 19 March 2026 12:46:34 +0000 (0:00:00.210) 0:00:49.579 ******** 2026-03-19 12:46:35.165578 | controller | ok: [instance] 2026-03-19 12:46:35.665692 | controller | 2026-03-19 12:46:35.665722 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2026-03-19 12:46:35.665730 | controller | Thursday 19 March 2026 12:46:35 +0000 (0:00:00.191) 0:00:49.771 ******** 2026-03-19 12:46:35.665740 | controller | changed: [instance] 2026-03-19 12:46:35.846311 | controller | 2026-03-19 12:46:35.846343 | controller | TASK [libvirt_manager : Remove ini file after conversion] ********************** 2026-03-19 12:46:35.846353 | controller | Thursday 19 March 2026 12:46:35 +0000 (0:00:00.500) 0:00:50.271 ******** 2026-03-19 12:46:35.846364 | controller | changed: [instance] 2026-03-19 12:46:35.868940 | controller | 2026-03-19 12:46:35.868960 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-03-19 12:46:35.868967 | controller | Thursday 19 March 2026 12:46:35 +0000 (0:00:00.180) 0:00:50.452 ******** 2026-03-19 12:46:35.868976 | controller | skipping: [instance] 2026-03-19 12:46:35.892278 | controller | 2026-03-19 12:46:35.892307 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-03-19 12:46:35.892316 | controller | Thursday 19 March 2026 12:46:35 +0000 (0:00:00.022) 0:00:50.475 ******** 2026-03-19 12:46:35.892327 | controller | skipping: [instance] 2026-03-19 12:46:35.916283 | controller | 2026-03-19 12:46:35.916305 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-03-19 12:46:35.916314 | controller | Thursday 19 March 2026 12:46:35 +0000 (0:00:00.023) 0:00:50.498 ******** 2026-03-19 12:46:35.916324 | controller | skipping: [instance] 2026-03-19 12:46:35.940586 | controller | 2026-03-19 12:46:35.940604 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-03-19 12:46:35.940612 | controller | Thursday 19 March 2026 12:46:35 +0000 (0:00:00.024) 0:00:50.522 ******** 2026-03-19 12:46:35.940621 | controller | skipping: [instance] 2026-03-19 12:46:35.940756 | controller | 2026-03-19 12:46:35.940903 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-03-19 12:46:35.941034 | controller | Thursday 19 March 2026 12:46:35 +0000 (0:00:00.024) 0:00:50.547 ******** 2026-03-19 12:46:35.959920 | controller | ok: [instance] 2026-03-19 12:46:35.960065 | controller | 2026-03-19 12:46:35.960200 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-03-19 12:46:35.960336 | controller | Thursday 19 March 2026 12:46:35 +0000 (0:00:00.019) 0:00:50.566 ******** 2026-03-19 12:46:36.044348 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-03-19 12:46:36.044535 | controller | 2026-03-19 12:46:36.044678 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-03-19 12:46:36.044808 | controller | Thursday 19 March 2026 12:46:36 +0000 (0:00:00.084) 0:00:50.651 ******** 2026-03-19 12:46:36.062627 | controller | skipping: [instance] 2026-03-19 12:46:36.062765 | controller | 2026-03-19 12:46:36.062926 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-03-19 12:46:36.063058 | controller | Thursday 19 March 2026 12:46:36 +0000 (0:00:00.018) 0:00:50.669 ******** 2026-03-19 12:46:36.267892 | controller | changed: [instance] 2026-03-19 12:46:36.661514 | controller | 2026-03-19 12:46:36.661555 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-03-19 12:46:36.661565 | controller | Thursday 19 March 2026 12:46:36 +0000 (0:00:00.204) 0:00:50.874 ******** 2026-03-19 12:46:36.661578 | controller | changed: [instance] 2026-03-19 12:46:36.721513 | controller | 2026-03-19 12:46:36.721546 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-03-19 12:46:36.721556 | controller | Thursday 19 March 2026 12:46:36 +0000 (0:00:00.393) 0:00:51.267 ******** 2026-03-19 12:46:36.721568 | controller | ok: [instance] 2026-03-19 12:46:36.721596 | controller | 2026-03-19 12:46:36.721606 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-03-19 12:46:36.721727 | controller | Thursday 19 March 2026 12:46:36 +0000 (0:00:00.060) 0:00:51.328 ******** 2026-03-19 12:46:36.752066 | controller | ok: [instance] 2026-03-19 12:46:37.133461 | controller | 2026-03-19 12:46:37.133494 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-03-19 12:46:37.133512 | controller | Thursday 19 March 2026 12:46:36 +0000 (0:00:00.030) 0:00:51.358 ******** 2026-03-19 12:46:37.133523 | controller | changed: [instance] 2026-03-19 12:46:37.133653 | controller | 2026-03-19 12:46:37.133688 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2026-03-19 12:46:37.133702 | controller | Thursday 19 March 2026 12:46:37 +0000 (0:00:00.381) 0:00:51.739 ******** 2026-03-19 12:46:37.216991 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2026-03-19 12:46:37.265508 | controller | 2026-03-19 12:46:37.265543 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2026-03-19 12:46:37.265551 | controller | Thursday 19 March 2026 12:46:37 +0000 (0:00:00.083) 0:00:51.823 ******** 2026-03-19 12:46:37.265562 | controller | ok: [instance] => (item=public) 2026-03-19 12:46:37.265588 | controller | ok: [instance] => (item=osp_trunk) 2026-03-19 12:46:37.265594 | controller | 2026-03-19 12:46:37.265602 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2026-03-19 12:46:37.265679 | controller | Thursday 19 March 2026 12:46:37 +0000 (0:00:00.048) 0:00:51.872 ******** 2026-03-19 12:46:37.698421 | controller | changed: [instance] => (item=cifmw-public) 2026-03-19 12:46:38.261692 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-03-19 12:46:38.261722 | controller | 2026-03-19 12:46:38.261730 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2026-03-19 12:46:38.261736 | controller | Thursday 19 March 2026 12:46:37 +0000 (0:00:00.432) 0:00:52.304 ******** 2026-03-19 12:46:38.261746 | controller | ok: [instance] => (item=cifmw-public) 2026-03-19 12:46:38.682167 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-19 12:46:38.682199 | controller | 2026-03-19 12:46:38.682207 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2026-03-19 12:46:38.682213 | controller | Thursday 19 March 2026 12:46:38 +0000 (0:00:00.563) 0:00:52.867 ******** 2026-03-19 12:46:38.682224 | controller | ok: [instance] => (item=cifmw-public) 2026-03-19 12:46:39.100467 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-19 12:46:39.100499 | controller | 2026-03-19 12:46:39.100507 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2026-03-19 12:46:39.100513 | controller | Thursday 19 March 2026 12:46:38 +0000 (0:00:00.420) 0:00:53.288 ******** 2026-03-19 12:46:39.100523 | controller | changed: [instance] => (item=cifmw-public) 2026-03-19 12:46:39.160421 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-03-19 12:46:39.160451 | controller | 2026-03-19 12:46:39.160460 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2026-03-19 12:46:39.160468 | controller | Thursday 19 March 2026 12:46:39 +0000 (0:00:00.418) 0:00:53.706 ******** 2026-03-19 12:46:39.160480 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2026-03-19 12:46:39.344870 | controller | 2026-03-19 12:46:39.344894 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2026-03-19 12:46:39.344902 | controller | Thursday 19 March 2026 12:46:39 +0000 (0:00:00.060) 0:00:53.766 ******** 2026-03-19 12:46:39.344924 | controller | ok: [instance] 2026-03-19 12:46:39.719855 | controller | 2026-03-19 12:46:39.719886 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2026-03-19 12:46:39.719894 | controller | Thursday 19 March 2026 12:46:39 +0000 (0:00:00.184) 0:00:53.951 ******** 2026-03-19 12:46:39.719905 | controller | ok: [instance] => (item=cifmw-public) 2026-03-19 12:46:39.789508 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-19 12:46:39.789561 | controller | 2026-03-19 12:46:39.789575 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2026-03-19 12:46:39.789586 | controller | Thursday 19 March 2026 12:46:39 +0000 (0:00:00.374) 0:00:54.325 ******** 2026-03-19 12:46:39.789604 | controller | 2026-03-19 12:46:39.826449 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-03-19 12:46:39.826475 | controller | Thursday 19 March 2026 12:46:39 +0000 (0:00:00.069) 0:00:54.395 ******** 2026-03-19 12:46:39.826492 | controller | skipping: [instance] 2026-03-19 12:46:41.094526 | controller | 2026-03-19 12:46:41.094562 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2026-03-19 12:46:41.094572 | controller | Thursday 19 March 2026 12:46:39 +0000 (0:00:00.037) 0:00:54.432 ******** 2026-03-19 12:46:41.094589 | controller | ok: [instance] 2026-03-19 12:46:41.282068 | controller | 2026-03-19 12:46:41.282100 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-03-19 12:46:41.282108 | controller | Thursday 19 March 2026 12:46:41 +0000 (0:00:01.267) 0:00:55.700 ******** 2026-03-19 12:46:41.282118 | controller | ok: [instance] 2026-03-19 12:46:41.636488 | controller | 2026-03-19 12:46:41.636521 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2026-03-19 12:46:41.636529 | controller | Thursday 19 March 2026 12:46:41 +0000 (0:00:00.187) 0:00:55.888 ******** 2026-03-19 12:46:41.636540 | controller | changed: [instance] 2026-03-19 12:46:43.281866 | controller | 2026-03-19 12:46:43.281897 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2026-03-19 12:46:43.281905 | controller | Thursday 19 March 2026 12:46:41 +0000 (0:00:00.354) 0:00:56.242 ******** 2026-03-19 12:46:43.281922 | controller | changed: [instance] 2026-03-19 12:46:43.630422 | controller | 2026-03-19 12:46:43.630454 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2026-03-19 12:46:43.630462 | controller | Thursday 19 March 2026 12:46:43 +0000 (0:00:01.645) 0:00:57.888 ******** 2026-03-19 12:46:43.630478 | controller | changed: [instance] 2026-03-19 12:46:43.663407 | controller | 2026-03-19 12:46:43.663428 | controller | TASK [Create extra network configuration] ************************************** 2026-03-19 12:46:43.663435 | controller | Thursday 19 March 2026 12:46:43 +0000 (0:00:00.348) 0:00:58.236 ******** 2026-03-19 12:46:43.663444 | controller | skipping: [instance] 2026-03-19 12:46:43.690901 | controller | 2026-03-19 12:46:43.690928 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2026-03-19 12:46:43.690941 | controller | Thursday 19 March 2026 12:46:43 +0000 (0:00:00.033) 0:00:58.269 ******** 2026-03-19 12:46:43.690951 | controller | skipping: [instance] 2026-03-19 12:46:44.125170 | controller | 2026-03-19 12:46:44.125206 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2026-03-19 12:46:44.125216 | controller | Thursday 19 March 2026 12:46:43 +0000 (0:00:00.027) 0:00:58.297 ******** 2026-03-19 12:46:44.125226 | controller | ok: [instance] 2026-03-19 12:46:44.266551 | controller | 2026-03-19 12:46:44.266589 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2026-03-19 12:46:44.266602 | controller | Thursday 19 March 2026 12:46:44 +0000 (0:00:00.434) 0:00:58.731 ******** 2026-03-19 12:46:44.266616 | controller | ok: [instance] => (item=cifmw-public) 2026-03-19 12:46:44.266655 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-19 12:46:44.266664 | controller | 2026-03-19 12:46:44.266826 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2026-03-19 12:46:45.524882 | controller | Thursday 19 March 2026 12:46:44 +0000 (0:00:00.141) 0:00:58.872 ******** 2026-03-19 12:46:45.524920 | controller | ok: [instance] 2026-03-19 12:46:49.239155 | controller | 2026-03-19 12:46:49.239186 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2026-03-19 12:46:49.239194 | controller | Thursday 19 March 2026 12:46:45 +0000 (0:00:01.258) 0:01:00.131 ******** 2026-03-19 12:46:49.239204 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2026-03-19 12:46:49.466195 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2026-03-19 12:46:49.466227 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2026-03-19 12:46:49.466242 | controller | 2026-03-19 12:46:49.466250 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2026-03-19 12:46:49.466257 | controller | Thursday 19 March 2026 12:46:49 +0000 (0:00:03.714) 0:01:03.845 ******** 2026-03-19 12:46:49.466268 | controller | changed: [instance] 2026-03-19 12:46:49.824485 | controller | 2026-03-19 12:46:49.824515 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2026-03-19 12:46:49.824523 | controller | Thursday 19 March 2026 12:46:49 +0000 (0:00:00.227) 0:01:04.072 ******** 2026-03-19 12:46:49.824533 | controller | changed: [instance] 2026-03-19 12:46:49.824719 | controller | 2026-03-19 12:46:49.824751 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2026-03-19 12:46:50.209487 | controller | Thursday 19 March 2026 12:46:49 +0000 (0:00:00.358) 0:01:04.430 ******** 2026-03-19 12:46:50.209530 | controller | changed: [instance] 2026-03-19 12:46:50.209615 | controller | 2026-03-19 12:46:50.209646 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2026-03-19 12:46:50.209659 | controller | Thursday 19 March 2026 12:46:50 +0000 (0:00:00.384) 0:01:04.815 ******** 2026-03-19 12:46:50.241167 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2026-03-19 12:46:50.618967 | controller | 2026-03-19 12:46:50.619003 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2026-03-19 12:46:50.619011 | controller | Thursday 19 March 2026 12:46:50 +0000 (0:00:00.031) 0:01:04.847 ******** 2026-03-19 12:46:50.619022 | controller | changed: [instance] 2026-03-19 12:46:50.637517 | controller | 2026-03-19 12:46:50.637557 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2026-03-19 12:46:50.637568 | controller | Thursday 19 March 2026 12:46:50 +0000 (0:00:00.377) 0:01:05.225 ******** 2026-03-19 12:46:50.637581 | controller | skipping: [instance] 2026-03-19 12:46:50.637613 | controller | 2026-03-19 12:46:50.637623 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2026-03-19 12:46:50.637728 | controller | Thursday 19 March 2026 12:46:50 +0000 (0:00:00.018) 0:01:05.244 ******** 2026-03-19 12:46:50.670476 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2026-03-19 12:46:50.670626 | controller | 2026-03-19 12:46:50.670666 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2026-03-19 12:46:50.670684 | controller | Thursday 19 March 2026 12:46:50 +0000 (0:00:00.033) 0:01:05.277 ******** 2026-03-19 12:46:51.036985 | controller | changed: [instance] 2026-03-19 12:46:51.079681 | controller | 2026-03-19 12:46:51.079713 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2026-03-19 12:46:51.079721 | controller | Thursday 19 March 2026 12:46:51 +0000 (0:00:00.366) 0:01:05.643 ******** 2026-03-19 12:46:51.079730 | controller | skipping: [instance] 2026-03-19 12:46:51.288470 | controller | 2026-03-19 12:46:51.288513 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2026-03-19 12:46:51.288523 | controller | Thursday 19 March 2026 12:46:51 +0000 (0:00:00.042) 0:01:05.685 ******** 2026-03-19 12:46:51.288537 | controller | ok: [instance] => (item=127.0.0.2) 2026-03-19 12:46:51.970448 | controller | 2026-03-19 12:46:51.970477 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2026-03-19 12:46:51.970485 | controller | Thursday 19 March 2026 12:46:51 +0000 (0:00:00.208) 0:01:05.894 ******** 2026-03-19 12:46:51.970496 | controller | changed: [instance] 2026-03-19 12:46:51.990869 | controller | 2026-03-19 12:46:51.990896 | controller | TASK [dnsmasq : Stop service] ************************************************** 2026-03-19 12:46:51.990906 | controller | Thursday 19 March 2026 12:46:51 +0000 (0:00:00.681) 0:01:06.576 ******** 2026-03-19 12:46:51.990918 | controller | skipping: [instance] 2026-03-19 12:46:52.009431 | controller | 2026-03-19 12:46:52.009450 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2026-03-19 12:46:52.009457 | controller | Thursday 19 March 2026 12:46:51 +0000 (0:00:00.020) 0:01:06.597 ******** 2026-03-19 12:46:52.009466 | controller | skipping: [instance] 2026-03-19 12:46:52.009760 | controller | 2026-03-19 12:46:52.039579 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2026-03-19 12:46:52.039626 | controller | Thursday 19 March 2026 12:46:52 +0000 (0:00:00.018) 0:01:06.616 ******** 2026-03-19 12:46:52.039647 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-03-19 12:46:52.159587 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2026-03-19 12:46:52.159624 | controller | skipping: [instance] 2026-03-19 12:46:52.159637 | controller | 2026-03-19 12:46:52.159648 | controller | TASK [Create dnsmasq networks] ************************************************* 2026-03-19 12:46:52.159655 | controller | Thursday 19 March 2026 12:46:52 +0000 (0:00:00.029) 0:01:06.645 ******** 2026-03-19 12:46:52.159664 | controller | 2026-03-19 12:46:52.191364 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-03-19 12:46:52.191430 | controller | Thursday 19 March 2026 12:46:52 +0000 (0:00:00.119) 0:01:06.765 ******** 2026-03-19 12:46:52.191449 | controller | ok: [instance] => changed=false 2026-03-19 12:46:52.230158 | controller | msg: All assertions passed 2026-03-19 12:46:52.230180 | controller | 2026-03-19 12:46:52.230190 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-03-19 12:46:52.230197 | controller | Thursday 19 March 2026 12:46:52 +0000 (0:00:00.031) 0:01:06.797 ******** 2026-03-19 12:46:52.230208 | controller | ok: [instance] => changed=false 2026-03-19 12:46:52.230410 | controller | msg: All assertions passed 2026-03-19 12:46:52.230587 | controller | 2026-03-19 12:46:52.230747 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-03-19 12:46:52.230883 | controller | Thursday 19 March 2026 12:46:52 +0000 (0:00:00.039) 0:01:06.836 ******** 2026-03-19 12:46:52.667905 | controller | changed: [instance] 2026-03-19 12:46:52.687922 | controller | 2026-03-19 12:46:52.687942 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-03-19 12:46:52.687949 | controller | Thursday 19 March 2026 12:46:52 +0000 (0:00:00.437) 0:01:07.274 ******** 2026-03-19 12:46:52.687958 | controller | skipping: [instance] 2026-03-19 12:46:52.712303 | controller | 2026-03-19 12:46:52.712320 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-03-19 12:46:52.712327 | controller | Thursday 19 March 2026 12:46:52 +0000 (0:00:00.020) 0:01:07.294 ******** 2026-03-19 12:46:52.712335 | controller | skipping: [instance] 2026-03-19 12:46:52.743362 | controller | 2026-03-19 12:46:52.743405 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-03-19 12:46:52.743414 | controller | Thursday 19 March 2026 12:46:52 +0000 (0:00:00.024) 0:01:07.318 ******** 2026-03-19 12:46:52.743423 | controller | ok: [instance] => changed=false 2026-03-19 12:46:52.782889 | controller | msg: All assertions passed 2026-03-19 12:46:52.782905 | controller | 2026-03-19 12:46:52.782911 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-03-19 12:46:52.782917 | controller | Thursday 19 March 2026 12:46:52 +0000 (0:00:00.030) 0:01:07.349 ******** 2026-03-19 12:46:52.782924 | controller | ok: [instance] => changed=false 2026-03-19 12:46:53.211801 | controller | msg: All assertions passed 2026-03-19 12:46:53.211833 | controller | 2026-03-19 12:46:53.211841 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-03-19 12:46:53.211848 | controller | Thursday 19 March 2026 12:46:52 +0000 (0:00:00.039) 0:01:07.389 ******** 2026-03-19 12:46:53.211858 | controller | changed: [instance] 2026-03-19 12:46:53.232026 | controller | 2026-03-19 12:46:53.232050 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-03-19 12:46:53.232059 | controller | Thursday 19 March 2026 12:46:53 +0000 (0:00:00.428) 0:01:07.817 ******** 2026-03-19 12:46:53.232076 | controller | skipping: [instance] 2026-03-19 12:46:53.258209 | controller | 2026-03-19 12:46:53.258231 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-03-19 12:46:53.258241 | controller | Thursday 19 March 2026 12:46:53 +0000 (0:00:00.020) 0:01:07.838 ******** 2026-03-19 12:46:53.258251 | controller | skipping: [instance] 2026-03-19 12:46:53.293297 | controller | 2026-03-19 12:46:53.293320 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2026-03-19 12:46:53.293329 | controller | Thursday 19 March 2026 12:46:53 +0000 (0:00:00.026) 0:01:07.864 ******** 2026-03-19 12:46:53.293340 | controller | skipping: [instance] 2026-03-19 12:46:53.784857 | controller | 2026-03-19 12:46:53.784887 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2026-03-19 12:46:53.784900 | controller | Thursday 19 March 2026 12:46:53 +0000 (0:00:00.035) 0:01:07.899 ******** 2026-03-19 12:46:53.784910 | controller | changed: [instance] => (item=cifmw-public) 2026-03-19 12:46:53.821344 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-03-19 12:46:53.821393 | controller | 2026-03-19 12:46:53.821405 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-03-19 12:46:53.821412 | controller | Thursday 19 March 2026 12:46:53 +0000 (0:00:00.491) 0:01:08.391 ******** 2026-03-19 12:46:53.821423 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2026-03-19 12:46:54.148930 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2026-03-19 12:46:54.148961 | controller | 2026-03-19 12:46:54.148969 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-03-19 12:46:54.148975 | controller | Thursday 19 March 2026 12:46:53 +0000 (0:00:00.036) 0:01:08.427 ******** 2026-03-19 12:46:54.148985 | controller | ok: [instance] 2026-03-19 12:46:54.184873 | controller | 2026-03-19 12:46:54.184898 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-03-19 12:46:54.184906 | controller | Thursday 19 March 2026 12:46:54 +0000 (0:00:00.327) 0:01:08.755 ******** 2026-03-19 12:46:54.184916 | controller | ok: [instance] 2026-03-19 12:46:54.386984 | controller | 2026-03-19 12:46:54.387013 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-03-19 12:46:54.387022 | controller | Thursday 19 March 2026 12:46:54 +0000 (0:00:00.036) 0:01:08.791 ******** 2026-03-19 12:46:54.387032 | controller | ok: [instance] 2026-03-19 12:46:54.421227 | controller | 2026-03-19 12:46:54.421248 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-03-19 12:46:54.421255 | controller | Thursday 19 March 2026 12:46:54 +0000 (0:00:00.201) 0:01:08.993 ******** 2026-03-19 12:46:54.421265 | controller | ok: [instance] 2026-03-19 12:46:54.750500 | controller | 2026-03-19 12:46:54.750536 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2026-03-19 12:46:54.750546 | controller | Thursday 19 March 2026 12:46:54 +0000 (0:00:00.034) 0:01:09.027 ******** 2026-03-19 12:46:54.750558 | controller | changed: [instance] 2026-03-19 12:46:54.750590 | controller | 2026-03-19 12:46:54.750725 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2026-03-19 12:46:54.750750 | controller | Thursday 19 March 2026 12:46:54 +0000 (0:00:00.329) 0:01:09.357 ******** 2026-03-19 12:46:55.092394 | controller | changed: [instance] 2026-03-19 12:46:55.434502 | controller | 2026-03-19 12:46:55.434537 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2026-03-19 12:46:55.434547 | controller | Thursday 19 March 2026 12:46:55 +0000 (0:00:00.341) 0:01:09.698 ******** 2026-03-19 12:46:55.434560 | controller | changed: [instance] 2026-03-19 12:46:55.530477 | controller | 2026-03-19 12:46:55.530512 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2026-03-19 12:46:55.530521 | controller | Thursday 19 March 2026 12:46:55 +0000 (0:00:00.342) 0:01:10.040 ******** 2026-03-19 12:46:55.530532 | controller | ok: [instance] 2026-03-19 12:46:55.530662 | controller | 2026-03-19 12:46:55.530697 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2026-03-19 12:46:55.530716 | controller | Thursday 19 March 2026 12:46:55 +0000 (0:00:00.096) 0:01:10.136 ******** 2026-03-19 12:46:55.871341 | controller | changed: [instance] 2026-03-19 12:46:55.896494 | controller | 2026-03-19 12:46:55.896530 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-03-19 12:46:55.896541 | controller | Thursday 19 March 2026 12:46:55 +0000 (0:00:00.340) 0:01:10.477 ******** 2026-03-19 12:46:55.896553 | controller | skipping: [instance] 2026-03-19 12:46:55.896580 | controller | 2026-03-19 12:46:55.896589 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-03-19 12:46:55.896598 | controller | Thursday 19 March 2026 12:46:55 +0000 (0:00:00.025) 0:01:10.502 ******** 2026-03-19 12:46:55.921395 | controller | skipping: [instance] 2026-03-19 12:46:55.946469 | controller | 2026-03-19 12:46:55.946490 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-03-19 12:46:55.946505 | controller | Thursday 19 March 2026 12:46:55 +0000 (0:00:00.024) 0:01:10.527 ******** 2026-03-19 12:46:55.946516 | controller | skipping: [instance] 2026-03-19 12:46:55.946696 | controller | 2026-03-19 12:46:55.946727 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-03-19 12:46:55.946746 | controller | Thursday 19 March 2026 12:46:55 +0000 (0:00:00.024) 0:01:10.552 ******** 2026-03-19 12:46:55.970906 | controller | skipping: [instance] 2026-03-19 12:46:55.990759 | controller | 2026-03-19 12:46:55.990777 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-03-19 12:46:55.990785 | controller | Thursday 19 March 2026 12:46:55 +0000 (0:00:00.024) 0:01:10.577 ******** 2026-03-19 12:46:55.990793 | controller | ok: [instance] 2026-03-19 12:46:56.082256 | controller | 2026-03-19 12:46:56.082276 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-03-19 12:46:56.082288 | controller | Thursday 19 March 2026 12:46:55 +0000 (0:00:00.019) 0:01:10.597 ******** 2026-03-19 12:46:56.082307 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-03-19 12:46:56.082666 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-03-19 12:46:56.082931 | controller | 2026-03-19 12:46:56.083162 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-03-19 12:46:56.083294 | controller | Thursday 19 March 2026 12:46:56 +0000 (0:00:00.091) 0:01:10.688 ******** 2026-03-19 12:46:56.101135 | controller | skipping: [instance] 2026-03-19 12:46:56.101300 | controller | 2026-03-19 12:46:56.101467 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-03-19 12:46:56.101602 | controller | Thursday 19 March 2026 12:46:56 +0000 (0:00:00.019) 0:01:10.708 ******** 2026-03-19 12:46:56.304490 | controller | ok: [instance] 2026-03-19 12:46:56.304702 | controller | 2026-03-19 12:46:56.304726 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-03-19 12:46:56.706343 | controller | Thursday 19 March 2026 12:46:56 +0000 (0:00:00.203) 0:01:10.911 ******** 2026-03-19 12:46:56.706397 | controller | changed: [instance] 2026-03-19 12:46:56.769414 | controller | 2026-03-19 12:46:56.769435 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-03-19 12:46:56.769443 | controller | Thursday 19 March 2026 12:46:56 +0000 (0:00:00.401) 0:01:11.312 ******** 2026-03-19 12:46:56.769452 | controller | ok: [instance] 2026-03-19 12:46:56.802115 | controller | 2026-03-19 12:46:56.802134 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-03-19 12:46:56.802142 | controller | Thursday 19 March 2026 12:46:56 +0000 (0:00:00.062) 0:01:11.375 ******** 2026-03-19 12:46:56.802151 | controller | ok: [instance] 2026-03-19 12:46:57.211348 | controller | 2026-03-19 12:46:57.211404 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-03-19 12:46:57.211416 | controller | Thursday 19 March 2026 12:46:56 +0000 (0:00:00.032) 0:01:11.408 ******** 2026-03-19 12:46:57.211427 | controller | changed: [instance] 2026-03-19 12:46:57.299146 | controller | 2026-03-19 12:46:57.299200 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2026-03-19 12:46:57.299214 | controller | Thursday 19 March 2026 12:46:57 +0000 (0:00:00.409) 0:01:11.817 ******** 2026-03-19 12:46:57.299231 | controller | ok: [instance] 2026-03-19 12:46:57.318031 | controller | 2026-03-19 12:46:57.318053 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2026-03-19 12:46:57.318062 | controller | Thursday 19 March 2026 12:46:57 +0000 (0:00:00.087) 0:01:11.905 ******** 2026-03-19 12:46:57.318073 | controller | ok: [instance] 2026-03-19 12:46:57.337856 | controller | 2026-03-19 12:46:57.337879 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2026-03-19 12:46:57.337888 | controller | Thursday 19 March 2026 12:46:57 +0000 (0:00:00.019) 0:01:11.924 ******** 2026-03-19 12:46:57.337899 | controller | ok: [instance] 2026-03-19 12:46:57.412535 | controller | 2026-03-19 12:46:57.412578 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2026-03-19 12:46:57.412589 | controller | Thursday 19 March 2026 12:46:57 +0000 (0:00:00.019) 0:01:11.944 ******** 2026-03-19 12:46:57.412604 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2026-03-19 12:46:57.412639 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2026-03-19 12:46:57.412648 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2026-03-19 12:46:57.412656 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2026-03-19 12:46:57.412666 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2026-03-19 12:46:57.412695 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2026-03-19 12:46:57.413037 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2026-03-19 12:46:57.548961 | controller | 2026-03-19 12:46:57.548988 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-03-19 12:46:57.548996 | controller | Thursday 19 March 2026 12:46:57 +0000 (0:00:00.074) 0:01:12.019 ******** 2026-03-19 12:46:57.549011 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2026-03-19 12:46:57.632224 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2026-03-19 12:46:57.632242 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2026-03-19 12:46:57.632250 | controller | 2026-03-19 12:46:57.632256 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-03-19 12:46:57.632262 | controller | Thursday 19 March 2026 12:46:57 +0000 (0:00:00.136) 0:01:12.155 ******** 2026-03-19 12:46:57.632276 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2026-03-19 12:46:57.632540 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2026-03-19 12:46:57.632807 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2026-03-19 12:46:57.633049 | controller | skipping: [instance] 2026-03-19 12:46:57.633171 | controller | 2026-03-19 12:46:57.633316 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-03-19 12:46:57.633469 | controller | Thursday 19 March 2026 12:46:57 +0000 (0:00:00.083) 0:01:12.239 ******** 2026-03-19 12:46:57.713731 | controller | skipping: [instance] => (item=compute-0 - storage) 2026-03-19 12:46:57.713917 | controller | skipping: [instance] => (item=controller-0 - storage) 2026-03-19 12:46:57.714080 | controller | skipping: [instance] => (item=crc-0 - storage) 2026-03-19 12:46:57.714240 | controller | skipping: [instance] 2026-03-19 12:46:57.714360 | controller | 2026-03-19 12:46:57.714517 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-03-19 12:46:57.714652 | controller | Thursday 19 March 2026 12:46:57 +0000 (0:00:00.081) 0:01:12.320 ******** 2026-03-19 12:46:57.794624 | controller | skipping: [instance] => (item=compute-0 - tenant) 2026-03-19 12:46:57.794782 | controller | skipping: [instance] => (item=controller-0 - tenant) 2026-03-19 12:46:57.794905 | controller | skipping: [instance] => (item=crc-0 - tenant) 2026-03-19 12:46:57.795022 | controller | skipping: [instance] 2026-03-19 12:46:57.795132 | controller | 2026-03-19 12:46:57.795258 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-03-19 12:46:57.795391 | controller | Thursday 19 March 2026 12:46:57 +0000 (0:00:00.080) 0:01:12.401 ******** 2026-03-19 12:46:57.874155 | controller | skipping: [instance] => (item=compute-0 - external) 2026-03-19 12:46:57.874511 | controller | skipping: [instance] => (item=controller-0 - external) 2026-03-19 12:46:57.874768 | controller | skipping: [instance] => (item=crc-0 - external) 2026-03-19 12:46:57.874997 | controller | skipping: [instance] 2026-03-19 12:46:57.875222 | controller | 2026-03-19 12:46:57.875341 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-03-19 12:46:57.875486 | controller | Thursday 19 March 2026 12:46:57 +0000 (0:00:00.079) 0:01:12.480 ******** 2026-03-19 12:46:57.955815 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2026-03-19 12:46:57.955997 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2026-03-19 12:46:57.956130 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2026-03-19 12:46:57.956273 | controller | skipping: [instance] 2026-03-19 12:46:57.956422 | controller | 2026-03-19 12:46:57.956557 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-03-19 12:46:57.956685 | controller | Thursday 19 March 2026 12:46:57 +0000 (0:00:00.081) 0:01:12.562 ******** 2026-03-19 12:46:58.091646 | controller | ok: [instance] => (item=compute-0 - public) 2026-03-19 12:46:58.091820 | controller | ok: [instance] => (item=controller-0 - public) 2026-03-19 12:46:58.091956 | controller | ok: [instance] => (item=crc-0 - public) 2026-03-19 12:46:58.092068 | controller | 2026-03-19 12:46:58.092201 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2026-03-19 12:46:58.092325 | controller | Thursday 19 March 2026 12:46:58 +0000 (0:00:00.136) 0:01:12.698 ******** 2026-03-19 12:46:58.202619 | controller | 2026-03-19 12:46:58.202775 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2026-03-19 12:46:58.202917 | controller | Thursday 19 March 2026 12:46:58 +0000 (0:00:00.110) 0:01:12.809 ******** 2026-03-19 12:46:58.241624 | controller | ok: [instance] 2026-03-19 12:46:58.241888 | controller | 2026-03-19 12:46:58.242127 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2026-03-19 12:46:58.242440 | controller | Thursday 19 March 2026 12:46:58 +0000 (0:00:00.038) 0:01:12.848 ******** 2026-03-19 12:46:58.342714 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:d6:36:a4', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-03-19 12:46:58.342882 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:47:aa:4a', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-03-19 12:46:58.343024 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:71:c0:4a', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-03-19 12:46:58.343159 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:ed:0e:95', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-03-19 12:46:58.343309 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:13:a8:c6', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-03-19 12:46:58.343469 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:77:6e:bf', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-03-19 12:46:58.343603 | controller | 2026-03-19 12:46:58.343728 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2026-03-19 12:46:58.343851 | controller | Thursday 19 March 2026 12:46:58 +0000 (0:00:00.101) 0:01:12.949 ******** 2026-03-19 12:46:58.393840 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2026-03-19 12:46:58.393995 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2026-03-19 12:46:58.394119 | controller | 2026-03-19 12:46:58.394264 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-03-19 12:46:58.394413 | controller | Thursday 19 March 2026 12:46:58 +0000 (0:00:00.050) 0:01:13.000 ******** 2026-03-19 12:46:58.596451 | controller | ok: [instance] 2026-03-19 12:46:58.619955 | controller | 2026-03-19 12:46:58.619980 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-03-19 12:46:58.619988 | controller | Thursday 19 March 2026 12:46:58 +0000 (0:00:00.202) 0:01:13.202 ******** 2026-03-19 12:46:58.619997 | controller | ok: [instance] 2026-03-19 12:46:58.795946 | controller | 2026-03-19 12:46:58.795967 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-03-19 12:46:58.795974 | controller | Thursday 19 March 2026 12:46:58 +0000 (0:00:00.023) 0:01:13.226 ******** 2026-03-19 12:46:58.795983 | controller | ok: [instance] 2026-03-19 12:46:58.820177 | controller | 2026-03-19 12:46:58.820207 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-03-19 12:46:58.820216 | controller | Thursday 19 March 2026 12:46:58 +0000 (0:00:00.176) 0:01:13.402 ******** 2026-03-19 12:46:58.820225 | controller | ok: [instance] 2026-03-19 12:46:58.841039 | controller | 2026-03-19 12:46:58.841064 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2026-03-19 12:46:58.841074 | controller | Thursday 19 March 2026 12:46:58 +0000 (0:00:00.024) 0:01:13.426 ******** 2026-03-19 12:46:58.841085 | controller | ok: [instance] 2026-03-19 12:46:59.010550 | controller | 2026-03-19 12:46:59.010589 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2026-03-19 12:46:59.010599 | controller | Thursday 19 March 2026 12:46:58 +0000 (0:00:00.020) 0:01:13.447 ******** 2026-03-19 12:46:59.010612 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:d6:36:a4', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-03-19 12:46:59.049349 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:47:aa:4a', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-03-19 12:46:59.049403 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:71:c0:4a', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-03-19 12:46:59.049423 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:ed:0e:95', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-03-19 12:46:59.049431 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:13:a8:c6', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-03-19 12:46:59.049438 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:77:6e:bf', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-03-19 12:46:59.049445 | controller | 2026-03-19 12:46:59.049453 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2026-03-19 12:46:59.049466 | controller | Thursday 19 March 2026 12:46:59 +0000 (0:00:00.169) 0:01:13.616 ******** 2026-03-19 12:46:59.049481 | controller | ok: [instance] 2026-03-19 12:46:59.049548 | controller | 2026-03-19 12:46:59.049773 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2026-03-19 12:46:59.049875 | controller | Thursday 19 March 2026 12:46:59 +0000 (0:00:00.039) 0:01:13.655 ******** 2026-03-19 12:47:01.092520 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:d6:36:a4', 'entry': 'set:compute,52:54:00:d6:36:a4,192.168.140.100,compute-0', 'state': 'present'}) 2026-03-19 12:47:01.092970 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:47:aa:4a', 'entry': 'set:controller,52:54:01:47:aa:4a,192.168.140.9,controller-0', 'state': 'present'}) 2026-03-19 12:47:01.092986 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:71:c0:4a', 'entry': 'set:ocp,52:54:02:71:c0:4a,192.168.140.10,crc-0', 'state': 'present'}) 2026-03-19 12:47:01.092993 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:ed:0e:95', 'entry': 'set:compute,52:54:00:ed:0e:95,192.168.101.100,compute-0', 'state': 'present'}) 2026-03-19 12:47:01.093002 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:13:a8:c6', 'entry': 'set:controller,52:54:01:13:a8:c6,192.168.101.9,controller-0', 'state': 'present'}) 2026-03-19 12:47:01.115268 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:77:6e:bf', 'entry': 'set:ocp,52:54:02:77:6e:bf,192.168.101.10,crc-0', 'state': 'present'}) 2026-03-19 12:47:01.115304 | controller | 2026-03-19 12:47:01.115316 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2026-03-19 12:47:01.115326 | controller | Thursday 19 March 2026 12:47:01 +0000 (0:00:02.042) 0:01:15.698 ******** 2026-03-19 12:47:01.115340 | controller | skipping: [instance] 2026-03-19 12:47:01.330323 | controller | 2026-03-19 12:47:01.330349 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2026-03-19 12:47:01.330357 | controller | Thursday 19 March 2026 12:47:01 +0000 (0:00:00.022) 0:01:15.721 ******** 2026-03-19 12:47:01.330366 | controller | ok: [instance] => (item=compute-0) 2026-03-19 12:47:01.479603 | controller | ok: [instance] => (item=controller-0) 2026-03-19 12:47:01.479637 | controller | ok: [instance] => (item=crc-0) 2026-03-19 12:47:01.479650 | controller | 2026-03-19 12:47:01.479661 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2026-03-19 12:47:01.479670 | controller | Thursday 19 March 2026 12:47:01 +0000 (0:00:00.215) 0:01:15.936 ******** 2026-03-19 12:47:01.479684 | controller | 2026-03-19 12:47:01.521999 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-03-19 12:47:01.522017 | controller | Thursday 19 March 2026 12:47:01 +0000 (0:00:00.149) 0:01:16.086 ******** 2026-03-19 12:47:01.522027 | controller | ok: [instance] 2026-03-19 12:47:01.727529 | controller | 2026-03-19 12:47:01.727570 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-03-19 12:47:01.727580 | controller | Thursday 19 March 2026 12:47:01 +0000 (0:00:00.042) 0:01:16.128 ******** 2026-03-19 12:47:01.727593 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-03-19 12:47:01.727610 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-03-19 12:47:01.727618 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-03-19 12:47:01.727625 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-03-19 12:47:01.727635 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-03-19 12:47:01.727796 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-03-19 12:47:01.727887 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-03-19 12:47:01.728000 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-19 12:47:01.728108 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-19 12:47:01.728205 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-03-19 12:47:01.728334 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-03-19 12:47:01.728446 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-03-19 12:47:01.728595 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-03-19 12:47:01.728700 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-03-19 12:47:01.728803 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-03-19 12:47:01.728904 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-03-19 12:47:01.729001 | controller | 2026-03-19 12:47:01.729111 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-03-19 12:47:01.729228 | controller | Thursday 19 March 2026 12:47:01 +0000 (0:00:00.205) 0:01:16.333 ******** 2026-03-19 12:47:04.823520 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-03-19 12:47:04.823581 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-03-19 12:47:04.823595 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-03-19 12:47:04.825023 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-03-19 12:47:04.855513 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-03-19 12:47:04.855547 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-03-19 12:47:04.855563 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-03-19 12:47:04.855571 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-19 12:47:04.855578 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-19 12:47:04.855585 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-03-19 12:47:04.855592 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-03-19 12:47:04.855599 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-03-19 12:47:04.855607 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-03-19 12:47:04.855614 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-03-19 12:47:04.855620 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-03-19 12:47:04.855628 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-03-19 12:47:04.855635 | controller | 2026-03-19 12:47:04.855642 | controller | TASK [dnsmasq : Remove crc.testing from host_records] ************************** 2026-03-19 12:47:04.855649 | controller | Thursday 19 March 2026 12:47:04 +0000 (0:00:03.096) 0:01:19.429 ******** 2026-03-19 12:47:04.855661 | controller | skipping: [instance] 2026-03-19 12:47:04.855691 | controller | 2026-03-19 12:47:04.855700 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-03-19 12:47:04.855725 | controller | Thursday 19 March 2026 12:47:04 +0000 (0:00:00.032) 0:01:19.462 ******** 2026-03-19 12:47:05.206480 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-03-19 12:47:05.207977 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-03-19 12:47:05.228160 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-03-19 12:47:05.228178 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-03-19 12:47:05.228186 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-03-19 12:47:05.228192 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-03-19 12:47:05.228198 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-03-19 12:47:05.228203 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-19 12:47:05.228213 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-19 12:47:05.228219 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-03-19 12:47:05.228224 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-03-19 12:47:05.228229 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-03-19 12:47:05.228235 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-03-19 12:47:05.228240 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-03-19 12:47:05.228246 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-03-19 12:47:05.228251 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-03-19 12:47:05.228261 | controller | 2026-03-19 12:47:05.228267 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2026-03-19 12:47:05.228273 | controller | Thursday 19 March 2026 12:47:05 +0000 (0:00:00.350) 0:01:19.812 ******** 2026-03-19 12:47:05.228281 | controller | ok: [instance] 2026-03-19 12:47:05.275437 | controller | 2026-03-19 12:47:05.275461 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2026-03-19 12:47:05.275469 | controller | Thursday 19 March 2026 12:47:05 +0000 (0:00:00.021) 0:01:19.834 ******** 2026-03-19 12:47:05.275478 | controller | skipping: [instance] => (item=compute) 2026-03-19 12:47:05.275594 | controller | skipping: [instance] => (item=controller) 2026-03-19 12:47:05.275604 | controller | skipping: [instance] => (item=crc) 2026-03-19 12:47:05.275610 | controller | skipping: [instance] 2026-03-19 12:47:05.275616 | controller | 2026-03-19 12:47:05.275622 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2026-03-19 12:47:05.275630 | controller | Thursday 19 March 2026 12:47:05 +0000 (0:00:00.046) 0:01:19.881 ******** 2026-03-19 12:47:05.307826 | controller | skipping: [instance] 2026-03-19 12:47:05.676176 | controller | 2026-03-19 12:47:05.676208 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2026-03-19 12:47:05.676216 | controller | Thursday 19 March 2026 12:47:05 +0000 (0:00:00.032) 0:01:19.914 ******** 2026-03-19 12:47:05.676226 | controller | changed: [instance] 2026-03-19 12:47:06.321450 | controller | 2026-03-19 12:47:06.321481 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2026-03-19 12:47:06.321490 | controller | Thursday 19 March 2026 12:47:05 +0000 (0:00:00.356) 0:01:20.270 ******** 2026-03-19 12:47:06.321496 | controller | 2026-03-19 12:47:06.321501 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-03-19 12:47:06.321507 | controller | Thursday 19 March 2026 12:47:05 +0000 (0:00:00.011) 0:01:20.282 ******** 2026-03-19 12:47:06.321517 | controller | changed: [instance] 2026-03-19 12:47:06.670243 | controller | 2026-03-19 12:47:06.670277 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-03-19 12:47:06.670286 | controller | Thursday 19 March 2026 12:47:06 +0000 (0:00:00.645) 0:01:20.927 ******** 2026-03-19 12:47:06.670300 | controller | changed: [instance] 2026-03-19 12:47:07.014158 | controller | 2026-03-19 12:47:07.014192 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2026-03-19 12:47:07.014200 | controller | Thursday 19 March 2026 12:47:06 +0000 (0:00:00.348) 0:01:21.276 ******** 2026-03-19 12:47:07.014211 | controller | changed: [instance] 2026-03-19 12:47:07.370141 | controller | 2026-03-19 12:47:07.370180 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2026-03-19 12:47:07.370189 | controller | Thursday 19 March 2026 12:47:07 +0000 (0:00:00.343) 0:01:21.620 ******** 2026-03-19 12:47:07.370200 | controller | changed: [instance] 2026-03-19 12:47:07.727836 | controller | 2026-03-19 12:47:07.727867 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2026-03-19 12:47:07.727876 | controller | Thursday 19 March 2026 12:47:07 +0000 (0:00:00.356) 0:01:21.976 ******** 2026-03-19 12:47:07.727886 | controller | changed: [instance] 2026-03-19 12:47:07.760457 | controller | 2026-03-19 12:47:07.760488 | controller | TASK [Build utility records dataset] ******************************************* 2026-03-19 12:47:07.760497 | controller | Thursday 19 March 2026 12:47:07 +0000 (0:00:00.357) 0:01:22.334 ******** 2026-03-19 12:47:07.760508 | controller | 2026-03-19 12:47:07.849208 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-03-19 12:47:07.849230 | controller | Thursday 19 March 2026 12:47:07 +0000 (0:00:00.032) 0:01:22.366 ******** 2026-03-19 12:47:07.849242 | controller | ok: [instance] 2026-03-19 12:47:07.946229 | controller | 2026-03-19 12:47:07.946251 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-03-19 12:47:07.946261 | controller | Thursday 19 March 2026 12:47:07 +0000 (0:00:00.088) 0:01:22.455 ******** 2026-03-19 12:47:07.946272 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-03-19 12:47:08.405074 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-19 12:47:08.405102 | controller | 2026-03-19 12:47:08.405114 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-03-19 12:47:08.405121 | controller | Thursday 19 March 2026 12:47:07 +0000 (0:00:00.096) 0:01:22.552 ******** 2026-03-19 12:47:08.405130 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-03-19 12:47:08.435491 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-19 12:47:08.435526 | controller | 2026-03-19 12:47:08.435536 | controller | TASK [dnsmasq : Remove crc.testing from host_records] ************************** 2026-03-19 12:47:08.435544 | controller | Thursday 19 March 2026 12:47:08 +0000 (0:00:00.458) 0:01:23.011 ******** 2026-03-19 12:47:08.435555 | controller | skipping: [instance] 2026-03-19 12:47:08.435586 | controller | 2026-03-19 12:47:08.435596 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-03-19 12:47:08.435622 | controller | Thursday 19 March 2026 12:47:08 +0000 (0:00:00.030) 0:01:23.042 ******** 2026-03-19 12:47:08.726501 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-03-19 12:47:08.726562 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-19 12:47:08.726575 | controller | 2026-03-19 12:47:08.727081 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-03-19 12:47:09.176842 | controller | Thursday 19 March 2026 12:47:08 +0000 (0:00:00.280) 0:01:23.322 ******** 2026-03-19 12:47:09.176873 | controller | 2026-03-19 12:47:09.176881 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-03-19 12:47:09.176887 | controller | Thursday 19 March 2026 12:47:08 +0000 (0:00:00.010) 0:01:23.332 ******** 2026-03-19 12:47:09.176897 | controller | changed: [instance] 2026-03-19 12:47:09.519933 | controller | 2026-03-19 12:47:09.519965 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-03-19 12:47:09.519973 | controller | Thursday 19 March 2026 12:47:09 +0000 (0:00:00.450) 0:01:23.783 ******** 2026-03-19 12:47:09.519983 | controller | changed: [instance] 2026-03-19 12:47:09.552892 | controller | 2026-03-19 12:47:09.552920 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2026-03-19 12:47:09.552928 | controller | Thursday 19 March 2026 12:47:09 +0000 (0:00:00.343) 0:01:24.126 ******** 2026-03-19 12:47:09.552937 | controller | skipping: [instance] 2026-03-19 12:47:09.625791 | controller | 2026-03-19 12:47:09.625834 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2026-03-19 12:47:09.625847 | controller | Thursday 19 March 2026 12:47:09 +0000 (0:00:00.033) 0:01:24.159 ******** 2026-03-19 12:47:09.625864 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2026-03-19 12:47:09.806958 | controller | 2026-03-19 12:47:09.806988 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2026-03-19 12:47:09.806997 | controller | Thursday 19 March 2026 12:47:09 +0000 (0:00:00.072) 0:01:24.232 ******** 2026-03-19 12:47:09.807007 | controller | ok: [instance] 2026-03-19 12:47:09.825519 | controller | 2026-03-19 12:47:09.825563 | controller | TASK [Deploy CRC if needed] **************************************************** 2026-03-19 12:47:09.825580 | controller | Thursday 19 March 2026 12:47:09 +0000 (0:00:00.181) 0:01:24.413 ******** 2026-03-19 12:47:09.825594 | controller | skipping: [instance] 2026-03-19 12:47:10.160802 | controller | 2026-03-19 12:47:10.160835 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2026-03-19 12:47:10.160843 | controller | Thursday 19 March 2026 12:47:09 +0000 (0:00:00.018) 0:01:24.431 ******** 2026-03-19 12:47:10.160853 | controller | ok: [instance] 2026-03-19 12:47:10.393482 | controller | 2026-03-19 12:47:10.393528 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2026-03-19 12:47:10.393537 | controller | Thursday 19 March 2026 12:47:10 +0000 (0:00:00.335) 0:01:24.767 ******** 2026-03-19 12:47:10.393549 | controller | ok: [instance] 2026-03-19 12:47:10.611861 | controller | 2026-03-19 12:47:10.611893 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2026-03-19 12:47:10.611902 | controller | Thursday 19 March 2026 12:47:10 +0000 (0:00:00.232) 0:01:24.999 ******** 2026-03-19 12:47:10.611912 | controller | ok: [instance] 2026-03-19 12:47:10.828450 | controller | 2026-03-19 12:47:10.828475 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2026-03-19 12:47:10.828484 | controller | Thursday 19 March 2026 12:47:10 +0000 (0:00:00.218) 0:01:25.218 ******** 2026-03-19 12:47:10.828495 | controller | ok: [instance] 2026-03-19 12:47:10.828522 | controller | 2026-03-19 12:47:10.828532 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2026-03-19 12:47:10.828620 | controller | Thursday 19 March 2026 12:47:10 +0000 (0:00:00.216) 0:01:25.435 ******** 2026-03-19 12:47:11.048523 | controller | ok: [instance] 2026-03-19 12:47:11.087530 | controller | 2026-03-19 12:47:11.087576 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-03-19 12:47:11.087590 | controller | Thursday 19 March 2026 12:47:11 +0000 (0:00:00.219) 0:01:25.654 ******** 2026-03-19 12:47:11.087607 | controller | 2026-03-19 12:47:11.087711 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-03-19 12:47:11.087730 | controller | Thursday 19 March 2026 12:47:11 +0000 (0:00:00.039) 0:01:25.693 ******** 2026-03-19 12:47:11.277501 | controller | ok: [instance] 2026-03-19 12:47:11.277535 | controller | 2026-03-19 12:47:11.277545 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-03-19 12:47:11.277555 | controller | Thursday 19 March 2026 12:47:11 +0000 (0:00:00.189) 0:01:25.883 ******** 2026-03-19 12:47:11.299474 | controller | ok: [instance] 2026-03-19 12:47:11.299750 | controller | 2026-03-19 12:47:11.299787 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-03-19 12:47:11.326205 | controller | Thursday 19 March 2026 12:47:11 +0000 (0:00:00.022) 0:01:25.906 ******** 2026-03-19 12:47:11.326229 | controller | skipping: [instance] 2026-03-19 12:47:11.572861 | controller | 2026-03-19 12:47:11.572880 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2026-03-19 12:47:11.572888 | controller | Thursday 19 March 2026 12:47:11 +0000 (0:00:00.026) 0:01:25.932 ******** 2026-03-19 12:47:11.572902 | controller | ok: [instance] 2026-03-19 12:47:11.789235 | controller | 2026-03-19 12:47:11.789263 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2026-03-19 12:47:11.789271 | controller | Thursday 19 March 2026 12:47:11 +0000 (0:00:00.247) 0:01:26.179 ******** 2026-03-19 12:47:11.789281 | controller | ok: [instance] 2026-03-19 12:47:11.958161 | controller | 2026-03-19 12:47:11.958190 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2026-03-19 12:47:11.958200 | controller | Thursday 19 March 2026 12:47:11 +0000 (0:00:00.216) 0:01:26.395 ******** 2026-03-19 12:47:11.958211 | controller | ok: [instance] 2026-03-19 12:47:12.013971 | controller | 2026-03-19 12:47:12.013995 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2026-03-19 12:47:12.014003 | controller | Thursday 19 March 2026 12:47:11 +0000 (0:00:00.168) 0:01:26.564 ******** 2026-03-19 12:47:12.014014 | controller | 2026-03-19 12:47:12.056279 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-03-19 12:47:12.056300 | controller | Thursday 19 March 2026 12:47:12 +0000 (0:00:00.056) 0:01:26.620 ******** 2026-03-19 12:47:12.056310 | controller | ok: [instance] => changed=false 2026-03-19 12:47:12.231411 | controller | msg: All assertions passed 2026-03-19 12:47:12.231440 | controller | 2026-03-19 12:47:12.231450 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-03-19 12:47:12.231458 | controller | Thursday 19 March 2026 12:47:12 +0000 (0:00:00.042) 0:01:26.662 ******** 2026-03-19 12:47:12.231473 | controller | ok: [instance] 2026-03-19 12:47:12.416439 | controller | 2026-03-19 12:47:12.416465 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-03-19 12:47:12.416472 | controller | Thursday 19 March 2026 12:47:12 +0000 (0:00:00.174) 0:01:26.837 ******** 2026-03-19 12:47:12.416482 | controller | ok: [instance] 2026-03-19 12:47:12.416631 | controller | 2026-03-19 12:47:12.416651 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-03-19 12:47:12.439180 | controller | Thursday 19 March 2026 12:47:12 +0000 (0:00:00.185) 0:01:27.023 ******** 2026-03-19 12:47:12.439205 | controller | ok: [instance] => changed=false 2026-03-19 12:47:12.622483 | controller | msg: All assertions passed 2026-03-19 12:47:12.622518 | controller | 2026-03-19 12:47:12.622527 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-03-19 12:47:12.622533 | controller | Thursday 19 March 2026 12:47:12 +0000 (0:00:00.022) 0:01:27.045 ******** 2026-03-19 12:47:12.622545 | controller | ok: [instance] 2026-03-19 12:47:12.622579 | controller | 2026-03-19 12:47:12.622587 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-03-19 12:47:12.622700 | controller | Thursday 19 March 2026 12:47:12 +0000 (0:00:00.183) 0:01:27.228 ******** 2026-03-19 12:47:12.792979 | controller | ok: [instance] 2026-03-19 12:47:12.838937 | controller | 2026-03-19 12:47:12.838966 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-03-19 12:47:12.838975 | controller | Thursday 19 March 2026 12:47:12 +0000 (0:00:00.170) 0:01:27.399 ******** 2026-03-19 12:47:12.838985 | controller | ok: [instance] 2026-03-19 12:47:13.212502 | controller | 2026-03-19 12:47:13.212535 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2026-03-19 12:47:13.212545 | controller | Thursday 19 March 2026 12:47:12 +0000 (0:00:00.046) 0:01:27.445 ******** 2026-03-19 12:47:13.212558 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2026-03-19 12:47:13.212585 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2026-03-19 12:47:13.212593 | controller | 2026-03-19 12:47:13.212602 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2026-03-19 12:47:13.212639 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.373) 0:01:27.818 ******** 2026-03-19 12:47:13.229782 | controller | skipping: [instance] 2026-03-19 12:47:13.260127 | controller | 2026-03-19 12:47:13.260147 | controller | TASK [Consume dev-scripts for bare metal OCP SNO] ****************************** 2026-03-19 12:47:13.260155 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.017) 0:01:27.836 ******** 2026-03-19 12:47:13.260164 | controller | skipping: [instance] 2026-03-19 12:47:13.289434 | controller | 2026-03-19 12:47:13.289459 | controller | TASK [reproducer : Slurp kubeconfig from dev-scripts] ************************** 2026-03-19 12:47:13.289468 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.030) 0:01:27.866 ******** 2026-03-19 12:47:13.289479 | controller | skipping: [instance] 2026-03-19 12:47:13.318361 | controller | 2026-03-19 12:47:13.318417 | controller | TASK [reproducer : Slurp kubeadmin-password from dev-scripts] ****************** 2026-03-19 12:47:13.318428 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.029) 0:01:27.895 ******** 2026-03-19 12:47:13.318439 | controller | skipping: [instance] 2026-03-19 12:47:13.347164 | controller | 2026-03-19 12:47:13.347185 | controller | TASK [reproducer : Ensure .kube directory exists] ****************************** 2026-03-19 12:47:13.347193 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.028) 0:01:27.924 ******** 2026-03-19 12:47:13.347201 | controller | skipping: [instance] 2026-03-19 12:47:13.376486 | controller | 2026-03-19 12:47:13.376510 | controller | TASK [reproducer : Copy kubeconfig to local ~/.kube/config] ******************** 2026-03-19 12:47:13.376520 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.028) 0:01:27.953 ******** 2026-03-19 12:47:13.376536 | controller | skipping: [instance] 2026-03-19 12:47:13.406994 | controller | 2026-03-19 12:47:13.407009 | controller | TASK [reproducer : Copy kubeadmin-password] ************************************ 2026-03-19 12:47:13.407017 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.029) 0:01:27.982 ******** 2026-03-19 12:47:13.407027 | controller | skipping: [instance] 2026-03-19 12:47:13.407145 | controller | 2026-03-19 12:47:13.407294 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-03-19 12:47:13.407465 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.030) 0:01:28.013 ******** 2026-03-19 12:47:13.440034 | controller | skipping: [instance] 2026-03-19 12:47:13.440181 | controller | 2026-03-19 12:47:13.440303 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-03-19 12:47:13.440441 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.032) 0:01:28.046 ******** 2026-03-19 12:47:13.469366 | controller | skipping: [instance] 2026-03-19 12:47:13.469555 | controller | 2026-03-19 12:47:13.469722 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-03-19 12:47:13.469832 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.029) 0:01:28.076 ******** 2026-03-19 12:47:13.499648 | controller | skipping: [instance] 2026-03-19 12:47:13.499797 | controller | 2026-03-19 12:47:13.499934 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-03-19 12:47:13.500065 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.030) 0:01:28.106 ******** 2026-03-19 12:47:13.530178 | controller | skipping: [instance] 2026-03-19 12:47:13.530284 | controller | 2026-03-19 12:47:13.530399 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-03-19 12:47:13.530540 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.030) 0:01:28.137 ******** 2026-03-19 12:47:13.560352 | controller | skipping: [instance] 2026-03-19 12:47:13.560550 | controller | 2026-03-19 12:47:13.560712 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-03-19 12:47:13.560828 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.030) 0:01:28.167 ******** 2026-03-19 12:47:13.590582 | controller | skipping: [instance] 2026-03-19 12:47:13.590742 | controller | 2026-03-19 12:47:13.590852 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-03-19 12:47:13.591023 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.030) 0:01:28.197 ******** 2026-03-19 12:47:13.630994 | controller | skipping: [instance] 2026-03-19 12:47:13.631155 | controller | 2026-03-19 12:47:13.631265 | controller | TASK [reproducer : Set wait for OCP cluster flag] ****************************** 2026-03-19 12:47:13.631407 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.040) 0:01:28.237 ******** 2026-03-19 12:47:13.661358 | controller | skipping: [instance] 2026-03-19 12:47:13.661561 | controller | 2026-03-19 12:47:13.661660 | controller | TASK [Load the architecture local kustomize patches] *************************** 2026-03-19 12:47:13.661766 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.030) 0:01:28.268 ******** 2026-03-19 12:47:13.684358 | controller | skipping: [instance] 2026-03-19 12:47:13.684555 | controller | 2026-03-19 12:47:13.684661 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2026-03-19 12:47:13.684820 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.022) 0:01:28.291 ******** 2026-03-19 12:47:13.780519 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2026-03-19 12:47:13.780678 | controller | 2026-03-19 12:47:13.780786 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2026-03-19 12:47:13.780894 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.096) 0:01:28.387 ******** 2026-03-19 12:47:13.807173 | controller | skipping: [instance] 2026-03-19 12:47:13.807328 | controller | 2026-03-19 12:47:13.807501 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2026-03-19 12:47:13.807641 | controller | Thursday 19 March 2026 12:47:13 +0000 (0:00:00.026) 0:01:28.413 ******** 2026-03-19 12:47:14.225863 | controller | changed: [instance] 2026-03-19 12:47:14.731475 | controller | 2026-03-19 12:47:14.731541 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2026-03-19 12:47:14.731551 | controller | Thursday 19 March 2026 12:47:14 +0000 (0:00:00.418) 0:01:28.831 ******** 2026-03-19 12:47:14.731568 | controller | changed: [instance] 2026-03-19 12:47:15.173457 | controller | 2026-03-19 12:47:15.173486 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2026-03-19 12:47:15.173494 | controller | Thursday 19 March 2026 12:47:14 +0000 (0:00:00.493) 0:01:29.325 ******** 2026-03-19 12:47:15.173500 | controller | 2026-03-19 12:47:15.173506 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-03-19 12:47:15.173512 | controller | Thursday 19 March 2026 12:47:14 +0000 (0:00:00.011) 0:01:29.337 ******** 2026-03-19 12:47:15.173521 | controller | changed: [instance] 2026-03-19 12:47:15.173544 | controller | 2026-03-19 12:47:15.173552 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-03-19 12:47:15.173669 | controller | Thursday 19 March 2026 12:47:15 +0000 (0:00:00.442) 0:01:29.779 ******** 2026-03-19 12:47:15.807989 | controller | changed: [instance] 2026-03-19 12:47:15.839980 | controller | 2026-03-19 12:47:15.840009 | controller | TASK [Deploy virtualbmc] ******************************************************* 2026-03-19 12:47:15.840018 | controller | Thursday 19 March 2026 12:47:15 +0000 (0:00:00.634) 0:01:30.414 ******** 2026-03-19 12:47:15.840028 | controller | skipping: [instance] 2026-03-19 12:47:15.872774 | controller | 2026-03-19 12:47:15.872802 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2026-03-19 12:47:15.872809 | controller | Thursday 19 March 2026 12:47:15 +0000 (0:00:00.032) 0:01:30.446 ******** 2026-03-19 12:47:15.872823 | controller | skipping: [instance] 2026-03-19 12:47:16.405496 | controller | 2026-03-19 12:47:16.405528 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2026-03-19 12:47:16.405536 | controller | Thursday 19 March 2026 12:47:15 +0000 (0:00:00.032) 0:01:30.479 ******** 2026-03-19 12:47:16.405546 | controller | changed: [instance] => (item=workload) 2026-03-19 12:47:16.405571 | controller | changed: [instance] => (item=reproducer-inventory) 2026-03-19 12:47:16.405579 | controller | ok: [instance] => (item=volumes) 2026-03-19 12:47:16.405600 | controller | 2026-03-19 12:47:16.405830 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2026-03-19 12:47:16.800511 | controller | Thursday 19 March 2026 12:47:16 +0000 (0:00:00.532) 0:01:31.011 ******** 2026-03-19 12:47:16.800548 | controller | changed: [instance] => (item=workload) 2026-03-19 12:47:16.800581 | controller | changed: [instance] => (item=volumes) 2026-03-19 12:47:16.800595 | controller | 2026-03-19 12:47:16.800797 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2026-03-19 12:47:16.824550 | controller | Thursday 19 March 2026 12:47:16 +0000 (0:00:00.395) 0:01:31.407 ******** 2026-03-19 12:47:16.824598 | controller | skipping: [instance] 2026-03-19 12:47:17.827140 | controller | 2026-03-19 12:47:17.827169 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2026-03-19 12:47:17.827181 | controller | Thursday 19 March 2026 12:47:16 +0000 (0:00:00.023) 0:01:31.431 ******** 2026-03-19 12:47:17.827192 | controller | changed: [instance] => (item=compute) 2026-03-19 12:47:17.859794 | controller | changed: [instance] => (item=controller) 2026-03-19 12:47:17.859819 | controller | changed: [instance] => (item=crc) 2026-03-19 12:47:17.859828 | controller | 2026-03-19 12:47:17.859836 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2026-03-19 12:47:17.859843 | controller | Thursday 19 March 2026 12:47:17 +0000 (0:00:01.002) 0:01:32.433 ******** 2026-03-19 12:47:17.859853 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance 2026-03-19 12:47:18.032418 | controller | 2026-03-19 12:47:18.032442 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] ***************** 2026-03-19 12:47:18.032461 | controller | Thursday 19 March 2026 12:47:17 +0000 (0:00:00.032) 0:01:32.466 ******** 2026-03-19 12:47:18.032473 | controller | ok: [instance] 2026-03-19 12:47:18.052249 | controller | 2026-03-19 12:47:18.052272 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* 2026-03-19 12:47:18.052281 | controller | Thursday 19 March 2026 12:47:18 +0000 (0:00:00.172) 0:01:32.638 ******** 2026-03-19 12:47:18.052292 | controller | skipping: [instance] 2026-03-19 12:47:18.414504 | controller | 2026-03-19 12:47:18.414543 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] *** 2026-03-19 12:47:18.414553 | controller | Thursday 19 March 2026 12:47:18 +0000 (0:00:00.019) 0:01:32.658 ******** 2026-03-19 12:47:18.414565 | controller | changed: [instance] 2026-03-19 12:47:18.434490 | controller | 2026-03-19 12:47:18.434514 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* 2026-03-19 12:47:18.434523 | controller | Thursday 19 March 2026 12:47:18 +0000 (0:00:00.362) 0:01:33.020 ******** 2026-03-19 12:47:18.434534 | controller | skipping: [instance] 2026-03-19 12:47:18.434724 | controller | 2026-03-19 12:47:18.434748 | controller | TASK [libvirt_manager : Write merged all-group.yml] **************************** 2026-03-19 12:47:18.454167 | controller | Thursday 19 March 2026 12:47:18 +0000 (0:00:00.020) 0:01:33.041 ******** 2026-03-19 12:47:18.454206 | controller | skipping: [instance] 2026-03-19 12:47:18.492522 | controller | 2026-03-19 12:47:18.492550 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2026-03-19 12:47:18.492560 | controller | Thursday 19 March 2026 12:47:18 +0000 (0:00:00.019) 0:01:33.060 ******** 2026-03-19 12:47:18.492571 | controller | skipping: [instance] 2026-03-19 12:47:18.560575 | controller | 2026-03-19 12:47:18.560618 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2026-03-19 12:47:18.560633 | controller | Thursday 19 March 2026 12:47:18 +0000 (0:00:00.038) 0:01:33.098 ******** 2026-03-19 12:47:18.560650 | controller | skipping: [instance] => (item=crc) 2026-03-19 12:47:18.763334 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2026-03-19 12:47:18.763358 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2026-03-19 12:47:18.763366 | controller | 2026-03-19 12:47:18.763389 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-03-19 12:47:18.763398 | controller | Thursday 19 March 2026 12:47:18 +0000 (0:00:00.068) 0:01:33.166 ******** 2026-03-19 12:47:18.763407 | controller | changed: [instance] 2026-03-19 12:47:18.937487 | controller | 2026-03-19 12:47:18.937524 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-03-19 12:47:18.937537 | controller | Thursday 19 March 2026 12:47:18 +0000 (0:00:00.202) 0:01:33.369 ******** 2026-03-19 12:47:18.937553 | controller | ok: [instance] 2026-03-19 12:47:18.937933 | controller | 2026-03-19 12:47:49.491127 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-03-19 12:47:49.491159 | controller | Thursday 19 March 2026 12:47:18 +0000 (0:00:00.174) 0:01:33.543 ******** 2026-03-19 12:47:49.491170 | controller | changed: [instance] 2026-03-19 12:47:49.699535 | controller | 2026-03-19 12:47:49.699574 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-03-19 12:47:49.699591 | controller | Thursday 19 March 2026 12:47:49 +0000 (0:00:30.553) 0:02:04.097 ******** 2026-03-19 12:47:49.699603 | controller | ok: [instance] 2026-03-19 12:47:49.741138 | controller | 2026-03-19 12:47:49.741165 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-03-19 12:47:49.741176 | controller | Thursday 19 March 2026 12:47:49 +0000 (0:00:00.208) 0:02:04.305 ******** 2026-03-19 12:47:49.741188 | controller | ok: [instance] => changed=false 2026-03-19 12:47:49.953463 | controller | msg: All assertions passed 2026-03-19 12:47:49.953501 | controller | 2026-03-19 12:47:49.953509 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-03-19 12:47:49.953515 | controller | Thursday 19 March 2026 12:47:49 +0000 (0:00:00.041) 0:02:04.347 ******** 2026-03-19 12:47:49.953527 | controller | changed: [instance] 2026-03-19 12:47:49.953564 | controller | 2026-03-19 12:47:49.953751 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-03-19 12:47:50.166093 | controller | Thursday 19 March 2026 12:47:49 +0000 (0:00:00.212) 0:02:04.559 ******** 2026-03-19 12:47:50.166121 | controller | ok: [instance] 2026-03-19 12:47:50.365450 | controller | 2026-03-19 12:47:50.365487 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-03-19 12:47:50.365496 | controller | Thursday 19 March 2026 12:47:50 +0000 (0:00:00.212) 0:02:04.772 ******** 2026-03-19 12:47:50.365508 | controller | ok: [instance] 2026-03-19 12:47:50.365542 | controller | 2026-03-19 12:47:50.365735 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-03-19 12:47:50.388495 | controller | Thursday 19 March 2026 12:47:50 +0000 (0:00:00.199) 0:02:04.972 ******** 2026-03-19 12:47:50.388531 | controller | skipping: [instance] 2026-03-19 12:47:50.388540 | controller | 2026-03-19 12:47:50.388546 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-03-19 12:47:50.388553 | controller | Thursday 19 March 2026 12:47:50 +0000 (0:00:00.022) 0:02:04.995 ******** 2026-03-19 12:47:50.596850 | controller | ok: [instance] 2026-03-19 12:47:50.639086 | controller | 2026-03-19 12:47:50.639105 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-03-19 12:47:50.639113 | controller | Thursday 19 March 2026 12:47:50 +0000 (0:00:00.207) 0:02:05.203 ******** 2026-03-19 12:47:50.639122 | controller | ok: [instance] => changed=false 2026-03-19 12:47:50.853433 | controller | msg: All assertions passed 2026-03-19 12:47:50.853453 | controller | 2026-03-19 12:47:50.853461 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-03-19 12:47:50.853467 | controller | Thursday 19 March 2026 12:47:50 +0000 (0:00:00.042) 0:02:05.245 ******** 2026-03-19 12:47:50.853475 | controller | ok: [instance] 2026-03-19 12:47:51.038845 | controller | 2026-03-19 12:47:51.038864 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2026-03-19 12:47:51.038871 | controller | Thursday 19 March 2026 12:47:50 +0000 (0:00:00.214) 0:02:05.459 ******** 2026-03-19 12:47:51.038889 | controller | ok: [instance] 2026-03-19 12:47:51.450740 | controller | 2026-03-19 12:47:51.450764 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2026-03-19 12:47:51.450772 | controller | Thursday 19 March 2026 12:47:51 +0000 (0:00:00.185) 0:02:05.645 ******** 2026-03-19 12:47:51.450781 | controller | changed: [instance] 2026-03-19 12:47:51.631190 | controller | 2026-03-19 12:47:51.631213 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2026-03-19 12:47:51.631221 | controller | Thursday 19 March 2026 12:47:51 +0000 (0:00:00.411) 0:02:06.057 ******** 2026-03-19 12:47:51.631230 | controller | ok: [instance] 2026-03-19 12:47:51.819822 | controller | 2026-03-19 12:47:51.819856 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2026-03-19 12:47:51.819865 | controller | Thursday 19 March 2026 12:47:51 +0000 (0:00:00.180) 0:02:06.237 ******** 2026-03-19 12:47:51.819875 | controller | ok: [instance] 2026-03-19 12:47:51.819919 | controller | 2026-03-19 12:47:51.819928 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2026-03-19 12:47:51.819943 | controller | Thursday 19 March 2026 12:47:51 +0000 (0:00:00.187) 0:02:06.425 ******** 2026-03-19 12:47:52.230991 | controller | changed: [instance] 2026-03-19 12:47:52.253868 | controller | 2026-03-19 12:47:52.253890 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2026-03-19 12:47:52.253912 | controller | Thursday 19 March 2026 12:47:52 +0000 (0:00:00.412) 0:02:06.837 ******** 2026-03-19 12:47:52.253924 | controller | ok: [instance] 2026-03-19 12:47:52.496881 | controller | 2026-03-19 12:47:52.496919 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2026-03-19 12:47:52.496930 | controller | Thursday 19 March 2026 12:47:52 +0000 (0:00:00.022) 0:02:06.860 ******** 2026-03-19 12:47:52.496946 | controller | ok: [instance] 2026-03-19 12:47:52.989508 | controller | 2026-03-19 12:47:52.989601 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2026-03-19 12:47:52.989611 | controller | Thursday 19 March 2026 12:47:52 +0000 (0:00:00.242) 0:02:07.102 ******** 2026-03-19 12:47:52.989630 | controller | ok: [instance] 2026-03-19 12:47:53.188028 | controller | 2026-03-19 12:47:53.188073 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2026-03-19 12:47:53.188082 | controller | Thursday 19 March 2026 12:47:52 +0000 (0:00:00.492) 0:02:07.595 ******** 2026-03-19 12:47:53.188093 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-03-19 12:47:53.458412 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-03-19 12:47:53.458448 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-03-19 12:47:53.458456 | controller | 2026-03-19 12:47:53.458463 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2026-03-19 12:47:53.458470 | controller | Thursday 19 March 2026 12:47:53 +0000 (0:00:00.198) 0:02:07.794 ******** 2026-03-19 12:47:53.458479 | controller | changed: [instance] 2026-03-19 12:47:53.691189 | controller | 2026-03-19 12:47:53.691225 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2026-03-19 12:47:53.691233 | controller | Thursday 19 March 2026 12:47:53 +0000 (0:00:00.270) 0:02:08.064 ******** 2026-03-19 12:47:53.691244 | controller | changed: [instance] 2026-03-19 12:47:53.991765 | controller | 2026-03-19 12:47:53.991801 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2026-03-19 12:47:53.991809 | controller | Thursday 19 March 2026 12:47:53 +0000 (0:00:00.232) 0:02:08.297 ******** 2026-03-19 12:47:53.991820 | controller | changed: [instance] 2026-03-19 12:47:54.022913 | controller | 2026-03-19 12:47:54.022950 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2026-03-19 12:47:54.022960 | controller | Thursday 19 March 2026 12:47:53 +0000 (0:00:00.300) 0:02:08.598 ******** 2026-03-19 12:47:54.022972 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-03-19 12:47:54.069576 | controller | 2026-03-19 12:47:54.069623 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-03-19 12:47:54.069636 | controller | Thursday 19 March 2026 12:47:54 +0000 (0:00:00.031) 0:02:08.629 ******** 2026-03-19 12:47:54.069653 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-03-19 12:47:54.314553 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-03-19 12:47:54.314624 | controller | 2026-03-19 12:47:54.314633 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-03-19 12:47:54.314641 | controller | Thursday 19 March 2026 12:47:54 +0000 (0:00:00.046) 0:02:08.675 ******** 2026-03-19 12:47:54.314664 | controller | ok: [instance] 2026-03-19 12:47:54.363513 | controller | 2026-03-19 12:47:54.363565 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-03-19 12:47:54.363574 | controller | Thursday 19 March 2026 12:47:54 +0000 (0:00:00.245) 0:02:08.920 ******** 2026-03-19 12:47:54.363588 | controller | ok: [instance] => (item=cifmw-public) 2026-03-19 12:47:54.608581 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-19 12:47:54.608617 | controller | 2026-03-19 12:47:54.608625 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-03-19 12:47:54.608632 | controller | Thursday 19 March 2026 12:47:54 +0000 (0:00:00.048) 0:02:08.969 ******** 2026-03-19 12:47:54.608643 | controller | ok: [instance] 2026-03-19 12:47:54.827713 | controller | 2026-03-19 12:47:54.827736 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-03-19 12:47:54.827744 | controller | Thursday 19 March 2026 12:47:54 +0000 (0:00:00.244) 0:02:09.214 ******** 2026-03-19 12:47:54.827753 | controller | ok: [instance] 2026-03-19 12:47:55.134476 | controller | 2026-03-19 12:47:55.134522 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2026-03-19 12:47:55.134531 | controller | Thursday 19 March 2026 12:47:54 +0000 (0:00:00.219) 0:02:09.434 ******** 2026-03-19 12:47:55.134545 | controller | changed: [instance] 2026-03-19 12:47:55.134574 | controller | 2026-03-19 12:47:55.134582 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-03-19 12:47:55.134604 | controller | Thursday 19 March 2026 12:47:55 +0000 (0:00:00.306) 0:02:09.740 ******** 2026-03-19 12:47:55.383510 | controller | ok: [instance] 2026-03-19 12:47:55.383566 | controller | 2026-03-19 12:47:55.383579 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-03-19 12:47:55.383703 | controller | Thursday 19 March 2026 12:47:55 +0000 (0:00:00.248) 0:02:09.989 ******** 2026-03-19 12:47:55.430063 | controller | ok: [instance] => (item=cifmw-public) 2026-03-19 12:47:55.681655 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-19 12:47:55.681730 | controller | 2026-03-19 12:47:55.681746 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-03-19 12:47:55.681759 | controller | Thursday 19 March 2026 12:47:55 +0000 (0:00:00.046) 0:02:10.036 ******** 2026-03-19 12:47:55.681779 | controller | ok: [instance] 2026-03-19 12:47:55.895328 | controller | 2026-03-19 12:47:55.895363 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-03-19 12:47:55.895395 | controller | Thursday 19 March 2026 12:47:55 +0000 (0:00:00.251) 0:02:10.287 ******** 2026-03-19 12:47:55.895410 | controller | ok: [instance] 2026-03-19 12:47:56.198361 | controller | 2026-03-19 12:47:56.198401 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2026-03-19 12:47:56.198409 | controller | Thursday 19 March 2026 12:47:55 +0000 (0:00:00.213) 0:02:10.501 ******** 2026-03-19 12:47:56.198419 | controller | changed: [instance] 2026-03-19 12:47:56.221580 | controller | 2026-03-19 12:47:56.221635 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2026-03-19 12:47:56.221650 | controller | Thursday 19 March 2026 12:47:56 +0000 (0:00:00.303) 0:02:10.804 ******** 2026-03-19 12:47:56.221668 | controller | skipping: [instance] 2026-03-19 12:47:56.221679 | controller | 2026-03-19 12:47:56.221693 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2026-03-19 12:47:56.252369 | controller | Thursday 19 March 2026 12:47:56 +0000 (0:00:00.023) 0:02:10.828 ******** 2026-03-19 12:47:56.252438 | controller | skipping: [instance] 2026-03-19 12:47:56.282935 | controller | 2026-03-19 12:47:56.282964 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2026-03-19 12:47:56.282972 | controller | Thursday 19 March 2026 12:47:56 +0000 (0:00:00.030) 0:02:10.858 ******** 2026-03-19 12:47:56.282981 | controller | skipping: [instance] 2026-03-19 12:47:56.311028 | controller | 2026-03-19 12:47:56.311047 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2026-03-19 12:47:56.311054 | controller | Thursday 19 March 2026 12:47:56 +0000 (0:00:00.030) 0:02:10.889 ******** 2026-03-19 12:47:56.311063 | controller | skipping: [instance] 2026-03-19 12:47:56.549183 | controller | 2026-03-19 12:47:56.549203 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-03-19 12:47:56.549210 | controller | Thursday 19 March 2026 12:47:56 +0000 (0:00:00.028) 0:02:10.917 ******** 2026-03-19 12:47:56.549219 | controller | changed: [instance] 2026-03-19 12:47:56.588549 | controller | 2026-03-19 12:47:56.588602 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-03-19 12:47:56.588612 | controller | Thursday 19 March 2026 12:47:56 +0000 (0:00:00.238) 0:02:11.155 ******** 2026-03-19 12:47:56.588628 | controller | ok: [instance] 2026-03-19 12:47:56.588650 | controller | 2026-03-19 12:47:56.588658 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-03-19 12:47:56.588667 | controller | Thursday 19 March 2026 12:47:56 +0000 (0:00:00.039) 0:02:11.195 ******** 2026-03-19 12:47:56.644966 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-03-19 12:47:56.645014 | controller | 2026-03-19 12:47:56.645116 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-03-19 12:47:56.645207 | controller | Thursday 19 March 2026 12:47:56 +0000 (0:00:00.056) 0:02:11.251 ******** 2026-03-19 12:47:56.848725 | controller | ok: [instance] 2026-03-19 12:47:56.848778 | controller | 2026-03-19 12:47:56.848816 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-03-19 12:47:56.848929 | controller | Thursday 19 March 2026 12:47:56 +0000 (0:00:00.203) 0:02:11.455 ******** 2026-03-19 12:47:56.912234 | controller | ok: [instance] 2026-03-19 12:47:56.912283 | controller | 2026-03-19 12:47:56.912418 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-03-19 12:47:56.912517 | controller | Thursday 19 March 2026 12:47:56 +0000 (0:00:00.063) 0:02:11.519 ******** 2026-03-19 12:47:56.959455 | controller | ok: [instance] 2026-03-19 12:47:56.959554 | controller | 2026-03-19 12:47:56.959655 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-03-19 12:47:56.959752 | controller | Thursday 19 March 2026 12:47:56 +0000 (0:00:00.047) 0:02:11.566 ******** 2026-03-19 12:47:57.014182 | controller | skipping: [instance] 2026-03-19 12:47:57.062013 | controller | 2026-03-19 12:47:57.062037 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-03-19 12:47:57.062048 | controller | Thursday 19 March 2026 12:47:57 +0000 (0:00:00.054) 0:02:11.620 ******** 2026-03-19 12:47:57.062060 | controller | skipping: [instance] 2026-03-19 12:47:57.126956 | controller | 2026-03-19 12:47:57.127007 | controller | TASK [Call the config_drive role] ********************************************** 2026-03-19 12:47:57.127021 | controller | Thursday 19 March 2026 12:47:57 +0000 (0:00:00.048) 0:02:11.668 ******** 2026-03-19 12:47:57.127037 | controller | 2026-03-19 12:47:57.554154 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-03-19 12:47:57.554191 | controller | Thursday 19 March 2026 12:47:57 +0000 (0:00:00.064) 0:02:11.733 ******** 2026-03-19 12:47:57.554210 | controller | ok: [instance] => (item=artifacts) 2026-03-19 12:47:58.851368 | controller | ok: [instance] => (item=logs) 2026-03-19 12:47:58.851443 | controller | 2026-03-19 12:47:58.851453 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-03-19 12:47:58.851460 | controller | Thursday 19 March 2026 12:47:57 +0000 (0:00:00.426) 0:02:12.160 ******** 2026-03-19 12:47:58.851472 | controller | ok: [instance] 2026-03-19 12:47:59.075234 | controller | 2026-03-19 12:47:59.075283 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-03-19 12:47:59.075292 | controller | Thursday 19 March 2026 12:47:58 +0000 (0:00:01.297) 0:02:13.457 ******** 2026-03-19 12:47:59.075304 | controller | changed: [instance] 2026-03-19 12:47:59.472301 | controller | 2026-03-19 12:47:59.472352 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-03-19 12:47:59.472363 | controller | Thursday 19 March 2026 12:47:59 +0000 (0:00:00.223) 0:02:13.681 ******** 2026-03-19 12:47:59.472395 | controller | changed: [instance] 2026-03-19 12:47:59.869627 | controller | 2026-03-19 12:47:59.869695 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-03-19 12:47:59.869708 | controller | Thursday 19 March 2026 12:47:59 +0000 (0:00:00.396) 0:02:14.078 ******** 2026-03-19 12:47:59.869721 | controller | changed: [instance] 2026-03-19 12:47:59.919427 | controller | 2026-03-19 12:47:59.919491 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-03-19 12:47:59.919503 | controller | Thursday 19 March 2026 12:47:59 +0000 (0:00:00.397) 0:02:14.475 ******** 2026-03-19 12:47:59.919518 | controller | skipping: [instance] 2026-03-19 12:48:00.129469 | controller | 2026-03-19 12:48:00.129514 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-03-19 12:48:00.129524 | controller | Thursday 19 March 2026 12:47:59 +0000 (0:00:00.049) 0:02:14.525 ******** 2026-03-19 12:48:00.129536 | controller | ok: [instance] 2026-03-19 12:48:00.174931 | controller | 2026-03-19 12:48:00.174966 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-03-19 12:48:00.174976 | controller | Thursday 19 March 2026 12:48:00 +0000 (0:00:00.210) 0:02:14.735 ******** 2026-03-19 12:48:00.174988 | controller | skipping: [instance] 2026-03-19 12:48:00.429491 | controller | 2026-03-19 12:48:00.429538 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-03-19 12:48:00.429549 | controller | Thursday 19 March 2026 12:48:00 +0000 (0:00:00.045) 0:02:14.781 ******** 2026-03-19 12:48:00.429561 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2026-03-19 12:48:00.725473 | controller | changed: [instance] 2026-03-19 12:48:00.725514 | controller | 2026-03-19 12:48:00.725523 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-03-19 12:48:00.725530 | controller | Thursday 19 March 2026 12:48:00 +0000 (0:00:00.254) 0:02:15.035 ******** 2026-03-19 12:48:00.725541 | controller | changed: [instance] 2026-03-19 12:48:00.774612 | controller | 2026-03-19 12:48:00.774678 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-03-19 12:48:00.774694 | controller | Thursday 19 March 2026 12:48:00 +0000 (0:00:00.295) 0:02:15.331 ******** 2026-03-19 12:48:00.774715 | controller | skipping: [instance] 2026-03-19 12:48:00.806286 | controller | 2026-03-19 12:48:00.806342 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2026-03-19 12:48:00.806352 | controller | Thursday 19 March 2026 12:48:00 +0000 (0:00:00.049) 0:02:15.380 ******** 2026-03-19 12:48:00.806365 | controller | skipping: [instance] 2026-03-19 12:48:01.069347 | controller | 2026-03-19 12:48:01.069421 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2026-03-19 12:48:01.069433 | controller | Thursday 19 March 2026 12:48:00 +0000 (0:00:00.031) 0:02:15.412 ******** 2026-03-19 12:48:01.069448 | controller | changed: [instance] 2026-03-19 12:48:01.311335 | controller | 2026-03-19 12:48:01.311404 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2026-03-19 12:48:01.311416 | controller | Thursday 19 March 2026 12:48:01 +0000 (0:00:00.262) 0:02:15.675 ******** 2026-03-19 12:48:01.311429 | controller | changed: [instance] 2026-03-19 12:48:01.629628 | controller | 2026-03-19 12:48:01.629670 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2026-03-19 12:48:01.629679 | controller | Thursday 19 March 2026 12:48:01 +0000 (0:00:00.241) 0:02:15.917 ******** 2026-03-19 12:48:01.629691 | controller | changed: [instance] 2026-03-19 12:48:01.661238 | controller | 2026-03-19 12:48:01.661258 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2026-03-19 12:48:01.661266 | controller | Thursday 19 March 2026 12:48:01 +0000 (0:00:00.318) 0:02:16.235 ******** 2026-03-19 12:48:01.661280 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-03-19 12:48:01.709297 | controller | 2026-03-19 12:48:01.709320 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-03-19 12:48:01.709327 | controller | Thursday 19 March 2026 12:48:01 +0000 (0:00:00.031) 0:02:16.267 ******** 2026-03-19 12:48:01.709337 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-03-19 12:48:01.961095 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-03-19 12:48:01.961144 | controller | 2026-03-19 12:48:01.961154 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-03-19 12:48:01.961163 | controller | Thursday 19 March 2026 12:48:01 +0000 (0:00:00.047) 0:02:16.315 ******** 2026-03-19 12:48:01.961177 | controller | ok: [instance] 2026-03-19 12:48:02.013431 | controller | 2026-03-19 12:48:02.013469 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-03-19 12:48:02.013479 | controller | Thursday 19 March 2026 12:48:01 +0000 (0:00:00.251) 0:02:16.566 ******** 2026-03-19 12:48:02.013493 | controller | ok: [instance] => (item=cifmw-public) 2026-03-19 12:48:02.259557 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-19 12:48:02.259617 | controller | 2026-03-19 12:48:02.259631 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-03-19 12:48:02.259642 | controller | Thursday 19 March 2026 12:48:02 +0000 (0:00:00.052) 0:02:16.619 ******** 2026-03-19 12:48:02.259659 | controller | ok: [instance] 2026-03-19 12:48:02.472483 | controller | 2026-03-19 12:48:02.472529 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-03-19 12:48:02.472538 | controller | Thursday 19 March 2026 12:48:02 +0000 (0:00:00.246) 0:02:16.865 ******** 2026-03-19 12:48:02.472550 | controller | ok: [instance] 2026-03-19 12:48:02.779903 | controller | 2026-03-19 12:48:02.779936 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2026-03-19 12:48:02.779945 | controller | Thursday 19 March 2026 12:48:02 +0000 (0:00:00.213) 0:02:17.078 ******** 2026-03-19 12:48:02.779955 | controller | changed: [instance] 2026-03-19 12:48:03.053503 | controller | 2026-03-19 12:48:03.053536 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-03-19 12:48:03.053544 | controller | Thursday 19 March 2026 12:48:02 +0000 (0:00:00.307) 0:02:17.386 ******** 2026-03-19 12:48:03.053554 | controller | ok: [instance] 2026-03-19 12:48:03.102491 | controller | 2026-03-19 12:48:03.102526 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-03-19 12:48:03.102534 | controller | Thursday 19 March 2026 12:48:03 +0000 (0:00:00.273) 0:02:17.659 ******** 2026-03-19 12:48:03.102544 | controller | ok: [instance] => (item=cifmw-public) 2026-03-19 12:48:03.102568 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-19 12:48:03.102576 | controller | 2026-03-19 12:48:03.102749 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-03-19 12:48:03.358911 | controller | Thursday 19 March 2026 12:48:03 +0000 (0:00:00.049) 0:02:17.708 ******** 2026-03-19 12:48:03.358956 | controller | ok: [instance] 2026-03-19 12:48:03.570791 | controller | 2026-03-19 12:48:03.570828 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-03-19 12:48:03.570836 | controller | Thursday 19 March 2026 12:48:03 +0000 (0:00:00.255) 0:02:17.964 ******** 2026-03-19 12:48:03.570846 | controller | ok: [instance] 2026-03-19 12:48:03.911506 | controller | 2026-03-19 12:48:03.911554 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2026-03-19 12:48:03.911564 | controller | Thursday 19 March 2026 12:48:03 +0000 (0:00:00.211) 0:02:18.176 ******** 2026-03-19 12:48:03.911581 | controller | changed: [instance] 2026-03-19 12:48:03.937416 | controller | 2026-03-19 12:48:03.937478 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2026-03-19 12:48:03.937488 | controller | Thursday 19 March 2026 12:48:03 +0000 (0:00:00.340) 0:02:18.517 ******** 2026-03-19 12:48:03.937502 | controller | skipping: [instance] 2026-03-19 12:48:03.971437 | controller | 2026-03-19 12:48:03.971472 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2026-03-19 12:48:03.971486 | controller | Thursday 19 March 2026 12:48:03 +0000 (0:00:00.026) 0:02:18.543 ******** 2026-03-19 12:48:03.971502 | controller | skipping: [instance] 2026-03-19 12:48:04.002584 | controller | 2026-03-19 12:48:04.002629 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2026-03-19 12:48:04.002639 | controller | Thursday 19 March 2026 12:48:03 +0000 (0:00:00.033) 0:02:18.577 ******** 2026-03-19 12:48:04.002662 | controller | skipping: [instance] 2026-03-19 12:48:04.002709 | controller | 2026-03-19 12:48:04.002722 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2026-03-19 12:48:04.031551 | controller | Thursday 19 March 2026 12:48:04 +0000 (0:00:00.031) 0:02:18.609 ******** 2026-03-19 12:48:04.031578 | controller | skipping: [instance] 2026-03-19 12:48:04.031885 | controller | 2026-03-19 12:48:04.031928 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-03-19 12:48:04.281364 | controller | Thursday 19 March 2026 12:48:04 +0000 (0:00:00.028) 0:02:18.637 ******** 2026-03-19 12:48:04.281434 | controller | changed: [instance] 2026-03-19 12:48:04.329015 | controller | 2026-03-19 12:48:04.329072 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-03-19 12:48:04.329081 | controller | Thursday 19 March 2026 12:48:04 +0000 (0:00:00.248) 0:02:18.886 ******** 2026-03-19 12:48:04.329093 | controller | ok: [instance] 2026-03-19 12:48:04.394523 | controller | 2026-03-19 12:48:04.394558 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-03-19 12:48:04.394568 | controller | Thursday 19 March 2026 12:48:04 +0000 (0:00:00.047) 0:02:18.934 ******** 2026-03-19 12:48:04.394580 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-03-19 12:48:04.394614 | controller | 2026-03-19 12:48:04.394624 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-03-19 12:48:04.394696 | controller | Thursday 19 March 2026 12:48:04 +0000 (0:00:00.066) 0:02:19.000 ******** 2026-03-19 12:48:04.617092 | controller | ok: [instance] 2026-03-19 12:48:04.691495 | controller | 2026-03-19 12:48:04.691542 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-03-19 12:48:04.691552 | controller | Thursday 19 March 2026 12:48:04 +0000 (0:00:00.222) 0:02:19.222 ******** 2026-03-19 12:48:04.691567 | controller | ok: [instance] 2026-03-19 12:48:04.691779 | controller | 2026-03-19 12:48:04.691802 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-03-19 12:48:04.748528 | controller | Thursday 19 March 2026 12:48:04 +0000 (0:00:00.074) 0:02:19.297 ******** 2026-03-19 12:48:04.748566 | controller | ok: [instance] 2026-03-19 12:48:04.748629 | controller | 2026-03-19 12:48:04.748651 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-03-19 12:48:04.748664 | controller | Thursday 19 March 2026 12:48:04 +0000 (0:00:00.057) 0:02:19.354 ******** 2026-03-19 12:48:04.808153 | controller | skipping: [instance] 2026-03-19 12:48:04.862509 | controller | 2026-03-19 12:48:04.862536 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-03-19 12:48:04.862546 | controller | Thursday 19 March 2026 12:48:04 +0000 (0:00:00.059) 0:02:19.413 ******** 2026-03-19 12:48:04.862557 | controller | skipping: [instance] 2026-03-19 12:48:04.933547 | controller | 2026-03-19 12:48:04.933598 | controller | TASK [Call the config_drive role] ********************************************** 2026-03-19 12:48:04.933611 | controller | Thursday 19 March 2026 12:48:04 +0000 (0:00:00.054) 0:02:19.468 ******** 2026-03-19 12:48:04.933628 | controller | 2026-03-19 12:48:05.386508 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-03-19 12:48:05.386568 | controller | Thursday 19 March 2026 12:48:04 +0000 (0:00:00.070) 0:02:19.539 ******** 2026-03-19 12:48:05.386586 | controller | ok: [instance] => (item=artifacts) 2026-03-19 12:48:06.685556 | controller | ok: [instance] => (item=logs) 2026-03-19 12:48:06.685592 | controller | 2026-03-19 12:48:06.685602 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-03-19 12:48:06.685610 | controller | Thursday 19 March 2026 12:48:05 +0000 (0:00:00.453) 0:02:19.992 ******** 2026-03-19 12:48:06.685622 | controller | ok: [instance] 2026-03-19 12:48:06.685655 | controller | 2026-03-19 12:48:06.685665 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-03-19 12:48:06.685768 | controller | Thursday 19 March 2026 12:48:06 +0000 (0:00:01.298) 0:02:21.291 ******** 2026-03-19 12:48:06.914558 | controller | changed: [instance] 2026-03-19 12:48:06.914673 | controller | 2026-03-19 12:48:06.914703 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-03-19 12:48:06.914715 | controller | Thursday 19 March 2026 12:48:06 +0000 (0:00:00.228) 0:02:21.520 ******** 2026-03-19 12:48:07.314036 | controller | changed: [instance] 2026-03-19 12:48:07.730453 | controller | 2026-03-19 12:48:07.730484 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-03-19 12:48:07.730492 | controller | Thursday 19 March 2026 12:48:07 +0000 (0:00:00.399) 0:02:21.919 ******** 2026-03-19 12:48:07.730502 | controller | changed: [instance] 2026-03-19 12:48:07.730526 | controller | 2026-03-19 12:48:07.730534 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-03-19 12:48:07.730630 | controller | Thursday 19 March 2026 12:48:07 +0000 (0:00:00.416) 0:02:22.336 ******** 2026-03-19 12:48:07.787836 | controller | skipping: [instance] 2026-03-19 12:48:08.027777 | controller | 2026-03-19 12:48:08.027799 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-03-19 12:48:08.027807 | controller | Thursday 19 March 2026 12:48:07 +0000 (0:00:00.057) 0:02:22.394 ******** 2026-03-19 12:48:08.027821 | controller | ok: [instance] 2026-03-19 12:48:08.080583 | controller | 2026-03-19 12:48:08.080612 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-03-19 12:48:08.080622 | controller | Thursday 19 March 2026 12:48:08 +0000 (0:00:00.240) 0:02:22.634 ******** 2026-03-19 12:48:08.080634 | controller | skipping: [instance] 2026-03-19 12:48:08.347456 | controller | 2026-03-19 12:48:08.347488 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-03-19 12:48:08.347497 | controller | Thursday 19 March 2026 12:48:08 +0000 (0:00:00.052) 0:02:22.686 ******** 2026-03-19 12:48:08.347507 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2026-03-19 12:48:08.347531 | controller | changed: [instance] 2026-03-19 12:48:08.347539 | controller | 2026-03-19 12:48:08.347742 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-03-19 12:48:08.675996 | controller | Thursday 19 March 2026 12:48:08 +0000 (0:00:00.266) 0:02:22.953 ******** 2026-03-19 12:48:08.676032 | controller | changed: [instance] 2026-03-19 12:48:08.738597 | controller | 2026-03-19 12:48:08.738649 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-03-19 12:48:08.738664 | controller | Thursday 19 March 2026 12:48:08 +0000 (0:00:00.328) 0:02:23.282 ******** 2026-03-19 12:48:08.738682 | controller | skipping: [instance] 2026-03-19 12:48:08.772947 | controller | 2026-03-19 12:48:08.772976 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2026-03-19 12:48:08.772985 | controller | Thursday 19 March 2026 12:48:08 +0000 (0:00:00.062) 0:02:23.345 ******** 2026-03-19 12:48:08.772996 | controller | skipping: [instance] 2026-03-19 12:48:09.062429 | controller | 2026-03-19 12:48:09.062453 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2026-03-19 12:48:09.062461 | controller | Thursday 19 March 2026 12:48:08 +0000 (0:00:00.034) 0:02:23.379 ******** 2026-03-19 12:48:09.062470 | controller | changed: [instance] 2026-03-19 12:48:09.349005 | controller | 2026-03-19 12:48:09.349040 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2026-03-19 12:48:09.349050 | controller | Thursday 19 March 2026 12:48:09 +0000 (0:00:00.289) 0:02:23.668 ******** 2026-03-19 12:48:09.349062 | controller | changed: [instance] 2026-03-19 12:48:09.787060 | controller | 2026-03-19 12:48:09.787094 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2026-03-19 12:48:09.787102 | controller | Thursday 19 March 2026 12:48:09 +0000 (0:00:00.286) 0:02:23.955 ******** 2026-03-19 12:48:09.787113 | controller | changed: [instance] 2026-03-19 12:48:09.819287 | controller | 2026-03-19 12:48:09.819309 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2026-03-19 12:48:09.819318 | controller | Thursday 19 March 2026 12:48:09 +0000 (0:00:00.438) 0:02:24.393 ******** 2026-03-19 12:48:09.819329 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-03-19 12:48:09.867549 | controller | 2026-03-19 12:48:09.867582 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-03-19 12:48:09.867590 | controller | Thursday 19 March 2026 12:48:09 +0000 (0:00:00.032) 0:02:24.425 ******** 2026-03-19 12:48:09.867601 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-03-19 12:48:09.867630 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-03-19 12:48:09.867638 | controller | 2026-03-19 12:48:09.867875 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-03-19 12:48:10.139002 | controller | Thursday 19 March 2026 12:48:09 +0000 (0:00:00.048) 0:02:24.474 ******** 2026-03-19 12:48:10.139026 | controller | ok: [instance] 2026-03-19 12:48:10.196081 | controller | 2026-03-19 12:48:10.196113 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-03-19 12:48:10.196139 | controller | Thursday 19 March 2026 12:48:10 +0000 (0:00:00.271) 0:02:24.745 ******** 2026-03-19 12:48:10.196151 | controller | ok: [instance] => (item=cifmw-public) 2026-03-19 12:48:10.468941 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-19 12:48:10.468975 | controller | 2026-03-19 12:48:10.468983 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-03-19 12:48:10.468990 | controller | Thursday 19 March 2026 12:48:10 +0000 (0:00:00.056) 0:02:24.802 ******** 2026-03-19 12:48:10.469000 | controller | ok: [instance] 2026-03-19 12:48:10.696035 | controller | 2026-03-19 12:48:10.696057 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-03-19 12:48:10.696064 | controller | Thursday 19 March 2026 12:48:10 +0000 (0:00:00.272) 0:02:25.075 ******** 2026-03-19 12:48:10.696074 | controller | ok: [instance] 2026-03-19 12:48:11.018778 | controller | 2026-03-19 12:48:11.018799 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2026-03-19 12:48:11.018807 | controller | Thursday 19 March 2026 12:48:10 +0000 (0:00:00.227) 0:02:25.302 ******** 2026-03-19 12:48:11.018821 | controller | changed: [instance] 2026-03-19 12:48:11.294026 | controller | 2026-03-19 12:48:11.294061 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-03-19 12:48:11.294069 | controller | Thursday 19 March 2026 12:48:11 +0000 (0:00:00.322) 0:02:25.625 ******** 2026-03-19 12:48:11.294079 | controller | ok: [instance] 2026-03-19 12:48:11.353495 | controller | 2026-03-19 12:48:11.353515 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-03-19 12:48:11.353522 | controller | Thursday 19 March 2026 12:48:11 +0000 (0:00:00.275) 0:02:25.900 ******** 2026-03-19 12:48:11.353532 | controller | ok: [instance] => (item=cifmw-public) 2026-03-19 12:48:11.619649 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-19 12:48:11.619687 | controller | 2026-03-19 12:48:11.619697 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-03-19 12:48:11.619704 | controller | Thursday 19 March 2026 12:48:11 +0000 (0:00:00.059) 0:02:25.959 ******** 2026-03-19 12:48:11.619716 | controller | ok: [instance] 2026-03-19 12:48:11.847030 | controller | 2026-03-19 12:48:11.847066 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-03-19 12:48:11.847077 | controller | Thursday 19 March 2026 12:48:11 +0000 (0:00:00.266) 0:02:26.225 ******** 2026-03-19 12:48:11.847089 | controller | ok: [instance] 2026-03-19 12:48:12.174946 | controller | 2026-03-19 12:48:12.174979 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2026-03-19 12:48:12.174987 | controller | Thursday 19 March 2026 12:48:11 +0000 (0:00:00.227) 0:02:26.453 ******** 2026-03-19 12:48:12.174996 | controller | changed: [instance] 2026-03-19 12:48:12.208292 | controller | 2026-03-19 12:48:12.208312 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2026-03-19 12:48:12.208319 | controller | Thursday 19 March 2026 12:48:12 +0000 (0:00:00.327) 0:02:26.781 ******** 2026-03-19 12:48:12.208328 | controller | skipping: [instance] 2026-03-19 12:48:12.250537 | controller | 2026-03-19 12:48:12.250566 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2026-03-19 12:48:12.250576 | controller | Thursday 19 March 2026 12:48:12 +0000 (0:00:00.033) 0:02:26.814 ******** 2026-03-19 12:48:12.250586 | controller | skipping: [instance] 2026-03-19 12:48:12.250652 | controller | 2026-03-19 12:48:12.250669 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2026-03-19 12:48:12.250680 | controller | Thursday 19 March 2026 12:48:12 +0000 (0:00:00.042) 0:02:26.857 ******** 2026-03-19 12:48:12.288323 | controller | skipping: [instance] 2026-03-19 12:48:12.324408 | controller | 2026-03-19 12:48:12.324440 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2026-03-19 12:48:12.324448 | controller | Thursday 19 March 2026 12:48:12 +0000 (0:00:00.037) 0:02:26.894 ******** 2026-03-19 12:48:12.324458 | controller | skipping: [instance] 2026-03-19 12:48:12.324465 | controller | 2026-03-19 12:48:12.324470 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-03-19 12:48:12.324478 | controller | Thursday 19 March 2026 12:48:12 +0000 (0:00:00.036) 0:02:26.930 ******** 2026-03-19 12:48:12.578446 | controller | changed: [instance] 2026-03-19 12:48:12.622239 | controller | 2026-03-19 12:48:12.622282 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-03-19 12:48:12.622292 | controller | Thursday 19 March 2026 12:48:12 +0000 (0:00:00.253) 0:02:27.184 ******** 2026-03-19 12:48:12.622304 | controller | ok: [instance] 2026-03-19 12:48:12.653563 | controller | 2026-03-19 12:48:12.653591 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-03-19 12:48:12.653601 | controller | Thursday 19 March 2026 12:48:12 +0000 (0:00:00.043) 0:02:27.228 ******** 2026-03-19 12:48:12.653613 | controller | skipping: [instance] 2026-03-19 12:48:12.688502 | controller | 2026-03-19 12:48:12.688525 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-03-19 12:48:12.688534 | controller | Thursday 19 March 2026 12:48:12 +0000 (0:00:00.031) 0:02:27.259 ******** 2026-03-19 12:48:12.688545 | controller | skipping: [instance] 2026-03-19 12:48:12.688620 | controller | 2026-03-19 12:48:12.688639 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-03-19 12:48:12.688651 | controller | Thursday 19 March 2026 12:48:12 +0000 (0:00:00.035) 0:02:27.295 ******** 2026-03-19 12:48:12.738920 | controller | skipping: [instance] 2026-03-19 12:48:12.776130 | controller | 2026-03-19 12:48:12.776158 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2026-03-19 12:48:12.776166 | controller | Thursday 19 March 2026 12:48:12 +0000 (0:00:00.050) 0:02:27.345 ******** 2026-03-19 12:48:12.776174 | controller | skipping: [instance] 2026-03-19 12:48:12.842177 | controller | 2026-03-19 12:48:12.842198 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2026-03-19 12:48:12.842211 | controller | Thursday 19 March 2026 12:48:12 +0000 (0:00:00.037) 0:02:27.382 ******** 2026-03-19 12:48:12.842220 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2026-03-19 12:48:13.110938 | controller | 2026-03-19 12:48:13.110970 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2026-03-19 12:48:13.110979 | controller | Thursday 19 March 2026 12:48:12 +0000 (0:00:00.065) 0:02:27.448 ******** 2026-03-19 12:48:13.110989 | controller | ok: [instance] => (item=crc) 2026-03-19 12:48:15.183715 | controller | 2026-03-19 12:48:15.183748 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2026-03-19 12:48:15.183756 | controller | Thursday 19 March 2026 12:48:13 +0000 (0:00:00.268) 0:02:27.717 ******** 2026-03-19 12:48:15.183766 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-03-19 12:48:15.183924 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-03-19 12:48:15.184074 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-03-19 12:48:15.184216 | controller | 2026-03-19 12:48:15.184345 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-03-19 12:48:15.184499 | controller | Thursday 19 March 2026 12:48:15 +0000 (0:00:02.073) 0:02:29.790 ******** 2026-03-19 12:48:15.822648 | controller | changed: [instance] 2026-03-19 12:48:15.822815 | controller | 2026-03-19 12:48:15.822952 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-03-19 12:48:15.823082 | controller | Thursday 19 March 2026 12:48:15 +0000 (0:00:00.638) 0:02:30.428 ******** 2026-03-19 12:48:16.416056 | controller | changed: [instance] 2026-03-19 12:48:17.055097 | controller | 2026-03-19 12:48:17.055136 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-03-19 12:48:17.055144 | controller | Thursday 19 March 2026 12:48:16 +0000 (0:00:00.592) 0:02:31.021 ******** 2026-03-19 12:48:17.055154 | controller | changed: [instance] 2026-03-19 12:48:17.901135 | controller | 2026-03-19 12:48:17.901189 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2026-03-19 12:48:17.901198 | controller | Thursday 19 March 2026 12:48:17 +0000 (0:00:00.635) 0:02:31.656 ******** 2026-03-19 12:48:17.901209 | controller | changed: [instance] => (item=compute-0.utility) 2026-03-19 12:48:41.072276 | controller | changed: [instance] => (item=controller-0.utility) 2026-03-19 12:48:41.072319 | controller | changed: [instance] => (item=crc-0.utility) 2026-03-19 12:48:41.072328 | controller | 2026-03-19 12:48:41.072334 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2026-03-19 12:48:41.072340 | controller | Thursday 19 March 2026 12:48:17 +0000 (0:00:00.849) 0:02:32.506 ******** 2026-03-19 12:48:41.072351 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-03-19 12:48:41.187564 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2026-03-19 12:48:41.187590 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2026-03-19 12:48:41.187598 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2026-03-19 12:48:41.187603 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2026-03-19 12:48:41.187609 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2026-03-19 12:48:41.187614 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). 2026-03-19 12:48:41.187620 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j646052346557.22301', 'results_file': '/home/zuul/.ansible_async/j646052346557.22301', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2026-03-19 12:48:41.187632 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j689798919690.22318', 'results_file': '/home/zuul/.ansible_async/j689798919690.22318', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2026-03-19 12:48:41.187637 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j13123810401.22334', 'results_file': '/home/zuul/.ansible_async/j13123810401.22334', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2026-03-19 12:48:41.187643 | controller | 2026-03-19 12:48:41.187649 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2026-03-19 12:48:41.187655 | controller | Thursday 19 March 2026 12:48:41 +0000 (0:00:23.170) 0:02:55.677 ******** 2026-03-19 12:48:41.187664 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-03-19 12:48:41.210949 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-03-19 12:48:41.210974 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-03-19 12:48:41.210995 | controller | 2026-03-19 12:48:41.211002 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-03-19 12:48:41.211008 | controller | Thursday 19 March 2026 12:48:41 +0000 (0:00:00.116) 0:02:55.793 ******** 2026-03-19 12:48:41.211017 | controller | skipping: [instance] 2026-03-19 12:48:41.250109 | controller | 2026-03-19 12:48:41.250134 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2026-03-19 12:48:41.250142 | controller | Thursday 19 March 2026 12:48:41 +0000 (0:00:00.023) 0:02:55.817 ******** 2026-03-19 12:48:41.250151 | controller | 2026-03-19 12:48:41.330214 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-03-19 12:48:41.330246 | controller | Thursday 19 March 2026 12:48:41 +0000 (0:00:00.039) 0:02:55.856 ******** 2026-03-19 12:48:41.330263 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-03-19 12:48:41.593456 | controller | 2026-03-19 12:48:41.593493 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-03-19 12:48:41.593501 | controller | Thursday 19 March 2026 12:48:41 +0000 (0:00:00.079) 0:02:55.936 ******** 2026-03-19 12:48:41.593511 | controller | changed: [instance] 2026-03-19 12:48:41.835686 | controller | 2026-03-19 12:48:41.835750 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-03-19 12:48:41.835759 | controller | Thursday 19 March 2026 12:48:41 +0000 (0:00:00.262) 0:02:56.199 ******** 2026-03-19 12:48:41.835774 | controller | changed: [instance] 2026-03-19 12:48:42.255061 | controller | 2026-03-19 12:48:42.255110 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2026-03-19 12:48:42.255119 | controller | Thursday 19 March 2026 12:48:41 +0000 (0:00:00.241) 0:02:56.441 ******** 2026-03-19 12:48:42.255140 | controller | changed: [instance] 2026-03-19 12:48:42.284587 | controller | 2026-03-19 12:48:42.284626 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2026-03-19 12:48:42.284635 | controller | Thursday 19 March 2026 12:48:42 +0000 (0:00:00.419) 0:02:56.860 ******** 2026-03-19 12:48:42.284646 | controller | skipping: [instance] 2026-03-19 12:48:42.314426 | controller | 2026-03-19 12:48:42.314451 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-03-19 12:48:42.314459 | controller | Thursday 19 March 2026 12:48:42 +0000 (0:00:00.029) 0:02:56.890 ******** 2026-03-19 12:48:42.314469 | controller | skipping: [instance] 2026-03-19 12:48:42.368460 | controller | 2026-03-19 12:48:42.368487 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2026-03-19 12:48:42.368495 | controller | Thursday 19 March 2026 12:48:42 +0000 (0:00:00.029) 0:02:56.920 ******** 2026-03-19 12:48:42.368506 | controller | skipping: [instance] 2026-03-19 12:48:42.417544 | controller | 2026-03-19 12:48:42.417564 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2026-03-19 12:48:42.417572 | controller | Thursday 19 March 2026 12:48:42 +0000 (0:00:00.054) 0:02:56.974 ******** 2026-03-19 12:48:42.417582 | controller | skipping: [instance] 2026-03-19 12:48:42.443332 | controller | 2026-03-19 12:48:42.443351 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-03-19 12:48:42.443359 | controller | Thursday 19 March 2026 12:48:42 +0000 (0:00:00.049) 0:02:57.023 ******** 2026-03-19 12:48:42.443367 | controller | skipping: [instance] 2026-03-19 12:48:42.489039 | controller | 2026-03-19 12:48:42.489059 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2026-03-19 12:48:42.489067 | controller | Thursday 19 March 2026 12:48:42 +0000 (0:00:00.025) 0:02:57.049 ******** 2026-03-19 12:48:42.489083 | controller | 2026-03-19 12:48:42.579613 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-03-19 12:48:42.579636 | controller | Thursday 19 March 2026 12:48:42 +0000 (0:00:00.045) 0:02:57.095 ******** 2026-03-19 12:48:42.579660 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-03-19 12:48:42.818104 | controller | 2026-03-19 12:48:42.818152 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-03-19 12:48:42.818160 | controller | Thursday 19 March 2026 12:48:42 +0000 (0:00:00.090) 0:02:57.185 ******** 2026-03-19 12:48:42.818172 | controller | ok: [instance] 2026-03-19 12:48:43.051230 | controller | 2026-03-19 12:48:43.051272 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-03-19 12:48:43.051280 | controller | Thursday 19 March 2026 12:48:42 +0000 (0:00:00.238) 0:02:57.424 ******** 2026-03-19 12:48:43.051292 | controller | ok: [instance] 2026-03-19 12:48:43.471627 | controller | 2026-03-19 12:48:43.471685 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2026-03-19 12:48:43.471694 | controller | Thursday 19 March 2026 12:48:43 +0000 (0:00:00.233) 0:02:57.657 ******** 2026-03-19 12:48:43.471707 | controller | changed: [instance] 2026-03-19 12:48:43.471726 | controller | 2026-03-19 12:48:43.471732 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2026-03-19 12:48:43.471739 | controller | Thursday 19 March 2026 12:48:43 +0000 (0:00:00.420) 0:02:58.077 ******** 2026-03-19 12:48:43.501186 | controller | skipping: [instance] 2026-03-19 12:48:43.501275 | controller | 2026-03-19 12:48:43.501410 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-03-19 12:48:43.501510 | controller | Thursday 19 March 2026 12:48:43 +0000 (0:00:00.030) 0:02:58.107 ******** 2026-03-19 12:48:43.537723 | controller | skipping: [instance] 2026-03-19 12:48:45.301038 | controller | 2026-03-19 12:48:45.301073 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2026-03-19 12:48:45.301082 | controller | Thursday 19 March 2026 12:48:43 +0000 (0:00:00.035) 0:02:58.143 ******** 2026-03-19 12:48:45.301092 | controller | changed: [instance -> controller-0.instance] 2026-03-19 12:48:46.570044 | controller | 2026-03-19 12:48:46.570083 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2026-03-19 12:48:46.570092 | controller | Thursday 19 March 2026 12:48:45 +0000 (0:00:01.763) 0:02:59.907 ******** 2026-03-19 12:48:46.570102 | controller | changed: [instance -> controller-0.instance] 2026-03-19 12:48:46.615554 | controller | 2026-03-19 12:48:46.615581 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-03-19 12:48:46.615589 | controller | Thursday 19 March 2026 12:48:46 +0000 (0:00:01.268) 0:03:01.175 ******** 2026-03-19 12:48:46.615599 | controller | 2026-03-19 12:48:46.834041 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-03-19 12:48:46.834074 | controller | Thursday 19 March 2026 12:48:46 +0000 (0:00:00.045) 0:03:01.221 ******** 2026-03-19 12:48:46.834087 | controller | ok: [instance] 2026-03-19 12:48:46.861812 | controller | 2026-03-19 12:48:46.861841 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-03-19 12:48:46.861854 | controller | Thursday 19 March 2026 12:48:46 +0000 (0:00:00.218) 0:03:01.440 ******** 2026-03-19 12:48:46.861864 | controller | ok: [instance] 2026-03-19 12:48:46.895224 | controller | 2026-03-19 12:48:46.895249 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-03-19 12:48:46.895258 | controller | Thursday 19 March 2026 12:48:46 +0000 (0:00:00.027) 0:03:01.468 ******** 2026-03-19 12:48:46.895268 | controller | skipping: [instance] 2026-03-19 12:48:46.943945 | controller | 2026-03-19 12:48:46.943979 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2026-03-19 12:48:46.943994 | controller | Thursday 19 March 2026 12:48:46 +0000 (0:00:00.033) 0:03:01.501 ******** 2026-03-19 12:48:46.944012 | controller | 2026-03-19 12:48:46.944030 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-03-19 12:48:46.944038 | controller | Thursday 19 March 2026 12:48:46 +0000 (0:00:00.049) 0:03:01.550 ******** 2026-03-19 12:48:47.038889 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2026-03-19 12:48:47.038969 | controller | 2026-03-19 12:48:47.039070 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-03-19 12:48:47.039170 | controller | Thursday 19 March 2026 12:48:47 +0000 (0:00:00.094) 0:03:01.645 ******** 2026-03-19 12:48:47.293483 | controller | ok: [instance] 2026-03-19 12:48:47.527787 | controller | 2026-03-19 12:48:47.527820 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-03-19 12:48:47.527829 | controller | Thursday 19 March 2026 12:48:47 +0000 (0:00:00.253) 0:03:01.899 ******** 2026-03-19 12:48:47.527839 | controller | ok: [instance] 2026-03-19 12:48:47.936645 | controller | 2026-03-19 12:48:47.936679 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2026-03-19 12:48:47.936687 | controller | Thursday 19 March 2026 12:48:47 +0000 (0:00:00.234) 0:03:02.133 ******** 2026-03-19 12:48:47.936697 | controller | changed: [instance] 2026-03-19 12:48:48.918943 | controller | 2026-03-19 12:48:48.919013 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2026-03-19 12:48:48.919023 | controller | Thursday 19 March 2026 12:48:47 +0000 (0:00:00.408) 0:03:02.542 ******** 2026-03-19 12:48:48.919035 | controller | changed: [instance] 2026-03-19 12:48:48.919193 | controller | 2026-03-19 12:48:48.919206 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-03-19 12:48:48.919317 | controller | Thursday 19 March 2026 12:48:48 +0000 (0:00:00.981) 0:03:03.524 ******** 2026-03-19 12:48:48.954366 | controller | skipping: [instance] 2026-03-19 12:48:49.008236 | controller | 2026-03-19 12:48:49.008257 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2026-03-19 12:48:49.008264 | controller | Thursday 19 March 2026 12:48:48 +0000 (0:00:00.035) 0:03:03.560 ******** 2026-03-19 12:48:49.008273 | controller | skipping: [instance] 2026-03-19 12:48:49.008508 | controller | 2026-03-19 12:48:49.008527 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2026-03-19 12:48:49.055746 | controller | Thursday 19 March 2026 12:48:49 +0000 (0:00:00.053) 0:03:03.614 ******** 2026-03-19 12:48:49.055768 | controller | skipping: [instance] 2026-03-19 12:48:49.111755 | controller | 2026-03-19 12:48:49.111775 | controller | TASK [Create VBMC entity] ****************************************************** 2026-03-19 12:48:49.111783 | controller | Thursday 19 March 2026 12:48:49 +0000 (0:00:00.047) 0:03:03.662 ******** 2026-03-19 12:48:49.111792 | controller | skipping: [instance] => (item=compute-0) 2026-03-19 12:48:49.387757 | controller | skipping: [instance] => (item=controller-0) 2026-03-19 12:48:49.387817 | controller | skipping: [instance] => (item=crc-0) 2026-03-19 12:48:49.387826 | controller | skipping: [instance] 2026-03-19 12:48:49.387834 | controller | 2026-03-19 12:48:49.387842 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2026-03-19 12:48:49.387849 | controller | Thursday 19 March 2026 12:48:49 +0000 (0:00:00.055) 0:03:03.717 ******** 2026-03-19 12:48:49.387863 | controller | ok: [instance] 2026-03-19 12:48:49.800507 | controller | 2026-03-19 12:48:49.800565 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2026-03-19 12:48:49.800576 | controller | Thursday 19 March 2026 12:48:49 +0000 (0:00:00.275) 0:03:03.993 ******** 2026-03-19 12:48:49.800590 | controller | changed: [instance] 2026-03-19 12:48:49.852980 | controller | 2026-03-19 12:48:49.853027 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2026-03-19 12:48:49.853036 | controller | Thursday 19 March 2026 12:48:49 +0000 (0:00:00.412) 0:03:04.405 ******** 2026-03-19 12:48:49.853048 | controller | skipping: [instance] 2026-03-19 12:48:49.891663 | controller | 2026-03-19 12:48:49.891693 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2026-03-19 12:48:49.891701 | controller | Thursday 19 March 2026 12:48:49 +0000 (0:00:00.052) 0:03:04.458 ******** 2026-03-19 12:48:49.891719 | controller | skipping: [instance] 2026-03-19 12:48:49.931240 | controller | 2026-03-19 12:48:49.931269 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2026-03-19 12:48:49.931279 | controller | Thursday 19 March 2026 12:48:49 +0000 (0:00:00.039) 0:03:04.497 ******** 2026-03-19 12:48:49.931291 | controller | skipping: [instance] 2026-03-19 12:48:50.789133 | controller | 2026-03-19 12:48:50.789191 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2026-03-19 12:48:50.789201 | controller | Thursday 19 March 2026 12:48:49 +0000 (0:00:00.039) 0:03:04.537 ******** 2026-03-19 12:48:50.789213 | controller | changed: [instance] 2026-03-19 12:48:51.643348 | controller | 2026-03-19 12:48:51.643420 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2026-03-19 12:48:51.643429 | controller | Thursday 19 March 2026 12:48:50 +0000 (0:00:00.857) 0:03:05.394 ******** 2026-03-19 12:48:51.643441 | controller | changed: [instance] 2026-03-19 12:48:51.692284 | controller | 2026-03-19 12:48:51.692323 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2026-03-19 12:48:51.692333 | controller | Thursday 19 March 2026 12:48:51 +0000 (0:00:00.853) 0:03:06.248 ******** 2026-03-19 12:48:51.692345 | controller | skipping: [instance] 2026-03-19 12:48:51.765646 | controller | 2026-03-19 12:48:51.765678 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2026-03-19 12:48:51.765687 | controller | Thursday 19 March 2026 12:48:51 +0000 (0:00:00.050) 0:03:06.298 ******** 2026-03-19 12:48:51.765700 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2026-03-19 12:48:51.828063 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2026-03-19 12:48:51.828096 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2026-03-19 12:48:51.828103 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2026-03-19 12:48:51.828109 | controller | 2026-03-19 12:48:51.828115 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2026-03-19 12:48:51.828121 | controller | Thursday 19 March 2026 12:48:51 +0000 (0:00:00.073) 0:03:06.371 ******** 2026-03-19 12:48:51.828131 | controller | skipping: [instance] 2026-03-19 12:48:51.866395 | controller | 2026-03-19 12:48:51.866422 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2026-03-19 12:48:51.866430 | controller | Thursday 19 March 2026 12:48:51 +0000 (0:00:00.060) 0:03:06.432 ******** 2026-03-19 12:48:51.866441 | controller | skipping: [instance] 2026-03-19 12:48:51.906655 | controller | 2026-03-19 12:48:51.906690 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2026-03-19 12:48:51.906699 | controller | Thursday 19 March 2026 12:48:51 +0000 (0:00:00.040) 0:03:06.472 ******** 2026-03-19 12:48:51.906710 | controller | skipping: [instance] 2026-03-19 12:48:51.947737 | controller | 2026-03-19 12:48:51.947767 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2026-03-19 12:48:51.947776 | controller | Thursday 19 March 2026 12:48:51 +0000 (0:00:00.040) 0:03:06.512 ******** 2026-03-19 12:48:51.947788 | controller | skipping: [instance] 2026-03-19 12:48:52.659368 | controller | 2026-03-19 12:48:52.659659 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2026-03-19 12:48:52.659669 | controller | Thursday 19 March 2026 12:48:51 +0000 (0:00:00.041) 0:03:06.554 ******** 2026-03-19 12:48:52.659686 | controller | changed: [instance] 2026-03-19 12:48:52.696883 | controller | 2026-03-19 12:48:52.696906 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2026-03-19 12:48:52.696914 | controller | Thursday 19 March 2026 12:48:52 +0000 (0:00:00.710) 0:03:07.264 ******** 2026-03-19 12:48:52.696924 | controller | skipping: [instance] 2026-03-19 12:48:52.731689 | controller | 2026-03-19 12:48:52.731713 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2026-03-19 12:48:52.731721 | controller | Thursday 19 March 2026 12:48:52 +0000 (0:00:00.038) 0:03:07.303 ******** 2026-03-19 12:48:52.731731 | controller | skipping: [instance] 2026-03-19 12:48:52.779473 | controller | 2026-03-19 12:48:52.779514 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2026-03-19 12:48:52.779523 | controller | Thursday 19 March 2026 12:48:52 +0000 (0:00:00.034) 0:03:07.338 ******** 2026-03-19 12:48:52.779536 | controller | skipping: [instance] 2026-03-19 12:48:52.812995 | controller | 2026-03-19 12:48:52.813027 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-03-19 12:48:52.813035 | controller | Thursday 19 March 2026 12:48:52 +0000 (0:00:00.046) 0:03:07.384 ******** 2026-03-19 12:48:52.813045 | controller | skipping: [instance] 2026-03-19 12:48:52.848074 | controller | 2026-03-19 12:48:52.848108 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-03-19 12:48:52.848116 | controller | Thursday 19 March 2026 12:48:52 +0000 (0:00:00.034) 0:03:07.419 ******** 2026-03-19 12:48:52.848127 | controller | skipping: [instance] 2026-03-19 12:48:52.887303 | controller | 2026-03-19 12:48:52.887334 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-03-19 12:48:52.887348 | controller | Thursday 19 March 2026 12:48:52 +0000 (0:00:00.034) 0:03:07.454 ******** 2026-03-19 12:48:52.887360 | controller | skipping: [instance] 2026-03-19 12:48:52.926223 | controller | 2026-03-19 12:48:52.926257 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-03-19 12:48:52.926266 | controller | Thursday 19 March 2026 12:48:52 +0000 (0:00:00.039) 0:03:07.493 ******** 2026-03-19 12:48:52.926277 | controller | skipping: [instance] 2026-03-19 12:48:52.963443 | controller | 2026-03-19 12:48:52.963474 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-03-19 12:48:52.963482 | controller | Thursday 19 March 2026 12:48:52 +0000 (0:00:00.038) 0:03:07.532 ******** 2026-03-19 12:48:52.963493 | controller | skipping: [instance] 2026-03-19 12:48:52.997755 | controller | 2026-03-19 12:48:52.997784 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-03-19 12:48:52.997793 | controller | Thursday 19 March 2026 12:48:52 +0000 (0:00:00.037) 0:03:07.569 ******** 2026-03-19 12:48:52.997804 | controller | skipping: [instance] 2026-03-19 12:48:53.067580 | controller | 2026-03-19 12:48:53.067625 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-03-19 12:48:53.067634 | controller | Thursday 19 March 2026 12:48:52 +0000 (0:00:00.034) 0:03:07.604 ******** 2026-03-19 12:48:53.067645 | controller | skipping: [instance] 2026-03-19 12:48:53.103861 | controller | 2026-03-19 12:48:53.103896 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2026-03-19 12:48:53.103905 | controller | Thursday 19 March 2026 12:48:53 +0000 (0:00:00.069) 0:03:07.673 ******** 2026-03-19 12:48:53.103915 | controller | skipping: [instance] 2026-03-19 12:48:53.331944 | controller | 2026-03-19 12:48:53.331986 | controller | TASK [reproducer : Configure Controller node] ********************************** 2026-03-19 12:48:53.331994 | controller | Thursday 19 March 2026 12:48:53 +0000 (0:00:00.036) 0:03:07.709 ******** 2026-03-19 12:48:53.332004 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2026-03-19 12:48:54.882337 | controller | 2026-03-19 12:48:54.882407 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-03-19 12:48:54.882420 | controller | Thursday 19 March 2026 12:48:53 +0000 (0:00:00.227) 0:03:07.937 ******** 2026-03-19 12:48:54.882432 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-03-19 12:48:54.906787 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-03-19 12:48:54.906807 | controller | 2026-03-19 12:48:54.906814 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-03-19 12:48:54.906820 | controller | Thursday 19 March 2026 12:48:54 +0000 (0:00:01.550) 0:03:09.488 ******** 2026-03-19 12:48:54.906830 | controller | skipping: [instance] 2026-03-19 12:48:55.657141 | controller | 2026-03-19 12:48:55.657187 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-03-19 12:48:55.657199 | controller | Thursday 19 March 2026 12:48:54 +0000 (0:00:00.025) 0:03:09.513 ******** 2026-03-19 12:48:55.657213 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:48:55.696244 | controller | 2026-03-19 12:48:55.696265 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-03-19 12:48:55.696274 | controller | Thursday 19 March 2026 12:48:55 +0000 (0:00:00.749) 0:03:10.262 ******** 2026-03-19 12:48:55.696286 | controller | skipping: [instance] 2026-03-19 12:48:55.734138 | controller | 2026-03-19 12:48:55.734164 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-03-19 12:48:55.734173 | controller | Thursday 19 March 2026 12:48:55 +0000 (0:00:00.039) 0:03:10.302 ******** 2026-03-19 12:48:55.734185 | controller | skipping: [instance] 2026-03-19 12:48:55.778564 | controller | 2026-03-19 12:48:55.778639 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-03-19 12:48:55.778652 | controller | Thursday 19 March 2026 12:48:55 +0000 (0:00:00.037) 0:03:10.340 ******** 2026-03-19 12:48:55.778669 | controller | skipping: [instance] 2026-03-19 12:48:55.778721 | controller | 2026-03-19 12:48:55.778803 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-03-19 12:48:55.778832 | controller | Thursday 19 March 2026 12:48:55 +0000 (0:00:00.044) 0:03:10.385 ******** 2026-03-19 12:48:55.827465 | controller | skipping: [instance] 2026-03-19 12:48:55.827789 | controller | 2026-03-19 12:48:55.827814 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2026-03-19 12:48:55.827826 | controller | Thursday 19 March 2026 12:48:55 +0000 (0:00:00.048) 0:03:10.433 ******** 2026-03-19 12:48:55.868589 | controller | skipping: [instance] 2026-03-19 12:48:55.868695 | controller | 2026-03-19 12:48:55.868711 | controller | TASK [reproducer : Install repos] ********************************************** 2026-03-19 12:48:55.868786 | controller | Thursday 19 March 2026 12:48:55 +0000 (0:00:00.041) 0:03:10.475 ******** 2026-03-19 12:48:55.910564 | controller | skipping: [instance] 2026-03-19 12:48:55.910592 | controller | 2026-03-19 12:48:55.910605 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2026-03-19 12:48:55.910828 | controller | Thursday 19 March 2026 12:48:55 +0000 (0:00:00.041) 0:03:10.516 ******** 2026-03-19 12:48:55.952093 | controller | skipping: [instance] 2026-03-19 12:48:55.952314 | controller | 2026-03-19 12:48:55.952588 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2026-03-19 12:48:55.952806 | controller | Thursday 19 March 2026 12:48:55 +0000 (0:00:00.041) 0:03:10.558 ******** 2026-03-19 12:48:55.992982 | controller | skipping: [instance] 2026-03-19 12:48:55.993161 | controller | 2026-03-19 12:48:55.993276 | controller | TASK [reproducer : Install some tools] ***************************************** 2026-03-19 12:48:55.993423 | controller | Thursday 19 March 2026 12:48:55 +0000 (0:00:00.040) 0:03:10.599 ******** 2026-03-19 12:48:57.193594 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:48:57.193680 | controller | 2026-03-19 12:48:57.193769 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2026-03-19 12:48:57.193884 | controller | Thursday 19 March 2026 12:48:57 +0000 (0:00:01.200) 0:03:11.799 ******** 2026-03-19 12:48:58.361469 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:48:58.361550 | controller | 2026-03-19 12:48:58.361721 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2026-03-19 12:48:58.361767 | controller | Thursday 19 March 2026 12:48:58 +0000 (0:00:01.167) 0:03:12.967 ******** 2026-03-19 12:48:59.008365 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:49:00.149721 | controller | 2026-03-19 12:49:00.149765 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2026-03-19 12:49:00.149774 | controller | Thursday 19 March 2026 12:48:59 +0000 (0:00:00.646) 0:03:13.614 ******** 2026-03-19 12:49:00.149786 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:49:00.149814 | controller | 2026-03-19 12:49:00.149823 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2026-03-19 12:49:01.280026 | controller | Thursday 19 March 2026 12:49:00 +0000 (0:00:01.141) 0:03:14.755 ******** 2026-03-19 12:49:01.280117 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-03-19 12:49:01.280325 | controller | skipping: [instance] => (item=compute-0) 2026-03-19 12:49:01.280394 | controller | skipping: [instance] => (item=controller-0) 2026-03-19 12:49:01.280411 | controller | skipping: [instance] => (item=crc-0) 2026-03-19 12:49:01.280437 | controller | 2026-03-19 12:49:02.051533 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2026-03-19 12:49:02.051583 | controller | Thursday 19 March 2026 12:49:01 +0000 (0:00:01.129) 0:03:15.885 ******** 2026-03-19 12:49:02.051600 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-03-19 12:49:02.051632 | controller | skipping: [instance] => (item=compute-0) 2026-03-19 12:49:02.051644 | controller | skipping: [instance] => (item=controller-0) 2026-03-19 12:49:02.051896 | controller | skipping: [instance] => (item=crc-0) 2026-03-19 12:49:02.051917 | controller | 2026-03-19 12:49:03.988642 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2026-03-19 12:49:03.988689 | controller | Thursday 19 March 2026 12:49:02 +0000 (0:00:00.771) 0:03:16.657 ******** 2026-03-19 12:49:03.988704 | controller | skipping: [instance] => (item=instance) 2026-03-19 12:49:04.787777 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2026-03-19 12:49:04.787817 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-03-19 12:49:04.787825 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2026-03-19 12:49:04.787831 | controller | 2026-03-19 12:49:04.787837 | controller | TASK [reproducer : Create kube directory] ************************************** 2026-03-19 12:49:04.787843 | controller | Thursday 19 March 2026 12:49:03 +0000 (0:00:01.936) 0:03:18.593 ******** 2026-03-19 12:49:04.787854 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:49:05.955871 | controller | 2026-03-19 12:49:05.955914 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2026-03-19 12:49:05.955923 | controller | Thursday 19 March 2026 12:49:04 +0000 (0:00:00.799) 0:03:19.393 ******** 2026-03-19 12:49:05.955936 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:49:07.077731 | controller | 2026-03-19 12:49:07.077770 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2026-03-19 12:49:07.077780 | controller | Thursday 19 March 2026 12:49:05 +0000 (0:00:01.168) 0:03:20.561 ******** 2026-03-19 12:49:07.077792 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:49:07.121464 | controller | 2026-03-19 12:49:07.121503 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2026-03-19 12:49:07.121511 | controller | Thursday 19 March 2026 12:49:07 +0000 (0:00:01.122) 0:03:21.683 ******** 2026-03-19 12:49:07.121523 | controller | skipping: [instance] 2026-03-19 12:49:07.121876 | controller | 2026-03-19 12:49:07.789651 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2026-03-19 12:49:07.789691 | controller | Thursday 19 March 2026 12:49:07 +0000 (0:00:00.044) 0:03:21.727 ******** 2026-03-19 12:49:07.789705 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:49:08.429948 | controller | 2026-03-19 12:49:08.429988 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2026-03-19 12:49:08.430002 | controller | Thursday 19 March 2026 12:49:07 +0000 (0:00:00.667) 0:03:22.395 ******** 2026-03-19 12:49:08.430018 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:49:08.475065 | controller | 2026-03-19 12:49:08.475091 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2026-03-19 12:49:08.475099 | controller | Thursday 19 March 2026 12:49:08 +0000 (0:00:00.640) 0:03:23.035 ******** 2026-03-19 12:49:08.475109 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:49:08.560232 | controller | 2026-03-19 12:49:08.560277 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2026-03-19 12:49:08.560286 | controller | Thursday 19 March 2026 12:49:08 +0000 (0:00:00.044) 0:03:23.080 ******** 2026-03-19 12:49:08.560298 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2026-03-19 12:49:08.617142 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2026-03-19 12:49:08.617181 | controller | 2026-03-19 12:49:08.617190 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-03-19 12:49:08.617197 | controller | Thursday 19 March 2026 12:49:08 +0000 (0:00:00.084) 0:03:23.165 ******** 2026-03-19 12:49:08.617208 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-03-19 12:49:08.675704 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2026-03-19 12:49:08.675756 | controller | 2026-03-19 12:49:08.675765 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-03-19 12:49:08.675773 | controller | Thursday 19 March 2026 12:49:08 +0000 (0:00:00.057) 0:03:23.223 ******** 2026-03-19 12:49:08.675786 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-03-19 12:49:08.734268 | controller | _secret_file: '' 2026-03-19 12:49:08.734301 | controller | 2026-03-19 12:49:08.734310 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-03-19 12:49:08.734317 | controller | Thursday 19 March 2026 12:49:08 +0000 (0:00:00.058) 0:03:23.281 ******** 2026-03-19 12:49:08.734327 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-03-19 12:49:08.791162 | controller | _secret_content: my-default-location-place 2026-03-19 12:49:08.791189 | controller | 2026-03-19 12:49:08.791197 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-03-19 12:49:08.791204 | controller | Thursday 19 March 2026 12:49:08 +0000 (0:00:00.058) 0:03:23.340 ******** 2026-03-19 12:49:08.791214 | controller | skipping: [instance] 2026-03-19 12:49:08.847573 | controller | 2026-03-19 12:49:08.847592 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-03-19 12:49:08.847600 | controller | Thursday 19 March 2026 12:49:08 +0000 (0:00:00.057) 0:03:23.397 ******** 2026-03-19 12:49:08.847609 | controller | skipping: [instance] 2026-03-19 12:49:08.904092 | controller | 2026-03-19 12:49:08.904110 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-03-19 12:49:08.904118 | controller | Thursday 19 March 2026 12:49:08 +0000 (0:00:00.056) 0:03:23.453 ******** 2026-03-19 12:49:08.904128 | controller | skipping: [instance] 2026-03-19 12:49:10.003720 | controller | 2026-03-19 12:49:10.003765 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-03-19 12:49:10.003774 | controller | Thursday 19 March 2026 12:49:08 +0000 (0:00:00.056) 0:03:23.510 ******** 2026-03-19 12:49:10.003787 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:49:10.069023 | controller | 2026-03-19 12:49:10.069041 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-03-19 12:49:10.069048 | controller | Thursday 19 March 2026 12:49:09 +0000 (0:00:01.095) 0:03:24.606 ******** 2026-03-19 12:49:10.069057 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-03-19 12:49:10.125436 | controller | _secret_dest: /home/zuul/ipmi-things 2026-03-19 12:49:10.125460 | controller | 2026-03-19 12:49:10.125470 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-03-19 12:49:10.125502 | controller | Thursday 19 March 2026 12:49:10 +0000 (0:00:00.069) 0:03:24.675 ******** 2026-03-19 12:49:10.125515 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-03-19 12:49:10.125812 | controller | _secret_file: /tmp/ipmi-things 2026-03-19 12:49:10.125823 | controller | 2026-03-19 12:49:10.125832 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-03-19 12:49:10.184954 | controller | Thursday 19 March 2026 12:49:10 +0000 (0:00:00.056) 0:03:24.731 ******** 2026-03-19 12:49:10.184977 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-03-19 12:49:10.254048 | controller | _secret_content: '' 2026-03-19 12:49:10.254065 | controller | 2026-03-19 12:49:10.254073 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-03-19 12:49:10.254080 | controller | Thursday 19 March 2026 12:49:10 +0000 (0:00:00.058) 0:03:24.790 ******** 2026-03-19 12:49:10.254089 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2026-03-19 12:49:10.909237 | controller | msg: All assertions passed 2026-03-19 12:49:10.909283 | controller | 2026-03-19 12:49:10.909293 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-03-19 12:49:10.909300 | controller | Thursday 19 March 2026 12:49:10 +0000 (0:00:00.069) 0:03:24.860 ******** 2026-03-19 12:49:10.909312 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:49:12.003459 | controller | 2026-03-19 12:49:12.003509 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-03-19 12:49:12.003518 | controller | Thursday 19 March 2026 12:49:10 +0000 (0:00:00.655) 0:03:25.515 ******** 2026-03-19 12:49:12.003536 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:49:12.068952 | controller | 2026-03-19 12:49:12.068992 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-03-19 12:49:12.069003 | controller | Thursday 19 March 2026 12:49:12 +0000 (0:00:01.094) 0:03:26.609 ******** 2026-03-19 12:49:12.069017 | controller | skipping: [instance] 2026-03-19 12:49:12.723369 | controller | 2026-03-19 12:49:12.723441 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2026-03-19 12:49:12.723452 | controller | Thursday 19 March 2026 12:49:12 +0000 (0:00:00.065) 0:03:26.675 ******** 2026-03-19 12:49:12.723467 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:49:13.408639 | controller | 2026-03-19 12:49:13.408684 | controller | TASK [reproducer : Check if async file is still available] ********************* 2026-03-19 12:49:13.408693 | controller | Thursday 19 March 2026 12:49:12 +0000 (0:00:00.654) 0:03:27.329 ******** 2026-03-19 12:49:13.408707 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:49:58.654813 | controller | 2026-03-19 12:49:58.654869 | controller | TASK [reproducer : Check package install status] ******************************* 2026-03-19 12:49:58.654878 | controller | Thursday 19 March 2026 12:49:13 +0000 (0:00:00.684) 0:03:28.014 ******** 2026-03-19 12:49:58.654890 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2026-03-19 12:49:58.655339 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2026-03-19 12:49:58.655516 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2026-03-19 12:49:58.655682 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2026-03-19 12:49:58.655828 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2026-03-19 12:49:58.655958 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2026-03-19 12:49:58.656083 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2026-03-19 12:49:58.656277 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2026-03-19 12:49:58.656436 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:49:58.656570 | controller | 2026-03-19 12:49:58.656701 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2026-03-19 12:49:58.656836 | controller | Thursday 19 March 2026 12:49:58 +0000 (0:00:45.241) 0:04:13.255 ******** 2026-03-19 12:49:59.307927 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:02.472715 | controller | 2026-03-19 12:50:02.472751 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2026-03-19 12:50:02.472760 | controller | Thursday 19 March 2026 12:49:59 +0000 (0:00:00.658) 0:04:13.914 ******** 2026-03-19 12:50:02.472770 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:02.520113 | controller | 2026-03-19 12:50:02.520146 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2026-03-19 12:50:02.520154 | controller | Thursday 19 March 2026 12:50:02 +0000 (0:00:03.164) 0:04:17.078 ******** 2026-03-19 12:50:02.520164 | controller | skipping: [instance] 2026-03-19 12:50:02.571471 | controller | 2026-03-19 12:50:02.571511 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2026-03-19 12:50:02.571520 | controller | Thursday 19 March 2026 12:50:02 +0000 (0:00:00.048) 0:04:17.126 ******** 2026-03-19 12:50:02.571530 | controller | skipping: [instance] 2026-03-19 12:50:03.225121 | controller | 2026-03-19 12:50:03.225157 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2026-03-19 12:50:03.225166 | controller | Thursday 19 March 2026 12:50:02 +0000 (0:00:00.049) 0:04:17.176 ******** 2026-03-19 12:50:03.225176 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:03.823415 | controller | 2026-03-19 12:50:03.823454 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2026-03-19 12:50:03.823463 | controller | Thursday 19 March 2026 12:50:03 +0000 (0:00:00.654) 0:04:17.831 ******** 2026-03-19 12:50:03.823473 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:04.147836 | controller | 2026-03-19 12:50:04.147871 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2026-03-19 12:50:04.147879 | controller | Thursday 19 March 2026 12:50:03 +0000 (0:00:00.597) 0:04:18.428 ******** 2026-03-19 12:50:04.147889 | controller | changed: [instance] 2026-03-19 12:50:04.815549 | controller | 2026-03-19 12:50:04.815592 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2026-03-19 12:50:04.815600 | controller | Thursday 19 March 2026 12:50:04 +0000 (0:00:00.323) 0:04:18.751 ******** 2026-03-19 12:50:04.815616 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:05.787054 | controller | 2026-03-19 12:50:05.787092 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2026-03-19 12:50:05.787102 | controller | Thursday 19 March 2026 12:50:04 +0000 (0:00:00.669) 0:04:19.421 ******** 2026-03-19 12:50:05.787114 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:05.830761 | controller | 2026-03-19 12:50:05.830791 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-03-19 12:50:05.830813 | controller | Thursday 19 March 2026 12:50:05 +0000 (0:00:00.971) 0:04:20.393 ******** 2026-03-19 12:50:05.830825 | controller | skipping: [instance] 2026-03-19 12:50:05.878765 | controller | 2026-03-19 12:50:05.878787 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-03-19 12:50:05.878806 | controller | Thursday 19 March 2026 12:50:05 +0000 (0:00:00.043) 0:04:20.437 ******** 2026-03-19 12:50:05.878816 | controller | skipping: [instance] 2026-03-19 12:50:05.878991 | controller | 2026-03-19 12:50:05.879004 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-03-19 12:50:05.879111 | controller | Thursday 19 March 2026 12:50:05 +0000 (0:00:00.047) 0:04:20.485 ******** 2026-03-19 12:50:05.916605 | controller | skipping: [instance] 2026-03-19 12:50:05.967700 | controller | 2026-03-19 12:50:05.967720 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2026-03-19 12:50:05.967727 | controller | Thursday 19 March 2026 12:50:05 +0000 (0:00:00.037) 0:04:20.522 ******** 2026-03-19 12:50:05.967741 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:06.003947 | controller | 2026-03-19 12:50:06.003969 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2026-03-19 12:50:06.003978 | controller | Thursday 19 March 2026 12:50:05 +0000 (0:00:00.051) 0:04:20.574 ******** 2026-03-19 12:50:06.003989 | controller | skipping: [instance] 2026-03-19 12:50:06.039584 | controller | 2026-03-19 12:50:06.039603 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2026-03-19 12:50:06.039611 | controller | Thursday 19 March 2026 12:50:06 +0000 (0:00:00.036) 0:04:20.610 ******** 2026-03-19 12:50:06.039620 | controller | skipping: [instance] 2026-03-19 12:50:06.078306 | controller | 2026-03-19 12:50:06.078330 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2026-03-19 12:50:06.078339 | controller | Thursday 19 March 2026 12:50:06 +0000 (0:00:00.035) 0:04:20.646 ******** 2026-03-19 12:50:06.078350 | controller | skipping: [instance] 2026-03-19 12:50:06.078538 | controller | 2026-03-19 12:50:06.078710 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2026-03-19 12:50:06.078870 | controller | Thursday 19 March 2026 12:50:06 +0000 (0:00:00.038) 0:04:20.684 ******** 2026-03-19 12:50:06.709303 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:06.816196 | controller | 2026-03-19 12:50:06.816230 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2026-03-19 12:50:06.816238 | controller | Thursday 19 March 2026 12:50:06 +0000 (0:00:00.630) 0:04:21.315 ******** 2026-03-19 12:50:06.816248 | controller | skipping: [instance] => (item=secret) 2026-03-19 12:50:07.843309 | controller | skipping: [instance] => (item=configmap) 2026-03-19 12:50:07.843342 | controller | skipping: [instance] => (item=pod) 2026-03-19 12:50:07.843349 | controller | skipping: [instance] => (item=service) 2026-03-19 12:50:07.843355 | controller | skipping: [instance] => (item=route) 2026-03-19 12:50:07.843361 | controller | skipping: [instance] 2026-03-19 12:50:07.843367 | controller | 2026-03-19 12:50:07.843388 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2026-03-19 12:50:07.843398 | controller | Thursday 19 March 2026 12:50:06 +0000 (0:00:00.106) 0:04:21.422 ******** 2026-03-19 12:50:07.843408 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:08.882022 | controller | 2026-03-19 12:50:08.882061 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2026-03-19 12:50:08.882069 | controller | Thursday 19 March 2026 12:50:07 +0000 (0:00:01.027) 0:04:22.449 ******** 2026-03-19 12:50:08.882079 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:08.920672 | controller | 2026-03-19 12:50:08.920692 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2026-03-19 12:50:08.920699 | controller | Thursday 19 March 2026 12:50:08 +0000 (0:00:01.038) 0:04:23.488 ******** 2026-03-19 12:50:08.920708 | controller | skipping: [instance] 2026-03-19 12:50:08.956629 | controller | 2026-03-19 12:50:08.956648 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2026-03-19 12:50:08.956656 | controller | Thursday 19 March 2026 12:50:08 +0000 (0:00:00.039) 0:04:23.527 ******** 2026-03-19 12:50:08.956665 | controller | skipping: [instance] 2026-03-19 12:50:09.030418 | controller | 2026-03-19 12:50:09.030437 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2026-03-19 12:50:09.030445 | controller | Thursday 19 March 2026 12:50:08 +0000 (0:00:00.035) 0:04:23.563 ******** 2026-03-19 12:50:09.030454 | controller | skipping: [instance] => (item=secret) 2026-03-19 12:50:09.030967 | controller | skipping: [instance] => (item=configmap) 2026-03-19 12:50:09.030982 | controller | skipping: [instance] => (item=service) 2026-03-19 12:50:09.069882 | controller | skipping: [instance] => (item=route) 2026-03-19 12:50:09.069900 | controller | skipping: [instance] 2026-03-19 12:50:09.069908 | controller | 2026-03-19 12:50:09.069914 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2026-03-19 12:50:09.069920 | controller | Thursday 19 March 2026 12:50:09 +0000 (0:00:00.073) 0:04:23.636 ******** 2026-03-19 12:50:09.069934 | controller | skipping: [instance] 2026-03-19 12:50:10.693078 | controller | 2026-03-19 12:50:10.693110 | controller | TASK [podman : Ensure podman is installed] ************************************* 2026-03-19 12:50:10.693118 | controller | Thursday 19 March 2026 12:50:09 +0000 (0:00:00.039) 0:04:23.676 ******** 2026-03-19 12:50:10.693132 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:11.486075 | controller | 2026-03-19 12:50:11.486109 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2026-03-19 12:50:11.486117 | controller | Thursday 19 March 2026 12:50:10 +0000 (0:00:01.623) 0:04:25.299 ******** 2026-03-19 12:50:11.486127 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:11.529542 | controller | 2026-03-19 12:50:11.529569 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2026-03-19 12:50:11.529578 | controller | Thursday 19 March 2026 12:50:11 +0000 (0:00:00.792) 0:04:26.091 ******** 2026-03-19 12:50:11.529587 | controller | skipping: [instance] 2026-03-19 12:50:11.567654 | controller | 2026-03-19 12:50:11.567679 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2026-03-19 12:50:11.567687 | controller | Thursday 19 March 2026 12:50:11 +0000 (0:00:00.044) 0:04:26.135 ******** 2026-03-19 12:50:11.567696 | controller | skipping: [instance] 2026-03-19 12:50:11.612883 | controller | 2026-03-19 12:50:11.612912 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2026-03-19 12:50:11.612920 | controller | Thursday 19 March 2026 12:50:11 +0000 (0:00:00.038) 0:04:26.174 ******** 2026-03-19 12:50:11.612929 | controller | skipping: [instance] 2026-03-19 12:50:22.623609 | controller | 2026-03-19 12:50:22.623646 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2026-03-19 12:50:22.623654 | controller | Thursday 19 March 2026 12:50:11 +0000 (0:00:00.044) 0:04:26.219 ******** 2026-03-19 12:50:22.623665 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:24.219617 | controller | 2026-03-19 12:50:24.219651 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2026-03-19 12:50:24.219659 | controller | Thursday 19 March 2026 12:50:22 +0000 (0:00:11.004) 0:04:37.223 ******** 2026-03-19 12:50:24.219669 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:25.456619 | controller | 2026-03-19 12:50:25.456652 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-03-19 12:50:25.456660 | controller | Thursday 19 March 2026 12:50:24 +0000 (0:00:01.602) 0:04:38.825 ******** 2026-03-19 12:50:25.456671 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-03-19 12:50:25.494129 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-03-19 12:50:25.494155 | controller | 2026-03-19 12:50:25.494162 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2026-03-19 12:50:25.494168 | controller | Thursday 19 March 2026 12:50:25 +0000 (0:00:01.237) 0:04:40.062 ******** 2026-03-19 12:50:25.494177 | controller | skipping: [instance] 2026-03-19 12:50:26.171736 | controller | 2026-03-19 12:50:26.171773 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2026-03-19 12:50:26.171783 | controller | Thursday 19 March 2026 12:50:25 +0000 (0:00:00.037) 0:04:40.100 ******** 2026-03-19 12:50:26.171796 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:26.208436 | controller | 2026-03-19 12:50:26.208465 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2026-03-19 12:50:26.208475 | controller | Thursday 19 March 2026 12:50:26 +0000 (0:00:00.677) 0:04:40.777 ******** 2026-03-19 12:50:26.208486 | controller | skipping: [instance] 2026-03-19 12:50:26.254958 | controller | 2026-03-19 12:50:26.254985 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2026-03-19 12:50:26.254993 | controller | Thursday 19 March 2026 12:50:26 +0000 (0:00:00.037) 0:04:40.814 ******** 2026-03-19 12:50:26.255003 | controller | skipping: [instance] 2026-03-19 12:50:26.296331 | controller | 2026-03-19 12:50:26.296351 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-03-19 12:50:26.296366 | controller | Thursday 19 March 2026 12:50:26 +0000 (0:00:00.046) 0:04:40.861 ******** 2026-03-19 12:50:26.296396 | controller | skipping: [instance] 2026-03-19 12:50:26.333108 | controller | 2026-03-19 12:50:26.333127 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-03-19 12:50:26.333135 | controller | Thursday 19 March 2026 12:50:26 +0000 (0:00:00.041) 0:04:40.902 ******** 2026-03-19 12:50:26.333144 | controller | skipping: [instance] 2026-03-19 12:50:26.475220 | controller | 2026-03-19 12:50:26.475244 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2026-03-19 12:50:26.475254 | controller | Thursday 19 March 2026 12:50:26 +0000 (0:00:00.036) 0:04:40.939 ******** 2026-03-19 12:50:26.475265 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) 2026-03-19 12:50:27.578477 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) 2026-03-19 12:50:27.578513 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) 2026-03-19 12:50:27.578521 | controller | 2026-03-19 12:50:27.578528 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2026-03-19 12:50:27.578534 | controller | Thursday 19 March 2026 12:50:26 +0000 (0:00:00.141) 0:04:41.081 ******** 2026-03-19 12:50:27.578544 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:27.631632 | controller | 2026-03-19 12:50:27.631662 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2026-03-19 12:50:27.631672 | controller | Thursday 19 March 2026 12:50:27 +0000 (0:00:01.097) 0:04:42.178 ******** 2026-03-19 12:50:27.631684 | controller | skipping: [instance] 2026-03-19 12:50:27.779700 | controller | 2026-03-19 12:50:27.779743 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2026-03-19 12:50:27.779754 | controller | Thursday 19 March 2026 12:50:27 +0000 (0:00:00.059) 0:04:42.237 ******** 2026-03-19 12:50:27.779766 | controller | 2026-03-19 12:50:27.841589 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2026-03-19 12:50:27.841614 | controller | Thursday 19 March 2026 12:50:27 +0000 (0:00:00.148) 0:04:42.385 ******** 2026-03-19 12:50:27.841628 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:27.893707 | controller | 2026-03-19 12:50:27.893732 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-03-19 12:50:27.893741 | controller | Thursday 19 March 2026 12:50:27 +0000 (0:00:00.061) 0:04:42.447 ******** 2026-03-19 12:50:27.893753 | controller | skipping: [instance] 2026-03-19 12:50:27.932957 | controller | 2026-03-19 12:50:27.932976 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-03-19 12:50:27.932984 | controller | Thursday 19 March 2026 12:50:27 +0000 (0:00:00.051) 0:04:42.499 ******** 2026-03-19 12:50:27.932993 | controller | skipping: [instance] 2026-03-19 12:50:29.356293 | controller | 2026-03-19 12:50:29.356330 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2026-03-19 12:50:29.356338 | controller | Thursday 19 March 2026 12:50:27 +0000 (0:00:00.039) 0:04:42.539 ******** 2026-03-19 12:50:29.356349 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:37.095987 | controller | 2026-03-19 12:50:37.096022 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2026-03-19 12:50:37.096030 | controller | Thursday 19 March 2026 12:50:29 +0000 (0:00:01.422) 0:04:43.962 ******** 2026-03-19 12:50:37.096040 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1) 2026-03-19 12:50:37.193259 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b) 2026-03-19 12:50:37.193292 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282) 2026-03-19 12:50:37.193303 | controller | 2026-03-19 12:50:37.193310 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2026-03-19 12:50:37.193316 | controller | Thursday 19 March 2026 12:50:37 +0000 (0:00:07.736) 0:04:51.698 ******** 2026-03-19 12:50:37.193325 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2026-03-19 12:50:37.193343 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2026-03-19 12:50:37.193349 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2026-03-19 12:50:37.193357 | controller | 2026-03-19 12:50:37.193507 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2026-03-19 12:50:37.193536 | controller | Thursday 19 March 2026 12:50:37 +0000 (0:00:00.101) 0:04:51.799 ******** 2026-03-19 12:50:37.403285 | controller | ok: [instance -> localhost] 2026-03-19 12:50:39.397015 | controller | 2026-03-19 12:50:39.397048 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2026-03-19 12:50:39.397057 | controller | Thursday 19 March 2026 12:50:37 +0000 (0:00:00.209) 0:04:52.009 ******** 2026-03-19 12:50:39.397067 | controller | changed: [instance -> localhost] => (item=controller-0) 2026-03-19 12:50:40.031312 | controller | 2026-03-19 12:50:40.031343 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2026-03-19 12:50:40.031351 | controller | Thursday 19 March 2026 12:50:39 +0000 (0:00:01.993) 0:04:54.002 ******** 2026-03-19 12:50:40.031361 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:40.726516 | controller | 2026-03-19 12:50:40.726548 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2026-03-19 12:50:40.726556 | controller | Thursday 19 March 2026 12:50:40 +0000 (0:00:00.634) 0:04:54.637 ******** 2026-03-19 12:50:40.726566 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:41.836199 | controller | 2026-03-19 12:50:41.836230 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2026-03-19 12:50:41.836239 | controller | Thursday 19 March 2026 12:50:40 +0000 (0:00:00.695) 0:04:55.332 ******** 2026-03-19 12:50:41.836249 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:42.500546 | controller | 2026-03-19 12:50:42.500577 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2026-03-19 12:50:42.500585 | controller | Thursday 19 March 2026 12:50:41 +0000 (0:00:01.109) 0:04:56.441 ******** 2026-03-19 12:50:42.500595 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:43.569996 | controller | 2026-03-19 12:50:43.570028 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2026-03-19 12:50:43.570036 | controller | Thursday 19 March 2026 12:50:42 +0000 (0:00:00.664) 0:04:57.106 ******** 2026-03-19 12:50:43.570046 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:44.159697 | controller | 2026-03-19 12:50:44.159730 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2026-03-19 12:50:44.159739 | controller | Thursday 19 March 2026 12:50:43 +0000 (0:00:01.069) 0:04:58.176 ******** 2026-03-19 12:50:44.159749 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:44.814471 | controller | 2026-03-19 12:50:44.814504 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2026-03-19 12:50:44.814512 | controller | Thursday 19 March 2026 12:50:44 +0000 (0:00:00.589) 0:04:58.765 ******** 2026-03-19 12:50:44.814530 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:44.814765 | controller | 2026-03-19 12:50:44.814780 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2026-03-19 12:50:46.217487 | controller | Thursday 19 March 2026 12:50:44 +0000 (0:00:00.653) 0:04:59.419 ******** 2026-03-19 12:50:46.217548 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-03-19 12:50:46.217568 | controller | 2026-03-19 12:50:46.217577 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-03-19 12:50:46.217690 | controller | Thursday 19 March 2026 12:50:46 +0000 (0:00:01.404) 0:05:00.823 ******** 2026-03-19 12:50:46.251978 | controller | skipping: [instance] 2026-03-19 12:50:46.252039 | controller | 2026-03-19 12:50:46.252147 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-03-19 12:50:46.252240 | controller | Thursday 19 March 2026 12:50:46 +0000 (0:00:00.034) 0:05:00.858 ******** 2026-03-19 12:50:46.287631 | controller | skipping: [instance] 2026-03-19 12:50:46.287683 | controller | 2026-03-19 12:50:46.287783 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-03-19 12:50:46.287878 | controller | Thursday 19 March 2026 12:50:46 +0000 (0:00:00.035) 0:05:00.894 ******** 2026-03-19 12:50:46.324753 | controller | skipping: [instance] 2026-03-19 12:50:46.324835 | controller | 2026-03-19 12:50:46.324932 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-03-19 12:50:46.325034 | controller | Thursday 19 March 2026 12:50:46 +0000 (0:00:00.037) 0:05:00.931 ******** 2026-03-19 12:50:46.360747 | controller | skipping: [instance] 2026-03-19 12:50:46.360834 | controller | 2026-03-19 12:50:46.360949 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-03-19 12:50:46.361052 | controller | Thursday 19 March 2026 12:50:46 +0000 (0:00:00.036) 0:05:00.967 ******** 2026-03-19 12:50:46.396169 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:46.396245 | controller | 2026-03-19 12:50:46.396347 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-03-19 12:50:46.396479 | controller | Thursday 19 March 2026 12:50:46 +0000 (0:00:00.035) 0:05:01.002 ******** 2026-03-19 12:50:46.504172 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-03-19 12:50:46.504248 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2026-03-19 12:50:46.504336 | controller | 2026-03-19 12:50:46.504465 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-03-19 12:50:46.504599 | controller | Thursday 19 March 2026 12:50:46 +0000 (0:00:00.107) 0:05:01.110 ******** 2026-03-19 12:50:46.550757 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2026-03-19 12:50:46.550844 | controller | 2026-03-19 12:50:46.550958 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2026-03-19 12:50:46.551059 | controller | Thursday 19 March 2026 12:50:46 +0000 (0:00:00.046) 0:05:01.157 ******** 2026-03-19 12:50:49.756893 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-03-19 12:50:50.800725 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2026-03-19 12:50:50.800761 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-03-19 12:50:50.800769 | controller | 2026-03-19 12:50:50.800775 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2026-03-19 12:50:50.800781 | controller | Thursday 19 March 2026 12:50:49 +0000 (0:00:03.205) 0:05:04.362 ******** 2026-03-19 12:50:50.800791 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:51.297657 | controller | 2026-03-19 12:50:51.297695 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-03-19 12:50:51.297703 | controller | Thursday 19 March 2026 12:50:50 +0000 (0:00:01.043) 0:05:05.406 ******** 2026-03-19 12:50:51.297713 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:52.248434 | controller | 2026-03-19 12:50:52.248470 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-03-19 12:50:52.248479 | controller | Thursday 19 March 2026 12:50:51 +0000 (0:00:00.496) 0:05:05.903 ******** 2026-03-19 12:50:52.248489 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:52.338482 | controller | 2026-03-19 12:50:52.338504 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-03-19 12:50:52.338512 | controller | Thursday 19 March 2026 12:50:52 +0000 (0:00:00.950) 0:05:06.854 ******** 2026-03-19 12:50:52.338522 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:52.399962 | controller | 2026-03-19 12:50:52.399983 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-03-19 12:50:52.399991 | controller | Thursday 19 March 2026 12:50:52 +0000 (0:00:00.090) 0:05:06.944 ******** 2026-03-19 12:50:52.400000 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:53.366515 | controller | 2026-03-19 12:50:53.366547 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-03-19 12:50:53.366555 | controller | Thursday 19 March 2026 12:50:52 +0000 (0:00:00.060) 0:05:07.005 ******** 2026-03-19 12:50:53.366565 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:50:54.359418 | controller | 2026-03-19 12:50:54.359451 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2026-03-19 12:50:54.359464 | controller | Thursday 19 March 2026 12:50:53 +0000 (0:00:00.967) 0:05:07.972 ******** 2026-03-19 12:50:54.359475 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:00.444687 | controller | 2026-03-19 12:51:00.444737 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2026-03-19 12:51:00.444746 | controller | Thursday 19 March 2026 12:50:54 +0000 (0:00:00.992) 0:05:08.965 ******** 2026-03-19 12:51:00.444759 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2026-03-19 12:51:00.650283 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:00.650332 | controller | 2026-03-19 12:51:00.650341 | controller | TASK [Configure ntp service] *************************************************** 2026-03-19 12:51:00.650355 | controller | Thursday 19 March 2026 12:51:00 +0000 (0:00:06.085) 0:05:15.050 ******** 2026-03-19 12:51:00.650367 | controller | 2026-03-19 12:51:00.650430 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2026-03-19 12:51:01.676470 | controller | Thursday 19 March 2026 12:51:00 +0000 (0:00:00.205) 0:05:15.256 ******** 2026-03-19 12:51:01.676519 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:01.676541 | controller | 2026-03-19 12:51:01.676627 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2026-03-19 12:51:01.676732 | controller | Thursday 19 March 2026 12:51:01 +0000 (0:00:01.026) 0:05:16.282 ******** 2026-03-19 12:51:02.706584 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2026-03-19 12:51:02.706900 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2026-03-19 12:51:03.694950 | controller | 2026-03-19 12:51:03.695027 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2026-03-19 12:51:03.695036 | controller | Thursday 19 March 2026 12:51:02 +0000 (0:00:01.030) 0:05:17.313 ******** 2026-03-19 12:51:03.695051 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:04.402494 | controller | 2026-03-19 12:51:04.402559 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2026-03-19 12:51:04.402569 | controller | Thursday 19 March 2026 12:51:03 +0000 (0:00:00.983) 0:05:18.297 ******** 2026-03-19 12:51:04.402584 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:04.541752 | controller | 2026-03-19 12:51:04.541787 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2026-03-19 12:51:04.541796 | controller | Thursday 19 March 2026 12:51:04 +0000 (0:00:00.711) 0:05:19.008 ******** 2026-03-19 12:51:04.541807 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2026-03-19 12:51:04.541825 | controller | 2026-03-19 12:51:04.541831 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2026-03-19 12:51:04.541839 | controller | Thursday 19 March 2026 12:51:04 +0000 (0:00:00.139) 0:05:19.148 ******** 2026-03-19 12:51:05.078526 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:05.078594 | controller | 2026-03-19 12:51:05.078699 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2026-03-19 12:51:05.078790 | controller | Thursday 19 March 2026 12:51:05 +0000 (0:00:00.536) 0:05:19.684 ******** 2026-03-19 12:51:05.598517 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-03-19 12:51:05.598577 | controller | 2026-03-19 12:51:05.598696 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2026-03-19 12:51:05.598776 | controller | Thursday 19 March 2026 12:51:05 +0000 (0:00:00.519) 0:05:20.204 ******** 2026-03-19 12:51:06.319252 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-03-19 12:51:06.319304 | controller | 2026-03-19 12:51:06.319401 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2026-03-19 12:51:06.319527 | controller | Thursday 19 March 2026 12:51:06 +0000 (0:00:00.720) 0:05:20.925 ******** 2026-03-19 12:51:06.911021 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-03-19 12:51:06.959762 | controller | 2026-03-19 12:51:06.959794 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2026-03-19 12:51:06.959803 | controller | Thursday 19 March 2026 12:51:06 +0000 (0:00:00.590) 0:05:21.515 ******** 2026-03-19 12:51:06.959813 | controller | 2026-03-19 12:51:06.959944 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2026-03-19 12:51:07.470996 | controller | Thursday 19 March 2026 12:51:06 +0000 (0:00:00.050) 0:05:21.566 ******** 2026-03-19 12:51:07.471049 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-03-19 12:51:08.347857 | controller | 2026-03-19 12:51:08.347904 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2026-03-19 12:51:08.347914 | controller | Thursday 19 March 2026 12:51:07 +0000 (0:00:00.510) 0:05:22.077 ******** 2026-03-19 12:51:08.347928 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-03-19 12:51:08.390137 | controller | 2026-03-19 12:51:08.390168 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2026-03-19 12:51:08.390177 | controller | Thursday 19 March 2026 12:51:08 +0000 (0:00:00.876) 0:05:22.953 ******** 2026-03-19 12:51:08.390189 | controller | skipping: [instance] 2026-03-19 12:51:08.434980 | controller | 2026-03-19 12:51:08.435016 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2026-03-19 12:51:08.435035 | controller | Thursday 19 March 2026 12:51:08 +0000 (0:00:00.042) 0:05:22.996 ******** 2026-03-19 12:51:08.435048 | controller | skipping: [instance] 2026-03-19 12:51:08.692119 | controller | 2026-03-19 12:51:08.692161 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2026-03-19 12:51:08.692172 | controller | Thursday 19 March 2026 12:51:08 +0000 (0:00:00.044) 0:05:23.041 ******** 2026-03-19 12:51:08.692191 | controller | changed: [instance] 2026-03-19 12:51:08.767739 | controller | 2026-03-19 12:51:08.767775 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2026-03-19 12:51:08.767784 | controller | Thursday 19 March 2026 12:51:08 +0000 (0:00:00.256) 0:05:23.298 ******** 2026-03-19 12:51:08.767795 | controller | skipping: [instance] => (item=) 2026-03-19 12:51:08.804596 | controller | 2026-03-19 12:51:08.804616 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2026-03-19 12:51:08.804624 | controller | Thursday 19 March 2026 12:51:08 +0000 (0:00:00.075) 0:05:23.374 ******** 2026-03-19 12:51:08.804633 | controller | ok: [instance] 2026-03-19 12:51:08.878552 | controller | 2026-03-19 12:51:08.878571 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-03-19 12:51:08.878579 | controller | Thursday 19 March 2026 12:51:08 +0000 (0:00:00.036) 0:05:23.411 ******** 2026-03-19 12:51:08.878588 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-03-19 12:51:09.130432 | controller | 2026-03-19 12:51:09.130461 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-03-19 12:51:09.130469 | controller | Thursday 19 March 2026 12:51:08 +0000 (0:00:00.073) 0:05:23.485 ******** 2026-03-19 12:51:09.130480 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-03-19 12:51:09.179476 | controller | 2026-03-19 12:51:09.179498 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2026-03-19 12:51:09.179506 | controller | Thursday 19 March 2026 12:51:09 +0000 (0:00:00.251) 0:05:23.736 ******** 2026-03-19 12:51:09.179516 | controller | 2026-03-19 12:51:09.241679 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-03-19 12:51:09.241698 | controller | Thursday 19 March 2026 12:51:09 +0000 (0:00:00.049) 0:05:23.786 ******** 2026-03-19 12:51:09.241709 | controller | ok: [instance] 2026-03-19 12:51:09.298913 | controller | 2026-03-19 12:51:09.298931 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-03-19 12:51:09.298939 | controller | Thursday 19 March 2026 12:51:09 +0000 (0:00:00.062) 0:05:23.848 ******** 2026-03-19 12:51:09.298949 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-03-19 12:51:09.575450 | controller | 2026-03-19 12:51:09.575471 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-03-19 12:51:09.575478 | controller | Thursday 19 March 2026 12:51:09 +0000 (0:00:00.057) 0:05:23.905 ******** 2026-03-19 12:51:09.575488 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-03-19 12:51:09.604181 | controller | 2026-03-19 12:51:09.604200 | controller | TASK [dnsmasq : Remove crc.testing from host_records] ************************** 2026-03-19 12:51:09.604208 | controller | Thursday 19 March 2026 12:51:09 +0000 (0:00:00.276) 0:05:24.181 ******** 2026-03-19 12:51:09.604217 | controller | skipping: [instance] 2026-03-19 12:51:09.664942 | controller | 2026-03-19 12:51:09.664960 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-03-19 12:51:09.664973 | controller | Thursday 19 March 2026 12:51:09 +0000 (0:00:00.028) 0:05:24.210 ******** 2026-03-19 12:51:09.664982 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-03-19 12:51:10.074986 | controller | skipping: [instance] 2026-03-19 12:51:10.075025 | controller | 2026-03-19 12:51:10.075034 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2026-03-19 12:51:10.075040 | controller | Thursday 19 March 2026 12:51:09 +0000 (0:00:00.060) 0:05:24.271 ******** 2026-03-19 12:51:10.075050 | controller | changed: [instance] 2026-03-19 12:51:10.822638 | controller | 2026-03-19 12:51:10.822669 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-03-19 12:51:10.822677 | controller | Thursday 19 March 2026 12:51:10 +0000 (0:00:00.396) 0:05:24.668 ******** 2026-03-19 12:51:10.822683 | controller | 2026-03-19 12:51:10.822689 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2026-03-19 12:51:10.822695 | controller | Thursday 19 March 2026 12:51:10 +0000 (0:00:00.012) 0:05:24.680 ******** 2026-03-19 12:51:10.822704 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:11.197621 | controller | 2026-03-19 12:51:11.197707 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-03-19 12:51:11.197718 | controller | Thursday 19 March 2026 12:51:10 +0000 (0:00:00.747) 0:05:25.428 ******** 2026-03-19 12:51:11.197736 | controller | changed: [instance] 2026-03-19 12:51:11.375210 | controller | 2026-03-19 12:51:11.375265 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2026-03-19 12:51:11.375273 | controller | Thursday 19 March 2026 12:51:11 +0000 (0:00:00.374) 0:05:25.803 ******** 2026-03-19 12:51:11.375286 | controller | skipping: [instance] => (item=controller-0) 2026-03-19 12:51:12.844525 | controller | skipping: [instance] => (item=crc-0) 2026-03-19 12:51:12.844559 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2026-03-19 12:51:12.844568 | controller | 2026-03-19 12:51:12.844576 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2026-03-19 12:51:12.844599 | controller | Thursday 19 March 2026 12:51:11 +0000 (0:00:00.177) 0:05:25.981 ******** 2026-03-19 12:51:12.844611 | controller | changed: [instance -> compute-0(compute-0.instance)] 2026-03-19 12:51:12.862470 | controller | 2026-03-19 12:51:12.862515 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-03-19 12:51:12.862524 | controller | Thursday 19 March 2026 12:51:12 +0000 (0:00:01.469) 0:05:27.450 ******** 2026-03-19 12:51:12.862538 | controller | skipping: [instance] 2026-03-19 12:51:12.862651 | controller | 2026-03-19 12:51:12.862689 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-03-19 12:51:12.862701 | controller | Thursday 19 March 2026 12:51:12 +0000 (0:00:00.018) 0:05:27.469 ******** 2026-03-19 12:51:13.324854 | controller | ok: [instance -> compute-0(compute-0.instance)] 2026-03-19 12:51:13.358837 | controller | 2026-03-19 12:51:13.358867 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-03-19 12:51:13.358875 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.461) 0:05:27.931 ******** 2026-03-19 12:51:13.358885 | controller | skipping: [instance] 2026-03-19 12:51:13.358912 | controller | 2026-03-19 12:51:13.359099 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-03-19 12:51:13.394071 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.034) 0:05:27.965 ******** 2026-03-19 12:51:13.394099 | controller | skipping: [instance] 2026-03-19 12:51:13.427491 | controller | 2026-03-19 12:51:13.427513 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-03-19 12:51:13.427521 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.034) 0:05:28.000 ******** 2026-03-19 12:51:13.427531 | controller | skipping: [instance] 2026-03-19 12:51:13.469396 | controller | 2026-03-19 12:51:13.469432 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-03-19 12:51:13.469445 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.033) 0:05:28.034 ******** 2026-03-19 12:51:13.469477 | controller | skipping: [instance] 2026-03-19 12:51:13.469589 | controller | 2026-03-19 12:51:13.469645 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2026-03-19 12:51:13.469667 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.042) 0:05:28.076 ******** 2026-03-19 12:51:13.503866 | controller | skipping: [instance] 2026-03-19 12:51:13.522166 | controller | 2026-03-19 12:51:13.522186 | controller | TASK [reproducer : Create repositories on computes] **************************** 2026-03-19 12:51:13.522194 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.034) 0:05:28.110 ******** 2026-03-19 12:51:13.522203 | controller | skipping: [instance] 2026-03-19 12:51:13.545484 | controller | 2026-03-19 12:51:13.545618 | controller | TASK [reproducer : Configure controller for bare metal OCP] ******************** 2026-03-19 12:51:13.545628 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.018) 0:05:28.128 ******** 2026-03-19 12:51:13.545639 | controller | skipping: [instance] 2026-03-19 12:51:13.545679 | controller | 2026-03-19 12:51:13.545855 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2026-03-19 12:51:13.574338 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.023) 0:05:28.152 ******** 2026-03-19 12:51:13.574364 | controller | skipping: [instance] 2026-03-19 12:51:13.630996 | controller | 2026-03-19 12:51:13.631048 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2026-03-19 12:51:13.631058 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.028) 0:05:28.180 ******** 2026-03-19 12:51:13.631071 | controller | ok: [instance] 2026-03-19 12:51:13.631687 | controller | 2026-03-19 12:51:13.631717 | controller | TASK [reproducer : Push local code] ******************************************** 2026-03-19 12:51:13.733078 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.056) 0:05:28.237 ******** 2026-03-19 12:51:13.733103 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2026-03-19 12:51:13.772488 | controller | 2026-03-19 12:51:13.772524 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2026-03-19 12:51:13.772534 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.101) 0:05:28.339 ******** 2026-03-19 12:51:13.772546 | controller | skipping: [instance] 2026-03-19 12:51:13.772570 | controller | 2026-03-19 12:51:13.772615 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2026-03-19 12:51:13.772721 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.039) 0:05:28.379 ******** 2026-03-19 12:51:13.859885 | controller | skipping: [instance] 2026-03-19 12:51:13.900740 | controller | 2026-03-19 12:51:13.900759 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2026-03-19 12:51:13.900767 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.087) 0:05:28.466 ******** 2026-03-19 12:51:13.900776 | controller | skipping: [instance] 2026-03-19 12:51:13.940926 | controller | 2026-03-19 12:51:13.940949 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2026-03-19 12:51:13.940958 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.040) 0:05:28.507 ******** 2026-03-19 12:51:13.940970 | controller | skipping: [instance] 2026-03-19 12:51:13.976951 | controller | 2026-03-19 12:51:13.976994 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2026-03-19 12:51:13.977014 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.040) 0:05:28.547 ******** 2026-03-19 12:51:13.977025 | controller | skipping: [instance] 2026-03-19 12:51:13.977046 | controller | 2026-03-19 12:51:13.977270 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2026-03-19 12:51:13.977329 | controller | Thursday 19 March 2026 12:51:13 +0000 (0:00:00.036) 0:05:28.583 ******** 2026-03-19 12:51:14.458298 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2026-03-19 12:51:14.458434 | controller | 2026-03-19 12:51:14.458457 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2026-03-19 12:51:14.458474 | controller | Thursday 19 March 2026 12:51:14 +0000 (0:00:00.481) 0:05:29.064 ******** 2026-03-19 12:51:15.032969 | controller | ok: [instance -> localhost] => (item=ci-framework) 2026-03-19 12:51:15.074301 | controller | 2026-03-19 12:51:15.074326 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2026-03-19 12:51:15.074334 | controller | Thursday 19 March 2026 12:51:15 +0000 (0:00:00.574) 0:05:29.639 ******** 2026-03-19 12:51:15.074343 | controller | skipping: [instance] => (item=ci-framework) 2026-03-19 12:51:15.155226 | controller | skipping: [instance] 2026-03-19 12:51:15.155263 | controller | 2026-03-19 12:51:15.155271 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2026-03-19 12:51:15.155278 | controller | Thursday 19 March 2026 12:51:15 +0000 (0:00:00.041) 0:05:29.680 ******** 2026-03-19 12:51:15.155289 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2026-03-19 12:51:15.155316 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2026-03-19 12:51:15.155323 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2026-03-19 12:51:15.155330 | controller | 2026-03-19 12:51:15.155513 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2026-03-19 12:51:15.155549 | controller | Thursday 19 March 2026 12:51:15 +0000 (0:00:00.080) 0:05:29.761 ******** 2026-03-19 12:51:15.604239 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:15.640929 | controller | 2026-03-19 12:51:15.640961 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2026-03-19 12:51:15.640969 | controller | Thursday 19 March 2026 12:51:15 +0000 (0:00:00.448) 0:05:30.210 ******** 2026-03-19 12:51:15.640980 | controller | skipping: [instance] 2026-03-19 12:51:16.100314 | controller | 2026-03-19 12:51:16.100348 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2026-03-19 12:51:16.100363 | controller | Thursday 19 March 2026 12:51:15 +0000 (0:00:00.036) 0:05:30.247 ******** 2026-03-19 12:51:16.100390 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:16.100417 | controller | 2026-03-19 12:51:16.100652 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2026-03-19 12:51:16.138210 | controller | Thursday 19 March 2026 12:51:16 +0000 (0:00:00.459) 0:05:30.706 ******** 2026-03-19 12:51:16.138234 | controller | skipping: [instance] 2026-03-19 12:51:16.577763 | controller | 2026-03-19 12:51:16.577792 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2026-03-19 12:51:16.577799 | controller | Thursday 19 March 2026 12:51:16 +0000 (0:00:00.037) 0:05:30.744 ******** 2026-03-19 12:51:16.577810 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:18.920434 | controller | 2026-03-19 12:51:18.920465 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2026-03-19 12:51:18.920473 | controller | Thursday 19 March 2026 12:51:16 +0000 (0:00:00.439) 0:05:31.184 ******** 2026-03-19 12:51:18.920483 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:40.047806 | controller | 2026-03-19 12:51:40.047857 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2026-03-19 12:51:40.047868 | controller | Thursday 19 March 2026 12:51:18 +0000 (0:00:02.342) 0:05:33.526 ******** 2026-03-19 12:51:40.047881 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:41.018914 | controller | 2026-03-19 12:51:41.018946 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2026-03-19 12:51:41.018954 | controller | Thursday 19 March 2026 12:51:40 +0000 (0:00:21.126) 0:05:54.653 ******** 2026-03-19 12:51:41.018964 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:41.118990 | controller | 2026-03-19 12:51:41.119028 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2026-03-19 12:51:41.119048 | controller | Thursday 19 March 2026 12:51:41 +0000 (0:00:00.971) 0:05:55.625 ******** 2026-03-19 12:51:41.119067 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2026-03-19 12:51:41.583488 | controller | 2026-03-19 12:51:41.583536 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2026-03-19 12:51:41.583547 | controller | Thursday 19 March 2026 12:51:41 +0000 (0:00:00.100) 0:05:55.725 ******** 2026-03-19 12:51:41.583560 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:41.618391 | controller | 2026-03-19 12:51:41.618416 | controller | TASK [reproducer : Rotate log if present] ************************************** 2026-03-19 12:51:41.618424 | controller | Thursday 19 March 2026 12:51:41 +0000 (0:00:00.464) 0:05:56.189 ******** 2026-03-19 12:51:41.618434 | controller | skipping: [instance] 2026-03-19 12:51:41.662118 | controller | 2026-03-19 12:51:41.662145 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2026-03-19 12:51:41.662153 | controller | Thursday 19 March 2026 12:51:41 +0000 (0:00:00.035) 0:05:56.224 ******** 2026-03-19 12:51:41.662169 | controller | skipping: [instance] 2026-03-19 12:51:41.662188 | controller | 2026-03-19 12:51:41.662282 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2026-03-19 12:51:41.662391 | controller | Thursday 19 March 2026 12:51:41 +0000 (0:00:00.043) 0:05:56.268 ******** 2026-03-19 12:51:41.753679 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:41.753808 | controller | 2026-03-19 12:51:41.753906 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-03-19 12:51:41.753996 | controller | Thursday 19 March 2026 12:51:41 +0000 (0:00:00.091) 0:05:56.360 ******** 2026-03-19 12:51:42.255077 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:42.255139 | controller | 2026-03-19 12:51:42.255427 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-03-19 12:51:42.292460 | controller | Thursday 19 March 2026 12:51:42 +0000 (0:00:00.501) 0:05:56.861 ******** 2026-03-19 12:51:42.292517 | controller | skipping: [instance] 2026-03-19 12:51:42.292561 | controller | 2026-03-19 12:51:42.292572 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-03-19 12:51:42.292663 | controller | Thursday 19 March 2026 12:51:42 +0000 (0:00:00.037) 0:05:56.898 ******** 2026-03-19 12:51:42.329270 | controller | skipping: [instance] 2026-03-19 12:51:42.329353 | controller | 2026-03-19 12:51:42.329470 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-03-19 12:51:42.329564 | controller | Thursday 19 March 2026 12:51:42 +0000 (0:00:00.036) 0:05:56.935 ******** 2026-03-19 12:51:42.366226 | controller | skipping: [instance] 2026-03-19 12:51:42.366310 | controller | 2026-03-19 12:51:42.366423 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-03-19 12:51:42.366554 | controller | Thursday 19 March 2026 12:51:42 +0000 (0:00:00.037) 0:05:56.972 ******** 2026-03-19 12:51:42.411283 | controller | skipping: [instance] 2026-03-19 12:51:42.411432 | controller | 2026-03-19 12:51:42.411473 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-03-19 12:51:42.411583 | controller | Thursday 19 March 2026 12:51:42 +0000 (0:00:00.044) 0:05:57.017 ******** 2026-03-19 12:51:43.713158 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:51:43.713277 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:51:43.713499 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:51:43.713554 | controller | changed: [instance -> controller-0] 2026-03-19 12:51:43.713749 | controller | 2026-03-19 12:51:43.713846 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-03-19 12:51:43.713857 | controller | Thursday 19 March 2026 12:51:43 +0000 (0:00:01.301) 0:05:58.319 ******** 2026-03-19 12:51:44.656802 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:44.656862 | controller | 2026-03-19 12:51:44.656974 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-03-19 12:51:44.657057 | controller | Thursday 19 March 2026 12:51:44 +0000 (0:00:00.943) 0:05:59.263 ******** 2026-03-19 12:51:45.922948 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:45.923014 | controller | 2026-03-19 12:51:45.923257 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-03-19 12:51:53.387798 | controller | Thursday 19 March 2026 12:51:45 +0000 (0:00:01.266) 0:06:00.529 ******** 2026-03-19 12:51:53.387884 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:53.387992 | controller | 2026-03-19 12:51:53.388004 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-03-19 12:51:53.388013 | controller | Thursday 19 March 2026 12:51:53 +0000 (0:00:07.463) 0:06:07.993 ******** 2026-03-19 12:51:54.445918 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:54.491605 | controller | 2026-03-19 12:51:54.491658 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-03-19 12:51:54.491667 | controller | Thursday 19 March 2026 12:51:54 +0000 (0:00:01.057) 0:06:09.051 ******** 2026-03-19 12:51:54.491679 | controller | skipping: [instance] 2026-03-19 12:51:55.730244 | controller | 2026-03-19 12:51:55.730316 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-03-19 12:51:55.730338 | controller | Thursday 19 March 2026 12:51:54 +0000 (0:00:00.046) 0:06:09.097 ******** 2026-03-19 12:51:55.730351 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:55.784222 | controller | 2026-03-19 12:51:55.784269 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-03-19 12:51:55.784278 | controller | Thursday 19 March 2026 12:51:55 +0000 (0:00:01.237) 0:06:10.334 ******** 2026-03-19 12:51:55.784290 | controller | skipping: [instance] 2026-03-19 12:51:55.835914 | controller | 2026-03-19 12:51:55.835952 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-03-19 12:51:55.835960 | controller | Thursday 19 March 2026 12:51:55 +0000 (0:00:00.055) 0:06:10.390 ******** 2026-03-19 12:51:55.835972 | controller | skipping: [instance] 2026-03-19 12:51:55.888482 | controller | 2026-03-19 12:51:55.888514 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-03-19 12:51:55.888522 | controller | Thursday 19 March 2026 12:51:55 +0000 (0:00:00.051) 0:06:10.442 ******** 2026-03-19 12:51:55.888534 | controller | skipping: [instance] 2026-03-19 12:51:56.792791 | controller | 2026-03-19 12:51:56.792832 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-03-19 12:51:56.792840 | controller | Thursday 19 March 2026 12:51:55 +0000 (0:00:00.052) 0:06:10.494 ******** 2026-03-19 12:51:56.792852 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:56.792882 | controller | 2026-03-19 12:51:56.792890 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-03-19 12:51:56.793050 | controller | Thursday 19 March 2026 12:51:56 +0000 (0:00:00.903) 0:06:11.398 ******** 2026-03-19 12:51:57.785738 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:57.824824 | controller | 2026-03-19 12:51:57.824859 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-03-19 12:51:57.824869 | controller | Thursday 19 March 2026 12:51:57 +0000 (0:00:00.987) 0:06:12.386 ******** 2026-03-19 12:51:57.824882 | controller | skipping: [instance] 2026-03-19 12:51:57.863711 | controller | 2026-03-19 12:51:57.863738 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-03-19 12:51:57.863747 | controller | Thursday 19 March 2026 12:51:57 +0000 (0:00:00.044) 0:06:12.431 ******** 2026-03-19 12:51:57.863757 | controller | skipping: [instance] 2026-03-19 12:51:57.901530 | controller | 2026-03-19 12:51:57.901582 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-03-19 12:51:57.901592 | controller | Thursday 19 March 2026 12:51:57 +0000 (0:00:00.039) 0:06:12.470 ******** 2026-03-19 12:51:57.901605 | controller | skipping: [instance] 2026-03-19 12:51:57.901636 | controller | 2026-03-19 12:51:57.901643 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-03-19 12:51:57.901650 | controller | Thursday 19 March 2026 12:51:57 +0000 (0:00:00.037) 0:06:12.508 ******** 2026-03-19 12:51:57.953839 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:57.991221 | controller | 2026-03-19 12:51:57.991239 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-03-19 12:51:57.991248 | controller | Thursday 19 March 2026 12:51:57 +0000 (0:00:00.052) 0:06:12.560 ******** 2026-03-19 12:51:57.991257 | controller | skipping: [instance] 2026-03-19 12:51:58.030213 | controller | 2026-03-19 12:51:58.030231 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-03-19 12:51:58.030238 | controller | Thursday 19 March 2026 12:51:57 +0000 (0:00:00.037) 0:06:12.597 ******** 2026-03-19 12:51:58.030247 | controller | skipping: [instance] 2026-03-19 12:51:58.074524 | controller | 2026-03-19 12:51:58.074581 | controller | TASK [Download the RPM] ******************************************************** 2026-03-19 12:51:58.074592 | controller | Thursday 19 March 2026 12:51:58 +0000 (0:00:00.038) 0:06:12.636 ******** 2026-03-19 12:51:58.074606 | controller | skipping: [instance] 2026-03-19 12:51:58.074614 | controller | 2026-03-19 12:51:58.074620 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-03-19 12:51:58.074629 | controller | Thursday 19 March 2026 12:51:58 +0000 (0:00:00.040) 0:06:12.676 ******** 2026-03-19 12:51:58.128988 | controller | skipping: [instance] 2026-03-19 12:51:58.168845 | controller | 2026-03-19 12:51:58.168864 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-03-19 12:51:58.168872 | controller | Thursday 19 March 2026 12:51:58 +0000 (0:00:00.058) 0:06:12.735 ******** 2026-03-19 12:51:58.168882 | controller | skipping: [instance] 2026-03-19 12:51:58.207689 | controller | 2026-03-19 12:51:58.207709 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-03-19 12:51:58.207717 | controller | Thursday 19 March 2026 12:51:58 +0000 (0:00:00.039) 0:06:12.775 ******** 2026-03-19 12:51:58.207740 | controller | skipping: [instance] 2026-03-19 12:51:58.246039 | controller | 2026-03-19 12:51:58.246102 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-03-19 12:51:58.246112 | controller | Thursday 19 March 2026 12:51:58 +0000 (0:00:00.038) 0:06:12.814 ******** 2026-03-19 12:51:58.246126 | controller | skipping: [instance] 2026-03-19 12:51:58.729101 | controller | 2026-03-19 12:51:58.729182 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-03-19 12:51:58.729193 | controller | Thursday 19 March 2026 12:51:58 +0000 (0:00:00.038) 0:06:12.852 ******** 2026-03-19 12:51:58.729207 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:58.789555 | controller | 2026-03-19 12:51:58.789628 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-03-19 12:51:58.789637 | controller | Thursday 19 March 2026 12:51:58 +0000 (0:00:00.482) 0:06:13.334 ******** 2026-03-19 12:51:58.789651 | controller | skipping: [instance] 2026-03-19 12:51:58.789673 | controller | 2026-03-19 12:51:58.789681 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-03-19 12:51:58.846190 | controller | Thursday 19 March 2026 12:51:58 +0000 (0:00:00.061) 0:06:13.395 ******** 2026-03-19 12:51:58.846227 | controller | skipping: [instance] 2026-03-19 12:51:58.846287 | controller | 2026-03-19 12:51:58.846492 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-03-19 12:51:58.846613 | controller | Thursday 19 March 2026 12:51:58 +0000 (0:00:00.056) 0:06:13.452 ******** 2026-03-19 12:51:58.890420 | controller | skipping: [instance] 2026-03-19 12:51:58.890511 | controller | 2026-03-19 12:51:58.890606 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-03-19 12:51:58.890695 | controller | Thursday 19 March 2026 12:51:58 +0000 (0:00:00.044) 0:06:13.496 ******** 2026-03-19 12:51:58.941636 | controller | skipping: [instance] 2026-03-19 12:51:58.941716 | controller | 2026-03-19 12:51:58.941825 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-03-19 12:51:58.941884 | controller | Thursday 19 March 2026 12:51:58 +0000 (0:00:00.051) 0:06:13.548 ******** 2026-03-19 12:51:58.999771 | controller | skipping: [instance] 2026-03-19 12:51:58.999828 | controller | 2026-03-19 12:51:58.999958 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-03-19 12:51:59.000026 | controller | Thursday 19 March 2026 12:51:58 +0000 (0:00:00.058) 0:06:13.606 ******** 2026-03-19 12:51:59.056557 | controller | skipping: [instance] 2026-03-19 12:51:59.056759 | controller | 2026-03-19 12:51:59.056797 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-03-19 12:51:59.056808 | controller | Thursday 19 March 2026 12:51:59 +0000 (0:00:00.056) 0:06:13.662 ******** 2026-03-19 12:51:59.114896 | controller | skipping: [instance] 2026-03-19 12:51:59.114977 | controller | 2026-03-19 12:51:59.115071 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-03-19 12:51:59.115166 | controller | Thursday 19 March 2026 12:51:59 +0000 (0:00:00.058) 0:06:13.721 ******** 2026-03-19 12:51:59.176670 | controller | skipping: [instance] 2026-03-19 12:51:59.176734 | controller | 2026-03-19 12:51:59.176748 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-03-19 12:51:59.176854 | controller | Thursday 19 March 2026 12:51:59 +0000 (0:00:00.061) 0:06:13.783 ******** 2026-03-19 12:51:59.883127 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:51:59.883185 | controller | 2026-03-19 12:51:59.883293 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-03-19 12:51:59.883418 | controller | Thursday 19 March 2026 12:51:59 +0000 (0:00:00.705) 0:06:14.488 ******** 2026-03-19 12:52:00.937486 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:52:00.937583 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:52:00.937670 | controller | changed: [instance -> controller-0] 2026-03-19 12:52:00.937751 | controller | 2026-03-19 12:52:00.937853 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-03-19 12:52:00.937983 | controller | Thursday 19 March 2026 12:52:00 +0000 (0:00:01.054) 0:06:15.543 ******** 2026-03-19 12:52:01.681521 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:01.681570 | controller | 2026-03-19 12:52:01.681666 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-03-19 12:52:01.681757 | controller | Thursday 19 March 2026 12:52:01 +0000 (0:00:00.744) 0:06:16.287 ******** 2026-03-19 12:52:02.205015 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:02.205071 | controller | 2026-03-19 12:52:02.205206 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-03-19 12:52:02.205308 | controller | Thursday 19 March 2026 12:52:02 +0000 (0:00:00.523) 0:06:16.811 ******** 2026-03-19 12:52:02.268442 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:52:02.309936 | controller | ok: [instance -> controller-0] 2026-03-19 12:52:02.309968 | controller | 2026-03-19 12:52:02.309976 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-03-19 12:52:02.309983 | controller | Thursday 19 March 2026 12:52:02 +0000 (0:00:00.063) 0:06:16.874 ******** 2026-03-19 12:52:02.309993 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:35.348193 | controller | 2026-03-19 12:52:35.348234 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-03-19 12:52:35.348242 | controller | Thursday 19 March 2026 12:52:02 +0000 (0:00:00.041) 0:06:16.916 ******** 2026-03-19 12:52:35.348266 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:35.832071 | controller | 2026-03-19 12:52:35.832110 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-03-19 12:52:35.832118 | controller | Thursday 19 March 2026 12:52:35 +0000 (0:00:33.038) 0:06:49.954 ******** 2026-03-19 12:52:35.832129 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:35.832149 | controller | 2026-03-19 12:52:35.832179 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-03-19 12:52:35.832281 | controller | Thursday 19 March 2026 12:52:35 +0000 (0:00:00.484) 0:06:50.438 ******** 2026-03-19 12:52:36.341998 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:41.172516 | controller | 2026-03-19 12:52:41.172572 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-03-19 12:52:41.172584 | controller | Thursday 19 March 2026 12:52:36 +0000 (0:00:00.509) 0:06:50.948 ******** 2026-03-19 12:52:41.172599 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:41.172622 | controller | 2026-03-19 12:52:41.172640 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-03-19 12:52:41.172662 | controller | Thursday 19 March 2026 12:52:41 +0000 (0:00:04.830) 0:06:55.778 ******** 2026-03-19 12:52:41.221426 | controller | skipping: [instance] 2026-03-19 12:52:41.221522 | controller | 2026-03-19 12:52:41.221626 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-03-19 12:52:41.221764 | controller | Thursday 19 March 2026 12:52:41 +0000 (0:00:00.049) 0:06:55.828 ******** 2026-03-19 12:52:41.815564 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:41.815645 | controller | 2026-03-19 12:52:41.815656 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-03-19 12:52:41.815732 | controller | Thursday 19 March 2026 12:52:41 +0000 (0:00:00.593) 0:06:56.421 ******** 2026-03-19 12:52:42.282672 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:42.282727 | controller | 2026-03-19 12:52:42.282820 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-03-19 12:52:42.282927 | controller | Thursday 19 March 2026 12:52:42 +0000 (0:00:00.467) 0:06:56.889 ******** 2026-03-19 12:52:42.320861 | controller | skipping: [instance] 2026-03-19 12:52:42.320952 | controller | 2026-03-19 12:52:42.321063 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-03-19 12:52:42.321172 | controller | Thursday 19 March 2026 12:52:42 +0000 (0:00:00.038) 0:06:56.927 ******** 2026-03-19 12:52:42.357932 | controller | skipping: [instance] 2026-03-19 12:52:42.357982 | controller | 2026-03-19 12:52:42.358001 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-03-19 12:52:42.358096 | controller | Thursday 19 March 2026 12:52:42 +0000 (0:00:00.036) 0:06:56.964 ******** 2026-03-19 12:52:42.395544 | controller | skipping: [instance] 2026-03-19 12:52:42.395614 | controller | 2026-03-19 12:52:42.395725 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-03-19 12:52:42.395814 | controller | Thursday 19 March 2026 12:52:42 +0000 (0:00:00.037) 0:06:57.002 ******** 2026-03-19 12:52:42.432294 | controller | skipping: [instance] 2026-03-19 12:52:42.432392 | controller | 2026-03-19 12:52:42.432505 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-03-19 12:52:42.432602 | controller | Thursday 19 March 2026 12:52:42 +0000 (0:00:00.036) 0:06:57.039 ******** 2026-03-19 12:52:42.470388 | controller | skipping: [instance] 2026-03-19 12:52:42.470505 | controller | 2026-03-19 12:52:42.470628 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-03-19 12:52:42.470744 | controller | Thursday 19 March 2026 12:52:42 +0000 (0:00:00.038) 0:06:57.077 ******** 2026-03-19 12:52:42.509649 | controller | skipping: [instance] 2026-03-19 12:52:42.509726 | controller | 2026-03-19 12:52:42.509822 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-03-19 12:52:42.509913 | controller | Thursday 19 March 2026 12:52:42 +0000 (0:00:00.039) 0:06:57.116 ******** 2026-03-19 12:52:44.953067 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:52:44.953193 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:52:44.953301 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:52:44.953352 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:52:44.953856 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:52:45.111900 | controller | changed: [instance -> controller-0] 2026-03-19 12:52:45.111934 | controller | 2026-03-19 12:52:45.111942 | controller | TASK [Prepare install_yamls make targets] ************************************** 2026-03-19 12:52:45.111948 | controller | Thursday 19 March 2026 12:52:44 +0000 (0:00:02.443) 0:06:59.559 ******** 2026-03-19 12:52:45.111958 | controller | 2026-03-19 12:52:46.519424 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2026-03-19 12:52:46.519457 | controller | Thursday 19 March 2026 12:52:45 +0000 (0:00:00.158) 0:06:59.717 ******** 2026-03-19 12:52:46.519473 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:52:46.577042 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:52:46.577073 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:52:46.577083 | controller | changed: [instance -> controller-0] 2026-03-19 12:52:46.577090 | controller | 2026-03-19 12:52:46.577098 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2026-03-19 12:52:46.577113 | controller | Thursday 19 March 2026 12:52:46 +0000 (0:00:01.407) 0:07:01.125 ******** 2026-03-19 12:52:46.577125 | controller | 2026-03-19 12:52:46.616253 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2026-03-19 12:52:46.616289 | controller | Thursday 19 March 2026 12:52:46 +0000 (0:00:00.058) 0:07:01.183 ******** 2026-03-19 12:52:46.616301 | controller | skipping: [instance] 2026-03-19 12:52:46.616327 | controller | 2026-03-19 12:52:46.616336 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2026-03-19 12:52:46.616358 | controller | Thursday 19 March 2026 12:52:46 +0000 (0:00:00.039) 0:07:01.222 ******** 2026-03-19 12:52:46.661747 | controller | skipping: [instance] 2026-03-19 12:52:46.724980 | controller | 2026-03-19 12:52:46.725012 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2026-03-19 12:52:46.725020 | controller | Thursday 19 March 2026 12:52:46 +0000 (0:00:00.045) 0:07:01.267 ******** 2026-03-19 12:52:46.725031 | controller | 2026-03-19 12:52:46.763022 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2026-03-19 12:52:46.763050 | controller | Thursday 19 March 2026 12:52:46 +0000 (0:00:00.063) 0:07:01.331 ******** 2026-03-19 12:52:46.763063 | controller | skipping: [instance] 2026-03-19 12:52:46.805969 | controller | 2026-03-19 12:52:46.806002 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2026-03-19 12:52:46.806012 | controller | Thursday 19 March 2026 12:52:46 +0000 (0:00:00.038) 0:07:01.369 ******** 2026-03-19 12:52:46.806025 | controller | skipping: [instance] 2026-03-19 12:52:46.847025 | controller | 2026-03-19 12:52:46.847058 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2026-03-19 12:52:46.847067 | controller | Thursday 19 March 2026 12:52:46 +0000 (0:00:00.041) 0:07:01.411 ******** 2026-03-19 12:52:46.847077 | controller | skipping: [instance] 2026-03-19 12:52:46.893475 | controller | 2026-03-19 12:52:46.893503 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2026-03-19 12:52:46.893513 | controller | Thursday 19 March 2026 12:52:46 +0000 (0:00:00.042) 0:07:01.453 ******** 2026-03-19 12:52:46.893525 | controller | skipping: [instance] 2026-03-19 12:52:46.893556 | controller | 2026-03-19 12:52:46.893585 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2026-03-19 12:52:46.893720 | controller | Thursday 19 March 2026 12:52:46 +0000 (0:00:00.046) 0:07:01.500 ******** 2026-03-19 12:52:46.990263 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-19 12:52:47.051734 | controller | ok: [instance -> controller-0] 2026-03-19 12:52:47.051756 | controller | 2026-03-19 12:52:47.051764 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2026-03-19 12:52:47.051776 | controller | Thursday 19 March 2026 12:52:46 +0000 (0:00:00.096) 0:07:01.596 ******** 2026-03-19 12:52:47.051785 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:47.051808 | controller | 2026-03-19 12:52:47.051814 | controller | TASK [install_yamls : Get environment structure] ******************************* 2026-03-19 12:52:47.051822 | controller | Thursday 19 March 2026 12:52:47 +0000 (0:00:00.061) 0:07:01.658 ******** 2026-03-19 12:52:48.019118 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:48.019170 | controller | 2026-03-19 12:52:48.019407 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2026-03-19 12:52:48.058044 | controller | Thursday 19 March 2026 12:52:48 +0000 (0:00:00.967) 0:07:02.625 ******** 2026-03-19 12:52:48.058082 | controller | skipping: [instance] 2026-03-19 12:52:48.058124 | controller | 2026-03-19 12:52:48.058135 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2026-03-19 12:52:48.058235 | controller | Thursday 19 March 2026 12:52:48 +0000 (0:00:00.038) 0:07:02.664 ******** 2026-03-19 12:52:48.105857 | controller | skipping: [instance] 2026-03-19 12:52:48.105941 | controller | 2026-03-19 12:52:48.106208 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2026-03-19 12:52:48.106302 | controller | Thursday 19 March 2026 12:52:48 +0000 (0:00:00.047) 0:07:02.712 ******** 2026-03-19 12:52:48.144586 | controller | skipping: [instance] 2026-03-19 12:52:48.144676 | controller | 2026-03-19 12:52:48.144776 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2026-03-19 12:52:48.144871 | controller | Thursday 19 March 2026 12:52:48 +0000 (0:00:00.038) 0:07:02.751 ******** 2026-03-19 12:52:48.200297 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:48.200421 | controller | 2026-03-19 12:52:48.200530 | controller | TASK [install_yamls : Show the env structure] ********************************** 2026-03-19 12:52:48.200615 | controller | Thursday 19 March 2026 12:52:48 +0000 (0:00:00.055) 0:07:02.807 ******** 2026-03-19 12:52:48.243835 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:48.243916 | controller | 2026-03-19 12:52:48.244026 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2026-03-19 12:52:48.244140 | controller | Thursday 19 March 2026 12:52:48 +0000 (0:00:00.043) 0:07:02.850 ******** 2026-03-19 12:52:48.297689 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:48.297762 | controller | 2026-03-19 12:52:48.297860 | controller | TASK [install_yamls : Generate make targets] *********************************** 2026-03-19 12:52:48.297980 | controller | Thursday 19 March 2026 12:52:48 +0000 (0:00:00.053) 0:07:02.904 ******** 2026-03-19 12:52:48.915676 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:48.915752 | controller | 2026-03-19 12:52:48.915849 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2026-03-19 12:52:48.915942 | controller | Thursday 19 March 2026 12:52:48 +0000 (0:00:00.618) 0:07:03.522 ******** 2026-03-19 12:52:48.962319 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:48.962408 | controller | 2026-03-19 12:52:48.962517 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2026-03-19 12:52:48.962607 | controller | Thursday 19 March 2026 12:52:48 +0000 (0:00:00.046) 0:07:03.568 ******** 2026-03-19 12:52:49.855724 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:49.855779 | controller | 2026-03-19 12:52:49.855876 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2026-03-19 12:52:49.855965 | controller | Thursday 19 March 2026 12:52:49 +0000 (0:00:00.893) 0:07:04.462 ******** 2026-03-19 12:52:49.899645 | controller | skipping: [instance] 2026-03-19 12:52:49.899721 | controller | 2026-03-19 12:52:49.899882 | controller | TASK [discover_latest_image : Set the discovered images dict to empty] ********* 2026-03-19 12:52:49.899982 | controller | Thursday 19 March 2026 12:52:49 +0000 (0:00:00.044) 0:07:04.506 ******** 2026-03-19 12:52:49.942772 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:49.942840 | controller | 2026-03-19 12:52:49.942936 | controller | TASK [discover_latest_image : Discover images] ********************************* 2026-03-19 12:52:49.943041 | controller | Thursday 19 March 2026 12:52:49 +0000 (0:00:00.042) 0:07:04.549 ******** 2026-03-19 12:52:49.997625 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/discover_latest_image/tasks/per-image.yml for instance => (item=(censored due to no_log)) 2026-03-19 12:52:49.997686 | controller | 2026-03-19 12:52:49.997777 | controller | TASK [discover_latest_image : Ensure the current image dict entry has the expected data] *** 2026-03-19 12:52:49.997886 | controller | Thursday 19 March 2026 12:52:49 +0000 (0:00:00.054) 0:07:04.604 ******** 2026-03-19 12:52:50.047814 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:50.047896 | controller | 2026-03-19 12:52:50.047992 | controller | TASK [discover_latest_image : Get latest image for the current entry] ********** 2026-03-19 12:52:50.048103 | controller | Thursday 19 March 2026 12:52:50 +0000 (0:00:00.050) 0:07:04.654 ******** 2026-03-19 12:52:50.768924 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:50.768980 | controller | 2026-03-19 12:52:50.769090 | controller | TASK [discover_latest_image : Append the current return value to the discovered images dict] *** 2026-03-19 12:52:50.769177 | controller | Thursday 19 March 2026 12:52:50 +0000 (0:00:00.720) 0:07:05.375 ******** 2026-03-19 12:52:50.817288 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:50.817356 | controller | 2026-03-19 12:52:50.817498 | controller | TASK [discover_latest_image : Export single-image facts if an image with name 'default' was discovered] *** 2026-03-19 12:52:50.817590 | controller | Thursday 19 March 2026 12:52:50 +0000 (0:00:00.048) 0:07:05.423 ******** 2026-03-19 12:52:50.875215 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:50.875277 | controller | 2026-03-19 12:52:50.875531 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2026-03-19 12:52:50.875660 | controller | Thursday 19 March 2026 12:52:50 +0000 (0:00:00.057) 0:07:05.481 ******** 2026-03-19 12:52:51.814212 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:51.814280 | controller | 2026-03-19 12:52:51.814364 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2026-03-19 12:52:51.814519 | controller | Thursday 19 March 2026 12:52:51 +0000 (0:00:00.938) 0:07:06.420 ******** 2026-03-19 12:52:52.288033 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:52.288104 | controller | 2026-03-19 12:52:52.288306 | controller | TASK [Configure CRC network if needed] ***************************************** 2026-03-19 12:52:52.438441 | controller | Thursday 19 March 2026 12:52:52 +0000 (0:00:00.473) 0:07:06.894 ******** 2026-03-19 12:52:52.438483 | controller | 2026-03-19 12:52:53.582183 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2026-03-19 12:52:53.582219 | controller | Thursday 19 March 2026 12:52:52 +0000 (0:00:00.150) 0:07:07.044 ******** 2026-03-19 12:52:53.582231 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:54.729139 | controller | 2026-03-19 12:52:54.729192 | controller | TASK [openshift_setup : Patch network operator] ******************************** 2026-03-19 12:52:54.729201 | controller | Thursday 19 March 2026 12:52:53 +0000 (0:00:01.143) 0:07:08.188 ******** 2026-03-19 12:52:54.729211 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:54.756494 | controller | 2026-03-19 12:52:54.756533 | controller | TASK [Ensure OCP cluster is stable] ******************************************** 2026-03-19 12:52:54.756543 | controller | Thursday 19 March 2026 12:52:54 +0000 (0:00:01.147) 0:07:09.335 ******** 2026-03-19 12:52:54.756556 | controller | skipping: [instance] 2026-03-19 12:52:54.756586 | controller | 2026-03-19 12:52:54.756594 | controller | TASK [reproducer : Emulate CI job] ********************************************* 2026-03-19 12:52:54.756617 | controller | Thursday 19 March 2026 12:52:54 +0000 (0:00:00.027) 0:07:09.362 ******** 2026-03-19 12:52:54.794679 | controller | skipping: [instance] 2026-03-19 12:52:54.794767 | controller | 2026-03-19 12:52:54.794867 | controller | TASK [reproducer : Prepare architecture-based deployment] ********************** 2026-03-19 12:52:54.794963 | controller | Thursday 19 March 2026 12:52:54 +0000 (0:00:00.038) 0:07:09.401 ******** 2026-03-19 12:52:54.836932 | controller | skipping: [instance] 2026-03-19 12:52:54.837017 | controller | 2026-03-19 12:52:54.837123 | controller | TASK [reproducer : Prepare architecture-based post deployment] ***************** 2026-03-19 12:52:54.837208 | controller | Thursday 19 March 2026 12:52:54 +0000 (0:00:00.042) 0:07:09.443 ******** 2026-03-19 12:52:54.872859 | controller | skipping: [instance] 2026-03-19 12:52:54.872946 | controller | 2026-03-19 12:52:54.873050 | controller | TASK [reproducer : Prepare ci-like EDPM deploy] ******************************** 2026-03-19 12:52:54.873169 | controller | Thursday 19 March 2026 12:52:54 +0000 (0:00:00.035) 0:07:09.479 ******** 2026-03-19 12:52:55.809774 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:56.307498 | controller | 2026-03-19 12:52:56.307538 | controller | TASK [Ensure we have appropriate credentials for OpenShift accesses] *********** 2026-03-19 12:52:56.307547 | controller | Thursday 19 March 2026 12:52:55 +0000 (0:00:00.936) 0:07:10.415 ******** 2026-03-19 12:52:56.307559 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:56.772459 | controller | 2026-03-19 12:52:56.772500 | controller | TASK [Ensure we have needed inventory files] *********************************** 2026-03-19 12:52:56.772508 | controller | Thursday 19 March 2026 12:52:56 +0000 (0:00:00.495) 0:07:10.911 ******** 2026-03-19 12:52:56.772520 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:56.772546 | controller | 2026-03-19 12:52:56.772762 | controller | TASK [Ensure we have CRC ssh key] ********************************************** 2026-03-19 12:52:57.255815 | controller | Thursday 19 March 2026 12:52:56 +0000 (0:00:00.467) 0:07:11.378 ******** 2026-03-19 12:52:57.255871 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:57.704531 | controller | 2026-03-19 12:52:57.704577 | controller | TASK [Ensure we have the MAC mapping file] ************************************* 2026-03-19 12:52:57.704586 | controller | Thursday 19 March 2026 12:52:57 +0000 (0:00:00.482) 0:07:11.861 ******** 2026-03-19 12:52:57.704597 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:58.155961 | controller | 2026-03-19 12:52:58.156013 | controller | TASK [Load crc inventory] ****************************************************** 2026-03-19 12:52:58.156022 | controller | Thursday 19 March 2026 12:52:57 +0000 (0:00:00.448) 0:07:12.310 ******** 2026-03-19 12:52:58.156034 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:58.604136 | controller | 2026-03-19 12:52:58.604187 | controller | TASK [Load compute inventory] ************************************************** 2026-03-19 12:52:58.604196 | controller | Thursday 19 March 2026 12:52:58 +0000 (0:00:00.451) 0:07:12.762 ******** 2026-03-19 12:52:58.604208 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:58.604298 | controller | 2026-03-19 12:52:58.604312 | controller | TASK [Ensure we can ping compute-0 on osp_trunk net] *************************** 2026-03-19 12:52:58.604403 | controller | Thursday 19 March 2026 12:52:58 +0000 (0:00:00.448) 0:07:13.210 ******** 2026-03-19 12:52:59.126288 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:59.126334 | controller | 2026-03-19 12:52:59.126470 | controller | TASK [Ensure we can ping crc-0 on osp_trunk net] ******************************* 2026-03-19 12:52:59.126565 | controller | Thursday 19 March 2026 12:52:59 +0000 (0:00:00.522) 0:07:13.732 ******** 2026-03-19 12:52:59.629554 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:52:59.629602 | controller | 2026-03-19 12:52:59.629687 | controller | TASK [Check default location secret file] ************************************** 2026-03-19 12:52:59.629781 | controller | Thursday 19 March 2026 12:52:59 +0000 (0:00:00.503) 0:07:14.235 ******** 2026-03-19 12:53:00.099105 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:53:00.099168 | controller | 2026-03-19 12:53:00.099276 | controller | TASK [Check non-default location secret] *************************************** 2026-03-19 12:53:00.099406 | controller | Thursday 19 March 2026 12:53:00 +0000 (0:00:00.469) 0:07:14.705 ******** 2026-03-19 12:53:00.577989 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-19 12:53:00.578051 | controller | 2026-03-19 12:53:00.578164 | controller | TASK [Assert all of the tests] ************************************************* 2026-03-19 12:53:00.578255 | controller | Thursday 19 March 2026 12:53:00 +0000 (0:00:00.478) 0:07:15.184 ******** 2026-03-19 12:53:00.619034 | controller | ok: [instance] 2026-03-19 12:53:00.619121 | controller | 2026-03-19 12:53:00.619214 | controller | TASK [Create dnsmasq dir] ****************************************************** 2026-03-19 12:53:00.619311 | controller | Thursday 19 March 2026 12:53:00 +0000 (0:00:00.041) 0:07:15.225 ******** 2026-03-19 12:53:00.815730 | controller | changed: [instance] 2026-03-19 12:53:00.815783 | controller | 2026-03-19 12:53:00.816006 | controller | TASK [Get journalctl in a file] ************************************************ 2026-03-19 12:53:01.033080 | controller | Thursday 19 March 2026 12:53:00 +0000 (0:00:00.196) 0:07:15.422 ******** 2026-03-19 12:53:01.033119 | controller | changed: [instance] 2026-03-19 12:53:01.406643 | controller | 2026-03-19 12:53:01.406674 | controller | TASK [Dump journalctl output] ************************************************** 2026-03-19 12:53:01.406682 | controller | Thursday 19 March 2026 12:53:01 +0000 (0:00:00.217) 0:07:15.639 ******** 2026-03-19 12:53:01.406691 | controller | changed: [instance] 2026-03-19 12:53:01.907240 | controller | 2026-03-19 12:53:01.907269 | controller | TASK [Copy all dnsmasq config] ************************************************* 2026-03-19 12:53:01.907277 | controller | Thursday 19 March 2026 12:53:01 +0000 (0:00:00.373) 0:07:16.012 ******** 2026-03-19 12:53:01.907288 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-03-19 12:53:01.907314 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2026-03-19 12:53:01.907701 | controller | 2026-03-19 12:53:02.103765 | controller | TASK [Create log directory] **************************************************** 2026-03-19 12:53:02.103806 | controller | Thursday 19 March 2026 12:53:01 +0000 (0:00:00.500) 0:07:16.513 ******** 2026-03-19 12:53:02.103819 | controller | changed: [instance] 2026-03-19 12:53:02.103846 | controller | 2026-03-19 12:53:02.103853 | controller | TASK [Sync logs from controller-0] ********************************************* 2026-03-19 12:53:02.103861 | controller | Thursday 19 March 2026 12:53:02 +0000 (0:00:00.196) 0:07:16.710 ******** 2026-03-19 12:53:02.990073 | controller | changed: [instance] 2026-03-19 12:53:02.990128 | controller | 2026-03-19 12:53:02.990215 | controller | PLAY RECAP ********************************************************************* 2026-03-19 12:53:02.990306 | controller | instance : ok=563 changed=212 unreachable=0 failed=0 skipped=254 rescued=0 ignored=0 2026-03-19 12:53:02.990407 | controller | 2026-03-19 12:53:02.990502 | controller | Thursday 19 March 2026 12:53:02 +0000 (0:00:00.885) 0:07:17.595 ******** 2026-03-19 12:53:02.990588 | controller | =============================================================================== 2026-03-19 12:53:02.990685 | controller | reproducer : Check package install status ------------------------------ 45.24s 2026-03-19 12:53:02.990760 | controller | ci_setup : Install needed packages ------------------------------------- 33.04s 2026-03-19 12:53:02.990846 | controller | libvirt_manager : Download base image ---------------------------------- 30.55s 2026-03-19 12:53:02.990926 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 23.17s 2026-03-19 12:53:02.991011 | controller | reproducer : Install collections on controller-0 ----------------------- 21.13s 2026-03-19 12:53:02.991098 | controller | libvirt_manager : Install packages required for using KVM -------------- 13.60s 2026-03-19 12:53:02.991195 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 11.00s 2026-03-19 12:53:02.991292 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 7.74s 2026-03-19 12:53:02.991401 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.46s 2026-03-19 12:53:02.991502 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.09s 2026-03-19 12:53:02.991589 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.49s 2026-03-19 12:53:02.991678 | controller | ci_setup : Install openshift client ------------------------------------- 4.83s 2026-03-19 12:53:02.991765 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.71s 2026-03-19 12:53:02.991849 | controller | networking_mapper : Gather the facts ------------------------------------ 3.21s 2026-03-19 12:53:02.991936 | controller | sushy_emulator : Install required packages ------------------------------ 3.16s 2026-03-19 12:53:02.992017 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.10s 2026-03-19 12:53:02.992099 | controller | ci_setup : Manage directories ------------------------------------------- 2.44s 2026-03-19 12:53:02.992182 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.34s 2026-03-19 12:53:02.992271 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2026-03-19 12:53:02.992349 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.04s 2026-03-19 12:53:03.116171 | controller | INFO Running crc_layout > cleanup 2026-03-19 12:53:03.116555 | controller | WARNING Skipping, cleanup playbook not configured. 2026-03-19 12:53:03.123788 | controller | INFO Running job_uri > prepare 2026-03-19 12:53:03.124140 | controller | WARNING Skipping, prepare playbook not configured. 2026-03-19 12:53:03.131427 | controller | INFO Running job_uri > converge 2026-03-19 12:53:03.560809 | controller | 2026-03-19 12:53:03.560927 | controller | PLAY [Prepare] ***************************************************************** 2026-03-19 12:53:03.561053 | controller | 2026-03-19 12:53:03.561154 | controller | TASK [Call task file in loop] ************************************************** 2026-03-19 12:53:03.561260 | controller | Thursday 19 March 2026 12:53:03 +0000 (0:00:00.037) 0:00:00.037 ******** 2026-03-19 12:53:03.662205 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////'}) 2026-03-19 12:53:03.662274 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2026-03-19 12:53:03.662400 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2026-03-19 12:53:03.662519 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35'}) 2026-03-19 12:53:03.662636 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2026-03-19 12:53:03.662738 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2026-03-19 12:53:03.662828 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log'}) 2026-03-19 12:53:03.662927 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/'}) 2026-03-19 12:53:03.663026 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4'}) 2026-03-19 12:53:03.663124 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': '/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a'}) 2026-03-19 12:53:03.663207 | controller | 2026-03-19 12:53:03.663308 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////] *** 2026-03-19 12:53:03.663422 | controller | Thursday 19 March 2026 12:53:03 +0000 (0:00:00.102) 0:00:00.139 ******** 2026-03-19 12:53:03.699588 | controller | 2026-03-19 12:53:03.699664 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-19 12:53:03.699756 | controller | Thursday 19 March 2026 12:53:03 +0000 (0:00:00.037) 0:00:00.176 ******** 2026-03-19 12:53:03.734794 | controller | ok: [instance] 2026-03-19 12:53:03.734849 | controller | 2026-03-19 12:53:03.734950 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-19 12:53:03.735046 | controller | Thursday 19 March 2026 12:53:03 +0000 (0:00:00.035) 0:00:00.211 ******** 2026-03-19 12:53:03.771066 | controller | ok: [instance] 2026-03-19 12:53:03.771137 | controller | 2026-03-19 12:53:03.771246 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2026-03-19 12:53:03.771358 | controller | Thursday 19 March 2026 12:53:03 +0000 (0:00:00.036) 0:00:00.248 ******** 2026-03-19 12:53:03.816991 | controller | ok: [instance] 2026-03-19 12:53:03.817052 | controller | 2026-03-19 12:53:03.817159 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2026-03-19 12:53:03.817276 | controller | Thursday 19 March 2026 12:53:03 +0000 (0:00:00.045) 0:00:00.294 ******** 2026-03-19 12:53:03.847754 | controller | skipping: [instance] 2026-03-19 12:53:03.847808 | controller | 2026-03-19 12:53:03.847905 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2026-03-19 12:53:03.847989 | controller | Thursday 19 March 2026 12:53:03 +0000 (0:00:00.030) 0:00:00.324 ******** 2026-03-19 12:53:03.917212 | controller | ok: [instance] => changed=false 2026-03-19 12:53:03.917313 | controller | msg: All assertions passed 2026-03-19 12:53:03.917443 | controller | 2026-03-19 12:53:03.917590 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2026-03-19 12:53:03.917699 | controller | Thursday 19 March 2026 12:53:03 +0000 (0:00:00.069) 0:00:00.394 ******** 2026-03-19 12:53:03.957680 | controller | 2026-03-19 12:53:03.957799 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-19 12:53:03.957911 | controller | Thursday 19 March 2026 12:53:03 +0000 (0:00:00.040) 0:00:00.434 ******** 2026-03-19 12:53:03.990268 | controller | ok: [instance] 2026-03-19 12:53:03.990395 | controller | 2026-03-19 12:53:03.990537 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-19 12:53:03.990648 | controller | Thursday 19 March 2026 12:53:03 +0000 (0:00:00.032) 0:00:00.467 ******** 2026-03-19 12:53:04.027389 | controller | ok: [instance] 2026-03-19 12:53:04.027484 | controller | 2026-03-19 12:53:04.027601 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2026-03-19 12:53:04.027705 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.037) 0:00:00.504 ******** 2026-03-19 12:53:04.062986 | controller | ok: [instance] 2026-03-19 12:53:04.063073 | controller | 2026-03-19 12:53:04.063192 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2026-03-19 12:53:04.063316 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.035) 0:00:00.539 ******** 2026-03-19 12:53:04.089934 | controller | skipping: [instance] 2026-03-19 12:53:04.090008 | controller | 2026-03-19 12:53:04.090222 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2026-03-19 12:53:04.126124 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.027) 0:00:00.567 ******** 2026-03-19 12:53:04.126149 | controller | ok: [instance] => changed=false 2026-03-19 12:53:04.126207 | controller | msg: All assertions passed 2026-03-19 12:53:04.126295 | controller | 2026-03-19 12:53:04.126440 | controller | TASK [Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2026-03-19 12:53:04.126532 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.036) 0:00:00.603 ******** 2026-03-19 12:53:04.164306 | controller | 2026-03-19 12:53:04.164460 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-19 12:53:04.164591 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.038) 0:00:00.641 ******** 2026-03-19 12:53:04.199169 | controller | ok: [instance] 2026-03-19 12:53:04.199253 | controller | 2026-03-19 12:53:04.199351 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-19 12:53:04.199692 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.034) 0:00:00.676 ******** 2026-03-19 12:53:04.236980 | controller | ok: [instance] 2026-03-19 12:53:04.237069 | controller | 2026-03-19 12:53:04.237173 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2026-03-19 12:53:04.237294 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.037) 0:00:00.714 ******** 2026-03-19 12:53:04.270625 | controller | ok: [instance] 2026-03-19 12:53:04.270715 | controller | 2026-03-19 12:53:04.270805 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2026-03-19 12:53:04.270911 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.033) 0:00:00.747 ******** 2026-03-19 12:53:04.295141 | controller | skipping: [instance] 2026-03-19 12:53:04.295248 | controller | 2026-03-19 12:53:04.295411 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2026-03-19 12:53:04.295530 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.024) 0:00:00.772 ******** 2026-03-19 12:53:04.335390 | controller | ok: [instance] => changed=false 2026-03-19 12:53:04.335502 | controller | msg: All assertions passed 2026-03-19 12:53:04.335604 | controller | 2026-03-19 12:53:04.335719 | controller | TASK [Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35] *** 2026-03-19 12:53:04.335818 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.040) 0:00:00.812 ******** 2026-03-19 12:53:04.373087 | controller | 2026-03-19 12:53:04.374085 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-19 12:53:04.374196 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.037) 0:00:00.850 ******** 2026-03-19 12:53:04.406548 | controller | ok: [instance] 2026-03-19 12:53:04.406657 | controller | 2026-03-19 12:53:04.406670 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-19 12:53:04.406755 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.033) 0:00:00.883 ******** 2026-03-19 12:53:04.443699 | controller | ok: [instance] 2026-03-19 12:53:04.443747 | controller | 2026-03-19 12:53:04.443854 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2026-03-19 12:53:04.443963 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.037) 0:00:00.920 ******** 2026-03-19 12:53:04.480709 | controller | ok: [instance] 2026-03-19 12:53:04.480801 | controller | 2026-03-19 12:53:04.480933 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2026-03-19 12:53:04.481058 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.036) 0:00:00.957 ******** 2026-03-19 12:53:04.505625 | controller | skipping: [instance] 2026-03-19 12:53:04.505739 | controller | 2026-03-19 12:53:04.505860 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2026-03-19 12:53:04.505952 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.025) 0:00:00.982 ******** 2026-03-19 12:53:04.542816 | controller | ok: [instance] => changed=false 2026-03-19 12:53:04.542944 | controller | msg: All assertions passed 2026-03-19 12:53:04.543052 | controller | 2026-03-19 12:53:04.543066 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2026-03-19 12:53:04.609011 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.037) 0:00:01.019 ******** 2026-03-19 12:53:04.609048 | controller | 2026-03-19 12:53:04.609085 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-19 12:53:04.609200 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.066) 0:00:01.086 ******** 2026-03-19 12:53:04.646256 | controller | ok: [instance] 2026-03-19 12:53:04.646295 | controller | 2026-03-19 12:53:04.646304 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-19 12:53:04.646311 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.036) 0:00:01.123 ******** 2026-03-19 12:53:04.673168 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:04.673261 | controller | assertion: _matched_url | default('') | length > 0 2026-03-19 12:53:04.673359 | controller | evaluated_to: false 2026-03-19 12:53:04.673492 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2026-03-19 12:53:04.699913 | controller | 2026-03-19 12:53:04.700002 | controller | TASK [Clear errors to manually handle them] ************************************ 2026-03-19 12:53:04.700094 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.037) 0:00:01.160 ******** 2026-03-19 12:53:04.700198 | controller | 2026-03-19 12:53:04.700291 | controller | TASK [Really fail if string passed but should have failed] ********************* 2026-03-19 12:53:04.700414 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.016) 0:00:01.176 ******** 2026-03-19 12:53:04.731204 | controller | skipping: [instance] 2026-03-19 12:53:04.731292 | controller | 2026-03-19 12:53:04.731405 | controller | TASK [Really fail if string failed but should have passed] ********************* 2026-03-19 12:53:04.731516 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.031) 0:00:01.208 ******** 2026-03-19 12:53:04.764389 | controller | skipping: [instance] 2026-03-19 12:53:04.764495 | controller | 2026-03-19 12:53:04.764621 | controller | TASK [Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2026-03-19 12:53:04.764762 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.033) 0:00:01.241 ******** 2026-03-19 12:53:04.803024 | controller | 2026-03-19 12:53:04.803133 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-19 12:53:04.803259 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.038) 0:00:01.280 ******** 2026-03-19 12:53:04.835729 | controller | ok: [instance] 2026-03-19 12:53:04.835831 | controller | 2026-03-19 12:53:04.835929 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-19 12:53:04.836025 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.032) 0:00:01.312 ******** 2026-03-19 12:53:04.862446 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:04.862562 | controller | assertion: _matched_url | default('') | length > 0 2026-03-19 12:53:04.862658 | controller | evaluated_to: false 2026-03-19 12:53:04.862759 | controller | msg: 'The cifmw_job_uri value provided is not valid: httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2026-03-19 12:53:04.889650 | controller | 2026-03-19 12:53:04.889737 | controller | TASK [Clear errors to manually handle them] ************************************ 2026-03-19 12:53:04.889834 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.038) 0:00:01.351 ******** 2026-03-19 12:53:04.889927 | controller | 2026-03-19 12:53:04.890015 | controller | TASK [Really fail if string passed but should have failed] ********************* 2026-03-19 12:53:04.890113 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.015) 0:00:01.366 ******** 2026-03-19 12:53:04.923580 | controller | skipping: [instance] 2026-03-19 12:53:04.923662 | controller | 2026-03-19 12:53:04.923763 | controller | TASK [Really fail if string failed but should have passed] ********************* 2026-03-19 12:53:04.923933 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.034) 0:00:01.400 ******** 2026-03-19 12:53:04.955526 | controller | skipping: [instance] 2026-03-19 12:53:04.955610 | controller | 2026-03-19 12:53:04.955711 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log] *** 2026-03-19 12:53:04.955809 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.031) 0:00:01.432 ******** 2026-03-19 12:53:04.995492 | controller | 2026-03-19 12:53:04.995560 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-19 12:53:04.995671 | controller | Thursday 19 March 2026 12:53:04 +0000 (0:00:00.039) 0:00:01.472 ******** 2026-03-19 12:53:05.028958 | controller | ok: [instance] 2026-03-19 12:53:05.029005 | controller | 2026-03-19 12:53:05.029119 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-19 12:53:05.029222 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.033) 0:00:01.505 ******** 2026-03-19 12:53:05.064634 | controller | ok: [instance] 2026-03-19 12:53:05.064724 | controller | 2026-03-19 12:53:05.064813 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2026-03-19 12:53:05.064920 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.035) 0:00:01.541 ******** 2026-03-19 12:53:05.105710 | controller | ok: [instance] 2026-03-19 12:53:05.105762 | controller | 2026-03-19 12:53:05.105864 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2026-03-19 12:53:05.105980 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.040) 0:00:01.582 ******** 2026-03-19 12:53:05.134405 | controller | skipping: [instance] 2026-03-19 12:53:05.134865 | controller | 2026-03-19 12:53:05.176712 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2026-03-19 12:53:05.176748 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.028) 0:00:01.611 ******** 2026-03-19 12:53:05.176767 | controller | ok: [instance] => changed=false 2026-03-19 12:53:05.176787 | controller | msg: All assertions passed 2026-03-19 12:53:05.176878 | controller | 2026-03-19 12:53:05.177011 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/] *** 2026-03-19 12:53:05.177103 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.042) 0:00:01.653 ******** 2026-03-19 12:53:05.235179 | controller | 2026-03-19 12:53:05.235251 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-19 12:53:05.235360 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.058) 0:00:01.712 ******** 2026-03-19 12:53:05.268616 | controller | ok: [instance] 2026-03-19 12:53:05.268721 | controller | 2026-03-19 12:53:05.268807 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-19 12:53:05.268913 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.033) 0:00:01.745 ******** 2026-03-19 12:53:05.306752 | controller | ok: [instance] 2026-03-19 12:53:05.306826 | controller | 2026-03-19 12:53:05.306923 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2026-03-19 12:53:05.307016 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.038) 0:00:01.783 ******** 2026-03-19 12:53:05.341259 | controller | ok: [instance] 2026-03-19 12:53:05.341338 | controller | 2026-03-19 12:53:05.341456 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2026-03-19 12:53:05.341563 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.034) 0:00:01.818 ******** 2026-03-19 12:53:05.369726 | controller | skipping: [instance] 2026-03-19 12:53:05.369778 | controller | 2026-03-19 12:53:05.369943 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2026-03-19 12:53:05.369969 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.028) 0:00:01.846 ******** 2026-03-19 12:53:05.404692 | controller | ok: [instance] => changed=false 2026-03-19 12:53:05.404799 | controller | msg: All assertions passed 2026-03-19 12:53:05.404904 | controller | 2026-03-19 12:53:05.405030 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4] *** 2026-03-19 12:53:05.405132 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.034) 0:00:01.881 ******** 2026-03-19 12:53:05.440807 | controller | 2026-03-19 12:53:05.440887 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-19 12:53:05.440900 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.036) 0:00:01.917 ******** 2026-03-19 12:53:05.475144 | controller | ok: [instance] 2026-03-19 12:53:05.475252 | controller | 2026-03-19 12:53:05.475326 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-19 12:53:05.475428 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.034) 0:00:01.952 ******** 2026-03-19 12:53:05.502983 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:05.503076 | controller | assertion: _matched_url | default('') | length > 0 2026-03-19 12:53:05.503172 | controller | evaluated_to: false 2026-03-19 12:53:05.503266 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2026-03-19 12:53:05.532023 | controller | 2026-03-19 12:53:05.532142 | controller | TASK [Clear errors to manually handle them] ************************************ 2026-03-19 12:53:05.532255 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.037) 0:00:01.990 ******** 2026-03-19 12:53:05.532350 | controller | 2026-03-19 12:53:05.532499 | controller | TASK [Really fail if string passed but should have failed] ********************* 2026-03-19 12:53:05.532627 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.017) 0:00:02.007 ******** 2026-03-19 12:53:05.565147 | controller | skipping: [instance] 2026-03-19 12:53:05.565243 | controller | 2026-03-19 12:53:05.565358 | controller | TASK [Really fail if string failed but should have passed] ********************* 2026-03-19 12:53:05.565471 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.034) 0:00:02.042 ******** 2026-03-19 12:53:05.598718 | controller | skipping: [instance] 2026-03-19 12:53:05.598801 | controller | 2026-03-19 12:53:05.598899 | controller | TASK [Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a] *** 2026-03-19 12:53:05.598998 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.033) 0:00:02.075 ******** 2026-03-19 12:53:05.636042 | controller | 2026-03-19 12:53:05.636184 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-19 12:53:05.636277 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.037) 0:00:02.113 ******** 2026-03-19 12:53:05.670607 | controller | ok: [instance] 2026-03-19 12:53:05.670684 | controller | 2026-03-19 12:53:05.670780 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-19 12:53:05.670883 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.034) 0:00:02.147 ******** 2026-03-19 12:53:05.698228 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:05.698338 | controller | assertion: _matched_url | default('') | length > 0 2026-03-19 12:53:05.698475 | controller | evaluated_to: false 2026-03-19 12:53:05.698609 | controller | msg: 'The cifmw_job_uri value provided is not valid: /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2026-03-19 12:53:05.724260 | controller | 2026-03-19 12:53:05.724355 | controller | TASK [Clear errors to manually handle them] ************************************ 2026-03-19 12:53:05.724478 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.038) 0:00:02.186 ******** 2026-03-19 12:53:05.724582 | controller | 2026-03-19 12:53:05.724673 | controller | TASK [Really fail if string passed but should have failed] ********************* 2026-03-19 12:53:05.724757 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.015) 0:00:02.201 ******** 2026-03-19 12:53:05.759158 | controller | skipping: [instance] 2026-03-19 12:53:05.759265 | controller | 2026-03-19 12:53:05.759350 | controller | TASK [Really fail if string failed but should have passed] ********************* 2026-03-19 12:53:05.759470 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.034) 0:00:02.236 ******** 2026-03-19 12:53:05.788623 | controller | skipping: [instance] 2026-03-19 12:53:05.788708 | controller | 2026-03-19 12:53:05.788803 | controller | TASK [Print success message] *************************************************** 2026-03-19 12:53:05.788894 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.029) 0:00:02.265 ******** 2026-03-19 12:53:05.858874 | controller | ok: [instance] => 2026-03-19 12:53:05.858968 | controller | msg: All strings passed! 2026-03-19 12:53:05.859101 | controller | 2026-03-19 12:53:05.859237 | controller | PLAY RECAP ********************************************************************* 2026-03-19 12:53:05.859256 | controller | instance : ok=39 changed=0 unreachable=0 failed=0 skipped=14 rescued=4 ignored=0 2026-03-19 12:53:05.859341 | controller | 2026-03-19 12:53:05.859443 | controller | Thursday 19 March 2026 12:53:05 +0000 (0:00:00.070) 0:00:02.335 ******** 2026-03-19 12:53:05.859538 | controller | =============================================================================== 2026-03-19 12:53:05.859621 | controller | Call task file in loop -------------------------------------------------- 0.10s 2026-03-19 12:53:05.859706 | controller | Print success message --------------------------------------------------- 0.07s 2026-03-19 12:53:05.859793 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.07s 2026-03-19 12:53:05.859883 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.07s 2026-03-19 12:53:05.859968 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/ --- 0.06s 2026-03-19 12:53:05.860065 | controller | reproducer : Extract job id for later reference ------------------------- 0.05s 2026-03-19 12:53:05.860214 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.04s 2026-03-19 12:53:05.860248 | controller | reproducer : Extract job id for later reference ------------------------- 0.04s 2026-03-19 12:53:05.860348 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7 --- 0.04s 2026-03-19 12:53:05.860459 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.04s 2026-03-19 12:53:05.860554 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log --- 0.04s 2026-03-19 12:53:05.860642 | controller | Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.04s 2026-03-19 12:53:05.860730 | controller | Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7 --- 0.04s 2026-03-19 12:53:05.860816 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2026-03-19 12:53:05.860904 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2026-03-19 12:53:05.860991 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2026-03-19 12:53:05.861074 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2026-03-19 12:53:05.861238 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2026-03-19 12:53:05.861257 | controller | Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35 --- 0.04s 2026-03-19 12:53:05.861335 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2026-03-19 12:53:05.911240 | controller | INFO Running job_uri > cleanup 2026-03-19 12:53:05.911664 | controller | WARNING Skipping, cleanup playbook not configured. 2026-03-19 12:53:05.918945 | controller | INFO Running network_validations > prepare 2026-03-19 12:53:05.919318 | controller | WARNING Skipping, prepare playbook not configured. 2026-03-19 12:53:05.926545 | controller | INFO Running network_validations > converge 2026-03-19 12:53:06.366160 | controller | 2026-03-19 12:53:06.366210 | controller | PLAY [Prepare] ***************************************************************** 2026-03-19 12:53:06.366338 | controller | 2026-03-19 12:53:06.366448 | controller | TASK [Set failed fact] ********************************************************* 2026-03-19 12:53:06.366555 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.034) 0:00:00.034 ******** 2026-03-19 12:53:06.387020 | controller | ok: [instance] 2026-03-19 12:53:06.387098 | controller | 2026-03-19 12:53:06.387209 | controller | TASK [Load scenarios] ********************************************************** 2026-03-19 12:53:06.387301 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.021) 0:00:00.055 ******** 2026-03-19 12:53:06.410603 | controller | ok: [instance] 2026-03-19 12:53:06.410659 | controller | 2026-03-19 12:53:06.410769 | controller | TASK [Test network validations] ************************************************ 2026-03-19 12:53:06.410867 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.023) 0:00:00.079 ******** 2026-03-19 12:53:06.473013 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets only) 2026-03-19 12:53:06.473124 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets and spine/leaf) 2026-03-19 12:53:06.473256 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets with extra defined net) 2026-03-19 12:53:06.473361 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing default net definition) 2026-03-19 12:53:06.473498 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing spine/leaf net definition) 2026-03-19 12:53:06.473603 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=No network for a VM) 2026-03-19 12:53:06.473684 | controller | 2026-03-19 12:53:06.473775 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:06.473863 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.062) 0:00:00.141 ******** 2026-03-19 12:53:06.493702 | controller | ok: [instance] 2026-03-19 12:53:06.493795 | controller | 2026-03-19 12:53:06.493906 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:06.494018 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.020) 0:00:00.162 ******** 2026-03-19 12:53:06.520647 | controller | ok: [instance] 2026-03-19 12:53:06.543104 | controller | 2026-03-19 12:53:06.543127 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:06.543135 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.025) 0:00:00.187 ******** 2026-03-19 12:53:06.543145 | controller | ok: [instance] => 2026-03-19 12:53:06.543212 | controller | msg: 'Running: Default nets only' 2026-03-19 12:53:06.543312 | controller | 2026-03-19 12:53:06.543407 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:06.543525 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.023) 0:00:00.211 ******** 2026-03-19 12:53:06.588533 | controller | 2026-03-19 12:53:06.588643 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-03-19 12:53:06.588755 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.045) 0:00:00.256 ******** 2026-03-19 12:53:06.613734 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2026-03-19 12:53:06.613816 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2026-03-19 12:53:06.613908 | controller | in the `loop_control` option for the task to something else to avoid variable 2026-03-19 12:53:06.614001 | controller | collisions and unexpected behavior. 2026-03-19 12:53:06.671849 | controller | ok: [instance] => (item=controller) 2026-03-19 12:53:06.672015 | controller | 2026-03-19 12:53:06.672237 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-03-19 12:53:06.672711 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.082) 0:00:00.339 ******** 2026-03-19 12:53:06.725972 | controller | ok: [instance] 2026-03-19 12:53:06.726049 | controller | 2026-03-19 12:53:06.726155 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-03-19 12:53:06.726242 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.054) 0:00:00.394 ******** 2026-03-19 12:53:06.789869 | controller | ok: [instance] => changed=false 2026-03-19 12:53:06.789955 | controller | msg: All assertions passed 2026-03-19 12:53:06.790037 | controller | 2026-03-19 12:53:06.790169 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:06.790258 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.063) 0:00:00.458 ******** 2026-03-19 12:53:06.825528 | controller | skipping: [instance] 2026-03-19 12:53:06.825633 | controller | 2026-03-19 12:53:06.826106 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:06.826196 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.035) 0:00:00.494 ******** 2026-03-19 12:53:06.857524 | controller | skipping: [instance] 2026-03-19 12:53:06.857610 | controller | 2026-03-19 12:53:06.857722 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:06.857810 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.031) 0:00:00.525 ******** 2026-03-19 12:53:06.892440 | controller | skipping: [instance] 2026-03-19 12:53:06.892744 | controller | 2026-03-19 12:53:06.892955 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:06.893058 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.034) 0:00:00.560 ******** 2026-03-19 12:53:06.914339 | controller | ok: [instance] 2026-03-19 12:53:06.914461 | controller | 2026-03-19 12:53:06.914621 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:06.914752 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.022) 0:00:00.582 ******** 2026-03-19 12:53:06.939621 | controller | ok: [instance] 2026-03-19 12:53:06.939698 | controller | 2026-03-19 12:53:06.939838 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:06.939922 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.025) 0:00:00.608 ******** 2026-03-19 12:53:06.964574 | controller | ok: [instance] => 2026-03-19 12:53:06.964671 | controller | msg: 'Running: Default nets and spine/leaf' 2026-03-19 12:53:06.964760 | controller | 2026-03-19 12:53:06.964854 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:06.964935 | controller | Thursday 19 March 2026 12:53:06 +0000 (0:00:00.025) 0:00:00.633 ******** 2026-03-19 12:53:07.004234 | controller | 2026-03-19 12:53:07.004367 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-03-19 12:53:07.004525 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.039) 0:00:00.672 ******** 2026-03-19 12:53:07.028339 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2026-03-19 12:53:07.028468 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2026-03-19 12:53:07.028607 | controller | in the `loop_control` option for the task to something else to avoid variable 2026-03-19 12:53:07.028702 | controller | collisions and unexpected behavior. 2026-03-19 12:53:07.051229 | controller | ok: [instance] => (item=controller) 2026-03-19 12:53:07.051318 | controller | 2026-03-19 12:53:07.051433 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-03-19 12:53:07.051536 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.046) 0:00:00.719 ******** 2026-03-19 12:53:07.108094 | controller | ok: [instance] 2026-03-19 12:53:07.108202 | controller | 2026-03-19 12:53:07.108320 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-03-19 12:53:07.108465 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.057) 0:00:00.776 ******** 2026-03-19 12:53:07.168944 | controller | ok: [instance] => changed=false 2026-03-19 12:53:07.169038 | controller | msg: All assertions passed 2026-03-19 12:53:07.169138 | controller | 2026-03-19 12:53:07.169496 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:07.203586 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.060) 0:00:00.837 ******** 2026-03-19 12:53:07.203614 | controller | skipping: [instance] 2026-03-19 12:53:07.203699 | controller | 2026-03-19 12:53:07.203828 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:07.203947 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.034) 0:00:00.871 ******** 2026-03-19 12:53:07.236576 | controller | skipping: [instance] 2026-03-19 12:53:07.236661 | controller | 2026-03-19 12:53:07.236755 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:07.236839 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.033) 0:00:00.905 ******** 2026-03-19 12:53:07.267509 | controller | skipping: [instance] 2026-03-19 12:53:07.267605 | controller | 2026-03-19 12:53:07.267705 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:07.267797 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.031) 0:00:00.936 ******** 2026-03-19 12:53:07.288071 | controller | ok: [instance] 2026-03-19 12:53:07.288150 | controller | 2026-03-19 12:53:07.288275 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:07.288382 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.020) 0:00:00.956 ******** 2026-03-19 12:53:07.312480 | controller | ok: [instance] 2026-03-19 12:53:07.312571 | controller | 2026-03-19 12:53:07.312666 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:07.312770 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.024) 0:00:00.981 ******** 2026-03-19 12:53:07.339404 | controller | ok: [instance] => 2026-03-19 12:53:07.339505 | controller | msg: 'Running: Default nets with extra defined net' 2026-03-19 12:53:07.339609 | controller | 2026-03-19 12:53:07.339696 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:07.339789 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.026) 0:00:01.007 ******** 2026-03-19 12:53:07.378487 | controller | 2026-03-19 12:53:07.378600 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-03-19 12:53:07.378725 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.039) 0:00:01.047 ******** 2026-03-19 12:53:07.402913 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2026-03-19 12:53:07.403023 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2026-03-19 12:53:07.403036 | controller | in the `loop_control` option for the task to something else to avoid variable 2026-03-19 12:53:07.403108 | controller | collisions and unexpected behavior. 2026-03-19 12:53:07.449394 | controller | ok: [instance] => (item=controller) 2026-03-19 12:53:07.449496 | controller | 2026-03-19 12:53:07.449615 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-03-19 12:53:07.449701 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.070) 0:00:01.117 ******** 2026-03-19 12:53:07.503670 | controller | ok: [instance] 2026-03-19 12:53:07.503722 | controller | 2026-03-19 12:53:07.503829 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-03-19 12:53:07.503922 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.054) 0:00:01.172 ******** 2026-03-19 12:53:07.548246 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:07.548334 | controller | assertion: _defined | difference(_all_nets) | length == 0 2026-03-19 12:53:07.548459 | controller | evaluated_to: false 2026-03-19 12:53:07.548566 | controller | msg: 'Inconsistency detected: ensure you''re attaching all of the defined networks. Those nets don''t seem to be attached: [''extra_net_1'']' 2026-03-19 12:53:07.560031 | controller | 2026-03-19 12:53:07.560135 | controller | TASK [reproducer : Dump initial layout] **************************************** 2026-03-19 12:53:07.560241 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.056) 0:00:01.228 ******** 2026-03-19 12:53:07.592592 | controller | ok: [instance] => 2026-03-19 12:53:07.592680 | controller | cifmw_libvirt_manager_configuration: 2026-03-19 12:53:07.592803 | controller | networks: 2026-03-19 12:53:07.592933 | controller | public: defined 2026-03-19 12:53:07.593055 | controller | vms: 2026-03-19 12:53:07.593207 | controller | controller: 2026-03-19 12:53:07.593332 | controller | nets: 2026-03-19 12:53:07.593465 | controller | - public 2026-03-19 12:53:07.593579 | controller | 2026-03-19 12:53:07.593701 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2026-03-19 12:53:07.593790 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.032) 0:00:01.261 ******** 2026-03-19 12:53:07.619276 | controller | skipping: [instance] 2026-03-19 12:53:07.619395 | controller | 2026-03-19 12:53:07.619476 | controller | TASK [reproducer : Dump layout patches] **************************************** 2026-03-19 12:53:07.619576 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.026) 0:00:01.287 ******** 2026-03-19 12:53:07.692683 | controller | skipping: [instance] 2026-03-19 12:53:07.692761 | controller | 2026-03-19 12:53:07.692861 | controller | TASK [reproducer : Dump built layout] ****************************************** 2026-03-19 12:53:07.692952 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.073) 0:00:01.361 ******** 2026-03-19 12:53:07.732734 | controller | ok: [instance] => 2026-03-19 12:53:07.732818 | controller | _cifmw_libvirt_manager_layout: 2026-03-19 12:53:07.733316 | controller | networks: 2026-03-19 12:53:07.733545 | controller | extra_net_1: defined 2026-03-19 12:53:07.733860 | controller | public: defined 2026-03-19 12:53:07.734135 | controller | vms: 2026-03-19 12:53:07.734777 | controller | controller: 2026-03-19 12:53:07.735400 | controller | nets: 2026-03-19 12:53:07.735802 | controller | - public 2026-03-19 12:53:07.736173 | controller | 2026-03-19 12:53:07.736820 | controller | TASK [reproducer : Fail for good] ********************************************** 2026-03-19 12:53:07.736979 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.040) 0:00:01.401 ******** 2026-03-19 12:53:07.748712 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:07.749274 | controller | msg: Error detected, please check assertions and debugging output above. 2026-03-19 12:53:07.777484 | controller | 2026-03-19 12:53:07.777586 | controller | TASK [Clear host errors] ******************************************************* 2026-03-19 12:53:07.777676 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.028) 0:00:01.429 ******** 2026-03-19 12:53:07.777764 | controller | 2026-03-19 12:53:07.777847 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:07.778007 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.016) 0:00:01.445 ******** 2026-03-19 12:53:07.799618 | controller | ok: [instance] 2026-03-19 12:53:07.799708 | controller | 2026-03-19 12:53:07.799823 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:07.799952 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.022) 0:00:01.468 ******** 2026-03-19 12:53:07.837488 | controller | skipping: [instance] 2026-03-19 12:53:07.837583 | controller | 2026-03-19 12:53:07.837672 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:07.837766 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.037) 0:00:01.506 ******** 2026-03-19 12:53:07.869194 | controller | skipping: [instance] 2026-03-19 12:53:07.869267 | controller | 2026-03-19 12:53:07.869357 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:07.869484 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.031) 0:00:01.537 ******** 2026-03-19 12:53:07.900935 | controller | skipping: [instance] 2026-03-19 12:53:07.901032 | controller | 2026-03-19 12:53:07.901151 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:07.901262 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.031) 0:00:01.569 ******** 2026-03-19 12:53:07.923138 | controller | ok: [instance] 2026-03-19 12:53:07.923215 | controller | 2026-03-19 12:53:07.923315 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:07.923425 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.022) 0:00:01.591 ******** 2026-03-19 12:53:07.948424 | controller | ok: [instance] 2026-03-19 12:53:07.948530 | controller | 2026-03-19 12:53:07.948631 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:07.948725 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.025) 0:00:01.616 ******** 2026-03-19 12:53:07.974470 | controller | ok: [instance] => 2026-03-19 12:53:07.974574 | controller | msg: 'Running: Missing default net definition' 2026-03-19 12:53:07.974663 | controller | 2026-03-19 12:53:07.974757 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:07.974851 | controller | Thursday 19 March 2026 12:53:07 +0000 (0:00:00.026) 0:00:01.643 ******** 2026-03-19 12:53:08.014057 | controller | 2026-03-19 12:53:08.014184 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-03-19 12:53:08.014289 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.039) 0:00:01.682 ******** 2026-03-19 12:53:08.039606 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2026-03-19 12:53:08.039692 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2026-03-19 12:53:08.039777 | controller | in the `loop_control` option for the task to something else to avoid variable 2026-03-19 12:53:08.039870 | controller | collisions and unexpected behavior. 2026-03-19 12:53:08.058296 | controller | ok: [instance] => (item=controller) 2026-03-19 12:53:08.058391 | controller | 2026-03-19 12:53:08.058550 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-03-19 12:53:08.058645 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.044) 0:00:01.726 ******** 2026-03-19 12:53:08.101485 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:08.101595 | controller | assertion: _all_nets | difference(_defined) | length == 0 2026-03-19 12:53:08.101702 | controller | evaluated_to: false 2026-03-19 12:53:08.101785 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''foo'']' 2026-03-19 12:53:08.112285 | controller | 2026-03-19 12:53:08.112364 | controller | TASK [reproducer : Dump initial layout] **************************************** 2026-03-19 12:53:08.112495 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.054) 0:00:01.780 ******** 2026-03-19 12:53:08.148392 | controller | ok: [instance] => 2026-03-19 12:53:08.148514 | controller | cifmw_libvirt_manager_configuration: 2026-03-19 12:53:08.148629 | controller | networks: 2026-03-19 12:53:08.148689 | controller | public: defined 2026-03-19 12:53:08.148791 | controller | vms: 2026-03-19 12:53:08.148883 | controller | controller: 2026-03-19 12:53:08.148967 | controller | nets: 2026-03-19 12:53:08.149055 | controller | - public 2026-03-19 12:53:08.149166 | controller | 2026-03-19 12:53:08.149243 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2026-03-19 12:53:08.149323 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.036) 0:00:01.816 ******** 2026-03-19 12:53:08.176658 | controller | skipping: [instance] 2026-03-19 12:53:08.176757 | controller | 2026-03-19 12:53:08.176877 | controller | TASK [reproducer : Dump layout patches] **************************************** 2026-03-19 12:53:08.176982 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.028) 0:00:01.845 ******** 2026-03-19 12:53:08.282198 | controller | skipping: [instance] 2026-03-19 12:53:08.282319 | controller | 2026-03-19 12:53:08.282491 | controller | TASK [reproducer : Dump built layout] ****************************************** 2026-03-19 12:53:08.282635 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.105) 0:00:01.950 ******** 2026-03-19 12:53:08.344636 | controller | ok: [instance] => 2026-03-19 12:53:08.344721 | controller | _cifmw_libvirt_manager_layout: 2026-03-19 12:53:08.344816 | controller | networks: 2026-03-19 12:53:08.344908 | controller | public: defined 2026-03-19 12:53:08.344997 | controller | vms: 2026-03-19 12:53:08.345090 | controller | controller: 2026-03-19 12:53:08.345217 | controller | nets: 2026-03-19 12:53:08.345295 | controller | - public 2026-03-19 12:53:08.345389 | controller | - foo 2026-03-19 12:53:08.345485 | controller | 2026-03-19 12:53:08.345595 | controller | TASK [reproducer : Fail for good] ********************************************** 2026-03-19 12:53:08.345676 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.062) 0:00:02.013 ******** 2026-03-19 12:53:08.356624 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:08.356721 | controller | msg: Error detected, please check assertions and debugging output above. 2026-03-19 12:53:08.383248 | controller | 2026-03-19 12:53:08.383360 | controller | TASK [Clear host errors] ******************************************************* 2026-03-19 12:53:08.383487 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.022) 0:00:02.035 ******** 2026-03-19 12:53:08.383583 | controller | 2026-03-19 12:53:08.383677 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:08.383767 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.016) 0:00:02.051 ******** 2026-03-19 12:53:08.405508 | controller | ok: [instance] 2026-03-19 12:53:08.405610 | controller | 2026-03-19 12:53:08.405700 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:08.405792 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.021) 0:00:02.073 ******** 2026-03-19 12:53:08.442947 | controller | skipping: [instance] 2026-03-19 12:53:08.443053 | controller | 2026-03-19 12:53:08.443185 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:08.443322 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.037) 0:00:02.111 ******** 2026-03-19 12:53:08.474922 | controller | skipping: [instance] 2026-03-19 12:53:08.475002 | controller | 2026-03-19 12:53:08.475112 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:08.475206 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.032) 0:00:02.143 ******** 2026-03-19 12:53:08.507989 | controller | skipping: [instance] 2026-03-19 12:53:08.508058 | controller | 2026-03-19 12:53:08.508207 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:08.508240 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.033) 0:00:02.176 ******** 2026-03-19 12:53:08.533809 | controller | ok: [instance] 2026-03-19 12:53:08.533904 | controller | 2026-03-19 12:53:08.534003 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:08.534093 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.025) 0:00:02.202 ******** 2026-03-19 12:53:08.563270 | controller | ok: [instance] 2026-03-19 12:53:08.563399 | controller | 2026-03-19 12:53:08.563515 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:08.563630 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.029) 0:00:02.231 ******** 2026-03-19 12:53:08.591970 | controller | ok: [instance] => 2026-03-19 12:53:08.592058 | controller | msg: 'Running: Missing spine/leaf net definition' 2026-03-19 12:53:08.592145 | controller | 2026-03-19 12:53:08.592240 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:08.592334 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.028) 0:00:02.260 ******** 2026-03-19 12:53:08.636718 | controller | 2026-03-19 12:53:08.636814 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-03-19 12:53:08.636917 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.044) 0:00:02.305 ******** 2026-03-19 12:53:08.662269 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2026-03-19 12:53:08.662289 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2026-03-19 12:53:08.662386 | controller | in the `loop_control` option for the task to something else to avoid variable 2026-03-19 12:53:08.662500 | controller | collisions and unexpected behavior. 2026-03-19 12:53:08.681174 | controller | ok: [instance] => (item=controller) 2026-03-19 12:53:08.681278 | controller | 2026-03-19 12:53:08.681391 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-03-19 12:53:08.681530 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.044) 0:00:02.349 ******** 2026-03-19 12:53:08.726401 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:08.726496 | controller | assertion: _all_nets | difference(_defined) | length == 0 2026-03-19 12:53:08.726602 | controller | evaluated_to: false 2026-03-19 12:53:08.726709 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''l00-s1'']' 2026-03-19 12:53:08.737554 | controller | 2026-03-19 12:53:08.737644 | controller | TASK [reproducer : Dump initial layout] **************************************** 2026-03-19 12:53:08.737735 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.056) 0:00:02.406 ******** 2026-03-19 12:53:08.766991 | controller | ok: [instance] => 2026-03-19 12:53:08.767073 | controller | cifmw_libvirt_manager_configuration: 2026-03-19 12:53:08.767184 | controller | networks: 2026-03-19 12:53:08.767272 | controller | l00-s0: defined 2026-03-19 12:53:08.767389 | controller | public: defined 2026-03-19 12:53:08.767476 | controller | vms: 2026-03-19 12:53:08.767586 | controller | controller: 2026-03-19 12:53:08.767654 | controller | nets: 2026-03-19 12:53:08.767743 | controller | - public 2026-03-19 12:53:08.767824 | controller | spineleafnets: 2026-03-19 12:53:08.767932 | controller | - l00-s0 2026-03-19 12:53:08.768007 | controller | 2026-03-19 12:53:08.768088 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2026-03-19 12:53:08.768190 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.029) 0:00:02.435 ******** 2026-03-19 12:53:08.796129 | controller | skipping: [instance] 2026-03-19 12:53:08.796215 | controller | 2026-03-19 12:53:08.796314 | controller | TASK [reproducer : Dump layout patches] **************************************** 2026-03-19 12:53:08.796417 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.027) 0:00:02.463 ******** 2026-03-19 12:53:08.867642 | controller | skipping: [instance] 2026-03-19 12:53:08.867721 | controller | 2026-03-19 12:53:08.867830 | controller | TASK [reproducer : Dump built layout] ****************************************** 2026-03-19 12:53:08.867917 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.072) 0:00:02.536 ******** 2026-03-19 12:53:08.906122 | controller | ok: [instance] => 2026-03-19 12:53:08.906210 | controller | _cifmw_libvirt_manager_layout: 2026-03-19 12:53:08.906307 | controller | networks: 2026-03-19 12:53:08.906422 | controller | l00-s0: defined 2026-03-19 12:53:08.906516 | controller | public: defined 2026-03-19 12:53:08.906607 | controller | vms: 2026-03-19 12:53:08.906701 | controller | controller: 2026-03-19 12:53:08.906790 | controller | nets: 2026-03-19 12:53:08.906878 | controller | - public 2026-03-19 12:53:08.906966 | controller | spineleafnets: 2026-03-19 12:53:08.907051 | controller | - l00-s0 2026-03-19 12:53:08.907140 | controller | - l00-s1 2026-03-19 12:53:08.907220 | controller | 2026-03-19 12:53:08.907313 | controller | TASK [reproducer : Fail for good] ********************************************** 2026-03-19 12:53:08.907428 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.038) 0:00:02.574 ******** 2026-03-19 12:53:08.919052 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:08.919216 | controller | msg: Error detected, please check assertions and debugging output above. 2026-03-19 12:53:08.950989 | controller | 2026-03-19 12:53:08.951083 | controller | TASK [Clear host errors] ******************************************************* 2026-03-19 12:53:08.951204 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.026) 0:00:02.601 ******** 2026-03-19 12:53:08.951297 | controller | 2026-03-19 12:53:08.951385 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:08.951504 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.017) 0:00:02.619 ******** 2026-03-19 12:53:08.973738 | controller | ok: [instance] 2026-03-19 12:53:08.973822 | controller | 2026-03-19 12:53:08.973916 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:08.974009 | controller | Thursday 19 March 2026 12:53:08 +0000 (0:00:00.023) 0:00:02.642 ******** 2026-03-19 12:53:09.011347 | controller | skipping: [instance] 2026-03-19 12:53:09.011493 | controller | 2026-03-19 12:53:09.011629 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:09.011739 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.037) 0:00:02.679 ******** 2026-03-19 12:53:09.045306 | controller | skipping: [instance] 2026-03-19 12:53:09.045404 | controller | 2026-03-19 12:53:09.045513 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:09.045618 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.033) 0:00:02.713 ******** 2026-03-19 12:53:09.099816 | controller | skipping: [instance] 2026-03-19 12:53:09.099918 | controller | 2026-03-19 12:53:09.100033 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:09.100151 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.054) 0:00:02.768 ******** 2026-03-19 12:53:09.120927 | controller | ok: [instance] 2026-03-19 12:53:09.121007 | controller | 2026-03-19 12:53:09.121099 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:09.121190 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.021) 0:00:02.789 ******** 2026-03-19 12:53:09.148185 | controller | ok: [instance] 2026-03-19 12:53:09.148322 | controller | 2026-03-19 12:53:09.148593 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:09.177643 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.027) 0:00:02.816 ******** 2026-03-19 12:53:09.177686 | controller | ok: [instance] => 2026-03-19 12:53:09.177735 | controller | msg: 'Running: No network for a VM' 2026-03-19 12:53:09.177967 | controller | 2026-03-19 12:53:09.178091 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:09.178180 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.029) 0:00:02.846 ******** 2026-03-19 12:53:09.218063 | controller | 2026-03-19 12:53:09.218236 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-03-19 12:53:09.218304 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.040) 0:00:02.886 ******** 2026-03-19 12:53:09.243074 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2026-03-19 12:53:09.243357 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2026-03-19 12:53:09.243497 | controller | in the `loop_control` option for the task to something else to avoid variable 2026-03-19 12:53:09.243964 | controller | collisions and unexpected behavior. 2026-03-19 12:53:09.258846 | controller | failed: [instance] (item=foo) => changed=false 2026-03-19 12:53:09.258944 | controller | ansible_loop_var: item 2026-03-19 12:53:09.259139 | controller | assertion: item.value.nets is defined 2026-03-19 12:53:09.260050 | controller | evaluated_to: false 2026-03-19 12:53:09.260133 | controller | item: 2026-03-19 12:53:09.260308 | controller | key: foo 2026-03-19 12:53:09.260405 | controller | value: 2026-03-19 12:53:09.260507 | controller | disksize: 10 2026-03-19 12:53:09.260610 | controller | msg: 'Inconsistency detected: VM type "foo" doesn''t seem to have any network.' 2026-03-19 12:53:09.271354 | controller | ok: [instance] => (item=controller) 2026-03-19 12:53:09.271590 | controller | 2026-03-19 12:53:09.271687 | controller | TASK [reproducer : Dump initial layout] **************************************** 2026-03-19 12:53:09.271777 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.053) 0:00:02.939 ******** 2026-03-19 12:53:09.302878 | controller | ok: [instance] => 2026-03-19 12:53:09.302980 | controller | cifmw_libvirt_manager_configuration: 2026-03-19 12:53:09.303092 | controller | networks: 2026-03-19 12:53:09.303203 | controller | public: defined 2026-03-19 12:53:09.303311 | controller | vms: 2026-03-19 12:53:09.303408 | controller | controller: 2026-03-19 12:53:09.303575 | controller | nets: 2026-03-19 12:53:09.303665 | controller | - public 2026-03-19 12:53:09.303764 | controller | 2026-03-19 12:53:09.303886 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2026-03-19 12:53:09.303979 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.031) 0:00:02.971 ******** 2026-03-19 12:53:09.332706 | controller | skipping: [instance] 2026-03-19 12:53:09.332809 | controller | 2026-03-19 12:53:09.332911 | controller | TASK [reproducer : Dump layout patches] **************************************** 2026-03-19 12:53:09.333007 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.028) 0:00:03.000 ******** 2026-03-19 12:53:09.405864 | controller | skipping: [instance] 2026-03-19 12:53:09.405957 | controller | 2026-03-19 12:53:09.406060 | controller | TASK [reproducer : Dump built layout] ****************************************** 2026-03-19 12:53:09.406143 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.073) 0:00:03.074 ******** 2026-03-19 12:53:09.448516 | controller | ok: [instance] => 2026-03-19 12:53:09.448615 | controller | _cifmw_libvirt_manager_layout: 2026-03-19 12:53:09.448707 | controller | networks: 2026-03-19 12:53:09.448810 | controller | public: defined 2026-03-19 12:53:09.448887 | controller | vms: 2026-03-19 12:53:09.448969 | controller | controller: 2026-03-19 12:53:09.449072 | controller | nets: 2026-03-19 12:53:09.449187 | controller | - public 2026-03-19 12:53:09.449267 | controller | foo: 2026-03-19 12:53:09.449358 | controller | disksize: 10 2026-03-19 12:53:09.449469 | controller | 2026-03-19 12:53:09.449561 | controller | TASK [reproducer : Fail for good] ********************************************** 2026-03-19 12:53:09.449649 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.042) 0:00:03.116 ******** 2026-03-19 12:53:09.460706 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:09.460799 | controller | msg: Error detected, please check assertions and debugging output above. 2026-03-19 12:53:09.488228 | controller | 2026-03-19 12:53:09.488326 | controller | TASK [Clear host errors] ******************************************************* 2026-03-19 12:53:09.488472 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.024) 0:00:03.141 ******** 2026-03-19 12:53:09.488590 | controller | 2026-03-19 12:53:09.488700 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:09.488802 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.015) 0:00:03.156 ******** 2026-03-19 12:53:09.509299 | controller | ok: [instance] 2026-03-19 12:53:09.509384 | controller | 2026-03-19 12:53:09.509498 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:09.509610 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.021) 0:00:03.177 ******** 2026-03-19 12:53:09.544572 | controller | skipping: [instance] 2026-03-19 12:53:09.544666 | controller | 2026-03-19 12:53:09.544769 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:09.544862 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.035) 0:00:03.213 ******** 2026-03-19 12:53:09.577737 | controller | skipping: [instance] 2026-03-19 12:53:09.577820 | controller | 2026-03-19 12:53:09.577925 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:09.578019 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.033) 0:00:03.246 ******** 2026-03-19 12:53:09.609201 | controller | skipping: [instance] 2026-03-19 12:53:09.609321 | controller | 2026-03-19 12:53:09.609465 | controller | TASK [Fail if needed] ********************************************************** 2026-03-19 12:53:09.609597 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.031) 0:00:03.277 ******** 2026-03-19 12:53:09.665082 | controller | skipping: [instance] 2026-03-19 12:53:09.665197 | controller | 2026-03-19 12:53:09.665322 | controller | PLAY RECAP ********************************************************************* 2026-03-19 12:53:09.665447 | controller | instance : ok=48 changed=0 unreachable=0 failed=0 skipped=27 rescued=8 ignored=0 2026-03-19 12:53:09.665630 | controller | 2026-03-19 12:53:09.665727 | controller | Thursday 19 March 2026 12:53:09 +0000 (0:00:00.055) 0:00:03.333 ******** 2026-03-19 12:53:09.665816 | controller | =============================================================================== 2026-03-19 12:53:09.665905 | controller | reproducer : Dump layout patches ---------------------------------------- 0.11s 2026-03-19 12:53:09.665995 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.08s 2026-03-19 12:53:09.666087 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2026-03-19 12:53:09.666197 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2026-03-19 12:53:09.666268 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2026-03-19 12:53:09.666361 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.07s 2026-03-19 12:53:09.666493 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2026-03-19 12:53:09.666591 | controller | reproducer : Dump built layout ------------------------------------------ 0.06s 2026-03-19 12:53:09.666674 | controller | Test network validations ------------------------------------------------ 0.06s 2026-03-19 12:53:09.666789 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2026-03-19 12:53:09.666884 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2026-03-19 12:53:09.666970 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2026-03-19 12:53:09.667072 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2026-03-19 12:53:09.667140 | controller | Fail if needed ---------------------------------------------------------- 0.06s 2026-03-19 12:53:09.667240 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.05s 2026-03-19 12:53:09.667324 | controller | Append failed scenario to list ------------------------------------------ 0.05s 2026-03-19 12:53:09.667431 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.05s 2026-03-19 12:53:09.667522 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.05s 2026-03-19 12:53:09.667674 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.05s 2026-03-19 12:53:09.667768 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.05s 2026-03-19 12:53:09.741825 | controller | INFO Running network_validations > cleanup 2026-03-19 12:53:09.742211 | controller | WARNING Skipping, cleanup playbook not configured. 2026-03-19 12:53:09.749456 | controller | INFO Running ocp_validations > prepare 2026-03-19 12:53:09.749899 | controller | WARNING Skipping, prepare playbook not configured. 2026-03-19 12:53:09.757520 | controller | INFO Running ocp_validations > converge 2026-03-19 12:53:10.197018 | controller | 2026-03-19 12:53:10.197132 | controller | PLAY [Prepare] ***************************************************************** 2026-03-19 12:53:10.197240 | controller | 2026-03-19 12:53:10.197351 | controller | TASK [Set failed fact] ********************************************************* 2026-03-19 12:53:10.197495 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.033) 0:00:00.033 ******** 2026-03-19 12:53:10.218269 | controller | ok: [instance] 2026-03-19 12:53:10.218393 | controller | 2026-03-19 12:53:10.218518 | controller | TASK [Load scenarios] ********************************************************** 2026-03-19 12:53:10.218654 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.021) 0:00:00.055 ******** 2026-03-19 12:53:10.241682 | controller | ok: [instance] 2026-03-19 12:53:10.241824 | controller | 2026-03-19 12:53:10.241984 | controller | TASK [Test no volumes] ********************************************************* 2026-03-19 12:53:10.242172 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.023) 0:00:00.078 ******** 2026-03-19 12:53:10.337126 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, no worker) 2026-03-19 12:53:10.337242 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, with worker) 2026-03-19 12:53:10.337332 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, no worker) 2026-03-19 12:53:10.337433 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, with worker) 2026-03-19 12:53:10.337542 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Too many allocated volumes) 2026-03-19 12:53:10.337644 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Different volume amount) 2026-03-19 12:53:10.337733 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVM without volume) 2026-03-19 12:53:10.337821 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVMS without volume) 2026-03-19 12:53:10.337915 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice) 2026-03-19 12:53:10.338003 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no LVMS) 2026-03-19 12:53:10.338134 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no cinder_lvm) 2026-03-19 12:53:10.338301 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Config overrides via devscripts) 2026-03-19 12:53:10.338386 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 10 dev-scripts extra_worker) 2026-03-19 12:53:10.338401 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 0 dev-scripts extra_worker) 2026-03-19 12:53:10.338479 | controller | 2026-03-19 12:53:10.338576 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:10.338665 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.095) 0:00:00.174 ******** 2026-03-19 12:53:10.357793 | controller | ok: [instance] 2026-03-19 12:53:10.357900 | controller | 2026-03-19 12:53:10.358017 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:10.358101 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.020) 0:00:00.194 ******** 2026-03-19 12:53:10.382696 | controller | ok: [instance] 2026-03-19 12:53:10.382790 | controller | 2026-03-19 12:53:10.382884 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:10.382976 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.025) 0:00:00.219 ******** 2026-03-19 12:53:10.407002 | controller | ok: [instance] => 2026-03-19 12:53:10.407102 | controller | msg: 'Running: No volume, no worker' 2026-03-19 12:53:10.407223 | controller | 2026-03-19 12:53:10.407335 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:10.407466 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.024) 0:00:00.243 ******** 2026-03-19 12:53:10.464294 | controller | 2026-03-19 12:53:10.464574 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-19 12:53:10.464676 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.057) 0:00:00.301 ******** 2026-03-19 12:53:10.519787 | controller | ok: [instance] 2026-03-19 12:53:10.519865 | controller | 2026-03-19 12:53:10.519962 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-19 12:53:10.520056 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.055) 0:00:00.356 ******** 2026-03-19 12:53:10.561488 | controller | ok: [instance] 2026-03-19 12:53:10.561565 | controller | 2026-03-19 12:53:10.561676 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-19 12:53:10.561761 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.041) 0:00:00.398 ******** 2026-03-19 12:53:10.630092 | controller | ok: [instance] 2026-03-19 12:53:10.630390 | controller | 2026-03-19 12:53:10.630412 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-19 12:53:10.630422 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.068) 0:00:00.467 ******** 2026-03-19 12:53:10.668812 | controller | skipping: [instance] 2026-03-19 12:53:10.668891 | controller | 2026-03-19 12:53:10.669001 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-19 12:53:10.669107 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.038) 0:00:00.505 ******** 2026-03-19 12:53:10.717065 | controller | ok: [instance] 2026-03-19 12:53:10.717144 | controller | 2026-03-19 12:53:10.717240 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-19 12:53:10.717351 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.048) 0:00:00.554 ******** 2026-03-19 12:53:10.759157 | controller | skipping: [instance] 2026-03-19 12:53:10.759257 | controller | 2026-03-19 12:53:10.759356 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-19 12:53:10.759472 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.041) 0:00:00.595 ******** 2026-03-19 12:53:10.798865 | controller | skipping: [instance] 2026-03-19 12:53:10.798950 | controller | 2026-03-19 12:53:10.799048 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-19 12:53:10.799145 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.040) 0:00:00.635 ******** 2026-03-19 12:53:10.839536 | controller | skipping: [instance] 2026-03-19 12:53:10.839635 | controller | 2026-03-19 12:53:10.839744 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2026-03-19 12:53:10.839833 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.040) 0:00:00.675 ******** 2026-03-19 12:53:10.881686 | controller | skipping: [instance] 2026-03-19 12:53:10.881780 | controller | 2026-03-19 12:53:10.881878 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2026-03-19 12:53:10.881974 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.042) 0:00:00.718 ******** 2026-03-19 12:53:10.924867 | controller | skipping: [instance] 2026-03-19 12:53:10.924941 | controller | 2026-03-19 12:53:10.925040 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2026-03-19 12:53:10.925135 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.043) 0:00:00.761 ******** 2026-03-19 12:53:10.974320 | controller | skipping: [instance] 2026-03-19 12:53:11.008392 | controller | 2026-03-19 12:53:11.008432 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:11.008447 | controller | Thursday 19 March 2026 12:53:10 +0000 (0:00:00.048) 0:00:00.810 ******** 2026-03-19 12:53:11.008458 | controller | skipping: [instance] 2026-03-19 12:53:11.008480 | controller | 2026-03-19 12:53:11.008582 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:11.008678 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.034) 0:00:00.845 ******** 2026-03-19 12:53:11.040914 | controller | skipping: [instance] 2026-03-19 12:53:11.041007 | controller | 2026-03-19 12:53:11.041101 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:11.041223 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.032) 0:00:00.877 ******** 2026-03-19 12:53:11.073570 | controller | skipping: [instance] 2026-03-19 12:53:11.073656 | controller | 2026-03-19 12:53:11.073757 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:11.073888 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.032) 0:00:00.910 ******** 2026-03-19 12:53:11.094281 | controller | ok: [instance] 2026-03-19 12:53:11.094364 | controller | 2026-03-19 12:53:11.094492 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:11.094593 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.020) 0:00:00.931 ******** 2026-03-19 12:53:11.119572 | controller | ok: [instance] 2026-03-19 12:53:11.119655 | controller | 2026-03-19 12:53:11.119754 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:11.119850 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.025) 0:00:00.956 ******** 2026-03-19 12:53:11.143759 | controller | ok: [instance] => 2026-03-19 12:53:11.143848 | controller | msg: 'Running: No volume, with worker' 2026-03-19 12:53:11.143936 | controller | 2026-03-19 12:53:11.144033 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:11.144124 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.024) 0:00:00.980 ******** 2026-03-19 12:53:11.184866 | controller | 2026-03-19 12:53:11.184955 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-19 12:53:11.185053 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.041) 0:00:01.021 ******** 2026-03-19 12:53:11.242814 | controller | ok: [instance] 2026-03-19 12:53:11.242896 | controller | 2026-03-19 12:53:11.242994 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-19 12:53:11.243088 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.057) 0:00:01.079 ******** 2026-03-19 12:53:11.282074 | controller | ok: [instance] 2026-03-19 12:53:11.282310 | controller | 2026-03-19 12:53:11.282462 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-19 12:53:11.282482 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.039) 0:00:01.119 ******** 2026-03-19 12:53:11.376979 | controller | ok: [instance] 2026-03-19 12:53:11.377030 | controller | 2026-03-19 12:53:11.377153 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-19 12:53:11.377247 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.094) 0:00:01.214 ******** 2026-03-19 12:53:11.446452 | controller | ok: [instance] 2026-03-19 12:53:11.446529 | controller | 2026-03-19 12:53:11.446650 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-19 12:53:11.446741 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.069) 0:00:01.283 ******** 2026-03-19 12:53:11.497713 | controller | ok: [instance] 2026-03-19 12:53:11.497795 | controller | 2026-03-19 12:53:11.497902 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-19 12:53:11.497988 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.051) 0:00:01.334 ******** 2026-03-19 12:53:11.536393 | controller | skipping: [instance] 2026-03-19 12:53:11.536493 | controller | 2026-03-19 12:53:11.536606 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-19 12:53:11.536702 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.038) 0:00:01.372 ******** 2026-03-19 12:53:11.578786 | controller | skipping: [instance] 2026-03-19 12:53:11.578867 | controller | 2026-03-19 12:53:11.578963 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-19 12:53:11.579055 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.042) 0:00:01.415 ******** 2026-03-19 12:53:11.618504 | controller | skipping: [instance] 2026-03-19 12:53:11.618602 | controller | 2026-03-19 12:53:11.618709 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2026-03-19 12:53:11.618806 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.039) 0:00:01.455 ******** 2026-03-19 12:53:11.660526 | controller | skipping: [instance] 2026-03-19 12:53:11.660633 | controller | 2026-03-19 12:53:11.660739 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2026-03-19 12:53:11.660835 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.041) 0:00:01.497 ******** 2026-03-19 12:53:11.705066 | controller | skipping: [instance] 2026-03-19 12:53:11.705156 | controller | 2026-03-19 12:53:11.705263 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2026-03-19 12:53:11.705354 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.044) 0:00:01.541 ******** 2026-03-19 12:53:11.756209 | controller | skipping: [instance] 2026-03-19 12:53:11.756293 | controller | 2026-03-19 12:53:11.756408 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:11.756510 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.051) 0:00:01.593 ******** 2026-03-19 12:53:11.791970 | controller | skipping: [instance] 2026-03-19 12:53:11.792038 | controller | 2026-03-19 12:53:11.792150 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:11.792242 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.035) 0:00:01.629 ******** 2026-03-19 12:53:11.827959 | controller | skipping: [instance] 2026-03-19 12:53:11.828009 | controller | 2026-03-19 12:53:11.828125 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:11.828238 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.035) 0:00:01.664 ******** 2026-03-19 12:53:11.861079 | controller | skipping: [instance] 2026-03-19 12:53:11.861179 | controller | 2026-03-19 12:53:11.861282 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:11.861410 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.033) 0:00:01.698 ******** 2026-03-19 12:53:11.886506 | controller | ok: [instance] 2026-03-19 12:53:11.886572 | controller | 2026-03-19 12:53:11.886672 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:11.886765 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.025) 0:00:01.723 ******** 2026-03-19 12:53:11.911670 | controller | ok: [instance] 2026-03-19 12:53:11.911747 | controller | 2026-03-19 12:53:11.911854 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:11.911950 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.025) 0:00:01.748 ******** 2026-03-19 12:53:11.936054 | controller | ok: [instance] => 2026-03-19 12:53:11.936193 | controller | msg: 'Running: Volume, no worker' 2026-03-19 12:53:11.936311 | controller | 2026-03-19 12:53:11.936325 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:11.977584 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.024) 0:00:01.772 ******** 2026-03-19 12:53:11.977606 | controller | 2026-03-19 12:53:11.977657 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-19 12:53:11.977764 | controller | Thursday 19 March 2026 12:53:11 +0000 (0:00:00.041) 0:00:01.814 ******** 2026-03-19 12:53:12.033815 | controller | ok: [instance] 2026-03-19 12:53:12.033884 | controller | 2026-03-19 12:53:12.033979 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-19 12:53:12.034071 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.056) 0:00:01.870 ******** 2026-03-19 12:53:12.073444 | controller | ok: [instance] 2026-03-19 12:53:12.073545 | controller | 2026-03-19 12:53:12.073677 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-19 12:53:12.073790 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.039) 0:00:01.910 ******** 2026-03-19 12:53:12.142793 | controller | ok: [instance] 2026-03-19 12:53:12.143071 | controller | 2026-03-19 12:53:12.183701 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-19 12:53:12.183740 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.069) 0:00:01.979 ******** 2026-03-19 12:53:12.183753 | controller | skipping: [instance] 2026-03-19 12:53:12.183802 | controller | 2026-03-19 12:53:12.183901 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-19 12:53:12.184000 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.040) 0:00:02.020 ******** 2026-03-19 12:53:12.226110 | controller | skipping: [instance] 2026-03-19 12:53:12.226202 | controller | 2026-03-19 12:53:12.226303 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-19 12:53:12.226395 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.042) 0:00:02.063 ******** 2026-03-19 12:53:12.269486 | controller | ok: [instance] 2026-03-19 12:53:12.269586 | controller | 2026-03-19 12:53:12.269690 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-19 12:53:12.269790 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.043) 0:00:02.106 ******** 2026-03-19 12:53:12.357428 | controller | skipping: [instance] 2026-03-19 12:53:12.357480 | controller | 2026-03-19 12:53:12.357592 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-19 12:53:12.357681 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.087) 0:00:02.194 ******** 2026-03-19 12:53:12.423028 | controller | ok: [instance] 2026-03-19 12:53:12.423459 | controller | 2026-03-19 12:53:12.488468 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2026-03-19 12:53:12.488492 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.065) 0:00:02.259 ******** 2026-03-19 12:53:12.488509 | controller | ok: [instance] 2026-03-19 12:53:12.488560 | controller | 2026-03-19 12:53:12.488668 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2026-03-19 12:53:12.488763 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.065) 0:00:02.325 ******** 2026-03-19 12:53:12.556726 | controller | ok: [instance] => changed=false 2026-03-19 12:53:12.556817 | controller | msg: All assertions passed 2026-03-19 12:53:12.556903 | controller | 2026-03-19 12:53:12.557004 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2026-03-19 12:53:12.557089 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.068) 0:00:02.393 ******** 2026-03-19 12:53:12.634399 | controller | ok: [instance] => changed=false 2026-03-19 12:53:12.634656 | controller | msg: All assertions passed 2026-03-19 12:53:12.634851 | controller | 2026-03-19 12:53:12.634862 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:12.634872 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.077) 0:00:02.471 ******** 2026-03-19 12:53:12.669580 | controller | skipping: [instance] 2026-03-19 12:53:12.669669 | controller | 2026-03-19 12:53:12.669768 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:12.669863 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.035) 0:00:02.506 ******** 2026-03-19 12:53:12.700668 | controller | skipping: [instance] 2026-03-19 12:53:12.700745 | controller | 2026-03-19 12:53:12.700841 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:12.700934 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.031) 0:00:02.537 ******** 2026-03-19 12:53:12.736217 | controller | skipping: [instance] 2026-03-19 12:53:12.736546 | controller | 2026-03-19 12:53:12.758103 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:12.758126 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.035) 0:00:02.573 ******** 2026-03-19 12:53:12.758138 | controller | ok: [instance] 2026-03-19 12:53:12.758190 | controller | 2026-03-19 12:53:12.758285 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:12.758392 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.021) 0:00:02.595 ******** 2026-03-19 12:53:12.783955 | controller | ok: [instance] 2026-03-19 12:53:12.784039 | controller | 2026-03-19 12:53:12.784137 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:12.784228 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.025) 0:00:02.621 ******** 2026-03-19 12:53:12.808193 | controller | ok: [instance] => 2026-03-19 12:53:12.808432 | controller | msg: 'Running: Volume, with worker' 2026-03-19 12:53:12.808529 | controller | 2026-03-19 12:53:12.808642 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:12.808728 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.023) 0:00:02.645 ******** 2026-03-19 12:53:12.855570 | controller | 2026-03-19 12:53:12.855682 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-19 12:53:12.855779 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.047) 0:00:02.692 ******** 2026-03-19 12:53:12.912411 | controller | ok: [instance] 2026-03-19 12:53:12.912498 | controller | 2026-03-19 12:53:12.912619 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-19 12:53:12.912799 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.056) 0:00:02.749 ******** 2026-03-19 12:53:12.954494 | controller | ok: [instance] 2026-03-19 12:53:12.954608 | controller | 2026-03-19 12:53:12.954690 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-19 12:53:12.954812 | controller | Thursday 19 March 2026 12:53:12 +0000 (0:00:00.042) 0:00:02.791 ******** 2026-03-19 12:53:13.024901 | controller | ok: [instance] 2026-03-19 12:53:13.024989 | controller | 2026-03-19 12:53:13.025096 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-19 12:53:13.025203 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.070) 0:00:02.861 ******** 2026-03-19 12:53:13.092793 | controller | ok: [instance] 2026-03-19 12:53:13.092886 | controller | 2026-03-19 12:53:13.092993 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-19 12:53:13.093090 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.067) 0:00:02.929 ******** 2026-03-19 12:53:13.135026 | controller | skipping: [instance] 2026-03-19 12:53:13.135108 | controller | 2026-03-19 12:53:13.135233 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-19 12:53:13.135324 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.042) 0:00:02.971 ******** 2026-03-19 12:53:13.180115 | controller | ok: [instance] 2026-03-19 12:53:13.180224 | controller | 2026-03-19 12:53:13.180340 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-19 12:53:13.180437 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.045) 0:00:03.017 ******** 2026-03-19 12:53:13.232818 | controller | ok: [instance] 2026-03-19 12:53:13.232899 | controller | 2026-03-19 12:53:13.232994 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-19 12:53:13.233102 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.052) 0:00:03.069 ******** 2026-03-19 12:53:13.297008 | controller | ok: [instance] 2026-03-19 12:53:13.297092 | controller | 2026-03-19 12:53:13.297191 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2026-03-19 12:53:13.297286 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.064) 0:00:03.134 ******** 2026-03-19 12:53:13.408902 | controller | ok: [instance] 2026-03-19 12:53:13.408966 | controller | 2026-03-19 12:53:13.409063 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2026-03-19 12:53:13.409156 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.111) 0:00:03.245 ******** 2026-03-19 12:53:13.476651 | controller | ok: [instance] => changed=false 2026-03-19 12:53:13.476755 | controller | msg: All assertions passed 2026-03-19 12:53:13.476859 | controller | 2026-03-19 12:53:13.476946 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2026-03-19 12:53:13.477043 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.067) 0:00:03.313 ******** 2026-03-19 12:53:13.557967 | controller | ok: [instance] => changed=false 2026-03-19 12:53:13.558054 | controller | msg: All assertions passed 2026-03-19 12:53:13.558149 | controller | 2026-03-19 12:53:13.558264 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:13.558367 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.081) 0:00:03.395 ******** 2026-03-19 12:53:13.594510 | controller | skipping: [instance] 2026-03-19 12:53:13.594626 | controller | 2026-03-19 12:53:13.594750 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:13.594875 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.036) 0:00:03.431 ******** 2026-03-19 12:53:13.628225 | controller | skipping: [instance] 2026-03-19 12:53:13.628305 | controller | 2026-03-19 12:53:13.628410 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:13.628520 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.033) 0:00:03.464 ******** 2026-03-19 12:53:13.660389 | controller | skipping: [instance] 2026-03-19 12:53:13.660469 | controller | 2026-03-19 12:53:13.660578 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:13.660682 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.032) 0:00:03.497 ******** 2026-03-19 12:53:13.681592 | controller | ok: [instance] 2026-03-19 12:53:13.681676 | controller | 2026-03-19 12:53:13.681771 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:13.681865 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.021) 0:00:03.518 ******** 2026-03-19 12:53:13.706713 | controller | ok: [instance] 2026-03-19 12:53:13.706787 | controller | 2026-03-19 12:53:13.706891 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:13.706982 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.024) 0:00:03.543 ******** 2026-03-19 12:53:13.740982 | controller | ok: [instance] => 2026-03-19 12:53:13.741103 | controller | msg: 'Running: Too many allocated volumes' 2026-03-19 12:53:13.741220 | controller | 2026-03-19 12:53:13.741336 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:13.741467 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.033) 0:00:03.577 ******** 2026-03-19 12:53:13.785721 | controller | 2026-03-19 12:53:13.785824 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-19 12:53:13.785942 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.045) 0:00:03.622 ******** 2026-03-19 12:53:13.843589 | controller | ok: [instance] 2026-03-19 12:53:13.843704 | controller | 2026-03-19 12:53:13.843822 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-19 12:53:13.843931 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.057) 0:00:03.680 ******** 2026-03-19 12:53:13.885129 | controller | ok: [instance] 2026-03-19 12:53:13.885227 | controller | 2026-03-19 12:53:13.885327 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-19 12:53:13.885433 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.041) 0:00:03.722 ******** 2026-03-19 12:53:13.954401 | controller | ok: [instance] 2026-03-19 12:53:13.954494 | controller | 2026-03-19 12:53:13.954596 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-19 12:53:13.954705 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.069) 0:00:03.791 ******** 2026-03-19 12:53:13.994300 | controller | skipping: [instance] 2026-03-19 12:53:13.994413 | controller | 2026-03-19 12:53:13.994543 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-19 12:53:13.994678 | controller | Thursday 19 March 2026 12:53:13 +0000 (0:00:00.039) 0:00:03.830 ******** 2026-03-19 12:53:14.037186 | controller | skipping: [instance] 2026-03-19 12:53:14.037290 | controller | 2026-03-19 12:53:14.037411 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-19 12:53:14.037512 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.043) 0:00:03.874 ******** 2026-03-19 12:53:14.086401 | controller | ok: [instance] 2026-03-19 12:53:14.086500 | controller | 2026-03-19 12:53:14.086606 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-19 12:53:14.086702 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.049) 0:00:03.923 ******** 2026-03-19 12:53:14.127905 | controller | skipping: [instance] 2026-03-19 12:53:14.128006 | controller | 2026-03-19 12:53:14.128115 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-19 12:53:14.128244 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.041) 0:00:03.964 ******** 2026-03-19 12:53:14.183922 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:14.184006 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2026-03-19 12:53:14.184098 | controller | evaluated_to: false 2026-03-19 12:53:14.184366 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 3' 2026-03-19 12:53:14.211953 | controller | 2026-03-19 12:53:14.212034 | controller | TASK [Clear host errors] ******************************************************* 2026-03-19 12:53:14.212125 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.066) 0:00:04.031 ******** 2026-03-19 12:53:14.212208 | controller | 2026-03-19 12:53:14.212296 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:14.212391 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.017) 0:00:04.049 ******** 2026-03-19 12:53:14.232980 | controller | ok: [instance] 2026-03-19 12:53:14.233065 | controller | 2026-03-19 12:53:14.233201 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:14.233300 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.020) 0:00:04.069 ******** 2026-03-19 12:53:14.269098 | controller | skipping: [instance] 2026-03-19 12:53:14.269190 | controller | 2026-03-19 12:53:14.269278 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:14.269365 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.036) 0:00:04.106 ******** 2026-03-19 12:53:14.335898 | controller | skipping: [instance] 2026-03-19 12:53:14.335981 | controller | 2026-03-19 12:53:14.336075 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:14.336193 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.066) 0:00:04.172 ******** 2026-03-19 12:53:14.367453 | controller | skipping: [instance] 2026-03-19 12:53:14.389727 | controller | 2026-03-19 12:53:14.389750 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:14.389765 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.031) 0:00:04.204 ******** 2026-03-19 12:53:14.389775 | controller | ok: [instance] 2026-03-19 12:53:14.389792 | controller | 2026-03-19 12:53:14.389900 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:14.389992 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.022) 0:00:04.226 ******** 2026-03-19 12:53:14.414163 | controller | ok: [instance] 2026-03-19 12:53:14.414282 | controller | 2026-03-19 12:53:14.414489 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:14.414512 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.024) 0:00:04.251 ******** 2026-03-19 12:53:14.441319 | controller | ok: [instance] => 2026-03-19 12:53:14.441419 | controller | msg: 'Running: Different volume amount' 2026-03-19 12:53:14.441523 | controller | 2026-03-19 12:53:14.441627 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:14.441757 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.027) 0:00:04.278 ******** 2026-03-19 12:53:14.481712 | controller | 2026-03-19 12:53:14.481846 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-19 12:53:14.481977 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.040) 0:00:04.318 ******** 2026-03-19 12:53:14.537679 | controller | ok: [instance] 2026-03-19 12:53:14.537757 | controller | 2026-03-19 12:53:14.537851 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-19 12:53:14.537962 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.056) 0:00:04.374 ******** 2026-03-19 12:53:14.580124 | controller | ok: [instance] 2026-03-19 12:53:14.580219 | controller | 2026-03-19 12:53:14.580324 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-19 12:53:14.580423 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.042) 0:00:04.417 ******** 2026-03-19 12:53:14.652667 | controller | ok: [instance] 2026-03-19 12:53:14.652760 | controller | 2026-03-19 12:53:14.652868 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-19 12:53:14.652954 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.072) 0:00:04.489 ******** 2026-03-19 12:53:14.729734 | controller | ok: [instance] 2026-03-19 12:53:14.729819 | controller | 2026-03-19 12:53:14.729913 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-19 12:53:14.730010 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.077) 0:00:04.566 ******** 2026-03-19 12:53:14.775356 | controller | skipping: [instance] 2026-03-19 12:53:14.775470 | controller | 2026-03-19 12:53:14.775580 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-19 12:53:14.775686 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.045) 0:00:04.612 ******** 2026-03-19 12:53:14.821595 | controller | ok: [instance] 2026-03-19 12:53:14.821689 | controller | 2026-03-19 12:53:14.821791 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-19 12:53:14.822469 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.046) 0:00:04.658 ******** 2026-03-19 12:53:14.864839 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:14.864922 | controller | assertion: (_work.extra_disks_num is defined and _ocp.extra_disks_num == _work.extra_disks_num and _ocp.extra_disks_size is defined and _work.extra_disks_size is defined and _ocp.extra_disks_size == _work.extra_disks_size) or _ocp.extra_disks_num is undefined or _ocp.extra_disks_num == 0 2026-03-19 12:53:14.865012 | controller | evaluated_to: false 2026-03-19 12:53:14.865272 | controller | msg: 'Inconsistency detected: ensure you don''t allocate more disks in cifmw_lvms_disk_list and cifmw_devscripts_cinder_volume_pvs than available.' 2026-03-19 12:53:14.892389 | controller | 2026-03-19 12:53:14.892446 | controller | TASK [Clear host errors] ******************************************************* 2026-03-19 12:53:14.892547 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.053) 0:00:04.712 ******** 2026-03-19 12:53:14.892676 | controller | 2026-03-19 12:53:14.892735 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:14.892839 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.016) 0:00:04.728 ******** 2026-03-19 12:53:14.919254 | controller | ok: [instance] 2026-03-19 12:53:14.919632 | controller | 2026-03-19 12:53:14.919757 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:14.919848 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.025) 0:00:04.754 ******** 2026-03-19 12:53:14.958348 | controller | skipping: [instance] 2026-03-19 12:53:14.958387 | controller | 2026-03-19 12:53:14.958401 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:14.958511 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.040) 0:00:04.794 ******** 2026-03-19 12:53:14.989241 | controller | skipping: [instance] 2026-03-19 12:53:14.989323 | controller | 2026-03-19 12:53:14.989445 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:14.989540 | controller | Thursday 19 March 2026 12:53:14 +0000 (0:00:00.031) 0:00:04.826 ******** 2026-03-19 12:53:15.022231 | controller | skipping: [instance] 2026-03-19 12:53:15.022300 | controller | 2026-03-19 12:53:15.022420 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:15.022535 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.033) 0:00:04.859 ******** 2026-03-19 12:53:15.046511 | controller | ok: [instance] 2026-03-19 12:53:15.046579 | controller | 2026-03-19 12:53:15.046678 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:15.046778 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.024) 0:00:04.883 ******** 2026-03-19 12:53:15.071830 | controller | ok: [instance] 2026-03-19 12:53:15.071894 | controller | 2026-03-19 12:53:15.071990 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:15.072091 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.025) 0:00:04.908 ******** 2026-03-19 12:53:15.096962 | controller | ok: [instance] => 2026-03-19 12:53:15.097035 | controller | msg: 'Running: Create LVM without volume' 2026-03-19 12:53:15.097129 | controller | 2026-03-19 12:53:15.097250 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:15.097348 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.024) 0:00:04.933 ******** 2026-03-19 12:53:15.162796 | controller | 2026-03-19 12:53:15.162870 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-19 12:53:15.162969 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.065) 0:00:04.999 ******** 2026-03-19 12:53:15.220559 | controller | ok: [instance] 2026-03-19 12:53:15.220611 | controller | 2026-03-19 12:53:15.220751 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-19 12:53:15.220829 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.057) 0:00:05.057 ******** 2026-03-19 12:53:15.264086 | controller | ok: [instance] 2026-03-19 12:53:15.264214 | controller | 2026-03-19 12:53:15.264267 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-19 12:53:15.264359 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.043) 0:00:05.100 ******** 2026-03-19 12:53:15.338805 | controller | ok: [instance] 2026-03-19 12:53:15.339002 | controller | 2026-03-19 12:53:15.339097 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-19 12:53:15.339133 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.074) 0:00:05.175 ******** 2026-03-19 12:53:15.380877 | controller | skipping: [instance] 2026-03-19 12:53:15.380956 | controller | 2026-03-19 12:53:15.381065 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-19 12:53:15.381157 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.042) 0:00:05.217 ******** 2026-03-19 12:53:15.415234 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:15.415331 | controller | assertion: not cifmw_devscripts_create_logical_volume | bool 2026-03-19 12:53:15.415464 | controller | evaluated_to: false 2026-03-19 12:53:15.415558 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2026-03-19 12:53:15.448393 | controller | 2026-03-19 12:53:15.448499 | controller | TASK [Clear host errors] ******************************************************* 2026-03-19 12:53:15.448604 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.045) 0:00:05.263 ******** 2026-03-19 12:53:15.448694 | controller | 2026-03-19 12:53:15.448787 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:15.448901 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.021) 0:00:05.284 ******** 2026-03-19 12:53:15.474795 | controller | ok: [instance] 2026-03-19 12:53:15.474875 | controller | 2026-03-19 12:53:15.474968 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:15.475057 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.026) 0:00:05.311 ******** 2026-03-19 12:53:15.510227 | controller | skipping: [instance] 2026-03-19 12:53:15.510402 | controller | 2026-03-19 12:53:15.510533 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:15.510544 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.035) 0:00:05.347 ******** 2026-03-19 12:53:15.541739 | controller | skipping: [instance] 2026-03-19 12:53:15.541815 | controller | 2026-03-19 12:53:15.541911 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:15.542004 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.031) 0:00:05.378 ******** 2026-03-19 12:53:15.576444 | controller | skipping: [instance] 2026-03-19 12:53:15.576577 | controller | 2026-03-19 12:53:15.576710 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:15.576830 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.034) 0:00:05.413 ******** 2026-03-19 12:53:15.597618 | controller | ok: [instance] 2026-03-19 12:53:15.597723 | controller | 2026-03-19 12:53:15.597876 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:15.597975 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.021) 0:00:05.434 ******** 2026-03-19 12:53:15.624632 | controller | ok: [instance] 2026-03-19 12:53:15.624703 | controller | 2026-03-19 12:53:15.624802 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:15.624900 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.026) 0:00:05.461 ******** 2026-03-19 12:53:15.649278 | controller | ok: [instance] => 2026-03-19 12:53:15.649304 | controller | msg: 'Running: Create LVMS without volume' 2026-03-19 12:53:15.649314 | controller | 2026-03-19 12:53:15.649486 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:15.649506 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.024) 0:00:05.486 ******** 2026-03-19 12:53:15.690773 | controller | 2026-03-19 12:53:15.690882 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-19 12:53:15.690964 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.041) 0:00:05.527 ******** 2026-03-19 12:53:15.750629 | controller | ok: [instance] 2026-03-19 12:53:15.750719 | controller | 2026-03-19 12:53:15.750818 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-19 12:53:15.750912 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.059) 0:00:05.587 ******** 2026-03-19 12:53:15.792842 | controller | ok: [instance] 2026-03-19 12:53:15.792941 | controller | 2026-03-19 12:53:15.793042 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-19 12:53:15.793151 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.042) 0:00:05.629 ******** 2026-03-19 12:53:15.861821 | controller | ok: [instance] 2026-03-19 12:53:15.861879 | controller | 2026-03-19 12:53:15.861961 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-19 12:53:15.862053 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.068) 0:00:05.698 ******** 2026-03-19 12:53:15.901562 | controller | skipping: [instance] 2026-03-19 12:53:15.901647 | controller | 2026-03-19 12:53:15.901750 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-19 12:53:15.901844 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.039) 0:00:05.738 ******** 2026-03-19 12:53:15.944077 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:15.944227 | controller | assertion: cifmw_lvms_disk_list is undefined or (cifmw_lvms_disk_list | length) == 0 2026-03-19 12:53:15.944274 | controller | evaluated_to: false 2026-03-19 12:53:15.944390 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2026-03-19 12:53:15.971286 | controller | 2026-03-19 12:53:15.971366 | controller | TASK [Clear host errors] ******************************************************* 2026-03-19 12:53:15.971497 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.054) 0:00:05.792 ******** 2026-03-19 12:53:15.971591 | controller | 2026-03-19 12:53:15.971685 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:15.971777 | controller | Thursday 19 March 2026 12:53:15 +0000 (0:00:00.015) 0:00:05.808 ******** 2026-03-19 12:53:16.020805 | controller | ok: [instance] 2026-03-19 12:53:16.020883 | controller | 2026-03-19 12:53:16.020978 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:16.021071 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.049) 0:00:05.857 ******** 2026-03-19 12:53:16.056955 | controller | skipping: [instance] 2026-03-19 12:53:16.057037 | controller | 2026-03-19 12:53:16.057134 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:16.057230 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.036) 0:00:05.893 ******** 2026-03-19 12:53:16.091334 | controller | skipping: [instance] 2026-03-19 12:53:16.091430 | controller | 2026-03-19 12:53:16.091531 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:16.091630 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.034) 0:00:05.928 ******** 2026-03-19 12:53:16.125032 | controller | skipping: [instance] 2026-03-19 12:53:16.125108 | controller | 2026-03-19 12:53:16.125210 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:16.125316 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.033) 0:00:05.962 ******** 2026-03-19 12:53:16.149987 | controller | ok: [instance] 2026-03-19 12:53:16.175744 | controller | 2026-03-19 12:53:16.175770 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:16.175779 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.024) 0:00:05.986 ******** 2026-03-19 12:53:16.175789 | controller | ok: [instance] 2026-03-19 12:53:16.200236 | controller | 2026-03-19 12:53:16.200259 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:16.200273 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.025) 0:00:06.012 ******** 2026-03-19 12:53:16.200283 | controller | ok: [instance] => 2026-03-19 12:53:16.200365 | controller | msg: 'Running: Allocate same volume twice' 2026-03-19 12:53:16.200486 | controller | 2026-03-19 12:53:16.200607 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:16.200876 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.024) 0:00:06.037 ******** 2026-03-19 12:53:16.246973 | controller | 2026-03-19 12:53:16.247065 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-19 12:53:16.247169 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.046) 0:00:06.084 ******** 2026-03-19 12:53:16.304677 | controller | ok: [instance] 2026-03-19 12:53:16.304812 | controller | 2026-03-19 12:53:16.304852 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-19 12:53:16.304971 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.057) 0:00:06.141 ******** 2026-03-19 12:53:16.349784 | controller | ok: [instance] 2026-03-19 12:53:16.349860 | controller | 2026-03-19 12:53:16.349953 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-19 12:53:16.350052 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.045) 0:00:06.186 ******** 2026-03-19 12:53:16.424239 | controller | ok: [instance] 2026-03-19 12:53:16.424320 | controller | 2026-03-19 12:53:16.424471 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-19 12:53:16.424587 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.074) 0:00:06.260 ******** 2026-03-19 12:53:16.464672 | controller | skipping: [instance] 2026-03-19 12:53:16.464751 | controller | 2026-03-19 12:53:16.464849 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-19 12:53:16.464944 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.040) 0:00:06.301 ******** 2026-03-19 12:53:16.508564 | controller | skipping: [instance] 2026-03-19 12:53:16.508656 | controller | 2026-03-19 12:53:16.508756 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-19 12:53:16.508851 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.043) 0:00:06.345 ******** 2026-03-19 12:53:16.554603 | controller | ok: [instance] 2026-03-19 12:53:16.554689 | controller | 2026-03-19 12:53:16.554785 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-19 12:53:16.554879 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.046) 0:00:06.391 ******** 2026-03-19 12:53:16.598419 | controller | skipping: [instance] 2026-03-19 12:53:16.598486 | controller | 2026-03-19 12:53:16.598557 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-19 12:53:16.598674 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.043) 0:00:06.435 ******** 2026-03-19 12:53:16.654438 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:16.654524 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2026-03-19 12:53:16.654634 | controller | evaluated_to: false 2026-03-19 12:53:16.654739 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 4' 2026-03-19 12:53:16.681465 | controller | 2026-03-19 12:53:16.681569 | controller | TASK [Clear host errors] ******************************************************* 2026-03-19 12:53:16.681694 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.066) 0:00:06.501 ******** 2026-03-19 12:53:16.681806 | controller | 2026-03-19 12:53:16.681907 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:16.681996 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.016) 0:00:06.518 ******** 2026-03-19 12:53:16.703180 | controller | ok: [instance] 2026-03-19 12:53:16.703276 | controller | 2026-03-19 12:53:16.703397 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:16.703494 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.021) 0:00:06.540 ******** 2026-03-19 12:53:16.738086 | controller | skipping: [instance] 2026-03-19 12:53:16.738174 | controller | 2026-03-19 12:53:16.738311 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:16.738446 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.034) 0:00:06.575 ******** 2026-03-19 12:53:16.770851 | controller | skipping: [instance] 2026-03-19 12:53:16.770967 | controller | 2026-03-19 12:53:16.771082 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:16.771181 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.031) 0:00:06.606 ******** 2026-03-19 12:53:16.804813 | controller | skipping: [instance] 2026-03-19 12:53:16.804917 | controller | 2026-03-19 12:53:16.805042 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:16.805159 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.034) 0:00:06.641 ******** 2026-03-19 12:53:16.827040 | controller | ok: [instance] 2026-03-19 12:53:16.827387 | controller | 2026-03-19 12:53:16.827496 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:16.827802 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.021) 0:00:06.663 ******** 2026-03-19 12:53:16.880586 | controller | ok: [instance] 2026-03-19 12:53:16.880711 | controller | 2026-03-19 12:53:16.880832 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:16.880964 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.053) 0:00:06.717 ******** 2026-03-19 12:53:16.906635 | controller | ok: [instance] => 2026-03-19 12:53:16.906764 | controller | msg: 'Running: Allocate same volume twice - no LVMS' 2026-03-19 12:53:16.906860 | controller | 2026-03-19 12:53:16.906976 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:16.907076 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.026) 0:00:06.743 ******** 2026-03-19 12:53:16.948062 | controller | 2026-03-19 12:53:16.948183 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-19 12:53:16.948302 | controller | Thursday 19 March 2026 12:53:16 +0000 (0:00:00.041) 0:00:06.784 ******** 2026-03-19 12:53:17.005911 | controller | ok: [instance] 2026-03-19 12:53:17.006027 | controller | 2026-03-19 12:53:17.006161 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-19 12:53:17.006289 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.057) 0:00:06.842 ******** 2026-03-19 12:53:17.046476 | controller | ok: [instance] 2026-03-19 12:53:17.046564 | controller | 2026-03-19 12:53:17.046675 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-19 12:53:17.046771 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.040) 0:00:06.883 ******** 2026-03-19 12:53:17.115746 | controller | ok: [instance] 2026-03-19 12:53:17.115822 | controller | 2026-03-19 12:53:17.115920 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-19 12:53:17.116012 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.069) 0:00:06.952 ******** 2026-03-19 12:53:17.155552 | controller | skipping: [instance] 2026-03-19 12:53:17.155645 | controller | 2026-03-19 12:53:17.155756 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-19 12:53:17.155863 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.039) 0:00:06.992 ******** 2026-03-19 12:53:17.198082 | controller | skipping: [instance] 2026-03-19 12:53:17.198160 | controller | 2026-03-19 12:53:17.198258 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-19 12:53:17.198353 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.042) 0:00:07.035 ******** 2026-03-19 12:53:17.246893 | controller | ok: [instance] 2026-03-19 12:53:17.246970 | controller | 2026-03-19 12:53:17.247068 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-19 12:53:17.247178 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.048) 0:00:07.083 ******** 2026-03-19 12:53:17.289536 | controller | skipping: [instance] 2026-03-19 12:53:17.289626 | controller | 2026-03-19 12:53:17.289729 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-19 12:53:17.289827 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.042) 0:00:07.126 ******** 2026-03-19 12:53:17.355068 | controller | ok: [instance] 2026-03-19 12:53:17.355156 | controller | 2026-03-19 12:53:17.355276 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2026-03-19 12:53:17.355362 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.065) 0:00:07.192 ******** 2026-03-19 12:53:17.407457 | controller | skipping: [instance] 2026-03-19 12:53:17.407547 | controller | 2026-03-19 12:53:17.407660 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2026-03-19 12:53:17.407809 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.052) 0:00:07.244 ******** 2026-03-19 12:53:17.474877 | controller | ok: [instance] => changed=false 2026-03-19 12:53:17.474970 | controller | msg: All assertions passed 2026-03-19 12:53:17.475058 | controller | 2026-03-19 12:53:17.475152 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2026-03-19 12:53:17.475279 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.067) 0:00:07.311 ******** 2026-03-19 12:53:17.555965 | controller | ok: [instance] => changed=false 2026-03-19 12:53:17.556042 | controller | msg: All assertions passed 2026-03-19 12:53:17.556137 | controller | 2026-03-19 12:53:17.556261 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:17.556341 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.081) 0:00:07.392 ******** 2026-03-19 12:53:17.590648 | controller | skipping: [instance] 2026-03-19 12:53:17.590705 | controller | 2026-03-19 12:53:17.590811 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:17.590909 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.034) 0:00:07.427 ******** 2026-03-19 12:53:17.625491 | controller | skipping: [instance] 2026-03-19 12:53:17.625571 | controller | 2026-03-19 12:53:17.625676 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:17.625776 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.034) 0:00:07.462 ******** 2026-03-19 12:53:17.659606 | controller | skipping: [instance] 2026-03-19 12:53:17.659683 | controller | 2026-03-19 12:53:17.659780 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:17.659902 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.034) 0:00:07.496 ******** 2026-03-19 12:53:17.691175 | controller | ok: [instance] 2026-03-19 12:53:17.691283 | controller | 2026-03-19 12:53:17.691396 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:17.691499 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.031) 0:00:07.528 ******** 2026-03-19 12:53:17.724137 | controller | ok: [instance] 2026-03-19 12:53:17.724237 | controller | 2026-03-19 12:53:17.724312 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:17.724446 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.032) 0:00:07.560 ******** 2026-03-19 12:53:17.757653 | controller | ok: [instance] => 2026-03-19 12:53:17.757754 | controller | msg: 'Running: Allocate same volume twice - no cinder_lvm' 2026-03-19 12:53:17.757843 | controller | 2026-03-19 12:53:17.757929 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:17.758023 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.033) 0:00:07.594 ******** 2026-03-19 12:53:17.838162 | controller | 2026-03-19 12:53:17.838277 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-19 12:53:17.838386 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.080) 0:00:07.675 ******** 2026-03-19 12:53:17.901466 | controller | ok: [instance] 2026-03-19 12:53:17.901550 | controller | 2026-03-19 12:53:17.901663 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-19 12:53:17.901769 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.063) 0:00:07.738 ******** 2026-03-19 12:53:17.952846 | controller | ok: [instance] 2026-03-19 12:53:17.952940 | controller | 2026-03-19 12:53:17.953034 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-19 12:53:17.953112 | controller | Thursday 19 March 2026 12:53:17 +0000 (0:00:00.051) 0:00:07.789 ******** 2026-03-19 12:53:18.028570 | controller | ok: [instance] 2026-03-19 12:53:18.028674 | controller | 2026-03-19 12:53:18.028759 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-19 12:53:18.028862 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.075) 0:00:07.865 ******** 2026-03-19 12:53:18.070775 | controller | skipping: [instance] 2026-03-19 12:53:18.070849 | controller | 2026-03-19 12:53:18.070950 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-19 12:53:18.071042 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.042) 0:00:07.907 ******** 2026-03-19 12:53:18.118180 | controller | skipping: [instance] 2026-03-19 12:53:18.118258 | controller | 2026-03-19 12:53:18.118354 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-19 12:53:18.118484 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.046) 0:00:07.954 ******** 2026-03-19 12:53:18.171208 | controller | ok: [instance] 2026-03-19 12:53:18.171290 | controller | 2026-03-19 12:53:18.171406 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-19 12:53:18.171505 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.053) 0:00:08.007 ******** 2026-03-19 12:53:18.225806 | controller | skipping: [instance] 2026-03-19 12:53:18.225856 | controller | 2026-03-19 12:53:18.225976 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-19 12:53:18.226072 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.054) 0:00:08.062 ******** 2026-03-19 12:53:18.306122 | controller | ok: [instance] 2026-03-19 12:53:18.306183 | controller | 2026-03-19 12:53:18.306288 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2026-03-19 12:53:18.306370 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.080) 0:00:08.142 ******** 2026-03-19 12:53:18.366628 | controller | skipping: [instance] 2026-03-19 12:53:18.366688 | controller | 2026-03-19 12:53:18.366795 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2026-03-19 12:53:18.366897 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.060) 0:00:08.203 ******** 2026-03-19 12:53:18.451295 | controller | ok: [instance] => changed=false 2026-03-19 12:53:18.451356 | controller | msg: All assertions passed 2026-03-19 12:53:18.451449 | controller | 2026-03-19 12:53:18.451544 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2026-03-19 12:53:18.451646 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.084) 0:00:08.288 ******** 2026-03-19 12:53:18.526115 | controller | skipping: [instance] 2026-03-19 12:53:18.526253 | controller | 2026-03-19 12:53:18.526277 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:18.526665 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.074) 0:00:08.362 ******** 2026-03-19 12:53:18.573344 | controller | skipping: [instance] 2026-03-19 12:53:18.573455 | controller | 2026-03-19 12:53:18.573557 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:18.573650 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.047) 0:00:08.410 ******** 2026-03-19 12:53:18.612045 | controller | skipping: [instance] 2026-03-19 12:53:18.612104 | controller | 2026-03-19 12:53:18.612208 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:18.612300 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.038) 0:00:08.449 ******** 2026-03-19 12:53:18.647036 | controller | skipping: [instance] 2026-03-19 12:53:18.647115 | controller | 2026-03-19 12:53:18.647248 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:18.647349 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.034) 0:00:08.484 ******** 2026-03-19 12:53:18.672398 | controller | ok: [instance] 2026-03-19 12:53:18.672483 | controller | 2026-03-19 12:53:18.672575 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:18.672676 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.025) 0:00:08.509 ******** 2026-03-19 12:53:18.702486 | controller | ok: [instance] 2026-03-19 12:53:18.702577 | controller | 2026-03-19 12:53:18.702687 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:18.702771 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.030) 0:00:08.539 ******** 2026-03-19 12:53:18.738995 | controller | ok: [instance] => 2026-03-19 12:53:18.739086 | controller | msg: 'Running: Config overrides via devscripts' 2026-03-19 12:53:18.739187 | controller | 2026-03-19 12:53:18.739272 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:18.739365 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.036) 0:00:08.575 ******** 2026-03-19 12:53:18.789607 | controller | 2026-03-19 12:53:18.789739 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-19 12:53:18.789851 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.050) 0:00:08.626 ******** 2026-03-19 12:53:18.824337 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:18.824433 | controller | assertion: cifmw_devscripts_config.master_memory is undefined 2026-03-19 12:53:18.824525 | controller | evaluated_to: false 2026-03-19 12:53:18.824651 | controller | msg: 'Inconsistency detected: your environment wants to provide devscripts configuration overrides. This isn''t supported, and you must pass those ressource allocation via the usual cifmw_libvirt_manager_configuration, or patch it.' 2026-03-19 12:53:18.852691 | controller | 2026-03-19 12:53:18.852807 | controller | TASK [Clear host errors] ******************************************************* 2026-03-19 12:53:18.852928 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.046) 0:00:08.673 ******** 2026-03-19 12:53:18.853028 | controller | 2026-03-19 12:53:18.853122 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:18.853272 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.016) 0:00:08.689 ******** 2026-03-19 12:53:18.920487 | controller | ok: [instance] 2026-03-19 12:53:18.920534 | controller | 2026-03-19 12:53:18.920659 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:18.920754 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.067) 0:00:08.757 ******** 2026-03-19 12:53:18.959007 | controller | skipping: [instance] 2026-03-19 12:53:18.959083 | controller | 2026-03-19 12:53:18.959190 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:18.959304 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.038) 0:00:08.795 ******** 2026-03-19 12:53:18.996289 | controller | skipping: [instance] 2026-03-19 12:53:18.996350 | controller | 2026-03-19 12:53:18.996436 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:18.996524 | controller | Thursday 19 March 2026 12:53:18 +0000 (0:00:00.037) 0:00:08.833 ******** 2026-03-19 12:53:19.032396 | controller | skipping: [instance] 2026-03-19 12:53:19.032495 | controller | 2026-03-19 12:53:19.032609 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:19.032710 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.036) 0:00:08.869 ******** 2026-03-19 12:53:19.055668 | controller | ok: [instance] 2026-03-19 12:53:19.055745 | controller | 2026-03-19 12:53:19.055852 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:19.055934 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.023) 0:00:08.892 ******** 2026-03-19 12:53:19.086880 | controller | ok: [instance] 2026-03-19 12:53:19.086959 | controller | 2026-03-19 12:53:19.087073 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:19.087156 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.031) 0:00:08.923 ******** 2026-03-19 12:53:19.116694 | controller | ok: [instance] => 2026-03-19 12:53:19.117058 | controller | msg: 'Running: Inject 10 dev-scripts extra_worker' 2026-03-19 12:53:19.117194 | controller | 2026-03-19 12:53:19.117275 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:19.117394 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.029) 0:00:08.953 ******** 2026-03-19 12:53:19.171242 | controller | 2026-03-19 12:53:19.171342 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-19 12:53:19.171449 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.054) 0:00:09.007 ******** 2026-03-19 12:53:19.234926 | controller | ok: [instance] 2026-03-19 12:53:19.235015 | controller | 2026-03-19 12:53:19.235209 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-19 12:53:19.235306 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.063) 0:00:09.071 ******** 2026-03-19 12:53:19.270973 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-19 12:53:19.270999 | controller | assertion: cifmw_devscripts_config.num_extra_workers is undefined or cifmw_devscripts_config.num_extra_workers == 0 2026-03-19 12:53:19.271113 | controller | evaluated_to: false 2026-03-19 12:53:19.271313 | controller | msg: 'Inconsistency detected: dev-scripts extra_worker resources aren''t supported here. You can create compute, networker or any other kind of VM by defining it as you define OCP cluster nodes.' 2026-03-19 12:53:19.299843 | controller | 2026-03-19 12:53:19.299971 | controller | TASK [Clear host errors] ******************************************************* 2026-03-19 12:53:19.300099 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.049) 0:00:09.120 ******** 2026-03-19 12:53:19.300217 | controller | 2026-03-19 12:53:19.300470 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:19.300605 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.015) 0:00:09.136 ******** 2026-03-19 12:53:19.324933 | controller | ok: [instance] 2026-03-19 12:53:19.325008 | controller | 2026-03-19 12:53:19.325098 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:19.325200 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.024) 0:00:09.161 ******** 2026-03-19 12:53:19.364928 | controller | skipping: [instance] 2026-03-19 12:53:19.365007 | controller | 2026-03-19 12:53:19.365103 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:19.365235 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.039) 0:00:09.201 ******** 2026-03-19 12:53:19.402629 | controller | skipping: [instance] 2026-03-19 12:53:19.402743 | controller | 2026-03-19 12:53:19.402870 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:19.403000 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.037) 0:00:09.239 ******** 2026-03-19 12:53:19.437881 | controller | skipping: [instance] 2026-03-19 12:53:19.437962 | controller | 2026-03-19 12:53:19.438061 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-19 12:53:19.438159 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.035) 0:00:09.274 ******** 2026-03-19 12:53:19.463526 | controller | ok: [instance] 2026-03-19 12:53:19.463612 | controller | 2026-03-19 12:53:19.463708 | controller | TASK [Load environment file] *************************************************** 2026-03-19 12:53:19.463827 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.025) 0:00:09.300 ******** 2026-03-19 12:53:19.498351 | controller | ok: [instance] 2026-03-19 12:53:19.498477 | controller | 2026-03-19 12:53:19.498616 | controller | TASK [Output scenario name] **************************************************** 2026-03-19 12:53:19.498748 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.034) 0:00:09.335 ******** 2026-03-19 12:53:19.526477 | controller | ok: [instance] => 2026-03-19 12:53:19.526569 | controller | msg: 'Running: Inject 0 dev-scripts extra_worker' 2026-03-19 12:53:19.526664 | controller | 2026-03-19 12:53:19.526776 | controller | TASK [Validate data] *********************************************************** 2026-03-19 12:53:19.526846 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.028) 0:00:09.363 ******** 2026-03-19 12:53:19.573122 | controller | 2026-03-19 12:53:19.573223 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-19 12:53:19.573341 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.046) 0:00:09.410 ******** 2026-03-19 12:53:19.636305 | controller | ok: [instance] 2026-03-19 12:53:19.636360 | controller | 2026-03-19 12:53:19.636506 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-19 12:53:19.636721 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.062) 0:00:09.472 ******** 2026-03-19 12:53:19.681300 | controller | ok: [instance] 2026-03-19 12:53:19.681360 | controller | 2026-03-19 12:53:19.681497 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-19 12:53:19.681589 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.045) 0:00:09.518 ******** 2026-03-19 12:53:19.836416 | controller | ok: [instance] 2026-03-19 12:53:19.836466 | controller | 2026-03-19 12:53:19.836633 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-19 12:53:19.836663 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.155) 0:00:09.673 ******** 2026-03-19 12:53:19.881203 | controller | skipping: [instance] 2026-03-19 12:53:19.881308 | controller | 2026-03-19 12:53:19.881471 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-19 12:53:19.881611 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.044) 0:00:09.717 ******** 2026-03-19 12:53:19.936632 | controller | ok: [instance] 2026-03-19 12:53:19.936707 | controller | 2026-03-19 12:53:19.936803 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-19 12:53:19.936905 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.055) 0:00:09.773 ******** 2026-03-19 12:53:19.979054 | controller | skipping: [instance] 2026-03-19 12:53:19.979131 | controller | 2026-03-19 12:53:19.979240 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-19 12:53:19.979333 | controller | Thursday 19 March 2026 12:53:19 +0000 (0:00:00.042) 0:00:09.815 ******** 2026-03-19 12:53:20.025262 | controller | skipping: [instance] 2026-03-19 12:53:20.025573 | controller | 2026-03-19 12:53:20.025586 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-19 12:53:20.025596 | controller | Thursday 19 March 2026 12:53:20 +0000 (0:00:00.045) 0:00:09.861 ******** 2026-03-19 12:53:20.070164 | controller | skipping: [instance] 2026-03-19 12:53:20.070805 | controller | 2026-03-19 12:53:20.071131 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2026-03-19 12:53:20.071225 | controller | Thursday 19 March 2026 12:53:20 +0000 (0:00:00.044) 0:00:09.906 ******** 2026-03-19 12:53:20.120148 | controller | skipping: [instance] 2026-03-19 12:53:20.120265 | controller | 2026-03-19 12:53:20.120422 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2026-03-19 12:53:20.120526 | controller | Thursday 19 March 2026 12:53:20 +0000 (0:00:00.049) 0:00:09.956 ******** 2026-03-19 12:53:20.173503 | controller | skipping: [instance] 2026-03-19 12:53:20.173577 | controller | 2026-03-19 12:53:20.173686 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2026-03-19 12:53:20.173792 | controller | Thursday 19 March 2026 12:53:20 +0000 (0:00:00.053) 0:00:10.010 ******** 2026-03-19 12:53:20.231974 | controller | skipping: [instance] 2026-03-19 12:53:20.232059 | controller | 2026-03-19 12:53:20.232253 | controller | TASK [Mark failure] ************************************************************ 2026-03-19 12:53:20.273962 | controller | Thursday 19 March 2026 12:53:20 +0000 (0:00:00.058) 0:00:10.068 ******** 2026-03-19 12:53:20.273997 | controller | skipping: [instance] 2026-03-19 12:53:20.274059 | controller | 2026-03-19 12:53:20.274157 | controller | TASK [Display error message] *************************************************** 2026-03-19 12:53:20.274264 | controller | Thursday 19 March 2026 12:53:20 +0000 (0:00:00.042) 0:00:10.110 ******** 2026-03-19 12:53:20.308728 | controller | skipping: [instance] 2026-03-19 12:53:20.308844 | controller | 2026-03-19 12:53:20.308946 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-19 12:53:20.309242 | controller | Thursday 19 March 2026 12:53:20 +0000 (0:00:00.034) 0:00:10.145 ******** 2026-03-19 12:53:20.346421 | controller | skipping: [instance] 2026-03-19 12:53:20.346468 | controller | 2026-03-19 12:53:20.346575 | controller | TASK [Fail if needed] ********************************************************** 2026-03-19 12:53:20.346672 | controller | Thursday 19 March 2026 12:53:20 +0000 (0:00:00.037) 0:00:10.183 ******** 2026-03-19 12:53:20.408256 | controller | skipping: [instance] 2026-03-19 12:53:20.408338 | controller | 2026-03-19 12:53:20.408451 | controller | PLAY RECAP ********************************************************************* 2026-03-19 12:53:20.408552 | controller | instance : ok=129 changed=0 unreachable=0 failed=0 skipped=85 rescued=7 ignored=0 2026-03-19 12:53:20.408649 | controller | 2026-03-19 12:53:20.408745 | controller | Thursday 19 March 2026 12:53:20 +0000 (0:00:00.061) 0:00:10.244 ******** 2026-03-19 12:53:20.408831 | controller | =============================================================================== 2026-03-19 12:53:20.408918 | controller | reproducer : Ensure we get required data in the layout description ------ 0.16s 2026-03-19 12:53:20.409013 | controller | reproducer : Ensure no allocation overlap ------------------------------- 0.11s 2026-03-19 12:53:20.409094 | controller | Test no volumes --------------------------------------------------------- 0.10s 2026-03-19 12:53:20.409181 | controller | reproducer : Ensure we get required data in the layout description ------ 0.09s 2026-03-19 12:53:20.409267 | controller | reproducer : Ensure same amount of disks are created -------------------- 0.09s 2026-03-19 12:53:20.409355 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.08s 2026-03-19 12:53:20.409481 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2026-03-19 12:53:20.409565 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2026-03-19 12:53:20.409688 | controller | Validate data ----------------------------------------------------------- 0.08s 2026-03-19 12:53:20.409753 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.08s 2026-03-19 12:53:20.409841 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2026-03-19 12:53:20.409927 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.08s 2026-03-19 12:53:20.410017 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2026-03-19 12:53:20.410102 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2026-03-19 12:53:20.410188 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2026-03-19 12:53:20.410278 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.07s 2026-03-19 12:53:20.410363 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2026-03-19 12:53:20.410488 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2026-03-19 12:53:20.410575 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.07s 2026-03-19 12:53:20.410709 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2026-03-19 12:53:20.497966 | controller | INFO Running ocp_validations > cleanup 2026-03-19 12:53:20.498338 | controller | WARNING Skipping, cleanup playbook not configured. 2026-03-19 12:53:20.498975 | controller | INFO Writing /tmp/report.html report. 2026-03-19 12:53:20.990177 | [controller] Waiting on logger 2026-03-19 12:53:26.133844 | [controller] Waiting on logger 2026-03-19 12:53:36.565714 | [controller] Waiting on logger 2026-03-19 12:53:46.997775 | [controller] Waiting on logger 2026-03-19 12:53:50.650723 | [Zuul] Log Stream did not terminate 2026-03-19 12:53:50.650968 | controller | changed 2026-03-19 12:53:50.710283 | 2026-03-19 12:53:50.710352 | PLAY RECAP 2026-03-19 12:53:50.710400 | controller | ok: 4 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-19 12:53:50.710423 | 2026-03-19 12:53:50.763453 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-03-19 12:53:50.764197 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-03-19 12:53:51.282758 | 2026-03-19 12:53:51.282856 | PLAY [Run ci/playbooks/collect-logs.yml] 2026-03-19 12:53:51.302922 | 2026-03-19 12:53:51.302997 | TASK [Filter out host if needed] 2026-03-19 12:53:51.311409 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2026-03-19 12:53:51.316093 | 2026-03-19 12:53:51.316160 | TASK [Ensure file is present] 2026-03-19 12:53:51.883289 | controller | ok 2026-03-19 12:53:51.888851 | 2026-03-19 12:53:51.888919 | TASK [Manage molecule report file] 2026-03-19 12:53:51.909942 | [controller] Waiting on logger 2026-03-19 12:54:01.269842 | [controller] Waiting on logger 2026-03-19 12:54:11.701740 | [controller] Waiting on logger 2026-03-19 12:54:21.082228 | [controller] Waiting on logger 2026-03-19 12:54:22.486179 | [Zuul] Log Stream did not terminate 2026-03-19 12:54:22.486450 | controller | changed 2026-03-19 12:54:22.491764 | 2026-03-19 12:54:22.491831 | TASK [Check if we get ci-framework-data basedir] 2026-03-19 12:54:22.895022 | controller | ok 2026-03-19 12:54:22.899939 | 2026-03-19 12:54:22.900001 | TASK [Create ci-framework-data log directory for zuul] 2026-03-19 12:54:23.426158 | controller | changed 2026-03-19 12:54:23.431096 | 2026-03-19 12:54:23.431161 | TASK [Copy ci-framework interesting files] 2026-03-19 12:54:24.501739 | [controller] Waiting on logger 2026-03-19 12:54:30.760914 | controller | changed 2026-03-19 12:54:30.766099 | 2026-03-19 12:54:30.766164 | TASK [Get SELinux listing] 2026-03-19 12:54:33.525783 | [controller] Waiting on logger 2026-03-19 12:54:35.791559 | controller | changed 2026-03-19 12:54:35.797029 | 2026-03-19 12:54:35.797106 | TASK [Generate log index] 2026-03-19 12:54:37.236984 | controller | changed 2026-03-19 12:54:37.241722 | 2026-03-19 12:54:37.241789 | TASK [Get some env related data] 2026-03-19 12:54:40.374178 | [controller] Waiting on logger 2026-03-19 12:54:47.002376 | [controller] Waiting on logger 2026-03-19 12:54:59.034590 | [controller] Waiting on logger 2026-03-19 12:55:08.725821 | [controller] Waiting on logger 2026-03-19 12:55:09.117665 | [Zuul] Log Stream did not terminate 2026-03-19 12:55:09.117845 | controller | changed 2026-03-19 12:55:09.122766 | 2026-03-19 12:55:09.122827 | TASK [Generate list of logs to collect in home directory] 2026-03-19 12:55:09.638383 | controller | ok: All paths examined 2026-03-19 12:55:09.643720 | 2026-03-19 12:55:09.643784 | LOOP [Copy logs from home directory] 2026-03-19 12:55:10.715532 | controller | changed: 2026-03-19 12:55:10.715730 | controller | { 2026-03-19 12:55:10.715758 | controller | "atime": 1773350327.2786021, 2026-03-19 12:55:10.715777 | controller | "ctime": 1773351461.47114, 2026-03-19 12:55:10.715794 | controller | "dev": 64513, 2026-03-19 12:55:10.715810 | controller | "gid": 1000, 2026-03-19 12:55:10.715825 | controller | "gr_name": "zuul", 2026-03-19 12:55:10.715839 | controller | "inode": 6822, 2026-03-19 12:55:10.715854 | controller | "isblk": false, 2026-03-19 12:55:10.715869 | controller | "ischr": false, 2026-03-19 12:55:10.715883 | controller | "isdir": false, 2026-03-19 12:55:10.715900 | controller | "isfifo": false, 2026-03-19 12:55:10.715915 | controller | "isgid": false, 2026-03-19 12:55:10.715929 | controller | "islnk": false, 2026-03-19 12:55:10.715943 | controller | "isreg": true, 2026-03-19 12:55:10.715957 | controller | "issock": false, 2026-03-19 12:55:10.715970 | controller | "isuid": false, 2026-03-19 12:55:10.715984 | controller | "mode": "0644", 2026-03-19 12:55:10.715997 | controller | "mtime": 1773351461.47114, 2026-03-19 12:55:10.716013 | controller | "nlink": 1, 2026-03-19 12:55:10.716027 | controller | "path": "/home/zuul/crc-setup.log", 2026-03-19 12:55:10.716041 | controller | "pw_name": "zuul", 2026-03-19 12:55:10.716055 | controller | "rgrp": true, 2026-03-19 12:55:10.716068 | controller | "roth": true, 2026-03-19 12:55:10.716082 | controller | "rusr": true, 2026-03-19 12:55:10.716096 | controller | "size": 4108, 2026-03-19 12:55:10.716110 | controller | "uid": 1000, 2026-03-19 12:55:10.716124 | controller | "wgrp": false, 2026-03-19 12:55:10.716137 | controller | "woth": false, 2026-03-19 12:55:10.716150 | controller | "wusr": true, 2026-03-19 12:55:10.716164 | controller | "xgrp": false, 2026-03-19 12:55:10.716179 | controller | "xoth": false, 2026-03-19 12:55:10.716193 | controller | "xusr": false 2026-03-19 12:55:10.716207 | controller | } 2026-03-19 12:55:12.056999 | controller | changed: 2026-03-19 12:55:12.057084 | controller | { 2026-03-19 12:55:12.057109 | controller | "atime": 1773351463.1371913, 2026-03-19 12:55:12.057128 | controller | "ctime": 1773352236.2951868, 2026-03-19 12:55:12.057145 | controller | "dev": 64513, 2026-03-19 12:55:12.057160 | controller | "gid": 1000, 2026-03-19 12:55:12.057175 | controller | "gr_name": "zuul", 2026-03-19 12:55:12.057189 | controller | "inode": 6833, 2026-03-19 12:55:12.057204 | controller | "isblk": false, 2026-03-19 12:55:12.057218 | controller | "ischr": false, 2026-03-19 12:55:12.057232 | controller | "isdir": false, 2026-03-19 12:55:12.057247 | controller | "isfifo": false, 2026-03-19 12:55:12.057278 | controller | "isgid": false, 2026-03-19 12:55:12.057302 | controller | "islnk": false, 2026-03-19 12:55:12.057318 | controller | "isreg": true, 2026-03-19 12:55:12.057332 | controller | "issock": false, 2026-03-19 12:55:12.057346 | controller | "isuid": false, 2026-03-19 12:55:12.057368 | controller | "mode": "0644", 2026-03-19 12:55:12.057384 | controller | "mtime": 1773352236.2951868, 2026-03-19 12:55:12.057404 | controller | "nlink": 1, 2026-03-19 12:55:12.057419 | controller | "path": "/home/zuul/crc-start.log", 2026-03-19 12:55:12.057434 | controller | "pw_name": "zuul", 2026-03-19 12:55:12.057448 | controller | "rgrp": true, 2026-03-19 12:55:12.057461 | controller | "roth": true, 2026-03-19 12:55:12.057475 | controller | "rusr": true, 2026-03-19 12:55:12.057488 | controller | "size": 4527, 2026-03-19 12:55:12.057501 | controller | "uid": 1000, 2026-03-19 12:55:12.057514 | controller | "wgrp": false, 2026-03-19 12:55:12.057527 | controller | "woth": false, 2026-03-19 12:55:12.057540 | controller | "wusr": true, 2026-03-19 12:55:12.057553 | controller | "xgrp": false, 2026-03-19 12:55:12.057566 | controller | "xoth": false, 2026-03-19 12:55:12.057579 | controller | "xusr": false 2026-03-19 12:55:12.057592 | controller | } 2026-03-19 12:55:13.266340 | controller | changed: 2026-03-19 12:55:13.266436 | controller | { 2026-03-19 12:55:13.266463 | controller | "atime": 1773924228.9871874, 2026-03-19 12:55:13.266482 | controller | "ctime": 1773924244.7757385, 2026-03-19 12:55:13.266498 | controller | "dev": 64513, 2026-03-19 12:55:13.266513 | controller | "gid": 1000, 2026-03-19 12:55:13.266527 | controller | "gr_name": "zuul", 2026-03-19 12:55:13.266541 | controller | "inode": 1426514, 2026-03-19 12:55:13.266555 | controller | "isblk": false, 2026-03-19 12:55:13.266569 | controller | "ischr": false, 2026-03-19 12:55:13.266584 | controller | "isdir": false, 2026-03-19 12:55:13.266598 | controller | "isfifo": false, 2026-03-19 12:55:13.266613 | controller | "isgid": false, 2026-03-19 12:55:13.266627 | controller | "islnk": false, 2026-03-19 12:55:13.266644 | controller | "isreg": true, 2026-03-19 12:55:13.266658 | controller | "issock": false, 2026-03-19 12:55:13.266672 | controller | "isuid": false, 2026-03-19 12:55:13.266685 | controller | "mode": "0644", 2026-03-19 12:55:13.266698 | controller | "mtime": 1773924244.7757385, 2026-03-19 12:55:13.266711 | controller | "nlink": 1, 2026-03-19 12:55:13.266761 | controller | "path": "/home/zuul/ansible.log", 2026-03-19 12:55:13.266789 | controller | "pw_name": "zuul", 2026-03-19 12:55:13.266808 | controller | "rgrp": true, 2026-03-19 12:55:13.266823 | controller | "roth": true, 2026-03-19 12:55:13.266837 | controller | "rusr": true, 2026-03-19 12:55:13.266851 | controller | "size": 6749, 2026-03-19 12:55:13.266865 | controller | "uid": 1000, 2026-03-19 12:55:13.266879 | controller | "wgrp": false, 2026-03-19 12:55:13.266892 | controller | "woth": false, 2026-03-19 12:55:13.266906 | controller | "wusr": true, 2026-03-19 12:55:13.266920 | controller | "xgrp": false, 2026-03-19 12:55:13.266934 | controller | "xoth": false, 2026-03-19 12:55:13.266947 | controller | "xusr": false 2026-03-19 12:55:13.266960 | controller | } 2026-03-19 12:55:13.275467 | 2026-03-19 12:55:13.275535 | TASK [Copy crio stats log file] 2026-03-19 12:55:13.288974 | controller | skipping: Conditional result was False 2026-03-19 12:55:13.294036 | 2026-03-19 12:55:13.294107 | TASK [Get SELinux related data] 2026-03-19 12:55:16.405997 | [controller] Waiting on logger 2026-03-19 12:55:21.717988 | [controller] Waiting on logger 2026-03-19 12:55:32.533867 | [controller] Waiting on logger 2026-03-19 12:55:39.126054 | [controller] Waiting on logger 2026-03-19 12:55:43.777995 | [Zuul] Log Stream did not terminate 2026-03-19 12:55:43.778230 | controller | ERROR 2026-03-19 12:55:43.778376 | controller | { 2026-03-19 12:55:43.778414 | controller | "delta": "0:00:00.010515", 2026-03-19 12:55:43.778439 | controller | "end": "2026-03-19 12:55:13.754344", 2026-03-19 12:55:43.778460 | controller | "msg": "non-zero return code", 2026-03-19 12:55:43.778479 | controller | "rc": 1, 2026-03-19 12:55:43.778497 | controller | "start": "2026-03-19 12:55:13.743829" 2026-03-19 12:55:43.778514 | controller | } 2026-03-19 12:55:43.778540 | controller | ERROR: Ignoring Errors 2026-03-19 12:55:43.783673 | 2026-03-19 12:55:43.783735 | TASK [Create system configuration directory] 2026-03-19 12:55:44.228069 | controller | changed 2026-03-19 12:55:44.233124 | 2026-03-19 12:55:44.233188 | TASK [Get some of the system configurations] 2026-03-19 12:55:44.253157 | [controller] Waiting on logger 2026-03-19 12:55:54.677956 | [controller] Waiting on logger 2026-03-19 12:56:04.058585 | [controller] Waiting on logger 2026-03-19 12:56:14.453817 | [controller] Waiting on logger 2026-03-19 12:56:14.605739 | [Zuul] Log Stream did not terminate 2026-03-19 12:56:14.605932 | controller | changed 2026-03-19 12:56:14.611085 | 2026-03-19 12:56:14.611155 | TASK [Copy generated documentation if available] 2026-03-19 12:56:14.624315 | controller | skipping: Conditional result was False 2026-03-19 12:56:14.629539 | 2026-03-19 12:56:14.629602 | TASK [Copy generated AsciiDoc documentation if available] 2026-03-19 12:56:14.643225 | controller | skipping: Conditional result was False 2026-03-19 12:56:14.648283 | 2026-03-19 12:56:14.648345 | TASK [Compress logs bigger than 2MB] 2026-03-19 12:56:17.717821 | [controller] Waiting on logger 2026-03-19 12:56:31.066828 | [controller] Waiting on logger 2026-03-19 12:56:33.833141 | controller | changed 2026-03-19 12:56:33.838233 | 2026-03-19 12:56:33.838315 | TASK [Copy files from workspace on node] 2026-03-19 12:56:33.855760 | controller | ok 2026-03-19 12:56:33.877732 | 2026-03-19 12:56:33.877801 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-19 12:56:33.890384 | controller | skipping: Conditional result was False 2026-03-19 12:56:33.895470 | 2026-03-19 12:56:33.895539 | TASK [fetch-output : Set log path for single node] 2026-03-19 12:56:33.922694 | controller | ok 2026-03-19 12:56:33.927353 | 2026-03-19 12:56:33.927428 | LOOP [fetch-output : Ensure local output dirs] 2026-03-19 12:56:34.115192 | controller -> localhost | ok: "/var/lib/zuul/builds/5820d139e9b0497ab73bcf6b4c79d223/work/logs" 2026-03-19 12:56:34.115441 | controller -> localhost | changed: All items complete 2026-03-19 12:56:34.115473 | 2026-03-19 12:56:34.292114 | controller -> localhost | changed: "/var/lib/zuul/builds/5820d139e9b0497ab73bcf6b4c79d223/work/artifacts" 2026-03-19 12:56:34.466679 | controller -> localhost | changed: "/var/lib/zuul/builds/5820d139e9b0497ab73bcf6b4c79d223/work/docs" 2026-03-19 12:56:34.483165 | 2026-03-19 12:56:34.483242 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-19 12:56:35.151092 | controller | changed: 2026-03-19 12:56:35.151255 | controller | .d..t...... ./ 2026-03-19 12:56:35.151355 | controller | >f+++++++++ README.html 2026-03-19 12:56:35.151395 | controller | >f+++++++++ ansible-execution.log 2026-03-19 12:56:35.151417 | controller | >f+++++++++ ansible.log 2026-03-19 12:56:35.151437 | controller | >f+++++++++ crc-setup.log 2026-03-19 12:56:35.151455 | controller | >f+++++++++ crc-start.log 2026-03-19 12:56:35.151472 | controller | >f+++++++++ dmesg.log 2026-03-19 12:56:35.151488 | controller | >f+++++++++ installed-pkgs.log 2026-03-19 12:56:35.151504 | controller | >f+++++++++ python.log 2026-03-19 12:56:35.151520 | controller | >f+++++++++ registries.conf 2026-03-19 12:56:35.151535 | controller | >f+++++++++ report.html 2026-03-19 12:56:35.151550 | controller | >f+++++++++ selinux-denials.log 2026-03-19 12:56:35.151565 | controller | >f+++++++++ selinux-listing.log 2026-03-19 12:56:35.151580 | controller | cd+++++++++ ci-framework-data/ 2026-03-19 12:56:35.151595 | controller | cd+++++++++ ci-framework-data/artifacts/ 2026-03-19 12:56:35.151610 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2026-03-19 12:56:35.151624 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2026-03-19 12:56:35.151639 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2026-03-19 12:56:35.151653 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2026-03-19 12:56:35.151668 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2026-03-19 12:56:35.151683 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2026-03-19 12:56:35.151705 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2026-03-19 12:56:35.151722 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2026-03-19 12:56:35.151738 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2026-03-19 12:56:35.151752 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2026-03-19 12:56:35.151766 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2026-03-19 12:56:35.151782 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2026-03-19 12:56:35.151798 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2026-03-19 12:56:35.151812 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:d6:36:a4 2026-03-19 12:56:35.151827 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:47:aa:4a 2026-03-19 12:56:35.151843 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:71:c0:4a 2026-03-19 12:56:35.151858 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:ed:0e:95 2026-03-19 12:56:35.151873 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:13:a8:c6 2026-03-19 12:56:35.151888 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:77:6e:bf 2026-03-19 12:56:35.151902 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2026-03-19 12:56:35.151917 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2026-03-19 12:56:35.151931 | controller | cd+++++++++ ci-framework-data/logs/ 2026-03-19 12:56:35.151946 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2026-03-19 12:56:35.151960 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2026-03-19 12:56:35.151975 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2026-03-19 12:56:35.151989 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2026-03-19 12:56:35.152004 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2026-03-19 12:56:35.152019 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2026-03-19 12:56:35.152034 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2026-03-19 12:56:35.152048 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2026-03-19 12:56:35.152062 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2026-03-19 12:56:35.152076 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2026-03-19 12:56:35.152093 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2026-03-19 12:56:35.152108 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2026-03-19 12:56:35.152123 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2026-03-19 12:56:35.152137 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2026-03-19 12:56:35.152151 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2026-03-19 12:56:35.152166 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2026-03-19 12:56:35.152181 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2026-03-19 12:56:35.152199 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2026-03-19 12:56:35.152214 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2026-03-19 12:56:35.152230 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2026-03-19 12:56:35.152244 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2026-03-19 12:56:35.152259 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2026-03-19 12:56:35.152296 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2026-03-19 12:56:35.152316 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2026-03-19 12:56:35.152332 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2026-03-19 12:56:35.152347 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2026-03-19 12:56:35.152362 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2026-03-19 12:56:35.152392 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2026-03-19 12:56:35.152407 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2026-03-19 12:56:35.152422 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2026-03-19 12:56:35.152437 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2026-03-19 12:56:35.152452 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2026-03-19 12:56:35.152466 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2026-03-19 12:56:35.152481 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2026-03-19 12:56:35.152496 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2026-03-19 12:56:35.152510 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2026-03-19 12:56:35.152525 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2026-03-19 12:56:35.152540 | controller | cd+++++++++ registries.conf.d/ 2026-03-19 12:56:35.152554 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2026-03-19 12:56:35.152569 | controller | cd+++++++++ system-config/ 2026-03-19 12:56:35.152584 | controller | cd+++++++++ system-config/libvirt/ 2026-03-19 12:56:35.152598 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2026-03-19 12:56:35.152613 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2026-03-19 12:56:35.152627 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2026-03-19 12:56:35.152641 | controller | >f+++++++++ system-config/libvirt/network.conf 2026-03-19 12:56:35.152655 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2026-03-19 12:56:35.152668 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2026-03-19 12:56:35.152682 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2026-03-19 12:56:35.152696 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2026-03-19 12:56:35.152710 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2026-03-19 12:56:35.152725 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2026-03-19 12:56:35.152739 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2026-03-19 12:56:35.152753 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2026-03-19 12:56:35.152773 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2026-03-19 12:56:35.152788 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2026-03-19 12:56:35.152803 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2026-03-19 12:56:35.152818 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2026-03-19 12:56:35.625306 | controller | changed: .d..t...... ./ 2026-03-19 12:56:36.099050 | controller | changed: .d..t...... ./ 2026-03-19 12:56:36.120586 | 2026-03-19 12:56:36.120685 | TASK [Return artifact to Zuul] 2026-03-19 12:56:36.149523 | controller | ok 2026-03-19 12:56:36.168312 | 2026-03-19 12:56:36.168377 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2026-03-19 12:56:36.168480 | 2026-03-19 12:56:36.168509 | PLAY RECAP 2026-03-19 12:56:36.168548 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2026-03-19 12:56:36.168570 | 2026-03-19 12:56:36.245014 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-03-19 12:56:36.245964 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-03-19 12:56:36.735971 | 2026-03-19 12:56:36.736066 | PLAY [all] 2026-03-19 12:56:36.752998 | 2026-03-19 12:56:36.753064 | TASK [include_role : fetch-output] 2026-03-19 12:56:36.781283 | controller | ok 2026-03-19 12:56:36.797320 | 2026-03-19 12:56:36.797411 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-19 12:56:36.841402 | controller | skipping: Conditional result was False 2026-03-19 12:56:36.846698 | 2026-03-19 12:56:36.846766 | TASK [fetch-output : Set log path for single node] 2026-03-19 12:56:36.874922 | controller | ok 2026-03-19 12:56:36.879922 | 2026-03-19 12:56:36.879990 | LOOP [fetch-output : Ensure local output dirs] 2026-03-19 12:56:37.188943 | controller -> localhost | ok: "/var/lib/zuul/builds/5820d139e9b0497ab73bcf6b4c79d223/work/logs" 2026-03-19 12:56:37.368160 | controller -> localhost | ok: "/var/lib/zuul/builds/5820d139e9b0497ab73bcf6b4c79d223/work/artifacts" 2026-03-19 12:56:37.548760 | controller -> localhost | ok: "/var/lib/zuul/builds/5820d139e9b0497ab73bcf6b4c79d223/work/docs" 2026-03-19 12:56:37.558070 | 2026-03-19 12:56:37.558141 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-19 12:56:38.157767 | controller | ok 2026-03-19 12:56:38.157954 | controller | ok: All items complete 2026-03-19 12:56:38.157984 | 2026-03-19 12:56:38.638336 | controller | ok 2026-03-19 12:56:39.119284 | controller | ok 2026-03-19 12:56:39.133972 | 2026-03-19 12:56:39.134037 | TASK [include_role : fetch-output-openshift] 2026-03-19 12:56:39.147423 | controller | skipping: Conditional result was False 2026-03-19 12:56:39.152697 | 2026-03-19 12:56:39.152771 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-19 12:56:39.475922 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006019 2026-03-19 12:56:39.660784 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006143 2026-03-19 12:56:39.686826 | 2026-03-19 12:56:39.686889 | PLAY [all] 2026-03-19 12:56:39.700702 | 2026-03-19 12:56:39.700767 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-19 12:56:40.265095 | controller | changed 2026-03-19 12:56:40.286818 | 2026-03-19 12:56:40.286876 | PLAY RECAP 2026-03-19 12:56:40.286920 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-03-19 12:56:40.286942 | 2026-03-19 12:56:40.352881 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-03-19 12:56:40.353614 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2026-03-19 12:56:40.879770 | 2026-03-19 12:56:40.879905 | PLAY [localhost] 2026-03-19 12:56:40.896811 | 2026-03-19 12:56:40.896888 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-19 12:56:41.197215 | localhost | changed 2026-03-19 12:56:41.201523 | 2026-03-19 12:56:41.201601 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-19 12:56:41.219289 | localhost | ok 2026-03-19 12:56:41.227357 | 2026-03-19 12:56:41.227436 | TASK [add-fileserver : Create SSH private key tempfile] 2026-03-19 12:56:41.508586 | localhost | changed 2026-03-19 12:56:41.513892 | 2026-03-19 12:56:41.513963 | TASK [add-fileserver : Create SSH private key from secret] 2026-03-19 12:56:42.037256 | localhost | changed 2026-03-19 12:56:42.042169 | 2026-03-19 12:56:42.042237 | TASK [add-fileserver : Add fileserver ssh key] 2026-03-19 12:56:42.353565 | localhost | Identity added: /var/lib/zuul/builds/5820d139e9b0497ab73bcf6b4c79d223/work/tmp/ansible.fqdx57r4 (/var/lib/zuul/builds/5820d139e9b0497ab73bcf6b4c79d223/work/tmp/ansible.fqdx57r4) 2026-03-19 12:56:42.353711 | localhost | ok: Runtime: 0:00:00.005964 2026-03-19 12:56:42.357804 | 2026-03-19 12:56:42.357872 | TASK [add-fileserver : Remove SSH private key from disk] 2026-03-19 12:56:42.567254 | localhost | ok: Runtime: 0:00:00.004064 2026-03-19 12:56:42.571847 | 2026-03-19 12:56:42.571913 | TASK [add-fileserver : Add fileserver to inventory] 2026-03-19 12:56:42.619128 | localhost | changed 2026-03-19 12:56:42.623945 | 2026-03-19 12:56:42.624016 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-03-19 12:56:42.924430 | localhost | changed 2026-03-19 12:56:42.943698 | 2026-03-19 12:56:42.943763 | PLAY [localhost] 2026-03-19 12:56:42.954809 | 2026-03-19 12:56:42.954873 | TASK [Generate bulk log download script] 2026-03-19 12:56:42.972727 | localhost | ok 2026-03-19 12:56:42.983750 | 2026-03-19 12:56:42.983818 | TASK [local-log-download : Check API endpoint is defined] 2026-03-19 12:56:43.010989 | localhost | ok: All assertions passed 2026-03-19 12:56:43.015311 | 2026-03-19 12:56:43.015385 | TASK [local-log-download : Create download script] 2026-03-19 12:56:43.352443 | localhost -> localhost | changed 2026-03-19 12:56:43.361088 | 2026-03-19 12:56:43.361154 | TASK [Register quick-download link] 2026-03-19 12:56:43.378108 | localhost | ok 2026-03-19 12:56:43.409773 | 2026-03-19 12:56:43.409845 | PLAY [logserver.rdoproject.org] 2026-03-19 12:56:43.418989 | 2026-03-19 12:56:43.419049 | TASK [Set zuul-log-path fact] 2026-03-19 12:56:43.434625 | logserver.rdoproject.org | ok 2026-03-19 12:56:43.443079 | 2026-03-19 12:56:43.443144 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-19 12:56:43.459576 | logserver.rdoproject.org | ok 2026-03-19 12:56:43.464675 | 2026-03-19 12:56:43.464742 | TASK [upload-logs : Create log directories] 2026-03-19 12:56:45.188002 | logserver.rdoproject.org | changed 2026-03-19 12:56:45.190974 | 2026-03-19 12:56:45.191044 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-19 12:56:45.407251 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004812 2026-03-19 12:56:45.411765 | 2026-03-19 12:56:45.411829 | TASK [upload-logs : Upload logs to log server] 2026-03-19 12:56:46.958388 | logserver.rdoproject.org | Output suppressed because no_log was given 2026-03-19 12:56:46.961212 | 2026-03-19 12:56:46.961300 | LOOP [upload-logs : Compress console log and json output] 2026-03-19 12:56:46.998001 | logserver.rdoproject.org | skipping: Conditional result was False 2026-03-19 12:56:47.005873 | logserver.rdoproject.org | skipping: Conditional result was False 2026-03-19 12:56:47.018523 | 2026-03-19 12:56:47.018604 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-19 12:56:47.052430 | logserver.rdoproject.org | skipping: Conditional result was False 2026-03-19 12:56:47.052692 | 2026-03-19 12:56:47.055578 | logserver.rdoproject.org | skipping: Conditional result was False 2026-03-19 12:56:47.067326 | 2026-03-19 12:56:47.067415 | LOOP [upload-logs : Upload console log and json output]