2026-02-26 12:31:43.839883 | Job console starting... 2026-02-26 12:31:44.058929 | Updating repositories 2026-02-26 12:31:44.819499 | Preparing job workspace 2026-02-26 12:31:51.636230 | Running Ansible setup... 2026-02-26 12:31:55.130511 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-26 12:31:55.609207 | 2026-02-26 12:31:55.609325 | PLAY [localhost] 2026-02-26 12:31:55.617545 | 2026-02-26 12:31:55.617613 | TASK [Gathering Facts] 2026-02-26 12:31:56.384796 | localhost | ok 2026-02-26 12:31:56.396743 | 2026-02-26 12:31:56.396816 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-02-26 12:31:56.694648 | localhost -> localhost | changed 2026-02-26 12:31:56.700201 | 2026-02-26 12:31:56.700292 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-02-26 12:31:57.331087 | localhost -> localhost | changed 2026-02-26 12:31:57.339123 | 2026-02-26 12:31:57.339202 | TASK [Setup log path fact] 2026-02-26 12:31:57.356011 | localhost | ok 2026-02-26 12:31:57.366402 | 2026-02-26 12:31:57.366480 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-26 12:31:57.383763 | localhost | ok 2026-02-26 12:31:57.390529 | 2026-02-26 12:31:57.390593 | TASK [emit-job-header : Print job information] 2026-02-26 12:31:57.417052 | # Job Information 2026-02-26 12:31:57.417162 | Ansible Version: 2.15.12 2026-02-26 12:31:57.417190 | Job: cifmw-molecule-reproducer 2026-02-26 12:31:57.417210 | Pipeline: github-check 2026-02-26 12:31:57.417230 | Executor: ibm-bm4-ze.softwarefactory-project.io 2026-02-26 12:31:57.417249 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3678 2026-02-26 12:31:57.417268 | Log URL (when completed): https://logserver.rdoproject.org/542/rdoproject.org/5426286bcef34762bdc458d2eab94a52/ 2026-02-26 12:31:57.417285 | Event ID: d42d3b40-130e-11f1-8b84-91bad812e2cf 2026-02-26 12:31:57.420696 | 2026-02-26 12:31:57.420756 | LOOP [emit-job-header : Print node information] 2026-02-26 12:31:57.499331 | localhost | ok: 2026-02-26 12:31:57.499536 | localhost | # Node Information 2026-02-26 12:31:57.499566 | localhost | Inventory Hostname: controller 2026-02-26 12:31:57.499589 | localhost | Hostname: np0005631455 2026-02-26 12:31:57.499608 | localhost | Username: zuul 2026-02-26 12:31:57.499627 | localhost | Distro: CentOS 9 2026-02-26 12:31:57.499644 | localhost | Provider: ibm-bm4-nodepool 2026-02-26 12:31:57.499661 | localhost | Region: regionOne 2026-02-26 12:31:57.499676 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2026-02-26 12:31:57.499691 | localhost | Product Name: OpenStack Compute 2026-02-26 12:31:57.499706 | localhost | Interface IP: 192.168.26.208 2026-02-26 12:31:57.521889 | 2026-02-26 12:31:57.521957 | PLAY [all] 2026-02-26 12:31:57.527628 | 2026-02-26 12:31:57.527689 | TASK [Gather network facts] 2026-02-26 12:31:57.972904 | controller | ok 2026-02-26 12:31:57.986270 | 2026-02-26 12:31:57.986349 | TASK [include_role : start-zuul-console] 2026-02-26 12:31:58.004270 | controller | ok 2026-02-26 12:31:58.014341 | 2026-02-26 12:31:58.014400 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-02-26 12:31:58.386926 | controller | ok 2026-02-26 12:31:58.394732 | 2026-02-26 12:31:58.394791 | TASK [include_role : add-build-sshkey] 2026-02-26 12:31:58.412150 | controller | ok 2026-02-26 12:31:58.424175 | 2026-02-26 12:31:58.424240 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-02-26 12:31:58.599342 | controller -> localhost | ok 2026-02-26 12:31:58.604146 | 2026-02-26 12:31:58.604210 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-02-26 12:31:58.622757 | controller | ok 2026-02-26 12:31:58.634271 | controller | included: /var/lib/zuul/builds/5426286bcef34762bdc458d2eab94a52/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-26 12:31:58.639440 | 2026-02-26 12:31:58.639511 | TASK [add-build-sshkey : Create Temp SSH key] 2026-02-26 12:31:59.037763 | controller -> localhost | Generating public/private rsa key pair. 2026-02-26 12:31:59.037947 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/5426286bcef34762bdc458d2eab94a52/work/5426286bcef34762bdc458d2eab94a52_id_rsa. 2026-02-26 12:31:59.037980 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/5426286bcef34762bdc458d2eab94a52/work/5426286bcef34762bdc458d2eab94a52_id_rsa.pub. 2026-02-26 12:31:59.038004 | controller -> localhost | The key fingerprint is: 2026-02-26 12:31:59.038024 | controller -> localhost | SHA256:PLFMha+mnmEP7fE6fqPo7pwuo8GO4fcpHvKUoHm+5SU zuul-build-sshkey 2026-02-26 12:31:59.038044 | controller -> localhost | The key's randomart image is: 2026-02-26 12:31:59.038062 | controller -> localhost | +---[RSA 3072]----+ 2026-02-26 12:31:59.038079 | controller -> localhost | | .. | 2026-02-26 12:31:59.038096 | controller -> localhost | | .. | 2026-02-26 12:31:59.038112 | controller -> localhost | | o. | 2026-02-26 12:31:59.038129 | controller -> localhost | | + o. | 2026-02-26 12:31:59.038145 | controller -> localhost | | . S. | 2026-02-26 12:31:59.038160 | controller -> localhost | |.o. . .o. | 2026-02-26 12:31:59.038177 | controller -> localhost | |+.++E =oo | 2026-02-26 12:31:59.038197 | controller -> localhost | |.*+*+=oO.oo | 2026-02-26 12:31:59.038214 | controller -> localhost | |..B=+@@.*=.. | 2026-02-26 12:31:59.038230 | controller -> localhost | +----[SHA256]-----+ 2026-02-26 12:31:59.038279 | controller -> localhost | ok: Runtime: 0:00:00.084321 2026-02-26 12:31:59.043905 | 2026-02-26 12:31:59.043970 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-02-26 12:31:59.061532 | controller | ok 2026-02-26 12:31:59.070371 | controller | included: /var/lib/zuul/builds/5426286bcef34762bdc458d2eab94a52/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-26 12:31:59.077818 | 2026-02-26 12:31:59.077883 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-02-26 12:31:59.091126 | controller | skipping: Conditional result was False 2026-02-26 12:31:59.096171 | 2026-02-26 12:31:59.096235 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-02-26 12:31:59.563668 | controller | changed 2026-02-26 12:31:59.568315 | 2026-02-26 12:31:59.568385 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-02-26 12:31:59.830364 | controller | ok 2026-02-26 12:31:59.834709 | 2026-02-26 12:31:59.834769 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-02-26 12:32:01.032818 | controller | changed 2026-02-26 12:32:01.037368 | 2026-02-26 12:32:01.037431 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-02-26 12:32:02.232567 | controller | changed 2026-02-26 12:32:02.237218 | 2026-02-26 12:32:02.237282 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-02-26 12:32:02.250580 | controller | skipping: Conditional result was False 2026-02-26 12:32:02.255815 | 2026-02-26 12:32:02.255878 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-02-26 12:32:02.542253 | controller -> localhost | changed 2026-02-26 12:32:02.551248 | 2026-02-26 12:32:02.551330 | TASK [add-build-sshkey : Add back temp key] 2026-02-26 12:32:02.756578 | controller -> localhost | Identity added: /var/lib/zuul/builds/5426286bcef34762bdc458d2eab94a52/work/5426286bcef34762bdc458d2eab94a52_id_rsa (zuul-build-sshkey) 2026-02-26 12:32:02.756752 | controller -> localhost | ok: Runtime: 0:00:00.006025 2026-02-26 12:32:02.762085 | 2026-02-26 12:32:02.762144 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-02-26 12:32:03.107765 | controller | ok 2026-02-26 12:32:03.111755 | 2026-02-26 12:32:03.111815 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-02-26 12:32:03.135422 | controller | skipping: Conditional result was False 2026-02-26 12:32:03.143991 | 2026-02-26 12:32:03.144048 | TASK [include_role : validate-host] 2026-02-26 12:32:03.161490 | controller | ok 2026-02-26 12:32:03.178360 | 2026-02-26 12:32:03.178422 | TASK [validate-host : Define zuul_info_dir fact] 2026-02-26 12:32:03.206054 | controller | ok 2026-02-26 12:32:03.210088 | 2026-02-26 12:32:03.210145 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-02-26 12:32:03.395373 | controller -> localhost | ok 2026-02-26 12:32:03.400549 | 2026-02-26 12:32:03.400626 | TASK [validate-host : Collect information about the host] 2026-02-26 12:32:04.123243 | controller | ok 2026-02-26 12:32:04.130385 | 2026-02-26 12:32:04.130469 | TASK [validate-host : Sanitize hostname] 2026-02-26 12:32:04.167983 | controller | ok 2026-02-26 12:32:04.172579 | 2026-02-26 12:32:04.172639 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-02-26 12:32:04.510207 | controller -> localhost | changed 2026-02-26 12:32:04.515580 | 2026-02-26 12:32:04.515654 | TASK [validate-host : Collect information about zuul worker] 2026-02-26 12:32:04.919433 | controller | ok 2026-02-26 12:32:04.923988 | 2026-02-26 12:32:04.924053 | TASK [validate-host : Write out all zuul information for each host] 2026-02-26 12:32:05.251686 | controller -> localhost | changed 2026-02-26 12:32:05.260054 | 2026-02-26 12:32:05.260112 | TASK [include_role : prepare-workspace-openshift] 2026-02-26 12:32:05.272928 | controller | skipping: Conditional result was False 2026-02-26 12:32:05.277095 | 2026-02-26 12:32:05.277153 | TASK [include_role : remove-zuul-sshkey] 2026-02-26 12:32:05.310100 | controller | skipping: Conditional result was False 2026-02-26 12:32:05.316599 | 2026-02-26 12:32:05.316681 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-02-26 12:32:05.607209 | controller | ok: "logs" 2026-02-26 12:32:05.607437 | controller | ok: All items complete 2026-02-26 12:32:05.607474 | 2026-02-26 12:32:05.840929 | controller | ok: "artifacts" 2026-02-26 12:32:06.077670 | controller | ok: "docs" 2026-02-26 12:32:06.090061 | 2026-02-26 12:32:06.090169 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-02-26 12:32:06.354697 | controller | changed: "logs" 2026-02-26 12:32:06.605498 | controller | changed: "artifacts" 2026-02-26 12:32:06.849441 | controller | changed: "docs" 2026-02-26 12:32:06.872278 | 2026-02-26 12:32:06.872402 | PLAY RECAP 2026-02-26 12:32:06.872445 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-26 12:32:06.872484 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-26 12:32:06.872503 | 2026-02-26 12:32:06.943006 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-26 12:32:06.943675 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-26 12:32:07.446192 | 2026-02-26 12:32:07.446292 | PLAY [all] 2026-02-26 12:32:07.464500 | 2026-02-26 12:32:07.464577 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-26 12:32:07.512835 | controller | ok 2026-02-26 12:32:07.517328 | 2026-02-26 12:32:07.517400 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-26 12:32:07.912219 | controller | changed 2026-02-26 12:32:07.917348 | 2026-02-26 12:32:07.917420 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-26 12:32:09.168752 | controller | changed 2026-02-26 12:32:09.178155 | 2026-02-26 12:32:09.178221 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2026-02-26 12:32:09.633730 | controller | changed: 2026-02-26 12:32:09.633952 | controller | { 2026-02-26 12:32:09.633990 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2026-02-26 12:32:09.634021 | controller | } 2026-02-26 12:32:09.918928 | controller | changed: 2026-02-26 12:32:09.918986 | controller | { 2026-02-26 12:32:09.919014 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2026-02-26 12:32:09.919035 | controller | } 2026-02-26 12:32:10.200423 | controller | changed: 2026-02-26 12:32:10.200529 | controller | { 2026-02-26 12:32:10.200562 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2026-02-26 12:32:10.200587 | controller | } 2026-02-26 12:32:10.482756 | controller | changed: 2026-02-26 12:32:10.482814 | controller | { 2026-02-26 12:32:10.482840 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2026-02-26 12:32:10.482860 | controller | } 2026-02-26 12:32:10.758582 | controller | changed: 2026-02-26 12:32:10.758681 | controller | { 2026-02-26 12:32:10.758716 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2026-02-26 12:32:10.758737 | controller | } 2026-02-26 12:32:11.050876 | controller | changed: 2026-02-26 12:32:11.050952 | controller | { 2026-02-26 12:32:11.050976 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2026-02-26 12:32:11.050995 | controller | } 2026-02-26 12:32:11.342554 | controller | changed: 2026-02-26 12:32:11.342656 | controller | { 2026-02-26 12:32:11.342682 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2026-02-26 12:32:11.342700 | controller | } 2026-02-26 12:32:11.632277 | controller | changed: 2026-02-26 12:32:11.632433 | controller | { 2026-02-26 12:32:11.632479 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2026-02-26 12:32:11.632501 | controller | } 2026-02-26 12:32:11.921895 | controller | changed: 2026-02-26 12:32:11.921956 | controller | { 2026-02-26 12:32:11.921980 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2026-02-26 12:32:11.921998 | controller | } 2026-02-26 12:32:12.240513 | controller | changed: 2026-02-26 12:32:12.240592 | controller | { 2026-02-26 12:32:12.240616 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2026-02-26 12:32:12.240634 | controller | } 2026-02-26 12:32:12.511641 | controller | changed: 2026-02-26 12:32:12.511706 | controller | { 2026-02-26 12:32:12.511729 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2026-02-26 12:32:12.511747 | controller | } 2026-02-26 12:32:12.793106 | controller | changed: 2026-02-26 12:32:12.793195 | controller | { 2026-02-26 12:32:12.793221 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2026-02-26 12:32:12.793240 | controller | } 2026-02-26 12:32:13.084751 | controller | changed: 2026-02-26 12:32:13.084840 | controller | { 2026-02-26 12:32:13.084866 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com" 2026-02-26 12:32:13.084888 | controller | } 2026-02-26 12:32:13.378410 | controller | changed: 2026-02-26 12:32:13.378495 | controller | { 2026-02-26 12:32:13.378522 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2026-02-26 12:32:13.378541 | controller | } 2026-02-26 12:32:13.677422 | controller | changed: 2026-02-26 12:32:13.677491 | controller | { 2026-02-26 12:32:13.677517 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2026-02-26 12:32:13.677536 | controller | } 2026-02-26 12:32:13.963795 | controller | changed: 2026-02-26 12:32:13.963857 | controller | { 2026-02-26 12:32:13.963882 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2026-02-26 12:32:13.963901 | controller | } 2026-02-26 12:32:14.255051 | controller | changed: 2026-02-26 12:32:14.255133 | controller | { 2026-02-26 12:32:14.255159 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2026-02-26 12:32:14.255179 | controller | } 2026-02-26 12:32:14.538448 | controller | changed: 2026-02-26 12:32:14.538519 | controller | { 2026-02-26 12:32:14.538544 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2026-02-26 12:32:14.538572 | controller | } 2026-02-26 12:32:14.827144 | controller | changed: 2026-02-26 12:32:14.827203 | controller | { 2026-02-26 12:32:14.827228 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2026-02-26 12:32:14.827247 | controller | } 2026-02-26 12:32:15.108553 | controller | changed: 2026-02-26 12:32:15.108618 | controller | { 2026-02-26 12:32:15.108644 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2026-02-26 12:32:15.108663 | controller | } 2026-02-26 12:32:15.379934 | controller | changed: 2026-02-26 12:32:15.379987 | controller | { 2026-02-26 12:32:15.380010 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2026-02-26 12:32:15.380029 | controller | } 2026-02-26 12:32:15.658481 | controller | changed: 2026-02-26 12:32:15.658528 | controller | { 2026-02-26 12:32:15.658551 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2026-02-26 12:32:15.658568 | controller | } 2026-02-26 12:32:15.923996 | controller | changed: 2026-02-26 12:32:15.924081 | controller | { 2026-02-26 12:32:15.924138 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2026-02-26 12:32:15.924162 | controller | } 2026-02-26 12:32:16.195618 | controller | changed: 2026-02-26 12:32:16.195708 | controller | { 2026-02-26 12:32:16.195731 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2026-02-26 12:32:16.195750 | controller | } 2026-02-26 12:32:16.477494 | controller | changed: 2026-02-26 12:32:16.477577 | controller | { 2026-02-26 12:32:16.477602 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2026-02-26 12:32:16.477622 | controller | } 2026-02-26 12:32:16.748195 | controller | changed: 2026-02-26 12:32:16.748248 | controller | { 2026-02-26 12:32:16.748271 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2026-02-26 12:32:16.748288 | controller | } 2026-02-26 12:32:16.762604 | 2026-02-26 12:32:16.762667 | TASK [Set timezone to UTC] 2026-02-26 12:32:17.229475 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2026-02-26 12:32:17.233938 | 2026-02-26 12:32:17.233996 | TASK [Create nodepool directory] 2026-02-26 12:32:17.495942 | controller | changed 2026-02-26 12:32:17.502143 | 2026-02-26 12:32:17.502210 | TASK [Create nodepool sub_nodes file] 2026-02-26 12:32:18.403610 | controller | changed 2026-02-26 12:32:18.408443 | 2026-02-26 12:32:18.408521 | TASK [Create nodepool sub_nodes_private file] 2026-02-26 12:32:19.300017 | controller | changed 2026-02-26 12:32:19.304386 | 2026-02-26 12:32:19.304444 | LOOP [Populate nodepool sub_nodes file] 2026-02-26 12:32:19.333209 | 2026-02-26 12:32:19.333331 | LOOP [Populate nodepool sub_nodes_private file] 2026-02-26 12:32:19.362150 | 2026-02-26 12:32:19.362309 | TASK [Create nodepool primary file] 2026-02-26 12:32:19.385829 | controller | skipping: Conditional result was False 2026-02-26 12:32:19.390722 | 2026-02-26 12:32:19.390786 | TASK [Create nodepool node_private for this node] 2026-02-26 12:32:20.397084 | controller | changed 2026-02-26 12:32:20.402264 | 2026-02-26 12:32:20.402342 | LOOP [Copy ssh keys to nodepool directory] 2026-02-26 12:32:20.773994 | controller | ok: Item: id_rsa Runtime: 0:00:00.004150 2026-02-26 12:32:20.774167 | 2026-02-26 12:32:21.014177 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.006070 2026-02-26 12:32:21.022066 | 2026-02-26 12:32:21.022158 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2026-02-26 12:32:22.048569 | controller | changed 2026-02-26 12:32:22.053166 | 2026-02-26 12:32:22.053226 | TASK [Validate sudoers config after edits] 2026-02-26 12:32:22.321758 | controller | /etc/sudoers: parsed OK 2026-02-26 12:32:22.321817 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2026-02-26 12:32:22.321828 | controller | /etc/sudoers.d/zuul: parsed OK 2026-02-26 12:32:22.321834 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2026-02-26 12:32:22.578934 | controller | ok: Runtime: 0:00:00.005064 2026-02-26 12:32:22.583720 | 2026-02-26 12:32:22.583776 | TASK [Show the environment passed in to job shell scripts] 2026-02-26 12:32:22.835052 | controller | SHELL=/bin/bash 2026-02-26 12:32:22.835089 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2026-02-26 12:32:22.835098 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2026-02-26 12:32:22.835105 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/78/3678/79bd51efd6147c0557dcf4fe58dd324d6dccaf35 2026-02-26 12:32:22.835110 | controller | PWD=/home/zuul 2026-02-26 12:32:22.835115 | controller | ZUUL_PIPELINE=github-check 2026-02-26 12:32:22.835120 | controller | LOGNAME=zuul 2026-02-26 12:32:22.835124 | controller | XDG_SESSION_TYPE=tty 2026-02-26 12:32:22.835129 | controller | _=/usr/bin/env 2026-02-26 12:32:22.835134 | controller | MOTD_SHOWN=pam 2026-02-26 12:32:22.835171 | controller | HOME=/home/zuul 2026-02-26 12:32:22.835179 | controller | LANG=en_US.UTF-8 2026-02-26 12:32:22.835184 | controller | SSH_CONNECTION=192.168.26.12 57286 192.168.26.208 22 2026-02-26 12:32:22.835189 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2026-02-26 12:32:22.835196 | controller | ZUUL_CHANGE_IDS=3678,79bd51efd6147c0557dcf4fe58dd324d6dccaf35 2026-02-26 12:32:22.835201 | controller | WORKSPACE=/home/zuul/workspace 2026-02-26 12:32:22.835206 | controller | XDG_SESSION_CLASS=user 2026-02-26 12:32:22.835221 | controller | SELINUX_ROLE_REQUESTED= 2026-02-26 12:32:22.835229 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2026-02-26 12:32:22.835234 | controller | USER=zuul 2026-02-26 12:32:22.835239 | controller | ZUUL_VOTING=True 2026-02-26 12:32:22.835243 | controller | BUILD_TIMEOUT=5400000 2026-02-26 12:32:22.835248 | controller | SELINUX_USE_CURRENT_RANGE= 2026-02-26 12:32:22.835253 | controller | SHLVL=1 2026-02-26 12:32:22.835257 | controller | ZUUL_PATCHSET=79bd51efd6147c0557dcf4fe58dd324d6dccaf35 2026-02-26 12:32:22.835262 | controller | XDG_SESSION_ID=1 2026-02-26 12:32:22.835267 | controller | ZUUL_BRANCH=main 2026-02-26 12:32:22.835272 | controller | XDG_RUNTIME_DIR=/run/user/1000 2026-02-26 12:32:22.835277 | controller | SSH_CLIENT=192.168.26.12 57286 22 2026-02-26 12:32:22.835283 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2026-02-26 12:32:22.835295 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2026-02-26 12:32:22.835301 | controller | which_declare=declare -f 2026-02-26 12:32:22.835306 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2026-02-26 12:32:22.835311 | controller | SELINUX_LEVEL_REQUESTED= 2026-02-26 12:32:22.835315 | controller | ZUUL_CHANGE=3678 2026-02-26 12:32:22.835320 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2026-02-26 12:32:22.835325 | controller | ZUUL_UUID=5426286bcef34762bdc458d2eab94a52 2026-02-26 12:32:22.835329 | controller | BASH_FUNC_which%%=() { ( alias; 2026-02-26 12:32:22.835334 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2026-02-26 12:32:22.835339 | controller | } 2026-02-26 12:32:23.108429 | controller | ok: Runtime: 0:00:00.005186 2026-02-26 12:32:23.113422 | 2026-02-26 12:32:23.113498 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2026-02-26 12:32:23.127030 | controller | skipping: Conditional result was False 2026-02-26 12:32:23.131961 | 2026-02-26 12:32:23.132020 | TASK [Symlink /home/zuul-worker/workspace] 2026-02-26 12:32:23.675114 | controller | skipping: Conditional result was False 2026-02-26 12:32:23.680754 | 2026-02-26 12:32:23.680815 | TASK [Ensure legacy workspace directory] 2026-02-26 12:32:23.943030 | controller | changed 2026-02-26 12:32:23.960529 | 2026-02-26 12:32:23.960586 | PLAY RECAP 2026-02-26 12:32:23.960630 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-26 12:32:23.960651 | 2026-02-26 12:32:24.024128 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-26 12:32:24.024826 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-26 12:32:24.479275 | 2026-02-26 12:32:24.479378 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2026-02-26 12:32:24.498835 | 2026-02-26 12:32:24.498910 | TASK [Create zuul-output directory] 2026-02-26 12:32:24.872319 | controller | changed 2026-02-26 12:32:24.877083 | 2026-02-26 12:32:24.877152 | TASK [Slurp Zuul inventory test] 2026-02-26 12:32:25.122493 | controller -> localhost | ok 2026-02-26 12:32:25.128176 | 2026-02-26 12:32:25.128248 | TASK [Save zuul inventory] 2026-02-26 12:32:26.406110 | controller | changed 2026-02-26 12:32:26.411355 | 2026-02-26 12:32:26.411419 | TASK [Save zuul vars without the change_message] 2026-02-26 12:32:27.492548 | controller | changed 2026-02-26 12:32:27.510096 | 2026-02-26 12:32:27.510146 | PLAY RECAP 2026-02-26 12:32:27.510189 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-26 12:32:27.510211 | 2026-02-26 12:32:27.568369 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-26 12:32:27.569102 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-26 12:32:28.060412 | 2026-02-26 12:32:28.060506 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2026-02-26 12:32:28.079198 | 2026-02-26 12:32:28.079264 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2026-02-26 12:32:28.096789 | controller | ok 2026-02-26 12:32:28.112012 | 2026-02-26 12:32:28.112087 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-26 12:32:28.135017 | controller | skipping: Conditional result was False 2026-02-26 12:32:28.140418 | 2026-02-26 12:32:28.140491 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-26 12:32:28.501948 | controller | ok 2026-02-26 12:32:28.507385 | 2026-02-26 12:32:28.507456 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-26 12:32:29.460447 | controller | ok 2026-02-26 12:32:29.469507 | 2026-02-26 12:32:29.469571 | TASK [Prepare workspace] 2026-02-26 12:32:29.486679 | controller | ok 2026-02-26 12:32:29.502062 | 2026-02-26 12:32:29.502129 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-02-26 12:32:29.854515 | controller | ok 2026-02-26 12:32:29.859982 | 2026-02-26 12:32:29.860048 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-02-26 12:32:32.170350 | controller | Output suppressed because no_log was given 2026-02-26 12:32:32.179103 | 2026-02-26 12:32:32.179167 | LOOP [Create zuul-output directory] 2026-02-26 12:32:32.431656 | controller | changed: "/home/zuul/ci-framework-data/logs" 2026-02-26 12:32:32.656830 | controller | ok: "/home/zuul/zuul-output/logs" 2026-02-26 12:32:32.667273 | 2026-02-26 12:32:32.667395 | TASK [Install required packages] 2026-02-26 12:32:52.722142 | controller | ok: Nothing to do 2026-02-26 12:32:52.726731 | 2026-02-26 12:32:52.726788 | TASK [Install venv] 2026-02-26 12:33:48.271696 | controller | changed 2026-02-26 12:33:48.294998 | 2026-02-26 12:33:48.295057 | PLAY RECAP 2026-02-26 12:33:48.295104 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-26 12:33:48.295144 | 2026-02-26 12:33:48.355354 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-26 12:33:48.356106 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-26 12:33:48.827141 | 2026-02-26 12:33:48.827234 | PLAY [Run ci/playbooks/molecule-test.yml] 2026-02-26 12:33:48.845757 | 2026-02-26 12:33:48.845827 | TASK [Gather required facts] 2026-02-26 12:33:49.392213 | controller | ok 2026-02-26 12:33:49.397399 | 2026-02-26 12:33:49.397476 | TASK [Load environment var if instructed to] 2026-02-26 12:33:49.420890 | controller | skipping: Conditional result was False 2026-02-26 12:33:49.425792 | 2026-02-26 12:33:49.425852 | TASK [Ensure group_vars dir exists] 2026-02-26 12:33:49.789644 | controller | ok 2026-02-26 12:33:49.794316 | 2026-02-26 12:33:49.794386 | TASK [Print related variables] 2026-02-26 12:33:49.822884 | controller | ok: 2026-02-26 12:33:49.823029 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2026-02-26 12:33:49.823060 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2026-02-26 12:33:49.827748 | 2026-02-26 12:33:49.827811 | TASK [Run molecule] 2026-02-26 12:33:50.785340 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2026-02-26 12:33:51.058385 | controller | INFO Performing prerun with role_name_check=0... 2026-02-26 12:34:07.887039 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.887344 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.887790 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.888197 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.888588 | controller | WARNING Another version of 'cifmw.general' 1.0.0+79bd51ef was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+79bd51ef (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.888994 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.889413 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.889801 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.890195 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.890566 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.890948 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.891370 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.891771 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.892174 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.892593 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 12:34:07.901448 | controller | INFO Running crc_layout > prepare 2026-02-26 12:34:08.525739 | controller | 2026-02-26 12:34:08.525787 | controller | PLAY [Prepare] ***************************************************************** 2026-02-26 12:34:08.525848 | controller | 2026-02-26 12:34:08.525933 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-26 12:34:08.526048 | controller | Thursday 26 February 2026 12:34:08 +0000 (0:00:00.018) 0:00:00.018 ***** 2026-02-26 12:34:09.389651 | controller | ok: [instance] 2026-02-26 12:34:09.389735 | controller | 2026-02-26 12:34:09.389854 | controller | TASK [Create custom basedir] *************************************************** 2026-02-26 12:34:09.389873 | controller | Thursday 26 February 2026 12:34:09 +0000 (0:00:00.864) 0:00:00.883 ***** 2026-02-26 12:34:09.694288 | controller | changed: [instance] 2026-02-26 12:34:09.694343 | controller | 2026-02-26 12:34:09.694412 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2026-02-26 12:34:09.694510 | controller | Thursday 26 February 2026 12:34:09 +0000 (0:00:00.304) 0:00:01.187 ***** 2026-02-26 12:34:09.712931 | controller | skipping: [instance] 2026-02-26 12:34:09.713005 | controller | 2026-02-26 12:34:09.713174 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2026-02-26 12:34:09.713248 | controller | Thursday 26 February 2026 12:34:09 +0000 (0:00:00.019) 0:00:01.206 ***** 2026-02-26 12:34:09.753484 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2026-02-26 12:34:09.753516 | controller | 2026-02-26 12:34:09.753630 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2026-02-26 12:34:09.753726 | controller | Thursday 26 February 2026 12:34:09 +0000 (0:00:00.040) 0:00:01.247 ***** 2026-02-26 12:34:10.040786 | controller | ok: [instance] 2026-02-26 12:34:10.040851 | controller | 2026-02-26 12:34:10.040864 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2026-02-26 12:34:10.040984 | controller | Thursday 26 February 2026 12:34:10 +0000 (0:00:00.287) 0:00:01.534 ***** 2026-02-26 12:34:10.264140 | controller | ok: [instance] 2026-02-26 12:34:10.264198 | controller | 2026-02-26 12:34:10.264281 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2026-02-26 12:34:10.264367 | controller | Thursday 26 February 2026 12:34:10 +0000 (0:00:00.223) 0:00:01.757 ***** 2026-02-26 12:34:11.010363 | controller | ok: [instance] => (item=ubi-9-appstream) 2026-02-26 12:34:11.010421 | controller | ok: [instance] => (item=ubi-9-baseos) 2026-02-26 12:34:11.010478 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2026-02-26 12:34:11.010560 | controller | 2026-02-26 12:34:11.010649 | controller | TASK [Deploy repo-setup] ******************************************************* 2026-02-26 12:34:11.010721 | controller | Thursday 26 February 2026 12:34:11 +0000 (0:00:00.745) 0:00:02.503 ***** 2026-02-26 12:34:11.068290 | controller | 2026-02-26 12:34:11.068413 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-26 12:34:11.068518 | controller | Thursday 26 February 2026 12:34:11 +0000 (0:00:00.058) 0:00:02.561 ***** 2026-02-26 12:34:11.593156 | controller | changed: [instance] => (item=tmp) 2026-02-26 12:34:11.593242 | controller | changed: [instance] => (item=artifacts/repositories) 2026-02-26 12:34:11.593301 | controller | changed: [instance] => (item=venv/repo_setup) 2026-02-26 12:34:11.593383 | controller | 2026-02-26 12:34:11.593469 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-26 12:34:11.593561 | controller | Thursday 26 February 2026 12:34:11 +0000 (0:00:00.524) 0:00:03.086 ***** 2026-02-26 12:34:12.485661 | controller | ok: [instance] 2026-02-26 12:34:12.485909 | controller | 2026-02-26 12:34:13.494805 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-26 12:34:13.494828 | controller | Thursday 26 February 2026 12:34:12 +0000 (0:00:00.892) 0:00:03.979 ***** 2026-02-26 12:34:13.494839 | controller | changed: [instance] 2026-02-26 12:34:20.785964 | controller | 2026-02-26 12:34:20.786001 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-26 12:34:20.786008 | controller | Thursday 26 February 2026 12:34:13 +0000 (0:00:01.008) 0:00:04.988 ***** 2026-02-26 12:34:20.786018 | controller | changed: [instance] 2026-02-26 12:34:21.474027 | controller | 2026-02-26 12:34:21.474057 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-26 12:34:21.474064 | controller | Thursday 26 February 2026 12:34:20 +0000 (0:00:07.290) 0:00:12.279 ***** 2026-02-26 12:34:21.474073 | controller | changed: [instance] 2026-02-26 12:34:21.496295 | controller | 2026-02-26 12:34:21.496322 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-26 12:34:21.496331 | controller | Thursday 26 February 2026 12:34:21 +0000 (0:00:00.688) 0:00:12.967 ***** 2026-02-26 12:34:21.496341 | controller | skipping: [instance] 2026-02-26 12:34:21.496385 | controller | 2026-02-26 12:34:21.496574 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-26 12:34:22.326636 | controller | Thursday 26 February 2026 12:34:21 +0000 (0:00:00.022) 0:00:12.989 ***** 2026-02-26 12:34:22.326674 | controller | changed: [instance] 2026-02-26 12:34:22.376131 | controller | 2026-02-26 12:34:22.376155 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-26 12:34:22.376164 | controller | Thursday 26 February 2026 12:34:22 +0000 (0:00:00.829) 0:00:13.819 ***** 2026-02-26 12:34:22.376175 | controller | skipping: [instance] 2026-02-26 12:34:22.424181 | controller | 2026-02-26 12:34:22.424204 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-26 12:34:22.424229 | controller | Thursday 26 February 2026 12:34:22 +0000 (0:00:00.049) 0:00:13.869 ***** 2026-02-26 12:34:22.424241 | controller | skipping: [instance] 2026-02-26 12:34:22.471489 | controller | 2026-02-26 12:34:22.471569 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-26 12:34:22.471581 | controller | Thursday 26 February 2026 12:34:22 +0000 (0:00:00.047) 0:00:13.916 ***** 2026-02-26 12:34:22.471599 | controller | skipping: [instance] 2026-02-26 12:34:23.118705 | controller | 2026-02-26 12:34:23.118740 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-26 12:34:23.118749 | controller | Thursday 26 February 2026 12:34:22 +0000 (0:00:00.047) 0:00:13.964 ***** 2026-02-26 12:34:23.118760 | controller | changed: [instance] 2026-02-26 12:34:23.569713 | controller | 2026-02-26 12:34:23.569745 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-26 12:34:23.569752 | controller | Thursday 26 February 2026 12:34:23 +0000 (0:00:00.647) 0:00:14.611 ***** 2026-02-26 12:34:23.569762 | controller | changed: [instance] 2026-02-26 12:34:23.600383 | controller | 2026-02-26 12:34:23.600409 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-26 12:34:23.600419 | controller | Thursday 26 February 2026 12:34:23 +0000 (0:00:00.451) 0:00:15.062 ***** 2026-02-26 12:34:23.600430 | controller | skipping: [instance] 2026-02-26 12:34:23.600457 | controller | 2026-02-26 12:34:23.600467 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-26 12:34:23.600606 | controller | Thursday 26 February 2026 12:34:23 +0000 (0:00:00.030) 0:00:15.093 ***** 2026-02-26 12:34:23.628196 | controller | skipping: [instance] 2026-02-26 12:34:23.667305 | controller | 2026-02-26 12:34:23.667334 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-26 12:34:23.667344 | controller | Thursday 26 February 2026 12:34:23 +0000 (0:00:00.027) 0:00:15.121 ***** 2026-02-26 12:34:23.667358 | controller | skipping: [instance] 2026-02-26 12:34:23.709385 | controller | 2026-02-26 12:34:23.709450 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-26 12:34:23.709461 | controller | Thursday 26 February 2026 12:34:23 +0000 (0:00:00.038) 0:00:15.160 ***** 2026-02-26 12:34:23.709478 | controller | ok: [instance] 2026-02-26 12:34:23.709516 | controller | 2026-02-26 12:34:23.709527 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-26 12:34:23.709621 | controller | Thursday 26 February 2026 12:34:23 +0000 (0:00:00.042) 0:00:15.202 ***** 2026-02-26 12:34:23.737814 | controller | skipping: [instance] 2026-02-26 12:34:23.765313 | controller | 2026-02-26 12:34:23.765358 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-26 12:34:23.765366 | controller | Thursday 26 February 2026 12:34:23 +0000 (0:00:00.028) 0:00:15.231 ***** 2026-02-26 12:34:23.765377 | controller | skipping: [instance] 2026-02-26 12:34:23.765404 | controller | 2026-02-26 12:34:23.765500 | controller | TASK [Download the RPM] ******************************************************** 2026-02-26 12:34:23.765520 | controller | Thursday 26 February 2026 12:34:23 +0000 (0:00:00.027) 0:00:15.259 ***** 2026-02-26 12:34:23.796600 | controller | skipping: [instance] 2026-02-26 12:34:23.828738 | controller | 2026-02-26 12:34:23.828767 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-26 12:34:23.828780 | controller | Thursday 26 February 2026 12:34:23 +0000 (0:00:00.031) 0:00:15.290 ***** 2026-02-26 12:34:23.828795 | controller | skipping: [instance] 2026-02-26 12:34:23.856837 | controller | 2026-02-26 12:34:23.856858 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-26 12:34:23.856866 | controller | Thursday 26 February 2026 12:34:23 +0000 (0:00:00.031) 0:00:15.321 ***** 2026-02-26 12:34:23.856876 | controller | skipping: [instance] 2026-02-26 12:34:23.893801 | controller | 2026-02-26 12:34:23.893823 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-26 12:34:23.893831 | controller | Thursday 26 February 2026 12:34:23 +0000 (0:00:00.028) 0:00:15.350 ***** 2026-02-26 12:34:23.893842 | controller | skipping: [instance] 2026-02-26 12:34:23.894010 | controller | 2026-02-26 12:34:23.894165 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-26 12:34:23.894341 | controller | Thursday 26 February 2026 12:34:23 +0000 (0:00:00.037) 0:00:15.387 ***** 2026-02-26 12:34:23.921283 | controller | skipping: [instance] 2026-02-26 12:34:23.921427 | controller | 2026-02-26 12:34:23.921554 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-26 12:34:23.921675 | controller | Thursday 26 February 2026 12:34:23 +0000 (0:00:00.027) 0:00:15.415 ***** 2026-02-26 12:34:24.107179 | controller | ok: [instance] 2026-02-26 12:34:24.341032 | controller | 2026-02-26 12:34:24.341058 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-26 12:34:24.341065 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.185) 0:00:15.600 ***** 2026-02-26 12:34:24.341076 | controller | changed: [instance] 2026-02-26 12:34:24.567851 | controller | 2026-02-26 12:34:24.567871 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-26 12:34:24.567879 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.233) 0:00:15.834 ***** 2026-02-26 12:34:24.567896 | controller | changed: [instance] 2026-02-26 12:34:24.592315 | controller | 2026-02-26 12:34:24.592366 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-26 12:34:24.592377 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.226) 0:00:16.061 ***** 2026-02-26 12:34:24.592392 | controller | skipping: [instance] 2026-02-26 12:34:24.592665 | controller | 2026-02-26 12:34:24.592702 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-26 12:34:24.617385 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.024) 0:00:16.085 ***** 2026-02-26 12:34:24.617433 | controller | skipping: [instance] 2026-02-26 12:34:24.617763 | controller | 2026-02-26 12:34:24.617797 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-26 12:34:24.639581 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.024) 0:00:16.110 ***** 2026-02-26 12:34:24.639600 | controller | skipping: [instance] 2026-02-26 12:34:24.661314 | controller | 2026-02-26 12:34:24.661346 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-26 12:34:24.661355 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.022) 0:00:16.133 ***** 2026-02-26 12:34:24.661365 | controller | skipping: [instance] 2026-02-26 12:34:24.682871 | controller | 2026-02-26 12:34:24.682905 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-26 12:34:24.682942 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.021) 0:00:16.154 ***** 2026-02-26 12:34:24.682959 | controller | skipping: [instance] 2026-02-26 12:34:24.706152 | controller | 2026-02-26 12:34:24.706185 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-26 12:34:24.706198 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.021) 0:00:16.175 ***** 2026-02-26 12:34:24.706258 | controller | skipping: [instance] 2026-02-26 12:34:24.706541 | controller | 2026-02-26 12:34:24.706793 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-26 12:34:24.707047 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.023) 0:00:16.199 ***** 2026-02-26 12:34:24.723950 | controller | skipping: [instance] 2026-02-26 12:34:24.724260 | controller | 2026-02-26 12:34:24.724488 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-26 12:34:24.724644 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.017) 0:00:16.217 ***** 2026-02-26 12:34:24.758604 | controller | skipping: [instance] 2026-02-26 12:34:24.758866 | controller | 2026-02-26 12:34:24.759133 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-26 12:34:24.759321 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.034) 0:00:16.252 ***** 2026-02-26 12:34:24.775351 | controller | skipping: [instance] 2026-02-26 12:34:24.775619 | controller | 2026-02-26 12:34:24.775878 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-26 12:34:24.776148 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.016) 0:00:16.268 ***** 2026-02-26 12:34:24.794682 | controller | skipping: [instance] 2026-02-26 12:34:24.794965 | controller | 2026-02-26 12:34:24.795280 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2026-02-26 12:34:24.795437 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.019) 0:00:16.288 ***** 2026-02-26 12:34:24.822712 | controller | skipping: [instance] 2026-02-26 12:34:24.822876 | controller | 2026-02-26 12:34:24.823049 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2026-02-26 12:34:24.823199 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.028) 0:00:16.316 ***** 2026-02-26 12:34:24.852335 | controller | skipping: [instance] 2026-02-26 12:34:24.852505 | controller | 2026-02-26 12:34:24.852630 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2026-02-26 12:34:24.852755 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.029) 0:00:16.345 ***** 2026-02-26 12:34:24.882636 | controller | skipping: [instance] 2026-02-26 12:34:24.882903 | controller | 2026-02-26 12:34:24.883172 | controller | TASK [test_deps : Install additional packages] ********************************* 2026-02-26 12:34:24.883463 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.030) 0:00:16.376 ***** 2026-02-26 12:34:24.912425 | controller | skipping: [instance] 2026-02-26 12:34:24.912592 | controller | 2026-02-26 12:34:24.912731 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2026-02-26 12:34:24.912854 | controller | Thursday 26 February 2026 12:34:24 +0000 (0:00:00.029) 0:00:16.405 ***** 2026-02-26 12:35:07.419894 | controller | ok: [instance] 2026-02-26 12:35:08.595986 | controller | 2026-02-26 12:35:08.596013 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2026-02-26 12:35:08.596022 | controller | Thursday 26 February 2026 12:35:07 +0000 (0:00:42.506) 0:00:58.912 ***** 2026-02-26 12:35:08.596033 | controller | ok: [instance] 2026-02-26 12:35:08.626721 | controller | 2026-02-26 12:35:08.626746 | controller | TASK [test_deps : Install extra packages] ************************************** 2026-02-26 12:35:08.626756 | controller | Thursday 26 February 2026 12:35:08 +0000 (0:00:01.176) 0:01:00.089 ***** 2026-02-26 12:35:08.626767 | controller | skipping: [instance] 2026-02-26 12:35:08.667472 | controller | 2026-02-26 12:35:08.667507 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-26 12:35:08.667517 | controller | Thursday 26 February 2026 12:35:08 +0000 (0:00:00.030) 0:01:00.120 ***** 2026-02-26 12:35:08.667530 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2026-02-26 12:35:08.685301 | controller | 2026-02-26 12:35:08.685334 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-26 12:35:08.685347 | controller | Thursday 26 February 2026 12:35:08 +0000 (0:00:00.040) 0:01:00.160 ***** 2026-02-26 12:35:08.685359 | controller | ok: [instance] => 2026-02-26 12:35:08.685384 | controller | cifmw_ci_setup_packages: 2026-02-26 12:35:08.686343 | controller | - bash-completion 2026-02-26 12:35:08.686387 | controller | - ca-certificates 2026-02-26 12:35:08.686398 | controller | - git-core 2026-02-26 12:35:08.686405 | controller | - make 2026-02-26 12:35:08.686412 | controller | - tar 2026-02-26 12:35:08.686419 | controller | - tmux 2026-02-26 12:35:08.686425 | controller | - python3-pip 2026-02-26 12:35:08.686432 | controller | 2026-02-26 12:35:08.686439 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-26 12:35:08.686448 | controller | Thursday 26 February 2026 12:35:08 +0000 (0:00:00.018) 0:01:00.178 ***** 2026-02-26 12:35:16.970290 | controller | changed: [instance] 2026-02-26 12:35:16.970358 | controller | 2026-02-26 12:35:16.970548 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-26 12:35:17.566953 | controller | Thursday 26 February 2026 12:35:16 +0000 (0:00:08.284) 0:01:08.463 ***** 2026-02-26 12:35:17.566990 | controller | ok: [instance] 2026-02-26 12:35:17.774192 | controller | 2026-02-26 12:35:17.774250 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-26 12:35:17.774259 | controller | Thursday 26 February 2026 12:35:17 +0000 (0:00:00.596) 0:01:09.059 ***** 2026-02-26 12:35:17.774270 | controller | changed: [instance] 2026-02-26 12:35:17.774450 | controller | 2026-02-26 12:35:23.659080 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-26 12:35:23.659111 | controller | Thursday 26 February 2026 12:35:17 +0000 (0:00:00.207) 0:01:09.267 ***** 2026-02-26 12:35:23.659123 | controller | changed: [instance] 2026-02-26 12:35:23.707169 | controller | 2026-02-26 12:35:23.707186 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-26 12:35:23.707193 | controller | Thursday 26 February 2026 12:35:23 +0000 (0:00:05.884) 0:01:15.152 ***** 2026-02-26 12:35:23.707201 | controller | ok: [instance] 2026-02-26 12:35:24.040400 | controller | 2026-02-26 12:35:24.040454 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-26 12:35:24.040465 | controller | Thursday 26 February 2026 12:35:23 +0000 (0:00:00.048) 0:01:15.200 ***** 2026-02-26 12:35:24.040479 | controller | changed: [instance] 2026-02-26 12:35:24.336922 | controller | 2026-02-26 12:35:24.336952 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-26 12:35:24.336961 | controller | Thursday 26 February 2026 12:35:24 +0000 (0:00:00.332) 0:01:15.533 ***** 2026-02-26 12:35:24.336971 | controller | changed: [instance] 2026-02-26 12:35:24.363026 | controller | 2026-02-26 12:35:24.363045 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-26 12:35:24.363052 | controller | Thursday 26 February 2026 12:35:24 +0000 (0:00:00.296) 0:01:15.830 ***** 2026-02-26 12:35:24.363061 | controller | skipping: [instance] 2026-02-26 12:35:24.382191 | controller | 2026-02-26 12:35:24.382207 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-26 12:35:24.382233 | controller | Thursday 26 February 2026 12:35:24 +0000 (0:00:00.026) 0:01:15.856 ***** 2026-02-26 12:35:24.382242 | controller | skipping: [instance] 2026-02-26 12:35:24.406459 | controller | 2026-02-26 12:35:24.406476 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-26 12:35:24.406483 | controller | Thursday 26 February 2026 12:35:24 +0000 (0:00:00.019) 0:01:15.875 ***** 2026-02-26 12:35:24.406491 | controller | skipping: [instance] 2026-02-26 12:35:24.425843 | controller | 2026-02-26 12:35:24.425865 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-26 12:35:24.425874 | controller | Thursday 26 February 2026 12:35:24 +0000 (0:00:00.024) 0:01:15.899 ***** 2026-02-26 12:35:24.425900 | controller | skipping: [instance] 2026-02-26 12:35:24.443645 | controller | 2026-02-26 12:35:24.443664 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-26 12:35:24.443677 | controller | Thursday 26 February 2026 12:35:24 +0000 (0:00:00.019) 0:01:15.919 ***** 2026-02-26 12:35:24.443686 | controller | skipping: [instance] 2026-02-26 12:35:24.473126 | controller | 2026-02-26 12:35:24.473144 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-26 12:35:24.473151 | controller | Thursday 26 February 2026 12:35:24 +0000 (0:00:00.017) 0:01:15.937 ***** 2026-02-26 12:35:24.473159 | controller | skipping: [instance] 2026-02-26 12:35:25.496350 | controller | 2026-02-26 12:35:25.496385 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-26 12:35:25.496395 | controller | Thursday 26 February 2026 12:35:24 +0000 (0:00:00.029) 0:01:15.966 ***** 2026-02-26 12:35:25.496407 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2026-02-26 12:35:25.496437 | controller | changed: [instance] => (item=/opt/basedir/logs) 2026-02-26 12:35:25.496444 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2026-02-26 12:35:25.496451 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2026-02-26 12:35:25.496457 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2026-02-26 12:35:25.496466 | controller | 2026-02-26 12:35:25.496526 | controller | TASK [Create secret file] ****************************************************** 2026-02-26 12:35:25.496544 | controller | Thursday 26 February 2026 12:35:25 +0000 (0:00:01.022) 0:01:16.989 ***** 2026-02-26 12:35:25.841434 | controller | changed: [instance] 2026-02-26 12:35:25.841509 | controller | 2026-02-26 12:35:25.841518 | controller | PLAY RECAP ********************************************************************* 2026-02-26 12:35:25.841526 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2026-02-26 12:35:25.841532 | controller | 2026-02-26 12:35:25.841537 | controller | Thursday 26 February 2026 12:35:25 +0000 (0:00:00.344) 0:01:17.333 ***** 2026-02-26 12:35:25.841542 | controller | =============================================================================== 2026-02-26 12:35:25.841547 | controller | test_deps : Install selinux python libs -------------------------------- 42.51s 2026-02-26 12:35:25.841552 | controller | ci_setup : Install needed packages -------------------------------------- 8.28s 2026-02-26 12:35:25.841557 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.29s 2026-02-26 12:35:25.841561 | controller | ci_setup : Install openshift client ------------------------------------- 5.88s 2026-02-26 12:35:25.841566 | controller | test_deps : Install python yaml libs ------------------------------------ 1.18s 2026-02-26 12:35:25.841571 | controller | ci_setup : Manage directories ------------------------------------------- 1.02s 2026-02-26 12:35:25.841577 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.01s 2026-02-26 12:35:25.841599 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.89s 2026-02-26 12:35:25.841607 | controller | Gathering Facts --------------------------------------------------------- 0.86s 2026-02-26 12:35:25.841629 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.83s 2026-02-26 12:35:25.842510 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.75s 2026-02-26 12:35:25.901617 | controller | repo_setup : Install repo-setup package --------------------------------- 0.69s 2026-02-26 12:35:25.901668 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.65s 2026-02-26 12:35:25.901676 | controller | ci_setup : Gather version of openshift client --------------------------- 0.60s 2026-02-26 12:35:25.901681 | controller | repo_setup : Ensure directories are present ----------------------------- 0.52s 2026-02-26 12:35:25.901687 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.45s 2026-02-26 12:35:25.901692 | controller | Create secret file ------------------------------------------------------ 0.34s 2026-02-26 12:35:25.901697 | controller | ci_setup : Create completion file --------------------------------------- 0.33s 2026-02-26 12:35:25.901702 | controller | Create custom basedir --------------------------------------------------- 0.30s 2026-02-26 12:35:25.901712 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.30s 2026-02-26 12:35:25.901724 | controller | INFO Running crc_layout > converge 2026-02-26 12:35:26.454383 | controller | 2026-02-26 12:35:26.454631 | controller | PLAY [Converge] **************************************************************** 2026-02-26 12:35:26.454783 | controller | 2026-02-26 12:35:26.454960 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-26 12:35:26.455110 | controller | Thursday 26 February 2026 12:35:26 +0000 (0:00:00.024) 0:00:00.024 ***** 2026-02-26 12:35:27.266908 | controller | ok: [instance] 2026-02-26 12:35:27.288028 | controller | 2026-02-26 12:35:27.288062 | controller | TASK [Load networking definition from scenario file] *************************** 2026-02-26 12:35:27.288071 | controller | Thursday 26 February 2026 12:35:27 +0000 (0:00:00.812) 0:00:00.836 ***** 2026-02-26 12:35:27.288084 | controller | ok: [instance] 2026-02-26 12:35:28.826649 | controller | 2026-02-26 12:35:28.826680 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-26 12:35:28.826688 | controller | Thursday 26 February 2026 12:35:27 +0000 (0:00:00.021) 0:00:00.858 ***** 2026-02-26 12:35:28.826698 | controller | changed: [instance] 2026-02-26 12:35:28.862371 | controller | 2026-02-26 12:35:28.862410 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-26 12:35:28.862426 | controller | Thursday 26 February 2026 12:35:28 +0000 (0:00:01.538) 0:00:02.396 ***** 2026-02-26 12:35:28.862440 | controller | ok: [instance] 2026-02-26 12:35:28.888011 | controller | 2026-02-26 12:35:28.888038 | controller | TASK [reproducer : Load CI job environment] ************************************ 2026-02-26 12:35:28.888047 | controller | Thursday 26 February 2026 12:35:28 +0000 (0:00:00.035) 0:00:02.432 ***** 2026-02-26 12:35:28.888057 | controller | skipping: [instance] 2026-02-26 12:35:28.948107 | controller | 2026-02-26 12:35:28.948137 | controller | TASK [Build final libvirt layout] ********************************************** 2026-02-26 12:35:28.948149 | controller | Thursday 26 February 2026 12:35:28 +0000 (0:00:00.025) 0:00:02.458 ***** 2026-02-26 12:35:28.948164 | controller | 2026-02-26 12:35:29.030875 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2026-02-26 12:35:29.030906 | controller | Thursday 26 February 2026 12:35:28 +0000 (0:00:00.060) 0:00:02.518 ***** 2026-02-26 12:35:29.030917 | controller | ok: [instance] 2026-02-26 12:35:29.098400 | controller | 2026-02-26 12:35:29.098435 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2026-02-26 12:35:29.098444 | controller | Thursday 26 February 2026 12:35:29 +0000 (0:00:00.082) 0:00:02.601 ***** 2026-02-26 12:35:29.098456 | controller | skipping: [instance] 2026-02-26 12:35:29.098489 | controller | 2026-02-26 12:35:29.098747 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2026-02-26 12:35:29.127981 | controller | Thursday 26 February 2026 12:35:29 +0000 (0:00:00.067) 0:00:02.668 ***** 2026-02-26 12:35:29.128006 | controller | ok: [instance] 2026-02-26 12:35:29.128162 | controller | 2026-02-26 12:35:29.128347 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2026-02-26 12:35:29.128502 | controller | Thursday 26 February 2026 12:35:29 +0000 (0:00:00.029) 0:00:02.698 ***** 2026-02-26 12:35:29.153365 | controller | ok: [instance] => changed=false 2026-02-26 12:35:29.153543 | controller | msg: All assertions passed 2026-02-26 12:35:29.153688 | controller | 2026-02-26 12:35:29.153839 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2026-02-26 12:35:29.153999 | controller | Thursday 26 February 2026 12:35:29 +0000 (0:00:00.025) 0:00:02.724 ***** 2026-02-26 12:35:29.196363 | controller | ok: [instance] 2026-02-26 12:35:29.196530 | controller | 2026-02-26 12:35:29.196682 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2026-02-26 12:35:29.196825 | controller | Thursday 26 February 2026 12:35:29 +0000 (0:00:00.042) 0:00:02.767 ***** 2026-02-26 12:35:29.660714 | controller | ok: [instance] => (item=artifacts) 2026-02-26 12:35:29.746404 | controller | ok: [instance] => (item=logs) 2026-02-26 12:35:29.746429 | controller | 2026-02-26 12:35:29.746438 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2026-02-26 12:35:29.746452 | controller | Thursday 26 February 2026 12:35:29 +0000 (0:00:00.463) 0:00:03.230 ***** 2026-02-26 12:35:29.746462 | controller | 2026-02-26 12:35:29.947073 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2026-02-26 12:35:29.947094 | controller | Thursday 26 February 2026 12:35:29 +0000 (0:00:00.085) 0:00:03.316 ***** 2026-02-26 12:35:29.947105 | controller | ok: [instance] 2026-02-26 12:35:30.263406 | controller | 2026-02-26 12:35:30.263457 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2026-02-26 12:35:30.263472 | controller | Thursday 26 February 2026 12:35:29 +0000 (0:00:00.200) 0:00:03.517 ***** 2026-02-26 12:35:30.263490 | controller | changed: [instance] 2026-02-26 12:35:30.263522 | controller | 2026-02-26 12:35:30.263606 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2026-02-26 12:35:30.263629 | controller | Thursday 26 February 2026 12:35:30 +0000 (0:00:00.316) 0:00:03.833 ***** 2026-02-26 12:35:30.593707 | controller | ok: [instance] 2026-02-26 12:35:30.626928 | controller | 2026-02-26 12:35:30.626947 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2026-02-26 12:35:30.626955 | controller | Thursday 26 February 2026 12:35:30 +0000 (0:00:00.330) 0:00:04.163 ***** 2026-02-26 12:35:30.626964 | controller | skipping: [instance] 2026-02-26 12:35:30.647093 | controller | 2026-02-26 12:35:30.647111 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2026-02-26 12:35:30.647118 | controller | Thursday 26 February 2026 12:35:30 +0000 (0:00:00.033) 0:00:04.197 ***** 2026-02-26 12:35:30.647127 | controller | skipping: [instance] 2026-02-26 12:35:30.678859 | controller | 2026-02-26 12:35:30.678877 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2026-02-26 12:35:30.678885 | controller | Thursday 26 February 2026 12:35:30 +0000 (0:00:00.020) 0:00:04.217 ***** 2026-02-26 12:35:30.678894 | controller | ok: [instance] 2026-02-26 12:35:30.717027 | controller | 2026-02-26 12:35:30.717045 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2026-02-26 12:35:30.717058 | controller | Thursday 26 February 2026 12:35:30 +0000 (0:00:00.031) 0:00:04.249 ***** 2026-02-26 12:35:30.717067 | controller | skipping: [instance] 2026-02-26 12:35:38.727182 | controller | 2026-02-26 12:35:38.727230 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2026-02-26 12:35:38.727243 | controller | Thursday 26 February 2026 12:35:30 +0000 (0:00:00.038) 0:00:04.287 ***** 2026-02-26 12:35:38.727256 | controller | changed: [instance] 2026-02-26 12:35:38.936375 | controller | 2026-02-26 12:35:38.936457 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2026-02-26 12:35:38.936465 | controller | Thursday 26 February 2026 12:35:38 +0000 (0:00:08.009) 0:00:12.297 ***** 2026-02-26 12:35:38.936485 | controller | changed: [instance] 2026-02-26 12:35:39.434383 | controller | 2026-02-26 12:35:39.434445 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2026-02-26 12:35:39.434455 | controller | Thursday 26 February 2026 12:35:38 +0000 (0:00:00.209) 0:00:12.506 ***** 2026-02-26 12:35:39.434471 | controller | changed: [instance] 2026-02-26 12:35:40.013533 | controller | 2026-02-26 12:35:40.013585 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2026-02-26 12:35:40.013596 | controller | Thursday 26 February 2026 12:35:39 +0000 (0:00:00.498) 0:00:13.004 ***** 2026-02-26 12:35:40.013609 | controller | changed: [instance] 2026-02-26 12:35:40.208453 | controller | 2026-02-26 12:35:40.208501 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2026-02-26 12:35:40.208509 | controller | Thursday 26 February 2026 12:35:40 +0000 (0:00:00.578) 0:00:13.583 ***** 2026-02-26 12:35:40.208521 | controller | ok: [instance] 2026-02-26 12:35:40.861956 | controller | 2026-02-26 12:35:40.862005 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2026-02-26 12:35:40.862016 | controller | Thursday 26 February 2026 12:35:40 +0000 (0:00:00.195) 0:00:13.778 ***** 2026-02-26 12:35:40.862030 | controller | ok: [instance] 2026-02-26 12:35:41.641116 | controller | 2026-02-26 12:35:41.641157 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2026-02-26 12:35:41.641173 | controller | Thursday 26 February 2026 12:35:40 +0000 (0:00:00.653) 0:00:14.431 ***** 2026-02-26 12:35:41.641184 | controller | changed: [instance] 2026-02-26 12:35:41.728326 | controller | 2026-02-26 12:35:41.728355 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2026-02-26 12:35:41.728364 | controller | Thursday 26 February 2026 12:35:41 +0000 (0:00:00.779) 0:00:15.210 ***** 2026-02-26 12:35:41.728376 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2026-02-26 12:35:41.728432 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2026-02-26 12:35:41.728447 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2026-02-26 12:35:41.728453 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2026-02-26 12:35:41.728458 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2026-02-26 12:35:41.728464 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2026-02-26 12:35:41.728471 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2026-02-26 12:35:41.728476 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2026-02-26 12:35:41.728481 | controller | 2026-02-26 12:35:41.728487 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2026-02-26 12:35:41.728495 | controller | Thursday 26 February 2026 12:35:41 +0000 (0:00:00.087) 0:00:15.298 ***** 2026-02-26 12:35:42.048653 | controller | ok: [instance] 2026-02-26 12:35:42.359343 | controller | 2026-02-26 12:35:42.359370 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2026-02-26 12:35:42.359379 | controller | Thursday 26 February 2026 12:35:42 +0000 (0:00:00.320) 0:00:15.618 ***** 2026-02-26 12:35:42.359390 | controller | ok: [instance] 2026-02-26 12:35:42.359416 | controller | 2026-02-26 12:35:42.359423 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2026-02-26 12:35:42.359432 | controller | Thursday 26 February 2026 12:35:42 +0000 (0:00:00.311) 0:00:15.929 ***** 2026-02-26 12:35:42.671924 | controller | ok: [instance] 2026-02-26 12:35:42.984931 | controller | 2026-02-26 12:35:42.984979 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2026-02-26 12:35:42.984987 | controller | Thursday 26 February 2026 12:35:42 +0000 (0:00:00.312) 0:00:16.241 ***** 2026-02-26 12:35:42.984998 | controller | ok: [instance] 2026-02-26 12:35:43.294666 | controller | 2026-02-26 12:35:43.294692 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2026-02-26 12:35:43.294701 | controller | Thursday 26 February 2026 12:35:42 +0000 (0:00:00.313) 0:00:16.555 ***** 2026-02-26 12:35:43.294712 | controller | ok: [instance] 2026-02-26 12:35:43.625805 | controller | 2026-02-26 12:35:43.625829 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2026-02-26 12:35:43.625837 | controller | Thursday 26 February 2026 12:35:43 +0000 (0:00:00.309) 0:00:16.864 ***** 2026-02-26 12:35:43.625847 | controller | ok: [instance] 2026-02-26 12:35:43.964954 | controller | 2026-02-26 12:35:43.964981 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2026-02-26 12:35:43.964988 | controller | Thursday 26 February 2026 12:35:43 +0000 (0:00:00.331) 0:00:17.196 ***** 2026-02-26 12:35:43.965009 | controller | ok: [instance] 2026-02-26 12:35:44.295833 | controller | 2026-02-26 12:35:44.295859 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2026-02-26 12:35:44.295867 | controller | Thursday 26 February 2026 12:35:43 +0000 (0:00:00.338) 0:00:17.534 ***** 2026-02-26 12:35:44.295883 | controller | ok: [instance] 2026-02-26 12:35:44.616036 | controller | 2026-02-26 12:35:44.616068 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2026-02-26 12:35:44.616077 | controller | Thursday 26 February 2026 12:35:44 +0000 (0:00:00.331) 0:00:17.866 ***** 2026-02-26 12:35:44.616089 | controller | ok: [instance] 2026-02-26 12:35:44.937132 | controller | 2026-02-26 12:35:44.937157 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2026-02-26 12:35:44.937165 | controller | Thursday 26 February 2026 12:35:44 +0000 (0:00:00.319) 0:00:18.185 ***** 2026-02-26 12:35:44.937175 | controller | ok: [instance] 2026-02-26 12:35:45.265034 | controller | 2026-02-26 12:35:45.265058 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2026-02-26 12:35:45.265066 | controller | Thursday 26 February 2026 12:35:44 +0000 (0:00:00.321) 0:00:18.507 ***** 2026-02-26 12:35:45.265076 | controller | ok: [instance] 2026-02-26 12:35:45.612311 | controller | 2026-02-26 12:35:45.612347 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2026-02-26 12:35:45.612355 | controller | Thursday 26 February 2026 12:35:45 +0000 (0:00:00.327) 0:00:18.835 ***** 2026-02-26 12:35:45.612366 | controller | ok: [instance] 2026-02-26 12:35:45.934302 | controller | 2026-02-26 12:35:45.934338 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2026-02-26 12:35:45.934346 | controller | Thursday 26 February 2026 12:35:45 +0000 (0:00:00.347) 0:00:19.182 ***** 2026-02-26 12:35:45.934357 | controller | ok: [instance] 2026-02-26 12:35:46.251720 | controller | 2026-02-26 12:35:46.251754 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2026-02-26 12:35:46.251762 | controller | Thursday 26 February 2026 12:35:45 +0000 (0:00:00.321) 0:00:19.504 ***** 2026-02-26 12:35:46.251773 | controller | ok: [instance] 2026-02-26 12:35:46.567235 | controller | 2026-02-26 12:35:46.567263 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2026-02-26 12:35:46.567270 | controller | Thursday 26 February 2026 12:35:46 +0000 (0:00:00.317) 0:00:19.821 ***** 2026-02-26 12:35:46.567280 | controller | ok: [instance] 2026-02-26 12:35:46.895889 | controller | 2026-02-26 12:35:46.895920 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2026-02-26 12:35:46.895928 | controller | Thursday 26 February 2026 12:35:46 +0000 (0:00:00.315) 0:00:20.137 ***** 2026-02-26 12:35:46.895938 | controller | ok: [instance] 2026-02-26 12:35:47.207628 | controller | 2026-02-26 12:35:47.207667 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2026-02-26 12:35:47.207676 | controller | Thursday 26 February 2026 12:35:46 +0000 (0:00:00.328) 0:00:20.465 ***** 2026-02-26 12:35:47.207686 | controller | ok: [instance] 2026-02-26 12:35:47.521131 | controller | 2026-02-26 12:35:47.521163 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2026-02-26 12:35:47.521171 | controller | Thursday 26 February 2026 12:35:47 +0000 (0:00:00.311) 0:00:20.777 ***** 2026-02-26 12:35:47.521181 | controller | ok: [instance] 2026-02-26 12:35:47.829303 | controller | 2026-02-26 12:35:47.829338 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2026-02-26 12:35:47.829346 | controller | Thursday 26 February 2026 12:35:47 +0000 (0:00:00.313) 0:00:21.091 ***** 2026-02-26 12:35:47.829356 | controller | ok: [instance] 2026-02-26 12:35:47.829381 | controller | 2026-02-26 12:35:47.829493 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2026-02-26 12:35:47.829511 | controller | Thursday 26 February 2026 12:35:47 +0000 (0:00:00.308) 0:00:21.399 ***** 2026-02-26 12:35:48.147300 | controller | ok: [instance] 2026-02-26 12:35:48.147363 | controller | 2026-02-26 12:35:48.147503 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2026-02-26 12:35:48.458295 | controller | Thursday 26 February 2026 12:35:48 +0000 (0:00:00.317) 0:00:21.717 ***** 2026-02-26 12:35:48.458333 | controller | ok: [instance] 2026-02-26 12:35:48.458644 | controller | 2026-02-26 12:35:48.771796 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2026-02-26 12:35:48.771832 | controller | Thursday 26 February 2026 12:35:48 +0000 (0:00:00.310) 0:00:22.028 ***** 2026-02-26 12:35:48.771851 | controller | ok: [instance] 2026-02-26 12:35:49.087700 | controller | 2026-02-26 12:35:49.087735 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2026-02-26 12:35:49.087751 | controller | Thursday 26 February 2026 12:35:48 +0000 (0:00:00.313) 0:00:22.341 ***** 2026-02-26 12:35:49.087762 | controller | ok: [instance] 2026-02-26 12:35:49.396990 | controller | 2026-02-26 12:35:49.397025 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2026-02-26 12:35:49.397033 | controller | Thursday 26 February 2026 12:35:49 +0000 (0:00:00.316) 0:00:22.657 ***** 2026-02-26 12:35:49.397045 | controller | ok: [instance] 2026-02-26 12:35:49.419236 | controller | 2026-02-26 12:35:49.419261 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2026-02-26 12:35:49.419268 | controller | Thursday 26 February 2026 12:35:49 +0000 (0:00:00.309) 0:00:22.966 ***** 2026-02-26 12:35:49.419278 | controller | skipping: [instance] 2026-02-26 12:35:49.694040 | controller | 2026-02-26 12:35:49.694071 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2026-02-26 12:35:49.694079 | controller | Thursday 26 February 2026 12:35:49 +0000 (0:00:00.022) 0:00:22.989 ***** 2026-02-26 12:35:49.694090 | controller | ok: [instance] 2026-02-26 12:35:50.060893 | controller | 2026-02-26 12:35:50.060925 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2026-02-26 12:35:50.060933 | controller | Thursday 26 February 2026 12:35:49 +0000 (0:00:00.274) 0:00:23.264 ***** 2026-02-26 12:35:50.060943 | controller | ok: [instance] 2026-02-26 12:35:50.361322 | controller | 2026-02-26 12:35:50.361357 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2026-02-26 12:35:50.361368 | controller | Thursday 26 February 2026 12:35:50 +0000 (0:00:00.366) 0:00:23.630 ***** 2026-02-26 12:35:50.361381 | controller | changed: [instance] 2026-02-26 12:35:50.361409 | controller | 2026-02-26 12:35:50.361419 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2026-02-26 12:35:50.361443 | controller | Thursday 26 February 2026 12:35:50 +0000 (0:00:00.300) 0:00:23.931 ***** 2026-02-26 12:35:50.610902 | controller | [WARNING]: Reset is not implemented for this connection 2026-02-26 12:35:50.620303 | controller | changed: [instance] 2026-02-26 12:35:50.620338 | controller | 2026-02-26 12:35:50.620349 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2026-02-26 12:35:50.620712 | controller | Thursday 26 February 2026 12:35:50 +0000 (0:00:00.243) 0:00:24.175 ***** 2026-02-26 12:35:50.689188 | controller | 2026-02-26 12:35:50.689228 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2026-02-26 12:35:50.689250 | controller | Thursday 26 February 2026 12:35:50 +0000 (0:00:00.015) 0:00:24.190 ***** 2026-02-26 12:35:50.689261 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2026-02-26 12:35:50.729807 | controller | 2026-02-26 12:35:50.729834 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2026-02-26 12:35:50.729844 | controller | Thursday 26 February 2026 12:35:50 +0000 (0:00:00.068) 0:00:24.259 ***** 2026-02-26 12:35:50.729859 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2026-02-26 12:35:50.775347 | controller | 2026-02-26 12:35:50.775373 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-02-26 12:35:50.775382 | controller | Thursday 26 February 2026 12:35:50 +0000 (0:00:00.040) 0:00:24.300 ***** 2026-02-26 12:35:50.775392 | controller | ok: [instance] => (item=compute) 2026-02-26 12:35:50.815622 | controller | ok: [instance] => (item=controller) 2026-02-26 12:35:50.815646 | controller | ok: [instance] => (item=crc) 2026-02-26 12:35:50.815654 | controller | 2026-02-26 12:35:50.815661 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-02-26 12:35:50.815667 | controller | Thursday 26 February 2026 12:35:50 +0000 (0:00:00.045) 0:00:24.345 ***** 2026-02-26 12:35:50.815677 | controller | ok: [instance] 2026-02-26 12:35:50.853957 | controller | 2026-02-26 12:35:50.853994 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-02-26 12:35:50.854011 | controller | Thursday 26 February 2026 12:35:50 +0000 (0:00:00.040) 0:00:24.385 ***** 2026-02-26 12:35:50.854021 | controller | ok: [instance] => changed=false 2026-02-26 12:35:50.854186 | controller | msg: All assertions passed 2026-02-26 12:35:50.854330 | controller | 2026-02-26 12:35:50.854457 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2026-02-26 12:35:50.854575 | controller | Thursday 26 February 2026 12:35:50 +0000 (0:00:00.038) 0:00:24.424 ***** 2026-02-26 12:35:50.897934 | controller | 2026-02-26 12:35:50.898235 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2026-02-26 12:35:50.898388 | controller | Thursday 26 February 2026 12:35:50 +0000 (0:00:00.043) 0:00:24.468 ***** 2026-02-26 12:35:50.976265 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.49', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2026-02-26 12:35:50.976447 | controller | ok: [instance] => (item={}) 2026-02-26 12:35:50.976576 | controller | 2026-02-26 12:35:50.976709 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2026-02-26 12:35:50.976836 | controller | Thursday 26 February 2026 12:35:50 +0000 (0:00:00.077) 0:00:24.546 ***** 2026-02-26 12:35:50.992201 | controller | skipping: [instance] 2026-02-26 12:35:50.992416 | controller | 2026-02-26 12:35:50.992558 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2026-02-26 12:35:50.992689 | controller | Thursday 26 February 2026 12:35:50 +0000 (0:00:00.016) 0:00:24.562 ***** 2026-02-26 12:35:51.196387 | controller | ok: [instance] 2026-02-26 12:35:51.196438 | controller | 2026-02-26 12:35:51.196450 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2026-02-26 12:35:51.196556 | controller | Thursday 26 February 2026 12:35:51 +0000 (0:00:00.203) 0:00:24.766 ***** 2026-02-26 12:35:51.520939 | controller | changed: [instance] 2026-02-26 12:35:52.273377 | controller | 2026-02-26 12:35:52.273411 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2026-02-26 12:35:52.273420 | controller | Thursday 26 February 2026 12:35:51 +0000 (0:00:00.324) 0:00:25.091 ***** 2026-02-26 12:35:52.273432 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2026-02-26 12:35:52.273459 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2026-02-26 12:35:52.273466 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2026-02-26 12:35:52.273472 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2026-02-26 12:35:52.273478 | controller | 2026-02-26 12:35:52.273486 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2026-02-26 12:35:52.273494 | controller | Thursday 26 February 2026 12:35:52 +0000 (0:00:00.752) 0:00:25.843 ***** 2026-02-26 12:35:52.297962 | controller | skipping: [instance] 2026-02-26 12:35:52.646019 | controller | 2026-02-26 12:35:52.646050 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2026-02-26 12:35:52.646059 | controller | Thursday 26 February 2026 12:35:52 +0000 (0:00:00.025) 0:00:25.868 ***** 2026-02-26 12:35:52.646069 | controller | changed: [instance] 2026-02-26 12:35:53.063364 | controller | 2026-02-26 12:35:53.063393 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2026-02-26 12:35:53.063402 | controller | Thursday 26 February 2026 12:35:52 +0000 (0:00:00.339) 0:00:26.208 ***** 2026-02-26 12:35:53.063408 | controller | 2026-02-26 12:35:53.063414 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-26 12:35:53.063419 | controller | Thursday 26 February 2026 12:35:52 +0000 (0:00:00.007) 0:00:26.216 ***** 2026-02-26 12:35:53.063436 | controller | changed: [instance] 2026-02-26 12:35:53.131336 | controller | 2026-02-26 12:35:53.131364 | controller | TASK [Ensure no default networks exists] *************************************** 2026-02-26 12:35:53.131373 | controller | Thursday 26 February 2026 12:35:53 +0000 (0:00:00.417) 0:00:26.633 ***** 2026-02-26 12:35:53.131383 | controller | 2026-02-26 12:35:54.276749 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2026-02-26 12:35:54.276778 | controller | Thursday 26 February 2026 12:35:53 +0000 (0:00:00.068) 0:00:26.701 ***** 2026-02-26 12:35:54.276791 | controller | ok: [instance] 2026-02-26 12:35:54.504351 | controller | 2026-02-26 12:35:54.504384 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2026-02-26 12:35:54.504394 | controller | Thursday 26 February 2026 12:35:54 +0000 (0:00:01.145) 0:00:27.846 ***** 2026-02-26 12:35:54.504407 | controller | ok: [instance] 2026-02-26 12:35:54.504620 | controller | 2026-02-26 12:35:54.504656 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2026-02-26 12:35:55.027301 | controller | Thursday 26 February 2026 12:35:54 +0000 (0:00:00.227) 0:00:28.074 ***** 2026-02-26 12:35:55.027339 | controller | ok: [instance] 2026-02-26 12:35:55.252636 | controller | 2026-02-26 12:35:55.252667 | controller | TASK [libvirt_manager : Removing default] ************************************** 2026-02-26 12:35:55.252675 | controller | Thursday 26 February 2026 12:35:55 +0000 (0:00:00.522) 0:00:28.597 ***** 2026-02-26 12:35:55.252685 | controller | ok: [instance] 2026-02-26 12:35:56.406734 | controller | 2026-02-26 12:35:56.406762 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2026-02-26 12:35:56.406770 | controller | Thursday 26 February 2026 12:35:55 +0000 (0:00:00.225) 0:00:28.822 ***** 2026-02-26 12:35:56.406779 | controller | ok: [instance] 2026-02-26 12:35:56.699731 | controller | 2026-02-26 12:35:56.699764 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2026-02-26 12:35:56.699774 | controller | Thursday 26 February 2026 12:35:56 +0000 (0:00:01.154) 0:00:29.977 ***** 2026-02-26 12:35:56.699794 | controller | ok: [instance] 2026-02-26 12:35:56.993598 | controller | 2026-02-26 12:35:56.993629 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2026-02-26 12:35:56.993639 | controller | Thursday 26 February 2026 12:35:56 +0000 (0:00:00.292) 0:00:30.269 ***** 2026-02-26 12:35:56.993651 | controller | changed: [instance] 2026-02-26 12:35:57.284680 | controller | 2026-02-26 12:35:57.284717 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2026-02-26 12:35:57.284726 | controller | Thursday 26 February 2026 12:35:56 +0000 (0:00:00.293) 0:00:30.563 ***** 2026-02-26 12:35:57.284736 | controller | changed: [instance] 2026-02-26 12:35:58.847265 | controller | 2026-02-26 12:35:58.847298 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2026-02-26 12:35:58.847306 | controller | Thursday 26 February 2026 12:35:57 +0000 (0:00:00.291) 0:00:30.854 ***** 2026-02-26 12:35:58.847316 | controller | changed: [instance] => (item=arptables) 2026-02-26 12:35:59.152343 | controller | changed: [instance] => (item=iptables) 2026-02-26 12:35:59.152385 | controller | changed: [instance] => (item=ip6tables) 2026-02-26 12:35:59.152394 | controller | 2026-02-26 12:35:59.152402 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2026-02-26 12:35:59.152409 | controller | Thursday 26 February 2026 12:35:58 +0000 (0:00:01.562) 0:00:32.417 ***** 2026-02-26 12:35:59.152423 | controller | ok: [instance] 2026-02-26 12:35:59.152453 | controller | 2026-02-26 12:35:59.152464 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2026-02-26 12:35:59.246365 | controller | Thursday 26 February 2026 12:35:59 +0000 (0:00:00.305) 0:00:32.722 ***** 2026-02-26 12:35:59.246409 | controller | ok: [instance] 2026-02-26 12:35:59.246501 | controller | 2026-02-26 12:35:59.246535 | controller | TASK [Ensure the required network configurations are applied] ****************** 2026-02-26 12:35:59.246550 | controller | Thursday 26 February 2026 12:35:59 +0000 (0:00:00.093) 0:00:32.816 ***** 2026-02-26 12:35:59.289396 | controller | 2026-02-26 12:35:59.289585 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2026-02-26 12:35:59.289628 | controller | Thursday 26 February 2026 12:35:59 +0000 (0:00:00.043) 0:00:32.859 ***** 2026-02-26 12:35:59.311250 | controller | skipping: [instance] 2026-02-26 12:35:59.334096 | controller | 2026-02-26 12:35:59.334126 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2026-02-26 12:35:59.334138 | controller | Thursday 26 February 2026 12:35:59 +0000 (0:00:00.021) 0:00:32.881 ***** 2026-02-26 12:35:59.334153 | controller | skipping: [instance] 2026-02-26 12:35:59.354292 | controller | 2026-02-26 12:35:59.354321 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-26 12:35:59.354329 | controller | Thursday 26 February 2026 12:35:59 +0000 (0:00:00.022) 0:00:32.904 ***** 2026-02-26 12:35:59.354339 | controller | skipping: [instance] 2026-02-26 12:35:59.354484 | controller | 2026-02-26 12:35:59.354508 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2026-02-26 12:35:59.380909 | controller | Thursday 26 February 2026 12:35:59 +0000 (0:00:00.020) 0:00:32.924 ***** 2026-02-26 12:35:59.380943 | controller | skipping: [instance] 2026-02-26 12:35:59.418888 | controller | 2026-02-26 12:35:59.418910 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2026-02-26 12:35:59.418919 | controller | Thursday 26 February 2026 12:35:59 +0000 (0:00:00.026) 0:00:32.951 ***** 2026-02-26 12:35:59.418930 | controller | ok: [instance] 2026-02-26 12:35:59.449687 | controller | 2026-02-26 12:35:59.449708 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2026-02-26 12:35:59.449717 | controller | Thursday 26 February 2026 12:35:59 +0000 (0:00:00.038) 0:00:32.989 ***** 2026-02-26 12:35:59.449727 | controller | skipping: [instance] 2026-02-26 12:35:59.472979 | controller | 2026-02-26 12:35:59.473008 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2026-02-26 12:35:59.473015 | controller | Thursday 26 February 2026 12:35:59 +0000 (0:00:00.030) 0:00:33.020 ***** 2026-02-26 12:35:59.473023 | controller | skipping: [instance] 2026-02-26 12:35:59.473150 | controller | 2026-02-26 12:35:59.473306 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2026-02-26 12:35:59.473432 | controller | Thursday 26 February 2026 12:35:59 +0000 (0:00:00.023) 0:00:33.043 ***** 2026-02-26 12:35:59.526977 | controller | ok: [instance] 2026-02-26 12:35:59.527274 | controller | 2026-02-26 12:35:59.527516 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2026-02-26 12:35:59.527694 | controller | Thursday 26 February 2026 12:35:59 +0000 (0:00:00.053) 0:00:33.097 ***** 2026-02-26 12:35:59.547731 | controller | skipping: [instance] 2026-02-26 12:35:59.547893 | controller | 2026-02-26 12:35:59.548060 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2026-02-26 12:35:59.548237 | controller | Thursday 26 February 2026 12:35:59 +0000 (0:00:00.020) 0:00:33.118 ***** 2026-02-26 12:35:59.592458 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2026-02-26 12:35:59.592595 | controller | 2026-02-26 12:35:59.592721 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-26 12:35:59.592842 | controller | Thursday 26 February 2026 12:35:59 +0000 (0:00:00.044) 0:00:33.163 ***** 2026-02-26 12:35:59.895144 | controller | ok: [instance -> localhost] 2026-02-26 12:35:59.895332 | controller | 2026-02-26 12:35:59.895462 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2026-02-26 12:35:59.895583 | controller | Thursday 26 February 2026 12:35:59 +0000 (0:00:00.302) 0:00:33.465 ***** 2026-02-26 12:36:04.734838 | controller | changed: [instance -> localhost] 2026-02-26 12:36:04.918606 | controller | 2026-02-26 12:36:04.918637 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-26 12:36:04.918645 | controller | Thursday 26 February 2026 12:36:04 +0000 (0:00:04.839) 0:00:38.304 ***** 2026-02-26 12:36:04.918654 | controller | changed: [instance] 2026-02-26 12:36:05.261761 | controller | 2026-02-26 12:36:05.261782 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2026-02-26 12:36:05.261789 | controller | Thursday 26 February 2026 12:36:04 +0000 (0:00:00.183) 0:00:38.489 ***** 2026-02-26 12:36:05.261805 | controller | changed: [instance] 2026-02-26 12:36:06.875359 | controller | 2026-02-26 12:36:06.875407 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2026-02-26 12:36:06.875418 | controller | Thursday 26 February 2026 12:36:05 +0000 (0:00:00.343) 0:00:38.832 ***** 2026-02-26 12:36:06.875434 | controller | changed: [instance -> localhost] 2026-02-26 12:36:07.237277 | controller | 2026-02-26 12:36:07.237307 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2026-02-26 12:36:07.237315 | controller | Thursday 26 February 2026 12:36:06 +0000 (0:00:01.613) 0:00:40.445 ***** 2026-02-26 12:36:07.237324 | controller | changed: [instance] 2026-02-26 12:36:07.268380 | controller | 2026-02-26 12:36:07.268421 | controller | TASK [reproducer : Select right domain] **************************************** 2026-02-26 12:36:07.268432 | controller | Thursday 26 February 2026 12:36:07 +0000 (0:00:00.362) 0:00:40.807 ***** 2026-02-26 12:36:07.268446 | controller | ok: [instance] 2026-02-26 12:36:07.268491 | controller | 2026-02-26 12:36:07.268724 | controller | TASK [Create the virtual networks] ********************************************* 2026-02-26 12:36:07.400981 | controller | Thursday 26 February 2026 12:36:07 +0000 (0:00:00.031) 0:00:40.838 ***** 2026-02-26 12:36:07.401040 | controller | 2026-02-26 12:36:07.421297 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2026-02-26 12:36:07.421317 | controller | Thursday 26 February 2026 12:36:07 +0000 (0:00:00.132) 0:00:40.971 ***** 2026-02-26 12:36:07.421329 | controller | ok: [instance] 2026-02-26 12:36:07.606270 | controller | 2026-02-26 12:36:07.606288 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2026-02-26 12:36:07.606296 | controller | Thursday 26 February 2026 12:36:07 +0000 (0:00:00.020) 0:00:40.991 ***** 2026-02-26 12:36:07.606305 | controller | ok: [instance] 2026-02-26 12:36:07.606534 | controller | 2026-02-26 12:36:07.606547 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2026-02-26 12:36:07.636389 | controller | Thursday 26 February 2026 12:36:07 +0000 (0:00:00.185) 0:00:41.176 ***** 2026-02-26 12:36:07.636436 | controller | skipping: [instance] 2026-02-26 12:36:07.636480 | controller | 2026-02-26 12:36:07.636494 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2026-02-26 12:36:07.636657 | controller | Thursday 26 February 2026 12:36:07 +0000 (0:00:00.029) 0:00:41.206 ***** 2026-02-26 12:36:07.665381 | controller | skipping: [instance] 2026-02-26 12:36:07.716807 | controller | 2026-02-26 12:36:07.716831 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2026-02-26 12:36:07.716840 | controller | Thursday 26 February 2026 12:36:07 +0000 (0:00:00.028) 0:00:41.235 ***** 2026-02-26 12:36:07.716850 | controller | ok: [instance] 2026-02-26 12:36:07.841204 | controller | 2026-02-26 12:36:07.841251 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2026-02-26 12:36:07.841260 | controller | Thursday 26 February 2026 12:36:07 +0000 (0:00:00.051) 0:00:41.287 ***** 2026-02-26 12:36:07.841271 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-26 12:36:07.874515 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-26 12:36:07.874613 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-26 12:36:07.874622 | controller | 2026-02-26 12:36:07.874628 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2026-02-26 12:36:07.874634 | controller | Thursday 26 February 2026 12:36:07 +0000 (0:00:00.123) 0:00:41.411 ***** 2026-02-26 12:36:07.874684 | controller | skipping: [instance] 2026-02-26 12:36:08.229259 | controller | 2026-02-26 12:36:08.229302 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2026-02-26 12:36:08.229312 | controller | Thursday 26 February 2026 12:36:07 +0000 (0:00:00.033) 0:00:41.444 ***** 2026-02-26 12:36:08.229324 | controller | changed: [instance] 2026-02-26 12:36:08.321489 | controller | 2026-02-26 12:36:08.321584 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2026-02-26 12:36:08.321600 | controller | Thursday 26 February 2026 12:36:08 +0000 (0:00:00.354) 0:00:41.799 ***** 2026-02-26 12:36:08.321647 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2026-02-26 12:36:08.374908 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2026-02-26 12:36:08.374938 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2026-02-26 12:36:08.374947 | controller | 2026-02-26 12:36:08.374954 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-26 12:36:08.374960 | controller | Thursday 26 February 2026 12:36:08 +0000 (0:00:00.091) 0:00:41.891 ***** 2026-02-26 12:36:08.374969 | controller | changed: [instance] 2026-02-26 12:36:08.692125 | controller | 2026-02-26 12:36:08.692160 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-26 12:36:08.692174 | controller | Thursday 26 February 2026 12:36:08 +0000 (0:00:00.053) 0:00:41.945 ***** 2026-02-26 12:36:08.692189 | controller | changed: [instance] 2026-02-26 12:36:08.914816 | controller | 2026-02-26 12:36:08.914835 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-26 12:36:08.914842 | controller | Thursday 26 February 2026 12:36:08 +0000 (0:00:00.316) 0:00:42.262 ***** 2026-02-26 12:36:08.914850 | controller | changed: [instance] 2026-02-26 12:36:08.966318 | controller | 2026-02-26 12:36:08.966355 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-26 12:36:08.966363 | controller | Thursday 26 February 2026 12:36:08 +0000 (0:00:00.223) 0:00:42.485 ***** 2026-02-26 12:36:08.966374 | controller | changed: [instance] 2026-02-26 12:36:08.966401 | controller | 2026-02-26 12:36:08.966808 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-26 12:36:09.168937 | controller | Thursday 26 February 2026 12:36:08 +0000 (0:00:00.051) 0:00:42.536 ***** 2026-02-26 12:36:09.168958 | controller | changed: [instance] 2026-02-26 12:36:09.380053 | controller | 2026-02-26 12:36:09.380080 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-26 12:36:09.380088 | controller | Thursday 26 February 2026 12:36:09 +0000 (0:00:00.202) 0:00:42.739 ***** 2026-02-26 12:36:09.380097 | controller | changed: [instance] 2026-02-26 12:36:09.431735 | controller | 2026-02-26 12:36:09.431759 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-26 12:36:09.431768 | controller | Thursday 26 February 2026 12:36:09 +0000 (0:00:00.211) 0:00:42.950 ***** 2026-02-26 12:36:09.431779 | controller | changed: [instance] 2026-02-26 12:36:09.624821 | controller | 2026-02-26 12:36:09.624839 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-26 12:36:09.624846 | controller | Thursday 26 February 2026 12:36:09 +0000 (0:00:00.051) 0:00:43.002 ***** 2026-02-26 12:36:09.624854 | controller | changed: [instance] 2026-02-26 12:36:09.828708 | controller | 2026-02-26 12:36:09.828734 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-26 12:36:09.828742 | controller | Thursday 26 February 2026 12:36:09 +0000 (0:00:00.193) 0:00:43.195 ***** 2026-02-26 12:36:09.828752 | controller | changed: [instance] 2026-02-26 12:36:10.016362 | controller | 2026-02-26 12:36:10.016391 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2026-02-26 12:36:10.016399 | controller | Thursday 26 February 2026 12:36:09 +0000 (0:00:00.203) 0:00:43.399 ***** 2026-02-26 12:36:10.016410 | controller | ok: [instance] 2026-02-26 12:36:10.507814 | controller | 2026-02-26 12:36:10.507860 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2026-02-26 12:36:10.507870 | controller | Thursday 26 February 2026 12:36:10 +0000 (0:00:00.187) 0:00:43.586 ***** 2026-02-26 12:36:10.507883 | controller | changed: [instance] 2026-02-26 12:36:10.685429 | controller | 2026-02-26 12:36:10.685484 | controller | TASK [libvirt_manager : Remove ini file after conversion] ********************** 2026-02-26 12:36:10.685499 | controller | Thursday 26 February 2026 12:36:10 +0000 (0:00:00.491) 0:00:44.077 ***** 2026-02-26 12:36:10.685531 | controller | changed: [instance] 2026-02-26 12:36:10.710053 | controller | 2026-02-26 12:36:10.710079 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-26 12:36:10.710089 | controller | Thursday 26 February 2026 12:36:10 +0000 (0:00:00.177) 0:00:44.255 ***** 2026-02-26 12:36:10.710099 | controller | skipping: [instance] 2026-02-26 12:36:10.732765 | controller | 2026-02-26 12:36:10.732793 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-26 12:36:10.732809 | controller | Thursday 26 February 2026 12:36:10 +0000 (0:00:00.024) 0:00:44.280 ***** 2026-02-26 12:36:10.732821 | controller | skipping: [instance] 2026-02-26 12:36:10.754757 | controller | 2026-02-26 12:36:10.754778 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-26 12:36:10.754787 | controller | Thursday 26 February 2026 12:36:10 +0000 (0:00:00.022) 0:00:44.303 ***** 2026-02-26 12:36:10.754797 | controller | skipping: [instance] 2026-02-26 12:36:10.776664 | controller | 2026-02-26 12:36:10.776684 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-26 12:36:10.776692 | controller | Thursday 26 February 2026 12:36:10 +0000 (0:00:00.022) 0:00:44.325 ***** 2026-02-26 12:36:10.776702 | controller | skipping: [instance] 2026-02-26 12:36:10.794153 | controller | 2026-02-26 12:36:10.794173 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-26 12:36:10.794182 | controller | Thursday 26 February 2026 12:36:10 +0000 (0:00:00.021) 0:00:44.347 ***** 2026-02-26 12:36:10.794192 | controller | ok: [instance] 2026-02-26 12:36:10.873407 | controller | 2026-02-26 12:36:10.873428 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-26 12:36:10.873437 | controller | Thursday 26 February 2026 12:36:10 +0000 (0:00:00.017) 0:00:44.364 ***** 2026-02-26 12:36:10.873451 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-26 12:36:10.873608 | controller | 2026-02-26 12:36:10.873776 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-26 12:36:10.873922 | controller | Thursday 26 February 2026 12:36:10 +0000 (0:00:00.079) 0:00:44.444 ***** 2026-02-26 12:36:10.891506 | controller | skipping: [instance] 2026-02-26 12:36:10.891664 | controller | 2026-02-26 12:36:10.891815 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-26 12:36:10.891959 | controller | Thursday 26 February 2026 12:36:10 +0000 (0:00:00.018) 0:00:44.462 ***** 2026-02-26 12:36:11.102341 | controller | changed: [instance] 2026-02-26 12:36:11.496060 | controller | 2026-02-26 12:36:11.496106 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-26 12:36:11.496120 | controller | Thursday 26 February 2026 12:36:11 +0000 (0:00:00.210) 0:00:44.672 ***** 2026-02-26 12:36:11.496138 | controller | changed: [instance] 2026-02-26 12:36:11.556335 | controller | 2026-02-26 12:36:11.556367 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-26 12:36:11.556376 | controller | Thursday 26 February 2026 12:36:11 +0000 (0:00:00.392) 0:00:45.065 ***** 2026-02-26 12:36:11.556387 | controller | ok: [instance] 2026-02-26 12:36:11.556414 | controller | 2026-02-26 12:36:11.556422 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-26 12:36:11.556552 | controller | Thursday 26 February 2026 12:36:11 +0000 (0:00:00.061) 0:00:45.126 ***** 2026-02-26 12:36:11.586314 | controller | ok: [instance] 2026-02-26 12:36:11.982916 | controller | 2026-02-26 12:36:11.982945 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-26 12:36:11.982953 | controller | Thursday 26 February 2026 12:36:11 +0000 (0:00:00.029) 0:00:45.156 ***** 2026-02-26 12:36:11.982963 | controller | changed: [instance] 2026-02-26 12:36:12.105601 | controller | 2026-02-26 12:36:12.105631 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2026-02-26 12:36:12.105638 | controller | Thursday 26 February 2026 12:36:11 +0000 (0:00:00.396) 0:00:45.553 ***** 2026-02-26 12:36:12.105646 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2026-02-26 12:36:12.153307 | controller | 2026-02-26 12:36:12.153346 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2026-02-26 12:36:12.153355 | controller | Thursday 26 February 2026 12:36:12 +0000 (0:00:00.122) 0:00:45.675 ***** 2026-02-26 12:36:12.153366 | controller | ok: [instance] => (item=public) 2026-02-26 12:36:12.153391 | controller | ok: [instance] => (item=osp_trunk) 2026-02-26 12:36:12.153399 | controller | 2026-02-26 12:36:12.153650 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2026-02-26 12:36:12.577669 | controller | Thursday 26 February 2026 12:36:12 +0000 (0:00:00.047) 0:00:45.723 ***** 2026-02-26 12:36:12.577691 | controller | changed: [instance] => (item=cifmw-public) 2026-02-26 12:36:13.180326 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-26 12:36:13.180376 | controller | 2026-02-26 12:36:13.180386 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2026-02-26 12:36:13.180395 | controller | Thursday 26 February 2026 12:36:12 +0000 (0:00:00.424) 0:00:46.148 ***** 2026-02-26 12:36:13.180409 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 12:36:13.180457 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 12:36:13.180468 | controller | 2026-02-26 12:36:13.180553 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2026-02-26 12:36:13.180580 | controller | Thursday 26 February 2026 12:36:13 +0000 (0:00:00.602) 0:00:46.750 ***** 2026-02-26 12:36:13.643338 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 12:36:13.643409 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 12:36:13.643684 | controller | 2026-02-26 12:36:14.089349 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2026-02-26 12:36:14.089381 | controller | Thursday 26 February 2026 12:36:13 +0000 (0:00:00.463) 0:00:47.213 ***** 2026-02-26 12:36:14.089574 | controller | changed: [instance] => (item=cifmw-public) 2026-02-26 12:36:14.089644 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-26 12:36:14.154392 | controller | 2026-02-26 12:36:14.154439 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2026-02-26 12:36:14.154451 | controller | Thursday 26 February 2026 12:36:14 +0000 (0:00:00.445) 0:00:47.659 ***** 2026-02-26 12:36:14.154464 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2026-02-26 12:36:14.344356 | controller | 2026-02-26 12:36:14.344400 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2026-02-26 12:36:14.344410 | controller | Thursday 26 February 2026 12:36:14 +0000 (0:00:00.064) 0:00:47.724 ***** 2026-02-26 12:36:14.344423 | controller | ok: [instance] 2026-02-26 12:36:14.719734 | controller | 2026-02-26 12:36:14.719758 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2026-02-26 12:36:14.719767 | controller | Thursday 26 February 2026 12:36:14 +0000 (0:00:00.189) 0:00:47.914 ***** 2026-02-26 12:36:14.719777 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 12:36:14.786009 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 12:36:14.786063 | controller | 2026-02-26 12:36:14.786077 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2026-02-26 12:36:14.786087 | controller | Thursday 26 February 2026 12:36:14 +0000 (0:00:00.375) 0:00:48.289 ***** 2026-02-26 12:36:14.786102 | controller | 2026-02-26 12:36:14.823823 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-26 12:36:14.823840 | controller | Thursday 26 February 2026 12:36:14 +0000 (0:00:00.066) 0:00:48.356 ***** 2026-02-26 12:36:14.823850 | controller | skipping: [instance] 2026-02-26 12:36:16.051196 | controller | 2026-02-26 12:36:16.051245 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2026-02-26 12:36:16.051253 | controller | Thursday 26 February 2026 12:36:14 +0000 (0:00:00.037) 0:00:48.394 ***** 2026-02-26 12:36:16.051263 | controller | ok: [instance] 2026-02-26 12:36:16.236889 | controller | 2026-02-26 12:36:16.236907 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-26 12:36:16.236914 | controller | Thursday 26 February 2026 12:36:16 +0000 (0:00:01.226) 0:00:49.621 ***** 2026-02-26 12:36:16.236922 | controller | ok: [instance] 2026-02-26 12:36:16.589743 | controller | 2026-02-26 12:36:16.589780 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2026-02-26 12:36:16.589791 | controller | Thursday 26 February 2026 12:36:16 +0000 (0:00:00.186) 0:00:49.807 ***** 2026-02-26 12:36:16.589804 | controller | changed: [instance] 2026-02-26 12:36:18.234740 | controller | 2026-02-26 12:36:18.234774 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2026-02-26 12:36:18.234783 | controller | Thursday 26 February 2026 12:36:16 +0000 (0:00:00.352) 0:00:50.159 ***** 2026-02-26 12:36:18.234793 | controller | changed: [instance] 2026-02-26 12:36:18.581122 | controller | 2026-02-26 12:36:18.581144 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2026-02-26 12:36:18.581151 | controller | Thursday 26 February 2026 12:36:18 +0000 (0:00:01.644) 0:00:51.804 ***** 2026-02-26 12:36:18.581159 | controller | changed: [instance] 2026-02-26 12:36:18.614942 | controller | 2026-02-26 12:36:18.614960 | controller | TASK [Create extra network configuration] ************************************** 2026-02-26 12:36:18.614967 | controller | Thursday 26 February 2026 12:36:18 +0000 (0:00:00.346) 0:00:52.151 ***** 2026-02-26 12:36:18.614976 | controller | skipping: [instance] 2026-02-26 12:36:18.644087 | controller | 2026-02-26 12:36:18.644105 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2026-02-26 12:36:18.644112 | controller | Thursday 26 February 2026 12:36:18 +0000 (0:00:00.033) 0:00:52.185 ***** 2026-02-26 12:36:18.644120 | controller | skipping: [instance] 2026-02-26 12:36:19.082384 | controller | 2026-02-26 12:36:19.082434 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2026-02-26 12:36:19.082448 | controller | Thursday 26 February 2026 12:36:18 +0000 (0:00:00.029) 0:00:52.214 ***** 2026-02-26 12:36:19.082466 | controller | ok: [instance] 2026-02-26 12:36:19.082519 | controller | 2026-02-26 12:36:19.082535 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2026-02-26 12:36:19.216956 | controller | Thursday 26 February 2026 12:36:19 +0000 (0:00:00.438) 0:00:52.652 ***** 2026-02-26 12:36:19.216983 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 12:36:20.382313 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 12:36:20.382337 | controller | 2026-02-26 12:36:20.382345 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2026-02-26 12:36:20.382357 | controller | Thursday 26 February 2026 12:36:19 +0000 (0:00:00.134) 0:00:52.787 ***** 2026-02-26 12:36:20.382367 | controller | ok: [instance] 2026-02-26 12:36:20.382391 | controller | 2026-02-26 12:36:20.382398 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2026-02-26 12:36:20.382406 | controller | Thursday 26 February 2026 12:36:20 +0000 (0:00:01.165) 0:00:53.952 ***** 2026-02-26 12:36:24.001083 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2026-02-26 12:36:24.250922 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2026-02-26 12:36:24.250953 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2026-02-26 12:36:24.250961 | controller | 2026-02-26 12:36:24.250966 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2026-02-26 12:36:24.250971 | controller | Thursday 26 February 2026 12:36:23 +0000 (0:00:03.618) 0:00:57.571 ***** 2026-02-26 12:36:24.250980 | controller | changed: [instance] 2026-02-26 12:36:24.624061 | controller | 2026-02-26 12:36:24.624082 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2026-02-26 12:36:24.624089 | controller | Thursday 26 February 2026 12:36:24 +0000 (0:00:00.249) 0:00:57.820 ***** 2026-02-26 12:36:24.624099 | controller | changed: [instance] 2026-02-26 12:36:25.044835 | controller | 2026-02-26 12:36:25.044870 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2026-02-26 12:36:25.044879 | controller | Thursday 26 February 2026 12:36:24 +0000 (0:00:00.373) 0:00:58.194 ***** 2026-02-26 12:36:25.044889 | controller | changed: [instance] 2026-02-26 12:36:25.081108 | controller | 2026-02-26 12:36:25.081140 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2026-02-26 12:36:25.081148 | controller | Thursday 26 February 2026 12:36:25 +0000 (0:00:00.420) 0:00:58.614 ***** 2026-02-26 12:36:25.081159 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2026-02-26 12:36:25.508652 | controller | 2026-02-26 12:36:25.508686 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2026-02-26 12:36:25.508695 | controller | Thursday 26 February 2026 12:36:25 +0000 (0:00:00.036) 0:00:58.651 ***** 2026-02-26 12:36:25.508705 | controller | changed: [instance] 2026-02-26 12:36:25.529360 | controller | 2026-02-26 12:36:25.529395 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2026-02-26 12:36:25.529406 | controller | Thursday 26 February 2026 12:36:25 +0000 (0:00:00.427) 0:00:59.078 ***** 2026-02-26 12:36:25.529418 | controller | skipping: [instance] 2026-02-26 12:36:25.529447 | controller | 2026-02-26 12:36:25.529458 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2026-02-26 12:36:25.529525 | controller | Thursday 26 February 2026 12:36:25 +0000 (0:00:00.021) 0:00:59.099 ***** 2026-02-26 12:36:25.565315 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2026-02-26 12:36:25.565646 | controller | 2026-02-26 12:36:25.941910 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2026-02-26 12:36:25.941942 | controller | Thursday 26 February 2026 12:36:25 +0000 (0:00:00.035) 0:00:59.135 ***** 2026-02-26 12:36:25.941953 | controller | changed: [instance] 2026-02-26 12:36:25.968292 | controller | 2026-02-26 12:36:25.968314 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2026-02-26 12:36:25.968322 | controller | Thursday 26 February 2026 12:36:25 +0000 (0:00:00.375) 0:00:59.511 ***** 2026-02-26 12:36:25.968344 | controller | skipping: [instance] 2026-02-26 12:36:25.968365 | controller | 2026-02-26 12:36:25.968465 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2026-02-26 12:36:25.968657 | controller | Thursday 26 February 2026 12:36:25 +0000 (0:00:00.027) 0:00:59.538 ***** 2026-02-26 12:36:26.189845 | controller | ok: [instance] => (item=127.0.0.2) 2026-02-26 12:36:26.908357 | controller | 2026-02-26 12:36:26.908416 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2026-02-26 12:36:26.908431 | controller | Thursday 26 February 2026 12:36:26 +0000 (0:00:00.221) 0:00:59.759 ***** 2026-02-26 12:36:26.908450 | controller | changed: [instance] 2026-02-26 12:36:26.928919 | controller | 2026-02-26 12:36:26.928956 | controller | TASK [dnsmasq : Stop service] ************************************************** 2026-02-26 12:36:26.928966 | controller | Thursday 26 February 2026 12:36:26 +0000 (0:00:00.718) 0:01:00.478 ***** 2026-02-26 12:36:26.928977 | controller | skipping: [instance] 2026-02-26 12:36:26.948066 | controller | 2026-02-26 12:36:26.948091 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2026-02-26 12:36:26.948099 | controller | Thursday 26 February 2026 12:36:26 +0000 (0:00:00.021) 0:01:00.499 ***** 2026-02-26 12:36:26.948110 | controller | skipping: [instance] 2026-02-26 12:36:26.979301 | controller | 2026-02-26 12:36:26.979326 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2026-02-26 12:36:26.979337 | controller | Thursday 26 February 2026 12:36:26 +0000 (0:00:00.019) 0:01:00.518 ***** 2026-02-26 12:36:26.979357 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-26 12:36:26.979583 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2026-02-26 12:36:26.979609 | controller | skipping: [instance] 2026-02-26 12:36:26.979622 | controller | 2026-02-26 12:36:26.979637 | controller | TASK [Create dnsmasq networks] ************************************************* 2026-02-26 12:36:27.090719 | controller | Thursday 26 February 2026 12:36:26 +0000 (0:00:00.030) 0:01:00.548 ***** 2026-02-26 12:36:27.090747 | controller | 2026-02-26 12:36:27.123208 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-26 12:36:27.123243 | controller | Thursday 26 February 2026 12:36:27 +0000 (0:00:00.112) 0:01:00.661 ***** 2026-02-26 12:36:27.123254 | controller | ok: [instance] => changed=false 2026-02-26 12:36:27.172831 | controller | msg: All assertions passed 2026-02-26 12:36:27.172861 | controller | 2026-02-26 12:36:27.172874 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-26 12:36:27.172884 | controller | Thursday 26 February 2026 12:36:27 +0000 (0:00:00.032) 0:01:00.693 ***** 2026-02-26 12:36:27.172898 | controller | ok: [instance] => changed=false 2026-02-26 12:36:27.173110 | controller | msg: All assertions passed 2026-02-26 12:36:27.173248 | controller | 2026-02-26 12:36:27.173380 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-26 12:36:27.173508 | controller | Thursday 26 February 2026 12:36:27 +0000 (0:00:00.050) 0:01:00.743 ***** 2026-02-26 12:36:27.626904 | controller | changed: [instance] 2026-02-26 12:36:27.627073 | controller | 2026-02-26 12:36:27.627204 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-26 12:36:27.627373 | controller | Thursday 26 February 2026 12:36:27 +0000 (0:00:00.453) 0:01:01.197 ***** 2026-02-26 12:36:27.652338 | controller | skipping: [instance] 2026-02-26 12:36:27.652500 | controller | 2026-02-26 12:36:27.652654 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-26 12:36:27.652809 | controller | Thursday 26 February 2026 12:36:27 +0000 (0:00:00.025) 0:01:01.222 ***** 2026-02-26 12:36:27.682087 | controller | skipping: [instance] 2026-02-26 12:36:27.682372 | controller | 2026-02-26 12:36:27.682603 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-26 12:36:27.682816 | controller | Thursday 26 February 2026 12:36:27 +0000 (0:00:00.029) 0:01:01.252 ***** 2026-02-26 12:36:27.718196 | controller | ok: [instance] => changed=false 2026-02-26 12:36:27.718405 | controller | msg: All assertions passed 2026-02-26 12:36:27.718551 | controller | 2026-02-26 12:36:27.718698 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-26 12:36:27.718849 | controller | Thursday 26 February 2026 12:36:27 +0000 (0:00:00.036) 0:01:01.288 ***** 2026-02-26 12:36:27.761907 | controller | ok: [instance] => changed=false 2026-02-26 12:36:27.762172 | controller | msg: All assertions passed 2026-02-26 12:36:27.762315 | controller | 2026-02-26 12:36:27.762449 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-26 12:36:27.762567 | controller | Thursday 26 February 2026 12:36:27 +0000 (0:00:00.043) 0:01:01.332 ***** 2026-02-26 12:36:28.207311 | controller | changed: [instance] 2026-02-26 12:36:28.227354 | controller | 2026-02-26 12:36:28.227393 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-26 12:36:28.227405 | controller | Thursday 26 February 2026 12:36:28 +0000 (0:00:00.444) 0:01:01.777 ***** 2026-02-26 12:36:28.227417 | controller | skipping: [instance] 2026-02-26 12:36:28.227440 | controller | 2026-02-26 12:36:28.227466 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-26 12:36:28.227573 | controller | Thursday 26 February 2026 12:36:28 +0000 (0:00:00.020) 0:01:01.798 ***** 2026-02-26 12:36:28.251196 | controller | skipping: [instance] 2026-02-26 12:36:28.251315 | controller | 2026-02-26 12:36:28.251411 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2026-02-26 12:36:28.251501 | controller | Thursday 26 February 2026 12:36:28 +0000 (0:00:00.023) 0:01:01.822 ***** 2026-02-26 12:36:28.280349 | controller | skipping: [instance] 2026-02-26 12:36:28.280412 | controller | 2026-02-26 12:36:28.280451 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2026-02-26 12:36:28.280581 | controller | Thursday 26 February 2026 12:36:28 +0000 (0:00:00.029) 0:01:01.851 ***** 2026-02-26 12:36:28.783295 | controller | changed: [instance] => (item=cifmw-public) 2026-02-26 12:36:28.820006 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-26 12:36:28.820043 | controller | 2026-02-26 12:36:28.820062 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-26 12:36:28.820069 | controller | Thursday 26 February 2026 12:36:28 +0000 (0:00:00.502) 0:01:02.353 ***** 2026-02-26 12:36:28.820080 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2026-02-26 12:36:29.176107 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2026-02-26 12:36:29.176149 | controller | 2026-02-26 12:36:29.176157 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-26 12:36:29.176164 | controller | Thursday 26 February 2026 12:36:28 +0000 (0:00:00.036) 0:01:02.390 ***** 2026-02-26 12:36:29.176173 | controller | ok: [instance] 2026-02-26 12:36:29.214324 | controller | 2026-02-26 12:36:29.214344 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-26 12:36:29.214358 | controller | Thursday 26 February 2026 12:36:29 +0000 (0:00:00.350) 0:01:02.740 ***** 2026-02-26 12:36:29.214369 | controller | ok: [instance] 2026-02-26 12:36:29.429355 | controller | 2026-02-26 12:36:29.429390 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-26 12:36:29.429401 | controller | Thursday 26 February 2026 12:36:29 +0000 (0:00:00.044) 0:01:02.784 ***** 2026-02-26 12:36:29.429412 | controller | ok: [instance] 2026-02-26 12:36:29.465341 | controller | 2026-02-26 12:36:29.465363 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-26 12:36:29.465371 | controller | Thursday 26 February 2026 12:36:29 +0000 (0:00:00.214) 0:01:02.999 ***** 2026-02-26 12:36:29.465382 | controller | ok: [instance] 2026-02-26 12:36:29.465468 | controller | 2026-02-26 12:36:29.465487 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2026-02-26 12:36:29.465498 | controller | Thursday 26 February 2026 12:36:29 +0000 (0:00:00.035) 0:01:03.035 ***** 2026-02-26 12:36:29.801823 | controller | changed: [instance] 2026-02-26 12:36:30.150872 | controller | 2026-02-26 12:36:30.150894 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2026-02-26 12:36:30.150906 | controller | Thursday 26 February 2026 12:36:29 +0000 (0:00:00.336) 0:01:03.372 ***** 2026-02-26 12:36:30.150915 | controller | changed: [instance] 2026-02-26 12:36:30.491772 | controller | 2026-02-26 12:36:30.491813 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2026-02-26 12:36:30.491824 | controller | Thursday 26 February 2026 12:36:30 +0000 (0:00:00.349) 0:01:03.721 ***** 2026-02-26 12:36:30.491837 | controller | changed: [instance] 2026-02-26 12:36:30.621617 | controller | 2026-02-26 12:36:30.621692 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2026-02-26 12:36:30.621703 | controller | Thursday 26 February 2026 12:36:30 +0000 (0:00:00.340) 0:01:04.061 ***** 2026-02-26 12:36:30.621720 | controller | ok: [instance] 2026-02-26 12:36:30.983410 | controller | 2026-02-26 12:36:30.983446 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2026-02-26 12:36:30.983456 | controller | Thursday 26 February 2026 12:36:30 +0000 (0:00:00.129) 0:01:04.191 ***** 2026-02-26 12:36:30.983467 | controller | changed: [instance] 2026-02-26 12:36:31.011002 | controller | 2026-02-26 12:36:31.011021 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-26 12:36:31.011028 | controller | Thursday 26 February 2026 12:36:30 +0000 (0:00:00.361) 0:01:04.553 ***** 2026-02-26 12:36:31.011037 | controller | skipping: [instance] 2026-02-26 12:36:31.070166 | controller | 2026-02-26 12:36:31.070232 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-26 12:36:31.070253 | controller | Thursday 26 February 2026 12:36:31 +0000 (0:00:00.027) 0:01:04.581 ***** 2026-02-26 12:36:31.070270 | controller | skipping: [instance] 2026-02-26 12:36:31.097877 | controller | 2026-02-26 12:36:31.097900 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-26 12:36:31.097909 | controller | Thursday 26 February 2026 12:36:31 +0000 (0:00:00.058) 0:01:04.640 ***** 2026-02-26 12:36:31.097920 | controller | skipping: [instance] 2026-02-26 12:36:31.125287 | controller | 2026-02-26 12:36:31.125309 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-26 12:36:31.125319 | controller | Thursday 26 February 2026 12:36:31 +0000 (0:00:00.028) 0:01:04.668 ***** 2026-02-26 12:36:31.125329 | controller | skipping: [instance] 2026-02-26 12:36:31.148644 | controller | 2026-02-26 12:36:31.148662 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-26 12:36:31.148669 | controller | Thursday 26 February 2026 12:36:31 +0000 (0:00:00.027) 0:01:04.695 ***** 2026-02-26 12:36:31.148678 | controller | ok: [instance] 2026-02-26 12:36:31.256208 | controller | 2026-02-26 12:36:31.256271 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-26 12:36:31.256282 | controller | Thursday 26 February 2026 12:36:31 +0000 (0:00:00.023) 0:01:04.718 ***** 2026-02-26 12:36:31.256300 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-26 12:36:31.256340 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-26 12:36:31.256351 | controller | 2026-02-26 12:36:31.256360 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-26 12:36:31.256519 | controller | Thursday 26 February 2026 12:36:31 +0000 (0:00:00.107) 0:01:04.826 ***** 2026-02-26 12:36:31.279197 | controller | skipping: [instance] 2026-02-26 12:36:31.279410 | controller | 2026-02-26 12:36:31.279577 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-26 12:36:31.279733 | controller | Thursday 26 February 2026 12:36:31 +0000 (0:00:00.023) 0:01:04.849 ***** 2026-02-26 12:36:31.491256 | controller | ok: [instance] 2026-02-26 12:36:31.885405 | controller | 2026-02-26 12:36:31.885456 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-26 12:36:31.885468 | controller | Thursday 26 February 2026 12:36:31 +0000 (0:00:00.211) 0:01:05.061 ***** 2026-02-26 12:36:31.885484 | controller | changed: [instance] 2026-02-26 12:36:31.885512 | controller | 2026-02-26 12:36:31.885524 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-26 12:36:31.950831 | controller | Thursday 26 February 2026 12:36:31 +0000 (0:00:00.394) 0:01:05.455 ***** 2026-02-26 12:36:31.950870 | controller | ok: [instance] 2026-02-26 12:36:31.984002 | controller | 2026-02-26 12:36:31.984036 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-26 12:36:31.984050 | controller | Thursday 26 February 2026 12:36:31 +0000 (0:00:00.065) 0:01:05.521 ***** 2026-02-26 12:36:31.984080 | controller | ok: [instance] 2026-02-26 12:36:32.400137 | controller | 2026-02-26 12:36:32.400170 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-26 12:36:32.400180 | controller | Thursday 26 February 2026 12:36:31 +0000 (0:00:00.032) 0:01:05.554 ***** 2026-02-26 12:36:32.400192 | controller | changed: [instance] 2026-02-26 12:36:32.441535 | controller | 2026-02-26 12:36:32.441591 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2026-02-26 12:36:32.441605 | controller | Thursday 26 February 2026 12:36:32 +0000 (0:00:00.416) 0:01:05.970 ***** 2026-02-26 12:36:32.441624 | controller | ok: [instance] 2026-02-26 12:36:32.465089 | controller | 2026-02-26 12:36:32.465110 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2026-02-26 12:36:32.465118 | controller | Thursday 26 February 2026 12:36:32 +0000 (0:00:00.041) 0:01:06.011 ***** 2026-02-26 12:36:32.465127 | controller | ok: [instance] 2026-02-26 12:36:32.485398 | controller | 2026-02-26 12:36:32.485443 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2026-02-26 12:36:32.485453 | controller | Thursday 26 February 2026 12:36:32 +0000 (0:00:00.023) 0:01:06.035 ***** 2026-02-26 12:36:32.485467 | controller | ok: [instance] 2026-02-26 12:36:32.561387 | controller | 2026-02-26 12:36:32.561429 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2026-02-26 12:36:32.561449 | controller | Thursday 26 February 2026 12:36:32 +0000 (0:00:00.020) 0:01:06.055 ***** 2026-02-26 12:36:32.561464 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2026-02-26 12:36:32.562331 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2026-02-26 12:36:32.562352 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2026-02-26 12:36:32.562359 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2026-02-26 12:36:32.562367 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2026-02-26 12:36:32.694399 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2026-02-26 12:36:32.694492 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2026-02-26 12:36:32.694503 | controller | 2026-02-26 12:36:32.694511 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-26 12:36:32.694520 | controller | Thursday 26 February 2026 12:36:32 +0000 (0:00:00.076) 0:01:06.131 ***** 2026-02-26 12:36:32.694540 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2026-02-26 12:36:32.775622 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2026-02-26 12:36:32.775652 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2026-02-26 12:36:32.775662 | controller | 2026-02-26 12:36:32.775669 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-26 12:36:32.775675 | controller | Thursday 26 February 2026 12:36:32 +0000 (0:00:00.132) 0:01:06.264 ***** 2026-02-26 12:36:32.775689 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2026-02-26 12:36:32.775800 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2026-02-26 12:36:32.775903 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2026-02-26 12:36:32.776007 | controller | skipping: [instance] 2026-02-26 12:36:32.776120 | controller | 2026-02-26 12:36:32.776231 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-26 12:36:32.776335 | controller | Thursday 26 February 2026 12:36:32 +0000 (0:00:00.081) 0:01:06.346 ***** 2026-02-26 12:36:32.855982 | controller | skipping: [instance] => (item=compute-0 - storage) 2026-02-26 12:36:32.856051 | controller | skipping: [instance] => (item=controller-0 - storage) 2026-02-26 12:36:32.856232 | controller | skipping: [instance] => (item=crc-0 - storage) 2026-02-26 12:36:32.856299 | controller | skipping: [instance] 2026-02-26 12:36:32.856442 | controller | 2026-02-26 12:36:32.856505 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-26 12:36:32.856664 | controller | Thursday 26 February 2026 12:36:32 +0000 (0:00:00.080) 0:01:06.426 ***** 2026-02-26 12:36:32.934651 | controller | skipping: [instance] => (item=compute-0 - tenant) 2026-02-26 12:36:32.934901 | controller | skipping: [instance] => (item=controller-0 - tenant) 2026-02-26 12:36:32.935149 | controller | skipping: [instance] => (item=crc-0 - tenant) 2026-02-26 12:36:32.935281 | controller | skipping: [instance] 2026-02-26 12:36:32.935303 | controller | 2026-02-26 12:36:32.935380 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-26 12:36:32.935497 | controller | Thursday 26 February 2026 12:36:32 +0000 (0:00:00.078) 0:01:06.505 ***** 2026-02-26 12:36:33.013818 | controller | skipping: [instance] => (item=compute-0 - external) 2026-02-26 12:36:33.013915 | controller | skipping: [instance] => (item=controller-0 - external) 2026-02-26 12:36:33.014073 | controller | skipping: [instance] => (item=crc-0 - external) 2026-02-26 12:36:33.014149 | controller | skipping: [instance] 2026-02-26 12:36:33.014281 | controller | 2026-02-26 12:36:33.014376 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-26 12:36:33.014478 | controller | Thursday 26 February 2026 12:36:33 +0000 (0:00:00.079) 0:01:06.584 ***** 2026-02-26 12:36:33.094349 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2026-02-26 12:36:33.094459 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2026-02-26 12:36:33.094572 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2026-02-26 12:36:33.094660 | controller | skipping: [instance] 2026-02-26 12:36:33.094772 | controller | 2026-02-26 12:36:33.094860 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-26 12:36:33.094960 | controller | Thursday 26 February 2026 12:36:33 +0000 (0:00:00.080) 0:01:06.665 ***** 2026-02-26 12:36:33.230580 | controller | ok: [instance] => (item=compute-0 - public) 2026-02-26 12:36:33.230651 | controller | ok: [instance] => (item=controller-0 - public) 2026-02-26 12:36:33.230780 | controller | ok: [instance] => (item=crc-0 - public) 2026-02-26 12:36:33.230881 | controller | 2026-02-26 12:36:33.231040 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2026-02-26 12:36:33.231142 | controller | Thursday 26 February 2026 12:36:33 +0000 (0:00:00.135) 0:01:06.801 ***** 2026-02-26 12:36:33.338073 | controller | 2026-02-26 12:36:33.338120 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2026-02-26 12:36:33.338254 | controller | Thursday 26 February 2026 12:36:33 +0000 (0:00:00.107) 0:01:06.908 ***** 2026-02-26 12:36:33.376685 | controller | ok: [instance] 2026-02-26 12:36:33.376913 | controller | 2026-02-26 12:36:33.376950 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2026-02-26 12:36:33.377102 | controller | Thursday 26 February 2026 12:36:33 +0000 (0:00:00.038) 0:01:06.947 ***** 2026-02-26 12:36:33.472106 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:2f:b5:d8', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-26 12:36:33.472418 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:11:d7:0b', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-26 12:36:33.472642 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:32:7e:45', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-26 12:36:33.472849 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:bd:e0:d3', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-26 12:36:33.473038 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:d2:91:6a', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-26 12:36:33.473121 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:7b:f7:5f', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-26 12:36:33.473230 | controller | 2026-02-26 12:36:33.473336 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2026-02-26 12:36:33.473448 | controller | Thursday 26 February 2026 12:36:33 +0000 (0:00:00.095) 0:01:07.042 ***** 2026-02-26 12:36:33.524905 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2026-02-26 12:36:33.525176 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2026-02-26 12:36:33.525272 | controller | 2026-02-26 12:36:33.525388 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-26 12:36:33.525499 | controller | Thursday 26 February 2026 12:36:33 +0000 (0:00:00.052) 0:01:07.095 ***** 2026-02-26 12:36:33.706245 | controller | ok: [instance] 2026-02-26 12:36:33.738762 | controller | 2026-02-26 12:36:33.738778 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-26 12:36:33.738787 | controller | Thursday 26 February 2026 12:36:33 +0000 (0:00:00.180) 0:01:07.276 ***** 2026-02-26 12:36:33.738795 | controller | ok: [instance] 2026-02-26 12:36:33.922254 | controller | 2026-02-26 12:36:33.922272 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-26 12:36:33.922279 | controller | Thursday 26 February 2026 12:36:33 +0000 (0:00:00.032) 0:01:07.308 ***** 2026-02-26 12:36:33.922287 | controller | ok: [instance] 2026-02-26 12:36:33.922523 | controller | 2026-02-26 12:36:33.948351 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-26 12:36:33.948401 | controller | Thursday 26 February 2026 12:36:33 +0000 (0:00:00.183) 0:01:07.492 ***** 2026-02-26 12:36:33.948417 | controller | ok: [instance] 2026-02-26 12:36:33.972423 | controller | 2026-02-26 12:36:33.972455 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2026-02-26 12:36:33.972465 | controller | Thursday 26 February 2026 12:36:33 +0000 (0:00:00.025) 0:01:07.518 ***** 2026-02-26 12:36:33.972477 | controller | ok: [instance] 2026-02-26 12:36:33.972498 | controller | 2026-02-26 12:36:33.972543 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2026-02-26 12:36:33.972637 | controller | Thursday 26 February 2026 12:36:33 +0000 (0:00:00.024) 0:01:07.543 ***** 2026-02-26 12:36:34.172031 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:2f:b5:d8', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-26 12:36:34.172115 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:11:d7:0b', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-26 12:36:34.172225 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:32:7e:45', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-26 12:36:34.172244 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:bd:e0:d3', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-26 12:36:34.172679 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:d2:91:6a', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-26 12:36:34.213333 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:7b:f7:5f', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-26 12:36:34.213371 | controller | 2026-02-26 12:36:34.213382 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2026-02-26 12:36:34.213390 | controller | Thursday 26 February 2026 12:36:34 +0000 (0:00:00.199) 0:01:07.742 ***** 2026-02-26 12:36:34.213402 | controller | ok: [instance] 2026-02-26 12:36:34.213455 | controller | 2026-02-26 12:36:34.213476 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2026-02-26 12:36:36.354276 | controller | Thursday 26 February 2026 12:36:34 +0000 (0:00:00.040) 0:01:07.783 ***** 2026-02-26 12:36:36.354319 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:2f:b5:d8', 'entry': 'set:compute,52:54:00:2f:b5:d8,192.168.140.100,compute-0', 'state': 'present'}) 2026-02-26 12:36:36.378700 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:11:d7:0b', 'entry': 'set:controller,52:54:01:11:d7:0b,192.168.140.9,controller-0', 'state': 'present'}) 2026-02-26 12:36:36.378724 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:32:7e:45', 'entry': 'set:ocp,52:54:02:32:7e:45,192.168.140.10,crc-0', 'state': 'present'}) 2026-02-26 12:36:36.378733 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:bd:e0:d3', 'entry': 'set:compute,52:54:00:bd:e0:d3,192.168.101.100,compute-0', 'state': 'present'}) 2026-02-26 12:36:36.378741 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:d2:91:6a', 'entry': 'set:controller,52:54:01:d2:91:6a,192.168.101.9,controller-0', 'state': 'present'}) 2026-02-26 12:36:36.378748 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:7b:f7:5f', 'entry': 'set:ocp,52:54:02:7b:f7:5f,192.168.101.10,crc-0', 'state': 'present'}) 2026-02-26 12:36:36.378756 | controller | 2026-02-26 12:36:36.378764 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2026-02-26 12:36:36.378777 | controller | Thursday 26 February 2026 12:36:36 +0000 (0:00:02.140) 0:01:09.923 ***** 2026-02-26 12:36:36.378788 | controller | skipping: [instance] 2026-02-26 12:36:36.598185 | controller | 2026-02-26 12:36:36.598204 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2026-02-26 12:36:36.598228 | controller | Thursday 26 February 2026 12:36:36 +0000 (0:00:00.025) 0:01:09.949 ***** 2026-02-26 12:36:36.598240 | controller | ok: [instance] => (item=compute-0) 2026-02-26 12:36:36.717902 | controller | ok: [instance] => (item=controller-0) 2026-02-26 12:36:36.717920 | controller | ok: [instance] => (item=crc-0) 2026-02-26 12:36:36.717928 | controller | 2026-02-26 12:36:36.717933 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2026-02-26 12:36:36.717939 | controller | Thursday 26 February 2026 12:36:36 +0000 (0:00:00.219) 0:01:10.168 ***** 2026-02-26 12:36:36.717948 | controller | 2026-02-26 12:36:36.759157 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-26 12:36:36.759189 | controller | Thursday 26 February 2026 12:36:36 +0000 (0:00:00.119) 0:01:10.288 ***** 2026-02-26 12:36:36.759244 | controller | ok: [instance] 2026-02-26 12:36:36.953739 | controller | 2026-02-26 12:36:36.953773 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-26 12:36:36.953786 | controller | Thursday 26 February 2026 12:36:36 +0000 (0:00:00.040) 0:01:10.329 ***** 2026-02-26 12:36:36.953802 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-26 12:36:36.954083 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-26 12:36:36.954396 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-26 12:36:36.954641 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-26 12:36:36.954767 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-26 12:36:36.954896 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-26 12:36:36.955015 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-26 12:36:36.955153 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 12:36:36.955294 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 12:36:36.955415 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-26 12:36:36.955529 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-26 12:36:36.955644 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-26 12:36:36.955756 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-26 12:36:36.955871 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-26 12:36:36.955984 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-26 12:36:36.956159 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-26 12:36:36.956306 | controller | 2026-02-26 12:36:36.956429 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-26 12:36:36.956549 | controller | Thursday 26 February 2026 12:36:36 +0000 (0:00:00.195) 0:01:10.524 ***** 2026-02-26 12:36:39.938569 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-26 12:36:40.277365 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-26 12:36:40.277406 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-26 12:36:40.277415 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-26 12:36:40.277422 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-26 12:36:40.277428 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-26 12:36:40.277434 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-26 12:36:40.277440 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 12:36:40.277447 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 12:36:40.277453 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-26 12:36:40.277459 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-26 12:36:40.277465 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-26 12:36:40.277471 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-26 12:36:40.277477 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-26 12:36:40.277483 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-26 12:36:40.277489 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-26 12:36:40.277495 | controller | 2026-02-26 12:36:40.277502 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-26 12:36:40.277509 | controller | Thursday 26 February 2026 12:36:39 +0000 (0:00:02.983) 0:01:13.507 ***** 2026-02-26 12:36:40.277521 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-26 12:36:40.277548 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-26 12:36:40.277560 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-26 12:36:40.277566 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-26 12:36:40.277572 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-26 12:36:40.277578 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-26 12:36:40.277584 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-26 12:36:40.277590 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 12:36:40.277596 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 12:36:40.277604 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-26 12:36:40.277626 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-26 12:36:40.277632 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-26 12:36:40.277640 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-26 12:36:40.278122 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-26 12:36:40.296910 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-26 12:36:40.296937 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-26 12:36:40.296952 | controller | 2026-02-26 12:36:40.296959 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2026-02-26 12:36:40.296966 | controller | Thursday 26 February 2026 12:36:40 +0000 (0:00:00.339) 0:01:13.846 ***** 2026-02-26 12:36:40.296977 | controller | ok: [instance] 2026-02-26 12:36:40.297146 | controller | 2026-02-26 12:36:40.297325 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2026-02-26 12:36:40.297486 | controller | Thursday 26 February 2026 12:36:40 +0000 (0:00:00.020) 0:01:13.867 ***** 2026-02-26 12:36:40.339780 | controller | skipping: [instance] => (item=compute) 2026-02-26 12:36:40.339950 | controller | skipping: [instance] => (item=controller) 2026-02-26 12:36:40.340100 | controller | skipping: [instance] => (item=crc) 2026-02-26 12:36:40.340252 | controller | skipping: [instance] 2026-02-26 12:36:40.340377 | controller | 2026-02-26 12:36:40.340498 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2026-02-26 12:36:40.340621 | controller | Thursday 26 February 2026 12:36:40 +0000 (0:00:00.042) 0:01:13.910 ***** 2026-02-26 12:36:40.371116 | controller | skipping: [instance] 2026-02-26 12:36:40.371307 | controller | 2026-02-26 12:36:40.371465 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2026-02-26 12:36:40.371611 | controller | Thursday 26 February 2026 12:36:40 +0000 (0:00:00.031) 0:01:13.941 ***** 2026-02-26 12:36:40.740054 | controller | changed: [instance] 2026-02-26 12:36:41.368653 | controller | 2026-02-26 12:36:41.368691 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2026-02-26 12:36:41.368701 | controller | Thursday 26 February 2026 12:36:40 +0000 (0:00:00.356) 0:01:14.298 ***** 2026-02-26 12:36:41.368708 | controller | 2026-02-26 12:36:41.368716 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-26 12:36:41.368722 | controller | Thursday 26 February 2026 12:36:40 +0000 (0:00:00.011) 0:01:14.309 ***** 2026-02-26 12:36:41.368734 | controller | changed: [instance] 2026-02-26 12:36:41.736243 | controller | 2026-02-26 12:36:41.736276 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-26 12:36:41.736286 | controller | Thursday 26 February 2026 12:36:41 +0000 (0:00:00.628) 0:01:14.938 ***** 2026-02-26 12:36:41.736296 | controller | changed: [instance] 2026-02-26 12:36:42.083290 | controller | 2026-02-26 12:36:42.083319 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2026-02-26 12:36:42.083329 | controller | Thursday 26 February 2026 12:36:41 +0000 (0:00:00.367) 0:01:15.306 ***** 2026-02-26 12:36:42.083340 | controller | changed: [instance] 2026-02-26 12:36:42.451648 | controller | 2026-02-26 12:36:42.451680 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2026-02-26 12:36:42.451688 | controller | Thursday 26 February 2026 12:36:42 +0000 (0:00:00.347) 0:01:15.653 ***** 2026-02-26 12:36:42.451697 | controller | changed: [instance] 2026-02-26 12:36:42.837455 | controller | 2026-02-26 12:36:42.837489 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2026-02-26 12:36:42.837498 | controller | Thursday 26 February 2026 12:36:42 +0000 (0:00:00.368) 0:01:16.021 ***** 2026-02-26 12:36:42.837508 | controller | changed: [instance] 2026-02-26 12:36:42.869566 | controller | 2026-02-26 12:36:42.869590 | controller | TASK [Build utility records dataset] ******************************************* 2026-02-26 12:36:42.869600 | controller | Thursday 26 February 2026 12:36:42 +0000 (0:00:00.385) 0:01:16.407 ***** 2026-02-26 12:36:42.869612 | controller | 2026-02-26 12:36:42.957249 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-26 12:36:42.957268 | controller | Thursday 26 February 2026 12:36:42 +0000 (0:00:00.032) 0:01:16.440 ***** 2026-02-26 12:36:42.957278 | controller | ok: [instance] 2026-02-26 12:36:43.051801 | controller | 2026-02-26 12:36:43.051828 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-26 12:36:43.051837 | controller | Thursday 26 February 2026 12:36:42 +0000 (0:00:00.087) 0:01:16.527 ***** 2026-02-26 12:36:43.051852 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-26 12:36:43.616330 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 12:36:43.616362 | controller | 2026-02-26 12:36:43.616370 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-26 12:36:43.616376 | controller | Thursday 26 February 2026 12:36:43 +0000 (0:00:00.094) 0:01:16.622 ***** 2026-02-26 12:36:43.616386 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-26 12:36:43.616409 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 12:36:43.616416 | controller | 2026-02-26 12:36:43.616615 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-26 12:36:43.911354 | controller | Thursday 26 February 2026 12:36:43 +0000 (0:00:00.564) 0:01:17.186 ***** 2026-02-26 12:36:43.911390 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-26 12:36:43.911421 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 12:36:43.911438 | controller | 2026-02-26 12:36:43.911448 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-26 12:36:43.911830 | controller | Thursday 26 February 2026 12:36:43 +0000 (0:00:00.284) 0:01:17.471 ***** 2026-02-26 12:36:45.404880 | controller | 2026-02-26 12:36:45.404917 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-26 12:36:45.404925 | controller | Thursday 26 February 2026 12:36:43 +0000 (0:00:00.010) 0:01:17.481 ***** 2026-02-26 12:36:45.404936 | controller | changed: [instance] 2026-02-26 12:36:45.404959 | controller | 2026-02-26 12:36:45.404965 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-26 12:36:45.404972 | controller | Thursday 26 February 2026 12:36:45 +0000 (0:00:01.493) 0:01:18.975 ***** 2026-02-26 12:36:45.784104 | controller | changed: [instance] 2026-02-26 12:36:45.784175 | controller | 2026-02-26 12:36:45.784192 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2026-02-26 12:36:45.784274 | controller | Thursday 26 February 2026 12:36:45 +0000 (0:00:00.379) 0:01:19.354 ***** 2026-02-26 12:36:45.824341 | controller | skipping: [instance] 2026-02-26 12:36:45.824559 | controller | 2026-02-26 12:36:45.824599 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2026-02-26 12:36:45.904047 | controller | Thursday 26 February 2026 12:36:45 +0000 (0:00:00.040) 0:01:19.394 ***** 2026-02-26 12:36:45.904072 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2026-02-26 12:36:46.118014 | controller | 2026-02-26 12:36:46.118032 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2026-02-26 12:36:46.118039 | controller | Thursday 26 February 2026 12:36:45 +0000 (0:00:00.079) 0:01:19.474 ***** 2026-02-26 12:36:46.118048 | controller | ok: [instance] 2026-02-26 12:36:46.146062 | controller | 2026-02-26 12:36:46.146095 | controller | TASK [Deploy CRC if needed] **************************************************** 2026-02-26 12:36:46.146104 | controller | Thursday 26 February 2026 12:36:46 +0000 (0:00:00.213) 0:01:19.688 ***** 2026-02-26 12:36:46.146114 | controller | skipping: [instance] 2026-02-26 12:36:46.512149 | controller | 2026-02-26 12:36:46.512180 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2026-02-26 12:36:46.512189 | controller | Thursday 26 February 2026 12:36:46 +0000 (0:00:00.028) 0:01:19.716 ***** 2026-02-26 12:36:46.512202 | controller | ok: [instance] 2026-02-26 12:36:46.769127 | controller | 2026-02-26 12:36:46.769159 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2026-02-26 12:36:46.769168 | controller | Thursday 26 February 2026 12:36:46 +0000 (0:00:00.365) 0:01:20.082 ***** 2026-02-26 12:36:46.769178 | controller | ok: [instance] 2026-02-26 12:36:47.009040 | controller | 2026-02-26 12:36:47.009071 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2026-02-26 12:36:47.009081 | controller | Thursday 26 February 2026 12:36:46 +0000 (0:00:00.257) 0:01:20.339 ***** 2026-02-26 12:36:47.009106 | controller | ok: [instance] 2026-02-26 12:36:47.246886 | controller | 2026-02-26 12:36:47.246907 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2026-02-26 12:36:47.246916 | controller | Thursday 26 February 2026 12:36:47 +0000 (0:00:00.239) 0:01:20.579 ***** 2026-02-26 12:36:47.246926 | controller | ok: [instance] 2026-02-26 12:36:47.490383 | controller | 2026-02-26 12:36:47.490449 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2026-02-26 12:36:47.490464 | controller | Thursday 26 February 2026 12:36:47 +0000 (0:00:00.237) 0:01:20.817 ***** 2026-02-26 12:36:47.490482 | controller | ok: [instance] 2026-02-26 12:36:47.534395 | controller | 2026-02-26 12:36:47.534449 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-26 12:36:47.534463 | controller | Thursday 26 February 2026 12:36:47 +0000 (0:00:00.242) 0:01:21.059 ***** 2026-02-26 12:36:47.534481 | controller | 2026-02-26 12:36:47.744687 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-26 12:36:47.744720 | controller | Thursday 26 February 2026 12:36:47 +0000 (0:00:00.044) 0:01:21.104 ***** 2026-02-26 12:36:47.744742 | controller | ok: [instance] 2026-02-26 12:36:47.771369 | controller | 2026-02-26 12:36:47.771422 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-26 12:36:47.771437 | controller | Thursday 26 February 2026 12:36:47 +0000 (0:00:00.210) 0:01:21.314 ***** 2026-02-26 12:36:47.771455 | controller | ok: [instance] 2026-02-26 12:36:47.771559 | controller | 2026-02-26 12:36:47.771809 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-26 12:36:47.771973 | controller | Thursday 26 February 2026 12:36:47 +0000 (0:00:00.026) 0:01:21.341 ***** 2026-02-26 12:36:47.797200 | controller | skipping: [instance] 2026-02-26 12:36:47.797321 | controller | 2026-02-26 12:36:47.797626 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2026-02-26 12:36:48.087984 | controller | Thursday 26 February 2026 12:36:47 +0000 (0:00:00.026) 0:01:21.367 ***** 2026-02-26 12:36:48.088023 | controller | ok: [instance] 2026-02-26 12:36:48.088106 | controller | 2026-02-26 12:36:48.088272 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2026-02-26 12:36:48.088406 | controller | Thursday 26 February 2026 12:36:48 +0000 (0:00:00.290) 0:01:21.658 ***** 2026-02-26 12:36:48.315495 | controller | ok: [instance] 2026-02-26 12:36:48.315638 | controller | 2026-02-26 12:36:48.315780 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2026-02-26 12:36:48.315913 | controller | Thursday 26 February 2026 12:36:48 +0000 (0:00:00.227) 0:01:21.885 ***** 2026-02-26 12:36:48.491367 | controller | ok: [instance] 2026-02-26 12:36:48.549850 | controller | 2026-02-26 12:36:48.549887 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2026-02-26 12:36:48.549898 | controller | Thursday 26 February 2026 12:36:48 +0000 (0:00:00.175) 0:01:22.061 ***** 2026-02-26 12:36:48.549910 | controller | 2026-02-26 12:36:48.596354 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-26 12:36:48.596392 | controller | Thursday 26 February 2026 12:36:48 +0000 (0:00:00.058) 0:01:22.120 ***** 2026-02-26 12:36:48.596404 | controller | ok: [instance] => changed=false 2026-02-26 12:36:48.596430 | controller | msg: All assertions passed 2026-02-26 12:36:48.596437 | controller | 2026-02-26 12:36:48.596445 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-26 12:36:48.596531 | controller | Thursday 26 February 2026 12:36:48 +0000 (0:00:00.046) 0:01:22.166 ***** 2026-02-26 12:36:48.783593 | controller | ok: [instance] 2026-02-26 12:36:48.977072 | controller | 2026-02-26 12:36:48.977120 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-26 12:36:48.977131 | controller | Thursday 26 February 2026 12:36:48 +0000 (0:00:00.187) 0:01:22.353 ***** 2026-02-26 12:36:48.977143 | controller | ok: [instance] 2026-02-26 12:36:49.002852 | controller | 2026-02-26 12:36:49.002875 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-26 12:36:49.002884 | controller | Thursday 26 February 2026 12:36:48 +0000 (0:00:00.193) 0:01:22.547 ***** 2026-02-26 12:36:49.002894 | controller | ok: [instance] => changed=false 2026-02-26 12:36:49.203074 | controller | msg: All assertions passed 2026-02-26 12:36:49.203105 | controller | 2026-02-26 12:36:49.203114 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-26 12:36:49.203120 | controller | Thursday 26 February 2026 12:36:49 +0000 (0:00:00.026) 0:01:22.573 ***** 2026-02-26 12:36:49.203129 | controller | ok: [instance] 2026-02-26 12:36:49.377138 | controller | 2026-02-26 12:36:49.377165 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-26 12:36:49.377175 | controller | Thursday 26 February 2026 12:36:49 +0000 (0:00:00.200) 0:01:22.773 ***** 2026-02-26 12:36:49.377186 | controller | ok: [instance] 2026-02-26 12:36:49.422918 | controller | 2026-02-26 12:36:49.422943 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-26 12:36:49.422952 | controller | Thursday 26 February 2026 12:36:49 +0000 (0:00:00.173) 0:01:22.947 ***** 2026-02-26 12:36:49.422962 | controller | ok: [instance] 2026-02-26 12:36:49.803845 | controller | 2026-02-26 12:36:49.803880 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2026-02-26 12:36:49.803888 | controller | Thursday 26 February 2026 12:36:49 +0000 (0:00:00.045) 0:01:22.993 ***** 2026-02-26 12:36:49.803898 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2026-02-26 12:36:49.824262 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2026-02-26 12:36:49.824285 | controller | 2026-02-26 12:36:49.824295 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2026-02-26 12:36:49.824303 | controller | Thursday 26 February 2026 12:36:49 +0000 (0:00:00.380) 0:01:23.373 ***** 2026-02-26 12:36:49.824314 | controller | skipping: [instance] 2026-02-26 12:36:49.849286 | controller | 2026-02-26 12:36:49.849313 | controller | TASK [Load the architecture local kustomize patches] *************************** 2026-02-26 12:36:49.849322 | controller | Thursday 26 February 2026 12:36:49 +0000 (0:00:00.020) 0:01:23.394 ***** 2026-02-26 12:36:49.849332 | controller | skipping: [instance] 2026-02-26 12:36:49.849360 | controller | 2026-02-26 12:36:49.849550 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2026-02-26 12:36:49.971081 | controller | Thursday 26 February 2026 12:36:49 +0000 (0:00:00.025) 0:01:23.419 ***** 2026-02-26 12:36:49.971123 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2026-02-26 12:36:49.995407 | controller | 2026-02-26 12:36:49.995455 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2026-02-26 12:36:49.995469 | controller | Thursday 26 February 2026 12:36:49 +0000 (0:00:00.121) 0:01:23.541 ***** 2026-02-26 12:36:49.995485 | controller | skipping: [instance] 2026-02-26 12:36:50.399792 | controller | 2026-02-26 12:36:50.399831 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2026-02-26 12:36:50.399842 | controller | Thursday 26 February 2026 12:36:49 +0000 (0:00:00.024) 0:01:23.565 ***** 2026-02-26 12:36:50.399853 | controller | changed: [instance] 2026-02-26 12:36:50.871021 | controller | 2026-02-26 12:36:50.871054 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2026-02-26 12:36:50.871063 | controller | Thursday 26 February 2026 12:36:50 +0000 (0:00:00.404) 0:01:23.969 ***** 2026-02-26 12:36:50.871072 | controller | changed: [instance] 2026-02-26 12:36:51.292991 | controller | 2026-02-26 12:36:51.293026 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2026-02-26 12:36:51.293034 | controller | Thursday 26 February 2026 12:36:50 +0000 (0:00:00.460) 0:01:24.430 ***** 2026-02-26 12:36:51.293040 | controller | 2026-02-26 12:36:51.293046 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-26 12:36:51.293051 | controller | Thursday 26 February 2026 12:36:50 +0000 (0:00:00.010) 0:01:24.440 ***** 2026-02-26 12:36:51.293060 | controller | changed: [instance] 2026-02-26 12:36:51.924145 | controller | 2026-02-26 12:36:51.924182 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-26 12:36:51.924191 | controller | Thursday 26 February 2026 12:36:51 +0000 (0:00:00.422) 0:01:24.863 ***** 2026-02-26 12:36:51.924201 | controller | changed: [instance] 2026-02-26 12:36:51.956201 | controller | 2026-02-26 12:36:51.956253 | controller | TASK [Deploy virtualbmc] ******************************************************* 2026-02-26 12:36:51.956263 | controller | Thursday 26 February 2026 12:36:51 +0000 (0:00:00.631) 0:01:25.494 ***** 2026-02-26 12:36:51.956273 | controller | skipping: [instance] 2026-02-26 12:36:51.956299 | controller | 2026-02-26 12:36:51.956308 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2026-02-26 12:36:51.956346 | controller | Thursday 26 February 2026 12:36:51 +0000 (0:00:00.032) 0:01:25.526 ***** 2026-02-26 12:36:51.991553 | controller | skipping: [instance] 2026-02-26 12:36:52.529297 | controller | 2026-02-26 12:36:52.529321 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2026-02-26 12:36:52.529329 | controller | Thursday 26 February 2026 12:36:51 +0000 (0:00:00.035) 0:01:25.561 ***** 2026-02-26 12:36:52.529338 | controller | changed: [instance] => (item=workload) 2026-02-26 12:36:52.920275 | controller | changed: [instance] => (item=reproducer-inventory) 2026-02-26 12:36:52.920310 | controller | ok: [instance] => (item=volumes) 2026-02-26 12:36:52.920321 | controller | 2026-02-26 12:36:52.920327 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2026-02-26 12:36:52.920332 | controller | Thursday 26 February 2026 12:36:52 +0000 (0:00:00.537) 0:01:26.099 ***** 2026-02-26 12:36:52.920342 | controller | changed: [instance] => (item=workload) 2026-02-26 12:36:52.943406 | controller | changed: [instance] => (item=volumes) 2026-02-26 12:36:52.943459 | controller | 2026-02-26 12:36:52.943474 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2026-02-26 12:36:52.943485 | controller | Thursday 26 February 2026 12:36:52 +0000 (0:00:00.391) 0:01:26.490 ***** 2026-02-26 12:36:52.943503 | controller | skipping: [instance] 2026-02-26 12:36:53.913944 | controller | 2026-02-26 12:36:53.913974 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2026-02-26 12:36:53.913982 | controller | Thursday 26 February 2026 12:36:52 +0000 (0:00:00.023) 0:01:26.513 ***** 2026-02-26 12:36:53.913991 | controller | changed: [instance] => (item=compute) 2026-02-26 12:36:53.944361 | controller | changed: [instance] => (item=controller) 2026-02-26 12:36:53.944406 | controller | changed: [instance] => (item=crc) 2026-02-26 12:36:53.944417 | controller | 2026-02-26 12:36:53.944427 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2026-02-26 12:36:53.944435 | controller | Thursday 26 February 2026 12:36:53 +0000 (0:00:00.970) 0:01:27.483 ***** 2026-02-26 12:36:53.944449 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance 2026-02-26 12:36:53.944485 | controller | 2026-02-26 12:36:53.944496 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] ***************** 2026-02-26 12:36:53.944699 | controller | Thursday 26 February 2026 12:36:53 +0000 (0:00:00.030) 0:01:27.514 ***** 2026-02-26 12:36:54.114455 | controller | ok: [instance] 2026-02-26 12:36:54.132975 | controller | 2026-02-26 12:36:54.133004 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* 2026-02-26 12:36:54.133014 | controller | Thursday 26 February 2026 12:36:54 +0000 (0:00:00.169) 0:01:27.684 ***** 2026-02-26 12:36:54.133025 | controller | skipping: [instance] 2026-02-26 12:36:54.494018 | controller | 2026-02-26 12:36:54.494056 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] *** 2026-02-26 12:36:54.494066 | controller | Thursday 26 February 2026 12:36:54 +0000 (0:00:00.018) 0:01:27.703 ***** 2026-02-26 12:36:54.494077 | controller | changed: [instance] 2026-02-26 12:36:54.512363 | controller | 2026-02-26 12:36:54.512403 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* 2026-02-26 12:36:54.512413 | controller | Thursday 26 February 2026 12:36:54 +0000 (0:00:00.360) 0:01:28.064 ***** 2026-02-26 12:36:54.512424 | controller | skipping: [instance] 2026-02-26 12:36:54.529919 | controller | 2026-02-26 12:36:54.529952 | controller | TASK [libvirt_manager : Write merged all-group.yml] **************************** 2026-02-26 12:36:54.529961 | controller | Thursday 26 February 2026 12:36:54 +0000 (0:00:00.018) 0:01:28.082 ***** 2026-02-26 12:36:54.529970 | controller | skipping: [instance] 2026-02-26 12:36:54.566069 | controller | 2026-02-26 12:36:54.566108 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2026-02-26 12:36:54.566117 | controller | Thursday 26 February 2026 12:36:54 +0000 (0:00:00.017) 0:01:28.100 ***** 2026-02-26 12:36:54.566127 | controller | skipping: [instance] 2026-02-26 12:36:54.630889 | controller | 2026-02-26 12:36:54.630913 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2026-02-26 12:36:54.630921 | controller | Thursday 26 February 2026 12:36:54 +0000 (0:00:00.036) 0:01:28.136 ***** 2026-02-26 12:36:54.630930 | controller | skipping: [instance] => (item=crc) 2026-02-26 12:36:54.834369 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2026-02-26 12:36:54.834428 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2026-02-26 12:36:54.834445 | controller | 2026-02-26 12:36:54.834454 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-26 12:36:54.834461 | controller | Thursday 26 February 2026 12:36:54 +0000 (0:00:00.064) 0:01:28.201 ***** 2026-02-26 12:36:54.834473 | controller | changed: [instance] 2026-02-26 12:36:55.006852 | controller | 2026-02-26 12:36:55.006887 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-26 12:36:55.006895 | controller | Thursday 26 February 2026 12:36:54 +0000 (0:00:00.203) 0:01:28.404 ***** 2026-02-26 12:36:55.006905 | controller | ok: [instance] 2026-02-26 12:37:24.069230 | controller | 2026-02-26 12:37:24.069296 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-26 12:37:24.069306 | controller | Thursday 26 February 2026 12:36:55 +0000 (0:00:00.172) 0:01:28.577 ***** 2026-02-26 12:37:24.069319 | controller | changed: [instance] 2026-02-26 12:37:24.266434 | controller | 2026-02-26 12:37:24.266499 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-26 12:37:24.266515 | controller | Thursday 26 February 2026 12:37:24 +0000 (0:00:29.061) 0:01:57.638 ***** 2026-02-26 12:37:24.266533 | controller | ok: [instance] 2026-02-26 12:37:24.305920 | controller | 2026-02-26 12:37:24.305964 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-26 12:37:24.305974 | controller | Thursday 26 February 2026 12:37:24 +0000 (0:00:00.197) 0:01:57.836 ***** 2026-02-26 12:37:24.305987 | controller | ok: [instance] => changed=false 2026-02-26 12:37:24.509115 | controller | msg: All assertions passed 2026-02-26 12:37:24.509155 | controller | 2026-02-26 12:37:24.509164 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-26 12:37:24.509171 | controller | Thursday 26 February 2026 12:37:24 +0000 (0:00:00.039) 0:01:57.876 ***** 2026-02-26 12:37:24.509181 | controller | changed: [instance] 2026-02-26 12:37:24.714425 | controller | 2026-02-26 12:37:24.714485 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-26 12:37:24.714500 | controller | Thursday 26 February 2026 12:37:24 +0000 (0:00:00.203) 0:01:58.079 ***** 2026-02-26 12:37:24.714519 | controller | ok: [instance] 2026-02-26 12:37:24.714652 | controller | 2026-02-26 12:37:24.714722 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-26 12:37:24.903942 | controller | Thursday 26 February 2026 12:37:24 +0000 (0:00:00.204) 0:01:58.284 ***** 2026-02-26 12:37:24.903975 | controller | ok: [instance] 2026-02-26 12:37:24.925941 | controller | 2026-02-26 12:37:24.925964 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-26 12:37:24.925972 | controller | Thursday 26 February 2026 12:37:24 +0000 (0:00:00.189) 0:01:58.474 ***** 2026-02-26 12:37:24.925983 | controller | skipping: [instance] 2026-02-26 12:37:25.123118 | controller | 2026-02-26 12:37:25.123164 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-26 12:37:25.123180 | controller | Thursday 26 February 2026 12:37:24 +0000 (0:00:00.022) 0:01:58.496 ***** 2026-02-26 12:37:25.123193 | controller | ok: [instance] 2026-02-26 12:37:25.165166 | controller | 2026-02-26 12:37:25.165187 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-26 12:37:25.165195 | controller | Thursday 26 February 2026 12:37:25 +0000 (0:00:00.197) 0:01:58.693 ***** 2026-02-26 12:37:25.165205 | controller | ok: [instance] => changed=false 2026-02-26 12:37:25.378898 | controller | msg: All assertions passed 2026-02-26 12:37:25.378923 | controller | 2026-02-26 12:37:25.378932 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-26 12:37:25.378940 | controller | Thursday 26 February 2026 12:37:25 +0000 (0:00:00.042) 0:01:58.735 ***** 2026-02-26 12:37:25.378951 | controller | ok: [instance] 2026-02-26 12:37:25.558348 | controller | 2026-02-26 12:37:25.558372 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2026-02-26 12:37:25.558380 | controller | Thursday 26 February 2026 12:37:25 +0000 (0:00:00.213) 0:01:58.949 ***** 2026-02-26 12:37:25.558391 | controller | ok: [instance] 2026-02-26 12:37:25.962187 | controller | 2026-02-26 12:37:25.962232 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2026-02-26 12:37:25.962251 | controller | Thursday 26 February 2026 12:37:25 +0000 (0:00:00.179) 0:01:59.128 ***** 2026-02-26 12:37:25.962262 | controller | changed: [instance] 2026-02-26 12:37:26.149614 | controller | 2026-02-26 12:37:26.149635 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2026-02-26 12:37:26.149642 | controller | Thursday 26 February 2026 12:37:25 +0000 (0:00:00.403) 0:01:59.532 ***** 2026-02-26 12:37:26.149652 | controller | ok: [instance] 2026-02-26 12:37:26.333433 | controller | 2026-02-26 12:37:26.333495 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2026-02-26 12:37:26.333507 | controller | Thursday 26 February 2026 12:37:26 +0000 (0:00:00.187) 0:01:59.720 ***** 2026-02-26 12:37:26.333524 | controller | ok: [instance] 2026-02-26 12:37:26.738351 | controller | 2026-02-26 12:37:26.738400 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2026-02-26 12:37:26.738415 | controller | Thursday 26 February 2026 12:37:26 +0000 (0:00:00.183) 0:01:59.903 ***** 2026-02-26 12:37:26.738435 | controller | changed: [instance] 2026-02-26 12:37:26.738488 | controller | 2026-02-26 12:37:26.738505 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2026-02-26 12:37:26.738548 | controller | Thursday 26 February 2026 12:37:26 +0000 (0:00:00.404) 0:02:00.308 ***** 2026-02-26 12:37:26.759429 | controller | ok: [instance] 2026-02-26 12:37:26.759830 | controller | 2026-02-26 12:37:26.759903 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2026-02-26 12:37:26.998072 | controller | Thursday 26 February 2026 12:37:26 +0000 (0:00:00.021) 0:02:00.329 ***** 2026-02-26 12:37:26.998142 | controller | ok: [instance] 2026-02-26 12:37:27.511358 | controller | 2026-02-26 12:37:27.511425 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2026-02-26 12:37:27.511436 | controller | Thursday 26 February 2026 12:37:26 +0000 (0:00:00.238) 0:02:00.567 ***** 2026-02-26 12:37:27.511455 | controller | ok: [instance] 2026-02-26 12:37:27.511505 | controller | 2026-02-26 12:37:27.511758 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2026-02-26 12:37:27.511851 | controller | Thursday 26 February 2026 12:37:27 +0000 (0:00:00.511) 0:02:01.079 ***** 2026-02-26 12:37:27.634409 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-26 12:37:27.909152 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-26 12:37:27.909184 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-26 12:37:27.909193 | controller | 2026-02-26 12:37:27.909199 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2026-02-26 12:37:27.909205 | controller | Thursday 26 February 2026 12:37:27 +0000 (0:00:00.124) 0:02:01.204 ***** 2026-02-26 12:37:27.909235 | controller | changed: [instance] 2026-02-26 12:37:28.158335 | controller | 2026-02-26 12:37:28.158390 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2026-02-26 12:37:28.158400 | controller | Thursday 26 February 2026 12:37:27 +0000 (0:00:00.274) 0:02:01.479 ***** 2026-02-26 12:37:28.158412 | controller | changed: [instance] 2026-02-26 12:37:28.158441 | controller | 2026-02-26 12:37:28.158449 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2026-02-26 12:37:28.158591 | controller | Thursday 26 February 2026 12:37:28 +0000 (0:00:00.248) 0:02:01.728 ***** 2026-02-26 12:37:28.456480 | controller | changed: [instance] 2026-02-26 12:37:28.456642 | controller | 2026-02-26 12:37:28.456693 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2026-02-26 12:37:28.484173 | controller | Thursday 26 February 2026 12:37:28 +0000 (0:00:00.298) 0:02:02.026 ***** 2026-02-26 12:37:28.484206 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-26 12:37:28.528361 | controller | 2026-02-26 12:37:28.528412 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-26 12:37:28.528424 | controller | Thursday 26 February 2026 12:37:28 +0000 (0:00:00.027) 0:02:02.054 ***** 2026-02-26 12:37:28.528440 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-26 12:37:28.772867 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-26 12:37:28.772913 | controller | 2026-02-26 12:37:28.772921 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-26 12:37:28.772927 | controller | Thursday 26 February 2026 12:37:28 +0000 (0:00:00.043) 0:02:02.098 ***** 2026-02-26 12:37:28.772938 | controller | ok: [instance] 2026-02-26 12:37:28.833021 | controller | 2026-02-26 12:37:28.833040 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-26 12:37:28.833048 | controller | Thursday 26 February 2026 12:37:28 +0000 (0:00:00.244) 0:02:02.343 ***** 2026-02-26 12:37:28.833057 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 12:37:29.089628 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 12:37:29.089651 | controller | 2026-02-26 12:37:29.089660 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-26 12:37:29.089666 | controller | Thursday 26 February 2026 12:37:28 +0000 (0:00:00.059) 0:02:02.402 ***** 2026-02-26 12:37:29.089676 | controller | ok: [instance] 2026-02-26 12:37:29.292153 | controller | 2026-02-26 12:37:29.292189 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-26 12:37:29.292197 | controller | Thursday 26 February 2026 12:37:29 +0000 (0:00:00.257) 0:02:02.660 ***** 2026-02-26 12:37:29.292208 | controller | ok: [instance] 2026-02-26 12:37:29.585332 | controller | 2026-02-26 12:37:29.585369 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2026-02-26 12:37:29.585379 | controller | Thursday 26 February 2026 12:37:29 +0000 (0:00:00.202) 0:02:02.862 ***** 2026-02-26 12:37:29.585392 | controller | changed: [instance] 2026-02-26 12:37:29.585424 | controller | 2026-02-26 12:37:29.585535 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-26 12:37:29.585553 | controller | Thursday 26 February 2026 12:37:29 +0000 (0:00:00.293) 0:02:03.155 ***** 2026-02-26 12:37:29.848801 | controller | ok: [instance] 2026-02-26 12:37:29.896108 | controller | 2026-02-26 12:37:29.896157 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-26 12:37:29.896167 | controller | Thursday 26 February 2026 12:37:29 +0000 (0:00:00.262) 0:02:03.418 ***** 2026-02-26 12:37:29.896179 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 12:37:30.143396 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 12:37:30.143454 | controller | 2026-02-26 12:37:30.143464 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-26 12:37:30.143471 | controller | Thursday 26 February 2026 12:37:29 +0000 (0:00:00.047) 0:02:03.466 ***** 2026-02-26 12:37:30.143484 | controller | ok: [instance] 2026-02-26 12:37:30.143967 | controller | 2026-02-26 12:37:30.361413 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-26 12:37:30.361457 | controller | Thursday 26 February 2026 12:37:30 +0000 (0:00:00.246) 0:02:03.713 ***** 2026-02-26 12:37:30.361469 | controller | ok: [instance] 2026-02-26 12:37:30.659579 | controller | 2026-02-26 12:37:30.659613 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2026-02-26 12:37:30.659622 | controller | Thursday 26 February 2026 12:37:30 +0000 (0:00:00.217) 0:02:03.930 ***** 2026-02-26 12:37:30.659633 | controller | changed: [instance] 2026-02-26 12:37:30.682869 | controller | 2026-02-26 12:37:30.682886 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2026-02-26 12:37:30.682893 | controller | Thursday 26 February 2026 12:37:30 +0000 (0:00:00.299) 0:02:04.229 ***** 2026-02-26 12:37:30.682901 | controller | skipping: [instance] 2026-02-26 12:37:30.716422 | controller | 2026-02-26 12:37:30.716467 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2026-02-26 12:37:30.716483 | controller | Thursday 26 February 2026 12:37:30 +0000 (0:00:00.023) 0:02:04.253 ***** 2026-02-26 12:37:30.716503 | controller | skipping: [instance] 2026-02-26 12:37:30.744261 | controller | 2026-02-26 12:37:30.744284 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2026-02-26 12:37:30.744294 | controller | Thursday 26 February 2026 12:37:30 +0000 (0:00:00.032) 0:02:04.286 ***** 2026-02-26 12:37:30.744306 | controller | skipping: [instance] 2026-02-26 12:37:30.769500 | controller | 2026-02-26 12:37:30.769567 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2026-02-26 12:37:30.769583 | controller | Thursday 26 February 2026 12:37:30 +0000 (0:00:00.028) 0:02:04.314 ***** 2026-02-26 12:37:30.769603 | controller | skipping: [instance] 2026-02-26 12:37:31.001056 | controller | 2026-02-26 12:37:31.001093 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-26 12:37:31.001107 | controller | Thursday 26 February 2026 12:37:30 +0000 (0:00:00.025) 0:02:04.339 ***** 2026-02-26 12:37:31.001118 | controller | changed: [instance] 2026-02-26 12:37:31.038273 | controller | 2026-02-26 12:37:31.038304 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-26 12:37:31.038316 | controller | Thursday 26 February 2026 12:37:30 +0000 (0:00:00.231) 0:02:04.571 ***** 2026-02-26 12:37:31.038330 | controller | ok: [instance] 2026-02-26 12:37:31.093939 | controller | 2026-02-26 12:37:31.093963 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-26 12:37:31.093973 | controller | Thursday 26 February 2026 12:37:31 +0000 (0:00:00.037) 0:02:04.608 ***** 2026-02-26 12:37:31.093992 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-26 12:37:31.296395 | controller | 2026-02-26 12:37:31.296448 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-26 12:37:31.296459 | controller | Thursday 26 February 2026 12:37:31 +0000 (0:00:00.055) 0:02:04.664 ***** 2026-02-26 12:37:31.296474 | controller | ok: [instance] 2026-02-26 12:37:31.365314 | controller | 2026-02-26 12:37:31.365336 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-26 12:37:31.365345 | controller | Thursday 26 February 2026 12:37:31 +0000 (0:00:00.201) 0:02:04.865 ***** 2026-02-26 12:37:31.365357 | controller | ok: [instance] 2026-02-26 12:37:31.365491 | controller | 2026-02-26 12:37:31.365543 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-26 12:37:31.365559 | controller | Thursday 26 February 2026 12:37:31 +0000 (0:00:00.069) 0:02:04.935 ***** 2026-02-26 12:37:31.418106 | controller | ok: [instance] 2026-02-26 12:37:31.466337 | controller | 2026-02-26 12:37:31.466369 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-26 12:37:31.466379 | controller | Thursday 26 February 2026 12:37:31 +0000 (0:00:00.052) 0:02:04.988 ***** 2026-02-26 12:37:31.466393 | controller | skipping: [instance] 2026-02-26 12:37:31.466434 | controller | 2026-02-26 12:37:31.466671 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-26 12:37:31.514708 | controller | Thursday 26 February 2026 12:37:31 +0000 (0:00:00.048) 0:02:05.036 ***** 2026-02-26 12:37:31.514738 | controller | skipping: [instance] 2026-02-26 12:37:31.582416 | controller | 2026-02-26 12:37:31.582464 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-26 12:37:31.582473 | controller | Thursday 26 February 2026 12:37:31 +0000 (0:00:00.048) 0:02:05.084 ***** 2026-02-26 12:37:31.582487 | controller | 2026-02-26 12:37:32.008410 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-26 12:37:32.008457 | controller | Thursday 26 February 2026 12:37:31 +0000 (0:00:00.067) 0:02:05.152 ***** 2026-02-26 12:37:32.008471 | controller | ok: [instance] => (item=artifacts) 2026-02-26 12:37:32.008479 | controller | ok: [instance] => (item=logs) 2026-02-26 12:37:32.008486 | controller | 2026-02-26 12:37:32.008492 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-26 12:37:32.008505 | controller | Thursday 26 February 2026 12:37:32 +0000 (0:00:00.425) 0:02:05.578 ***** 2026-02-26 12:37:33.207192 | controller | ok: [instance] 2026-02-26 12:37:33.421664 | controller | 2026-02-26 12:37:33.421686 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-26 12:37:33.421695 | controller | Thursday 26 February 2026 12:37:33 +0000 (0:00:01.198) 0:02:06.776 ***** 2026-02-26 12:37:33.421703 | controller | changed: [instance] 2026-02-26 12:37:33.782349 | controller | 2026-02-26 12:37:33.782408 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-26 12:37:33.782421 | controller | Thursday 26 February 2026 12:37:33 +0000 (0:00:00.215) 0:02:06.992 ***** 2026-02-26 12:37:33.782438 | controller | changed: [instance] 2026-02-26 12:37:34.163090 | controller | 2026-02-26 12:37:34.163147 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-26 12:37:34.163157 | controller | Thursday 26 February 2026 12:37:33 +0000 (0:00:00.360) 0:02:07.352 ***** 2026-02-26 12:37:34.163168 | controller | changed: [instance] 2026-02-26 12:37:34.210032 | controller | 2026-02-26 12:37:34.210051 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-26 12:37:34.210058 | controller | Thursday 26 February 2026 12:37:34 +0000 (0:00:00.380) 0:02:07.733 ***** 2026-02-26 12:37:34.210066 | controller | skipping: [instance] 2026-02-26 12:37:34.412369 | controller | 2026-02-26 12:37:34.412395 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-26 12:37:34.412403 | controller | Thursday 26 February 2026 12:37:34 +0000 (0:00:00.046) 0:02:07.780 ***** 2026-02-26 12:37:34.412418 | controller | ok: [instance] 2026-02-26 12:37:34.456472 | controller | 2026-02-26 12:37:34.456526 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-26 12:37:34.456537 | controller | Thursday 26 February 2026 12:37:34 +0000 (0:00:00.202) 0:02:07.982 ***** 2026-02-26 12:37:34.456551 | controller | skipping: [instance] 2026-02-26 12:37:34.456598 | controller | 2026-02-26 12:37:34.456609 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-26 12:37:34.738642 | controller | Thursday 26 February 2026 12:37:34 +0000 (0:00:00.044) 0:02:08.026 ***** 2026-02-26 12:37:34.738679 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2026-02-26 12:37:35.074371 | controller | changed: [instance] 2026-02-26 12:37:35.074417 | controller | 2026-02-26 12:37:35.074429 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-26 12:37:35.074437 | controller | Thursday 26 February 2026 12:37:34 +0000 (0:00:00.282) 0:02:08.308 ***** 2026-02-26 12:37:35.074451 | controller | changed: [instance] 2026-02-26 12:37:35.074490 | controller | 2026-02-26 12:37:35.074511 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-26 12:37:35.074535 | controller | Thursday 26 February 2026 12:37:35 +0000 (0:00:00.335) 0:02:08.644 ***** 2026-02-26 12:37:35.119316 | controller | skipping: [instance] 2026-02-26 12:37:35.119466 | controller | 2026-02-26 12:37:35.119507 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2026-02-26 12:37:35.119523 | controller | Thursday 26 February 2026 12:37:35 +0000 (0:00:00.045) 0:02:08.689 ***** 2026-02-26 12:37:35.145940 | controller | skipping: [instance] 2026-02-26 12:37:35.396686 | controller | 2026-02-26 12:37:35.396710 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2026-02-26 12:37:35.396719 | controller | Thursday 26 February 2026 12:37:35 +0000 (0:00:00.026) 0:02:08.716 ***** 2026-02-26 12:37:35.396729 | controller | changed: [instance] 2026-02-26 12:37:35.637859 | controller | 2026-02-26 12:37:35.637904 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2026-02-26 12:37:35.637912 | controller | Thursday 26 February 2026 12:37:35 +0000 (0:00:00.250) 0:02:08.967 ***** 2026-02-26 12:37:35.637923 | controller | changed: [instance] 2026-02-26 12:37:35.953868 | controller | 2026-02-26 12:37:35.953919 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2026-02-26 12:37:35.953928 | controller | Thursday 26 February 2026 12:37:35 +0000 (0:00:00.240) 0:02:09.207 ***** 2026-02-26 12:37:35.953945 | controller | changed: [instance] 2026-02-26 12:37:35.981698 | controller | 2026-02-26 12:37:35.981724 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2026-02-26 12:37:35.981734 | controller | Thursday 26 February 2026 12:37:35 +0000 (0:00:00.316) 0:02:09.523 ***** 2026-02-26 12:37:35.981746 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-26 12:37:36.025527 | controller | 2026-02-26 12:37:36.025597 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-26 12:37:36.025613 | controller | Thursday 26 February 2026 12:37:35 +0000 (0:00:00.028) 0:02:09.552 ***** 2026-02-26 12:37:36.025635 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-26 12:37:36.268882 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-26 12:37:36.268922 | controller | 2026-02-26 12:37:36.268931 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-26 12:37:36.268938 | controller | Thursday 26 February 2026 12:37:36 +0000 (0:00:00.043) 0:02:09.595 ***** 2026-02-26 12:37:36.268949 | controller | ok: [instance] 2026-02-26 12:37:36.325802 | controller | 2026-02-26 12:37:36.325839 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-26 12:37:36.325849 | controller | Thursday 26 February 2026 12:37:36 +0000 (0:00:00.243) 0:02:09.839 ***** 2026-02-26 12:37:36.325861 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 12:37:36.579932 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 12:37:36.579966 | controller | 2026-02-26 12:37:36.579974 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-26 12:37:36.579981 | controller | Thursday 26 February 2026 12:37:36 +0000 (0:00:00.056) 0:02:09.895 ***** 2026-02-26 12:37:36.579992 | controller | ok: [instance] 2026-02-26 12:37:36.817661 | controller | 2026-02-26 12:37:36.817703 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-26 12:37:36.817711 | controller | Thursday 26 February 2026 12:37:36 +0000 (0:00:00.254) 0:02:10.150 ***** 2026-02-26 12:37:36.817723 | controller | ok: [instance] 2026-02-26 12:37:37.119700 | controller | 2026-02-26 12:37:37.119742 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2026-02-26 12:37:37.119751 | controller | Thursday 26 February 2026 12:37:36 +0000 (0:00:00.237) 0:02:10.387 ***** 2026-02-26 12:37:37.119769 | controller | changed: [instance] 2026-02-26 12:37:37.372916 | controller | 2026-02-26 12:37:37.372971 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-26 12:37:37.372981 | controller | Thursday 26 February 2026 12:37:37 +0000 (0:00:00.301) 0:02:10.689 ***** 2026-02-26 12:37:37.372995 | controller | ok: [instance] 2026-02-26 12:37:37.418061 | controller | 2026-02-26 12:37:37.418093 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-26 12:37:37.418102 | controller | Thursday 26 February 2026 12:37:37 +0000 (0:00:00.253) 0:02:10.942 ***** 2026-02-26 12:37:37.418113 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 12:37:37.666348 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 12:37:37.666384 | controller | 2026-02-26 12:37:37.666395 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-26 12:37:37.666403 | controller | Thursday 26 February 2026 12:37:37 +0000 (0:00:00.045) 0:02:10.988 ***** 2026-02-26 12:37:37.666416 | controller | ok: [instance] 2026-02-26 12:37:37.878339 | controller | 2026-02-26 12:37:37.878389 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-26 12:37:37.878398 | controller | Thursday 26 February 2026 12:37:37 +0000 (0:00:00.247) 0:02:11.235 ***** 2026-02-26 12:37:37.878410 | controller | ok: [instance] 2026-02-26 12:37:37.878473 | controller | 2026-02-26 12:37:37.878509 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2026-02-26 12:37:37.878525 | controller | Thursday 26 February 2026 12:37:37 +0000 (0:00:00.212) 0:02:11.448 ***** 2026-02-26 12:37:38.182353 | controller | changed: [instance] 2026-02-26 12:37:38.204379 | controller | 2026-02-26 12:37:38.204410 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2026-02-26 12:37:38.204422 | controller | Thursday 26 February 2026 12:37:38 +0000 (0:00:00.303) 0:02:11.752 ***** 2026-02-26 12:37:38.204436 | controller | skipping: [instance] 2026-02-26 12:37:38.232283 | controller | 2026-02-26 12:37:38.232300 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2026-02-26 12:37:38.232307 | controller | Thursday 26 February 2026 12:37:38 +0000 (0:00:00.022) 0:02:11.774 ***** 2026-02-26 12:37:38.232315 | controller | skipping: [instance] 2026-02-26 12:37:38.262120 | controller | 2026-02-26 12:37:38.262157 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2026-02-26 12:37:38.262167 | controller | Thursday 26 February 2026 12:37:38 +0000 (0:00:00.028) 0:02:11.802 ***** 2026-02-26 12:37:38.262178 | controller | skipping: [instance] 2026-02-26 12:37:38.288812 | controller | 2026-02-26 12:37:38.288830 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2026-02-26 12:37:38.288838 | controller | Thursday 26 February 2026 12:37:38 +0000 (0:00:00.029) 0:02:11.832 ***** 2026-02-26 12:37:38.288847 | controller | skipping: [instance] 2026-02-26 12:37:38.540934 | controller | 2026-02-26 12:37:38.540989 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-26 12:37:38.541000 | controller | Thursday 26 February 2026 12:37:38 +0000 (0:00:00.026) 0:02:11.859 ***** 2026-02-26 12:37:38.541013 | controller | changed: [instance] 2026-02-26 12:37:38.593300 | controller | 2026-02-26 12:37:38.593345 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-26 12:37:38.593355 | controller | Thursday 26 February 2026 12:37:38 +0000 (0:00:00.251) 0:02:12.110 ***** 2026-02-26 12:37:38.593367 | controller | ok: [instance] 2026-02-26 12:37:38.658486 | controller | 2026-02-26 12:37:38.658557 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-26 12:37:38.658573 | controller | Thursday 26 February 2026 12:37:38 +0000 (0:00:00.052) 0:02:12.163 ***** 2026-02-26 12:37:38.658593 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-26 12:37:38.658626 | controller | 2026-02-26 12:37:38.658637 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-26 12:37:38.658650 | controller | Thursday 26 February 2026 12:37:38 +0000 (0:00:00.064) 0:02:12.228 ***** 2026-02-26 12:37:38.882047 | controller | ok: [instance] 2026-02-26 12:37:38.882148 | controller | 2026-02-26 12:37:38.882258 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-26 12:37:38.882369 | controller | Thursday 26 February 2026 12:37:38 +0000 (0:00:00.223) 0:02:12.452 ***** 2026-02-26 12:37:38.959916 | controller | ok: [instance] 2026-02-26 12:37:38.960008 | controller | 2026-02-26 12:37:38.960108 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-26 12:37:38.960358 | controller | Thursday 26 February 2026 12:37:38 +0000 (0:00:00.077) 0:02:12.529 ***** 2026-02-26 12:37:39.011427 | controller | ok: [instance] 2026-02-26 12:37:39.011475 | controller | 2026-02-26 12:37:39.011581 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-26 12:37:39.011683 | controller | Thursday 26 February 2026 12:37:39 +0000 (0:00:00.052) 0:02:12.582 ***** 2026-02-26 12:37:39.057168 | controller | skipping: [instance] 2026-02-26 12:37:39.057242 | controller | 2026-02-26 12:37:39.057405 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-26 12:37:39.057485 | controller | Thursday 26 February 2026 12:37:39 +0000 (0:00:00.045) 0:02:12.627 ***** 2026-02-26 12:37:39.100899 | controller | skipping: [instance] 2026-02-26 12:37:39.101013 | controller | 2026-02-26 12:37:39.101157 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-26 12:37:39.101324 | controller | Thursday 26 February 2026 12:37:39 +0000 (0:00:00.043) 0:02:12.671 ***** 2026-02-26 12:37:39.160093 | controller | 2026-02-26 12:37:39.160178 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-26 12:37:39.160256 | controller | Thursday 26 February 2026 12:37:39 +0000 (0:00:00.059) 0:02:12.730 ***** 2026-02-26 12:37:39.582947 | controller | ok: [instance] => (item=artifacts) 2026-02-26 12:37:39.583003 | controller | ok: [instance] => (item=logs) 2026-02-26 12:37:39.583095 | controller | 2026-02-26 12:37:39.583203 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-26 12:37:39.583324 | controller | Thursday 26 February 2026 12:37:39 +0000 (0:00:00.422) 0:02:13.153 ***** 2026-02-26 12:37:40.929365 | controller | ok: [instance] 2026-02-26 12:37:41.157413 | controller | 2026-02-26 12:37:41.157487 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-26 12:37:41.157503 | controller | Thursday 26 February 2026 12:37:40 +0000 (0:00:01.345) 0:02:14.499 ***** 2026-02-26 12:37:41.157526 | controller | changed: [instance] 2026-02-26 12:37:41.544612 | controller | 2026-02-26 12:37:41.544669 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-26 12:37:41.544680 | controller | Thursday 26 February 2026 12:37:41 +0000 (0:00:00.228) 0:02:14.727 ***** 2026-02-26 12:37:41.544693 | controller | changed: [instance] 2026-02-26 12:37:41.927973 | controller | 2026-02-26 12:37:41.928020 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-26 12:37:41.928029 | controller | Thursday 26 February 2026 12:37:41 +0000 (0:00:00.387) 0:02:15.114 ***** 2026-02-26 12:37:41.928042 | controller | changed: [instance] 2026-02-26 12:37:41.972834 | controller | 2026-02-26 12:37:41.972851 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-26 12:37:41.972858 | controller | Thursday 26 February 2026 12:37:41 +0000 (0:00:00.383) 0:02:15.498 ***** 2026-02-26 12:37:41.972866 | controller | skipping: [instance] 2026-02-26 12:37:42.180843 | controller | 2026-02-26 12:37:42.180869 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-26 12:37:42.180878 | controller | Thursday 26 February 2026 12:37:41 +0000 (0:00:00.044) 0:02:15.543 ***** 2026-02-26 12:37:42.180889 | controller | ok: [instance] 2026-02-26 12:37:42.232755 | controller | 2026-02-26 12:37:42.232781 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-26 12:37:42.232789 | controller | Thursday 26 February 2026 12:37:42 +0000 (0:00:00.208) 0:02:15.751 ***** 2026-02-26 12:37:42.232798 | controller | skipping: [instance] 2026-02-26 12:37:42.478751 | controller | 2026-02-26 12:37:42.478777 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-26 12:37:42.478784 | controller | Thursday 26 February 2026 12:37:42 +0000 (0:00:00.051) 0:02:15.803 ***** 2026-02-26 12:37:42.478794 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2026-02-26 12:37:42.798090 | controller | changed: [instance] 2026-02-26 12:37:42.798131 | controller | 2026-02-26 12:37:42.798146 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-26 12:37:42.798152 | controller | Thursday 26 February 2026 12:37:42 +0000 (0:00:00.245) 0:02:16.048 ***** 2026-02-26 12:37:42.798161 | controller | changed: [instance] 2026-02-26 12:37:42.851415 | controller | 2026-02-26 12:37:42.851470 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-26 12:37:42.851482 | controller | Thursday 26 February 2026 12:37:42 +0000 (0:00:00.319) 0:02:16.368 ***** 2026-02-26 12:37:42.851497 | controller | skipping: [instance] 2026-02-26 12:37:42.851540 | controller | 2026-02-26 12:37:42.851551 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2026-02-26 12:37:42.887443 | controller | Thursday 26 February 2026 12:37:42 +0000 (0:00:00.053) 0:02:16.421 ***** 2026-02-26 12:37:42.887500 | controller | skipping: [instance] 2026-02-26 12:37:43.200430 | controller | 2026-02-26 12:37:43.200491 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2026-02-26 12:37:43.200514 | controller | Thursday 26 February 2026 12:37:42 +0000 (0:00:00.036) 0:02:16.457 ***** 2026-02-26 12:37:43.200534 | controller | changed: [instance] 2026-02-26 12:37:43.444824 | controller | 2026-02-26 12:37:43.444867 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2026-02-26 12:37:43.444883 | controller | Thursday 26 February 2026 12:37:43 +0000 (0:00:00.312) 0:02:16.770 ***** 2026-02-26 12:37:43.444895 | controller | changed: [instance] 2026-02-26 12:37:43.779543 | controller | 2026-02-26 12:37:43.779597 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2026-02-26 12:37:43.779607 | controller | Thursday 26 February 2026 12:37:43 +0000 (0:00:00.244) 0:02:17.015 ***** 2026-02-26 12:37:43.779619 | controller | changed: [instance] 2026-02-26 12:37:43.815453 | controller | 2026-02-26 12:37:43.815503 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2026-02-26 12:37:43.815514 | controller | Thursday 26 February 2026 12:37:43 +0000 (0:00:00.334) 0:02:17.349 ***** 2026-02-26 12:37:43.815528 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-26 12:37:43.869429 | controller | 2026-02-26 12:37:43.869463 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-26 12:37:43.869477 | controller | Thursday 26 February 2026 12:37:43 +0000 (0:00:00.036) 0:02:17.385 ***** 2026-02-26 12:37:43.869493 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-26 12:37:44.128332 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-26 12:37:44.128385 | controller | 2026-02-26 12:37:44.128397 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-26 12:37:44.128406 | controller | Thursday 26 February 2026 12:37:43 +0000 (0:00:00.053) 0:02:17.439 ***** 2026-02-26 12:37:44.128422 | controller | ok: [instance] 2026-02-26 12:37:44.128616 | controller | 2026-02-26 12:37:44.128651 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-26 12:37:44.128664 | controller | Thursday 26 February 2026 12:37:44 +0000 (0:00:00.259) 0:02:17.698 ***** 2026-02-26 12:37:44.181979 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 12:37:44.441933 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 12:37:44.441956 | controller | 2026-02-26 12:37:44.441965 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-26 12:37:44.441972 | controller | Thursday 26 February 2026 12:37:44 +0000 (0:00:00.053) 0:02:17.751 ***** 2026-02-26 12:37:44.441982 | controller | ok: [instance] 2026-02-26 12:37:44.645851 | controller | 2026-02-26 12:37:44.645891 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-26 12:37:44.645899 | controller | Thursday 26 February 2026 12:37:44 +0000 (0:00:00.260) 0:02:18.012 ***** 2026-02-26 12:37:44.645909 | controller | ok: [instance] 2026-02-26 12:37:44.946731 | controller | 2026-02-26 12:37:44.946752 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2026-02-26 12:37:44.946759 | controller | Thursday 26 February 2026 12:37:44 +0000 (0:00:00.203) 0:02:18.215 ***** 2026-02-26 12:37:44.946767 | controller | changed: [instance] 2026-02-26 12:37:45.194388 | controller | 2026-02-26 12:37:45.194421 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-26 12:37:45.194429 | controller | Thursday 26 February 2026 12:37:44 +0000 (0:00:00.301) 0:02:18.516 ***** 2026-02-26 12:37:45.194439 | controller | ok: [instance] 2026-02-26 12:37:45.242430 | controller | 2026-02-26 12:37:45.242510 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-26 12:37:45.242528 | controller | Thursday 26 February 2026 12:37:45 +0000 (0:00:00.247) 0:02:18.764 ***** 2026-02-26 12:37:45.242553 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 12:37:45.498601 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 12:37:45.498634 | controller | 2026-02-26 12:37:45.498643 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-26 12:37:45.498650 | controller | Thursday 26 February 2026 12:37:45 +0000 (0:00:00.047) 0:02:18.812 ***** 2026-02-26 12:37:45.498660 | controller | ok: [instance] 2026-02-26 12:37:45.726348 | controller | 2026-02-26 12:37:45.726391 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-26 12:37:45.726399 | controller | Thursday 26 February 2026 12:37:45 +0000 (0:00:00.256) 0:02:19.069 ***** 2026-02-26 12:37:45.726411 | controller | ok: [instance] 2026-02-26 12:37:45.726429 | controller | 2026-02-26 12:37:45.726625 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2026-02-26 12:37:46.024991 | controller | Thursday 26 February 2026 12:37:45 +0000 (0:00:00.227) 0:02:19.296 ***** 2026-02-26 12:37:46.025031 | controller | changed: [instance] 2026-02-26 12:37:46.049448 | controller | 2026-02-26 12:37:46.049506 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2026-02-26 12:37:46.049515 | controller | Thursday 26 February 2026 12:37:46 +0000 (0:00:00.298) 0:02:19.595 ***** 2026-02-26 12:37:46.049533 | controller | skipping: [instance] 2026-02-26 12:37:46.049555 | controller | 2026-02-26 12:37:46.049561 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2026-02-26 12:37:46.049568 | controller | Thursday 26 February 2026 12:37:46 +0000 (0:00:00.024) 0:02:19.619 ***** 2026-02-26 12:37:46.084027 | controller | skipping: [instance] 2026-02-26 12:37:46.114372 | controller | 2026-02-26 12:37:46.114405 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2026-02-26 12:37:46.114420 | controller | Thursday 26 February 2026 12:37:46 +0000 (0:00:00.034) 0:02:19.654 ***** 2026-02-26 12:37:46.114436 | controller | skipping: [instance] 2026-02-26 12:37:46.142331 | controller | 2026-02-26 12:37:46.142376 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2026-02-26 12:37:46.142386 | controller | Thursday 26 February 2026 12:37:46 +0000 (0:00:00.030) 0:02:19.684 ***** 2026-02-26 12:37:46.142399 | controller | skipping: [instance] 2026-02-26 12:37:46.368056 | controller | 2026-02-26 12:37:46.368085 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-26 12:37:46.368093 | controller | Thursday 26 February 2026 12:37:46 +0000 (0:00:00.028) 0:02:19.712 ***** 2026-02-26 12:37:46.368102 | controller | changed: [instance] 2026-02-26 12:37:46.406157 | controller | 2026-02-26 12:37:46.406176 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-26 12:37:46.406183 | controller | Thursday 26 February 2026 12:37:46 +0000 (0:00:00.225) 0:02:19.938 ***** 2026-02-26 12:37:46.406191 | controller | ok: [instance] 2026-02-26 12:37:46.434607 | controller | 2026-02-26 12:37:46.434628 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-26 12:37:46.434636 | controller | Thursday 26 February 2026 12:37:46 +0000 (0:00:00.038) 0:02:19.976 ***** 2026-02-26 12:37:46.434646 | controller | skipping: [instance] 2026-02-26 12:37:46.463338 | controller | 2026-02-26 12:37:46.463383 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-26 12:37:46.463392 | controller | Thursday 26 February 2026 12:37:46 +0000 (0:00:00.028) 0:02:20.005 ***** 2026-02-26 12:37:46.463412 | controller | skipping: [instance] 2026-02-26 12:37:46.508415 | controller | 2026-02-26 12:37:46.508455 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-26 12:37:46.508465 | controller | Thursday 26 February 2026 12:37:46 +0000 (0:00:00.028) 0:02:20.033 ***** 2026-02-26 12:37:46.508476 | controller | skipping: [instance] 2026-02-26 12:37:46.546050 | controller | 2026-02-26 12:37:46.546076 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2026-02-26 12:37:46.546086 | controller | Thursday 26 February 2026 12:37:46 +0000 (0:00:00.045) 0:02:20.078 ***** 2026-02-26 12:37:46.546097 | controller | skipping: [instance] 2026-02-26 12:37:46.614357 | controller | 2026-02-26 12:37:46.614383 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2026-02-26 12:37:46.614393 | controller | Thursday 26 February 2026 12:37:46 +0000 (0:00:00.037) 0:02:20.116 ***** 2026-02-26 12:37:46.614404 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2026-02-26 12:37:46.874195 | controller | 2026-02-26 12:37:46.874237 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2026-02-26 12:37:46.874254 | controller | Thursday 26 February 2026 12:37:46 +0000 (0:00:00.068) 0:02:20.184 ***** 2026-02-26 12:37:46.874264 | controller | ok: [instance] => (item=crc) 2026-02-26 12:37:48.947151 | controller | 2026-02-26 12:37:48.947179 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2026-02-26 12:37:48.947187 | controller | Thursday 26 February 2026 12:37:46 +0000 (0:00:00.259) 0:02:20.444 ***** 2026-02-26 12:37:48.947196 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-26 12:37:49.874411 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-26 12:37:49.874477 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-26 12:37:49.874488 | controller | 2026-02-26 12:37:49.874497 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-26 12:37:49.874506 | controller | Thursday 26 February 2026 12:37:48 +0000 (0:00:02.072) 0:02:22.517 ***** 2026-02-26 12:37:49.874521 | controller | changed: [instance] 2026-02-26 12:37:50.704932 | controller | 2026-02-26 12:37:50.704981 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-26 12:37:50.704991 | controller | Thursday 26 February 2026 12:37:49 +0000 (0:00:00.927) 0:02:23.444 ***** 2026-02-26 12:37:50.705004 | controller | changed: [instance] 2026-02-26 12:37:51.551612 | controller | 2026-02-26 12:37:51.551647 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-26 12:37:51.551655 | controller | Thursday 26 February 2026 12:37:50 +0000 (0:00:00.830) 0:02:24.274 ***** 2026-02-26 12:37:51.551665 | controller | changed: [instance] 2026-02-26 12:37:52.356827 | controller | 2026-02-26 12:37:52.356882 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2026-02-26 12:37:52.356898 | controller | Thursday 26 February 2026 12:37:51 +0000 (0:00:00.846) 0:02:25.121 ***** 2026-02-26 12:37:52.356911 | controller | changed: [instance] => (item=compute-0.utility) 2026-02-26 12:38:15.459814 | controller | changed: [instance] => (item=controller-0.utility) 2026-02-26 12:38:15.459850 | controller | changed: [instance] => (item=crc-0.utility) 2026-02-26 12:38:15.459866 | controller | 2026-02-26 12:38:15.459871 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2026-02-26 12:38:15.459877 | controller | Thursday 26 February 2026 12:37:52 +0000 (0:00:00.804) 0:02:25.926 ***** 2026-02-26 12:38:15.459888 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-02-26 12:38:15.459911 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2026-02-26 12:38:15.459917 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2026-02-26 12:38:15.459922 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2026-02-26 12:38:15.459927 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2026-02-26 12:38:15.459932 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2026-02-26 12:38:15.459937 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). 2026-02-26 12:38:15.459942 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j109603649149.24599', 'results_file': '/home/zuul/.ansible_async/j109603649149.24599', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2026-02-26 12:38:15.459958 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j180728091349.24616', 'results_file': '/home/zuul/.ansible_async/j180728091349.24616', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2026-02-26 12:38:15.459965 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j673136259128.24632', 'results_file': '/home/zuul/.ansible_async/j673136259128.24632', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2026-02-26 12:38:15.459984 | controller | 2026-02-26 12:38:15.460285 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2026-02-26 12:38:15.567706 | controller | Thursday 26 February 2026 12:38:15 +0000 (0:00:23.102) 0:02:49.029 ***** 2026-02-26 12:38:15.567767 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-26 12:38:15.592464 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-26 12:38:15.592500 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-26 12:38:15.592508 | controller | 2026-02-26 12:38:15.592514 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-26 12:38:15.592520 | controller | Thursday 26 February 2026 12:38:15 +0000 (0:00:00.108) 0:02:49.137 ***** 2026-02-26 12:38:15.592532 | controller | skipping: [instance] 2026-02-26 12:38:15.630753 | controller | 2026-02-26 12:38:15.630780 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2026-02-26 12:38:15.630794 | controller | Thursday 26 February 2026 12:38:15 +0000 (0:00:00.025) 0:02:49.162 ***** 2026-02-26 12:38:15.630812 | controller | 2026-02-26 12:38:15.804725 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-26 12:38:15.804767 | controller | Thursday 26 February 2026 12:38:15 +0000 (0:00:00.038) 0:02:49.201 ***** 2026-02-26 12:38:15.804787 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-26 12:38:15.804897 | controller | 2026-02-26 12:38:15.805175 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-26 12:38:16.029478 | controller | Thursday 26 February 2026 12:38:15 +0000 (0:00:00.173) 0:02:49.375 ***** 2026-02-26 12:38:16.029523 | controller | changed: [instance] 2026-02-26 12:38:16.029552 | controller | 2026-02-26 12:38:16.029559 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-26 12:38:16.029567 | controller | Thursday 26 February 2026 12:38:16 +0000 (0:00:00.224) 0:02:49.599 ***** 2026-02-26 12:38:16.262305 | controller | changed: [instance] 2026-02-26 12:38:16.262363 | controller | 2026-02-26 12:38:16.262483 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2026-02-26 12:38:16.262582 | controller | Thursday 26 February 2026 12:38:16 +0000 (0:00:00.232) 0:02:49.832 ***** 2026-02-26 12:38:16.673903 | controller | changed: [instance] 2026-02-26 12:38:16.673969 | controller | 2026-02-26 12:38:16.674049 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2026-02-26 12:38:16.674163 | controller | Thursday 26 February 2026 12:38:16 +0000 (0:00:00.411) 0:02:50.244 ***** 2026-02-26 12:38:16.708353 | controller | skipping: [instance] 2026-02-26 12:38:16.708430 | controller | 2026-02-26 12:38:16.708536 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-26 12:38:16.708637 | controller | Thursday 26 February 2026 12:38:16 +0000 (0:00:00.034) 0:02:50.278 ***** 2026-02-26 12:38:16.742063 | controller | skipping: [instance] 2026-02-26 12:38:16.795840 | controller | 2026-02-26 12:38:16.795891 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2026-02-26 12:38:16.795900 | controller | Thursday 26 February 2026 12:38:16 +0000 (0:00:00.033) 0:02:50.312 ***** 2026-02-26 12:38:16.795920 | controller | skipping: [instance] 2026-02-26 12:38:16.851849 | controller | 2026-02-26 12:38:16.851888 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2026-02-26 12:38:16.851896 | controller | Thursday 26 February 2026 12:38:16 +0000 (0:00:00.053) 0:02:50.366 ***** 2026-02-26 12:38:16.851908 | controller | skipping: [instance] 2026-02-26 12:38:16.852128 | controller | 2026-02-26 12:38:16.882458 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-26 12:38:16.882503 | controller | Thursday 26 February 2026 12:38:16 +0000 (0:00:00.056) 0:02:50.422 ***** 2026-02-26 12:38:16.882516 | controller | skipping: [instance] 2026-02-26 12:38:16.928290 | controller | 2026-02-26 12:38:16.928313 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2026-02-26 12:38:16.928321 | controller | Thursday 26 February 2026 12:38:16 +0000 (0:00:00.030) 0:02:50.452 ***** 2026-02-26 12:38:16.928330 | controller | 2026-02-26 12:38:17.018976 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-26 12:38:17.019000 | controller | Thursday 26 February 2026 12:38:16 +0000 (0:00:00.045) 0:02:50.498 ***** 2026-02-26 12:38:17.019018 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-26 12:38:17.270525 | controller | 2026-02-26 12:38:17.270566 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-26 12:38:17.270575 | controller | Thursday 26 February 2026 12:38:17 +0000 (0:00:00.090) 0:02:50.589 ***** 2026-02-26 12:38:17.270587 | controller | ok: [instance] 2026-02-26 12:38:17.505426 | controller | 2026-02-26 12:38:17.505475 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-26 12:38:17.505484 | controller | Thursday 26 February 2026 12:38:17 +0000 (0:00:00.251) 0:02:50.840 ***** 2026-02-26 12:38:17.505496 | controller | ok: [instance] 2026-02-26 12:38:17.505514 | controller | 2026-02-26 12:38:17.505520 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2026-02-26 12:38:17.505526 | controller | Thursday 26 February 2026 12:38:17 +0000 (0:00:00.235) 0:02:51.075 ***** 2026-02-26 12:38:17.913566 | controller | changed: [instance] 2026-02-26 12:38:17.953845 | controller | 2026-02-26 12:38:17.953887 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2026-02-26 12:38:17.953897 | controller | Thursday 26 February 2026 12:38:17 +0000 (0:00:00.407) 0:02:51.482 ***** 2026-02-26 12:38:17.953908 | controller | skipping: [instance] 2026-02-26 12:38:17.986827 | controller | 2026-02-26 12:38:17.986880 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-26 12:38:17.986889 | controller | Thursday 26 February 2026 12:38:17 +0000 (0:00:00.040) 0:02:51.523 ***** 2026-02-26 12:38:17.986902 | controller | skipping: [instance] 2026-02-26 12:38:17.986922 | controller | 2026-02-26 12:38:17.986929 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2026-02-26 12:38:19.747384 | controller | Thursday 26 February 2026 12:38:17 +0000 (0:00:00.033) 0:02:51.557 ***** 2026-02-26 12:38:19.747464 | controller | changed: [instance -> controller-0.instance] 2026-02-26 12:38:20.908252 | controller | 2026-02-26 12:38:20.908315 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2026-02-26 12:38:20.908325 | controller | Thursday 26 February 2026 12:38:19 +0000 (0:00:01.759) 0:02:53.316 ***** 2026-02-26 12:38:20.908340 | controller | changed: [instance -> controller-0.instance] 2026-02-26 12:38:20.957076 | controller | 2026-02-26 12:38:20.957128 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-26 12:38:20.957138 | controller | Thursday 26 February 2026 12:38:20 +0000 (0:00:01.160) 0:02:54.477 ***** 2026-02-26 12:38:20.957150 | controller | 2026-02-26 12:38:21.220867 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-26 12:38:21.220921 | controller | Thursday 26 February 2026 12:38:20 +0000 (0:00:00.049) 0:02:54.527 ***** 2026-02-26 12:38:21.220936 | controller | ok: [instance] 2026-02-26 12:38:21.248955 | controller | 2026-02-26 12:38:21.248990 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-26 12:38:21.249005 | controller | Thursday 26 February 2026 12:38:21 +0000 (0:00:00.263) 0:02:54.790 ***** 2026-02-26 12:38:21.249016 | controller | ok: [instance] 2026-02-26 12:38:21.278724 | controller | 2026-02-26 12:38:21.278747 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-26 12:38:21.278756 | controller | Thursday 26 February 2026 12:38:21 +0000 (0:00:00.028) 0:02:54.819 ***** 2026-02-26 12:38:21.278767 | controller | skipping: [instance] 2026-02-26 12:38:21.322974 | controller | 2026-02-26 12:38:21.322996 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2026-02-26 12:38:21.323005 | controller | Thursday 26 February 2026 12:38:21 +0000 (0:00:00.029) 0:02:54.849 ***** 2026-02-26 12:38:21.323014 | controller | 2026-02-26 12:38:21.398103 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-26 12:38:21.398128 | controller | Thursday 26 February 2026 12:38:21 +0000 (0:00:00.044) 0:02:54.893 ***** 2026-02-26 12:38:21.398141 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2026-02-26 12:38:21.620910 | controller | 2026-02-26 12:38:21.620963 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-26 12:38:21.620973 | controller | Thursday 26 February 2026 12:38:21 +0000 (0:00:00.074) 0:02:54.968 ***** 2026-02-26 12:38:21.620985 | controller | ok: [instance] 2026-02-26 12:38:21.868355 | controller | 2026-02-26 12:38:21.868400 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-26 12:38:21.868409 | controller | Thursday 26 February 2026 12:38:21 +0000 (0:00:00.221) 0:02:55.190 ***** 2026-02-26 12:38:21.868421 | controller | ok: [instance] 2026-02-26 12:38:22.269898 | controller | 2026-02-26 12:38:22.269946 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2026-02-26 12:38:22.269968 | controller | Thursday 26 February 2026 12:38:21 +0000 (0:00:00.247) 0:02:55.438 ***** 2026-02-26 12:38:22.269982 | controller | changed: [instance] 2026-02-26 12:38:23.248472 | controller | 2026-02-26 12:38:23.248533 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2026-02-26 12:38:23.248542 | controller | Thursday 26 February 2026 12:38:22 +0000 (0:00:00.399) 0:02:55.837 ***** 2026-02-26 12:38:23.248555 | controller | changed: [instance] 2026-02-26 12:38:23.288787 | controller | 2026-02-26 12:38:23.288824 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-26 12:38:23.288832 | controller | Thursday 26 February 2026 12:38:23 +0000 (0:00:00.978) 0:02:56.816 ***** 2026-02-26 12:38:23.288843 | controller | skipping: [instance] 2026-02-26 12:38:23.350504 | controller | 2026-02-26 12:38:23.350543 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2026-02-26 12:38:23.350554 | controller | Thursday 26 February 2026 12:38:23 +0000 (0:00:00.042) 0:02:56.859 ***** 2026-02-26 12:38:23.350568 | controller | skipping: [instance] 2026-02-26 12:38:23.406407 | controller | 2026-02-26 12:38:23.406434 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2026-02-26 12:38:23.406442 | controller | Thursday 26 February 2026 12:38:23 +0000 (0:00:00.061) 0:02:56.920 ***** 2026-02-26 12:38:23.406451 | controller | skipping: [instance] 2026-02-26 12:38:23.475774 | controller | 2026-02-26 12:38:23.475802 | controller | TASK [Create VBMC entity] ****************************************************** 2026-02-26 12:38:23.475811 | controller | Thursday 26 February 2026 12:38:23 +0000 (0:00:00.056) 0:02:56.976 ***** 2026-02-26 12:38:23.475829 | controller | skipping: [instance] => (item=compute-0) 2026-02-26 12:38:23.774083 | controller | skipping: [instance] => (item=controller-0) 2026-02-26 12:38:23.774138 | controller | skipping: [instance] => (item=crc-0) 2026-02-26 12:38:23.774146 | controller | skipping: [instance] 2026-02-26 12:38:23.774153 | controller | 2026-02-26 12:38:23.774159 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2026-02-26 12:38:23.774166 | controller | Thursday 26 February 2026 12:38:23 +0000 (0:00:00.068) 0:02:57.045 ***** 2026-02-26 12:38:23.774177 | controller | ok: [instance] 2026-02-26 12:38:24.187727 | controller | 2026-02-26 12:38:24.187771 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2026-02-26 12:38:24.187779 | controller | Thursday 26 February 2026 12:38:23 +0000 (0:00:00.293) 0:02:57.338 ***** 2026-02-26 12:38:24.187790 | controller | changed: [instance] 2026-02-26 12:38:24.232470 | controller | 2026-02-26 12:38:24.232499 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2026-02-26 12:38:24.232506 | controller | Thursday 26 February 2026 12:38:24 +0000 (0:00:00.418) 0:02:57.757 ***** 2026-02-26 12:38:24.232516 | controller | skipping: [instance] 2026-02-26 12:38:24.275955 | controller | 2026-02-26 12:38:24.275980 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2026-02-26 12:38:24.275988 | controller | Thursday 26 February 2026 12:38:24 +0000 (0:00:00.045) 0:02:57.802 ***** 2026-02-26 12:38:24.275997 | controller | skipping: [instance] 2026-02-26 12:38:24.327935 | controller | 2026-02-26 12:38:24.327962 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2026-02-26 12:38:24.327970 | controller | Thursday 26 February 2026 12:38:24 +0000 (0:00:00.043) 0:02:57.846 ***** 2026-02-26 12:38:24.327979 | controller | skipping: [instance] 2026-02-26 12:38:25.115299 | controller | 2026-02-26 12:38:25.115364 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2026-02-26 12:38:25.115374 | controller | Thursday 26 February 2026 12:38:24 +0000 (0:00:00.051) 0:02:57.898 ***** 2026-02-26 12:38:25.115386 | controller | changed: [instance] 2026-02-26 12:38:25.869112 | controller | 2026-02-26 12:38:25.869174 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2026-02-26 12:38:25.869184 | controller | Thursday 26 February 2026 12:38:25 +0000 (0:00:00.786) 0:02:58.684 ***** 2026-02-26 12:38:25.869197 | controller | changed: [instance] 2026-02-26 12:38:25.916489 | controller | 2026-02-26 12:38:25.916529 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2026-02-26 12:38:25.916538 | controller | Thursday 26 February 2026 12:38:25 +0000 (0:00:00.753) 0:02:59.438 ***** 2026-02-26 12:38:25.916549 | controller | skipping: [instance] 2026-02-26 12:38:25.988629 | controller | 2026-02-26 12:38:25.988717 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2026-02-26 12:38:25.988727 | controller | Thursday 26 February 2026 12:38:25 +0000 (0:00:00.048) 0:02:59.486 ***** 2026-02-26 12:38:25.988743 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2026-02-26 12:38:25.988767 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2026-02-26 12:38:25.988774 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2026-02-26 12:38:25.988784 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2026-02-26 12:38:25.988845 | controller | 2026-02-26 12:38:25.988856 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2026-02-26 12:38:25.988955 | controller | Thursday 26 February 2026 12:38:25 +0000 (0:00:00.071) 0:02:59.558 ***** 2026-02-26 12:38:26.037915 | controller | skipping: [instance] 2026-02-26 12:38:26.037982 | controller | 2026-02-26 12:38:26.038098 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2026-02-26 12:38:26.038192 | controller | Thursday 26 February 2026 12:38:26 +0000 (0:00:00.049) 0:02:59.608 ***** 2026-02-26 12:38:26.076665 | controller | skipping: [instance] 2026-02-26 12:38:26.076763 | controller | 2026-02-26 12:38:26.076877 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2026-02-26 12:38:26.076970 | controller | Thursday 26 February 2026 12:38:26 +0000 (0:00:00.038) 0:02:59.647 ***** 2026-02-26 12:38:26.116578 | controller | skipping: [instance] 2026-02-26 12:38:26.116667 | controller | 2026-02-26 12:38:26.116800 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2026-02-26 12:38:26.116879 | controller | Thursday 26 February 2026 12:38:26 +0000 (0:00:00.039) 0:02:59.687 ***** 2026-02-26 12:38:26.163959 | controller | skipping: [instance] 2026-02-26 12:38:26.164047 | controller | 2026-02-26 12:38:26.164146 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2026-02-26 12:38:26.164292 | controller | Thursday 26 February 2026 12:38:26 +0000 (0:00:00.047) 0:02:59.734 ***** 2026-02-26 12:38:26.879948 | controller | changed: [instance] 2026-02-26 12:38:26.880009 | controller | 2026-02-26 12:38:26.880120 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2026-02-26 12:38:26.880242 | controller | Thursday 26 February 2026 12:38:26 +0000 (0:00:00.715) 0:03:00.450 ***** 2026-02-26 12:38:26.916287 | controller | skipping: [instance] 2026-02-26 12:38:26.916378 | controller | 2026-02-26 12:38:26.916482 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2026-02-26 12:38:26.916580 | controller | Thursday 26 February 2026 12:38:26 +0000 (0:00:00.036) 0:03:00.486 ***** 2026-02-26 12:38:26.955256 | controller | skipping: [instance] 2026-02-26 12:38:26.955333 | controller | 2026-02-26 12:38:26.955441 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2026-02-26 12:38:26.955541 | controller | Thursday 26 February 2026 12:38:26 +0000 (0:00:00.038) 0:03:00.525 ***** 2026-02-26 12:38:26.996726 | controller | skipping: [instance] 2026-02-26 12:38:26.996814 | controller | 2026-02-26 12:38:26.996917 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-26 12:38:26.997029 | controller | Thursday 26 February 2026 12:38:26 +0000 (0:00:00.041) 0:03:00.567 ***** 2026-02-26 12:38:27.030724 | controller | skipping: [instance] 2026-02-26 12:38:27.030813 | controller | 2026-02-26 12:38:27.030916 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-26 12:38:27.031047 | controller | Thursday 26 February 2026 12:38:27 +0000 (0:00:00.034) 0:03:00.601 ***** 2026-02-26 12:38:27.065951 | controller | skipping: [instance] 2026-02-26 12:38:27.066034 | controller | 2026-02-26 12:38:27.066151 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-26 12:38:27.066275 | controller | Thursday 26 February 2026 12:38:27 +0000 (0:00:00.035) 0:03:00.636 ***** 2026-02-26 12:38:27.102334 | controller | skipping: [instance] 2026-02-26 12:38:27.102448 | controller | 2026-02-26 12:38:27.102547 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-26 12:38:27.102673 | controller | Thursday 26 February 2026 12:38:27 +0000 (0:00:00.036) 0:03:00.672 ***** 2026-02-26 12:38:27.226067 | controller | skipping: [instance] 2026-02-26 12:38:27.226193 | controller | 2026-02-26 12:38:27.226359 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-26 12:38:27.226458 | controller | Thursday 26 February 2026 12:38:27 +0000 (0:00:00.122) 0:03:00.795 ***** 2026-02-26 12:38:27.262544 | controller | skipping: [instance] 2026-02-26 12:38:27.262630 | controller | 2026-02-26 12:38:27.262741 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-26 12:38:27.262837 | controller | Thursday 26 February 2026 12:38:27 +0000 (0:00:00.037) 0:03:00.833 ***** 2026-02-26 12:38:27.298936 | controller | skipping: [instance] 2026-02-26 12:38:27.299022 | controller | 2026-02-26 12:38:27.299149 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-26 12:38:27.299285 | controller | Thursday 26 February 2026 12:38:27 +0000 (0:00:00.036) 0:03:00.869 ***** 2026-02-26 12:38:27.349050 | controller | skipping: [instance] 2026-02-26 12:38:27.349129 | controller | 2026-02-26 12:38:27.349944 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2026-02-26 12:38:27.350064 | controller | Thursday 26 February 2026 12:38:27 +0000 (0:00:00.050) 0:03:00.919 ***** 2026-02-26 12:38:27.384319 | controller | skipping: [instance] 2026-02-26 12:38:27.384435 | controller | 2026-02-26 12:38:27.384468 | controller | TASK [reproducer : Configure Controller node] ********************************** 2026-02-26 12:38:27.384478 | controller | Thursday 26 February 2026 12:38:27 +0000 (0:00:00.035) 0:03:00.954 ***** 2026-02-26 12:38:27.559760 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2026-02-26 12:38:27.559842 | controller | 2026-02-26 12:38:27.559940 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-26 12:38:27.560042 | controller | Thursday 26 February 2026 12:38:27 +0000 (0:00:00.174) 0:03:01.129 ***** 2026-02-26 12:38:28.981674 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-26 12:38:28.981740 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-26 12:38:28.981808 | controller | 2026-02-26 12:38:28.981935 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-26 12:38:28.982006 | controller | Thursday 26 February 2026 12:38:28 +0000 (0:00:01.422) 0:03:02.551 ***** 2026-02-26 12:38:29.003198 | controller | skipping: [instance] 2026-02-26 12:38:29.003255 | controller | 2026-02-26 12:38:29.003368 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-26 12:38:29.003466 | controller | Thursday 26 February 2026 12:38:29 +0000 (0:00:00.021) 0:03:02.573 ***** 2026-02-26 12:38:29.605435 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:29.605577 | controller | 2026-02-26 12:38:29.605616 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-26 12:38:29.605858 | controller | Thursday 26 February 2026 12:38:29 +0000 (0:00:00.602) 0:03:03.175 ***** 2026-02-26 12:38:29.643278 | controller | skipping: [instance] 2026-02-26 12:38:29.643394 | controller | 2026-02-26 12:38:29.643511 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-26 12:38:29.643624 | controller | Thursday 26 February 2026 12:38:29 +0000 (0:00:00.038) 0:03:03.213 ***** 2026-02-26 12:38:29.680439 | controller | skipping: [instance] 2026-02-26 12:38:29.680526 | controller | 2026-02-26 12:38:29.680643 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-26 12:38:29.680758 | controller | Thursday 26 February 2026 12:38:29 +0000 (0:00:00.037) 0:03:03.250 ***** 2026-02-26 12:38:29.715040 | controller | skipping: [instance] 2026-02-26 12:38:29.715139 | controller | 2026-02-26 12:38:29.715244 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-26 12:38:29.715364 | controller | Thursday 26 February 2026 12:38:29 +0000 (0:00:00.034) 0:03:03.285 ***** 2026-02-26 12:38:29.756756 | controller | skipping: [instance] 2026-02-26 12:38:29.756806 | controller | 2026-02-26 12:38:29.756968 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2026-02-26 12:38:29.757031 | controller | Thursday 26 February 2026 12:38:29 +0000 (0:00:00.041) 0:03:03.327 ***** 2026-02-26 12:38:29.797684 | controller | skipping: [instance] 2026-02-26 12:38:29.797726 | controller | 2026-02-26 12:38:29.797835 | controller | TASK [reproducer : Install repos] ********************************************** 2026-02-26 12:38:29.797928 | controller | Thursday 26 February 2026 12:38:29 +0000 (0:00:00.041) 0:03:03.368 ***** 2026-02-26 12:38:29.833742 | controller | skipping: [instance] 2026-02-26 12:38:29.833815 | controller | 2026-02-26 12:38:29.833977 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2026-02-26 12:38:29.834044 | controller | Thursday 26 February 2026 12:38:29 +0000 (0:00:00.036) 0:03:03.404 ***** 2026-02-26 12:38:29.875861 | controller | skipping: [instance] 2026-02-26 12:38:29.875954 | controller | 2026-02-26 12:38:29.876063 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2026-02-26 12:38:29.876186 | controller | Thursday 26 February 2026 12:38:29 +0000 (0:00:00.041) 0:03:03.446 ***** 2026-02-26 12:38:29.916165 | controller | skipping: [instance] 2026-02-26 12:38:29.916258 | controller | 2026-02-26 12:38:29.916349 | controller | TASK [reproducer : Install some tools] ***************************************** 2026-02-26 12:38:29.916435 | controller | Thursday 26 February 2026 12:38:29 +0000 (0:00:00.040) 0:03:03.486 ***** 2026-02-26 12:38:30.928956 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:30.929189 | controller | 2026-02-26 12:38:31.985177 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2026-02-26 12:38:31.985248 | controller | Thursday 26 February 2026 12:38:30 +0000 (0:00:01.012) 0:03:04.499 ***** 2026-02-26 12:38:31.985264 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:32.619360 | controller | 2026-02-26 12:38:32.619397 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2026-02-26 12:38:32.619406 | controller | Thursday 26 February 2026 12:38:31 +0000 (0:00:01.055) 0:03:05.554 ***** 2026-02-26 12:38:32.619422 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:33.704059 | controller | 2026-02-26 12:38:33.704112 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2026-02-26 12:38:33.704126 | controller | Thursday 26 February 2026 12:38:32 +0000 (0:00:00.634) 0:03:06.189 ***** 2026-02-26 12:38:33.704138 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:34.723494 | controller | 2026-02-26 12:38:34.723542 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2026-02-26 12:38:34.723551 | controller | Thursday 26 February 2026 12:38:33 +0000 (0:00:01.084) 0:03:07.274 ***** 2026-02-26 12:38:34.723565 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-26 12:38:35.383107 | controller | skipping: [instance] => (item=compute-0) 2026-02-26 12:38:35.383178 | controller | skipping: [instance] => (item=controller-0) 2026-02-26 12:38:35.383188 | controller | skipping: [instance] => (item=crc-0) 2026-02-26 12:38:35.383194 | controller | 2026-02-26 12:38:35.383230 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2026-02-26 12:38:35.383242 | controller | Thursday 26 February 2026 12:38:34 +0000 (0:00:01.018) 0:03:08.292 ***** 2026-02-26 12:38:35.383258 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-26 12:38:37.231937 | controller | skipping: [instance] => (item=compute-0) 2026-02-26 12:38:37.232006 | controller | skipping: [instance] => (item=controller-0) 2026-02-26 12:38:37.232014 | controller | skipping: [instance] => (item=crc-0) 2026-02-26 12:38:37.232020 | controller | 2026-02-26 12:38:37.232026 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2026-02-26 12:38:37.232032 | controller | Thursday 26 February 2026 12:38:35 +0000 (0:00:00.660) 0:03:08.952 ***** 2026-02-26 12:38:37.232047 | controller | skipping: [instance] => (item=instance) 2026-02-26 12:38:37.232085 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2026-02-26 12:38:37.232092 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-26 12:38:37.232099 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2026-02-26 12:38:37.232446 | controller | 2026-02-26 12:38:37.232509 | controller | TASK [reproducer : Create kube directory] ************************************** 2026-02-26 12:38:37.888260 | controller | Thursday 26 February 2026 12:38:37 +0000 (0:00:01.849) 0:03:10.802 ***** 2026-02-26 12:38:37.888301 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:38.965622 | controller | 2026-02-26 12:38:38.965666 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2026-02-26 12:38:38.965675 | controller | Thursday 26 February 2026 12:38:37 +0000 (0:00:00.655) 0:03:11.457 ***** 2026-02-26 12:38:38.965687 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:39.933228 | controller | 2026-02-26 12:38:39.933270 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2026-02-26 12:38:39.933279 | controller | Thursday 26 February 2026 12:38:38 +0000 (0:00:01.077) 0:03:12.535 ***** 2026-02-26 12:38:39.933291 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:39.969715 | controller | 2026-02-26 12:38:39.969744 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2026-02-26 12:38:39.969752 | controller | Thursday 26 February 2026 12:38:39 +0000 (0:00:00.967) 0:03:13.503 ***** 2026-02-26 12:38:39.969762 | controller | skipping: [instance] 2026-02-26 12:38:40.606175 | controller | 2026-02-26 12:38:40.606230 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2026-02-26 12:38:40.606242 | controller | Thursday 26 February 2026 12:38:39 +0000 (0:00:00.036) 0:03:13.540 ***** 2026-02-26 12:38:40.606254 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:41.305798 | controller | 2026-02-26 12:38:41.305835 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2026-02-26 12:38:41.305844 | controller | Thursday 26 February 2026 12:38:40 +0000 (0:00:00.636) 0:03:14.176 ***** 2026-02-26 12:38:41.305855 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:41.347260 | controller | 2026-02-26 12:38:41.347290 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2026-02-26 12:38:41.347297 | controller | Thursday 26 February 2026 12:38:41 +0000 (0:00:00.699) 0:03:14.875 ***** 2026-02-26 12:38:41.347308 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:41.413559 | controller | 2026-02-26 12:38:41.413584 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2026-02-26 12:38:41.413591 | controller | Thursday 26 February 2026 12:38:41 +0000 (0:00:00.042) 0:03:14.917 ***** 2026-02-26 12:38:41.413601 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2026-02-26 12:38:41.467141 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2026-02-26 12:38:41.467169 | controller | 2026-02-26 12:38:41.467177 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-26 12:38:41.467184 | controller | Thursday 26 February 2026 12:38:41 +0000 (0:00:00.066) 0:03:14.983 ***** 2026-02-26 12:38:41.467195 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-26 12:38:41.530741 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2026-02-26 12:38:41.530767 | controller | 2026-02-26 12:38:41.530775 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-26 12:38:41.530781 | controller | Thursday 26 February 2026 12:38:41 +0000 (0:00:00.053) 0:03:15.037 ***** 2026-02-26 12:38:41.530791 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-26 12:38:41.582381 | controller | _secret_file: '' 2026-02-26 12:38:41.582405 | controller | 2026-02-26 12:38:41.582412 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-26 12:38:41.582418 | controller | Thursday 26 February 2026 12:38:41 +0000 (0:00:00.063) 0:03:15.101 ***** 2026-02-26 12:38:41.582428 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-26 12:38:41.638090 | controller | _secret_content: my-default-location-place 2026-02-26 12:38:41.638113 | controller | 2026-02-26 12:38:41.638120 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-26 12:38:41.638131 | controller | Thursday 26 February 2026 12:38:41 +0000 (0:00:00.051) 0:03:15.152 ***** 2026-02-26 12:38:41.638141 | controller | skipping: [instance] 2026-02-26 12:38:41.691459 | controller | 2026-02-26 12:38:41.691481 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-26 12:38:41.691488 | controller | Thursday 26 February 2026 12:38:41 +0000 (0:00:00.055) 0:03:15.208 ***** 2026-02-26 12:38:41.691498 | controller | skipping: [instance] 2026-02-26 12:38:41.740007 | controller | 2026-02-26 12:38:41.740033 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-26 12:38:41.740041 | controller | Thursday 26 February 2026 12:38:41 +0000 (0:00:00.052) 0:03:15.261 ***** 2026-02-26 12:38:41.740068 | controller | skipping: [instance] 2026-02-26 12:38:42.787320 | controller | 2026-02-26 12:38:42.787355 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-26 12:38:42.787363 | controller | Thursday 26 February 2026 12:38:41 +0000 (0:00:00.049) 0:03:15.310 ***** 2026-02-26 12:38:42.787374 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:42.841780 | controller | 2026-02-26 12:38:42.841812 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-26 12:38:42.841820 | controller | Thursday 26 February 2026 12:38:42 +0000 (0:00:01.047) 0:03:16.357 ***** 2026-02-26 12:38:42.841831 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-26 12:38:42.889396 | controller | _secret_dest: /home/zuul/ipmi-things 2026-02-26 12:38:42.889425 | controller | 2026-02-26 12:38:42.889433 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-26 12:38:42.889438 | controller | Thursday 26 February 2026 12:38:42 +0000 (0:00:00.054) 0:03:16.412 ***** 2026-02-26 12:38:42.889448 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-26 12:38:42.938235 | controller | _secret_file: /tmp/ipmi-things 2026-02-26 12:38:42.938267 | controller | 2026-02-26 12:38:42.938274 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-26 12:38:42.938280 | controller | Thursday 26 February 2026 12:38:42 +0000 (0:00:00.047) 0:03:16.459 ***** 2026-02-26 12:38:42.938290 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-26 12:38:42.991878 | controller | _secret_content: '' 2026-02-26 12:38:42.991905 | controller | 2026-02-26 12:38:42.991912 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-26 12:38:42.991918 | controller | Thursday 26 February 2026 12:38:42 +0000 (0:00:00.048) 0:03:16.508 ***** 2026-02-26 12:38:42.991929 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2026-02-26 12:38:43.649506 | controller | msg: All assertions passed 2026-02-26 12:38:43.649545 | controller | 2026-02-26 12:38:43.649553 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-26 12:38:43.649559 | controller | Thursday 26 February 2026 12:38:42 +0000 (0:00:00.053) 0:03:16.562 ***** 2026-02-26 12:38:43.649569 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:44.746369 | controller | 2026-02-26 12:38:44.746427 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-26 12:38:44.746437 | controller | Thursday 26 February 2026 12:38:43 +0000 (0:00:00.656) 0:03:17.219 ***** 2026-02-26 12:38:44.746450 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:44.746470 | controller | 2026-02-26 12:38:44.746476 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-26 12:38:44.746484 | controller | Thursday 26 February 2026 12:38:44 +0000 (0:00:01.096) 0:03:18.316 ***** 2026-02-26 12:38:44.807036 | controller | skipping: [instance] 2026-02-26 12:38:44.807128 | controller | 2026-02-26 12:38:44.807243 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2026-02-26 12:38:44.807347 | controller | Thursday 26 February 2026 12:38:44 +0000 (0:00:00.061) 0:03:18.377 ***** 2026-02-26 12:38:45.465586 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:38:45.465657 | controller | 2026-02-26 12:38:45.465748 | controller | TASK [reproducer : Check if async file is still available] ********************* 2026-02-26 12:38:45.465764 | controller | Thursday 26 February 2026 12:38:45 +0000 (0:00:00.657) 0:03:19.034 ***** 2026-02-26 12:38:46.158060 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:31.343091 | controller | 2026-02-26 12:39:31.343160 | controller | TASK [reproducer : Check package install status] ******************************* 2026-02-26 12:39:31.343169 | controller | Thursday 26 February 2026 12:38:46 +0000 (0:00:00.693) 0:03:19.727 ***** 2026-02-26 12:39:31.343183 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2026-02-26 12:39:31.343203 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2026-02-26 12:39:31.343272 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2026-02-26 12:39:31.343285 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2026-02-26 12:39:31.343380 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2026-02-26 12:39:31.343488 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2026-02-26 12:39:31.343569 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2026-02-26 12:39:31.343661 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2026-02-26 12:39:31.343758 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:31.343842 | controller | 2026-02-26 12:39:31.343932 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2026-02-26 12:39:31.344035 | controller | Thursday 26 February 2026 12:39:31 +0000 (0:00:45.185) 0:04:04.913 ***** 2026-02-26 12:39:32.050131 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:34.619869 | controller | 2026-02-26 12:39:34.619931 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2026-02-26 12:39:34.619941 | controller | Thursday 26 February 2026 12:39:32 +0000 (0:00:00.706) 0:04:05.619 ***** 2026-02-26 12:39:34.619957 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:34.672406 | controller | 2026-02-26 12:39:34.672430 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2026-02-26 12:39:34.672438 | controller | Thursday 26 February 2026 12:39:34 +0000 (0:00:02.569) 0:04:08.189 ***** 2026-02-26 12:39:34.672448 | controller | skipping: [instance] 2026-02-26 12:39:34.726365 | controller | 2026-02-26 12:39:34.726389 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2026-02-26 12:39:34.726397 | controller | Thursday 26 February 2026 12:39:34 +0000 (0:00:00.053) 0:04:08.242 ***** 2026-02-26 12:39:34.726408 | controller | skipping: [instance] 2026-02-26 12:39:35.380683 | controller | 2026-02-26 12:39:35.380749 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2026-02-26 12:39:35.380758 | controller | Thursday 26 February 2026 12:39:34 +0000 (0:00:00.053) 0:04:08.296 ***** 2026-02-26 12:39:35.380775 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:35.926532 | controller | 2026-02-26 12:39:35.926573 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2026-02-26 12:39:35.926581 | controller | Thursday 26 February 2026 12:39:35 +0000 (0:00:00.654) 0:04:08.950 ***** 2026-02-26 12:39:35.926593 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:36.243074 | controller | 2026-02-26 12:39:36.243115 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2026-02-26 12:39:36.243124 | controller | Thursday 26 February 2026 12:39:35 +0000 (0:00:00.545) 0:04:09.496 ***** 2026-02-26 12:39:36.243135 | controller | changed: [instance] 2026-02-26 12:39:36.913399 | controller | 2026-02-26 12:39:36.913439 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2026-02-26 12:39:36.913448 | controller | Thursday 26 February 2026 12:39:36 +0000 (0:00:00.316) 0:04:09.813 ***** 2026-02-26 12:39:36.913459 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:37.930347 | controller | 2026-02-26 12:39:37.930394 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2026-02-26 12:39:37.930403 | controller | Thursday 26 February 2026 12:39:36 +0000 (0:00:00.670) 0:04:10.483 ***** 2026-02-26 12:39:37.930415 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:37.982314 | controller | 2026-02-26 12:39:37.982347 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-26 12:39:37.982356 | controller | Thursday 26 February 2026 12:39:37 +0000 (0:00:01.017) 0:04:11.500 ***** 2026-02-26 12:39:37.982369 | controller | skipping: [instance] 2026-02-26 12:39:38.032305 | controller | 2026-02-26 12:39:38.032336 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-26 12:39:38.032344 | controller | Thursday 26 February 2026 12:39:37 +0000 (0:00:00.052) 0:04:11.552 ***** 2026-02-26 12:39:38.032355 | controller | skipping: [instance] 2026-02-26 12:39:38.069820 | controller | 2026-02-26 12:39:38.069843 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-26 12:39:38.069850 | controller | Thursday 26 February 2026 12:39:38 +0000 (0:00:00.050) 0:04:11.602 ***** 2026-02-26 12:39:38.069859 | controller | skipping: [instance] 2026-02-26 12:39:38.122754 | controller | 2026-02-26 12:39:38.122780 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2026-02-26 12:39:38.122787 | controller | Thursday 26 February 2026 12:39:38 +0000 (0:00:00.037) 0:04:11.640 ***** 2026-02-26 12:39:38.122796 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:38.160421 | controller | 2026-02-26 12:39:38.160442 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2026-02-26 12:39:38.160450 | controller | Thursday 26 February 2026 12:39:38 +0000 (0:00:00.052) 0:04:11.693 ***** 2026-02-26 12:39:38.160458 | controller | skipping: [instance] 2026-02-26 12:39:38.197969 | controller | 2026-02-26 12:39:38.197995 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2026-02-26 12:39:38.198003 | controller | Thursday 26 February 2026 12:39:38 +0000 (0:00:00.037) 0:04:11.730 ***** 2026-02-26 12:39:38.198012 | controller | skipping: [instance] 2026-02-26 12:39:38.233473 | controller | 2026-02-26 12:39:38.233497 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2026-02-26 12:39:38.233510 | controller | Thursday 26 February 2026 12:39:38 +0000 (0:00:00.037) 0:04:11.768 ***** 2026-02-26 12:39:38.233520 | controller | skipping: [instance] 2026-02-26 12:39:38.887148 | controller | 2026-02-26 12:39:38.887192 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2026-02-26 12:39:38.887201 | controller | Thursday 26 February 2026 12:39:38 +0000 (0:00:00.035) 0:04:11.803 ***** 2026-02-26 12:39:38.887227 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:38.991138 | controller | 2026-02-26 12:39:38.991171 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2026-02-26 12:39:38.991179 | controller | Thursday 26 February 2026 12:39:38 +0000 (0:00:00.653) 0:04:12.457 ***** 2026-02-26 12:39:38.991190 | controller | skipping: [instance] => (item=secret) 2026-02-26 12:39:39.990551 | controller | skipping: [instance] => (item=configmap) 2026-02-26 12:39:39.990591 | controller | skipping: [instance] => (item=pod) 2026-02-26 12:39:39.990599 | controller | skipping: [instance] => (item=service) 2026-02-26 12:39:39.990605 | controller | skipping: [instance] => (item=route) 2026-02-26 12:39:39.990610 | controller | skipping: [instance] 2026-02-26 12:39:39.990617 | controller | 2026-02-26 12:39:39.990622 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2026-02-26 12:39:39.990628 | controller | Thursday 26 February 2026 12:39:38 +0000 (0:00:00.103) 0:04:12.560 ***** 2026-02-26 12:39:39.990639 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:40.923176 | controller | 2026-02-26 12:39:40.923231 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2026-02-26 12:39:40.923244 | controller | Thursday 26 February 2026 12:39:39 +0000 (0:00:00.999) 0:04:13.560 ***** 2026-02-26 12:39:40.923255 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:40.923424 | controller | 2026-02-26 12:39:40.923566 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2026-02-26 12:39:40.923694 | controller | Thursday 26 February 2026 12:39:40 +0000 (0:00:00.932) 0:04:14.493 ***** 2026-02-26 12:39:40.962198 | controller | skipping: [instance] 2026-02-26 12:39:40.962409 | controller | 2026-02-26 12:39:40.962551 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2026-02-26 12:39:40.962682 | controller | Thursday 26 February 2026 12:39:40 +0000 (0:00:00.038) 0:04:14.531 ***** 2026-02-26 12:39:41.002783 | controller | skipping: [instance] 2026-02-26 12:39:41.002981 | controller | 2026-02-26 12:39:41.003122 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2026-02-26 12:39:41.003272 | controller | Thursday 26 February 2026 12:39:41 +0000 (0:00:00.041) 0:04:14.573 ***** 2026-02-26 12:39:41.084250 | controller | skipping: [instance] => (item=secret) 2026-02-26 12:39:41.128819 | controller | skipping: [instance] => (item=configmap) 2026-02-26 12:39:41.128856 | controller | skipping: [instance] => (item=service) 2026-02-26 12:39:41.128864 | controller | skipping: [instance] => (item=route) 2026-02-26 12:39:41.128870 | controller | skipping: [instance] 2026-02-26 12:39:41.128876 | controller | 2026-02-26 12:39:41.128882 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2026-02-26 12:39:41.128888 | controller | Thursday 26 February 2026 12:39:41 +0000 (0:00:00.080) 0:04:14.653 ***** 2026-02-26 12:39:41.128899 | controller | skipping: [instance] 2026-02-26 12:39:42.678803 | controller | 2026-02-26 12:39:42.678844 | controller | TASK [podman : Ensure podman is installed] ************************************* 2026-02-26 12:39:42.678853 | controller | Thursday 26 February 2026 12:39:41 +0000 (0:00:00.045) 0:04:14.699 ***** 2026-02-26 12:39:42.678864 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:43.495053 | controller | 2026-02-26 12:39:43.495093 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2026-02-26 12:39:43.495102 | controller | Thursday 26 February 2026 12:39:42 +0000 (0:00:01.549) 0:04:16.248 ***** 2026-02-26 12:39:43.495114 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:43.541237 | controller | 2026-02-26 12:39:43.541269 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2026-02-26 12:39:43.541278 | controller | Thursday 26 February 2026 12:39:43 +0000 (0:00:00.815) 0:04:17.064 ***** 2026-02-26 12:39:43.541289 | controller | skipping: [instance] 2026-02-26 12:39:43.583278 | controller | 2026-02-26 12:39:43.583310 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2026-02-26 12:39:43.583319 | controller | Thursday 26 February 2026 12:39:43 +0000 (0:00:00.046) 0:04:17.111 ***** 2026-02-26 12:39:43.583330 | controller | skipping: [instance] 2026-02-26 12:39:43.583408 | controller | 2026-02-26 12:39:43.583418 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2026-02-26 12:39:43.583426 | controller | Thursday 26 February 2026 12:39:43 +0000 (0:00:00.042) 0:04:17.153 ***** 2026-02-26 12:39:43.630185 | controller | skipping: [instance] 2026-02-26 12:39:53.477153 | controller | 2026-02-26 12:39:53.477193 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2026-02-26 12:39:53.477201 | controller | Thursday 26 February 2026 12:39:43 +0000 (0:00:00.046) 0:04:17.200 ***** 2026-02-26 12:39:53.477227 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:53.477517 | controller | 2026-02-26 12:39:53.477532 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2026-02-26 12:39:54.894550 | controller | Thursday 26 February 2026 12:39:53 +0000 (0:00:09.846) 0:04:27.047 ***** 2026-02-26 12:39:54.894607 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:56.095493 | controller | 2026-02-26 12:39:56.095537 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-26 12:39:56.095546 | controller | Thursday 26 February 2026 12:39:54 +0000 (0:00:01.417) 0:04:28.464 ***** 2026-02-26 12:39:56.095558 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-26 12:39:56.138127 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-26 12:39:56.138153 | controller | 2026-02-26 12:39:56.138160 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2026-02-26 12:39:56.138166 | controller | Thursday 26 February 2026 12:39:56 +0000 (0:00:01.200) 0:04:29.665 ***** 2026-02-26 12:39:56.138176 | controller | skipping: [instance] 2026-02-26 12:39:56.675920 | controller | 2026-02-26 12:39:56.675968 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2026-02-26 12:39:56.675983 | controller | Thursday 26 February 2026 12:39:56 +0000 (0:00:00.043) 0:04:29.708 ***** 2026-02-26 12:39:56.675994 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:56.713766 | controller | 2026-02-26 12:39:56.713784 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2026-02-26 12:39:56.713790 | controller | Thursday 26 February 2026 12:39:56 +0000 (0:00:00.537) 0:04:30.245 ***** 2026-02-26 12:39:56.713799 | controller | skipping: [instance] 2026-02-26 12:39:56.755691 | controller | 2026-02-26 12:39:56.755708 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2026-02-26 12:39:56.755715 | controller | Thursday 26 February 2026 12:39:56 +0000 (0:00:00.038) 0:04:30.284 ***** 2026-02-26 12:39:56.755723 | controller | skipping: [instance] 2026-02-26 12:39:56.799199 | controller | 2026-02-26 12:39:56.799231 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-26 12:39:56.799241 | controller | Thursday 26 February 2026 12:39:56 +0000 (0:00:00.041) 0:04:30.326 ***** 2026-02-26 12:39:56.799250 | controller | skipping: [instance] 2026-02-26 12:39:56.799390 | controller | 2026-02-26 12:39:56.799533 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-26 12:39:56.799664 | controller | Thursday 26 February 2026 12:39:56 +0000 (0:00:00.043) 0:04:30.369 ***** 2026-02-26 12:39:56.837246 | controller | skipping: [instance] 2026-02-26 12:39:56.837386 | controller | 2026-02-26 12:39:56.837515 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2026-02-26 12:39:56.837636 | controller | Thursday 26 February 2026 12:39:56 +0000 (0:00:00.038) 0:04:30.407 ***** 2026-02-26 12:39:56.964625 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) 2026-02-26 12:39:57.938139 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) 2026-02-26 12:39:57.938180 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) 2026-02-26 12:39:57.938187 | controller | 2026-02-26 12:39:57.938193 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2026-02-26 12:39:57.938199 | controller | Thursday 26 February 2026 12:39:56 +0000 (0:00:00.126) 0:04:30.534 ***** 2026-02-26 12:39:57.938227 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:57.976854 | controller | 2026-02-26 12:39:57.976878 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2026-02-26 12:39:57.976887 | controller | Thursday 26 February 2026 12:39:57 +0000 (0:00:00.973) 0:04:31.508 ***** 2026-02-26 12:39:57.976898 | controller | skipping: [instance] 2026-02-26 12:39:58.098185 | controller | 2026-02-26 12:39:58.098207 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2026-02-26 12:39:58.098235 | controller | Thursday 26 February 2026 12:39:57 +0000 (0:00:00.039) 0:04:31.547 ***** 2026-02-26 12:39:58.098247 | controller | 2026-02-26 12:39:58.146879 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2026-02-26 12:39:58.146900 | controller | Thursday 26 February 2026 12:39:58 +0000 (0:00:00.121) 0:04:31.668 ***** 2026-02-26 12:39:58.146913 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:39:58.146968 | controller | 2026-02-26 12:39:58.146978 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-26 12:39:58.146986 | controller | Thursday 26 February 2026 12:39:58 +0000 (0:00:00.048) 0:04:31.717 ***** 2026-02-26 12:39:58.190642 | controller | skipping: [instance] 2026-02-26 12:39:58.227632 | controller | 2026-02-26 12:39:58.227651 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-26 12:39:58.227659 | controller | Thursday 26 February 2026 12:39:58 +0000 (0:00:00.043) 0:04:31.760 ***** 2026-02-26 12:39:58.227667 | controller | skipping: [instance] 2026-02-26 12:39:59.496702 | controller | 2026-02-26 12:39:59.496746 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2026-02-26 12:39:59.496755 | controller | Thursday 26 February 2026 12:39:58 +0000 (0:00:00.037) 0:04:31.798 ***** 2026-02-26 12:39:59.496767 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:06.747080 | controller | 2026-02-26 12:40:06.747125 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2026-02-26 12:40:06.747133 | controller | Thursday 26 February 2026 12:39:59 +0000 (0:00:01.268) 0:04:33.066 ***** 2026-02-26 12:40:06.747145 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1) 2026-02-26 12:40:06.849674 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b) 2026-02-26 12:40:06.849706 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282) 2026-02-26 12:40:06.849714 | controller | 2026-02-26 12:40:06.849721 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2026-02-26 12:40:06.849726 | controller | Thursday 26 February 2026 12:40:06 +0000 (0:00:07.248) 0:04:40.315 ***** 2026-02-26 12:40:06.849737 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2026-02-26 12:40:07.065012 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2026-02-26 12:40:07.065048 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2026-02-26 12:40:07.065056 | controller | 2026-02-26 12:40:07.065062 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2026-02-26 12:40:07.065067 | controller | Thursday 26 February 2026 12:40:06 +0000 (0:00:00.104) 0:04:40.419 ***** 2026-02-26 12:40:07.065076 | controller | ok: [instance -> localhost] 2026-02-26 12:40:09.179424 | controller | 2026-02-26 12:40:09.179469 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2026-02-26 12:40:09.179477 | controller | Thursday 26 February 2026 12:40:07 +0000 (0:00:00.215) 0:04:40.635 ***** 2026-02-26 12:40:09.179488 | controller | changed: [instance -> localhost] => (item=controller-0) 2026-02-26 12:40:09.874973 | controller | 2026-02-26 12:40:09.875028 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2026-02-26 12:40:09.875037 | controller | Thursday 26 February 2026 12:40:09 +0000 (0:00:02.114) 0:04:42.749 ***** 2026-02-26 12:40:09.875050 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:10.659897 | controller | 2026-02-26 12:40:10.659966 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2026-02-26 12:40:10.659976 | controller | Thursday 26 February 2026 12:40:09 +0000 (0:00:00.694) 0:04:43.444 ***** 2026-02-26 12:40:10.659989 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:11.854342 | controller | 2026-02-26 12:40:11.854389 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2026-02-26 12:40:11.854398 | controller | Thursday 26 February 2026 12:40:10 +0000 (0:00:00.784) 0:04:44.228 ***** 2026-02-26 12:40:11.854412 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:12.575448 | controller | 2026-02-26 12:40:12.575501 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2026-02-26 12:40:12.575511 | controller | Thursday 26 February 2026 12:40:11 +0000 (0:00:01.195) 0:04:45.424 ***** 2026-02-26 12:40:12.575524 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:13.733494 | controller | 2026-02-26 12:40:13.733550 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2026-02-26 12:40:13.733559 | controller | Thursday 26 February 2026 12:40:12 +0000 (0:00:00.720) 0:04:46.144 ***** 2026-02-26 12:40:13.733572 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:14.399572 | controller | 2026-02-26 12:40:14.399623 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2026-02-26 12:40:14.399632 | controller | Thursday 26 February 2026 12:40:13 +0000 (0:00:01.158) 0:04:47.303 ***** 2026-02-26 12:40:14.399653 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:15.085165 | controller | 2026-02-26 12:40:15.085234 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2026-02-26 12:40:15.085247 | controller | Thursday 26 February 2026 12:40:14 +0000 (0:00:00.665) 0:04:47.969 ***** 2026-02-26 12:40:15.085259 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:16.545268 | controller | 2026-02-26 12:40:16.545309 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2026-02-26 12:40:16.545317 | controller | Thursday 26 February 2026 12:40:15 +0000 (0:00:00.681) 0:04:48.650 ***** 2026-02-26 12:40:16.545327 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-26 12:40:16.589193 | controller | 2026-02-26 12:40:16.589264 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-26 12:40:16.589273 | controller | Thursday 26 February 2026 12:40:16 +0000 (0:00:01.463) 0:04:50.113 ***** 2026-02-26 12:40:16.589284 | controller | skipping: [instance] 2026-02-26 12:40:16.629355 | controller | 2026-02-26 12:40:16.629374 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-26 12:40:16.629381 | controller | Thursday 26 February 2026 12:40:16 +0000 (0:00:00.045) 0:04:50.158 ***** 2026-02-26 12:40:16.629389 | controller | skipping: [instance] 2026-02-26 12:40:16.670345 | controller | 2026-02-26 12:40:16.670365 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-26 12:40:16.670374 | controller | Thursday 26 February 2026 12:40:16 +0000 (0:00:00.040) 0:04:50.199 ***** 2026-02-26 12:40:16.670383 | controller | skipping: [instance] 2026-02-26 12:40:16.715672 | controller | 2026-02-26 12:40:16.715689 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-26 12:40:16.715697 | controller | Thursday 26 February 2026 12:40:16 +0000 (0:00:00.040) 0:04:50.240 ***** 2026-02-26 12:40:16.715705 | controller | skipping: [instance] 2026-02-26 12:40:16.759600 | controller | 2026-02-26 12:40:16.759619 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-26 12:40:16.759627 | controller | Thursday 26 February 2026 12:40:16 +0000 (0:00:00.045) 0:04:50.286 ***** 2026-02-26 12:40:16.759643 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:16.879138 | controller | 2026-02-26 12:40:16.879158 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-26 12:40:16.879167 | controller | Thursday 26 February 2026 12:40:16 +0000 (0:00:00.043) 0:04:50.329 ***** 2026-02-26 12:40:16.879186 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-26 12:40:16.936867 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2026-02-26 12:40:16.936887 | controller | 2026-02-26 12:40:16.936895 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-26 12:40:16.936901 | controller | Thursday 26 February 2026 12:40:16 +0000 (0:00:00.119) 0:04:50.449 ***** 2026-02-26 12:40:16.936919 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2026-02-26 12:40:20.519975 | controller | 2026-02-26 12:40:20.520056 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2026-02-26 12:40:20.520068 | controller | Thursday 26 February 2026 12:40:16 +0000 (0:00:00.057) 0:04:50.507 ***** 2026-02-26 12:40:20.520092 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-26 12:40:21.736120 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2026-02-26 12:40:21.736196 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-26 12:40:21.736205 | controller | 2026-02-26 12:40:21.736235 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2026-02-26 12:40:21.736242 | controller | Thursday 26 February 2026 12:40:20 +0000 (0:00:03.582) 0:04:54.089 ***** 2026-02-26 12:40:21.736256 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:22.547262 | controller | 2026-02-26 12:40:22.547323 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-26 12:40:22.547332 | controller | Thursday 26 February 2026 12:40:21 +0000 (0:00:01.215) 0:04:55.304 ***** 2026-02-26 12:40:22.547351 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:23.523031 | controller | 2026-02-26 12:40:23.523100 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-26 12:40:23.523110 | controller | Thursday 26 February 2026 12:40:22 +0000 (0:00:00.811) 0:04:56.116 ***** 2026-02-26 12:40:23.523124 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:23.608164 | controller | 2026-02-26 12:40:23.608200 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-26 12:40:23.608226 | controller | Thursday 26 February 2026 12:40:23 +0000 (0:00:00.975) 0:04:57.092 ***** 2026-02-26 12:40:23.608242 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:23.664576 | controller | 2026-02-26 12:40:23.664598 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-26 12:40:23.664606 | controller | Thursday 26 February 2026 12:40:23 +0000 (0:00:00.085) 0:04:57.177 ***** 2026-02-26 12:40:23.664616 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:24.675748 | controller | 2026-02-26 12:40:24.675835 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-26 12:40:24.675848 | controller | Thursday 26 February 2026 12:40:23 +0000 (0:00:00.056) 0:04:57.234 ***** 2026-02-26 12:40:24.675862 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:25.818757 | controller | 2026-02-26 12:40:25.818814 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2026-02-26 12:40:25.818830 | controller | Thursday 26 February 2026 12:40:24 +0000 (0:00:01.010) 0:04:58.245 ***** 2026-02-26 12:40:25.818860 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:25.818882 | controller | 2026-02-26 12:40:25.818890 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2026-02-26 12:40:31.987165 | controller | Thursday 26 February 2026 12:40:25 +0000 (0:00:01.143) 0:04:59.388 ***** 2026-02-26 12:40:31.987205 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2026-02-26 12:40:31.987274 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:31.987383 | controller | 2026-02-26 12:40:31.987485 | controller | TASK [Configure ntp service] *************************************************** 2026-02-26 12:40:31.987585 | controller | Thursday 26 February 2026 12:40:31 +0000 (0:00:06.168) 0:05:05.557 ***** 2026-02-26 12:40:32.219140 | controller | 2026-02-26 12:40:32.219207 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2026-02-26 12:40:32.219275 | controller | Thursday 26 February 2026 12:40:32 +0000 (0:00:00.231) 0:05:05.788 ***** 2026-02-26 12:40:33.220730 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:33.220789 | controller | 2026-02-26 12:40:33.220903 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2026-02-26 12:40:33.221039 | controller | Thursday 26 February 2026 12:40:33 +0000 (0:00:01.002) 0:05:06.790 ***** 2026-02-26 12:40:34.314725 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2026-02-26 12:40:35.411633 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2026-02-26 12:40:35.411690 | controller | 2026-02-26 12:40:35.411698 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2026-02-26 12:40:35.411705 | controller | Thursday 26 February 2026 12:40:34 +0000 (0:00:01.092) 0:05:07.883 ***** 2026-02-26 12:40:35.411717 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:36.063008 | controller | 2026-02-26 12:40:36.063061 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2026-02-26 12:40:36.063076 | controller | Thursday 26 February 2026 12:40:35 +0000 (0:00:01.095) 0:05:08.979 ***** 2026-02-26 12:40:36.063089 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:36.215730 | controller | 2026-02-26 12:40:36.215754 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2026-02-26 12:40:36.215761 | controller | Thursday 26 February 2026 12:40:36 +0000 (0:00:00.651) 0:05:09.631 ***** 2026-02-26 12:40:36.215772 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2026-02-26 12:40:36.767811 | controller | 2026-02-26 12:40:36.769405 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2026-02-26 12:40:36.769422 | controller | Thursday 26 February 2026 12:40:36 +0000 (0:00:00.154) 0:05:09.785 ***** 2026-02-26 12:40:36.769436 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:37.310190 | controller | 2026-02-26 12:40:37.310263 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2026-02-26 12:40:37.310272 | controller | Thursday 26 February 2026 12:40:36 +0000 (0:00:00.547) 0:05:10.333 ***** 2026-02-26 12:40:37.310520 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-26 12:40:38.095099 | controller | 2026-02-26 12:40:38.095141 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2026-02-26 12:40:38.095149 | controller | Thursday 26 February 2026 12:40:37 +0000 (0:00:00.544) 0:05:10.878 ***** 2026-02-26 12:40:38.095160 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-26 12:40:38.095317 | controller | 2026-02-26 12:40:38.095451 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2026-02-26 12:40:38.095579 | controller | Thursday 26 February 2026 12:40:38 +0000 (0:00:00.780) 0:05:11.658 ***** 2026-02-26 12:40:38.687728 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-26 12:40:38.746112 | controller | 2026-02-26 12:40:38.746150 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2026-02-26 12:40:38.746159 | controller | Thursday 26 February 2026 12:40:38 +0000 (0:00:00.596) 0:05:12.255 ***** 2026-02-26 12:40:38.746169 | controller | 2026-02-26 12:40:39.279423 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2026-02-26 12:40:39.279476 | controller | Thursday 26 February 2026 12:40:38 +0000 (0:00:00.060) 0:05:12.316 ***** 2026-02-26 12:40:39.279491 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-26 12:40:40.057957 | controller | 2026-02-26 12:40:40.058016 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2026-02-26 12:40:40.058026 | controller | Thursday 26 February 2026 12:40:39 +0000 (0:00:00.531) 0:05:12.847 ***** 2026-02-26 12:40:40.058040 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-26 12:40:40.093683 | controller | 2026-02-26 12:40:40.093714 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2026-02-26 12:40:40.093723 | controller | Thursday 26 February 2026 12:40:40 +0000 (0:00:00.778) 0:05:13.625 ***** 2026-02-26 12:40:40.093734 | controller | skipping: [instance] 2026-02-26 12:40:40.142822 | controller | 2026-02-26 12:40:40.142859 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2026-02-26 12:40:40.142869 | controller | Thursday 26 February 2026 12:40:40 +0000 (0:00:00.038) 0:05:13.663 ***** 2026-02-26 12:40:40.142880 | controller | skipping: [instance] 2026-02-26 12:40:40.383502 | controller | 2026-02-26 12:40:40.383545 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2026-02-26 12:40:40.383554 | controller | Thursday 26 February 2026 12:40:40 +0000 (0:00:00.048) 0:05:13.712 ***** 2026-02-26 12:40:40.383565 | controller | changed: [instance] 2026-02-26 12:40:40.464363 | controller | 2026-02-26 12:40:40.464413 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2026-02-26 12:40:40.464422 | controller | Thursday 26 February 2026 12:40:40 +0000 (0:00:00.240) 0:05:13.953 ***** 2026-02-26 12:40:40.464434 | controller | skipping: [instance] => (item=) 2026-02-26 12:40:40.464769 | controller | 2026-02-26 12:40:40.504123 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2026-02-26 12:40:40.504144 | controller | Thursday 26 February 2026 12:40:40 +0000 (0:00:00.081) 0:05:14.034 ***** 2026-02-26 12:40:40.504155 | controller | ok: [instance] 2026-02-26 12:40:40.598815 | controller | 2026-02-26 12:40:40.598857 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-26 12:40:40.598866 | controller | Thursday 26 February 2026 12:40:40 +0000 (0:00:00.039) 0:05:14.074 ***** 2026-02-26 12:40:40.598877 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-26 12:40:40.862273 | controller | 2026-02-26 12:40:40.862321 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-26 12:40:40.862331 | controller | Thursday 26 February 2026 12:40:40 +0000 (0:00:00.090) 0:05:14.165 ***** 2026-02-26 12:40:40.862349 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-26 12:40:40.912155 | controller | 2026-02-26 12:40:40.912193 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2026-02-26 12:40:40.912202 | controller | Thursday 26 February 2026 12:40:40 +0000 (0:00:00.266) 0:05:14.432 ***** 2026-02-26 12:40:40.912237 | controller | 2026-02-26 12:40:40.985842 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-26 12:40:40.985870 | controller | Thursday 26 February 2026 12:40:40 +0000 (0:00:00.050) 0:05:14.482 ***** 2026-02-26 12:40:40.985881 | controller | ok: [instance] 2026-02-26 12:40:41.051523 | controller | 2026-02-26 12:40:41.051568 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-26 12:40:41.051577 | controller | Thursday 26 February 2026 12:40:40 +0000 (0:00:00.073) 0:05:14.556 ***** 2026-02-26 12:40:41.051589 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-26 12:40:41.367551 | controller | 2026-02-26 12:40:41.367596 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-26 12:40:41.367604 | controller | Thursday 26 February 2026 12:40:41 +0000 (0:00:00.065) 0:05:14.621 ***** 2026-02-26 12:40:41.367615 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-26 12:40:41.438318 | controller | 2026-02-26 12:40:41.438347 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-26 12:40:41.438356 | controller | Thursday 26 February 2026 12:40:41 +0000 (0:00:00.315) 0:05:14.937 ***** 2026-02-26 12:40:41.438373 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-26 12:40:41.871781 | controller | skipping: [instance] 2026-02-26 12:40:41.871811 | controller | 2026-02-26 12:40:41.871818 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2026-02-26 12:40:41.871824 | controller | Thursday 26 February 2026 12:40:41 +0000 (0:00:00.071) 0:05:15.008 ***** 2026-02-26 12:40:41.871834 | controller | changed: [instance] 2026-02-26 12:40:42.646727 | controller | 2026-02-26 12:40:42.646789 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-26 12:40:42.646799 | controller | Thursday 26 February 2026 12:40:41 +0000 (0:00:00.421) 0:05:15.429 ***** 2026-02-26 12:40:42.646804 | controller | 2026-02-26 12:40:42.646810 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2026-02-26 12:40:42.646815 | controller | Thursday 26 February 2026 12:40:41 +0000 (0:00:00.011) 0:05:15.441 ***** 2026-02-26 12:40:42.646827 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:44.082815 | controller | 2026-02-26 12:40:44.082877 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-26 12:40:44.082889 | controller | Thursday 26 February 2026 12:40:42 +0000 (0:00:00.774) 0:05:16.216 ***** 2026-02-26 12:40:44.082909 | controller | changed: [instance] 2026-02-26 12:40:44.082986 | controller | 2026-02-26 12:40:44.083188 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2026-02-26 12:40:44.083275 | controller | Thursday 26 February 2026 12:40:44 +0000 (0:00:01.436) 0:05:17.652 ***** 2026-02-26 12:40:44.348917 | controller | skipping: [instance] => (item=controller-0) 2026-02-26 12:40:45.985103 | controller | skipping: [instance] => (item=crc-0) 2026-02-26 12:40:45.985152 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2026-02-26 12:40:45.985162 | controller | 2026-02-26 12:40:45.985169 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2026-02-26 12:40:45.985176 | controller | Thursday 26 February 2026 12:40:44 +0000 (0:00:00.265) 0:05:17.918 ***** 2026-02-26 12:40:45.985188 | controller | changed: [instance -> compute-0(compute-0.instance)] 2026-02-26 12:40:46.010461 | controller | 2026-02-26 12:40:46.010539 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-26 12:40:46.010550 | controller | Thursday 26 February 2026 12:40:45 +0000 (0:00:01.636) 0:05:19.554 ***** 2026-02-26 12:40:46.010567 | controller | skipping: [instance] 2026-02-26 12:40:46.548903 | controller | 2026-02-26 12:40:46.548961 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-26 12:40:46.548970 | controller | Thursday 26 February 2026 12:40:46 +0000 (0:00:00.025) 0:05:19.580 ***** 2026-02-26 12:40:46.548983 | controller | ok: [instance -> compute-0(compute-0.instance)] 2026-02-26 12:40:46.595405 | controller | 2026-02-26 12:40:46.595464 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-26 12:40:46.595475 | controller | Thursday 26 February 2026 12:40:46 +0000 (0:00:00.536) 0:05:20.117 ***** 2026-02-26 12:40:46.595490 | controller | skipping: [instance] 2026-02-26 12:40:46.638346 | controller | 2026-02-26 12:40:46.638395 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-26 12:40:46.638414 | controller | Thursday 26 February 2026 12:40:46 +0000 (0:00:00.047) 0:05:20.165 ***** 2026-02-26 12:40:46.638428 | controller | skipping: [instance] 2026-02-26 12:40:46.679165 | controller | 2026-02-26 12:40:46.679195 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-26 12:40:46.679203 | controller | Thursday 26 February 2026 12:40:46 +0000 (0:00:00.043) 0:05:20.208 ***** 2026-02-26 12:40:46.679242 | controller | skipping: [instance] 2026-02-26 12:40:46.730984 | controller | 2026-02-26 12:40:46.731009 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-26 12:40:46.731017 | controller | Thursday 26 February 2026 12:40:46 +0000 (0:00:00.041) 0:05:20.249 ***** 2026-02-26 12:40:46.731027 | controller | skipping: [instance] 2026-02-26 12:40:46.779057 | controller | 2026-02-26 12:40:46.779089 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2026-02-26 12:40:46.779098 | controller | Thursday 26 February 2026 12:40:46 +0000 (0:00:00.051) 0:05:20.301 ***** 2026-02-26 12:40:46.779108 | controller | skipping: [instance] 2026-02-26 12:40:46.803569 | controller | 2026-02-26 12:40:46.803593 | controller | TASK [reproducer : Create repositories on computes] **************************** 2026-02-26 12:40:46.803602 | controller | Thursday 26 February 2026 12:40:46 +0000 (0:00:00.047) 0:05:20.349 ***** 2026-02-26 12:40:46.803614 | controller | skipping: [instance] 2026-02-26 12:40:46.803767 | controller | 2026-02-26 12:40:46.803785 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2026-02-26 12:40:46.835445 | controller | Thursday 26 February 2026 12:40:46 +0000 (0:00:00.025) 0:05:20.374 ***** 2026-02-26 12:40:46.835549 | controller | skipping: [instance] 2026-02-26 12:40:46.900772 | controller | 2026-02-26 12:40:46.900807 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2026-02-26 12:40:46.900819 | controller | Thursday 26 February 2026 12:40:46 +0000 (0:00:00.031) 0:05:20.405 ***** 2026-02-26 12:40:46.900833 | controller | ok: [instance] 2026-02-26 12:40:47.008522 | controller | 2026-02-26 12:40:47.008554 | controller | TASK [reproducer : Push local code] ******************************************** 2026-02-26 12:40:47.008564 | controller | Thursday 26 February 2026 12:40:46 +0000 (0:00:00.064) 0:05:20.470 ***** 2026-02-26 12:40:47.008575 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2026-02-26 12:40:47.052928 | controller | 2026-02-26 12:40:47.052966 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2026-02-26 12:40:47.052975 | controller | Thursday 26 February 2026 12:40:47 +0000 (0:00:00.107) 0:05:20.578 ***** 2026-02-26 12:40:47.052985 | controller | skipping: [instance] 2026-02-26 12:40:47.100398 | controller | 2026-02-26 12:40:47.100433 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2026-02-26 12:40:47.100443 | controller | Thursday 26 February 2026 12:40:47 +0000 (0:00:00.044) 0:05:20.622 ***** 2026-02-26 12:40:47.100455 | controller | skipping: [instance] 2026-02-26 12:40:47.100463 | controller | 2026-02-26 12:40:47.100476 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2026-02-26 12:40:47.100485 | controller | Thursday 26 February 2026 12:40:47 +0000 (0:00:00.047) 0:05:20.670 ***** 2026-02-26 12:40:47.146902 | controller | skipping: [instance] 2026-02-26 12:40:47.195827 | controller | 2026-02-26 12:40:47.195850 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2026-02-26 12:40:47.195860 | controller | Thursday 26 February 2026 12:40:47 +0000 (0:00:00.046) 0:05:20.717 ***** 2026-02-26 12:40:47.195870 | controller | skipping: [instance] 2026-02-26 12:40:47.244134 | controller | 2026-02-26 12:40:47.244156 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2026-02-26 12:40:47.244166 | controller | Thursday 26 February 2026 12:40:47 +0000 (0:00:00.049) 0:05:20.766 ***** 2026-02-26 12:40:47.244176 | controller | skipping: [instance] 2026-02-26 12:40:47.764259 | controller | 2026-02-26 12:40:47.764327 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2026-02-26 12:40:47.764340 | controller | Thursday 26 February 2026 12:40:47 +0000 (0:00:00.048) 0:05:20.814 ***** 2026-02-26 12:40:47.764361 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2026-02-26 12:40:48.381133 | controller | 2026-02-26 12:40:48.381180 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2026-02-26 12:40:48.381189 | controller | Thursday 26 February 2026 12:40:47 +0000 (0:00:00.519) 0:05:21.333 ***** 2026-02-26 12:40:48.381201 | controller | ok: [instance -> localhost] => (item=ci-framework) 2026-02-26 12:40:48.429824 | controller | 2026-02-26 12:40:48.429893 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2026-02-26 12:40:48.429903 | controller | Thursday 26 February 2026 12:40:48 +0000 (0:00:00.617) 0:05:21.951 ***** 2026-02-26 12:40:48.429919 | controller | skipping: [instance] => (item=ci-framework) 2026-02-26 12:40:48.429956 | controller | skipping: [instance] 2026-02-26 12:40:48.429964 | controller | 2026-02-26 12:40:48.429969 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2026-02-26 12:40:48.429976 | controller | Thursday 26 February 2026 12:40:48 +0000 (0:00:00.048) 0:05:21.999 ***** 2026-02-26 12:40:48.519751 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2026-02-26 12:40:48.519812 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2026-02-26 12:40:48.519916 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2026-02-26 12:40:48.520016 | controller | 2026-02-26 12:40:48.520113 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2026-02-26 12:40:48.520202 | controller | Thursday 26 February 2026 12:40:48 +0000 (0:00:00.090) 0:05:22.090 ***** 2026-02-26 12:40:49.073427 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:49.073507 | controller | 2026-02-26 12:40:49.073601 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2026-02-26 12:40:49.073698 | controller | Thursday 26 February 2026 12:40:49 +0000 (0:00:00.552) 0:05:22.643 ***** 2026-02-26 12:40:49.123773 | controller | skipping: [instance] 2026-02-26 12:40:49.123874 | controller | 2026-02-26 12:40:49.123992 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2026-02-26 12:40:49.124108 | controller | Thursday 26 February 2026 12:40:49 +0000 (0:00:00.050) 0:05:22.693 ***** 2026-02-26 12:40:49.694953 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:49.695020 | controller | 2026-02-26 12:40:49.695114 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2026-02-26 12:40:49.695239 | controller | Thursday 26 February 2026 12:40:49 +0000 (0:00:00.571) 0:05:23.264 ***** 2026-02-26 12:40:49.739660 | controller | skipping: [instance] 2026-02-26 12:40:49.739776 | controller | 2026-02-26 12:40:49.739901 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2026-02-26 12:40:49.740017 | controller | Thursday 26 February 2026 12:40:49 +0000 (0:00:00.045) 0:05:23.310 ***** 2026-02-26 12:40:50.264325 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:50.264401 | controller | 2026-02-26 12:40:50.264478 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2026-02-26 12:40:50.264601 | controller | Thursday 26 February 2026 12:40:50 +0000 (0:00:00.524) 0:05:23.834 ***** 2026-02-26 12:40:52.783985 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:40:52.784047 | controller | 2026-02-26 12:40:52.784231 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2026-02-26 12:41:12.901305 | controller | Thursday 26 February 2026 12:40:52 +0000 (0:00:02.519) 0:05:26.353 ***** 2026-02-26 12:41:12.901360 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:14.004277 | controller | 2026-02-26 12:41:14.004323 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2026-02-26 12:41:14.004340 | controller | Thursday 26 February 2026 12:41:12 +0000 (0:00:20.117) 0:05:46.471 ***** 2026-02-26 12:41:14.004352 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:14.105197 | controller | 2026-02-26 12:41:14.105230 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2026-02-26 12:41:14.105240 | controller | Thursday 26 February 2026 12:41:14 +0000 (0:00:01.103) 0:05:47.574 ***** 2026-02-26 12:41:14.105249 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2026-02-26 12:41:14.604411 | controller | 2026-02-26 12:41:14.604523 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2026-02-26 12:41:14.604538 | controller | Thursday 26 February 2026 12:41:14 +0000 (0:00:00.101) 0:05:47.675 ***** 2026-02-26 12:41:14.604558 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:14.643179 | controller | 2026-02-26 12:41:14.643230 | controller | TASK [reproducer : Rotate log if present] ************************************** 2026-02-26 12:41:14.643242 | controller | Thursday 26 February 2026 12:41:14 +0000 (0:00:00.498) 0:05:48.174 ***** 2026-02-26 12:41:14.643253 | controller | skipping: [instance] 2026-02-26 12:41:14.687992 | controller | 2026-02-26 12:41:14.688008 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2026-02-26 12:41:14.688014 | controller | Thursday 26 February 2026 12:41:14 +0000 (0:00:00.039) 0:05:48.213 ***** 2026-02-26 12:41:14.688022 | controller | skipping: [instance] 2026-02-26 12:41:14.792149 | controller | 2026-02-26 12:41:14.792165 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2026-02-26 12:41:14.792172 | controller | Thursday 26 February 2026 12:41:14 +0000 (0:00:00.044) 0:05:48.258 ***** 2026-02-26 12:41:14.792181 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:15.345269 | controller | 2026-02-26 12:41:15.345313 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-26 12:41:15.345322 | controller | Thursday 26 February 2026 12:41:14 +0000 (0:00:00.104) 0:05:48.362 ***** 2026-02-26 12:41:15.345335 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:15.389347 | controller | 2026-02-26 12:41:15.389395 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-26 12:41:15.389407 | controller | Thursday 26 February 2026 12:41:15 +0000 (0:00:00.552) 0:05:48.914 ***** 2026-02-26 12:41:15.389421 | controller | skipping: [instance] 2026-02-26 12:41:15.430283 | controller | 2026-02-26 12:41:15.430318 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-26 12:41:15.430327 | controller | Thursday 26 February 2026 12:41:15 +0000 (0:00:00.044) 0:05:48.959 ***** 2026-02-26 12:41:15.430337 | controller | skipping: [instance] 2026-02-26 12:41:15.471288 | controller | 2026-02-26 12:41:15.471305 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-26 12:41:15.471312 | controller | Thursday 26 February 2026 12:41:15 +0000 (0:00:00.040) 0:05:49.000 ***** 2026-02-26 12:41:15.471327 | controller | skipping: [instance] 2026-02-26 12:41:15.520285 | controller | 2026-02-26 12:41:15.520341 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-26 12:41:15.520352 | controller | Thursday 26 February 2026 12:41:15 +0000 (0:00:00.040) 0:05:49.041 ***** 2026-02-26 12:41:15.520369 | controller | skipping: [instance] 2026-02-26 12:41:16.994428 | controller | 2026-02-26 12:41:16.994505 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-26 12:41:16.994515 | controller | Thursday 26 February 2026 12:41:15 +0000 (0:00:00.048) 0:05:49.090 ***** 2026-02-26 12:41:16.994531 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:41:16.994592 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:41:16.994601 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:41:16.994609 | controller | changed: [instance -> controller-0] 2026-02-26 12:41:16.994689 | controller | 2026-02-26 12:41:16.994773 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-26 12:41:16.994855 | controller | Thursday 26 February 2026 12:41:16 +0000 (0:00:01.473) 0:05:50.564 ***** 2026-02-26 12:41:18.052661 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:19.391383 | controller | 2026-02-26 12:41:19.391439 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-26 12:41:19.391451 | controller | Thursday 26 February 2026 12:41:18 +0000 (0:00:01.058) 0:05:51.622 ***** 2026-02-26 12:41:19.391466 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:19.391507 | controller | 2026-02-26 12:41:19.391540 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-26 12:41:19.391550 | controller | Thursday 26 February 2026 12:41:19 +0000 (0:00:01.338) 0:05:52.961 ***** 2026-02-26 12:41:27.119181 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:28.080288 | controller | 2026-02-26 12:41:28.080346 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-26 12:41:28.080355 | controller | Thursday 26 February 2026 12:41:27 +0000 (0:00:07.726) 0:06:00.688 ***** 2026-02-26 12:41:28.080369 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:28.122777 | controller | 2026-02-26 12:41:28.122829 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-26 12:41:28.122837 | controller | Thursday 26 February 2026 12:41:28 +0000 (0:00:00.961) 0:06:01.649 ***** 2026-02-26 12:41:28.122849 | controller | skipping: [instance] 2026-02-26 12:41:29.421994 | controller | 2026-02-26 12:41:29.422044 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-26 12:41:29.422054 | controller | Thursday 26 February 2026 12:41:28 +0000 (0:00:00.043) 0:06:01.693 ***** 2026-02-26 12:41:29.422068 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:29.484075 | controller | 2026-02-26 12:41:29.484097 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-26 12:41:29.484105 | controller | Thursday 26 February 2026 12:41:29 +0000 (0:00:01.298) 0:06:02.991 ***** 2026-02-26 12:41:29.484122 | controller | skipping: [instance] 2026-02-26 12:41:29.484324 | controller | 2026-02-26 12:41:29.484340 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-26 12:41:29.484463 | controller | Thursday 26 February 2026 12:41:29 +0000 (0:00:00.063) 0:06:03.054 ***** 2026-02-26 12:41:29.552393 | controller | skipping: [instance] 2026-02-26 12:41:29.552494 | controller | 2026-02-26 12:41:29.552508 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-26 12:41:29.552698 | controller | Thursday 26 February 2026 12:41:29 +0000 (0:00:00.068) 0:06:03.122 ***** 2026-02-26 12:41:29.617523 | controller | skipping: [instance] 2026-02-26 12:41:29.617585 | controller | 2026-02-26 12:41:29.617693 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-26 12:41:29.617968 | controller | Thursday 26 February 2026 12:41:29 +0000 (0:00:00.065) 0:06:03.187 ***** 2026-02-26 12:41:30.533394 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:30.533442 | controller | 2026-02-26 12:41:30.533521 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-26 12:41:30.533609 | controller | Thursday 26 February 2026 12:41:30 +0000 (0:00:00.915) 0:06:04.103 ***** 2026-02-26 12:41:31.608368 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:31.608435 | controller | 2026-02-26 12:41:31.608702 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-26 12:41:31.653884 | controller | Thursday 26 February 2026 12:41:31 +0000 (0:00:01.075) 0:06:05.178 ***** 2026-02-26 12:41:31.653911 | controller | skipping: [instance] 2026-02-26 12:41:31.697168 | controller | 2026-02-26 12:41:31.697186 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-26 12:41:31.697193 | controller | Thursday 26 February 2026 12:41:31 +0000 (0:00:00.045) 0:06:05.224 ***** 2026-02-26 12:41:31.697201 | controller | skipping: [instance] 2026-02-26 12:41:31.738373 | controller | 2026-02-26 12:41:31.738451 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-26 12:41:31.738465 | controller | Thursday 26 February 2026 12:41:31 +0000 (0:00:00.043) 0:06:05.267 ***** 2026-02-26 12:41:31.738483 | controller | skipping: [instance] 2026-02-26 12:41:31.738589 | controller | 2026-02-26 12:41:31.738617 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-26 12:41:31.738632 | controller | Thursday 26 February 2026 12:41:31 +0000 (0:00:00.041) 0:06:05.308 ***** 2026-02-26 12:41:31.794765 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:31.836321 | controller | 2026-02-26 12:41:31.836343 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-26 12:41:31.836351 | controller | Thursday 26 February 2026 12:41:31 +0000 (0:00:00.056) 0:06:05.365 ***** 2026-02-26 12:41:31.836360 | controller | skipping: [instance] 2026-02-26 12:41:31.877673 | controller | 2026-02-26 12:41:31.877723 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-26 12:41:31.877732 | controller | Thursday 26 February 2026 12:41:31 +0000 (0:00:00.041) 0:06:05.406 ***** 2026-02-26 12:41:31.877744 | controller | skipping: [instance] 2026-02-26 12:41:31.877774 | controller | 2026-02-26 12:41:31.877890 | controller | TASK [Download the RPM] ******************************************************** 2026-02-26 12:41:31.877914 | controller | Thursday 26 February 2026 12:41:31 +0000 (0:00:00.041) 0:06:05.448 ***** 2026-02-26 12:41:31.922032 | controller | skipping: [instance] 2026-02-26 12:41:31.922167 | controller | 2026-02-26 12:41:31.922324 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-26 12:41:31.922453 | controller | Thursday 26 February 2026 12:41:31 +0000 (0:00:00.044) 0:06:05.492 ***** 2026-02-26 12:41:31.970454 | controller | skipping: [instance] 2026-02-26 12:41:31.970784 | controller | 2026-02-26 12:41:31.970940 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-26 12:41:31.971118 | controller | Thursday 26 February 2026 12:41:31 +0000 (0:00:00.048) 0:06:05.540 ***** 2026-02-26 12:41:32.021927 | controller | skipping: [instance] 2026-02-26 12:41:32.022075 | controller | 2026-02-26 12:41:32.022204 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-26 12:41:32.022372 | controller | Thursday 26 February 2026 12:41:32 +0000 (0:00:00.051) 0:06:05.592 ***** 2026-02-26 12:41:32.069765 | controller | skipping: [instance] 2026-02-26 12:41:32.069939 | controller | 2026-02-26 12:41:32.070126 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-26 12:41:32.070315 | controller | Thursday 26 February 2026 12:41:32 +0000 (0:00:00.047) 0:06:05.640 ***** 2026-02-26 12:41:32.114354 | controller | skipping: [instance] 2026-02-26 12:41:32.114507 | controller | 2026-02-26 12:41:32.114641 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-26 12:41:32.114770 | controller | Thursday 26 February 2026 12:41:32 +0000 (0:00:00.044) 0:06:05.684 ***** 2026-02-26 12:41:32.624625 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:32.624778 | controller | 2026-02-26 12:41:32.624829 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-26 12:41:32.684899 | controller | Thursday 26 February 2026 12:41:32 +0000 (0:00:00.509) 0:06:06.194 ***** 2026-02-26 12:41:32.684940 | controller | skipping: [instance] 2026-02-26 12:41:32.742889 | controller | 2026-02-26 12:41:32.742916 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-26 12:41:32.742925 | controller | Thursday 26 February 2026 12:41:32 +0000 (0:00:00.060) 0:06:06.255 ***** 2026-02-26 12:41:32.742935 | controller | skipping: [instance] 2026-02-26 12:41:32.742968 | controller | 2026-02-26 12:41:32.742978 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-26 12:41:32.743068 | controller | Thursday 26 February 2026 12:41:32 +0000 (0:00:00.057) 0:06:06.312 ***** 2026-02-26 12:41:32.793344 | controller | skipping: [instance] 2026-02-26 12:41:32.793373 | controller | 2026-02-26 12:41:32.793384 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-26 12:41:32.793403 | controller | Thursday 26 February 2026 12:41:32 +0000 (0:00:00.050) 0:06:06.363 ***** 2026-02-26 12:41:32.853400 | controller | skipping: [instance] 2026-02-26 12:41:32.853447 | controller | 2026-02-26 12:41:32.853462 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-26 12:41:32.853523 | controller | Thursday 26 February 2026 12:41:32 +0000 (0:00:00.060) 0:06:06.423 ***** 2026-02-26 12:41:32.912813 | controller | skipping: [instance] 2026-02-26 12:41:32.971287 | controller | 2026-02-26 12:41:32.971337 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-26 12:41:32.971348 | controller | Thursday 26 February 2026 12:41:32 +0000 (0:00:00.059) 0:06:06.482 ***** 2026-02-26 12:41:32.971362 | controller | skipping: [instance] 2026-02-26 12:41:33.029350 | controller | 2026-02-26 12:41:33.029404 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-26 12:41:33.029417 | controller | Thursday 26 February 2026 12:41:32 +0000 (0:00:00.058) 0:06:06.541 ***** 2026-02-26 12:41:33.029433 | controller | skipping: [instance] 2026-02-26 12:41:33.029473 | controller | 2026-02-26 12:41:33.029585 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-26 12:41:33.029626 | controller | Thursday 26 February 2026 12:41:33 +0000 (0:00:00.058) 0:06:06.599 ***** 2026-02-26 12:41:33.090400 | controller | skipping: [instance] 2026-02-26 12:41:33.090458 | controller | 2026-02-26 12:41:33.090466 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-26 12:41:33.090477 | controller | Thursday 26 February 2026 12:41:33 +0000 (0:00:00.060) 0:06:06.660 ***** 2026-02-26 12:41:33.803824 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:33.803868 | controller | 2026-02-26 12:41:33.804001 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-26 12:41:33.804120 | controller | Thursday 26 February 2026 12:41:33 +0000 (0:00:00.713) 0:06:07.373 ***** 2026-02-26 12:41:34.909413 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:41:34.909488 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:41:34.909501 | controller | changed: [instance -> controller-0] 2026-02-26 12:41:34.909529 | controller | 2026-02-26 12:41:34.909765 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-26 12:41:35.681672 | controller | Thursday 26 February 2026 12:41:34 +0000 (0:00:01.105) 0:06:08.479 ***** 2026-02-26 12:41:35.681722 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:36.221836 | controller | 2026-02-26 12:41:36.221873 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-26 12:41:36.221882 | controller | Thursday 26 February 2026 12:41:35 +0000 (0:00:00.772) 0:06:09.251 ***** 2026-02-26 12:41:36.221893 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:41:36.282766 | controller | 2026-02-26 12:41:36.282819 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-26 12:41:36.282831 | controller | Thursday 26 February 2026 12:41:36 +0000 (0:00:00.540) 0:06:09.791 ***** 2026-02-26 12:41:36.282847 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:41:36.282889 | controller | ok: [instance -> controller-0] 2026-02-26 12:41:36.283151 | controller | 2026-02-26 12:41:36.283175 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-26 12:41:36.329785 | controller | Thursday 26 February 2026 12:41:36 +0000 (0:00:00.060) 0:06:09.852 ***** 2026-02-26 12:41:36.329814 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:11.935843 | controller | 2026-02-26 12:42:11.935894 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-26 12:42:11.935902 | controller | Thursday 26 February 2026 12:41:36 +0000 (0:00:00.047) 0:06:09.900 ***** 2026-02-26 12:42:11.935913 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:12.464652 | controller | 2026-02-26 12:42:12.464703 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-26 12:42:12.464711 | controller | Thursday 26 February 2026 12:42:11 +0000 (0:00:35.605) 0:06:45.505 ***** 2026-02-26 12:42:12.464722 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:13.023051 | controller | 2026-02-26 12:42:13.023094 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-26 12:42:13.023103 | controller | Thursday 26 February 2026 12:42:12 +0000 (0:00:00.528) 0:06:46.034 ***** 2026-02-26 12:42:13.023116 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:19.376882 | controller | 2026-02-26 12:42:19.376939 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-26 12:42:19.376948 | controller | Thursday 26 February 2026 12:42:13 +0000 (0:00:00.558) 0:06:46.592 ***** 2026-02-26 12:42:19.376961 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:19.377314 | controller | 2026-02-26 12:42:19.377328 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-26 12:42:19.429671 | controller | Thursday 26 February 2026 12:42:19 +0000 (0:00:06.351) 0:06:52.944 ***** 2026-02-26 12:42:19.429714 | controller | skipping: [instance] 2026-02-26 12:42:19.429742 | controller | 2026-02-26 12:42:19.430019 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-26 12:42:20.102906 | controller | Thursday 26 February 2026 12:42:19 +0000 (0:00:00.055) 0:06:53.000 ***** 2026-02-26 12:42:20.104017 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:20.631635 | controller | 2026-02-26 12:42:20.631686 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-26 12:42:20.631695 | controller | Thursday 26 February 2026 12:42:20 +0000 (0:00:00.671) 0:06:53.672 ***** 2026-02-26 12:42:20.631717 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:20.681442 | controller | 2026-02-26 12:42:20.681512 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-26 12:42:20.681524 | controller | Thursday 26 February 2026 12:42:20 +0000 (0:00:00.529) 0:06:54.201 ***** 2026-02-26 12:42:20.681543 | controller | skipping: [instance] 2026-02-26 12:42:20.728961 | controller | 2026-02-26 12:42:20.729000 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-26 12:42:20.729008 | controller | Thursday 26 February 2026 12:42:20 +0000 (0:00:00.050) 0:06:54.251 ***** 2026-02-26 12:42:20.729023 | controller | skipping: [instance] 2026-02-26 12:42:20.775751 | controller | 2026-02-26 12:42:20.775800 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-26 12:42:20.775809 | controller | Thursday 26 February 2026 12:42:20 +0000 (0:00:00.047) 0:06:54.298 ***** 2026-02-26 12:42:20.775822 | controller | skipping: [instance] 2026-02-26 12:42:20.775849 | controller | 2026-02-26 12:42:20.775858 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-26 12:42:20.819361 | controller | Thursday 26 February 2026 12:42:20 +0000 (0:00:00.046) 0:06:54.345 ***** 2026-02-26 12:42:20.819412 | controller | skipping: [instance] 2026-02-26 12:42:20.819472 | controller | 2026-02-26 12:42:20.819485 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-26 12:42:20.862377 | controller | Thursday 26 February 2026 12:42:20 +0000 (0:00:00.044) 0:06:54.389 ***** 2026-02-26 12:42:20.862412 | controller | skipping: [instance] 2026-02-26 12:42:20.862551 | controller | 2026-02-26 12:42:20.862561 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-26 12:42:20.862572 | controller | Thursday 26 February 2026 12:42:20 +0000 (0:00:00.042) 0:06:54.432 ***** 2026-02-26 12:42:20.911251 | controller | skipping: [instance] 2026-02-26 12:42:23.716360 | controller | 2026-02-26 12:42:23.716431 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-26 12:42:23.716441 | controller | Thursday 26 February 2026 12:42:20 +0000 (0:00:00.048) 0:06:54.481 ***** 2026-02-26 12:42:23.716459 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:42:23.716775 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:42:23.716803 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:42:23.716815 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:42:23.716851 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:42:23.716858 | controller | changed: [instance -> controller-0] 2026-02-26 12:42:23.716864 | controller | 2026-02-26 12:42:23.716869 | controller | TASK [Prepare install_yamls make targets] ************************************** 2026-02-26 12:42:23.716877 | controller | Thursday 26 February 2026 12:42:23 +0000 (0:00:02.804) 0:06:57.286 ***** 2026-02-26 12:42:23.884508 | controller | 2026-02-26 12:42:25.474294 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2026-02-26 12:42:25.474347 | controller | Thursday 26 February 2026 12:42:23 +0000 (0:00:00.167) 0:06:57.454 ***** 2026-02-26 12:42:25.474365 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:42:25.474400 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:42:25.474410 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:42:25.474485 | controller | changed: [instance -> controller-0] 2026-02-26 12:42:25.474567 | controller | 2026-02-26 12:42:25.474654 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2026-02-26 12:42:25.474730 | controller | Thursday 26 February 2026 12:42:25 +0000 (0:00:01.590) 0:06:59.044 ***** 2026-02-26 12:42:25.540703 | controller | 2026-02-26 12:42:25.540788 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2026-02-26 12:42:25.540886 | controller | Thursday 26 February 2026 12:42:25 +0000 (0:00:00.066) 0:06:59.111 ***** 2026-02-26 12:42:25.591039 | controller | skipping: [instance] 2026-02-26 12:42:25.591154 | controller | 2026-02-26 12:42:25.591168 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2026-02-26 12:42:25.591305 | controller | Thursday 26 February 2026 12:42:25 +0000 (0:00:00.049) 0:06:59.160 ***** 2026-02-26 12:42:25.643283 | controller | skipping: [instance] 2026-02-26 12:42:25.643379 | controller | 2026-02-26 12:42:25.643482 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2026-02-26 12:42:25.643581 | controller | Thursday 26 February 2026 12:42:25 +0000 (0:00:00.051) 0:06:59.212 ***** 2026-02-26 12:42:25.717794 | controller | 2026-02-26 12:42:25.717884 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-26 12:42:25.717991 | controller | Thursday 26 February 2026 12:42:25 +0000 (0:00:00.076) 0:06:59.288 ***** 2026-02-26 12:42:25.760806 | controller | skipping: [instance] 2026-02-26 12:42:25.760847 | controller | 2026-02-26 12:42:25.760958 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-26 12:42:25.761071 | controller | Thursday 26 February 2026 12:42:25 +0000 (0:00:00.043) 0:06:59.331 ***** 2026-02-26 12:42:25.801196 | controller | skipping: [instance] 2026-02-26 12:42:25.801342 | controller | 2026-02-26 12:42:25.801461 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-26 12:42:25.801576 | controller | Thursday 26 February 2026 12:42:25 +0000 (0:00:00.040) 0:06:59.371 ***** 2026-02-26 12:42:25.844603 | controller | skipping: [instance] 2026-02-26 12:42:25.844702 | controller | 2026-02-26 12:42:25.844817 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-26 12:42:25.844906 | controller | Thursday 26 February 2026 12:42:25 +0000 (0:00:00.042) 0:06:59.414 ***** 2026-02-26 12:42:25.892137 | controller | skipping: [instance] 2026-02-26 12:42:25.892224 | controller | 2026-02-26 12:42:25.892337 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2026-02-26 12:42:25.892460 | controller | Thursday 26 February 2026 12:42:25 +0000 (0:00:00.048) 0:06:59.462 ***** 2026-02-26 12:42:26.158423 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 12:42:26.158469 | controller | ok: [instance -> controller-0] 2026-02-26 12:42:26.158568 | controller | 2026-02-26 12:42:26.158667 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2026-02-26 12:42:26.158755 | controller | Thursday 26 February 2026 12:42:26 +0000 (0:00:00.266) 0:06:59.728 ***** 2026-02-26 12:42:26.230630 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:26.230748 | controller | 2026-02-26 12:42:26.230877 | controller | TASK [install_yamls : Get environment structure] ******************************* 2026-02-26 12:42:26.230967 | controller | Thursday 26 February 2026 12:42:26 +0000 (0:00:00.072) 0:06:59.801 ***** 2026-02-26 12:42:27.144527 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:27.144610 | controller | 2026-02-26 12:42:27.144641 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2026-02-26 12:42:27.144747 | controller | Thursday 26 February 2026 12:42:27 +0000 (0:00:00.913) 0:07:00.714 ***** 2026-02-26 12:42:27.191865 | controller | skipping: [instance] 2026-02-26 12:42:27.191947 | controller | 2026-02-26 12:42:27.192078 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2026-02-26 12:42:27.192201 | controller | Thursday 26 February 2026 12:42:27 +0000 (0:00:00.048) 0:07:00.762 ***** 2026-02-26 12:42:27.248343 | controller | skipping: [instance] 2026-02-26 12:42:27.248417 | controller | 2026-02-26 12:42:27.248509 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2026-02-26 12:42:27.248605 | controller | Thursday 26 February 2026 12:42:27 +0000 (0:00:00.056) 0:07:00.818 ***** 2026-02-26 12:42:27.296040 | controller | skipping: [instance] 2026-02-26 12:42:27.296116 | controller | 2026-02-26 12:42:27.296207 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2026-02-26 12:42:27.296320 | controller | Thursday 26 February 2026 12:42:27 +0000 (0:00:00.047) 0:07:00.866 ***** 2026-02-26 12:42:27.369399 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:27.369514 | controller | 2026-02-26 12:42:27.369645 | controller | TASK [install_yamls : Show the env structure] ********************************** 2026-02-26 12:42:27.369769 | controller | Thursday 26 February 2026 12:42:27 +0000 (0:00:00.073) 0:07:00.939 ***** 2026-02-26 12:42:27.417073 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:27.417146 | controller | 2026-02-26 12:42:27.417268 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2026-02-26 12:42:27.417362 | controller | Thursday 26 February 2026 12:42:27 +0000 (0:00:00.047) 0:07:00.987 ***** 2026-02-26 12:42:27.481640 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:27.481760 | controller | 2026-02-26 12:42:27.482006 | controller | TASK [install_yamls : Generate make targets] *********************************** 2026-02-26 12:42:28.194531 | controller | Thursday 26 February 2026 12:42:27 +0000 (0:00:00.064) 0:07:01.052 ***** 2026-02-26 12:42:28.194624 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:28.194705 | controller | 2026-02-26 12:42:28.194716 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2026-02-26 12:42:28.194797 | controller | Thursday 26 February 2026 12:42:28 +0000 (0:00:00.712) 0:07:01.764 ***** 2026-02-26 12:42:28.256099 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:28.256189 | controller | 2026-02-26 12:42:28.256352 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2026-02-26 12:42:28.256494 | controller | Thursday 26 February 2026 12:42:28 +0000 (0:00:00.061) 0:07:01.826 ***** 2026-02-26 12:42:29.240884 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:29.240952 | controller | 2026-02-26 12:42:29.241075 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2026-02-26 12:42:29.241093 | controller | Thursday 26 February 2026 12:42:29 +0000 (0:00:00.984) 0:07:02.810 ***** 2026-02-26 12:42:29.296021 | controller | skipping: [instance] 2026-02-26 12:42:30.030690 | controller | 2026-02-26 12:42:30.030744 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-26 12:42:30.030753 | controller | Thursday 26 February 2026 12:42:29 +0000 (0:00:00.055) 0:07:02.866 ***** 2026-02-26 12:42:30.030776 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:30.030924 | controller | 2026-02-26 12:42:30.031090 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-26 12:42:30.031255 | controller | Thursday 26 February 2026 12:42:30 +0000 (0:00:00.734) 0:07:03.600 ***** 2026-02-26 12:42:30.089015 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:31.141071 | controller | 2026-02-26 12:42:31.141121 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2026-02-26 12:42:31.141130 | controller | Thursday 26 February 2026 12:42:30 +0000 (0:00:00.058) 0:07:03.659 ***** 2026-02-26 12:42:31.141144 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:31.699044 | controller | 2026-02-26 12:42:31.699095 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2026-02-26 12:42:31.699104 | controller | Thursday 26 February 2026 12:42:31 +0000 (0:00:01.051) 0:07:04.710 ***** 2026-02-26 12:42:31.699125 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 12:42:31.863322 | controller | 2026-02-26 12:42:31.863367 | controller | TASK [Configure CRC network if needed] ***************************************** 2026-02-26 12:42:31.863375 | controller | Thursday 26 February 2026 12:42:31 +0000 (0:00:00.558) 0:07:05.268 ***** 2026-02-26 12:42:31.863387 | controller | 2026-02-26 12:42:31.863405 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2026-02-26 12:42:31.863412 | controller | Thursday 26 February 2026 12:42:31 +0000 (0:00:00.164) 0:07:05.433 ***** 2026-02-26 12:42:33.139319 | controller | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-26 12:42:33.141184 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false 2026-02-26 12:42:33.141279 | controller | module_stderr: |- 2026-02-26 12:42:33.141414 | controller | Shared connection to controller-0.utility closed. 2026-02-26 12:42:33.141734 | controller | module_stdout: |- 2026-02-26 12:42:33.141772 | controller | Traceback (most recent call last): 2026-02-26 12:42:33.141780 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 700, in urlopen 2026-02-26 12:42:33.141787 | controller | httplib_response = self._make_request( 2026-02-26 12:42:33.142237 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 383, in _make_request 2026-02-26 12:42:33.142292 | controller | self._validate_conn(conn) 2026-02-26 12:42:33.142302 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1015, in _validate_conn 2026-02-26 12:42:33.142309 | controller | conn.connect() 2026-02-26 12:42:33.142315 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connection.py", line 411, in connect 2026-02-26 12:42:33.142323 | controller | self.sock = ssl_wrap_socket( 2026-02-26 12:42:33.142386 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket 2026-02-26 12:42:33.142476 | controller | ssl_sock = _ssl_wrap_socket_impl( 2026-02-26 12:42:33.142560 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl 2026-02-26 12:42:33.142656 | controller | return ssl_context.wrap_socket(sock, server_hostname=server_hostname) 2026-02-26 12:42:33.142742 | controller | File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket 2026-02-26 12:42:33.142827 | controller | return self.sslsocket_class._create( 2026-02-26 12:42:33.142930 | controller | File "/usr/lib64/python3.9/ssl.py", line 1076, in _create 2026-02-26 12:42:33.143014 | controller | self.do_handshake() 2026-02-26 12:42:33.143110 | controller | File "/usr/lib64/python3.9/ssl.py", line 1345, in do_handshake 2026-02-26 12:42:33.143200 | controller | self._sslobj.do_handshake() 2026-02-26 12:42:33.143314 | controller | ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147) 2026-02-26 12:42:33.143392 | controller | 2026-02-26 12:42:33.143481 | controller | During handling of the above exception, another exception occurred: 2026-02-26 12:42:33.143553 | controller | 2026-02-26 12:42:33.143641 | controller | Traceback (most recent call last): 2026-02-26 12:42:33.143730 | controller | File "/tmp/ansible-tmp-1772109751.9056003-28511-41954032808094/AnsiballZ_k8s_info.py", line 107, in 2026-02-26 12:42:33.143814 | controller | _ansiballz_main() 2026-02-26 12:42:33.143901 | controller | File "/tmp/ansible-tmp-1772109751.9056003-28511-41954032808094/AnsiballZ_k8s_info.py", line 99, in _ansiballz_main 2026-02-26 12:42:33.144003 | controller | invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS) 2026-02-26 12:42:33.144134 | controller | File "/tmp/ansible-tmp-1772109751.9056003-28511-41954032808094/AnsiballZ_k8s_info.py", line 47, in invoke_module 2026-02-26 12:42:33.144241 | controller | runpy.run_module(mod_name='ansible_collections.kubernetes.core.plugins.modules.k8s_info', init_globals=dict(_module_fqn='ansible_collections.kubernetes.core.plugins.modules.k8s_info', _modlib_path=modlib_path), 2026-02-26 12:42:33.144338 | controller | File "/usr/lib64/python3.9/runpy.py", line 225, in run_module 2026-02-26 12:42:33.144414 | controller | return _run_module_code(code, init_globals, run_name, mod_spec) 2026-02-26 12:42:33.144499 | controller | File "/usr/lib64/python3.9/runpy.py", line 97, in _run_module_code 2026-02-26 12:42:33.144584 | controller | _run_code(code, mod_globals, init_globals, 2026-02-26 12:42:33.144669 | controller | File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-26 12:42:33.144762 | controller | exec(code, run_globals) 2026-02-26 12:42:33.144855 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_615vy0b8/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 229, in 2026-02-26 12:42:33.144947 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_615vy0b8/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 221, in main 2026-02-26 12:42:33.145059 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_615vy0b8/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 352, in get_api_client 2026-02-26 12:42:33.145137 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_615vy0b8/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 246, in wrapper 2026-02-26 12:42:33.145251 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_615vy0b8/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 259, in create_api_client 2026-02-26 12:42:33.145349 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 84, in __init__ 2026-02-26 12:42:33.145435 | controller | self.__discoverer = discoverer(self, cache_file) 2026-02-26 12:42:33.145523 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_615vy0b8/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 190, in __init__ 2026-02-26 12:42:33.145610 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_615vy0b8/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 45, in __init__ 2026-02-26 12:42:33.145702 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_615vy0b8/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 92, in __init_cache 2026-02-26 12:42:33.145788 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/discovery.py", line 146, in _load_server_info 2026-02-26 12:42:33.145874 | controller | 'kubernetes': self.client.request('get', '/version', serializer=just_json) 2026-02-26 12:42:33.145960 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-26 12:42:33.146064 | controller | resp = func(self, *args, **kwargs) 2026-02-26 12:42:33.146150 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 277, in request 2026-02-26 12:42:33.146256 | controller | api_response = self.client.call_api( 2026-02-26 12:42:33.146344 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-26 12:42:33.146429 | controller | return self.__call_api(resource_path, method, 2026-02-26 12:42:33.146516 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-26 12:42:33.146599 | controller | response_data = self.request( 2026-02-26 12:42:33.146687 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-26 12:42:33.146770 | controller | return self.rest_client.GET(url, 2026-02-26 12:42:33.146856 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-26 12:42:33.146948 | controller | return self.request("GET", url, 2026-02-26 12:42:33.147048 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 217, in request 2026-02-26 12:42:33.147147 | controller | r = self.pool_manager.request(method, url, 2026-02-26 12:42:33.147252 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 74, in request 2026-02-26 12:42:33.147340 | controller | return self.request_encode_url( 2026-02-26 12:42:33.147427 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 96, in request_encode_url 2026-02-26 12:42:33.147512 | controller | return self.urlopen(method, url, **extra_kw) 2026-02-26 12:42:33.147600 | controller | File "/usr/lib/python3.9/site-packages/urllib3/poolmanager.py", line 376, in urlopen 2026-02-26 12:42:33.147686 | controller | response = conn.urlopen(method, u.request_uri, **kw) 2026-02-26 12:42:33.147775 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-26 12:42:33.147861 | controller | return self.urlopen( 2026-02-26 12:42:33.147950 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-26 12:42:33.148049 | controller | return self.urlopen( 2026-02-26 12:42:33.148138 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-26 12:42:33.148241 | controller | return self.urlopen( 2026-02-26 12:42:33.148335 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 756, in urlopen 2026-02-26 12:42:33.148421 | controller | retries = retries.increment( 2026-02-26 12:42:33.148507 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 576, in increment 2026-02-26 12:42:33.148662 | controller | raise MaxRetryError(_pool, url, error or ResponseError(cause)) 2026-02-26 12:42:33.148766 | controller | urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-26 12:42:33.148852 | controller | msg: |- 2026-02-26 12:42:33.148941 | controller | MODULE FAILURE 2026-02-26 12:42:33.149040 | controller | See stdout/stderr for the exact error 2026-02-26 12:42:33.149127 | controller | rc: 1 2026-02-26 12:42:33.151051 | controller | 2026-02-26 12:42:33.151177 | controller | TASK [Create dnsmasq dir] ****************************************************** 2026-02-26 12:42:33.151325 | controller | Thursday 26 February 2026 12:42:33 +0000 (0:00:01.288) 0:07:06.721 ***** 2026-02-26 12:42:33.391032 | controller | changed: [instance] 2026-02-26 12:42:33.391128 | controller | 2026-02-26 12:42:33.391268 | controller | TASK [Get journalctl in a file] ************************************************ 2026-02-26 12:42:33.391383 | controller | Thursday 26 February 2026 12:42:33 +0000 (0:00:00.239) 0:07:06.961 ***** 2026-02-26 12:42:33.656927 | controller | changed: [instance] 2026-02-26 12:42:33.656984 | controller | 2026-02-26 12:42:33.657081 | controller | TASK [Dump journalctl output] ************************************************** 2026-02-26 12:42:33.657166 | controller | Thursday 26 February 2026 12:42:33 +0000 (0:00:00.265) 0:07:07.226 ***** 2026-02-26 12:42:34.104258 | controller | changed: [instance] 2026-02-26 12:42:34.104321 | controller | 2026-02-26 12:42:34.104354 | controller | TASK [Copy all dnsmasq config] ************************************************* 2026-02-26 12:42:34.104454 | controller | Thursday 26 February 2026 12:42:34 +0000 (0:00:00.447) 0:07:07.674 ***** 2026-02-26 12:42:34.660983 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-26 12:42:34.661062 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2026-02-26 12:42:34.661117 | controller | 2026-02-26 12:42:34.661209 | controller | TASK [Create log directory] **************************************************** 2026-02-26 12:42:34.661352 | controller | Thursday 26 February 2026 12:42:34 +0000 (0:00:00.556) 0:07:08.230 ***** 2026-02-26 12:42:34.914393 | controller | changed: [instance] 2026-02-26 12:42:34.914443 | controller | 2026-02-26 12:42:34.914547 | controller | TASK [Sync logs from controller-0] ********************************************* 2026-02-26 12:42:34.914714 | controller | Thursday 26 February 2026 12:42:34 +0000 (0:00:00.253) 0:07:08.484 ***** 2026-02-26 12:42:35.825608 | controller | changed: [instance] 2026-02-26 12:42:35.827874 | controller | 2026-02-26 12:42:35.972345 | controller | PLAY RECAP ********************************************************************* 2026-02-26 12:42:35.972399 | controller | instance : ok=541 changed=208 unreachable=0 failed=1 skipped=229 rescued=0 ignored=0 2026-02-26 12:42:35.972407 | controller | 2026-02-26 12:42:35.972414 | controller | Thursday 26 February 2026 12:42:35 +0000 (0:00:00.909) 0:07:09.393 ***** 2026-02-26 12:42:35.972419 | controller | =============================================================================== 2026-02-26 12:42:35.972424 | controller | reproducer : Check package install status ------------------------------ 45.19s 2026-02-26 12:42:35.972435 | controller | ci_setup : Install needed packages ------------------------------------- 35.61s 2026-02-26 12:42:35.972441 | controller | libvirt_manager : Download base image ---------------------------------- 29.06s 2026-02-26 12:42:35.972446 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 23.10s 2026-02-26 12:42:35.972451 | controller | reproducer : Install collections on controller-0 ----------------------- 20.12s 2026-02-26 12:42:35.972456 | controller | sushy_emulator : Pull Sushy Emulator container image -------------------- 9.85s 2026-02-26 12:42:35.972460 | controller | libvirt_manager : Install packages required for using KVM --------------- 8.01s 2026-02-26 12:42:35.972465 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.73s 2026-02-26 12:42:35.972470 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 7.25s 2026-02-26 12:42:35.972475 | controller | ci_setup : Install openshift client ------------------------------------- 6.35s 2026-02-26 12:42:35.972479 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.17s 2026-02-26 12:42:35.972484 | controller | ci_nmstate : Install required packages on localhost --------------------- 4.84s 2026-02-26 12:42:35.972489 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.62s 2026-02-26 12:42:35.972494 | controller | networking_mapper : Gather the facts ------------------------------------ 3.58s 2026-02-26 12:42:35.972499 | controller | dnsmasq : Add/Remove address -------------------------------------------- 2.98s 2026-02-26 12:42:35.972504 | controller | ci_setup : Manage directories ------------------------------------------- 2.80s 2026-02-26 12:42:35.972509 | controller | sushy_emulator : Install required packages ------------------------------ 2.57s 2026-02-26 12:42:35.972514 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.52s 2026-02-26 12:42:35.972518 | controller | reproducer : Restart NetworkManager ------------------------------------- 2.33s 2026-02-26 12:42:35.972523 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.14s 2026-02-26 12:42:35.972541 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2026-02-26 12:42:35.973000 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2026-02-26 12:42:35.985735 | controller | INFO Running crc_layout > cleanup 2026-02-26 12:42:35.986393 | controller | WARNING Skipping, cleanup playbook not configured. 2026-02-26 12:42:35.994059 | controller | INFO Running crc_layout > destroy 2026-02-26 12:42:35.994403 | controller | WARNING Skipping, instances are delegated. 2026-02-26 12:42:35.994717 | controller | INFO Pruning extra files from scenario ephemeral directory 2026-02-26 12:42:35.996237 | controller | INFO Writing /tmp/report.html report. 2026-02-26 12:42:36.504597 | [controller] Waiting on logger 2026-02-26 12:42:41.660071 | [controller] Waiting on logger 2026-02-26 12:42:52.091825 | [controller] Waiting on logger 2026-02-26 12:43:02.524057 | [controller] Waiting on logger 2026-02-26 12:43:06.116510 | [Zuul] Log Stream did not terminate 2026-02-26 12:43:06.116793 | controller | ERROR 2026-02-26 12:43:06.116885 | controller | { 2026-02-26 12:43:06.116917 | controller | "delta": "0:08:45.893972", 2026-02-26 12:43:06.116936 | controller | "end": "2026-02-26 12:42:36.074798", 2026-02-26 12:43:06.116953 | controller | "msg": "non-zero return code", 2026-02-26 12:43:06.116969 | controller | "rc": 1, 2026-02-26 12:43:06.116984 | controller | "start": "2026-02-26 12:33:50.180826" 2026-02-26 12:43:06.116999 | controller | } failure 2026-02-26 12:43:06.167048 | 2026-02-26 12:43:06.167111 | PLAY RECAP 2026-02-26 12:43:06.167163 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2026-02-26 12:43:06.167194 | 2026-02-26 12:43:06.237553 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-26 12:43:06.238519 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-26 12:43:06.750974 | 2026-02-26 12:43:06.751067 | PLAY [Run ci/playbooks/collect-logs.yml] 2026-02-26 12:43:06.771201 | 2026-02-26 12:43:06.771274 | TASK [Filter out host if needed] 2026-02-26 12:43:06.779552 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2026-02-26 12:43:06.783892 | 2026-02-26 12:43:06.783970 | TASK [Ensure file is present] 2026-02-26 12:43:07.187819 | controller | ok 2026-02-26 12:43:07.193153 | 2026-02-26 12:43:07.193218 | TASK [Manage molecule report file] 2026-02-26 12:43:07.215829 | [controller] Waiting on logger 2026-02-26 12:43:16.576725 | [controller] Waiting on logger 2026-02-26 12:43:26.971923 | [controller] Waiting on logger 2026-02-26 12:43:37.403812 | [controller] Waiting on logger 2026-02-26 12:43:37.646419 | [Zuul] Log Stream did not terminate 2026-02-26 12:43:37.646619 | controller | changed 2026-02-26 12:43:37.651801 | 2026-02-26 12:43:37.651862 | TASK [Check if we get ci-framework-data basedir] 2026-02-26 12:43:37.955922 | controller | ok 2026-02-26 12:43:37.960834 | 2026-02-26 12:43:37.960896 | TASK [Create ci-framework-data log directory for zuul] 2026-02-26 12:43:38.376624 | controller | changed 2026-02-26 12:43:38.382044 | 2026-02-26 12:43:38.382113 | TASK [Copy ci-framework interesting files] 2026-02-26 12:43:43.403010 | controller | changed 2026-02-26 12:43:43.408153 | 2026-02-26 12:43:43.408216 | TASK [Get SELinux listing] 2026-02-26 12:43:46.747900 | [controller] Waiting on logger 2026-02-26 12:43:48.433593 | controller | changed 2026-02-26 12:43:48.439048 | 2026-02-26 12:43:48.439134 | TASK [Generate log index] 2026-02-26 12:43:49.756319 | controller | changed 2026-02-26 12:43:49.761156 | 2026-02-26 12:43:49.761246 | TASK [Get some env related data] 2026-02-26 12:43:49.781685 | [controller] Waiting on logger 2026-02-26 12:44:00.188091 | [controller] Waiting on logger 2026-02-26 12:44:09.568660 | [controller] Waiting on logger 2026-02-26 12:44:19.964049 | [controller] Waiting on logger 2026-02-26 12:44:21.120435 | [Zuul] Log Stream did not terminate 2026-02-26 12:44:21.120611 | controller | changed 2026-02-26 12:44:21.144040 | 2026-02-26 12:44:21.144106 | TASK [Generate list of logs to collect in home directory] 2026-02-26 12:44:21.496508 | controller | ok: All paths examined 2026-02-26 12:44:21.501823 | 2026-02-26 12:44:21.501890 | LOOP [Copy logs from home directory] 2026-02-26 12:44:22.209803 | controller | changed: 2026-02-26 12:44:22.210064 | controller | { 2026-02-26 12:44:22.210099 | controller | "atime": 1743544925.4788878, 2026-02-26 12:44:22.210121 | controller | "ctime": 1743545329.1409318, 2026-02-26 12:44:22.210138 | controller | "dev": 64513, 2026-02-26 12:44:22.210154 | controller | "gid": 1000, 2026-02-26 12:44:22.210168 | controller | "gr_name": "zuul", 2026-02-26 12:44:22.210182 | controller | "inode": 4518807, 2026-02-26 12:44:22.210198 | controller | "isblk": false, 2026-02-26 12:44:22.210214 | controller | "ischr": false, 2026-02-26 12:44:22.210229 | controller | "isdir": false, 2026-02-26 12:44:22.210243 | controller | "isfifo": false, 2026-02-26 12:44:22.210260 | controller | "isgid": false, 2026-02-26 12:44:22.210275 | controller | "islnk": false, 2026-02-26 12:44:22.210289 | controller | "isreg": true, 2026-02-26 12:44:22.210337 | controller | "issock": false, 2026-02-26 12:44:22.210356 | controller | "isuid": false, 2026-02-26 12:44:22.210373 | controller | "mode": "0644", 2026-02-26 12:44:22.210388 | controller | "mtime": 1743545329.1409318, 2026-02-26 12:44:22.210402 | controller | "nlink": 1, 2026-02-26 12:44:22.210418 | controller | "path": "/home/zuul/crc-setup.log", 2026-02-26 12:44:22.210433 | controller | "pw_name": "zuul", 2026-02-26 12:44:22.210447 | controller | "rgrp": true, 2026-02-26 12:44:22.210461 | controller | "roth": true, 2026-02-26 12:44:22.210475 | controller | "rusr": true, 2026-02-26 12:44:22.210488 | controller | "size": 4108, 2026-02-26 12:44:22.210501 | controller | "uid": 1000, 2026-02-26 12:44:22.210514 | controller | "wgrp": false, 2026-02-26 12:44:22.210528 | controller | "woth": false, 2026-02-26 12:44:22.210541 | controller | "wusr": true, 2026-02-26 12:44:22.210555 | controller | "xgrp": false, 2026-02-26 12:44:22.210568 | controller | "xoth": false, 2026-02-26 12:44:22.210581 | controller | "xusr": false 2026-02-26 12:44:22.210594 | controller | } 2026-02-26 12:44:22.858257 | controller | changed: 2026-02-26 12:44:22.858429 | controller | { 2026-02-26 12:44:22.858464 | controller | "atime": 1743545331.0429637, 2026-02-26 12:44:22.858486 | controller | "ctime": 1743545842.0111232, 2026-02-26 12:44:22.858503 | controller | "dev": 64513, 2026-02-26 12:44:22.858519 | controller | "gid": 1000, 2026-02-26 12:44:22.858535 | controller | "gr_name": "zuul", 2026-02-26 12:44:22.858550 | controller | "inode": 4194437, 2026-02-26 12:44:22.858565 | controller | "isblk": false, 2026-02-26 12:44:22.858579 | controller | "ischr": false, 2026-02-26 12:44:22.858595 | controller | "isdir": false, 2026-02-26 12:44:22.858615 | controller | "isfifo": false, 2026-02-26 12:44:22.858629 | controller | "isgid": false, 2026-02-26 12:44:22.858644 | controller | "islnk": false, 2026-02-26 12:44:22.858659 | controller | "isreg": true, 2026-02-26 12:44:22.858673 | controller | "issock": false, 2026-02-26 12:44:22.858687 | controller | "isuid": false, 2026-02-26 12:44:22.858711 | controller | "mode": "0644", 2026-02-26 12:44:22.858725 | controller | "mtime": 1743545842.0111232, 2026-02-26 12:44:22.858738 | controller | "nlink": 1, 2026-02-26 12:44:22.858751 | controller | "path": "/home/zuul/crc-start.log", 2026-02-26 12:44:22.858765 | controller | "pw_name": "zuul", 2026-02-26 12:44:22.858778 | controller | "rgrp": true, 2026-02-26 12:44:22.858791 | controller | "roth": true, 2026-02-26 12:44:22.858804 | controller | "rusr": true, 2026-02-26 12:44:22.858818 | controller | "size": 4023, 2026-02-26 12:44:22.858831 | controller | "uid": 1000, 2026-02-26 12:44:22.858844 | controller | "wgrp": false, 2026-02-26 12:44:22.858857 | controller | "woth": false, 2026-02-26 12:44:22.858870 | controller | "wusr": true, 2026-02-26 12:44:22.858883 | controller | "xgrp": false, 2026-02-26 12:44:22.858896 | controller | "xoth": false, 2026-02-26 12:44:22.858909 | controller | "xusr": false 2026-02-26 12:44:22.858922 | controller | } 2026-02-26 12:44:23.531508 | controller | changed: 2026-02-26 12:44:23.531595 | controller | { 2026-02-26 12:44:23.531621 | controller | "atime": 1772109212.297188, 2026-02-26 12:44:23.531642 | controller | "ctime": 1772109227.8532345, 2026-02-26 12:44:23.531659 | controller | "dev": 64513, 2026-02-26 12:44:23.531676 | controller | "gid": 1000, 2026-02-26 12:44:23.531703 | controller | "gr_name": "zuul", 2026-02-26 12:44:23.531721 | controller | "inode": 4685793, 2026-02-26 12:44:23.531736 | controller | "isblk": false, 2026-02-26 12:44:23.531750 | controller | "ischr": false, 2026-02-26 12:44:23.531765 | controller | "isdir": false, 2026-02-26 12:44:23.531779 | controller | "isfifo": false, 2026-02-26 12:44:23.531793 | controller | "isgid": false, 2026-02-26 12:44:23.531807 | controller | "islnk": false, 2026-02-26 12:44:23.531821 | controller | "isreg": true, 2026-02-26 12:44:23.531837 | controller | "issock": false, 2026-02-26 12:44:23.531852 | controller | "isuid": false, 2026-02-26 12:44:23.531865 | controller | "mode": "0644", 2026-02-26 12:44:23.531878 | controller | "mtime": 1772109227.8532345, 2026-02-26 12:44:23.531892 | controller | "nlink": 1, 2026-02-26 12:44:23.531905 | controller | "path": "/home/zuul/ansible.log", 2026-02-26 12:44:23.531918 | controller | "pw_name": "zuul", 2026-02-26 12:44:23.531931 | controller | "rgrp": true, 2026-02-26 12:44:23.531943 | controller | "roth": true, 2026-02-26 12:44:23.531956 | controller | "rusr": true, 2026-02-26 12:44:23.531968 | controller | "size": 6749, 2026-02-26 12:44:23.531981 | controller | "uid": 1000, 2026-02-26 12:44:23.531993 | controller | "wgrp": false, 2026-02-26 12:44:23.532006 | controller | "woth": false, 2026-02-26 12:44:23.532019 | controller | "wusr": true, 2026-02-26 12:44:23.532032 | controller | "xgrp": false, 2026-02-26 12:44:23.532046 | controller | "xoth": false, 2026-02-26 12:44:23.532059 | controller | "xusr": false 2026-02-26 12:44:23.532071 | controller | } 2026-02-26 12:44:23.543827 | 2026-02-26 12:44:23.543896 | TASK [Copy crio stats log file] 2026-02-26 12:44:23.557288 | controller | skipping: Conditional result was False 2026-02-26 12:44:23.562396 | 2026-02-26 12:44:23.562462 | TASK [Get SELinux related data] 2026-02-26 12:44:26.683943 | [controller] Waiting on logger 2026-02-26 12:44:39.163920 | [controller] Waiting on logger 2026-02-26 12:44:48.544526 | [controller] Waiting on logger 2026-02-26 12:44:53.914497 | [Zuul] Log Stream did not terminate 2026-02-26 12:44:53.914740 | controller | ERROR 2026-02-26 12:44:53.914855 | controller | { 2026-02-26 12:44:53.914885 | controller | "delta": "0:00:00.010041", 2026-02-26 12:44:53.914912 | controller | "end": "2026-02-26 12:44:23.890029", 2026-02-26 12:44:53.914932 | controller | "msg": "non-zero return code", 2026-02-26 12:44:53.914948 | controller | "rc": 1, 2026-02-26 12:44:53.914962 | controller | "start": "2026-02-26 12:44:23.879988" 2026-02-26 12:44:53.914978 | controller | } 2026-02-26 12:44:53.915002 | controller | ERROR: Ignoring Errors 2026-02-26 12:44:53.920329 | 2026-02-26 12:44:53.920392 | TASK [Create system configuration directory] 2026-02-26 12:44:54.181134 | controller | changed 2026-02-26 12:44:54.186202 | 2026-02-26 12:44:54.186269 | TASK [Get some of the system configurations] 2026-02-26 12:44:54.208051 | [controller] Waiting on logger 2026-02-26 12:45:03.914104 | controller | changed 2026-02-26 12:45:03.919194 | 2026-02-26 12:45:03.919260 | TASK [Copy generated documentation if available] 2026-02-26 12:45:03.932870 | controller | skipping: Conditional result was False 2026-02-26 12:45:03.938001 | 2026-02-26 12:45:03.938064 | TASK [Copy generated AsciiDoc documentation if available] 2026-02-26 12:45:03.951120 | controller | skipping: Conditional result was False 2026-02-26 12:45:03.956456 | 2026-02-26 12:45:03.956520 | TASK [Compress logs bigger than 2MB] 2026-02-26 12:45:03.978011 | [controller] Waiting on logger 2026-02-26 12:45:06.171894 | [controller] Waiting on logger 2026-02-26 12:45:21.505225 | [controller] Waiting on logger 2026-02-26 12:45:27.931857 | [controller] Waiting on logger 2026-02-26 12:45:34.238616 | [Zuul] Log Stream did not terminate 2026-02-26 12:45:34.238867 | controller | changed 2026-02-26 12:45:34.244330 | 2026-02-26 12:45:34.244396 | TASK [Copy files from workspace on node] 2026-02-26 12:45:34.262092 | controller | ok 2026-02-26 12:45:34.283427 | 2026-02-26 12:45:34.283499 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-26 12:45:34.296723 | controller | skipping: Conditional result was False 2026-02-26 12:45:34.302194 | 2026-02-26 12:45:34.302264 | TASK [fetch-output : Set log path for single node] 2026-02-26 12:45:34.330078 | controller | ok 2026-02-26 12:45:34.334897 | 2026-02-26 12:45:34.334962 | LOOP [fetch-output : Ensure local output dirs] 2026-02-26 12:45:34.524966 | controller -> localhost | ok: "/var/lib/zuul/builds/5426286bcef34762bdc458d2eab94a52/work/logs" 2026-02-26 12:45:34.525359 | controller -> localhost | changed: All items complete 2026-02-26 12:45:34.525411 | 2026-02-26 12:45:34.699937 | controller -> localhost | changed: "/var/lib/zuul/builds/5426286bcef34762bdc458d2eab94a52/work/artifacts" 2026-02-26 12:45:34.873314 | controller -> localhost | changed: "/var/lib/zuul/builds/5426286bcef34762bdc458d2eab94a52/work/docs" 2026-02-26 12:45:34.881861 | 2026-02-26 12:45:34.881939 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-26 12:45:35.541500 | controller | changed: 2026-02-26 12:45:35.541695 | controller | .d..t...... ./ 2026-02-26 12:45:35.541729 | controller | >f+++++++++ README.html 2026-02-26 12:45:35.541751 | controller | >f+++++++++ ansible-execution.log 2026-02-26 12:45:35.541788 | controller | >f+++++++++ ansible.log 2026-02-26 12:45:35.541812 | controller | >f+++++++++ crc-setup.log 2026-02-26 12:45:35.541831 | controller | >f+++++++++ crc-start.log 2026-02-26 12:45:35.541849 | controller | >f+++++++++ dmesg.log 2026-02-26 12:45:35.541866 | controller | >f+++++++++ installed-pkgs.log 2026-02-26 12:45:35.541882 | controller | >f+++++++++ python.log 2026-02-26 12:45:35.541899 | controller | >f+++++++++ registries.conf 2026-02-26 12:45:35.541915 | controller | >f+++++++++ report.html 2026-02-26 12:45:35.541930 | controller | >f+++++++++ selinux-denials.log 2026-02-26 12:45:35.541946 | controller | >f+++++++++ selinux-listing.log 2026-02-26 12:45:35.541962 | controller | cd+++++++++ ci-framework-data/ 2026-02-26 12:45:35.541977 | controller | cd+++++++++ ci-framework-data/artifacts/ 2026-02-26 12:45:35.541992 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2026-02-26 12:45:35.542008 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2026-02-26 12:45:35.542028 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2026-02-26 12:45:35.542045 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2026-02-26 12:45:35.542062 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2026-02-26 12:45:35.542078 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2026-02-26 12:45:35.542093 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2026-02-26 12:45:35.542108 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2026-02-26 12:45:35.542124 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2026-02-26 12:45:35.542139 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2026-02-26 12:45:35.542154 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2026-02-26 12:45:35.542169 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2026-02-26 12:45:35.542186 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2026-02-26 12:45:35.542201 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:2f:b5:d8 2026-02-26 12:45:35.542217 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:11:d7:0b 2026-02-26 12:45:35.542233 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:32:7e:45 2026-02-26 12:45:35.542247 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:bd:e0:d3 2026-02-26 12:45:35.542262 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:d2:91:6a 2026-02-26 12:45:35.542276 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:7b:f7:5f 2026-02-26 12:45:35.542291 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2026-02-26 12:45:35.542331 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2026-02-26 12:45:35.542351 | controller | cd+++++++++ ci-framework-data/logs/ 2026-02-26 12:45:35.542368 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2026-02-26 12:45:35.542384 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2026-02-26 12:45:35.542399 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2026-02-26 12:45:35.542415 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2026-02-26 12:45:35.542430 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2026-02-26 12:45:35.542445 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2026-02-26 12:45:35.542460 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2026-02-26 12:45:35.542474 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2026-02-26 12:45:35.542489 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2026-02-26 12:45:35.542503 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2026-02-26 12:45:35.542518 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2026-02-26 12:45:35.542532 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2026-02-26 12:45:35.542547 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2026-02-26 12:45:35.542564 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2026-02-26 12:45:35.542582 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2026-02-26 12:45:35.542602 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2026-02-26 12:45:35.542619 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2026-02-26 12:45:35.542636 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2026-02-26 12:45:35.542653 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2026-02-26 12:45:35.542670 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2026-02-26 12:45:35.542686 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2026-02-26 12:45:35.542701 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2026-02-26 12:45:35.542717 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2026-02-26 12:45:35.542732 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2026-02-26 12:45:35.542747 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2026-02-26 12:45:35.542761 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2026-02-26 12:45:35.542788 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2026-02-26 12:45:35.542805 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2026-02-26 12:45:35.542821 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2026-02-26 12:45:35.542836 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2026-02-26 12:45:35.542851 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2026-02-26 12:45:35.542866 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2026-02-26 12:45:35.542881 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2026-02-26 12:45:35.542896 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2026-02-26 12:45:35.542910 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2026-02-26 12:45:35.542925 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2026-02-26 12:45:35.542941 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2026-02-26 12:45:35.542958 | controller | cd+++++++++ registries.conf.d/ 2026-02-26 12:45:35.542974 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2026-02-26 12:45:35.542990 | controller | cd+++++++++ system-config/ 2026-02-26 12:45:35.543006 | controller | cd+++++++++ system-config/libvirt/ 2026-02-26 12:45:35.543021 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2026-02-26 12:45:35.543037 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2026-02-26 12:45:35.543052 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2026-02-26 12:45:35.543067 | controller | >f+++++++++ system-config/libvirt/network.conf 2026-02-26 12:45:35.543082 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2026-02-26 12:45:35.543097 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2026-02-26 12:45:35.543111 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2026-02-26 12:45:35.543126 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2026-02-26 12:45:35.543143 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2026-02-26 12:45:35.543159 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2026-02-26 12:45:35.543173 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2026-02-26 12:45:35.543188 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2026-02-26 12:45:35.543202 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2026-02-26 12:45:35.543216 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2026-02-26 12:45:35.543231 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2026-02-26 12:45:35.543245 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2026-02-26 12:45:36.018462 | controller | changed: .d..t...... ./ 2026-02-26 12:45:36.501077 | controller | changed: .d..t...... ./ 2026-02-26 12:45:36.513250 | 2026-02-26 12:45:36.513369 | TASK [Return artifact to Zuul] 2026-02-26 12:45:36.541364 | controller | ok 2026-02-26 12:45:36.560508 | 2026-02-26 12:45:36.560565 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2026-02-26 12:45:36.560656 | 2026-02-26 12:45:36.560684 | PLAY RECAP 2026-02-26 12:45:36.560721 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2026-02-26 12:45:36.560743 | 2026-02-26 12:45:36.633344 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-26 12:45:36.634085 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-26 12:45:37.124413 | 2026-02-26 12:45:37.124509 | PLAY [all] 2026-02-26 12:45:37.141315 | 2026-02-26 12:45:37.141384 | TASK [include_role : fetch-output] 2026-02-26 12:45:37.170004 | controller | ok 2026-02-26 12:45:37.185720 | 2026-02-26 12:45:37.185807 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-26 12:45:37.219770 | controller | skipping: Conditional result was False 2026-02-26 12:45:37.225015 | 2026-02-26 12:45:37.225085 | TASK [fetch-output : Set log path for single node] 2026-02-26 12:45:37.253225 | controller | ok 2026-02-26 12:45:37.257913 | 2026-02-26 12:45:37.257985 | LOOP [fetch-output : Ensure local output dirs] 2026-02-26 12:45:37.573440 | controller -> localhost | ok: "/var/lib/zuul/builds/5426286bcef34762bdc458d2eab94a52/work/logs" 2026-02-26 12:45:37.752945 | controller -> localhost | ok: "/var/lib/zuul/builds/5426286bcef34762bdc458d2eab94a52/work/artifacts" 2026-02-26 12:45:37.931436 | controller -> localhost | ok: "/var/lib/zuul/builds/5426286bcef34762bdc458d2eab94a52/work/docs" 2026-02-26 12:45:37.949370 | 2026-02-26 12:45:37.949474 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-26 12:45:38.548525 | controller | ok 2026-02-26 12:45:38.548716 | controller | ok: All items complete 2026-02-26 12:45:38.548747 | 2026-02-26 12:45:39.005158 | controller | ok 2026-02-26 12:45:39.464221 | controller | ok 2026-02-26 12:45:39.480744 | 2026-02-26 12:45:39.480869 | TASK [include_role : fetch-output-openshift] 2026-02-26 12:45:39.494756 | controller | skipping: Conditional result was False 2026-02-26 12:45:39.500330 | 2026-02-26 12:45:39.500408 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-02-26 12:45:39.837064 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006202 2026-02-26 12:45:40.028796 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.007302 2026-02-26 12:45:40.054166 | 2026-02-26 12:45:40.054255 | PLAY [all] 2026-02-26 12:45:40.067971 | 2026-02-26 12:45:40.068039 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-02-26 12:45:40.543509 | controller | changed 2026-02-26 12:45:40.564831 | 2026-02-26 12:45:40.564901 | PLAY RECAP 2026-02-26 12:45:40.564946 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-02-26 12:45:40.564968 | 2026-02-26 12:45:40.630111 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-26 12:45:40.630850 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2026-02-26 12:45:41.172413 | 2026-02-26 12:45:41.172525 | PLAY [localhost] 2026-02-26 12:45:41.189754 | 2026-02-26 12:45:41.189842 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-02-26 12:45:41.480395 | localhost | changed 2026-02-26 12:45:41.484684 | 2026-02-26 12:45:41.484762 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-02-26 12:45:41.502478 | localhost | ok 2026-02-26 12:45:41.510108 | 2026-02-26 12:45:41.510176 | TASK [add-fileserver : Create SSH private key tempfile] 2026-02-26 12:45:41.800915 | localhost | changed 2026-02-26 12:45:41.806743 | 2026-02-26 12:45:41.806829 | TASK [add-fileserver : Create SSH private key from secret] 2026-02-26 12:45:42.339599 | localhost | changed 2026-02-26 12:45:42.344435 | 2026-02-26 12:45:42.344507 | TASK [add-fileserver : Add fileserver ssh key] 2026-02-26 12:45:42.666367 | localhost | Identity added: /var/lib/zuul/builds/5426286bcef34762bdc458d2eab94a52/work/tmp/ansible.rupszdfg (/var/lib/zuul/builds/5426286bcef34762bdc458d2eab94a52/work/tmp/ansible.rupszdfg) 2026-02-26 12:45:42.666529 | localhost | ok: Runtime: 0:00:00.006122 2026-02-26 12:45:42.670768 | 2026-02-26 12:45:42.670847 | TASK [add-fileserver : Remove SSH private key from disk] 2026-02-26 12:45:42.890322 | localhost | ok: Runtime: 0:00:00.004291 2026-02-26 12:45:42.894799 | 2026-02-26 12:45:42.894865 | TASK [add-fileserver : Add fileserver to inventory] 2026-02-26 12:45:42.942411 | localhost | changed 2026-02-26 12:45:42.947348 | 2026-02-26 12:45:42.947416 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-02-26 12:45:43.247707 | localhost | changed 2026-02-26 12:45:43.267480 | 2026-02-26 12:45:43.267547 | PLAY [localhost] 2026-02-26 12:45:43.278868 | 2026-02-26 12:45:43.278930 | TASK [Generate bulk log download script] 2026-02-26 12:45:43.297097 | localhost | ok 2026-02-26 12:45:43.308234 | 2026-02-26 12:45:43.308316 | TASK [local-log-download : Check API endpoint is defined] 2026-02-26 12:45:43.335981 | localhost | ok: All assertions passed 2026-02-26 12:45:43.340225 | 2026-02-26 12:45:43.340285 | TASK [local-log-download : Create download script] 2026-02-26 12:45:43.677373 | localhost -> localhost | changed 2026-02-26 12:45:43.685745 | 2026-02-26 12:45:43.685823 | TASK [Register quick-download link] 2026-02-26 12:45:43.702580 | localhost | ok 2026-02-26 12:45:43.736697 | 2026-02-26 12:45:43.736765 | PLAY [logserver.rdoproject.org] 2026-02-26 12:45:43.745838 | 2026-02-26 12:45:43.745894 | TASK [Set zuul-log-path fact] 2026-02-26 12:45:43.761412 | logserver.rdoproject.org | ok 2026-02-26 12:45:43.769914 | 2026-02-26 12:45:43.769977 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-26 12:45:43.795839 | logserver.rdoproject.org | ok 2026-02-26 12:45:43.801180 | 2026-02-26 12:45:43.801240 | TASK [upload-logs : Create log directories] 2026-02-26 12:45:45.870596 | logserver.rdoproject.org | changed 2026-02-26 12:45:45.873738 | 2026-02-26 12:45:45.873814 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-02-26 12:45:46.089963 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005049 2026-02-26 12:45:46.094723 | 2026-02-26 12:45:46.094814 | TASK [upload-logs : Upload logs to log server] 2026-02-26 12:45:47.582834 | logserver.rdoproject.org | Output suppressed because no_log was given 2026-02-26 12:45:47.585596 | 2026-02-26 12:45:47.585662 | LOOP [upload-logs : Compress console log and json output] 2026-02-26 12:45:47.622094 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-26 12:45:47.630245 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-26 12:45:47.643008 | 2026-02-26 12:45:47.643075 | LOOP [upload-logs : Upload compressed console log and json output] 2026-02-26 12:45:47.676828 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-26 12:45:47.677039 | 2026-02-26 12:45:47.680365 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-26 12:45:47.691253 | 2026-02-26 12:45:47.691382 | LOOP [upload-logs : Upload console log and json output]