2026-02-24 21:51:26.177861 | Job console starting... 2026-02-24 21:51:26.394193 | Updating repositories 2026-02-24 21:51:27.152187 | Preparing job workspace 2026-02-24 21:51:34.765536 | Running Ansible setup... 2026-02-24 21:51:38.256894 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-24 21:51:38.722727 | 2026-02-24 21:51:38.722820 | PLAY [localhost] 2026-02-24 21:51:38.730649 | 2026-02-24 21:51:38.730715 | TASK [Gathering Facts] 2026-02-24 21:51:39.463034 | localhost | ok 2026-02-24 21:51:39.475151 | 2026-02-24 21:51:39.475230 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-02-24 21:51:39.761281 | localhost -> localhost | changed 2026-02-24 21:51:39.766188 | 2026-02-24 21:51:39.766259 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-02-24 21:51:40.395975 | localhost -> localhost | changed 2026-02-24 21:51:40.403606 | 2026-02-24 21:51:40.403688 | TASK [Setup log path fact] 2026-02-24 21:51:40.419673 | localhost | ok 2026-02-24 21:51:40.429824 | 2026-02-24 21:51:40.429888 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-24 21:51:40.445874 | localhost | ok 2026-02-24 21:51:40.452891 | 2026-02-24 21:51:40.452959 | TASK [emit-job-header : Print job information] 2026-02-24 21:51:40.478676 | # Job Information 2026-02-24 21:51:40.478787 | Ansible Version: 2.15.12 2026-02-24 21:51:40.478815 | Job: cifmw-molecule-reproducer 2026-02-24 21:51:40.478837 | Pipeline: github-check 2026-02-24 21:51:40.478857 | Executor: ibm-bm4-ze.softwarefactory-project.io 2026-02-24 21:51:40.478875 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3711 2026-02-24 21:51:40.478894 | Log URL (when completed): https://logserver.rdoproject.org/32f/rdoproject.org/32f5a9506601437c8d9723a1fdd3db21/ 2026-02-24 21:51:40.478913 | Event ID: d6a5c490-11ca-11f1-8934-e160ceabf549 2026-02-24 21:51:40.482349 | 2026-02-24 21:51:40.482419 | LOOP [emit-job-header : Print node information] 2026-02-24 21:51:40.558078 | localhost | ok: 2026-02-24 21:51:40.558227 | localhost | # Node Information 2026-02-24 21:51:40.558253 | localhost | Inventory Hostname: controller 2026-02-24 21:51:40.558276 | localhost | Hostname: np0005628684 2026-02-24 21:51:40.558317 | localhost | Username: zuul 2026-02-24 21:51:40.558348 | localhost | Distro: CentOS 9 2026-02-24 21:51:40.558367 | localhost | Provider: ibm-bm4-nodepool 2026-02-24 21:51:40.558383 | localhost | Region: regionOne 2026-02-24 21:51:40.558399 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2026-02-24 21:51:40.558413 | localhost | Product Name: OpenStack Compute 2026-02-24 21:51:40.558429 | localhost | Interface IP: 192.168.26.246 2026-02-24 21:51:40.582940 | 2026-02-24 21:51:40.583022 | PLAY [all] 2026-02-24 21:51:40.588877 | 2026-02-24 21:51:40.588941 | TASK [Gather network facts] 2026-02-24 21:51:41.033272 | controller | ok 2026-02-24 21:51:41.046744 | 2026-02-24 21:51:41.046806 | TASK [include_role : start-zuul-console] 2026-02-24 21:51:41.064440 | controller | ok 2026-02-24 21:51:41.074819 | 2026-02-24 21:51:41.074878 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-02-24 21:51:41.437155 | controller | ok 2026-02-24 21:51:41.444683 | 2026-02-24 21:51:41.444741 | TASK [include_role : add-build-sshkey] 2026-02-24 21:51:41.461501 | controller | ok 2026-02-24 21:51:41.472551 | 2026-02-24 21:51:41.472610 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-02-24 21:51:41.647043 | controller -> localhost | ok 2026-02-24 21:51:41.651666 | 2026-02-24 21:51:41.651724 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-02-24 21:51:41.669259 | controller | ok 2026-02-24 21:51:41.680058 | controller | included: /var/lib/zuul/builds/32f5a9506601437c8d9723a1fdd3db21/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-24 21:51:41.685065 | 2026-02-24 21:51:41.685122 | TASK [add-build-sshkey : Create Temp SSH key] 2026-02-24 21:51:42.173168 | controller -> localhost | Generating public/private rsa key pair. 2026-02-24 21:51:42.173335 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/32f5a9506601437c8d9723a1fdd3db21/work/32f5a9506601437c8d9723a1fdd3db21_id_rsa. 2026-02-24 21:51:42.173370 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/32f5a9506601437c8d9723a1fdd3db21/work/32f5a9506601437c8d9723a1fdd3db21_id_rsa.pub. 2026-02-24 21:51:42.173393 | controller -> localhost | The key fingerprint is: 2026-02-24 21:51:42.173412 | controller -> localhost | SHA256:bmySBXvlXR+Qe3SCJvwvQXlfajlTl/besq3fcAmHCcY zuul-build-sshkey 2026-02-24 21:51:42.173430 | controller -> localhost | The key's randomart image is: 2026-02-24 21:51:42.173446 | controller -> localhost | +---[RSA 3072]----+ 2026-02-24 21:51:42.173462 | controller -> localhost | | . +. .| 2026-02-24 21:51:42.173477 | controller -> localhost | | + =.++=| 2026-02-24 21:51:42.173502 | controller -> localhost | | . .E .=B=| 2026-02-24 21:51:42.173520 | controller -> localhost | | o o..+oOo+| 2026-02-24 21:51:42.173535 | controller -> localhost | | . S . .B.=o| 2026-02-24 21:51:42.173551 | controller -> localhost | | * . = +| 2026-02-24 21:51:42.173566 | controller -> localhost | | o = ..=.| 2026-02-24 21:51:42.173584 | controller -> localhost | | + .oo| 2026-02-24 21:51:42.173599 | controller -> localhost | | .oo| 2026-02-24 21:51:42.173614 | controller -> localhost | +----[SHA256]-----+ 2026-02-24 21:51:42.173649 | controller -> localhost | ok: Runtime: 0:00:00.186984 2026-02-24 21:51:42.178574 | 2026-02-24 21:51:42.178633 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-02-24 21:51:42.195411 | controller | ok 2026-02-24 21:51:42.203555 | controller | included: /var/lib/zuul/builds/32f5a9506601437c8d9723a1fdd3db21/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-24 21:51:42.210420 | 2026-02-24 21:51:42.210479 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-02-24 21:51:42.223241 | controller | skipping: Conditional result was False 2026-02-24 21:51:42.227861 | 2026-02-24 21:51:42.227922 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-02-24 21:51:42.671443 | controller | changed 2026-02-24 21:51:42.675835 | 2026-02-24 21:51:42.675892 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-02-24 21:51:42.946906 | controller | ok 2026-02-24 21:51:42.951317 | 2026-02-24 21:51:42.951382 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-02-24 21:51:44.135781 | controller | changed 2026-02-24 21:51:44.140163 | 2026-02-24 21:51:44.140221 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-02-24 21:51:45.295699 | controller | changed 2026-02-24 21:51:45.299939 | 2026-02-24 21:51:45.299997 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-02-24 21:51:45.312468 | controller | skipping: Conditional result was False 2026-02-24 21:51:45.317270 | 2026-02-24 21:51:45.317345 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-02-24 21:51:45.583098 | controller -> localhost | changed 2026-02-24 21:51:45.591843 | 2026-02-24 21:51:45.591906 | TASK [add-build-sshkey : Add back temp key] 2026-02-24 21:51:45.797349 | controller -> localhost | Identity added: /var/lib/zuul/builds/32f5a9506601437c8d9723a1fdd3db21/work/32f5a9506601437c8d9723a1fdd3db21_id_rsa (zuul-build-sshkey) 2026-02-24 21:51:45.797542 | controller -> localhost | ok: Runtime: 0:00:00.005809 2026-02-24 21:51:45.802746 | 2026-02-24 21:51:45.802809 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-02-24 21:51:46.155826 | controller | ok 2026-02-24 21:51:46.160042 | 2026-02-24 21:51:46.160106 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-02-24 21:51:46.183992 | controller | skipping: Conditional result was False 2026-02-24 21:51:46.192366 | 2026-02-24 21:51:46.192423 | TASK [include_role : validate-host] 2026-02-24 21:51:46.209628 | controller | ok 2026-02-24 21:51:46.226770 | 2026-02-24 21:51:46.226829 | TASK [validate-host : Define zuul_info_dir fact] 2026-02-24 21:51:46.244630 | controller | ok 2026-02-24 21:51:46.248596 | 2026-02-24 21:51:46.248654 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-02-24 21:51:46.433416 | controller -> localhost | ok 2026-02-24 21:51:46.438291 | 2026-02-24 21:51:46.438365 | TASK [validate-host : Collect information about the host] 2026-02-24 21:51:47.180958 | controller | ok 2026-02-24 21:51:47.187938 | 2026-02-24 21:51:47.187994 | TASK [validate-host : Sanitize hostname] 2026-02-24 21:51:47.225691 | controller | ok 2026-02-24 21:51:47.229919 | 2026-02-24 21:51:47.229980 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-02-24 21:51:47.588732 | controller -> localhost | changed 2026-02-24 21:51:47.594032 | 2026-02-24 21:51:47.594093 | TASK [validate-host : Collect information about zuul worker] 2026-02-24 21:51:47.987691 | controller | ok 2026-02-24 21:51:47.992128 | 2026-02-24 21:51:47.992198 | TASK [validate-host : Write out all zuul information for each host] 2026-02-24 21:51:48.329762 | controller -> localhost | changed 2026-02-24 21:51:48.338623 | 2026-02-24 21:51:48.338690 | TASK [include_role : prepare-workspace-openshift] 2026-02-24 21:51:48.351622 | controller | skipping: Conditional result was False 2026-02-24 21:51:48.355971 | 2026-02-24 21:51:48.356039 | TASK [include_role : remove-zuul-sshkey] 2026-02-24 21:51:48.368909 | controller | skipping: Conditional result was False 2026-02-24 21:51:48.373842 | 2026-02-24 21:51:48.373905 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-02-24 21:51:48.648563 | controller | ok: "logs" 2026-02-24 21:51:48.648773 | controller | ok: All items complete 2026-02-24 21:51:48.648801 | 2026-02-24 21:51:48.892514 | controller | ok: "artifacts" 2026-02-24 21:51:49.127574 | controller | ok: "docs" 2026-02-24 21:51:49.140944 | 2026-02-24 21:51:49.141056 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-02-24 21:51:49.414457 | controller | changed: "logs" 2026-02-24 21:51:49.667480 | controller | changed: "artifacts" 2026-02-24 21:51:49.929816 | controller | changed: "docs" 2026-02-24 21:51:49.956600 | 2026-02-24 21:51:49.956670 | PLAY RECAP 2026-02-24 21:51:49.956710 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-24 21:51:49.956737 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-24 21:51:49.956755 | 2026-02-24 21:51:50.025576 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-24 21:51:50.026184 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-24 21:51:50.514628 | 2026-02-24 21:51:50.514767 | PLAY [all] 2026-02-24 21:51:50.532128 | 2026-02-24 21:51:50.532199 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-24 21:51:50.580559 | controller | ok 2026-02-24 21:51:50.584975 | 2026-02-24 21:51:50.585050 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-24 21:51:50.990357 | controller | changed 2026-02-24 21:51:50.995118 | 2026-02-24 21:51:50.995183 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-24 21:51:52.313136 | controller | changed 2026-02-24 21:51:52.322159 | 2026-02-24 21:51:52.322221 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2026-02-24 21:51:52.760067 | controller | changed: 2026-02-24 21:51:52.760215 | controller | { 2026-02-24 21:51:52.760247 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2026-02-24 21:51:52.760277 | controller | } 2026-02-24 21:51:53.067093 | controller | changed: 2026-02-24 21:51:53.067210 | controller | { 2026-02-24 21:51:53.067244 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2026-02-24 21:51:53.067267 | controller | } 2026-02-24 21:51:53.390059 | controller | changed: 2026-02-24 21:51:53.390107 | controller | { 2026-02-24 21:51:53.390130 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2026-02-24 21:51:53.390150 | controller | } 2026-02-24 21:51:53.702119 | controller | changed: 2026-02-24 21:51:53.702171 | controller | { 2026-02-24 21:51:53.702197 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2026-02-24 21:51:53.702216 | controller | } 2026-02-24 21:51:54.008033 | controller | changed: 2026-02-24 21:51:54.008086 | controller | { 2026-02-24 21:51:54.008112 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2026-02-24 21:51:54.008132 | controller | } 2026-02-24 21:51:54.302198 | controller | changed: 2026-02-24 21:51:54.302245 | controller | { 2026-02-24 21:51:54.302273 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2026-02-24 21:51:54.302293 | controller | } 2026-02-24 21:51:54.598234 | controller | changed: 2026-02-24 21:51:54.598280 | controller | { 2026-02-24 21:51:54.598325 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2026-02-24 21:51:54.598348 | controller | } 2026-02-24 21:51:54.895829 | controller | changed: 2026-02-24 21:51:54.895880 | controller | { 2026-02-24 21:51:54.895904 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2026-02-24 21:51:54.895923 | controller | } 2026-02-24 21:51:55.195872 | controller | changed: 2026-02-24 21:51:55.195926 | controller | { 2026-02-24 21:51:55.195950 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2026-02-24 21:51:55.195968 | controller | } 2026-02-24 21:51:55.491078 | controller | changed: 2026-02-24 21:51:55.491141 | controller | { 2026-02-24 21:51:55.491167 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2026-02-24 21:51:55.491185 | controller | } 2026-02-24 21:51:55.793346 | controller | changed: 2026-02-24 21:51:55.793394 | controller | { 2026-02-24 21:51:55.793417 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2026-02-24 21:51:55.793436 | controller | } 2026-02-24 21:51:56.095355 | controller | changed: 2026-02-24 21:51:56.095404 | controller | { 2026-02-24 21:51:56.095428 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2026-02-24 21:51:56.095447 | controller | } 2026-02-24 21:51:56.397841 | controller | changed: 2026-02-24 21:51:56.397939 | controller | { 2026-02-24 21:51:56.397967 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com" 2026-02-24 21:51:56.397987 | controller | } 2026-02-24 21:51:56.703248 | controller | changed: 2026-02-24 21:51:56.703341 | controller | { 2026-02-24 21:51:56.703368 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2026-02-24 21:51:56.703387 | controller | } 2026-02-24 21:51:57.006470 | controller | changed: 2026-02-24 21:51:57.006533 | controller | { 2026-02-24 21:51:57.006557 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2026-02-24 21:51:57.006575 | controller | } 2026-02-24 21:51:57.304607 | controller | changed: 2026-02-24 21:51:57.304653 | controller | { 2026-02-24 21:51:57.304675 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2026-02-24 21:51:57.304693 | controller | } 2026-02-24 21:51:57.615488 | controller | changed: 2026-02-24 21:51:57.615557 | controller | { 2026-02-24 21:51:57.615584 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2026-02-24 21:51:57.615605 | controller | } 2026-02-24 21:51:57.939349 | controller | changed: 2026-02-24 21:51:57.939397 | controller | { 2026-02-24 21:51:57.939421 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2026-02-24 21:51:57.939447 | controller | } 2026-02-24 21:51:58.294404 | controller | changed: 2026-02-24 21:51:58.294452 | controller | { 2026-02-24 21:51:58.294475 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2026-02-24 21:51:58.294502 | controller | } 2026-02-24 21:51:58.600866 | controller | changed: 2026-02-24 21:51:58.600913 | controller | { 2026-02-24 21:51:58.600937 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2026-02-24 21:51:58.600956 | controller | } 2026-02-24 21:51:58.897086 | controller | changed: 2026-02-24 21:51:58.897135 | controller | { 2026-02-24 21:51:58.897160 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2026-02-24 21:51:58.897179 | controller | } 2026-02-24 21:51:59.212044 | controller | changed: 2026-02-24 21:51:59.212097 | controller | { 2026-02-24 21:51:59.212123 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2026-02-24 21:51:59.212141 | controller | } 2026-02-24 21:51:59.527179 | controller | changed: 2026-02-24 21:51:59.527230 | controller | { 2026-02-24 21:51:59.527256 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2026-02-24 21:51:59.527278 | controller | } 2026-02-24 21:51:59.835356 | controller | changed: 2026-02-24 21:51:59.835444 | controller | { 2026-02-24 21:51:59.835471 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2026-02-24 21:51:59.835498 | controller | } 2026-02-24 21:52:00.140382 | controller | changed: 2026-02-24 21:52:00.140474 | controller | { 2026-02-24 21:52:00.140514 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2026-02-24 21:52:00.140535 | controller | } 2026-02-24 21:52:00.442291 | controller | changed: 2026-02-24 21:52:00.442395 | controller | { 2026-02-24 21:52:00.442419 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2026-02-24 21:52:00.442438 | controller | } 2026-02-24 21:52:00.459685 | 2026-02-24 21:52:00.459750 | TASK [Set timezone to UTC] 2026-02-24 21:52:00.975209 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2026-02-24 21:52:00.979458 | 2026-02-24 21:52:00.979526 | TASK [Create nodepool directory] 2026-02-24 21:52:01.272773 | controller | changed 2026-02-24 21:52:01.278092 | 2026-02-24 21:52:01.278158 | TASK [Create nodepool sub_nodes file] 2026-02-24 21:52:02.320584 | controller | changed 2026-02-24 21:52:02.325474 | 2026-02-24 21:52:02.325562 | TASK [Create nodepool sub_nodes_private file] 2026-02-24 21:52:03.369026 | controller | changed 2026-02-24 21:52:03.373751 | 2026-02-24 21:52:03.373811 | LOOP [Populate nodepool sub_nodes file] 2026-02-24 21:52:03.402070 | 2026-02-24 21:52:03.402195 | LOOP [Populate nodepool sub_nodes_private file] 2026-02-24 21:52:03.429872 | 2026-02-24 21:52:03.429984 | TASK [Create nodepool primary file] 2026-02-24 21:52:03.442758 | controller | skipping: Conditional result was False 2026-02-24 21:52:03.447594 | 2026-02-24 21:52:03.447662 | TASK [Create nodepool node_private for this node] 2026-02-24 21:52:04.554371 | controller | changed 2026-02-24 21:52:04.559411 | 2026-02-24 21:52:04.559477 | LOOP [Copy ssh keys to nodepool directory] 2026-02-24 21:52:04.938948 | controller | ok: Item: id_rsa Runtime: 0:00:00.005785 2026-02-24 21:52:04.939127 | 2026-02-24 21:52:05.187355 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.005940 2026-02-24 21:52:05.197338 | 2026-02-24 21:52:05.197446 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2026-02-24 21:52:06.280555 | controller | changed 2026-02-24 21:52:06.285251 | 2026-02-24 21:52:06.285328 | TASK [Validate sudoers config after edits] 2026-02-24 21:52:06.567931 | controller | /etc/sudoers: parsed OK 2026-02-24 21:52:06.568000 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2026-02-24 21:52:06.568011 | controller | /etc/sudoers.d/zuul: parsed OK 2026-02-24 21:52:06.568018 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2026-02-24 21:52:06.809841 | controller | ok: Runtime: 0:00:00.006545 2026-02-24 21:52:06.814568 | 2026-02-24 21:52:06.814623 | TASK [Show the environment passed in to job shell scripts] 2026-02-24 21:52:07.117211 | controller | SHELL=/bin/bash 2026-02-24 21:52:07.117280 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2026-02-24 21:52:07.117298 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2026-02-24 21:52:07.117313 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/11/3711/89255679f72d8a958cb738d10498cded3d733868 2026-02-24 21:52:07.117327 | controller | PWD=/home/zuul 2026-02-24 21:52:07.117332 | controller | ZUUL_PIPELINE=github-check 2026-02-24 21:52:07.117393 | controller | LOGNAME=zuul 2026-02-24 21:52:07.117402 | controller | XDG_SESSION_TYPE=tty 2026-02-24 21:52:07.117408 | controller | _=/usr/bin/env 2026-02-24 21:52:07.117413 | controller | MOTD_SHOWN=pam 2026-02-24 21:52:07.117417 | controller | HOME=/home/zuul 2026-02-24 21:52:07.117422 | controller | LANG=en_US.UTF-8 2026-02-24 21:52:07.117427 | controller | SSH_CONNECTION=192.168.26.12 36486 192.168.26.246 22 2026-02-24 21:52:07.117433 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2026-02-24 21:52:07.117443 | controller | ZUUL_CHANGE_IDS=3711,89255679f72d8a958cb738d10498cded3d733868 2026-02-24 21:52:07.117448 | controller | WORKSPACE=/home/zuul/workspace 2026-02-24 21:52:07.117453 | controller | XDG_SESSION_CLASS=user 2026-02-24 21:52:07.117458 | controller | SELINUX_ROLE_REQUESTED= 2026-02-24 21:52:07.117463 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2026-02-24 21:52:07.117468 | controller | USER=zuul 2026-02-24 21:52:07.117474 | controller | ZUUL_VOTING=True 2026-02-24 21:52:07.117478 | controller | BUILD_TIMEOUT=5400000 2026-02-24 21:52:07.117483 | controller | SELINUX_USE_CURRENT_RANGE= 2026-02-24 21:52:07.117488 | controller | SHLVL=1 2026-02-24 21:52:07.117493 | controller | ZUUL_PATCHSET=89255679f72d8a958cb738d10498cded3d733868 2026-02-24 21:52:07.117498 | controller | XDG_SESSION_ID=1 2026-02-24 21:52:07.117502 | controller | ZUUL_BRANCH=main 2026-02-24 21:52:07.117507 | controller | XDG_RUNTIME_DIR=/run/user/1000 2026-02-24 21:52:07.117512 | controller | SSH_CLIENT=192.168.26.12 36486 22 2026-02-24 21:52:07.117518 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2026-02-24 21:52:07.117523 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2026-02-24 21:52:07.117528 | controller | which_declare=declare -f 2026-02-24 21:52:07.117534 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2026-02-24 21:52:07.117540 | controller | SELINUX_LEVEL_REQUESTED= 2026-02-24 21:52:07.117545 | controller | ZUUL_CHANGE=3711 2026-02-24 21:52:07.117550 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2026-02-24 21:52:07.117554 | controller | ZUUL_UUID=32f5a9506601437c8d9723a1fdd3db21 2026-02-24 21:52:07.117559 | controller | BASH_FUNC_which%%=() { ( alias; 2026-02-24 21:52:07.117564 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2026-02-24 21:52:07.117570 | controller | } 2026-02-24 21:52:07.339267 | controller | ok: Runtime: 0:00:00.007705 2026-02-24 21:52:07.344117 | 2026-02-24 21:52:07.344174 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2026-02-24 21:52:07.358061 | controller | skipping: Conditional result was False 2026-02-24 21:52:07.362901 | 2026-02-24 21:52:07.362964 | TASK [Symlink /home/zuul-worker/workspace] 2026-02-24 21:52:07.903483 | controller | skipping: Conditional result was False 2026-02-24 21:52:07.908602 | 2026-02-24 21:52:07.908662 | TASK [Ensure legacy workspace directory] 2026-02-24 21:52:08.160451 | controller | changed 2026-02-24 21:52:08.177106 | 2026-02-24 21:52:08.177153 | PLAY RECAP 2026-02-24 21:52:08.177194 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-24 21:52:08.177215 | 2026-02-24 21:52:08.238806 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-24 21:52:08.239455 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-24 21:52:08.694105 | 2026-02-24 21:52:08.694195 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2026-02-24 21:52:08.712677 | 2026-02-24 21:52:08.712745 | TASK [Create zuul-output directory] 2026-02-24 21:52:09.106141 | controller | changed 2026-02-24 21:52:09.110907 | 2026-02-24 21:52:09.110983 | TASK [Slurp Zuul inventory test] 2026-02-24 21:52:09.357177 | controller -> localhost | ok 2026-02-24 21:52:09.362822 | 2026-02-24 21:52:09.362891 | TASK [Save zuul inventory] 2026-02-24 21:52:10.606098 | controller | changed 2026-02-24 21:52:10.611174 | 2026-02-24 21:52:10.611242 | TASK [Save zuul vars without the change_message] 2026-02-24 21:52:11.764662 | controller | changed 2026-02-24 21:52:11.781105 | 2026-02-24 21:52:11.781163 | PLAY RECAP 2026-02-24 21:52:11.781203 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-24 21:52:11.781225 | 2026-02-24 21:52:11.842830 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-24 21:52:11.843531 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-24 21:52:12.340652 | 2026-02-24 21:52:12.340746 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2026-02-24 21:52:12.360564 | 2026-02-24 21:52:12.360637 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2026-02-24 21:52:12.378718 | controller | ok 2026-02-24 21:52:12.394802 | 2026-02-24 21:52:12.394886 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-24 21:52:12.417865 | controller | skipping: Conditional result was False 2026-02-24 21:52:12.423483 | 2026-02-24 21:52:12.423562 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-24 21:52:12.837980 | controller | ok 2026-02-24 21:52:12.843904 | 2026-02-24 21:52:12.843974 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-24 21:52:13.823639 | controller | ok 2026-02-24 21:52:13.832767 | 2026-02-24 21:52:13.832831 | TASK [Prepare workspace] 2026-02-24 21:52:13.850432 | controller | ok 2026-02-24 21:52:13.866860 | 2026-02-24 21:52:13.866929 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-02-24 21:52:14.220655 | controller | ok 2026-02-24 21:52:14.226070 | 2026-02-24 21:52:14.226132 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-02-24 21:52:16.514011 | controller | Output suppressed because no_log was given 2026-02-24 21:52:16.522658 | 2026-02-24 21:52:16.522724 | LOOP [Create zuul-output directory] 2026-02-24 21:52:16.800576 | controller | changed: "/home/zuul/ci-framework-data/logs" 2026-02-24 21:52:17.051733 | controller | ok: "/home/zuul/zuul-output/logs" 2026-02-24 21:52:17.060636 | 2026-02-24 21:52:17.060746 | TASK [Install required packages] 2026-02-24 21:52:34.031795 | controller | ok: Nothing to do 2026-02-24 21:52:34.036206 | 2026-02-24 21:52:34.036263 | TASK [Install venv] 2026-02-24 21:53:31.131225 | controller | changed 2026-02-24 21:53:31.153847 | 2026-02-24 21:53:31.153905 | PLAY RECAP 2026-02-24 21:53:31.153946 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-24 21:53:31.153992 | 2026-02-24 21:53:31.218095 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-24 21:53:31.218943 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-24 21:53:31.690499 | 2026-02-24 21:53:31.690591 | PLAY [Run ci/playbooks/molecule-test.yml] 2026-02-24 21:53:31.709213 | 2026-02-24 21:53:31.709288 | TASK [Gather required facts] 2026-02-24 21:53:32.247474 | controller | ok 2026-02-24 21:53:32.252581 | 2026-02-24 21:53:32.252655 | TASK [Load environment var if instructed to] 2026-02-24 21:53:32.276427 | controller | skipping: Conditional result was False 2026-02-24 21:53:32.281387 | 2026-02-24 21:53:32.281448 | TASK [Ensure group_vars dir exists] 2026-02-24 21:53:32.636146 | controller | ok 2026-02-24 21:53:32.640699 | 2026-02-24 21:53:32.640759 | TASK [Print related variables] 2026-02-24 21:53:32.668836 | controller | ok: 2026-02-24 21:53:32.668942 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2026-02-24 21:53:32.668969 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2026-02-24 21:53:32.673196 | 2026-02-24 21:53:32.673254 | TASK [Run molecule] 2026-02-24 21:53:33.617123 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2026-02-24 21:53:33.878792 | controller | INFO Performing prerun with role_name_check=0... 2026-02-24 21:53:50.759181 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.759542 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.759966 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.760377 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.760774 | controller | WARNING Another version of 'cifmw.general' 1.0.0+89255679 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+89255679 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.761200 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.761595 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.761996 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.762394 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.762775 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.763188 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.763553 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.763935 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.764335 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.764717 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 21:53:50.773647 | controller | INFO Running crc_layout > prepare 2026-02-24 21:53:51.415393 | controller | 2026-02-24 21:53:51.415441 | controller | PLAY [Prepare] ***************************************************************** 2026-02-24 21:53:51.415574 | controller | 2026-02-24 21:53:51.415647 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-24 21:53:51.415743 | controller | Tuesday 24 February 2026 21:53:51 +0000 (0:00:00.019) 0:00:00.019 ****** 2026-02-24 21:53:52.242082 | controller | ok: [instance] 2026-02-24 21:53:52.242237 | controller | 2026-02-24 21:53:52.242416 | controller | TASK [Create custom basedir] *************************************************** 2026-02-24 21:53:52.242585 | controller | Tuesday 24 February 2026 21:53:52 +0000 (0:00:00.827) 0:00:00.846 ****** 2026-02-24 21:53:52.552583 | controller | changed: [instance] 2026-02-24 21:53:52.552624 | controller | 2026-02-24 21:53:52.552752 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2026-02-24 21:53:52.552880 | controller | Tuesday 24 February 2026 21:53:52 +0000 (0:00:00.310) 0:00:01.157 ****** 2026-02-24 21:53:52.570980 | controller | skipping: [instance] 2026-02-24 21:53:52.571074 | controller | 2026-02-24 21:53:52.571263 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2026-02-24 21:53:52.571357 | controller | Tuesday 24 February 2026 21:53:52 +0000 (0:00:00.018) 0:00:01.175 ****** 2026-02-24 21:53:52.613879 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2026-02-24 21:53:52.613974 | controller | 2026-02-24 21:53:52.614113 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2026-02-24 21:53:52.614234 | controller | Tuesday 24 February 2026 21:53:52 +0000 (0:00:00.042) 0:00:01.218 ****** 2026-02-24 21:53:52.896381 | controller | ok: [instance] 2026-02-24 21:53:52.896486 | controller | 2026-02-24 21:53:52.896617 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2026-02-24 21:53:52.896734 | controller | Tuesday 24 February 2026 21:53:52 +0000 (0:00:00.282) 0:00:01.500 ****** 2026-02-24 21:53:53.098772 | controller | ok: [instance] 2026-02-24 21:53:53.098962 | controller | 2026-02-24 21:53:53.099190 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2026-02-24 21:53:53.099373 | controller | Tuesday 24 February 2026 21:53:53 +0000 (0:00:00.202) 0:00:01.703 ****** 2026-02-24 21:53:53.772398 | controller | ok: [instance] => (item=ubi-9-appstream) 2026-02-24 21:53:53.772519 | controller | ok: [instance] => (item=ubi-9-baseos) 2026-02-24 21:53:53.772652 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2026-02-24 21:53:53.772770 | controller | 2026-02-24 21:53:53.772911 | controller | TASK [Deploy repo-setup] ******************************************************* 2026-02-24 21:53:53.773035 | controller | Tuesday 24 February 2026 21:53:53 +0000 (0:00:00.673) 0:00:02.376 ****** 2026-02-24 21:53:53.830489 | controller | 2026-02-24 21:53:53.830561 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-24 21:53:53.830763 | controller | Tuesday 24 February 2026 21:53:53 +0000 (0:00:00.058) 0:00:02.435 ****** 2026-02-24 21:53:54.341650 | controller | changed: [instance] => (item=tmp) 2026-02-24 21:53:54.341821 | controller | changed: [instance] => (item=artifacts/repositories) 2026-02-24 21:53:54.342010 | controller | changed: [instance] => (item=venv/repo_setup) 2026-02-24 21:53:54.342174 | controller | 2026-02-24 21:53:54.342277 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-24 21:53:54.342387 | controller | Tuesday 24 February 2026 21:53:54 +0000 (0:00:00.510) 0:00:02.945 ****** 2026-02-24 21:53:55.149628 | controller | ok: [instance] 2026-02-24 21:53:55.149684 | controller | 2026-02-24 21:53:55.149922 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-24 21:53:56.212842 | controller | Tuesday 24 February 2026 21:53:55 +0000 (0:00:00.808) 0:00:03.754 ****** 2026-02-24 21:53:56.212888 | controller | changed: [instance] 2026-02-24 21:54:03.469211 | controller | 2026-02-24 21:54:03.469256 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-24 21:54:03.469266 | controller | Tuesday 24 February 2026 21:53:56 +0000 (0:00:01.062) 0:00:04.816 ****** 2026-02-24 21:54:03.469278 | controller | changed: [instance] 2026-02-24 21:54:04.155859 | controller | 2026-02-24 21:54:04.155897 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-24 21:54:04.155905 | controller | Tuesday 24 February 2026 21:54:03 +0000 (0:00:07.256) 0:00:12.073 ****** 2026-02-24 21:54:04.155915 | controller | changed: [instance] 2026-02-24 21:54:04.178102 | controller | 2026-02-24 21:54:04.178141 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-24 21:54:04.178150 | controller | Tuesday 24 February 2026 21:54:04 +0000 (0:00:00.686) 0:00:12.759 ****** 2026-02-24 21:54:04.178160 | controller | skipping: [instance] 2026-02-24 21:54:04.178178 | controller | 2026-02-24 21:54:04.178233 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-24 21:54:04.178330 | controller | Tuesday 24 February 2026 21:54:04 +0000 (0:00:00.022) 0:00:12.782 ****** 2026-02-24 21:54:04.977666 | controller | changed: [instance] 2026-02-24 21:54:05.013968 | controller | 2026-02-24 21:54:05.013989 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-24 21:54:05.013997 | controller | Tuesday 24 February 2026 21:54:04 +0000 (0:00:00.798) 0:00:13.581 ****** 2026-02-24 21:54:05.014005 | controller | skipping: [instance] 2026-02-24 21:54:05.052149 | controller | 2026-02-24 21:54:05.052201 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-24 21:54:05.052211 | controller | Tuesday 24 February 2026 21:54:05 +0000 (0:00:00.036) 0:00:13.618 ****** 2026-02-24 21:54:05.052224 | controller | skipping: [instance] 2026-02-24 21:54:05.052371 | controller | 2026-02-24 21:54:05.052596 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-24 21:54:05.091077 | controller | Tuesday 24 February 2026 21:54:05 +0000 (0:00:00.038) 0:00:13.656 ****** 2026-02-24 21:54:05.091099 | controller | skipping: [instance] 2026-02-24 21:54:05.613913 | controller | 2026-02-24 21:54:05.613937 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-24 21:54:05.613945 | controller | Tuesday 24 February 2026 21:54:05 +0000 (0:00:00.038) 0:00:13.695 ****** 2026-02-24 21:54:05.613955 | controller | changed: [instance] 2026-02-24 21:54:06.048590 | controller | 2026-02-24 21:54:06.048657 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-24 21:54:06.048666 | controller | Tuesday 24 February 2026 21:54:05 +0000 (0:00:00.522) 0:00:14.217 ****** 2026-02-24 21:54:06.048677 | controller | changed: [instance] 2026-02-24 21:54:06.092688 | controller | 2026-02-24 21:54:06.092711 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-24 21:54:06.092718 | controller | Tuesday 24 February 2026 21:54:06 +0000 (0:00:00.434) 0:00:14.652 ****** 2026-02-24 21:54:06.092729 | controller | skipping: [instance] 2026-02-24 21:54:06.120888 | controller | 2026-02-24 21:54:06.120909 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-24 21:54:06.120916 | controller | Tuesday 24 February 2026 21:54:06 +0000 (0:00:00.044) 0:00:14.696 ****** 2026-02-24 21:54:06.120929 | controller | skipping: [instance] 2026-02-24 21:54:06.151167 | controller | 2026-02-24 21:54:06.151224 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-24 21:54:06.151234 | controller | Tuesday 24 February 2026 21:54:06 +0000 (0:00:00.028) 0:00:14.725 ****** 2026-02-24 21:54:06.151247 | controller | skipping: [instance] 2026-02-24 21:54:06.190081 | controller | 2026-02-24 21:54:06.190109 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-24 21:54:06.190117 | controller | Tuesday 24 February 2026 21:54:06 +0000 (0:00:00.030) 0:00:14.755 ****** 2026-02-24 21:54:06.190128 | controller | ok: [instance] 2026-02-24 21:54:06.218587 | controller | 2026-02-24 21:54:06.218610 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-24 21:54:06.218619 | controller | Tuesday 24 February 2026 21:54:06 +0000 (0:00:00.039) 0:00:14.794 ****** 2026-02-24 21:54:06.218642 | controller | skipping: [instance] 2026-02-24 21:54:06.245918 | controller | 2026-02-24 21:54:06.245937 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-24 21:54:06.245945 | controller | Tuesday 24 February 2026 21:54:06 +0000 (0:00:00.028) 0:00:14.822 ****** 2026-02-24 21:54:06.245954 | controller | skipping: [instance] 2026-02-24 21:54:06.272147 | controller | 2026-02-24 21:54:06.272165 | controller | TASK [Download the RPM] ******************************************************** 2026-02-24 21:54:06.272173 | controller | Tuesday 24 February 2026 21:54:06 +0000 (0:00:00.027) 0:00:14.850 ****** 2026-02-24 21:54:06.272181 | controller | skipping: [instance] 2026-02-24 21:54:06.272333 | controller | 2026-02-24 21:54:06.272472 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-24 21:54:06.272613 | controller | Tuesday 24 February 2026 21:54:06 +0000 (0:00:00.026) 0:00:14.876 ****** 2026-02-24 21:54:06.300517 | controller | skipping: [instance] 2026-02-24 21:54:06.300685 | controller | 2026-02-24 21:54:06.300846 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-24 21:54:06.301003 | controller | Tuesday 24 February 2026 21:54:06 +0000 (0:00:00.028) 0:00:14.905 ****** 2026-02-24 21:54:06.332045 | controller | skipping: [instance] 2026-02-24 21:54:06.332220 | controller | 2026-02-24 21:54:06.332366 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-24 21:54:06.332498 | controller | Tuesday 24 February 2026 21:54:06 +0000 (0:00:00.031) 0:00:14.936 ****** 2026-02-24 21:54:06.385224 | controller | skipping: [instance] 2026-02-24 21:54:06.385370 | controller | 2026-02-24 21:54:06.385507 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-24 21:54:06.385637 | controller | Tuesday 24 February 2026 21:54:06 +0000 (0:00:00.053) 0:00:14.989 ****** 2026-02-24 21:54:06.410627 | controller | skipping: [instance] 2026-02-24 21:54:06.410762 | controller | 2026-02-24 21:54:06.410895 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-24 21:54:06.411044 | controller | Tuesday 24 February 2026 21:54:06 +0000 (0:00:00.025) 0:00:15.015 ****** 2026-02-24 21:54:06.594807 | controller | ok: [instance] 2026-02-24 21:54:06.801151 | controller | 2026-02-24 21:54:06.801188 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-24 21:54:06.801197 | controller | Tuesday 24 February 2026 21:54:06 +0000 (0:00:00.183) 0:00:15.198 ****** 2026-02-24 21:54:06.801219 | controller | changed: [instance] 2026-02-24 21:54:07.021628 | controller | 2026-02-24 21:54:07.021659 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-24 21:54:07.021666 | controller | Tuesday 24 February 2026 21:54:06 +0000 (0:00:00.206) 0:00:15.405 ****** 2026-02-24 21:54:07.021676 | controller | changed: [instance] 2026-02-24 21:54:07.043154 | controller | 2026-02-24 21:54:07.043192 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-24 21:54:07.043202 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.220) 0:00:15.625 ****** 2026-02-24 21:54:07.043229 | controller | skipping: [instance] 2026-02-24 21:54:07.066157 | controller | 2026-02-24 21:54:07.066184 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-24 21:54:07.066194 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.021) 0:00:15.647 ****** 2026-02-24 21:54:07.066225 | controller | skipping: [instance] 2026-02-24 21:54:07.066257 | controller | 2026-02-24 21:54:07.066268 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-24 21:54:07.066425 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.022) 0:00:15.670 ****** 2026-02-24 21:54:07.088894 | controller | skipping: [instance] 2026-02-24 21:54:07.109851 | controller | 2026-02-24 21:54:07.109868 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-24 21:54:07.109876 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.022) 0:00:15.692 ****** 2026-02-24 21:54:07.109883 | controller | skipping: [instance] 2026-02-24 21:54:07.131499 | controller | 2026-02-24 21:54:07.131517 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-24 21:54:07.131530 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.020) 0:00:15.713 ****** 2026-02-24 21:54:07.131539 | controller | skipping: [instance] 2026-02-24 21:54:07.153561 | controller | 2026-02-24 21:54:07.153584 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-24 21:54:07.153593 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.021) 0:00:15.735 ****** 2026-02-24 21:54:07.153609 | controller | skipping: [instance] 2026-02-24 21:54:07.153765 | controller | 2026-02-24 21:54:07.153902 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-24 21:54:07.154068 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.022) 0:00:15.758 ****** 2026-02-24 21:54:07.170982 | controller | skipping: [instance] 2026-02-24 21:54:07.171310 | controller | 2026-02-24 21:54:07.171571 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-24 21:54:07.171809 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.017) 0:00:15.775 ****** 2026-02-24 21:54:07.199205 | controller | skipping: [instance] 2026-02-24 21:54:07.199504 | controller | 2026-02-24 21:54:07.199644 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-24 21:54:07.199781 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.028) 0:00:15.803 ****** 2026-02-24 21:54:07.215541 | controller | skipping: [instance] 2026-02-24 21:54:07.215805 | controller | 2026-02-24 21:54:07.215977 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-24 21:54:07.216137 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.016) 0:00:15.820 ****** 2026-02-24 21:54:07.235851 | controller | skipping: [instance] 2026-02-24 21:54:07.236050 | controller | 2026-02-24 21:54:07.236195 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2026-02-24 21:54:07.236337 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.020) 0:00:15.840 ****** 2026-02-24 21:54:07.267624 | controller | skipping: [instance] 2026-02-24 21:54:07.267864 | controller | 2026-02-24 21:54:07.268063 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2026-02-24 21:54:07.268192 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.031) 0:00:15.872 ****** 2026-02-24 21:54:07.296148 | controller | skipping: [instance] 2026-02-24 21:54:07.296333 | controller | 2026-02-24 21:54:07.296493 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2026-02-24 21:54:07.296651 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.028) 0:00:15.900 ****** 2026-02-24 21:54:07.325287 | controller | skipping: [instance] 2026-02-24 21:54:07.325554 | controller | 2026-02-24 21:54:07.325815 | controller | TASK [test_deps : Install additional packages] ********************************* 2026-02-24 21:54:07.326200 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.029) 0:00:15.929 ****** 2026-02-24 21:54:07.355134 | controller | skipping: [instance] 2026-02-24 21:54:07.355186 | controller | 2026-02-24 21:54:07.355198 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2026-02-24 21:54:07.355209 | controller | Tuesday 24 February 2026 21:54:07 +0000 (0:00:00.029) 0:00:15.959 ****** 2026-02-24 21:55:10.979150 | controller | ok: [instance] 2026-02-24 21:55:10.979205 | controller | 2026-02-24 21:55:10.979215 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2026-02-24 21:55:10.979459 | controller | Tuesday 24 February 2026 21:55:10 +0000 (0:01:03.623) 0:01:19.583 ****** 2026-02-24 21:55:12.128040 | controller | ok: [instance] 2026-02-24 21:55:12.158922 | controller | 2026-02-24 21:55:12.158953 | controller | TASK [test_deps : Install extra packages] ************************************** 2026-02-24 21:55:12.158962 | controller | Tuesday 24 February 2026 21:55:12 +0000 (0:00:01.149) 0:01:20.732 ****** 2026-02-24 21:55:12.158970 | controller | skipping: [instance] 2026-02-24 21:55:12.198336 | controller | 2026-02-24 21:55:12.198388 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-24 21:55:12.198402 | controller | Tuesday 24 February 2026 21:55:12 +0000 (0:00:00.030) 0:01:20.762 ****** 2026-02-24 21:55:12.198422 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2026-02-24 21:55:12.217200 | controller | 2026-02-24 21:55:12.217232 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-24 21:55:12.217256 | controller | Tuesday 24 February 2026 21:55:12 +0000 (0:00:00.039) 0:01:20.802 ****** 2026-02-24 21:55:12.217273 | controller | ok: [instance] => 2026-02-24 21:55:12.217334 | controller | cifmw_ci_setup_packages: 2026-02-24 21:55:12.217346 | controller | - bash-completion 2026-02-24 21:55:12.217359 | controller | - ca-certificates 2026-02-24 21:55:12.217396 | controller | - git-core 2026-02-24 21:55:12.217917 | controller | - make 2026-02-24 21:55:19.949180 | controller | - tar 2026-02-24 21:55:19.949212 | controller | - tmux 2026-02-24 21:55:19.949220 | controller | - python3-pip 2026-02-24 21:55:19.949225 | controller | 2026-02-24 21:55:19.949232 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-24 21:55:19.949240 | controller | Tuesday 24 February 2026 21:55:12 +0000 (0:00:00.018) 0:01:20.821 ****** 2026-02-24 21:55:19.949250 | controller | changed: [instance] 2026-02-24 21:55:19.949289 | controller | 2026-02-24 21:55:19.949298 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-24 21:55:19.949453 | controller | Tuesday 24 February 2026 21:55:19 +0000 (0:00:07.731) 0:01:28.553 ****** 2026-02-24 21:55:20.542052 | controller | ok: [instance] 2026-02-24 21:55:20.542260 | controller | 2026-02-24 21:55:20.542291 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-24 21:55:20.746565 | controller | Tuesday 24 February 2026 21:55:20 +0000 (0:00:00.592) 0:01:29.146 ****** 2026-02-24 21:55:20.746604 | controller | changed: [instance] 2026-02-24 21:55:26.788464 | controller | 2026-02-24 21:55:26.788504 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-24 21:55:26.788513 | controller | Tuesday 24 February 2026 21:55:20 +0000 (0:00:00.204) 0:01:29.350 ****** 2026-02-24 21:55:26.788523 | controller | changed: [instance] 2026-02-24 21:55:26.825183 | controller | 2026-02-24 21:55:26.825224 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-24 21:55:26.825235 | controller | Tuesday 24 February 2026 21:55:26 +0000 (0:00:06.042) 0:01:35.392 ****** 2026-02-24 21:55:26.825248 | controller | ok: [instance] 2026-02-24 21:55:26.825307 | controller | 2026-02-24 21:55:26.825320 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-24 21:55:26.825370 | controller | Tuesday 24 February 2026 21:55:26 +0000 (0:00:00.037) 0:01:35.429 ****** 2026-02-24 21:55:27.091845 | controller | changed: [instance] 2026-02-24 21:55:27.354731 | controller | 2026-02-24 21:55:27.354753 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-24 21:55:27.354761 | controller | Tuesday 24 February 2026 21:55:27 +0000 (0:00:00.266) 0:01:35.696 ****** 2026-02-24 21:55:27.354770 | controller | changed: [instance] 2026-02-24 21:55:27.373202 | controller | 2026-02-24 21:55:27.373249 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-24 21:55:27.373276 | controller | Tuesday 24 February 2026 21:55:27 +0000 (0:00:00.263) 0:01:35.959 ****** 2026-02-24 21:55:27.373293 | controller | skipping: [instance] 2026-02-24 21:55:27.390480 | controller | 2026-02-24 21:55:27.390505 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-24 21:55:27.390514 | controller | Tuesday 24 February 2026 21:55:27 +0000 (0:00:00.018) 0:01:35.977 ****** 2026-02-24 21:55:27.390524 | controller | skipping: [instance] 2026-02-24 21:55:27.407664 | controller | 2026-02-24 21:55:27.407682 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-24 21:55:27.407690 | controller | Tuesday 24 February 2026 21:55:27 +0000 (0:00:00.017) 0:01:35.994 ****** 2026-02-24 21:55:27.407699 | controller | skipping: [instance] 2026-02-24 21:55:27.424098 | controller | 2026-02-24 21:55:27.424133 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-24 21:55:27.424143 | controller | Tuesday 24 February 2026 21:55:27 +0000 (0:00:00.017) 0:01:36.011 ****** 2026-02-24 21:55:27.424154 | controller | skipping: [instance] 2026-02-24 21:55:27.424182 | controller | 2026-02-24 21:55:27.424191 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-24 21:55:27.424388 | controller | Tuesday 24 February 2026 21:55:27 +0000 (0:00:00.016) 0:01:36.028 ****** 2026-02-24 21:55:27.441103 | controller | skipping: [instance] 2026-02-24 21:55:27.441267 | controller | 2026-02-24 21:55:27.441532 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-24 21:55:27.441671 | controller | Tuesday 24 February 2026 21:55:27 +0000 (0:00:00.015) 0:01:36.043 ****** 2026-02-24 21:55:27.462176 | controller | skipping: [instance] 2026-02-24 21:55:27.462365 | controller | 2026-02-24 21:55:27.462387 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-24 21:55:28.448113 | controller | Tuesday 24 February 2026 21:55:27 +0000 (0:00:00.023) 0:01:36.066 ****** 2026-02-24 21:55:28.448143 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2026-02-24 21:55:28.775112 | controller | changed: [instance] => (item=/opt/basedir/logs) 2026-02-24 21:55:28.775148 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2026-02-24 21:55:28.775156 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2026-02-24 21:55:28.775162 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2026-02-24 21:55:28.775168 | controller | 2026-02-24 21:55:28.775173 | controller | TASK [Create secret file] ****************************************************** 2026-02-24 21:55:28.775180 | controller | Tuesday 24 February 2026 21:55:28 +0000 (0:00:00.985) 0:01:37.052 ****** 2026-02-24 21:55:28.775197 | controller | changed: [instance] 2026-02-24 21:55:28.775221 | controller | 2026-02-24 21:55:28.775228 | controller | PLAY RECAP ********************************************************************* 2026-02-24 21:55:28.775234 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2026-02-24 21:55:28.775239 | controller | 2026-02-24 21:55:28.775245 | controller | Tuesday 24 February 2026 21:55:28 +0000 (0:00:00.326) 0:01:37.378 ****** 2026-02-24 21:55:28.775250 | controller | =============================================================================== 2026-02-24 21:55:28.775264 | controller | test_deps : Install selinux python libs -------------------------------- 63.62s 2026-02-24 21:55:28.775270 | controller | ci_setup : Install needed packages -------------------------------------- 7.73s 2026-02-24 21:55:28.775275 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.26s 2026-02-24 21:55:28.775282 | controller | ci_setup : Install openshift client ------------------------------------- 6.04s 2026-02-24 21:55:28.775304 | controller | test_deps : Install python yaml libs ------------------------------------ 1.15s 2026-02-24 21:55:28.776156 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.06s 2026-02-24 21:55:28.776203 | controller | ci_setup : Manage directories ------------------------------------------- 0.99s 2026-02-24 21:55:28.776214 | controller | Gathering Facts --------------------------------------------------------- 0.83s 2026-02-24 21:55:28.776221 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.81s 2026-02-24 21:55:28.776228 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.80s 2026-02-24 21:55:28.776234 | controller | repo_setup : Install repo-setup package --------------------------------- 0.69s 2026-02-24 21:55:28.776241 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.67s 2026-02-24 21:55:28.776247 | controller | ci_setup : Gather version of openshift client --------------------------- 0.59s 2026-02-24 21:55:28.776254 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.52s 2026-02-24 21:55:28.776274 | controller | repo_setup : Ensure directories are present ----------------------------- 0.51s 2026-02-24 21:55:28.776300 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.43s 2026-02-24 21:55:28.776671 | controller | Create secret file ------------------------------------------------------ 0.33s 2026-02-24 21:55:28.832978 | controller | Create custom basedir --------------------------------------------------- 0.31s 2026-02-24 21:55:28.832996 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.28s 2026-02-24 21:55:28.833009 | controller | ci_setup : Create completion file --------------------------------------- 0.27s 2026-02-24 21:55:28.833017 | controller | INFO Running crc_layout > converge 2026-02-24 21:55:29.412836 | controller | 2026-02-24 21:55:29.413009 | controller | PLAY [Converge] **************************************************************** 2026-02-24 21:55:29.413160 | controller | 2026-02-24 21:55:29.413303 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-24 21:55:29.413432 | controller | Tuesday 24 February 2026 21:55:29 +0000 (0:00:00.026) 0:00:00.026 ****** 2026-02-24 21:55:30.208232 | controller | ok: [instance] 2026-02-24 21:55:30.208302 | controller | 2026-02-24 21:55:30.208315 | controller | TASK [Load networking definition from scenario file] *************************** 2026-02-24 21:55:30.208456 | controller | Tuesday 24 February 2026 21:55:30 +0000 (0:00:00.795) 0:00:00.821 ****** 2026-02-24 21:55:30.267137 | controller | ok: [instance] 2026-02-24 21:55:30.267409 | controller | 2026-02-24 21:55:30.267432 | controller | TASK [reproducer : Discover latest images when multi-image dict is set] ******** 2026-02-24 21:55:30.299156 | controller | Tuesday 24 February 2026 21:55:30 +0000 (0:00:00.059) 0:00:00.880 ****** 2026-02-24 21:55:30.299193 | controller | skipping: [instance] 2026-02-24 21:55:30.299238 | controller | 2026-02-24 21:55:30.299269 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-24 21:55:30.299410 | controller | Tuesday 24 February 2026 21:55:30 +0000 (0:00:00.032) 0:00:00.912 ****** 2026-02-24 21:55:32.138149 | controller | changed: [instance] 2026-02-24 21:55:32.138201 | controller | 2026-02-24 21:55:32.138212 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-24 21:55:32.138395 | controller | Tuesday 24 February 2026 21:55:32 +0000 (0:00:01.838) 0:00:02.751 ****** 2026-02-24 21:55:32.179040 | controller | ok: [instance] 2026-02-24 21:55:32.202215 | controller | 2026-02-24 21:55:32.202282 | controller | TASK [reproducer : Load CI job environment] ************************************ 2026-02-24 21:55:32.202297 | controller | Tuesday 24 February 2026 21:55:32 +0000 (0:00:00.040) 0:00:02.792 ****** 2026-02-24 21:55:32.202315 | controller | skipping: [instance] 2026-02-24 21:55:32.202359 | controller | 2026-02-24 21:55:32.202374 | controller | TASK [Build final libvirt layout] ********************************************** 2026-02-24 21:55:32.202503 | controller | Tuesday 24 February 2026 21:55:32 +0000 (0:00:00.023) 0:00:02.815 ****** 2026-02-24 21:55:32.251000 | controller | 2026-02-24 21:55:32.327118 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2026-02-24 21:55:32.327152 | controller | Tuesday 24 February 2026 21:55:32 +0000 (0:00:00.048) 0:00:02.864 ****** 2026-02-24 21:55:32.327164 | controller | ok: [instance] 2026-02-24 21:55:32.327194 | controller | 2026-02-24 21:55:32.327411 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2026-02-24 21:55:32.393842 | controller | Tuesday 24 February 2026 21:55:32 +0000 (0:00:00.075) 0:00:02.940 ****** 2026-02-24 21:55:32.393880 | controller | skipping: [instance] 2026-02-24 21:55:32.394174 | controller | 2026-02-24 21:55:32.394369 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2026-02-24 21:55:32.394492 | controller | Tuesday 24 February 2026 21:55:32 +0000 (0:00:00.067) 0:00:03.007 ****** 2026-02-24 21:55:32.420490 | controller | ok: [instance] 2026-02-24 21:55:32.420667 | controller | 2026-02-24 21:55:32.420833 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2026-02-24 21:55:32.420993 | controller | Tuesday 24 February 2026 21:55:32 +0000 (0:00:00.026) 0:00:03.034 ****** 2026-02-24 21:55:32.445159 | controller | ok: [instance] => changed=false 2026-02-24 21:55:32.445405 | controller | msg: All assertions passed 2026-02-24 21:55:32.445557 | controller | 2026-02-24 21:55:32.445695 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2026-02-24 21:55:32.445824 | controller | Tuesday 24 February 2026 21:55:32 +0000 (0:00:00.024) 0:00:03.058 ****** 2026-02-24 21:55:32.490392 | controller | ok: [instance] 2026-02-24 21:55:32.490538 | controller | 2026-02-24 21:55:32.490685 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2026-02-24 21:55:32.490818 | controller | Tuesday 24 February 2026 21:55:32 +0000 (0:00:00.045) 0:00:03.104 ****** 2026-02-24 21:55:32.938501 | controller | ok: [instance] => (item=artifacts) 2026-02-24 21:55:33.011621 | controller | ok: [instance] => (item=logs) 2026-02-24 21:55:33.011638 | controller | 2026-02-24 21:55:33.011645 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2026-02-24 21:55:33.011650 | controller | Tuesday 24 February 2026 21:55:32 +0000 (0:00:00.447) 0:00:03.552 ****** 2026-02-24 21:55:33.011658 | controller | 2026-02-24 21:55:33.191772 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2026-02-24 21:55:33.191790 | controller | Tuesday 24 February 2026 21:55:33 +0000 (0:00:00.073) 0:00:03.625 ****** 2026-02-24 21:55:33.191801 | controller | ok: [instance] 2026-02-24 21:55:33.465532 | controller | 2026-02-24 21:55:33.465550 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2026-02-24 21:55:33.465558 | controller | Tuesday 24 February 2026 21:55:33 +0000 (0:00:00.180) 0:00:03.805 ****** 2026-02-24 21:55:33.465566 | controller | changed: [instance] 2026-02-24 21:55:33.737047 | controller | 2026-02-24 21:55:33.737079 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2026-02-24 21:55:33.737086 | controller | Tuesday 24 February 2026 21:55:33 +0000 (0:00:00.273) 0:00:04.078 ****** 2026-02-24 21:55:33.737097 | controller | ok: [instance] 2026-02-24 21:55:33.766908 | controller | 2026-02-24 21:55:33.766925 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2026-02-24 21:55:33.766931 | controller | Tuesday 24 February 2026 21:55:33 +0000 (0:00:00.271) 0:00:04.350 ****** 2026-02-24 21:55:33.766939 | controller | skipping: [instance] 2026-02-24 21:55:33.784579 | controller | 2026-02-24 21:55:33.784600 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2026-02-24 21:55:33.784609 | controller | Tuesday 24 February 2026 21:55:33 +0000 (0:00:00.030) 0:00:04.380 ****** 2026-02-24 21:55:33.784620 | controller | skipping: [instance] 2026-02-24 21:55:33.807068 | controller | 2026-02-24 21:55:33.807087 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2026-02-24 21:55:33.807102 | controller | Tuesday 24 February 2026 21:55:33 +0000 (0:00:00.017) 0:00:04.398 ****** 2026-02-24 21:55:33.807113 | controller | ok: [instance] 2026-02-24 21:55:33.835531 | controller | 2026-02-24 21:55:33.835549 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2026-02-24 21:55:33.835556 | controller | Tuesday 24 February 2026 21:55:33 +0000 (0:00:00.022) 0:00:04.420 ****** 2026-02-24 21:55:33.835566 | controller | skipping: [instance] 2026-02-24 21:55:41.754106 | controller | 2026-02-24 21:55:41.754144 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2026-02-24 21:55:41.754153 | controller | Tuesday 24 February 2026 21:55:33 +0000 (0:00:00.028) 0:00:04.449 ****** 2026-02-24 21:55:41.754163 | controller | changed: [instance] 2026-02-24 21:55:41.754188 | controller | 2026-02-24 21:55:41.754359 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2026-02-24 21:55:41.964539 | controller | Tuesday 24 February 2026 21:55:41 +0000 (0:00:07.918) 0:00:12.367 ****** 2026-02-24 21:55:41.964577 | controller | changed: [instance] 2026-02-24 21:55:41.964646 | controller | 2026-02-24 21:55:41.964668 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2026-02-24 21:55:41.964680 | controller | Tuesday 24 February 2026 21:55:41 +0000 (0:00:00.210) 0:00:12.578 ****** 2026-02-24 21:55:42.457256 | controller | changed: [instance] 2026-02-24 21:55:43.031551 | controller | 2026-02-24 21:55:43.031582 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2026-02-24 21:55:43.031590 | controller | Tuesday 24 February 2026 21:55:42 +0000 (0:00:00.492) 0:00:13.070 ****** 2026-02-24 21:55:43.031600 | controller | changed: [instance] 2026-02-24 21:55:43.225536 | controller | 2026-02-24 21:55:43.225562 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2026-02-24 21:55:43.225569 | controller | Tuesday 24 February 2026 21:55:43 +0000 (0:00:00.574) 0:00:13.644 ****** 2026-02-24 21:55:43.225580 | controller | ok: [instance] 2026-02-24 21:55:43.865972 | controller | 2026-02-24 21:55:43.865997 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2026-02-24 21:55:43.866014 | controller | Tuesday 24 February 2026 21:55:43 +0000 (0:00:00.194) 0:00:13.839 ****** 2026-02-24 21:55:43.866044 | controller | ok: [instance] 2026-02-24 21:55:44.603036 | controller | 2026-02-24 21:55:44.603067 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2026-02-24 21:55:44.603075 | controller | Tuesday 24 February 2026 21:55:43 +0000 (0:00:00.640) 0:00:14.479 ****** 2026-02-24 21:55:44.603085 | controller | changed: [instance] 2026-02-24 21:55:44.688166 | controller | 2026-02-24 21:55:44.688204 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2026-02-24 21:55:44.688214 | controller | Tuesday 24 February 2026 21:55:44 +0000 (0:00:00.736) 0:00:15.216 ****** 2026-02-24 21:55:44.688242 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2026-02-24 21:55:44.688267 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2026-02-24 21:55:44.688275 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2026-02-24 21:55:44.688282 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2026-02-24 21:55:44.688290 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2026-02-24 21:55:44.688297 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2026-02-24 21:55:44.688304 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2026-02-24 21:55:44.688311 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2026-02-24 21:55:44.688318 | controller | 2026-02-24 21:55:44.688325 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2026-02-24 21:55:44.688335 | controller | Tuesday 24 February 2026 21:55:44 +0000 (0:00:00.084) 0:00:15.301 ****** 2026-02-24 21:55:45.003494 | controller | ok: [instance] 2026-02-24 21:55:45.329632 | controller | 2026-02-24 21:55:45.329663 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2026-02-24 21:55:45.329671 | controller | Tuesday 24 February 2026 21:55:45 +0000 (0:00:00.315) 0:00:15.616 ****** 2026-02-24 21:55:45.329682 | controller | ok: [instance] 2026-02-24 21:55:46.640639 | controller | 2026-02-24 21:55:46.640674 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2026-02-24 21:55:46.640682 | controller | Tuesday 24 February 2026 21:55:45 +0000 (0:00:00.326) 0:00:15.943 ****** 2026-02-24 21:55:46.640692 | controller | ok: [instance] 2026-02-24 21:55:47.953721 | controller | 2026-02-24 21:55:47.953755 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2026-02-24 21:55:47.953763 | controller | Tuesday 24 February 2026 21:55:46 +0000 (0:00:01.311) 0:00:17.254 ****** 2026-02-24 21:55:47.953773 | controller | ok: [instance] 2026-02-24 21:55:48.265012 | controller | 2026-02-24 21:55:48.265055 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2026-02-24 21:55:48.265064 | controller | Tuesday 24 February 2026 21:55:47 +0000 (0:00:01.312) 0:00:18.567 ****** 2026-02-24 21:55:48.265073 | controller | ok: [instance] 2026-02-24 21:55:48.573668 | controller | 2026-02-24 21:55:48.573697 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2026-02-24 21:55:48.573705 | controller | Tuesday 24 February 2026 21:55:48 +0000 (0:00:00.311) 0:00:18.878 ****** 2026-02-24 21:55:48.573722 | controller | ok: [instance] 2026-02-24 21:55:48.879564 | controller | 2026-02-24 21:55:48.879593 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2026-02-24 21:55:48.879601 | controller | Tuesday 24 February 2026 21:55:48 +0000 (0:00:00.308) 0:00:19.187 ****** 2026-02-24 21:55:48.879616 | controller | ok: [instance] 2026-02-24 21:55:49.190697 | controller | 2026-02-24 21:55:49.190726 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2026-02-24 21:55:49.190734 | controller | Tuesday 24 February 2026 21:55:48 +0000 (0:00:00.305) 0:00:19.493 ****** 2026-02-24 21:55:49.190744 | controller | ok: [instance] 2026-02-24 21:55:50.505994 | controller | 2026-02-24 21:55:50.506045 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2026-02-24 21:55:50.506056 | controller | Tuesday 24 February 2026 21:55:49 +0000 (0:00:00.311) 0:00:19.804 ****** 2026-02-24 21:55:50.506067 | controller | ok: [instance] 2026-02-24 21:55:50.814139 | controller | 2026-02-24 21:55:50.814180 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2026-02-24 21:55:50.814191 | controller | Tuesday 24 February 2026 21:55:50 +0000 (0:00:01.315) 0:00:21.119 ****** 2026-02-24 21:55:50.814217 | controller | ok: [instance] 2026-02-24 21:55:50.814263 | controller | 2026-02-24 21:55:50.814273 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2026-02-24 21:55:50.814283 | controller | Tuesday 24 February 2026 21:55:50 +0000 (0:00:00.308) 0:00:21.427 ****** 2026-02-24 21:55:51.120741 | controller | ok: [instance] 2026-02-24 21:55:51.432798 | controller | 2026-02-24 21:55:51.432830 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2026-02-24 21:55:51.432838 | controller | Tuesday 24 February 2026 21:55:51 +0000 (0:00:00.306) 0:00:21.734 ****** 2026-02-24 21:55:51.432848 | controller | ok: [instance] 2026-02-24 21:55:51.750037 | controller | 2026-02-24 21:55:51.750065 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2026-02-24 21:55:51.750073 | controller | Tuesday 24 February 2026 21:55:51 +0000 (0:00:00.312) 0:00:22.046 ****** 2026-02-24 21:55:51.750082 | controller | ok: [instance] 2026-02-24 21:55:52.075150 | controller | 2026-02-24 21:55:52.075183 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2026-02-24 21:55:52.075207 | controller | Tuesday 24 February 2026 21:55:51 +0000 (0:00:00.317) 0:00:22.363 ****** 2026-02-24 21:55:52.075219 | controller | ok: [instance] 2026-02-24 21:55:52.075251 | controller | 2026-02-24 21:55:52.075261 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2026-02-24 21:55:52.075356 | controller | Tuesday 24 February 2026 21:55:52 +0000 (0:00:00.324) 0:00:22.688 ****** 2026-02-24 21:55:52.383571 | controller | ok: [instance] 2026-02-24 21:55:52.691729 | controller | 2026-02-24 21:55:52.691772 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2026-02-24 21:55:52.691782 | controller | Tuesday 24 February 2026 21:55:52 +0000 (0:00:00.308) 0:00:22.997 ****** 2026-02-24 21:55:52.691795 | controller | ok: [instance] 2026-02-24 21:55:53.000432 | controller | 2026-02-24 21:55:53.000467 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2026-02-24 21:55:53.000476 | controller | Tuesday 24 February 2026 21:55:52 +0000 (0:00:00.308) 0:00:23.305 ****** 2026-02-24 21:55:53.000486 | controller | ok: [instance] 2026-02-24 21:55:53.309572 | controller | 2026-02-24 21:55:53.309596 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2026-02-24 21:55:53.309604 | controller | Tuesday 24 February 2026 21:55:52 +0000 (0:00:00.308) 0:00:23.613 ****** 2026-02-24 21:55:53.309613 | controller | ok: [instance] 2026-02-24 21:55:53.617176 | controller | 2026-02-24 21:55:53.617230 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2026-02-24 21:55:53.617241 | controller | Tuesday 24 February 2026 21:55:53 +0000 (0:00:00.309) 0:00:23.923 ****** 2026-02-24 21:55:53.617253 | controller | ok: [instance] 2026-02-24 21:55:53.617289 | controller | 2026-02-24 21:55:53.617517 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2026-02-24 21:55:53.925216 | controller | Tuesday 24 February 2026 21:55:53 +0000 (0:00:00.307) 0:00:24.230 ****** 2026-02-24 21:55:53.925269 | controller | ok: [instance] 2026-02-24 21:55:53.925332 | controller | 2026-02-24 21:55:53.925362 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2026-02-24 21:55:53.925375 | controller | Tuesday 24 February 2026 21:55:53 +0000 (0:00:00.308) 0:00:24.538 ****** 2026-02-24 21:55:54.236708 | controller | ok: [instance] 2026-02-24 21:55:54.548994 | controller | 2026-02-24 21:55:54.549018 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2026-02-24 21:55:54.549058 | controller | Tuesday 24 February 2026 21:55:54 +0000 (0:00:00.311) 0:00:24.850 ****** 2026-02-24 21:55:54.549068 | controller | ok: [instance] 2026-02-24 21:55:54.855801 | controller | 2026-02-24 21:55:54.855830 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2026-02-24 21:55:54.855838 | controller | Tuesday 24 February 2026 21:55:54 +0000 (0:00:00.312) 0:00:25.162 ****** 2026-02-24 21:55:54.855848 | controller | ok: [instance] 2026-02-24 21:55:55.159513 | controller | 2026-02-24 21:55:55.159542 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2026-02-24 21:55:55.159551 | controller | Tuesday 24 February 2026 21:55:54 +0000 (0:00:00.306) 0:00:25.469 ****** 2026-02-24 21:55:55.159561 | controller | ok: [instance] 2026-02-24 21:55:55.180143 | controller | 2026-02-24 21:55:55.180189 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2026-02-24 21:55:55.180199 | controller | Tuesday 24 February 2026 21:55:55 +0000 (0:00:00.303) 0:00:25.772 ****** 2026-02-24 21:55:55.180210 | controller | skipping: [instance] 2026-02-24 21:55:55.456628 | controller | 2026-02-24 21:55:55.456655 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2026-02-24 21:55:55.456663 | controller | Tuesday 24 February 2026 21:55:55 +0000 (0:00:00.020) 0:00:25.793 ****** 2026-02-24 21:55:55.456673 | controller | ok: [instance] 2026-02-24 21:55:55.820160 | controller | 2026-02-24 21:55:55.820200 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2026-02-24 21:55:55.820208 | controller | Tuesday 24 February 2026 21:55:55 +0000 (0:00:00.276) 0:00:26.070 ****** 2026-02-24 21:55:55.820218 | controller | ok: [instance] 2026-02-24 21:55:55.820246 | controller | 2026-02-24 21:55:55.820254 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2026-02-24 21:55:55.820389 | controller | Tuesday 24 February 2026 21:55:55 +0000 (0:00:00.363) 0:00:26.433 ****** 2026-02-24 21:55:56.141192 | controller | changed: [instance] 2026-02-24 21:55:56.141305 | controller | 2026-02-24 21:55:56.141335 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2026-02-24 21:55:56.141347 | controller | Tuesday 24 February 2026 21:55:56 +0000 (0:00:00.320) 0:00:26.754 ****** 2026-02-24 21:55:56.403143 | controller | [WARNING]: Reset is not implemented for this connection 2026-02-24 21:55:56.413145 | controller | changed: [instance] 2026-02-24 21:55:56.413535 | controller | 2026-02-24 21:55:56.413565 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2026-02-24 21:55:56.413576 | controller | Tuesday 24 February 2026 21:55:56 +0000 (0:00:00.256) 0:00:27.010 ****** 2026-02-24 21:55:56.413590 | controller | 2026-02-24 21:55:56.485677 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2026-02-24 21:55:56.485709 | controller | Tuesday 24 February 2026 21:55:56 +0000 (0:00:00.015) 0:00:27.026 ****** 2026-02-24 21:55:56.485727 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2026-02-24 21:55:56.527781 | controller | 2026-02-24 21:55:56.527811 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2026-02-24 21:55:56.527823 | controller | Tuesday 24 February 2026 21:55:56 +0000 (0:00:00.072) 0:00:27.098 ****** 2026-02-24 21:55:56.527845 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2026-02-24 21:55:56.575207 | controller | 2026-02-24 21:55:56.575244 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-02-24 21:55:56.575253 | controller | Tuesday 24 February 2026 21:55:56 +0000 (0:00:00.042) 0:00:27.141 ****** 2026-02-24 21:55:56.575266 | controller | ok: [instance] => (item=compute) 2026-02-24 21:55:56.575287 | controller | ok: [instance] => (item=controller) 2026-02-24 21:55:56.575295 | controller | ok: [instance] => (item=crc) 2026-02-24 21:55:56.575304 | controller | 2026-02-24 21:55:56.575404 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-02-24 21:55:56.575431 | controller | Tuesday 24 February 2026 21:55:56 +0000 (0:00:00.047) 0:00:27.188 ****** 2026-02-24 21:55:56.616104 | controller | ok: [instance] 2026-02-24 21:55:56.616218 | controller | 2026-02-24 21:55:56.616358 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-02-24 21:55:56.616497 | controller | Tuesday 24 February 2026 21:55:56 +0000 (0:00:00.041) 0:00:27.229 ****** 2026-02-24 21:55:56.658211 | controller | ok: [instance] => changed=false 2026-02-24 21:55:56.658442 | controller | msg: All assertions passed 2026-02-24 21:55:56.658636 | controller | 2026-02-24 21:55:56.658850 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2026-02-24 21:55:56.659075 | controller | Tuesday 24 February 2026 21:55:56 +0000 (0:00:00.041) 0:00:27.271 ****** 2026-02-24 21:55:56.699466 | controller | 2026-02-24 21:55:56.699615 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2026-02-24 21:55:56.699744 | controller | Tuesday 24 February 2026 21:55:56 +0000 (0:00:00.041) 0:00:27.313 ****** 2026-02-24 21:55:56.776142 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.49', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2026-02-24 21:55:56.776313 | controller | ok: [instance] => (item={}) 2026-02-24 21:55:56.776423 | controller | 2026-02-24 21:55:56.776536 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2026-02-24 21:55:56.776643 | controller | Tuesday 24 February 2026 21:55:56 +0000 (0:00:00.076) 0:00:27.390 ****** 2026-02-24 21:55:56.793302 | controller | skipping: [instance] 2026-02-24 21:55:56.793452 | controller | 2026-02-24 21:55:56.793597 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2026-02-24 21:55:56.793732 | controller | Tuesday 24 February 2026 21:55:56 +0000 (0:00:00.017) 0:00:27.407 ****** 2026-02-24 21:55:57.010109 | controller | ok: [instance] 2026-02-24 21:55:57.352929 | controller | 2026-02-24 21:55:57.352959 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2026-02-24 21:55:57.352967 | controller | Tuesday 24 February 2026 21:55:57 +0000 (0:00:00.216) 0:00:27.623 ****** 2026-02-24 21:55:57.352977 | controller | changed: [instance] 2026-02-24 21:55:58.077150 | controller | 2026-02-24 21:55:58.077199 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2026-02-24 21:55:58.077210 | controller | Tuesday 24 February 2026 21:55:57 +0000 (0:00:00.342) 0:00:27.966 ****** 2026-02-24 21:55:58.077222 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2026-02-24 21:55:58.077255 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2026-02-24 21:55:58.077263 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2026-02-24 21:55:58.077270 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2026-02-24 21:55:58.077279 | controller | 2026-02-24 21:55:58.077389 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2026-02-24 21:55:58.077425 | controller | Tuesday 24 February 2026 21:55:58 +0000 (0:00:00.723) 0:00:28.690 ****** 2026-02-24 21:55:58.102947 | controller | skipping: [instance] 2026-02-24 21:55:58.456118 | controller | 2026-02-24 21:55:58.456156 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2026-02-24 21:55:58.456177 | controller | Tuesday 24 February 2026 21:55:58 +0000 (0:00:00.026) 0:00:28.716 ****** 2026-02-24 21:55:58.456191 | controller | changed: [instance] 2026-02-24 21:55:58.868091 | controller | 2026-02-24 21:55:58.868124 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2026-02-24 21:55:58.868139 | controller | Tuesday 24 February 2026 21:55:58 +0000 (0:00:00.345) 0:00:29.061 ****** 2026-02-24 21:55:58.868145 | controller | 2026-02-24 21:55:58.868151 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 21:55:58.868156 | controller | Tuesday 24 February 2026 21:55:58 +0000 (0:00:00.007) 0:00:29.069 ****** 2026-02-24 21:55:58.868174 | controller | changed: [instance] 2026-02-24 21:55:58.868217 | controller | 2026-02-24 21:55:58.868469 | controller | TASK [Ensure no default networks exists] *************************************** 2026-02-24 21:55:58.941471 | controller | Tuesday 24 February 2026 21:55:58 +0000 (0:00:00.412) 0:00:29.481 ****** 2026-02-24 21:55:58.941501 | controller | 2026-02-24 21:56:00.181113 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2026-02-24 21:56:00.181145 | controller | Tuesday 24 February 2026 21:55:58 +0000 (0:00:00.073) 0:00:29.554 ****** 2026-02-24 21:56:00.181157 | controller | ok: [instance] 2026-02-24 21:56:00.417953 | controller | 2026-02-24 21:56:00.417978 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2026-02-24 21:56:00.417986 | controller | Tuesday 24 February 2026 21:56:00 +0000 (0:00:01.239) 0:00:30.794 ****** 2026-02-24 21:56:00.417996 | controller | ok: [instance] 2026-02-24 21:56:00.954239 | controller | 2026-02-24 21:56:00.954287 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2026-02-24 21:56:00.954297 | controller | Tuesday 24 February 2026 21:56:00 +0000 (0:00:00.236) 0:00:31.031 ****** 2026-02-24 21:56:00.954309 | controller | ok: [instance] 2026-02-24 21:56:01.197443 | controller | 2026-02-24 21:56:01.197468 | controller | TASK [libvirt_manager : Removing default] ************************************** 2026-02-24 21:56:01.197476 | controller | Tuesday 24 February 2026 21:56:00 +0000 (0:00:00.535) 0:00:31.567 ****** 2026-02-24 21:56:01.197485 | controller | ok: [instance] 2026-02-24 21:56:02.400862 | controller | 2026-02-24 21:56:02.400895 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2026-02-24 21:56:02.400903 | controller | Tuesday 24 February 2026 21:56:01 +0000 (0:00:00.243) 0:00:31.810 ****** 2026-02-24 21:56:02.400921 | controller | ok: [instance] 2026-02-24 21:56:02.728799 | controller | 2026-02-24 21:56:02.728827 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2026-02-24 21:56:02.728835 | controller | Tuesday 24 February 2026 21:56:02 +0000 (0:00:01.203) 0:00:33.014 ****** 2026-02-24 21:56:02.728843 | controller | ok: [instance] 2026-02-24 21:56:03.048542 | controller | 2026-02-24 21:56:03.048570 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2026-02-24 21:56:03.048579 | controller | Tuesday 24 February 2026 21:56:02 +0000 (0:00:00.328) 0:00:33.342 ****** 2026-02-24 21:56:03.048588 | controller | changed: [instance] 2026-02-24 21:56:03.369491 | controller | 2026-02-24 21:56:03.369514 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2026-02-24 21:56:03.369522 | controller | Tuesday 24 February 2026 21:56:03 +0000 (0:00:00.319) 0:00:33.662 ****** 2026-02-24 21:56:03.369531 | controller | changed: [instance] 2026-02-24 21:56:04.944790 | controller | 2026-02-24 21:56:04.944822 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2026-02-24 21:56:04.944830 | controller | Tuesday 24 February 2026 21:56:03 +0000 (0:00:00.320) 0:00:33.982 ****** 2026-02-24 21:56:04.944840 | controller | changed: [instance] => (item=arptables) 2026-02-24 21:56:05.266728 | controller | changed: [instance] => (item=iptables) 2026-02-24 21:56:05.266765 | controller | changed: [instance] => (item=ip6tables) 2026-02-24 21:56:05.266773 | controller | 2026-02-24 21:56:05.266779 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2026-02-24 21:56:05.266785 | controller | Tuesday 24 February 2026 21:56:04 +0000 (0:00:01.574) 0:00:35.557 ****** 2026-02-24 21:56:05.266793 | controller | ok: [instance] 2026-02-24 21:56:05.360689 | controller | 2026-02-24 21:56:05.360714 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2026-02-24 21:56:05.360722 | controller | Tuesday 24 February 2026 21:56:05 +0000 (0:00:00.322) 0:00:35.880 ****** 2026-02-24 21:56:05.360731 | controller | ok: [instance] 2026-02-24 21:56:05.403884 | controller | 2026-02-24 21:56:05.403905 | controller | TASK [Ensure the required network configurations are applied] ****************** 2026-02-24 21:56:05.403920 | controller | Tuesday 24 February 2026 21:56:05 +0000 (0:00:00.094) 0:00:35.974 ****** 2026-02-24 21:56:05.403930 | controller | 2026-02-24 21:56:05.428940 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2026-02-24 21:56:05.428958 | controller | Tuesday 24 February 2026 21:56:05 +0000 (0:00:00.043) 0:00:36.017 ****** 2026-02-24 21:56:05.428967 | controller | skipping: [instance] 2026-02-24 21:56:05.452469 | controller | 2026-02-24 21:56:05.452489 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2026-02-24 21:56:05.452498 | controller | Tuesday 24 February 2026 21:56:05 +0000 (0:00:00.024) 0:00:36.042 ****** 2026-02-24 21:56:05.452508 | controller | skipping: [instance] 2026-02-24 21:56:05.477040 | controller | 2026-02-24 21:56:05.477061 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 21:56:05.477069 | controller | Tuesday 24 February 2026 21:56:05 +0000 (0:00:00.023) 0:00:36.065 ****** 2026-02-24 21:56:05.477079 | controller | skipping: [instance] 2026-02-24 21:56:05.504986 | controller | 2026-02-24 21:56:05.505006 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2026-02-24 21:56:05.505014 | controller | Tuesday 24 February 2026 21:56:05 +0000 (0:00:00.024) 0:00:36.090 ****** 2026-02-24 21:56:05.505044 | controller | skipping: [instance] 2026-02-24 21:56:05.543257 | controller | 2026-02-24 21:56:05.543366 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2026-02-24 21:56:05.543383 | controller | Tuesday 24 February 2026 21:56:05 +0000 (0:00:00.027) 0:00:36.118 ****** 2026-02-24 21:56:05.543408 | controller | ok: [instance] 2026-02-24 21:56:05.543421 | controller | 2026-02-24 21:56:05.543435 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2026-02-24 21:56:05.543636 | controller | Tuesday 24 February 2026 21:56:05 +0000 (0:00:00.038) 0:00:36.157 ****** 2026-02-24 21:56:05.577169 | controller | skipping: [instance] 2026-02-24 21:56:05.577290 | controller | 2026-02-24 21:56:05.577449 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2026-02-24 21:56:05.577552 | controller | Tuesday 24 February 2026 21:56:05 +0000 (0:00:00.033) 0:00:36.191 ****** 2026-02-24 21:56:05.601401 | controller | skipping: [instance] 2026-02-24 21:56:05.601498 | controller | 2026-02-24 21:56:05.601650 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2026-02-24 21:56:05.601723 | controller | Tuesday 24 February 2026 21:56:05 +0000 (0:00:00.024) 0:00:36.215 ****** 2026-02-24 21:56:05.658408 | controller | ok: [instance] 2026-02-24 21:56:05.658612 | controller | 2026-02-24 21:56:05.658807 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2026-02-24 21:56:05.659005 | controller | Tuesday 24 February 2026 21:56:05 +0000 (0:00:00.056) 0:00:36.272 ****** 2026-02-24 21:56:05.681288 | controller | skipping: [instance] 2026-02-24 21:56:05.681414 | controller | 2026-02-24 21:56:05.681742 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2026-02-24 21:56:05.681842 | controller | Tuesday 24 February 2026 21:56:05 +0000 (0:00:00.022) 0:00:36.295 ****** 2026-02-24 21:56:05.729310 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2026-02-24 21:56:05.729410 | controller | 2026-02-24 21:56:05.729585 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-24 21:56:05.729699 | controller | Tuesday 24 February 2026 21:56:05 +0000 (0:00:00.047) 0:00:36.343 ****** 2026-02-24 21:56:06.053258 | controller | ok: [instance -> localhost] 2026-02-24 21:56:06.053338 | controller | 2026-02-24 21:56:06.053351 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2026-02-24 21:56:11.122620 | controller | Tuesday 24 February 2026 21:56:06 +0000 (0:00:00.323) 0:00:36.666 ****** 2026-02-24 21:56:11.122663 | controller | changed: [instance -> localhost] 2026-02-24 21:56:11.313769 | controller | 2026-02-24 21:56:11.313793 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-24 21:56:11.313801 | controller | Tuesday 24 February 2026 21:56:11 +0000 (0:00:05.068) 0:00:41.735 ****** 2026-02-24 21:56:11.313816 | controller | changed: [instance] 2026-02-24 21:56:11.660215 | controller | 2026-02-24 21:56:11.660277 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2026-02-24 21:56:11.660288 | controller | Tuesday 24 February 2026 21:56:11 +0000 (0:00:00.191) 0:00:41.927 ****** 2026-02-24 21:56:11.660303 | controller | changed: [instance] 2026-02-24 21:56:13.267971 | controller | 2026-02-24 21:56:13.268010 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2026-02-24 21:56:13.268018 | controller | Tuesday 24 February 2026 21:56:11 +0000 (0:00:00.346) 0:00:42.273 ****** 2026-02-24 21:56:13.268045 | controller | changed: [instance -> localhost] 2026-02-24 21:56:13.638945 | controller | 2026-02-24 21:56:13.638972 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2026-02-24 21:56:13.638979 | controller | Tuesday 24 February 2026 21:56:13 +0000 (0:00:01.607) 0:00:43.881 ****** 2026-02-24 21:56:13.638988 | controller | changed: [instance] 2026-02-24 21:56:13.690982 | controller | 2026-02-24 21:56:13.691016 | controller | TASK [reproducer : Select right domain] **************************************** 2026-02-24 21:56:13.691059 | controller | Tuesday 24 February 2026 21:56:13 +0000 (0:00:00.371) 0:00:44.252 ****** 2026-02-24 21:56:13.691076 | controller | ok: [instance] 2026-02-24 21:56:13.810316 | controller | 2026-02-24 21:56:13.810336 | controller | TASK [Create the virtual networks] ********************************************* 2026-02-24 21:56:13.810345 | controller | Tuesday 24 February 2026 21:56:13 +0000 (0:00:00.051) 0:00:44.304 ****** 2026-02-24 21:56:13.810355 | controller | 2026-02-24 21:56:13.837192 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2026-02-24 21:56:13.837224 | controller | Tuesday 24 February 2026 21:56:13 +0000 (0:00:00.119) 0:00:44.423 ****** 2026-02-24 21:56:13.837242 | controller | ok: [instance] 2026-02-24 21:56:13.837284 | controller | 2026-02-24 21:56:13.837299 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2026-02-24 21:56:13.837469 | controller | Tuesday 24 February 2026 21:56:13 +0000 (0:00:00.026) 0:00:44.450 ****** 2026-02-24 21:56:14.030591 | controller | ok: [instance] 2026-02-24 21:56:14.062137 | controller | 2026-02-24 21:56:14.062174 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2026-02-24 21:56:14.062184 | controller | Tuesday 24 February 2026 21:56:14 +0000 (0:00:00.193) 0:00:44.644 ****** 2026-02-24 21:56:14.062196 | controller | skipping: [instance] 2026-02-24 21:56:14.062226 | controller | 2026-02-24 21:56:14.062235 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2026-02-24 21:56:14.062346 | controller | Tuesday 24 February 2026 21:56:14 +0000 (0:00:00.031) 0:00:44.675 ****** 2026-02-24 21:56:14.091840 | controller | skipping: [instance] 2026-02-24 21:56:14.147090 | controller | 2026-02-24 21:56:14.147126 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2026-02-24 21:56:14.147135 | controller | Tuesday 24 February 2026 21:56:14 +0000 (0:00:00.029) 0:00:44.705 ****** 2026-02-24 21:56:14.147146 | controller | ok: [instance] 2026-02-24 21:56:14.274774 | controller | 2026-02-24 21:56:14.274795 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2026-02-24 21:56:14.274802 | controller | Tuesday 24 February 2026 21:56:14 +0000 (0:00:00.055) 0:00:44.760 ****** 2026-02-24 21:56:14.274817 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 21:56:14.313706 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 21:56:14.313724 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 21:56:14.313731 | controller | 2026-02-24 21:56:14.313737 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2026-02-24 21:56:14.313743 | controller | Tuesday 24 February 2026 21:56:14 +0000 (0:00:00.126) 0:00:44.887 ****** 2026-02-24 21:56:14.313751 | controller | skipping: [instance] 2026-02-24 21:56:14.651161 | controller | 2026-02-24 21:56:14.651199 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2026-02-24 21:56:14.651209 | controller | Tuesday 24 February 2026 21:56:14 +0000 (0:00:00.039) 0:00:44.926 ****** 2026-02-24 21:56:14.651232 | controller | changed: [instance] 2026-02-24 21:56:14.651262 | controller | 2026-02-24 21:56:14.651469 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2026-02-24 21:56:14.651487 | controller | Tuesday 24 February 2026 21:56:14 +0000 (0:00:00.337) 0:00:45.264 ****** 2026-02-24 21:56:14.748204 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2026-02-24 21:56:14.748437 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2026-02-24 21:56:14.748451 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2026-02-24 21:56:14.748458 | controller | 2026-02-24 21:56:14.748466 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 21:56:14.806551 | controller | Tuesday 24 February 2026 21:56:14 +0000 (0:00:00.096) 0:00:45.361 ****** 2026-02-24 21:56:14.806571 | controller | changed: [instance] 2026-02-24 21:56:15.138812 | controller | 2026-02-24 21:56:15.138831 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 21:56:15.138838 | controller | Tuesday 24 February 2026 21:56:14 +0000 (0:00:00.058) 0:00:45.420 ****** 2026-02-24 21:56:15.138846 | controller | changed: [instance] 2026-02-24 21:56:15.362080 | controller | 2026-02-24 21:56:15.362099 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 21:56:15.362116 | controller | Tuesday 24 February 2026 21:56:15 +0000 (0:00:00.332) 0:00:45.752 ****** 2026-02-24 21:56:15.362125 | controller | changed: [instance] 2026-02-24 21:56:15.362442 | controller | 2026-02-24 21:56:15.417064 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 21:56:15.417085 | controller | Tuesday 24 February 2026 21:56:15 +0000 (0:00:00.223) 0:00:45.975 ****** 2026-02-24 21:56:15.417096 | controller | changed: [instance] 2026-02-24 21:56:15.622876 | controller | 2026-02-24 21:56:15.622897 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 21:56:15.622906 | controller | Tuesday 24 February 2026 21:56:15 +0000 (0:00:00.054) 0:00:46.030 ****** 2026-02-24 21:56:15.622915 | controller | changed: [instance] 2026-02-24 21:56:15.847801 | controller | 2026-02-24 21:56:15.847826 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 21:56:15.847834 | controller | Tuesday 24 February 2026 21:56:15 +0000 (0:00:00.205) 0:00:46.236 ****** 2026-02-24 21:56:15.847842 | controller | changed: [instance] 2026-02-24 21:56:15.907249 | controller | 2026-02-24 21:56:15.907281 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 21:56:15.907290 | controller | Tuesday 24 February 2026 21:56:15 +0000 (0:00:00.224) 0:00:46.461 ****** 2026-02-24 21:56:15.907301 | controller | changed: [instance] 2026-02-24 21:56:15.907362 | controller | 2026-02-24 21:56:15.907382 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 21:56:15.907394 | controller | Tuesday 24 February 2026 21:56:15 +0000 (0:00:00.059) 0:00:46.520 ****** 2026-02-24 21:56:16.112568 | controller | changed: [instance] 2026-02-24 21:56:16.334504 | controller | 2026-02-24 21:56:16.334529 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 21:56:16.334537 | controller | Tuesday 24 February 2026 21:56:16 +0000 (0:00:00.205) 0:00:46.726 ****** 2026-02-24 21:56:16.334546 | controller | changed: [instance] 2026-02-24 21:56:16.535443 | controller | 2026-02-24 21:56:16.535477 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2026-02-24 21:56:16.535485 | controller | Tuesday 24 February 2026 21:56:16 +0000 (0:00:00.221) 0:00:46.947 ****** 2026-02-24 21:56:16.535495 | controller | ok: [instance] 2026-02-24 21:56:17.018148 | controller | 2026-02-24 21:56:17.018182 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2026-02-24 21:56:17.018197 | controller | Tuesday 24 February 2026 21:56:16 +0000 (0:00:00.200) 0:00:47.148 ****** 2026-02-24 21:56:17.018210 | controller | changed: [instance] 2026-02-24 21:56:17.018239 | controller | 2026-02-24 21:56:17.018249 | controller | TASK [libvirt_manager : Remove ini file after conversion] ********************** 2026-02-24 21:56:17.018389 | controller | Tuesday 24 February 2026 21:56:17 +0000 (0:00:00.482) 0:00:47.631 ****** 2026-02-24 21:56:17.207970 | controller | changed: [instance] 2026-02-24 21:56:17.237185 | controller | 2026-02-24 21:56:17.237217 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 21:56:17.237235 | controller | Tuesday 24 February 2026 21:56:17 +0000 (0:00:00.189) 0:00:47.821 ****** 2026-02-24 21:56:17.237247 | controller | skipping: [instance] 2026-02-24 21:56:17.237516 | controller | 2026-02-24 21:56:17.237549 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 21:56:17.268214 | controller | Tuesday 24 February 2026 21:56:17 +0000 (0:00:00.029) 0:00:47.850 ****** 2026-02-24 21:56:17.268242 | controller | skipping: [instance] 2026-02-24 21:56:17.296970 | controller | 2026-02-24 21:56:17.297000 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 21:56:17.297012 | controller | Tuesday 24 February 2026 21:56:17 +0000 (0:00:00.030) 0:00:47.881 ****** 2026-02-24 21:56:17.297053 | controller | skipping: [instance] 2026-02-24 21:56:17.326178 | controller | 2026-02-24 21:56:17.326235 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 21:56:17.326250 | controller | Tuesday 24 February 2026 21:56:17 +0000 (0:00:00.028) 0:00:47.910 ****** 2026-02-24 21:56:17.326267 | controller | skipping: [instance] 2026-02-24 21:56:17.326608 | controller | 2026-02-24 21:56:17.349173 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 21:56:17.349194 | controller | Tuesday 24 February 2026 21:56:17 +0000 (0:00:00.029) 0:00:47.939 ****** 2026-02-24 21:56:17.349212 | controller | ok: [instance] 2026-02-24 21:56:17.349436 | controller | 2026-02-24 21:56:17.349672 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 21:56:17.349889 | controller | Tuesday 24 February 2026 21:56:17 +0000 (0:00:00.023) 0:00:47.963 ****** 2026-02-24 21:56:17.473401 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-24 21:56:17.473593 | controller | 2026-02-24 21:56:17.473719 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 21:56:17.473837 | controller | Tuesday 24 February 2026 21:56:17 +0000 (0:00:00.123) 0:00:48.086 ****** 2026-02-24 21:56:17.495916 | controller | skipping: [instance] 2026-02-24 21:56:17.496237 | controller | 2026-02-24 21:56:17.496491 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 21:56:17.496726 | controller | Tuesday 24 February 2026 21:56:17 +0000 (0:00:00.022) 0:00:48.109 ****** 2026-02-24 21:56:17.704152 | controller | changed: [instance] 2026-02-24 21:56:17.704206 | controller | 2026-02-24 21:56:17.704216 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 21:56:17.704304 | controller | Tuesday 24 February 2026 21:56:17 +0000 (0:00:00.208) 0:00:48.317 ****** 2026-02-24 21:56:18.095854 | controller | changed: [instance] 2026-02-24 21:56:18.167177 | controller | 2026-02-24 21:56:18.167214 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 21:56:18.167224 | controller | Tuesday 24 February 2026 21:56:18 +0000 (0:00:00.391) 0:00:48.708 ****** 2026-02-24 21:56:18.167236 | controller | ok: [instance] 2026-02-24 21:56:18.167267 | controller | 2026-02-24 21:56:18.167277 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 21:56:18.167396 | controller | Tuesday 24 February 2026 21:56:18 +0000 (0:00:00.071) 0:00:48.780 ****** 2026-02-24 21:56:18.206872 | controller | ok: [instance] 2026-02-24 21:56:18.588574 | controller | 2026-02-24 21:56:18.588597 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 21:56:18.588605 | controller | Tuesday 24 February 2026 21:56:18 +0000 (0:00:00.039) 0:00:48.820 ****** 2026-02-24 21:56:18.588613 | controller | changed: [instance] 2026-02-24 21:56:18.678138 | controller | 2026-02-24 21:56:18.678225 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2026-02-24 21:56:18.678235 | controller | Tuesday 24 February 2026 21:56:18 +0000 (0:00:00.381) 0:00:49.201 ****** 2026-02-24 21:56:18.678249 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2026-02-24 21:56:18.736612 | controller | 2026-02-24 21:56:18.736641 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2026-02-24 21:56:18.736650 | controller | Tuesday 24 February 2026 21:56:18 +0000 (0:00:00.089) 0:00:49.291 ****** 2026-02-24 21:56:18.736662 | controller | ok: [instance] => (item=public) 2026-02-24 21:56:19.195672 | controller | ok: [instance] => (item=osp_trunk) 2026-02-24 21:56:19.195711 | controller | 2026-02-24 21:56:19.195720 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2026-02-24 21:56:19.195726 | controller | Tuesday 24 February 2026 21:56:18 +0000 (0:00:00.058) 0:00:49.349 ****** 2026-02-24 21:56:19.195738 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 21:56:19.847891 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 21:56:19.847921 | controller | 2026-02-24 21:56:19.847929 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2026-02-24 21:56:19.847934 | controller | Tuesday 24 February 2026 21:56:19 +0000 (0:00:00.458) 0:00:49.808 ****** 2026-02-24 21:56:19.847952 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 21:56:20.271475 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 21:56:20.271507 | controller | 2026-02-24 21:56:20.271514 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2026-02-24 21:56:20.271520 | controller | Tuesday 24 February 2026 21:56:19 +0000 (0:00:00.652) 0:00:50.460 ****** 2026-02-24 21:56:20.271530 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 21:56:20.691608 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 21:56:20.691639 | controller | 2026-02-24 21:56:20.691651 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2026-02-24 21:56:20.691657 | controller | Tuesday 24 February 2026 21:56:20 +0000 (0:00:00.423) 0:00:50.884 ****** 2026-02-24 21:56:20.691667 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 21:56:20.748205 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 21:56:20.748246 | controller | 2026-02-24 21:56:20.748259 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2026-02-24 21:56:20.748269 | controller | Tuesday 24 February 2026 21:56:20 +0000 (0:00:00.420) 0:00:51.304 ****** 2026-02-24 21:56:20.748285 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2026-02-24 21:56:20.970711 | controller | 2026-02-24 21:56:20.970741 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2026-02-24 21:56:20.970749 | controller | Tuesday 24 February 2026 21:56:20 +0000 (0:00:00.056) 0:00:51.361 ****** 2026-02-24 21:56:20.970759 | controller | ok: [instance] 2026-02-24 21:56:21.343295 | controller | 2026-02-24 21:56:21.343375 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2026-02-24 21:56:21.343391 | controller | Tuesday 24 February 2026 21:56:20 +0000 (0:00:00.222) 0:00:51.584 ****** 2026-02-24 21:56:21.343413 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 21:56:21.414150 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 21:56:21.414202 | controller | 2026-02-24 21:56:21.414211 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2026-02-24 21:56:21.414218 | controller | Tuesday 24 February 2026 21:56:21 +0000 (0:00:00.372) 0:00:51.956 ****** 2026-02-24 21:56:21.414230 | controller | 2026-02-24 21:56:21.452100 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-24 21:56:21.452137 | controller | Tuesday 24 February 2026 21:56:21 +0000 (0:00:00.071) 0:00:52.027 ****** 2026-02-24 21:56:21.452150 | controller | skipping: [instance] 2026-02-24 21:56:22.690692 | controller | 2026-02-24 21:56:22.690716 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2026-02-24 21:56:22.690724 | controller | Tuesday 24 February 2026 21:56:21 +0000 (0:00:00.037) 0:00:52.065 ****** 2026-02-24 21:56:22.690733 | controller | ok: [instance] 2026-02-24 21:56:22.883136 | controller | 2026-02-24 21:56:22.883178 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-24 21:56:22.883187 | controller | Tuesday 24 February 2026 21:56:22 +0000 (0:00:01.238) 0:00:53.304 ****** 2026-02-24 21:56:22.883199 | controller | ok: [instance] 2026-02-24 21:56:22.883325 | controller | 2026-02-24 21:56:22.883356 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2026-02-24 21:56:22.883375 | controller | Tuesday 24 February 2026 21:56:22 +0000 (0:00:00.192) 0:00:53.496 ****** 2026-02-24 21:56:23.253168 | controller | changed: [instance] 2026-02-24 21:56:23.253208 | controller | 2026-02-24 21:56:23.253217 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2026-02-24 21:56:23.253228 | controller | Tuesday 24 February 2026 21:56:23 +0000 (0:00:00.370) 0:00:53.866 ****** 2026-02-24 21:56:24.930245 | controller | changed: [instance] 2026-02-24 21:56:25.266930 | controller | 2026-02-24 21:56:25.266959 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2026-02-24 21:56:25.266968 | controller | Tuesday 24 February 2026 21:56:24 +0000 (0:00:01.676) 0:00:55.543 ****** 2026-02-24 21:56:25.266978 | controller | changed: [instance] 2026-02-24 21:56:25.299249 | controller | 2026-02-24 21:56:25.299292 | controller | TASK [Create extra network configuration] ************************************** 2026-02-24 21:56:25.299302 | controller | Tuesday 24 February 2026 21:56:25 +0000 (0:00:00.337) 0:00:55.880 ****** 2026-02-24 21:56:25.299315 | controller | skipping: [instance] 2026-02-24 21:56:25.299345 | controller | 2026-02-24 21:56:25.299363 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2026-02-24 21:56:25.299454 | controller | Tuesday 24 February 2026 21:56:25 +0000 (0:00:00.032) 0:00:55.912 ****** 2026-02-24 21:56:25.325512 | controller | skipping: [instance] 2026-02-24 21:56:25.766538 | controller | 2026-02-24 21:56:25.766560 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2026-02-24 21:56:25.766569 | controller | Tuesday 24 February 2026 21:56:25 +0000 (0:00:00.026) 0:00:55.939 ****** 2026-02-24 21:56:25.766578 | controller | ok: [instance] 2026-02-24 21:56:25.906702 | controller | 2026-02-24 21:56:25.906720 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2026-02-24 21:56:25.906728 | controller | Tuesday 24 February 2026 21:56:25 +0000 (0:00:00.440) 0:00:56.380 ****** 2026-02-24 21:56:25.906742 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 21:56:27.100207 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 21:56:27.100260 | controller | 2026-02-24 21:56:27.100275 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2026-02-24 21:56:27.100285 | controller | Tuesday 24 February 2026 21:56:25 +0000 (0:00:00.140) 0:00:56.520 ****** 2026-02-24 21:56:27.100303 | controller | ok: [instance] 2026-02-24 21:56:27.100358 | controller | 2026-02-24 21:56:27.100373 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2026-02-24 21:56:27.100479 | controller | Tuesday 24 February 2026 21:56:27 +0000 (0:00:01.193) 0:00:57.713 ****** 2026-02-24 21:56:30.715143 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2026-02-24 21:56:30.926104 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2026-02-24 21:56:30.926130 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2026-02-24 21:56:30.926139 | controller | 2026-02-24 21:56:30.926147 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2026-02-24 21:56:30.926154 | controller | Tuesday 24 February 2026 21:56:30 +0000 (0:00:03.615) 0:01:01.328 ****** 2026-02-24 21:56:30.926165 | controller | changed: [instance] 2026-02-24 21:56:30.926222 | controller | 2026-02-24 21:56:30.926251 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2026-02-24 21:56:30.926263 | controller | Tuesday 24 February 2026 21:56:30 +0000 (0:00:00.211) 0:01:01.539 ****** 2026-02-24 21:56:31.276202 | controller | changed: [instance] 2026-02-24 21:56:31.276266 | controller | 2026-02-24 21:56:31.276276 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2026-02-24 21:56:31.276285 | controller | Tuesday 24 February 2026 21:56:31 +0000 (0:00:00.349) 0:01:01.889 ****** 2026-02-24 21:56:31.654719 | controller | changed: [instance] 2026-02-24 21:56:31.687043 | controller | 2026-02-24 21:56:31.687079 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2026-02-24 21:56:31.687089 | controller | Tuesday 24 February 2026 21:56:31 +0000 (0:00:00.378) 0:01:02.268 ****** 2026-02-24 21:56:31.687100 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2026-02-24 21:56:32.069812 | controller | 2026-02-24 21:56:32.069833 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2026-02-24 21:56:32.069841 | controller | Tuesday 24 February 2026 21:56:31 +0000 (0:00:00.032) 0:01:02.300 ****** 2026-02-24 21:56:32.069850 | controller | changed: [instance] 2026-02-24 21:56:32.091511 | controller | 2026-02-24 21:56:32.091535 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2026-02-24 21:56:32.091545 | controller | Tuesday 24 February 2026 21:56:32 +0000 (0:00:00.382) 0:01:02.683 ****** 2026-02-24 21:56:32.091556 | controller | skipping: [instance] 2026-02-24 21:56:32.126143 | controller | 2026-02-24 21:56:32.126191 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2026-02-24 21:56:32.126200 | controller | Tuesday 24 February 2026 21:56:32 +0000 (0:00:00.021) 0:01:02.705 ****** 2026-02-24 21:56:32.126212 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2026-02-24 21:56:32.498459 | controller | 2026-02-24 21:56:32.498484 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2026-02-24 21:56:32.498492 | controller | Tuesday 24 February 2026 21:56:32 +0000 (0:00:00.034) 0:01:02.739 ****** 2026-02-24 21:56:32.498507 | controller | changed: [instance] 2026-02-24 21:56:32.518111 | controller | 2026-02-24 21:56:32.518140 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2026-02-24 21:56:32.518147 | controller | Tuesday 24 February 2026 21:56:32 +0000 (0:00:00.372) 0:01:03.111 ****** 2026-02-24 21:56:32.518157 | controller | skipping: [instance] 2026-02-24 21:56:32.518179 | controller | 2026-02-24 21:56:32.518186 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2026-02-24 21:56:32.518192 | controller | Tuesday 24 February 2026 21:56:32 +0000 (0:00:00.019) 0:01:03.131 ****** 2026-02-24 21:56:32.728170 | controller | ok: [instance] => (item=127.0.0.2) 2026-02-24 21:56:32.728229 | controller | 2026-02-24 21:56:32.728247 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2026-02-24 21:56:32.728344 | controller | Tuesday 24 February 2026 21:56:32 +0000 (0:00:00.210) 0:01:03.341 ****** 2026-02-24 21:56:33.397183 | controller | changed: [instance] 2026-02-24 21:56:33.417147 | controller | 2026-02-24 21:56:33.417182 | controller | TASK [dnsmasq : Stop service] ************************************************** 2026-02-24 21:56:33.417193 | controller | Tuesday 24 February 2026 21:56:33 +0000 (0:00:00.668) 0:01:04.010 ****** 2026-02-24 21:56:33.417205 | controller | skipping: [instance] 2026-02-24 21:56:33.417243 | controller | 2026-02-24 21:56:33.417368 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2026-02-24 21:56:33.417390 | controller | Tuesday 24 February 2026 21:56:33 +0000 (0:00:00.020) 0:01:04.031 ****** 2026-02-24 21:56:33.437151 | controller | skipping: [instance] 2026-02-24 21:56:33.437193 | controller | 2026-02-24 21:56:33.437455 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2026-02-24 21:56:33.468141 | controller | Tuesday 24 February 2026 21:56:33 +0000 (0:00:00.019) 0:01:04.051 ****** 2026-02-24 21:56:33.468171 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-24 21:56:33.468204 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2026-02-24 21:56:33.468212 | controller | skipping: [instance] 2026-02-24 21:56:33.468219 | controller | 2026-02-24 21:56:33.468228 | controller | TASK [Create dnsmasq networks] ************************************************* 2026-02-24 21:56:33.468315 | controller | Tuesday 24 February 2026 21:56:33 +0000 (0:00:00.030) 0:01:04.081 ****** 2026-02-24 21:56:33.580275 | controller | 2026-02-24 21:56:33.608120 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-24 21:56:33.608166 | controller | Tuesday 24 February 2026 21:56:33 +0000 (0:00:00.112) 0:01:04.193 ****** 2026-02-24 21:56:33.608180 | controller | ok: [instance] => changed=false 2026-02-24 21:56:33.646668 | controller | msg: All assertions passed 2026-02-24 21:56:33.646694 | controller | 2026-02-24 21:56:33.646703 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-24 21:56:33.646710 | controller | Tuesday 24 February 2026 21:56:33 +0000 (0:00:00.027) 0:01:04.221 ****** 2026-02-24 21:56:33.646721 | controller | ok: [instance] => changed=false 2026-02-24 21:56:33.646912 | controller | msg: All assertions passed 2026-02-24 21:56:33.647140 | controller | 2026-02-24 21:56:33.647231 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-24 21:56:33.647332 | controller | Tuesday 24 February 2026 21:56:33 +0000 (0:00:00.039) 0:01:04.260 ****** 2026-02-24 21:56:34.076511 | controller | changed: [instance] 2026-02-24 21:56:34.096625 | controller | 2026-02-24 21:56:34.096648 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-24 21:56:34.096658 | controller | Tuesday 24 February 2026 21:56:34 +0000 (0:00:00.429) 0:01:04.689 ****** 2026-02-24 21:56:34.096668 | controller | skipping: [instance] 2026-02-24 21:56:34.120954 | controller | 2026-02-24 21:56:34.120971 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-24 21:56:34.120978 | controller | Tuesday 24 February 2026 21:56:34 +0000 (0:00:00.020) 0:01:04.710 ****** 2026-02-24 21:56:34.120987 | controller | skipping: [instance] 2026-02-24 21:56:34.148732 | controller | 2026-02-24 21:56:34.148755 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-24 21:56:34.148770 | controller | Tuesday 24 February 2026 21:56:34 +0000 (0:00:00.024) 0:01:04.734 ****** 2026-02-24 21:56:34.148781 | controller | ok: [instance] => changed=false 2026-02-24 21:56:34.185993 | controller | msg: All assertions passed 2026-02-24 21:56:34.186013 | controller | 2026-02-24 21:56:34.186037 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-24 21:56:34.186061 | controller | Tuesday 24 February 2026 21:56:34 +0000 (0:00:00.027) 0:01:04.762 ****** 2026-02-24 21:56:34.186070 | controller | ok: [instance] => changed=false 2026-02-24 21:56:34.612866 | controller | msg: All assertions passed 2026-02-24 21:56:34.612896 | controller | 2026-02-24 21:56:34.612904 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-24 21:56:34.612911 | controller | Tuesday 24 February 2026 21:56:34 +0000 (0:00:00.037) 0:01:04.799 ****** 2026-02-24 21:56:34.612921 | controller | changed: [instance] 2026-02-24 21:56:34.631923 | controller | 2026-02-24 21:56:34.631939 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-24 21:56:34.631946 | controller | Tuesday 24 February 2026 21:56:34 +0000 (0:00:00.426) 0:01:05.226 ****** 2026-02-24 21:56:34.631955 | controller | skipping: [instance] 2026-02-24 21:56:34.656500 | controller | 2026-02-24 21:56:34.656524 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-24 21:56:34.656533 | controller | Tuesday 24 February 2026 21:56:34 +0000 (0:00:00.019) 0:01:05.245 ****** 2026-02-24 21:56:34.656543 | controller | skipping: [instance] 2026-02-24 21:56:34.686699 | controller | 2026-02-24 21:56:34.686718 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2026-02-24 21:56:34.686725 | controller | Tuesday 24 February 2026 21:56:34 +0000 (0:00:00.024) 0:01:05.270 ****** 2026-02-24 21:56:34.686734 | controller | skipping: [instance] 2026-02-24 21:56:35.178744 | controller | 2026-02-24 21:56:35.178774 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2026-02-24 21:56:35.178782 | controller | Tuesday 24 February 2026 21:56:34 +0000 (0:00:00.030) 0:01:05.300 ****** 2026-02-24 21:56:35.178792 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 21:56:35.218260 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 21:56:35.218293 | controller | 2026-02-24 21:56:35.218301 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 21:56:35.218308 | controller | Tuesday 24 February 2026 21:56:35 +0000 (0:00:00.491) 0:01:05.791 ****** 2026-02-24 21:56:35.218318 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2026-02-24 21:56:35.562753 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2026-02-24 21:56:35.562787 | controller | 2026-02-24 21:56:35.562795 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 21:56:35.562808 | controller | Tuesday 24 February 2026 21:56:35 +0000 (0:00:00.039) 0:01:05.831 ****** 2026-02-24 21:56:35.562818 | controller | ok: [instance] 2026-02-24 21:56:35.599976 | controller | 2026-02-24 21:56:35.600004 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-24 21:56:35.600014 | controller | Tuesday 24 February 2026 21:56:35 +0000 (0:00:00.344) 0:01:06.176 ****** 2026-02-24 21:56:35.600074 | controller | ok: [instance] 2026-02-24 21:56:35.807608 | controller | 2026-02-24 21:56:35.807630 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 21:56:35.807638 | controller | Tuesday 24 February 2026 21:56:35 +0000 (0:00:00.037) 0:01:06.213 ****** 2026-02-24 21:56:35.807647 | controller | ok: [instance] 2026-02-24 21:56:35.843472 | controller | 2026-02-24 21:56:35.843493 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-24 21:56:35.843500 | controller | Tuesday 24 February 2026 21:56:35 +0000 (0:00:00.207) 0:01:06.421 ****** 2026-02-24 21:56:35.843509 | controller | ok: [instance] 2026-02-24 21:56:36.176724 | controller | 2026-02-24 21:56:36.176757 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2026-02-24 21:56:36.176770 | controller | Tuesday 24 February 2026 21:56:35 +0000 (0:00:00.035) 0:01:06.457 ****** 2026-02-24 21:56:36.176780 | controller | changed: [instance] 2026-02-24 21:56:36.511844 | controller | 2026-02-24 21:56:36.511868 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2026-02-24 21:56:36.511876 | controller | Tuesday 24 February 2026 21:56:36 +0000 (0:00:00.332) 0:01:06.790 ****** 2026-02-24 21:56:36.511886 | controller | changed: [instance] 2026-02-24 21:56:36.840454 | controller | 2026-02-24 21:56:36.840473 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2026-02-24 21:56:36.840479 | controller | Tuesday 24 February 2026 21:56:36 +0000 (0:00:00.335) 0:01:07.125 ****** 2026-02-24 21:56:36.840487 | controller | changed: [instance] 2026-02-24 21:56:36.933522 | controller | 2026-02-24 21:56:36.933540 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2026-02-24 21:56:36.933546 | controller | Tuesday 24 February 2026 21:56:36 +0000 (0:00:00.328) 0:01:07.454 ****** 2026-02-24 21:56:36.933554 | controller | ok: [instance] 2026-02-24 21:56:37.266804 | controller | 2026-02-24 21:56:37.266832 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2026-02-24 21:56:37.266840 | controller | Tuesday 24 February 2026 21:56:36 +0000 (0:00:00.093) 0:01:07.547 ****** 2026-02-24 21:56:37.266849 | controller | changed: [instance] 2026-02-24 21:56:37.292975 | controller | 2026-02-24 21:56:37.292991 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 21:56:37.292997 | controller | Tuesday 24 February 2026 21:56:37 +0000 (0:00:00.333) 0:01:07.880 ****** 2026-02-24 21:56:37.293004 | controller | skipping: [instance] 2026-02-24 21:56:37.318191 | controller | 2026-02-24 21:56:37.318236 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 21:56:37.318251 | controller | Tuesday 24 February 2026 21:56:37 +0000 (0:00:00.026) 0:01:07.906 ****** 2026-02-24 21:56:37.318268 | controller | skipping: [instance] 2026-02-24 21:56:37.319409 | controller | 2026-02-24 21:56:37.320080 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 21:56:37.320460 | controller | Tuesday 24 February 2026 21:56:37 +0000 (0:00:00.024) 0:01:07.931 ****** 2026-02-24 21:56:37.342612 | controller | skipping: [instance] 2026-02-24 21:56:37.343860 | controller | 2026-02-24 21:56:37.344640 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 21:56:37.345509 | controller | Tuesday 24 February 2026 21:56:37 +0000 (0:00:00.025) 0:01:07.956 ****** 2026-02-24 21:56:37.380454 | controller | skipping: [instance] 2026-02-24 21:56:37.380576 | controller | 2026-02-24 21:56:37.380757 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 21:56:37.380863 | controller | Tuesday 24 February 2026 21:56:37 +0000 (0:00:00.038) 0:01:07.994 ****** 2026-02-24 21:56:37.399917 | controller | ok: [instance] 2026-02-24 21:56:37.400005 | controller | 2026-02-24 21:56:37.400134 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 21:56:37.400268 | controller | Tuesday 24 February 2026 21:56:37 +0000 (0:00:00.019) 0:01:08.013 ****** 2026-02-24 21:56:37.489685 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-24 21:56:37.489828 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-24 21:56:37.489972 | controller | 2026-02-24 21:56:37.490104 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 21:56:37.490235 | controller | Tuesday 24 February 2026 21:56:37 +0000 (0:00:00.089) 0:01:08.103 ****** 2026-02-24 21:56:37.507970 | controller | skipping: [instance] 2026-02-24 21:56:37.508107 | controller | 2026-02-24 21:56:37.508282 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 21:56:37.508376 | controller | Tuesday 24 February 2026 21:56:37 +0000 (0:00:00.018) 0:01:08.121 ****** 2026-02-24 21:56:37.707916 | controller | ok: [instance] 2026-02-24 21:56:38.093122 | controller | 2026-02-24 21:56:38.093154 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 21:56:38.093163 | controller | Tuesday 24 February 2026 21:56:37 +0000 (0:00:00.199) 0:01:08.321 ****** 2026-02-24 21:56:38.093173 | controller | changed: [instance] 2026-02-24 21:56:38.093400 | controller | 2026-02-24 21:56:38.093415 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 21:56:38.156864 | controller | Tuesday 24 February 2026 21:56:38 +0000 (0:00:00.385) 0:01:08.706 ****** 2026-02-24 21:56:38.156888 | controller | ok: [instance] 2026-02-24 21:56:38.189087 | controller | 2026-02-24 21:56:38.189104 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 21:56:38.189111 | controller | Tuesday 24 February 2026 21:56:38 +0000 (0:00:00.063) 0:01:08.770 ****** 2026-02-24 21:56:38.189119 | controller | ok: [instance] 2026-02-24 21:56:38.189318 | controller | 2026-02-24 21:56:38.189331 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 21:56:38.584317 | controller | Tuesday 24 February 2026 21:56:38 +0000 (0:00:00.032) 0:01:08.802 ****** 2026-02-24 21:56:38.584364 | controller | changed: [instance] 2026-02-24 21:56:38.613635 | controller | 2026-02-24 21:56:38.613653 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2026-02-24 21:56:38.613660 | controller | Tuesday 24 February 2026 21:56:38 +0000 (0:00:00.393) 0:01:09.196 ****** 2026-02-24 21:56:38.613669 | controller | ok: [instance] 2026-02-24 21:56:38.632397 | controller | 2026-02-24 21:56:38.632415 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2026-02-24 21:56:38.632422 | controller | Tuesday 24 February 2026 21:56:38 +0000 (0:00:00.030) 0:01:09.227 ****** 2026-02-24 21:56:38.632431 | controller | ok: [instance] 2026-02-24 21:56:38.652570 | controller | 2026-02-24 21:56:38.652588 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2026-02-24 21:56:38.652598 | controller | Tuesday 24 February 2026 21:56:38 +0000 (0:00:00.018) 0:01:09.246 ****** 2026-02-24 21:56:38.652607 | controller | ok: [instance] 2026-02-24 21:56:38.725263 | controller | 2026-02-24 21:56:38.725315 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2026-02-24 21:56:38.725326 | controller | Tuesday 24 February 2026 21:56:38 +0000 (0:00:00.020) 0:01:09.266 ****** 2026-02-24 21:56:38.725341 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2026-02-24 21:56:38.725365 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2026-02-24 21:56:38.725373 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2026-02-24 21:56:38.725383 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2026-02-24 21:56:38.725858 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2026-02-24 21:56:38.857744 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2026-02-24 21:56:38.857766 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2026-02-24 21:56:38.857773 | controller | 2026-02-24 21:56:38.857779 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 21:56:38.857785 | controller | Tuesday 24 February 2026 21:56:38 +0000 (0:00:00.072) 0:01:09.339 ****** 2026-02-24 21:56:38.857793 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2026-02-24 21:56:38.934279 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2026-02-24 21:56:38.934333 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2026-02-24 21:56:38.934347 | controller | 2026-02-24 21:56:38.934358 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 21:56:38.934369 | controller | Tuesday 24 February 2026 21:56:38 +0000 (0:00:00.132) 0:01:09.471 ****** 2026-02-24 21:56:38.934387 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2026-02-24 21:56:38.934417 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2026-02-24 21:56:38.934431 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2026-02-24 21:56:38.934606 | controller | skipping: [instance] 2026-02-24 21:56:38.934625 | controller | 2026-02-24 21:56:38.934635 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 21:56:39.011191 | controller | Tuesday 24 February 2026 21:56:38 +0000 (0:00:00.076) 0:01:09.547 ****** 2026-02-24 21:56:39.011232 | controller | skipping: [instance] => (item=compute-0 - storage) 2026-02-24 21:56:39.011263 | controller | skipping: [instance] => (item=controller-0 - storage) 2026-02-24 21:56:39.011271 | controller | skipping: [instance] => (item=crc-0 - storage) 2026-02-24 21:56:39.011281 | controller | skipping: [instance] 2026-02-24 21:56:39.011306 | controller | 2026-02-24 21:56:39.011496 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 21:56:39.089213 | controller | Tuesday 24 February 2026 21:56:39 +0000 (0:00:00.076) 0:01:09.624 ****** 2026-02-24 21:56:39.089254 | controller | skipping: [instance] => (item=compute-0 - tenant) 2026-02-24 21:56:39.164997 | controller | skipping: [instance] => (item=controller-0 - tenant) 2026-02-24 21:56:39.165047 | controller | skipping: [instance] => (item=crc-0 - tenant) 2026-02-24 21:56:39.165061 | controller | skipping: [instance] 2026-02-24 21:56:39.165068 | controller | 2026-02-24 21:56:39.165075 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 21:56:39.165081 | controller | Tuesday 24 February 2026 21:56:39 +0000 (0:00:00.077) 0:01:09.702 ****** 2026-02-24 21:56:39.165092 | controller | skipping: [instance] => (item=compute-0 - external) 2026-02-24 21:56:39.165158 | controller | skipping: [instance] => (item=controller-0 - external) 2026-02-24 21:56:39.165323 | controller | skipping: [instance] => (item=crc-0 - external) 2026-02-24 21:56:39.165423 | controller | skipping: [instance] 2026-02-24 21:56:39.165524 | controller | 2026-02-24 21:56:39.165625 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 21:56:39.165727 | controller | Tuesday 24 February 2026 21:56:39 +0000 (0:00:00.076) 0:01:09.778 ****** 2026-02-24 21:56:39.245186 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2026-02-24 21:56:39.245410 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2026-02-24 21:56:39.245557 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2026-02-24 21:56:39.245730 | controller | skipping: [instance] 2026-02-24 21:56:39.245793 | controller | 2026-02-24 21:56:39.245893 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 21:56:39.245990 | controller | Tuesday 24 February 2026 21:56:39 +0000 (0:00:00.079) 0:01:09.858 ****** 2026-02-24 21:56:39.375907 | controller | ok: [instance] => (item=compute-0 - public) 2026-02-24 21:56:39.376016 | controller | ok: [instance] => (item=controller-0 - public) 2026-02-24 21:56:39.376148 | controller | ok: [instance] => (item=crc-0 - public) 2026-02-24 21:56:39.376261 | controller | 2026-02-24 21:56:39.376370 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2026-02-24 21:56:39.376475 | controller | Tuesday 24 February 2026 21:56:39 +0000 (0:00:00.130) 0:01:09.989 ****** 2026-02-24 21:56:39.478858 | controller | 2026-02-24 21:56:39.478968 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2026-02-24 21:56:39.479135 | controller | Tuesday 24 February 2026 21:56:39 +0000 (0:00:00.103) 0:01:10.092 ****** 2026-02-24 21:56:39.516278 | controller | ok: [instance] 2026-02-24 21:56:39.516373 | controller | 2026-02-24 21:56:39.516512 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2026-02-24 21:56:39.516628 | controller | Tuesday 24 February 2026 21:56:39 +0000 (0:00:00.037) 0:01:10.130 ****** 2026-02-24 21:56:39.608218 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:b4:57:13', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-24 21:56:39.608366 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:69:82:7f', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-24 21:56:39.608466 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:aa:9c:cb', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-24 21:56:39.608586 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:ce:94:7b', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-24 21:56:39.608687 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:17:10:87', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-24 21:56:39.608803 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:e1:07:ea', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-24 21:56:39.608895 | controller | 2026-02-24 21:56:39.609001 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2026-02-24 21:56:39.609143 | controller | Tuesday 24 February 2026 21:56:39 +0000 (0:00:00.091) 0:01:10.222 ****** 2026-02-24 21:56:39.660568 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2026-02-24 21:56:39.660773 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2026-02-24 21:56:39.660873 | controller | 2026-02-24 21:56:39.660978 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-24 21:56:39.661123 | controller | Tuesday 24 February 2026 21:56:39 +0000 (0:00:00.052) 0:01:10.274 ****** 2026-02-24 21:56:39.836168 | controller | ok: [instance] 2026-02-24 21:56:39.836209 | controller | 2026-02-24 21:56:39.836223 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-24 21:56:39.836237 | controller | Tuesday 24 February 2026 21:56:39 +0000 (0:00:00.175) 0:01:10.449 ****** 2026-02-24 21:56:39.859519 | controller | ok: [instance] 2026-02-24 21:56:40.040126 | controller | 2026-02-24 21:56:40.040189 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-24 21:56:40.040200 | controller | Tuesday 24 February 2026 21:56:39 +0000 (0:00:00.023) 0:01:10.473 ****** 2026-02-24 21:56:40.040217 | controller | ok: [instance] 2026-02-24 21:56:40.040259 | controller | 2026-02-24 21:56:40.040270 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-24 21:56:40.040296 | controller | Tuesday 24 February 2026 21:56:40 +0000 (0:00:00.180) 0:01:10.653 ****** 2026-02-24 21:56:40.064744 | controller | ok: [instance] 2026-02-24 21:56:40.086044 | controller | 2026-02-24 21:56:40.086075 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2026-02-24 21:56:40.086083 | controller | Tuesday 24 February 2026 21:56:40 +0000 (0:00:00.024) 0:01:10.678 ****** 2026-02-24 21:56:40.086094 | controller | ok: [instance] 2026-02-24 21:56:40.269169 | controller | 2026-02-24 21:56:40.269203 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2026-02-24 21:56:40.269213 | controller | Tuesday 24 February 2026 21:56:40 +0000 (0:00:00.021) 0:01:10.699 ****** 2026-02-24 21:56:40.269226 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:b4:57:13', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-24 21:56:40.307442 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:69:82:7f', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-24 21:56:40.307476 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:aa:9c:cb', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-24 21:56:40.307484 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:ce:94:7b', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-24 21:56:40.307490 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:17:10:87', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-24 21:56:40.307495 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:e1:07:ea', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-24 21:56:40.307501 | controller | 2026-02-24 21:56:40.307507 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2026-02-24 21:56:40.307513 | controller | Tuesday 24 February 2026 21:56:40 +0000 (0:00:00.182) 0:01:10.881 ****** 2026-02-24 21:56:40.307523 | controller | ok: [instance] 2026-02-24 21:56:42.321109 | controller | 2026-02-24 21:56:42.321140 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2026-02-24 21:56:42.321148 | controller | Tuesday 24 February 2026 21:56:40 +0000 (0:00:00.039) 0:01:10.921 ****** 2026-02-24 21:56:42.321159 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:b4:57:13', 'entry': 'set:compute,52:54:00:b4:57:13,192.168.140.100,compute-0', 'state': 'present'}) 2026-02-24 21:56:42.321183 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:69:82:7f', 'entry': 'set:controller,52:54:01:69:82:7f,192.168.140.9,controller-0', 'state': 'present'}) 2026-02-24 21:56:42.321189 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:aa:9c:cb', 'entry': 'set:ocp,52:54:02:aa:9c:cb,192.168.140.10,crc-0', 'state': 'present'}) 2026-02-24 21:56:42.321195 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:ce:94:7b', 'entry': 'set:compute,52:54:00:ce:94:7b,192.168.101.100,compute-0', 'state': 'present'}) 2026-02-24 21:56:42.321202 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:17:10:87', 'entry': 'set:controller,52:54:01:17:10:87,192.168.101.9,controller-0', 'state': 'present'}) 2026-02-24 21:56:42.321530 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:e1:07:ea', 'entry': 'set:ocp,52:54:02:e1:07:ea,192.168.101.10,crc-0', 'state': 'present'}) 2026-02-24 21:56:42.344168 | controller | 2026-02-24 21:56:42.344199 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2026-02-24 21:56:42.344212 | controller | Tuesday 24 February 2026 21:56:42 +0000 (0:00:02.013) 0:01:12.934 ****** 2026-02-24 21:56:42.344227 | controller | skipping: [instance] 2026-02-24 21:56:42.344257 | controller | 2026-02-24 21:56:42.344529 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2026-02-24 21:56:42.561288 | controller | Tuesday 24 February 2026 21:56:42 +0000 (0:00:00.023) 0:01:12.957 ****** 2026-02-24 21:56:42.561315 | controller | ok: [instance] => (item=compute-0) 2026-02-24 21:56:42.561345 | controller | ok: [instance] => (item=controller-0) 2026-02-24 21:56:42.561353 | controller | ok: [instance] => (item=crc-0) 2026-02-24 21:56:42.561360 | controller | 2026-02-24 21:56:42.561367 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2026-02-24 21:56:42.561376 | controller | Tuesday 24 February 2026 21:56:42 +0000 (0:00:00.216) 0:01:13.174 ****** 2026-02-24 21:56:42.674884 | controller | 2026-02-24 21:56:42.715170 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 21:56:42.715210 | controller | Tuesday 24 February 2026 21:56:42 +0000 (0:00:00.113) 0:01:13.288 ****** 2026-02-24 21:56:42.715226 | controller | ok: [instance] 2026-02-24 21:56:42.715260 | controller | 2026-02-24 21:56:42.715272 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 21:56:42.715333 | controller | Tuesday 24 February 2026 21:56:42 +0000 (0:00:00.040) 0:01:13.328 ****** 2026-02-24 21:56:42.909191 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 21:56:42.909374 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 21:56:42.909533 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 21:56:42.909654 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 21:56:42.909772 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 21:56:42.909897 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 21:56:42.910043 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 21:56:42.910200 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 21:56:42.910322 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 21:56:42.910438 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 21:56:42.910551 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 21:56:42.910714 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 21:56:42.910828 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 21:56:42.910946 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 21:56:42.911089 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 21:56:42.911212 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 21:56:42.911320 | controller | 2026-02-24 21:56:42.911432 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 21:56:42.911550 | controller | Tuesday 24 February 2026 21:56:42 +0000 (0:00:00.194) 0:01:13.523 ****** 2026-02-24 21:56:45.881145 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 21:56:45.881211 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 21:56:45.881227 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 21:56:45.881237 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 21:56:45.882575 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 21:56:46.229184 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 21:56:46.229219 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 21:56:46.229229 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 21:56:46.229237 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 21:56:46.229243 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 21:56:46.229250 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 21:56:46.229257 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 21:56:46.229263 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 21:56:46.229270 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 21:56:46.229276 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 21:56:46.229283 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 21:56:46.229289 | controller | 2026-02-24 21:56:46.229296 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 21:56:46.229303 | controller | Tuesday 24 February 2026 21:56:45 +0000 (0:00:02.971) 0:01:16.494 ****** 2026-02-24 21:56:46.229320 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 21:56:46.229350 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 21:56:46.229360 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 21:56:46.230147 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 21:56:46.230173 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 21:56:46.230196 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 21:56:46.230204 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 21:56:46.230210 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 21:56:46.230217 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 21:56:46.230224 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 21:56:46.230230 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 21:56:46.230239 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 21:56:46.230267 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 21:56:46.230796 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 21:56:46.249153 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 21:56:46.249175 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 21:56:46.249189 | controller | 2026-02-24 21:56:46.249197 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2026-02-24 21:56:46.249204 | controller | Tuesday 24 February 2026 21:56:46 +0000 (0:00:00.348) 0:01:16.842 ****** 2026-02-24 21:56:46.249214 | controller | ok: [instance] 2026-02-24 21:56:46.249409 | controller | 2026-02-24 21:56:46.249431 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2026-02-24 21:56:46.292074 | controller | Tuesday 24 February 2026 21:56:46 +0000 (0:00:00.020) 0:01:16.862 ****** 2026-02-24 21:56:46.292097 | controller | skipping: [instance] => (item=compute) 2026-02-24 21:56:46.292419 | controller | skipping: [instance] => (item=controller) 2026-02-24 21:56:46.292435 | controller | skipping: [instance] => (item=crc) 2026-02-24 21:56:46.292446 | controller | skipping: [instance] 2026-02-24 21:56:46.324150 | controller | 2026-02-24 21:56:46.324182 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2026-02-24 21:56:46.324192 | controller | Tuesday 24 February 2026 21:56:46 +0000 (0:00:00.042) 0:01:16.905 ****** 2026-02-24 21:56:46.324206 | controller | skipping: [instance] 2026-02-24 21:56:46.693154 | controller | 2026-02-24 21:56:46.693183 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2026-02-24 21:56:46.693193 | controller | Tuesday 24 February 2026 21:56:46 +0000 (0:00:00.032) 0:01:16.937 ****** 2026-02-24 21:56:46.693203 | controller | changed: [instance] 2026-02-24 21:56:46.693230 | controller | 2026-02-24 21:56:46.693238 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2026-02-24 21:56:46.693244 | controller | Tuesday 24 February 2026 21:56:46 +0000 (0:00:00.357) 0:01:17.295 ****** 2026-02-24 21:56:46.693250 | controller | 2026-02-24 21:56:46.693258 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-24 21:56:46.693327 | controller | Tuesday 24 February 2026 21:56:46 +0000 (0:00:00.010) 0:01:17.306 ****** 2026-02-24 21:56:47.307438 | controller | changed: [instance] 2026-02-24 21:56:47.656099 | controller | 2026-02-24 21:56:47.656128 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 21:56:47.656136 | controller | Tuesday 24 February 2026 21:56:47 +0000 (0:00:00.614) 0:01:17.920 ****** 2026-02-24 21:56:47.656145 | controller | changed: [instance] 2026-02-24 21:56:47.656167 | controller | 2026-02-24 21:56:47.656175 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2026-02-24 21:56:47.656272 | controller | Tuesday 24 February 2026 21:56:47 +0000 (0:00:00.348) 0:01:18.269 ****** 2026-02-24 21:56:47.994633 | controller | changed: [instance] 2026-02-24 21:56:48.351130 | controller | 2026-02-24 21:56:48.351164 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2026-02-24 21:56:48.351172 | controller | Tuesday 24 February 2026 21:56:47 +0000 (0:00:00.338) 0:01:18.608 ****** 2026-02-24 21:56:48.351183 | controller | changed: [instance] 2026-02-24 21:56:48.351209 | controller | 2026-02-24 21:56:48.351217 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2026-02-24 21:56:48.351239 | controller | Tuesday 24 February 2026 21:56:48 +0000 (0:00:00.356) 0:01:18.964 ****** 2026-02-24 21:56:48.716168 | controller | changed: [instance] 2026-02-24 21:56:48.716227 | controller | 2026-02-24 21:56:48.716240 | controller | TASK [Build utility records dataset] ******************************************* 2026-02-24 21:56:48.716378 | controller | Tuesday 24 February 2026 21:56:48 +0000 (0:00:00.365) 0:01:19.329 ****** 2026-02-24 21:56:48.747400 | controller | 2026-02-24 21:56:48.835894 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 21:56:48.835912 | controller | Tuesday 24 February 2026 21:56:48 +0000 (0:00:00.031) 0:01:19.361 ****** 2026-02-24 21:56:48.835926 | controller | ok: [instance] 2026-02-24 21:56:48.932234 | controller | 2026-02-24 21:56:48.932272 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 21:56:48.932285 | controller | Tuesday 24 February 2026 21:56:48 +0000 (0:00:00.088) 0:01:19.449 ****** 2026-02-24 21:56:48.932301 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 21:56:49.377576 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 21:56:49.377605 | controller | 2026-02-24 21:56:49.377612 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 21:56:49.377619 | controller | Tuesday 24 February 2026 21:56:48 +0000 (0:00:00.096) 0:01:19.545 ****** 2026-02-24 21:56:49.377628 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 21:56:49.663152 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 21:56:49.663187 | controller | 2026-02-24 21:56:49.663197 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 21:56:49.663205 | controller | Tuesday 24 February 2026 21:56:49 +0000 (0:00:00.445) 0:01:19.990 ****** 2026-02-24 21:56:49.663225 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 21:56:49.663257 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 21:56:49.663265 | controller | 2026-02-24 21:56:49.663271 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-24 21:56:49.663278 | controller | Tuesday 24 February 2026 21:56:49 +0000 (0:00:00.274) 0:01:20.265 ****** 2026-02-24 21:56:49.663287 | controller | 2026-02-24 21:56:49.663483 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 21:56:50.126669 | controller | Tuesday 24 February 2026 21:56:49 +0000 (0:00:00.011) 0:01:20.276 ****** 2026-02-24 21:56:50.126706 | controller | changed: [instance] 2026-02-24 21:56:50.126736 | controller | 2026-02-24 21:56:50.126744 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 21:56:50.126848 | controller | Tuesday 24 February 2026 21:56:50 +0000 (0:00:00.463) 0:01:20.740 ****** 2026-02-24 21:56:50.477472 | controller | changed: [instance] 2026-02-24 21:56:50.510217 | controller | 2026-02-24 21:56:50.510263 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2026-02-24 21:56:50.510277 | controller | Tuesday 24 February 2026 21:56:50 +0000 (0:00:00.350) 0:01:21.090 ****** 2026-02-24 21:56:50.510294 | controller | skipping: [instance] 2026-02-24 21:56:50.510338 | controller | 2026-02-24 21:56:50.510353 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2026-02-24 21:56:50.510435 | controller | Tuesday 24 February 2026 21:56:50 +0000 (0:00:00.033) 0:01:21.123 ****** 2026-02-24 21:56:50.587077 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2026-02-24 21:56:50.772941 | controller | 2026-02-24 21:56:50.772961 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2026-02-24 21:56:50.772969 | controller | Tuesday 24 February 2026 21:56:50 +0000 (0:00:00.076) 0:01:21.200 ****** 2026-02-24 21:56:50.772978 | controller | ok: [instance] 2026-02-24 21:56:50.793515 | controller | 2026-02-24 21:56:50.793531 | controller | TASK [Deploy CRC if needed] **************************************************** 2026-02-24 21:56:50.793537 | controller | Tuesday 24 February 2026 21:56:50 +0000 (0:00:00.185) 0:01:21.386 ****** 2026-02-24 21:56:50.793545 | controller | skipping: [instance] 2026-02-24 21:56:51.136207 | controller | 2026-02-24 21:56:51.136240 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2026-02-24 21:56:51.136248 | controller | Tuesday 24 February 2026 21:56:50 +0000 (0:00:00.020) 0:01:21.407 ****** 2026-02-24 21:56:51.136258 | controller | ok: [instance] 2026-02-24 21:56:51.363197 | controller | 2026-02-24 21:56:51.363237 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2026-02-24 21:56:51.363251 | controller | Tuesday 24 February 2026 21:56:51 +0000 (0:00:00.342) 0:01:21.749 ****** 2026-02-24 21:56:51.363267 | controller | ok: [instance] 2026-02-24 21:56:51.363315 | controller | 2026-02-24 21:56:51.363329 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2026-02-24 21:56:51.363366 | controller | Tuesday 24 February 2026 21:56:51 +0000 (0:00:00.227) 0:01:21.976 ****** 2026-02-24 21:56:51.573780 | controller | ok: [instance] 2026-02-24 21:56:51.781063 | controller | 2026-02-24 21:56:51.781096 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2026-02-24 21:56:51.781107 | controller | Tuesday 24 February 2026 21:56:51 +0000 (0:00:00.210) 0:01:22.187 ****** 2026-02-24 21:56:51.781118 | controller | ok: [instance] 2026-02-24 21:56:51.993776 | controller | 2026-02-24 21:56:51.993795 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2026-02-24 21:56:51.993803 | controller | Tuesday 24 February 2026 21:56:51 +0000 (0:00:00.207) 0:01:22.394 ****** 2026-02-24 21:56:51.993811 | controller | ok: [instance] 2026-02-24 21:56:52.031138 | controller | 2026-02-24 21:56:52.031159 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 21:56:52.031174 | controller | Tuesday 24 February 2026 21:56:51 +0000 (0:00:00.212) 0:01:22.607 ****** 2026-02-24 21:56:52.031189 | controller | 2026-02-24 21:56:52.031219 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-24 21:56:52.031243 | controller | Tuesday 24 February 2026 21:56:52 +0000 (0:00:00.037) 0:01:22.645 ****** 2026-02-24 21:56:52.220175 | controller | ok: [instance] 2026-02-24 21:56:52.220251 | controller | 2026-02-24 21:56:52.220389 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-24 21:56:52.220417 | controller | Tuesday 24 February 2026 21:56:52 +0000 (0:00:00.188) 0:01:22.833 ****** 2026-02-24 21:56:52.244167 | controller | ok: [instance] 2026-02-24 21:56:52.268747 | controller | 2026-02-24 21:56:52.268774 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-24 21:56:52.268783 | controller | Tuesday 24 February 2026 21:56:52 +0000 (0:00:00.023) 0:01:22.857 ****** 2026-02-24 21:56:52.268793 | controller | skipping: [instance] 2026-02-24 21:56:52.545141 | controller | 2026-02-24 21:56:52.545173 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2026-02-24 21:56:52.545181 | controller | Tuesday 24 February 2026 21:56:52 +0000 (0:00:00.024) 0:01:22.882 ****** 2026-02-24 21:56:52.545191 | controller | ok: [instance] 2026-02-24 21:56:52.545216 | controller | 2026-02-24 21:56:52.545364 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2026-02-24 21:56:52.764557 | controller | Tuesday 24 February 2026 21:56:52 +0000 (0:00:00.276) 0:01:23.159 ****** 2026-02-24 21:56:52.764583 | controller | ok: [instance] 2026-02-24 21:56:52.931879 | controller | 2026-02-24 21:56:52.931906 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2026-02-24 21:56:52.931914 | controller | Tuesday 24 February 2026 21:56:52 +0000 (0:00:00.219) 0:01:23.378 ****** 2026-02-24 21:56:52.931923 | controller | ok: [instance] 2026-02-24 21:56:52.988414 | controller | 2026-02-24 21:56:52.988434 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2026-02-24 21:56:52.988440 | controller | Tuesday 24 February 2026 21:56:52 +0000 (0:00:00.167) 0:01:23.545 ****** 2026-02-24 21:56:52.988448 | controller | 2026-02-24 21:56:53.030803 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-24 21:56:53.030819 | controller | Tuesday 24 February 2026 21:56:52 +0000 (0:00:00.056) 0:01:23.602 ****** 2026-02-24 21:56:53.030829 | controller | ok: [instance] => changed=false 2026-02-24 21:56:53.205946 | controller | msg: All assertions passed 2026-02-24 21:56:53.205967 | controller | 2026-02-24 21:56:53.205974 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-24 21:56:53.205980 | controller | Tuesday 24 February 2026 21:56:53 +0000 (0:00:00.042) 0:01:23.644 ****** 2026-02-24 21:56:53.205989 | controller | ok: [instance] 2026-02-24 21:56:53.386352 | controller | 2026-02-24 21:56:53.386375 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-24 21:56:53.386384 | controller | Tuesday 24 February 2026 21:56:53 +0000 (0:00:00.175) 0:01:23.819 ****** 2026-02-24 21:56:53.386394 | controller | ok: [instance] 2026-02-24 21:56:53.412095 | controller | 2026-02-24 21:56:53.412118 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-24 21:56:53.412126 | controller | Tuesday 24 February 2026 21:56:53 +0000 (0:00:00.180) 0:01:23.999 ****** 2026-02-24 21:56:53.412135 | controller | ok: [instance] => changed=false 2026-02-24 21:56:53.592627 | controller | msg: All assertions passed 2026-02-24 21:56:53.592657 | controller | 2026-02-24 21:56:53.592665 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-24 21:56:53.592672 | controller | Tuesday 24 February 2026 21:56:53 +0000 (0:00:00.025) 0:01:24.025 ****** 2026-02-24 21:56:53.592682 | controller | ok: [instance] 2026-02-24 21:56:53.761579 | controller | 2026-02-24 21:56:53.761603 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-24 21:56:53.761611 | controller | Tuesday 24 February 2026 21:56:53 +0000 (0:00:00.180) 0:01:24.206 ****** 2026-02-24 21:56:53.761620 | controller | ok: [instance] 2026-02-24 21:56:53.810152 | controller | 2026-02-24 21:56:53.810181 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-24 21:56:53.810192 | controller | Tuesday 24 February 2026 21:56:53 +0000 (0:00:00.169) 0:01:24.375 ****** 2026-02-24 21:56:53.810204 | controller | ok: [instance] 2026-02-24 21:56:53.810289 | controller | 2026-02-24 21:56:53.810302 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2026-02-24 21:56:53.810313 | controller | Tuesday 24 February 2026 21:56:53 +0000 (0:00:00.048) 0:01:24.423 ****** 2026-02-24 21:56:54.182991 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2026-02-24 21:56:54.201665 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2026-02-24 21:56:54.201686 | controller | 2026-02-24 21:56:54.201696 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2026-02-24 21:56:54.201708 | controller | Tuesday 24 February 2026 21:56:54 +0000 (0:00:00.372) 0:01:24.796 ****** 2026-02-24 21:56:54.201721 | controller | skipping: [instance] 2026-02-24 21:56:54.224943 | controller | 2026-02-24 21:56:54.224961 | controller | TASK [Load the architecture local kustomize patches] *************************** 2026-02-24 21:56:54.224968 | controller | Tuesday 24 February 2026 21:56:54 +0000 (0:00:00.018) 0:01:24.815 ****** 2026-02-24 21:56:54.224978 | controller | skipping: [instance] 2026-02-24 21:56:54.377782 | controller | 2026-02-24 21:56:54.377801 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2026-02-24 21:56:54.377808 | controller | Tuesday 24 February 2026 21:56:54 +0000 (0:00:00.023) 0:01:24.838 ****** 2026-02-24 21:56:54.377823 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2026-02-24 21:56:54.403018 | controller | 2026-02-24 21:56:54.403067 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2026-02-24 21:56:54.403077 | controller | Tuesday 24 February 2026 21:56:54 +0000 (0:00:00.152) 0:01:24.991 ****** 2026-02-24 21:56:54.403088 | controller | skipping: [instance] 2026-02-24 21:56:54.809140 | controller | 2026-02-24 21:56:54.809176 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2026-02-24 21:56:54.809185 | controller | Tuesday 24 February 2026 21:56:54 +0000 (0:00:00.025) 0:01:25.016 ****** 2026-02-24 21:56:54.809197 | controller | changed: [instance] 2026-02-24 21:56:54.809236 | controller | 2026-02-24 21:56:54.809259 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2026-02-24 21:56:54.809388 | controller | Tuesday 24 February 2026 21:56:54 +0000 (0:00:00.406) 0:01:25.422 ****** 2026-02-24 21:56:55.295164 | controller | changed: [instance] 2026-02-24 21:56:55.295224 | controller | 2026-02-24 21:56:55.295235 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2026-02-24 21:56:55.295244 | controller | Tuesday 24 February 2026 21:56:55 +0000 (0:00:00.474) 0:01:25.897 ****** 2026-02-24 21:56:55.295251 | controller | 2026-02-24 21:56:55.295261 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 21:56:55.295366 | controller | Tuesday 24 February 2026 21:56:55 +0000 (0:00:00.011) 0:01:25.908 ****** 2026-02-24 21:56:55.701746 | controller | changed: [instance] 2026-02-24 21:56:56.341710 | controller | 2026-02-24 21:56:56.341750 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-24 21:56:56.341758 | controller | Tuesday 24 February 2026 21:56:55 +0000 (0:00:00.406) 0:01:26.315 ****** 2026-02-24 21:56:56.341769 | controller | changed: [instance] 2026-02-24 21:56:56.376751 | controller | 2026-02-24 21:56:56.376784 | controller | TASK [Deploy virtualbmc] ******************************************************* 2026-02-24 21:56:56.376792 | controller | Tuesday 24 February 2026 21:56:56 +0000 (0:00:00.639) 0:01:26.955 ****** 2026-02-24 21:56:56.376802 | controller | skipping: [instance] 2026-02-24 21:56:56.409231 | controller | 2026-02-24 21:56:56.409255 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2026-02-24 21:56:56.409262 | controller | Tuesday 24 February 2026 21:56:56 +0000 (0:00:00.035) 0:01:26.990 ****** 2026-02-24 21:56:56.409272 | controller | skipping: [instance] 2026-02-24 21:56:56.944967 | controller | 2026-02-24 21:56:56.945206 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2026-02-24 21:56:56.945233 | controller | Tuesday 24 February 2026 21:56:56 +0000 (0:00:00.032) 0:01:27.022 ****** 2026-02-24 21:56:56.945246 | controller | changed: [instance] => (item=workload) 2026-02-24 21:56:56.946055 | controller | changed: [instance] => (item=reproducer-inventory) 2026-02-24 21:56:56.946119 | controller | ok: [instance] => (item=volumes) 2026-02-24 21:56:56.946135 | controller | 2026-02-24 21:56:56.946335 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2026-02-24 21:56:57.337147 | controller | Tuesday 24 February 2026 21:56:56 +0000 (0:00:00.535) 0:01:27.558 ****** 2026-02-24 21:56:57.337189 | controller | changed: [instance] => (item=workload) 2026-02-24 21:56:57.337223 | controller | changed: [instance] => (item=volumes) 2026-02-24 21:56:57.337232 | controller | 2026-02-24 21:56:57.337241 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2026-02-24 21:56:57.337347 | controller | Tuesday 24 February 2026 21:56:57 +0000 (0:00:00.391) 0:01:27.950 ****** 2026-02-24 21:56:57.361840 | controller | skipping: [instance] 2026-02-24 21:56:58.355915 | controller | 2026-02-24 21:56:58.355946 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2026-02-24 21:56:58.355954 | controller | Tuesday 24 February 2026 21:56:57 +0000 (0:00:00.024) 0:01:27.975 ****** 2026-02-24 21:56:58.355964 | controller | changed: [instance] => (item=compute) 2026-02-24 21:56:58.386953 | controller | changed: [instance] => (item=controller) 2026-02-24 21:56:58.386972 | controller | changed: [instance] => (item=crc) 2026-02-24 21:56:58.386979 | controller | 2026-02-24 21:56:58.386985 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2026-02-24 21:56:58.386991 | controller | Tuesday 24 February 2026 21:56:58 +0000 (0:00:00.993) 0:01:28.969 ****** 2026-02-24 21:56:58.387002 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance 2026-02-24 21:56:58.559940 | controller | 2026-02-24 21:56:58.559971 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] ***************** 2026-02-24 21:56:58.559979 | controller | Tuesday 24 February 2026 21:56:58 +0000 (0:00:00.031) 0:01:29.000 ****** 2026-02-24 21:56:58.559988 | controller | ok: [instance] 2026-02-24 21:56:58.579038 | controller | 2026-02-24 21:56:58.579060 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* 2026-02-24 21:56:58.579081 | controller | Tuesday 24 February 2026 21:56:58 +0000 (0:00:00.172) 0:01:29.173 ****** 2026-02-24 21:56:58.579092 | controller | skipping: [instance] 2026-02-24 21:56:58.936154 | controller | 2026-02-24 21:56:58.936191 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] *** 2026-02-24 21:56:58.936202 | controller | Tuesday 24 February 2026 21:56:58 +0000 (0:00:00.019) 0:01:29.192 ****** 2026-02-24 21:56:58.936215 | controller | changed: [instance] 2026-02-24 21:56:58.956600 | controller | 2026-02-24 21:56:58.956632 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* 2026-02-24 21:56:58.956641 | controller | Tuesday 24 February 2026 21:56:58 +0000 (0:00:00.356) 0:01:29.549 ****** 2026-02-24 21:56:58.956651 | controller | skipping: [instance] 2026-02-24 21:56:58.977550 | controller | 2026-02-24 21:56:58.977572 | controller | TASK [libvirt_manager : Write merged all-group.yml] **************************** 2026-02-24 21:56:58.977582 | controller | Tuesday 24 February 2026 21:56:58 +0000 (0:00:00.020) 0:01:29.570 ****** 2026-02-24 21:56:58.977593 | controller | skipping: [instance] 2026-02-24 21:56:59.015987 | controller | 2026-02-24 21:56:59.016009 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2026-02-24 21:56:59.016019 | controller | Tuesday 24 February 2026 21:56:58 +0000 (0:00:00.020) 0:01:29.591 ****** 2026-02-24 21:56:59.016053 | controller | skipping: [instance] 2026-02-24 21:56:59.087148 | controller | 2026-02-24 21:56:59.087170 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2026-02-24 21:56:59.087180 | controller | Tuesday 24 February 2026 21:56:59 +0000 (0:00:00.038) 0:01:29.629 ****** 2026-02-24 21:56:59.087191 | controller | skipping: [instance] => (item=crc) 2026-02-24 21:56:59.295692 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2026-02-24 21:56:59.295727 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2026-02-24 21:56:59.295736 | controller | 2026-02-24 21:56:59.295742 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-24 21:56:59.295748 | controller | Tuesday 24 February 2026 21:56:59 +0000 (0:00:00.070) 0:01:29.700 ****** 2026-02-24 21:56:59.295758 | controller | changed: [instance] 2026-02-24 21:56:59.473153 | controller | 2026-02-24 21:56:59.473183 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-24 21:56:59.473192 | controller | Tuesday 24 February 2026 21:56:59 +0000 (0:00:00.208) 0:01:29.908 ****** 2026-02-24 21:56:59.473202 | controller | ok: [instance] 2026-02-24 21:56:59.473431 | controller | 2026-02-24 21:56:59.473467 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-24 21:57:31.608529 | controller | Tuesday 24 February 2026 21:56:59 +0000 (0:00:00.177) 0:01:30.086 ****** 2026-02-24 21:57:31.608574 | controller | changed: [instance] 2026-02-24 21:57:31.830489 | controller | 2026-02-24 21:57:31.830515 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-24 21:57:31.830523 | controller | Tuesday 24 February 2026 21:57:31 +0000 (0:00:32.135) 0:02:02.221 ****** 2026-02-24 21:57:31.830533 | controller | ok: [instance] 2026-02-24 21:57:31.873058 | controller | 2026-02-24 21:57:31.873079 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-24 21:57:31.873088 | controller | Tuesday 24 February 2026 21:57:31 +0000 (0:00:00.222) 0:02:02.443 ****** 2026-02-24 21:57:31.873099 | controller | ok: [instance] => changed=false 2026-02-24 21:57:32.085648 | controller | msg: All assertions passed 2026-02-24 21:57:32.085668 | controller | 2026-02-24 21:57:32.085675 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-24 21:57:32.085681 | controller | Tuesday 24 February 2026 21:57:31 +0000 (0:00:00.042) 0:02:02.486 ****** 2026-02-24 21:57:32.085689 | controller | changed: [instance] 2026-02-24 21:57:32.292120 | controller | 2026-02-24 21:57:32.292149 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-24 21:57:32.292157 | controller | Tuesday 24 February 2026 21:57:32 +0000 (0:00:00.212) 0:02:02.699 ****** 2026-02-24 21:57:32.292167 | controller | ok: [instance] 2026-02-24 21:57:32.292205 | controller | 2026-02-24 21:57:32.292216 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-24 21:57:32.292313 | controller | Tuesday 24 February 2026 21:57:32 +0000 (0:00:00.206) 0:02:02.905 ****** 2026-02-24 21:57:32.489596 | controller | ok: [instance] 2026-02-24 21:57:32.512737 | controller | 2026-02-24 21:57:32.512754 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-24 21:57:32.512765 | controller | Tuesday 24 February 2026 21:57:32 +0000 (0:00:00.197) 0:02:03.103 ****** 2026-02-24 21:57:32.512774 | controller | skipping: [instance] 2026-02-24 21:57:32.704098 | controller | 2026-02-24 21:57:32.704127 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-24 21:57:32.704135 | controller | Tuesday 24 February 2026 21:57:32 +0000 (0:00:00.023) 0:02:03.126 ****** 2026-02-24 21:57:32.704145 | controller | ok: [instance] 2026-02-24 21:57:32.704162 | controller | 2026-02-24 21:57:32.704223 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-24 21:57:32.704310 | controller | Tuesday 24 February 2026 21:57:32 +0000 (0:00:00.191) 0:02:03.318 ****** 2026-02-24 21:57:32.744173 | controller | ok: [instance] => changed=false 2026-02-24 21:57:32.744234 | controller | msg: All assertions passed 2026-02-24 21:57:32.744242 | controller | 2026-02-24 21:57:32.744250 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-24 21:57:32.744272 | controller | Tuesday 24 February 2026 21:57:32 +0000 (0:00:00.039) 0:02:03.357 ****** 2026-02-24 21:57:32.947073 | controller | ok: [instance] 2026-02-24 21:57:33.118854 | controller | 2026-02-24 21:57:33.118874 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2026-02-24 21:57:33.118888 | controller | Tuesday 24 February 2026 21:57:32 +0000 (0:00:00.202) 0:02:03.560 ****** 2026-02-24 21:57:33.118897 | controller | ok: [instance] 2026-02-24 21:57:33.459968 | controller | 2026-02-24 21:57:33.459993 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2026-02-24 21:57:33.460003 | controller | Tuesday 24 February 2026 21:57:33 +0000 (0:00:00.171) 0:02:03.732 ****** 2026-02-24 21:57:33.460014 | controller | changed: [instance] 2026-02-24 21:57:33.630904 | controller | 2026-02-24 21:57:33.630924 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2026-02-24 21:57:33.630932 | controller | Tuesday 24 February 2026 21:57:33 +0000 (0:00:00.340) 0:02:04.073 ****** 2026-02-24 21:57:33.630941 | controller | ok: [instance] 2026-02-24 21:57:33.804589 | controller | 2026-02-24 21:57:33.804609 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2026-02-24 21:57:33.804616 | controller | Tuesday 24 February 2026 21:57:33 +0000 (0:00:00.170) 0:02:04.244 ****** 2026-02-24 21:57:33.804626 | controller | ok: [instance] 2026-02-24 21:57:34.204943 | controller | 2026-02-24 21:57:34.204962 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2026-02-24 21:57:34.204969 | controller | Tuesday 24 February 2026 21:57:33 +0000 (0:00:00.173) 0:02:04.418 ****** 2026-02-24 21:57:34.204978 | controller | changed: [instance] 2026-02-24 21:57:34.226715 | controller | 2026-02-24 21:57:34.226733 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2026-02-24 21:57:34.226741 | controller | Tuesday 24 February 2026 21:57:34 +0000 (0:00:00.400) 0:02:04.818 ****** 2026-02-24 21:57:34.226751 | controller | ok: [instance] 2026-02-24 21:57:34.453044 | controller | 2026-02-24 21:57:34.453063 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2026-02-24 21:57:34.453070 | controller | Tuesday 24 February 2026 21:57:34 +0000 (0:00:00.021) 0:02:04.840 ****** 2026-02-24 21:57:34.453078 | controller | ok: [instance] 2026-02-24 21:57:34.921938 | controller | 2026-02-24 21:57:34.921975 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2026-02-24 21:57:34.921985 | controller | Tuesday 24 February 2026 21:57:34 +0000 (0:00:00.226) 0:02:05.066 ****** 2026-02-24 21:57:34.921998 | controller | ok: [instance] 2026-02-24 21:57:35.039834 | controller | 2026-02-24 21:57:35.039851 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2026-02-24 21:57:35.039858 | controller | Tuesday 24 February 2026 21:57:34 +0000 (0:00:00.468) 0:02:05.535 ****** 2026-02-24 21:57:35.039867 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 21:57:35.291118 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 21:57:35.291154 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 21:57:35.291163 | controller | 2026-02-24 21:57:35.291171 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2026-02-24 21:57:35.291178 | controller | Tuesday 24 February 2026 21:57:35 +0000 (0:00:00.117) 0:02:05.652 ****** 2026-02-24 21:57:35.291201 | controller | changed: [instance] 2026-02-24 21:57:35.291232 | controller | 2026-02-24 21:57:35.291242 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2026-02-24 21:57:35.291389 | controller | Tuesday 24 February 2026 21:57:35 +0000 (0:00:00.251) 0:02:05.904 ****** 2026-02-24 21:57:35.511545 | controller | changed: [instance] 2026-02-24 21:57:35.799102 | controller | 2026-02-24 21:57:35.799142 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2026-02-24 21:57:35.799152 | controller | Tuesday 24 February 2026 21:57:35 +0000 (0:00:00.220) 0:02:06.124 ****** 2026-02-24 21:57:35.799169 | controller | changed: [instance] 2026-02-24 21:57:35.828160 | controller | 2026-02-24 21:57:35.828183 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2026-02-24 21:57:35.828211 | controller | Tuesday 24 February 2026 21:57:35 +0000 (0:00:00.287) 0:02:06.412 ****** 2026-02-24 21:57:35.828223 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 21:57:35.828458 | controller | 2026-02-24 21:57:35.828502 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 21:57:35.872916 | controller | Tuesday 24 February 2026 21:57:35 +0000 (0:00:00.029) 0:02:06.441 ****** 2026-02-24 21:57:35.872947 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 21:57:36.104792 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 21:57:36.104822 | controller | 2026-02-24 21:57:36.104830 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 21:57:36.104837 | controller | Tuesday 24 February 2026 21:57:35 +0000 (0:00:00.044) 0:02:06.486 ****** 2026-02-24 21:57:36.104847 | controller | ok: [instance] 2026-02-24 21:57:36.150711 | controller | 2026-02-24 21:57:36.150732 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 21:57:36.150740 | controller | Tuesday 24 February 2026 21:57:36 +0000 (0:00:00.231) 0:02:06.718 ****** 2026-02-24 21:57:36.150749 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 21:57:36.382540 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 21:57:36.382581 | controller | 2026-02-24 21:57:36.382589 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 21:57:36.382596 | controller | Tuesday 24 February 2026 21:57:36 +0000 (0:00:00.045) 0:02:06.764 ****** 2026-02-24 21:57:36.382607 | controller | ok: [instance] 2026-02-24 21:57:36.582136 | controller | 2026-02-24 21:57:36.582176 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 21:57:36.582186 | controller | Tuesday 24 February 2026 21:57:36 +0000 (0:00:00.231) 0:02:06.995 ****** 2026-02-24 21:57:36.582211 | controller | ok: [instance] 2026-02-24 21:57:36.582277 | controller | 2026-02-24 21:57:36.582305 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2026-02-24 21:57:36.869819 | controller | Tuesday 24 February 2026 21:57:36 +0000 (0:00:00.200) 0:02:07.195 ****** 2026-02-24 21:57:36.869848 | controller | changed: [instance] 2026-02-24 21:57:37.090685 | controller | 2026-02-24 21:57:37.090721 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 21:57:37.090729 | controller | Tuesday 24 February 2026 21:57:36 +0000 (0:00:00.287) 0:02:07.483 ****** 2026-02-24 21:57:37.090740 | controller | ok: [instance] 2026-02-24 21:57:37.131245 | controller | 2026-02-24 21:57:37.131283 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 21:57:37.131294 | controller | Tuesday 24 February 2026 21:57:37 +0000 (0:00:00.220) 0:02:07.703 ****** 2026-02-24 21:57:37.131308 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 21:57:37.131344 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 21:57:37.131355 | controller | 2026-02-24 21:57:37.131367 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 21:57:37.131481 | controller | Tuesday 24 February 2026 21:57:37 +0000 (0:00:00.041) 0:02:07.744 ****** 2026-02-24 21:57:37.358165 | controller | ok: [instance] 2026-02-24 21:57:37.566068 | controller | 2026-02-24 21:57:37.566097 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 21:57:37.566106 | controller | Tuesday 24 February 2026 21:57:37 +0000 (0:00:00.227) 0:02:07.971 ****** 2026-02-24 21:57:37.566116 | controller | ok: [instance] 2026-02-24 21:57:37.847839 | controller | 2026-02-24 21:57:37.847872 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2026-02-24 21:57:37.847881 | controller | Tuesday 24 February 2026 21:57:37 +0000 (0:00:00.207) 0:02:08.179 ****** 2026-02-24 21:57:37.847892 | controller | changed: [instance] 2026-02-24 21:57:37.869640 | controller | 2026-02-24 21:57:37.869667 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2026-02-24 21:57:37.869676 | controller | Tuesday 24 February 2026 21:57:37 +0000 (0:00:00.281) 0:02:08.461 ****** 2026-02-24 21:57:37.869687 | controller | skipping: [instance] 2026-02-24 21:57:37.895799 | controller | 2026-02-24 21:57:37.895821 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2026-02-24 21:57:37.895830 | controller | Tuesday 24 February 2026 21:57:37 +0000 (0:00:00.021) 0:02:08.483 ****** 2026-02-24 21:57:37.895840 | controller | skipping: [instance] 2026-02-24 21:57:37.921073 | controller | 2026-02-24 21:57:37.921094 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2026-02-24 21:57:37.921101 | controller | Tuesday 24 February 2026 21:57:37 +0000 (0:00:00.026) 0:02:08.509 ****** 2026-02-24 21:57:37.921111 | controller | skipping: [instance] 2026-02-24 21:57:37.947111 | controller | 2026-02-24 21:57:37.947144 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2026-02-24 21:57:37.947156 | controller | Tuesday 24 February 2026 21:57:37 +0000 (0:00:00.025) 0:02:08.534 ****** 2026-02-24 21:57:37.947167 | controller | skipping: [instance] 2026-02-24 21:57:37.947193 | controller | 2026-02-24 21:57:37.947432 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 21:57:38.159540 | controller | Tuesday 24 February 2026 21:57:37 +0000 (0:00:00.026) 0:02:08.560 ****** 2026-02-24 21:57:38.159572 | controller | changed: [instance] 2026-02-24 21:57:38.195618 | controller | 2026-02-24 21:57:38.195642 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 21:57:38.195649 | controller | Tuesday 24 February 2026 21:57:38 +0000 (0:00:00.212) 0:02:08.773 ****** 2026-02-24 21:57:38.195659 | controller | ok: [instance] 2026-02-24 21:57:38.247174 | controller | 2026-02-24 21:57:38.247226 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 21:57:38.247237 | controller | Tuesday 24 February 2026 21:57:38 +0000 (0:00:00.036) 0:02:08.809 ****** 2026-02-24 21:57:38.247255 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-24 21:57:38.247289 | controller | 2026-02-24 21:57:38.247317 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-24 21:57:38.247478 | controller | Tuesday 24 February 2026 21:57:38 +0000 (0:00:00.051) 0:02:08.860 ****** 2026-02-24 21:57:38.440765 | controller | ok: [instance] 2026-02-24 21:57:38.504448 | controller | 2026-02-24 21:57:38.504472 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-24 21:57:38.504481 | controller | Tuesday 24 February 2026 21:57:38 +0000 (0:00:00.193) 0:02:09.054 ****** 2026-02-24 21:57:38.504492 | controller | ok: [instance] 2026-02-24 21:57:38.550157 | controller | 2026-02-24 21:57:38.550231 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-24 21:57:38.550247 | controller | Tuesday 24 February 2026 21:57:38 +0000 (0:00:00.063) 0:02:09.118 ****** 2026-02-24 21:57:38.550268 | controller | ok: [instance] 2026-02-24 21:57:38.594549 | controller | 2026-02-24 21:57:38.594571 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-24 21:57:38.594579 | controller | Tuesday 24 February 2026 21:57:38 +0000 (0:00:00.045) 0:02:09.163 ****** 2026-02-24 21:57:38.594589 | controller | skipping: [instance] 2026-02-24 21:57:38.637540 | controller | 2026-02-24 21:57:38.637557 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-24 21:57:38.637565 | controller | Tuesday 24 February 2026 21:57:38 +0000 (0:00:00.044) 0:02:09.208 ****** 2026-02-24 21:57:38.637573 | controller | skipping: [instance] 2026-02-24 21:57:38.696148 | controller | 2026-02-24 21:57:38.696174 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-24 21:57:38.696184 | controller | Tuesday 24 February 2026 21:57:38 +0000 (0:00:00.042) 0:02:09.250 ****** 2026-02-24 21:57:38.696195 | controller | 2026-02-24 21:57:39.090162 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-24 21:57:39.090195 | controller | Tuesday 24 February 2026 21:57:38 +0000 (0:00:00.058) 0:02:09.309 ****** 2026-02-24 21:57:39.090223 | controller | ok: [instance] => (item=artifacts) 2026-02-24 21:57:39.090253 | controller | ok: [instance] => (item=logs) 2026-02-24 21:57:39.090261 | controller | 2026-02-24 21:57:39.090269 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-24 21:57:39.090336 | controller | Tuesday 24 February 2026 21:57:39 +0000 (0:00:00.394) 0:02:09.704 ****** 2026-02-24 21:57:40.258110 | controller | ok: [instance] 2026-02-24 21:57:40.258156 | controller | 2026-02-24 21:57:40.258169 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-24 21:57:40.258268 | controller | Tuesday 24 February 2026 21:57:40 +0000 (0:00:01.167) 0:02:10.871 ****** 2026-02-24 21:57:40.472400 | controller | changed: [instance] 2026-02-24 21:57:40.839175 | controller | 2026-02-24 21:57:40.839216 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-24 21:57:40.839225 | controller | Tuesday 24 February 2026 21:57:40 +0000 (0:00:00.214) 0:02:11.086 ****** 2026-02-24 21:57:40.839236 | controller | changed: [instance] 2026-02-24 21:57:41.229679 | controller | 2026-02-24 21:57:41.229711 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-24 21:57:41.229719 | controller | Tuesday 24 February 2026 21:57:40 +0000 (0:00:00.366) 0:02:11.452 ****** 2026-02-24 21:57:41.229730 | controller | changed: [instance] 2026-02-24 21:57:41.278356 | controller | 2026-02-24 21:57:41.278467 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-24 21:57:41.278479 | controller | Tuesday 24 February 2026 21:57:41 +0000 (0:00:00.390) 0:02:11.842 ****** 2026-02-24 21:57:41.278513 | controller | skipping: [instance] 2026-02-24 21:57:41.486616 | controller | 2026-02-24 21:57:41.486648 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-24 21:57:41.486656 | controller | Tuesday 24 February 2026 21:57:41 +0000 (0:00:00.048) 0:02:11.891 ****** 2026-02-24 21:57:41.486666 | controller | ok: [instance] 2026-02-24 21:57:41.531659 | controller | 2026-02-24 21:57:41.531685 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-24 21:57:41.531693 | controller | Tuesday 24 February 2026 21:57:41 +0000 (0:00:00.208) 0:02:12.099 ****** 2026-02-24 21:57:41.531704 | controller | skipping: [instance] 2026-02-24 21:57:41.763777 | controller | 2026-02-24 21:57:41.763810 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-24 21:57:41.763818 | controller | Tuesday 24 February 2026 21:57:41 +0000 (0:00:00.045) 0:02:12.145 ****** 2026-02-24 21:57:41.763829 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2026-02-24 21:57:42.042060 | controller | changed: [instance] 2026-02-24 21:57:42.042093 | controller | 2026-02-24 21:57:42.042101 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 21:57:42.042107 | controller | Tuesday 24 February 2026 21:57:41 +0000 (0:00:00.231) 0:02:12.377 ****** 2026-02-24 21:57:42.042118 | controller | changed: [instance] 2026-02-24 21:57:42.087825 | controller | 2026-02-24 21:57:42.087848 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 21:57:42.087856 | controller | Tuesday 24 February 2026 21:57:42 +0000 (0:00:00.278) 0:02:12.655 ****** 2026-02-24 21:57:42.087865 | controller | skipping: [instance] 2026-02-24 21:57:42.112736 | controller | 2026-02-24 21:57:42.112763 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2026-02-24 21:57:42.112772 | controller | Tuesday 24 February 2026 21:57:42 +0000 (0:00:00.046) 0:02:12.701 ****** 2026-02-24 21:57:42.112787 | controller | skipping: [instance] 2026-02-24 21:57:42.354193 | controller | 2026-02-24 21:57:42.354246 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2026-02-24 21:57:42.354257 | controller | Tuesday 24 February 2026 21:57:42 +0000 (0:00:00.024) 0:02:12.726 ****** 2026-02-24 21:57:42.354271 | controller | changed: [instance] 2026-02-24 21:57:42.576823 | controller | 2026-02-24 21:57:42.576855 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2026-02-24 21:57:42.576864 | controller | Tuesday 24 February 2026 21:57:42 +0000 (0:00:00.241) 0:02:12.967 ****** 2026-02-24 21:57:42.576881 | controller | changed: [instance] 2026-02-24 21:57:42.864162 | controller | 2026-02-24 21:57:42.864207 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2026-02-24 21:57:42.864229 | controller | Tuesday 24 February 2026 21:57:42 +0000 (0:00:00.222) 0:02:13.190 ****** 2026-02-24 21:57:42.864242 | controller | changed: [instance] 2026-02-24 21:57:42.864250 | controller | 2026-02-24 21:57:42.864257 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2026-02-24 21:57:42.864266 | controller | Tuesday 24 February 2026 21:57:42 +0000 (0:00:00.287) 0:02:13.477 ****** 2026-02-24 21:57:42.893153 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 21:57:42.893236 | controller | 2026-02-24 21:57:42.893254 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 21:57:42.893266 | controller | Tuesday 24 February 2026 21:57:42 +0000 (0:00:00.029) 0:02:13.506 ****** 2026-02-24 21:57:42.937886 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 21:57:43.161098 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 21:57:43.161125 | controller | 2026-02-24 21:57:43.161133 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 21:57:43.161140 | controller | Tuesday 24 February 2026 21:57:42 +0000 (0:00:00.044) 0:02:13.551 ****** 2026-02-24 21:57:43.161149 | controller | ok: [instance] 2026-02-24 21:57:43.161156 | controller | 2026-02-24 21:57:43.161161 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 21:57:43.161168 | controller | Tuesday 24 February 2026 21:57:43 +0000 (0:00:00.223) 0:02:13.774 ****** 2026-02-24 21:57:43.202508 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 21:57:43.422797 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 21:57:43.422833 | controller | 2026-02-24 21:57:43.422842 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 21:57:43.422849 | controller | Tuesday 24 February 2026 21:57:43 +0000 (0:00:00.041) 0:02:13.815 ****** 2026-02-24 21:57:43.422861 | controller | ok: [instance] 2026-02-24 21:57:43.615647 | controller | 2026-02-24 21:57:43.615680 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 21:57:43.615688 | controller | Tuesday 24 February 2026 21:57:43 +0000 (0:00:00.220) 0:02:14.036 ****** 2026-02-24 21:57:43.615703 | controller | ok: [instance] 2026-02-24 21:57:43.886476 | controller | 2026-02-24 21:57:43.886507 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2026-02-24 21:57:43.886515 | controller | Tuesday 24 February 2026 21:57:43 +0000 (0:00:00.192) 0:02:14.228 ****** 2026-02-24 21:57:43.886525 | controller | changed: [instance] 2026-02-24 21:57:44.106748 | controller | 2026-02-24 21:57:44.106780 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 21:57:44.106788 | controller | Tuesday 24 February 2026 21:57:43 +0000 (0:00:00.270) 0:02:14.499 ****** 2026-02-24 21:57:44.106798 | controller | ok: [instance] 2026-02-24 21:57:44.148115 | controller | 2026-02-24 21:57:44.148143 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 21:57:44.148152 | controller | Tuesday 24 February 2026 21:57:44 +0000 (0:00:00.220) 0:02:14.720 ****** 2026-02-24 21:57:44.148163 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 21:57:44.148190 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 21:57:44.148197 | controller | 2026-02-24 21:57:44.148205 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 21:57:44.148312 | controller | Tuesday 24 February 2026 21:57:44 +0000 (0:00:00.041) 0:02:14.761 ****** 2026-02-24 21:57:44.374248 | controller | ok: [instance] 2026-02-24 21:57:44.570063 | controller | 2026-02-24 21:57:44.570089 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 21:57:44.570099 | controller | Tuesday 24 February 2026 21:57:44 +0000 (0:00:00.225) 0:02:14.987 ****** 2026-02-24 21:57:44.570109 | controller | ok: [instance] 2026-02-24 21:57:44.849146 | controller | 2026-02-24 21:57:44.849176 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2026-02-24 21:57:44.849184 | controller | Tuesday 24 February 2026 21:57:44 +0000 (0:00:00.195) 0:02:15.183 ****** 2026-02-24 21:57:44.849194 | controller | changed: [instance] 2026-02-24 21:57:44.869108 | controller | 2026-02-24 21:57:44.869134 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2026-02-24 21:57:44.869143 | controller | Tuesday 24 February 2026 21:57:44 +0000 (0:00:00.278) 0:02:15.462 ****** 2026-02-24 21:57:44.869153 | controller | skipping: [instance] 2026-02-24 21:57:44.869331 | controller | 2026-02-24 21:57:44.869352 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2026-02-24 21:57:44.893122 | controller | Tuesday 24 February 2026 21:57:44 +0000 (0:00:00.020) 0:02:15.483 ****** 2026-02-24 21:57:44.893146 | controller | skipping: [instance] 2026-02-24 21:57:44.893175 | controller | 2026-02-24 21:57:44.893183 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2026-02-24 21:57:44.893191 | controller | Tuesday 24 February 2026 21:57:44 +0000 (0:00:00.023) 0:02:15.506 ****** 2026-02-24 21:57:44.919180 | controller | skipping: [instance] 2026-02-24 21:57:44.919297 | controller | 2026-02-24 21:57:44.919312 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2026-02-24 21:57:44.919321 | controller | Tuesday 24 February 2026 21:57:44 +0000 (0:00:00.026) 0:02:15.532 ****** 2026-02-24 21:57:44.943086 | controller | skipping: [instance] 2026-02-24 21:57:44.943166 | controller | 2026-02-24 21:57:44.943178 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 21:57:44.943189 | controller | Tuesday 24 February 2026 21:57:44 +0000 (0:00:00.023) 0:02:15.556 ****** 2026-02-24 21:57:45.151113 | controller | changed: [instance] 2026-02-24 21:57:45.151298 | controller | 2026-02-24 21:57:45.151318 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 21:57:45.188161 | controller | Tuesday 24 February 2026 21:57:45 +0000 (0:00:00.207) 0:02:15.764 ****** 2026-02-24 21:57:45.188189 | controller | ok: [instance] 2026-02-24 21:57:45.188235 | controller | 2026-02-24 21:57:45.188247 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 21:57:45.188351 | controller | Tuesday 24 February 2026 21:57:45 +0000 (0:00:00.037) 0:02:15.801 ****** 2026-02-24 21:57:45.237592 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-24 21:57:45.422102 | controller | 2026-02-24 21:57:45.422134 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-24 21:57:45.422150 | controller | Tuesday 24 February 2026 21:57:45 +0000 (0:00:00.049) 0:02:15.851 ****** 2026-02-24 21:57:45.422161 | controller | ok: [instance] 2026-02-24 21:57:45.422185 | controller | 2026-02-24 21:57:45.422439 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-24 21:57:45.483486 | controller | Tuesday 24 February 2026 21:57:45 +0000 (0:00:00.184) 0:02:16.035 ****** 2026-02-24 21:57:45.483513 | controller | ok: [instance] 2026-02-24 21:57:45.529151 | controller | 2026-02-24 21:57:45.529179 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-24 21:57:45.529205 | controller | Tuesday 24 February 2026 21:57:45 +0000 (0:00:00.061) 0:02:16.096 ****** 2026-02-24 21:57:45.529217 | controller | ok: [instance] 2026-02-24 21:57:45.570293 | controller | 2026-02-24 21:57:45.570324 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-24 21:57:45.570335 | controller | Tuesday 24 February 2026 21:57:45 +0000 (0:00:00.045) 0:02:16.142 ****** 2026-02-24 21:57:45.570347 | controller | skipping: [instance] 2026-02-24 21:57:45.570375 | controller | 2026-02-24 21:57:45.570536 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-24 21:57:45.570612 | controller | Tuesday 24 February 2026 21:57:45 +0000 (0:00:00.041) 0:02:16.184 ****** 2026-02-24 21:57:45.609853 | controller | skipping: [instance] 2026-02-24 21:57:45.609937 | controller | 2026-02-24 21:57:45.610119 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-24 21:57:45.610207 | controller | Tuesday 24 February 2026 21:57:45 +0000 (0:00:00.039) 0:02:16.223 ****** 2026-02-24 21:57:45.666801 | controller | 2026-02-24 21:57:45.666973 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-24 21:57:45.667150 | controller | Tuesday 24 February 2026 21:57:45 +0000 (0:00:00.056) 0:02:16.280 ****** 2026-02-24 21:57:46.043113 | controller | ok: [instance] => (item=artifacts) 2026-02-24 21:57:47.209555 | controller | ok: [instance] => (item=logs) 2026-02-24 21:57:47.209587 | controller | 2026-02-24 21:57:47.209594 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-24 21:57:47.209601 | controller | Tuesday 24 February 2026 21:57:46 +0000 (0:00:00.375) 0:02:16.656 ****** 2026-02-24 21:57:47.209611 | controller | ok: [instance] 2026-02-24 21:57:47.415318 | controller | 2026-02-24 21:57:47.415349 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-24 21:57:47.415357 | controller | Tuesday 24 February 2026 21:57:47 +0000 (0:00:01.166) 0:02:17.822 ****** 2026-02-24 21:57:47.415367 | controller | changed: [instance] 2026-02-24 21:57:47.773554 | controller | 2026-02-24 21:57:47.773587 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-24 21:57:47.773596 | controller | Tuesday 24 February 2026 21:57:47 +0000 (0:00:00.205) 0:02:18.028 ****** 2026-02-24 21:57:47.773606 | controller | changed: [instance] 2026-02-24 21:57:48.139563 | controller | 2026-02-24 21:57:48.139594 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-24 21:57:48.139603 | controller | Tuesday 24 February 2026 21:57:47 +0000 (0:00:00.358) 0:02:18.386 ****** 2026-02-24 21:57:48.139613 | controller | changed: [instance] 2026-02-24 21:57:48.183378 | controller | 2026-02-24 21:57:48.183409 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-24 21:57:48.183418 | controller | Tuesday 24 February 2026 21:57:48 +0000 (0:00:00.366) 0:02:18.752 ****** 2026-02-24 21:57:48.183431 | controller | skipping: [instance] 2026-02-24 21:57:48.378116 | controller | 2026-02-24 21:57:48.378154 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-24 21:57:48.378164 | controller | Tuesday 24 February 2026 21:57:48 +0000 (0:00:00.043) 0:02:18.796 ****** 2026-02-24 21:57:48.378177 | controller | ok: [instance] 2026-02-24 21:57:48.417193 | controller | 2026-02-24 21:57:48.417323 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-24 21:57:48.417339 | controller | Tuesday 24 February 2026 21:57:48 +0000 (0:00:00.194) 0:02:18.991 ****** 2026-02-24 21:57:48.417360 | controller | skipping: [instance] 2026-02-24 21:57:48.658056 | controller | 2026-02-24 21:57:48.658101 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-24 21:57:48.658112 | controller | Tuesday 24 February 2026 21:57:48 +0000 (0:00:00.039) 0:02:19.030 ****** 2026-02-24 21:57:48.658125 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2026-02-24 21:57:48.936571 | controller | changed: [instance] 2026-02-24 21:57:48.936607 | controller | 2026-02-24 21:57:48.936618 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 21:57:48.936625 | controller | Tuesday 24 February 2026 21:57:48 +0000 (0:00:00.240) 0:02:19.271 ****** 2026-02-24 21:57:48.936638 | controller | changed: [instance] 2026-02-24 21:57:48.981148 | controller | 2026-02-24 21:57:48.981174 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 21:57:48.981183 | controller | Tuesday 24 February 2026 21:57:48 +0000 (0:00:00.278) 0:02:19.549 ****** 2026-02-24 21:57:48.981193 | controller | skipping: [instance] 2026-02-24 21:57:48.981276 | controller | 2026-02-24 21:57:48.981293 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2026-02-24 21:57:48.981306 | controller | Tuesday 24 February 2026 21:57:48 +0000 (0:00:00.045) 0:02:19.594 ****** 2026-02-24 21:57:49.008075 | controller | skipping: [instance] 2026-02-24 21:57:49.008432 | controller | 2026-02-24 21:57:49.251764 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2026-02-24 21:57:49.251799 | controller | Tuesday 24 February 2026 21:57:49 +0000 (0:00:00.027) 0:02:19.622 ****** 2026-02-24 21:57:49.251811 | controller | changed: [instance] 2026-02-24 21:57:49.472580 | controller | 2026-02-24 21:57:49.472605 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2026-02-24 21:57:49.472613 | controller | Tuesday 24 February 2026 21:57:49 +0000 (0:00:00.243) 0:02:19.865 ****** 2026-02-24 21:57:49.472623 | controller | changed: [instance] 2026-02-24 21:57:49.763011 | controller | 2026-02-24 21:57:49.763062 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2026-02-24 21:57:49.763071 | controller | Tuesday 24 February 2026 21:57:49 +0000 (0:00:00.220) 0:02:20.086 ****** 2026-02-24 21:57:49.763081 | controller | changed: [instance] 2026-02-24 21:57:49.792108 | controller | 2026-02-24 21:57:49.792132 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2026-02-24 21:57:49.792142 | controller | Tuesday 24 February 2026 21:57:49 +0000 (0:00:00.290) 0:02:20.376 ****** 2026-02-24 21:57:49.792154 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 21:57:49.792183 | controller | 2026-02-24 21:57:49.792443 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 21:57:49.836128 | controller | Tuesday 24 February 2026 21:57:49 +0000 (0:00:00.029) 0:02:20.405 ****** 2026-02-24 21:57:49.836153 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 21:57:49.836183 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 21:57:49.836511 | controller | 2026-02-24 21:57:50.074071 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 21:57:50.074106 | controller | Tuesday 24 February 2026 21:57:49 +0000 (0:00:00.044) 0:02:20.449 ****** 2026-02-24 21:57:50.074120 | controller | ok: [instance] 2026-02-24 21:57:50.117738 | controller | 2026-02-24 21:57:50.117765 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 21:57:50.117775 | controller | Tuesday 24 February 2026 21:57:50 +0000 (0:00:00.237) 0:02:20.687 ****** 2026-02-24 21:57:50.117787 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 21:57:50.347813 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 21:57:50.347844 | controller | 2026-02-24 21:57:50.347851 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 21:57:50.347857 | controller | Tuesday 24 February 2026 21:57:50 +0000 (0:00:00.043) 0:02:20.731 ****** 2026-02-24 21:57:50.347866 | controller | ok: [instance] 2026-02-24 21:57:50.535481 | controller | 2026-02-24 21:57:50.535514 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 21:57:50.535523 | controller | Tuesday 24 February 2026 21:57:50 +0000 (0:00:00.230) 0:02:20.961 ****** 2026-02-24 21:57:50.535535 | controller | ok: [instance] 2026-02-24 21:57:50.813446 | controller | 2026-02-24 21:57:50.813479 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2026-02-24 21:57:50.813487 | controller | Tuesday 24 February 2026 21:57:50 +0000 (0:00:00.187) 0:02:21.148 ****** 2026-02-24 21:57:50.813497 | controller | changed: [instance] 2026-02-24 21:57:51.037175 | controller | 2026-02-24 21:57:51.037212 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 21:57:51.037222 | controller | Tuesday 24 February 2026 21:57:50 +0000 (0:00:00.277) 0:02:21.426 ****** 2026-02-24 21:57:51.037244 | controller | ok: [instance] 2026-02-24 21:57:51.079202 | controller | 2026-02-24 21:57:51.079232 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 21:57:51.079252 | controller | Tuesday 24 February 2026 21:57:51 +0000 (0:00:00.223) 0:02:21.650 ****** 2026-02-24 21:57:51.079265 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 21:57:51.079328 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 21:57:51.079353 | controller | 2026-02-24 21:57:51.079362 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 21:57:51.079373 | controller | Tuesday 24 February 2026 21:57:51 +0000 (0:00:00.042) 0:02:21.692 ****** 2026-02-24 21:57:51.302632 | controller | ok: [instance] 2026-02-24 21:57:51.500782 | controller | 2026-02-24 21:57:51.500813 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 21:57:51.500821 | controller | Tuesday 24 February 2026 21:57:51 +0000 (0:00:00.223) 0:02:21.916 ****** 2026-02-24 21:57:51.500831 | controller | ok: [instance] 2026-02-24 21:57:51.772542 | controller | 2026-02-24 21:57:51.772574 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2026-02-24 21:57:51.772582 | controller | Tuesday 24 February 2026 21:57:51 +0000 (0:00:00.198) 0:02:22.114 ****** 2026-02-24 21:57:51.772597 | controller | changed: [instance] 2026-02-24 21:57:51.793956 | controller | 2026-02-24 21:57:51.793977 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2026-02-24 21:57:51.793984 | controller | Tuesday 24 February 2026 21:57:51 +0000 (0:00:00.271) 0:02:22.385 ****** 2026-02-24 21:57:51.793992 | controller | skipping: [instance] 2026-02-24 21:57:51.824077 | controller | 2026-02-24 21:57:51.824098 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2026-02-24 21:57:51.824106 | controller | Tuesday 24 February 2026 21:57:51 +0000 (0:00:00.021) 0:02:22.407 ****** 2026-02-24 21:57:51.824115 | controller | skipping: [instance] 2026-02-24 21:57:51.852515 | controller | 2026-02-24 21:57:51.852539 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2026-02-24 21:57:51.852548 | controller | Tuesday 24 February 2026 21:57:51 +0000 (0:00:00.030) 0:02:22.437 ****** 2026-02-24 21:57:51.852560 | controller | skipping: [instance] 2026-02-24 21:57:51.878890 | controller | 2026-02-24 21:57:51.878913 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2026-02-24 21:57:51.878922 | controller | Tuesday 24 February 2026 21:57:51 +0000 (0:00:00.028) 0:02:22.465 ****** 2026-02-24 21:57:51.878933 | controller | skipping: [instance] 2026-02-24 21:57:52.088945 | controller | 2026-02-24 21:57:52.088979 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 21:57:52.088987 | controller | Tuesday 24 February 2026 21:57:51 +0000 (0:00:00.026) 0:02:22.492 ****** 2026-02-24 21:57:52.088998 | controller | changed: [instance] 2026-02-24 21:57:52.125192 | controller | 2026-02-24 21:57:52.125225 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 21:57:52.125235 | controller | Tuesday 24 February 2026 21:57:52 +0000 (0:00:00.209) 0:02:22.702 ****** 2026-02-24 21:57:52.125260 | controller | ok: [instance] 2026-02-24 21:57:52.125290 | controller | 2026-02-24 21:57:52.125300 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 21:57:52.125390 | controller | Tuesday 24 February 2026 21:57:52 +0000 (0:00:00.036) 0:02:22.738 ****** 2026-02-24 21:57:52.151635 | controller | skipping: [instance] 2026-02-24 21:57:52.176647 | controller | 2026-02-24 21:57:52.176667 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 21:57:52.176674 | controller | Tuesday 24 February 2026 21:57:52 +0000 (0:00:00.026) 0:02:22.765 ****** 2026-02-24 21:57:52.176682 | controller | skipping: [instance] 2026-02-24 21:57:52.218454 | controller | 2026-02-24 21:57:52.218480 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 21:57:52.218489 | controller | Tuesday 24 February 2026 21:57:52 +0000 (0:00:00.025) 0:02:22.790 ****** 2026-02-24 21:57:52.218499 | controller | skipping: [instance] 2026-02-24 21:57:52.244838 | controller | 2026-02-24 21:57:52.244855 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2026-02-24 21:57:52.244862 | controller | Tuesday 24 February 2026 21:57:52 +0000 (0:00:00.041) 0:02:22.832 ****** 2026-02-24 21:57:52.244870 | controller | skipping: [instance] 2026-02-24 21:57:52.304563 | controller | 2026-02-24 21:57:52.304582 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2026-02-24 21:57:52.304588 | controller | Tuesday 24 February 2026 21:57:52 +0000 (0:00:00.026) 0:02:22.858 ****** 2026-02-24 21:57:52.304603 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2026-02-24 21:57:52.542864 | controller | 2026-02-24 21:57:52.542896 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2026-02-24 21:57:52.542905 | controller | Tuesday 24 February 2026 21:57:52 +0000 (0:00:00.059) 0:02:22.918 ****** 2026-02-24 21:57:52.542915 | controller | ok: [instance] => (item=crc) 2026-02-24 21:57:54.614717 | controller | 2026-02-24 21:57:54.614748 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2026-02-24 21:57:54.614756 | controller | Tuesday 24 February 2026 21:57:52 +0000 (0:00:00.237) 0:02:23.156 ****** 2026-02-24 21:57:54.614767 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 21:57:55.447757 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 21:57:55.447790 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 21:57:55.447799 | controller | 2026-02-24 21:57:55.447805 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 21:57:55.447811 | controller | Tuesday 24 February 2026 21:57:54 +0000 (0:00:02.071) 0:02:25.227 ****** 2026-02-24 21:57:55.447821 | controller | changed: [instance] 2026-02-24 21:57:56.223494 | controller | 2026-02-24 21:57:56.223526 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 21:57:56.223534 | controller | Tuesday 24 February 2026 21:57:55 +0000 (0:00:00.833) 0:02:26.061 ****** 2026-02-24 21:57:56.223544 | controller | changed: [instance] 2026-02-24 21:57:57.034929 | controller | 2026-02-24 21:57:57.034964 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 21:57:57.034977 | controller | Tuesday 24 February 2026 21:57:56 +0000 (0:00:00.775) 0:02:26.836 ****** 2026-02-24 21:57:57.034988 | controller | changed: [instance] 2026-02-24 21:57:57.776652 | controller | 2026-02-24 21:57:57.776684 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2026-02-24 21:57:57.776692 | controller | Tuesday 24 February 2026 21:57:57 +0000 (0:00:00.811) 0:02:27.648 ****** 2026-02-24 21:57:57.776703 | controller | changed: [instance] => (item=compute-0.utility) 2026-02-24 21:58:20.776482 | controller | changed: [instance] => (item=controller-0.utility) 2026-02-24 21:58:20.776561 | controller | changed: [instance] => (item=crc-0.utility) 2026-02-24 21:58:20.776570 | controller | 2026-02-24 21:58:20.776577 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2026-02-24 21:58:20.776584 | controller | Tuesday 24 February 2026 21:57:57 +0000 (0:00:00.736) 0:02:28.384 ****** 2026-02-24 21:58:20.776598 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-02-24 21:58:20.939148 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2026-02-24 21:58:20.939197 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2026-02-24 21:58:20.939205 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2026-02-24 21:58:20.939210 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2026-02-24 21:58:20.939215 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2026-02-24 21:58:20.939220 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). 2026-02-24 21:58:20.939226 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j38966170900.24359', 'results_file': '/home/zuul/.ansible_async/j38966170900.24359', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2026-02-24 21:58:20.939239 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j833263080021.24376', 'results_file': '/home/zuul/.ansible_async/j833263080021.24376', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2026-02-24 21:58:20.939252 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j228244448733.24392', 'results_file': '/home/zuul/.ansible_async/j228244448733.24392', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2026-02-24 21:58:20.939257 | controller | 2026-02-24 21:58:20.939263 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2026-02-24 21:58:20.939268 | controller | Tuesday 24 February 2026 21:58:20 +0000 (0:00:23.003) 0:02:51.388 ****** 2026-02-24 21:58:20.939278 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 21:58:20.963736 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 21:58:20.963754 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 21:58:20.963762 | controller | 2026-02-24 21:58:20.963768 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 21:58:20.963773 | controller | Tuesday 24 February 2026 21:58:20 +0000 (0:00:00.164) 0:02:51.552 ****** 2026-02-24 21:58:20.963781 | controller | skipping: [instance] 2026-02-24 21:58:21.053147 | controller | 2026-02-24 21:58:21.053179 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2026-02-24 21:58:21.053187 | controller | Tuesday 24 February 2026 21:58:20 +0000 (0:00:00.025) 0:02:51.577 ****** 2026-02-24 21:58:21.053197 | controller | 2026-02-24 21:58:21.144343 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 21:58:21.144400 | controller | Tuesday 24 February 2026 21:58:21 +0000 (0:00:00.089) 0:02:51.666 ****** 2026-02-24 21:58:21.144426 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-24 21:58:21.144447 | controller | 2026-02-24 21:58:21.144455 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 21:58:21.406686 | controller | Tuesday 24 February 2026 21:58:21 +0000 (0:00:00.091) 0:02:51.757 ****** 2026-02-24 21:58:21.406736 | controller | changed: [instance] 2026-02-24 21:58:21.667109 | controller | 2026-02-24 21:58:21.667157 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 21:58:21.667165 | controller | Tuesday 24 February 2026 21:58:21 +0000 (0:00:00.261) 0:02:52.019 ****** 2026-02-24 21:58:21.667177 | controller | changed: [instance] 2026-02-24 21:58:22.074598 | controller | 2026-02-24 21:58:22.074645 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2026-02-24 21:58:22.074654 | controller | Tuesday 24 February 2026 21:58:21 +0000 (0:00:00.260) 0:02:52.280 ****** 2026-02-24 21:58:22.074665 | controller | changed: [instance] 2026-02-24 21:58:22.107013 | controller | 2026-02-24 21:58:22.107049 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2026-02-24 21:58:22.107057 | controller | Tuesday 24 February 2026 21:58:22 +0000 (0:00:00.407) 0:02:52.687 ****** 2026-02-24 21:58:22.107067 | controller | skipping: [instance] 2026-02-24 21:58:22.149471 | controller | 2026-02-24 21:58:22.149488 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 21:58:22.149496 | controller | Tuesday 24 February 2026 21:58:22 +0000 (0:00:00.032) 0:02:52.720 ****** 2026-02-24 21:58:22.149524 | controller | skipping: [instance] 2026-02-24 21:58:22.213633 | controller | 2026-02-24 21:58:22.213683 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2026-02-24 21:58:22.213693 | controller | Tuesday 24 February 2026 21:58:22 +0000 (0:00:00.042) 0:02:52.762 ****** 2026-02-24 21:58:22.213705 | controller | skipping: [instance] 2026-02-24 21:58:22.213726 | controller | 2026-02-24 21:58:22.213733 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2026-02-24 21:58:22.270779 | controller | Tuesday 24 February 2026 21:58:22 +0000 (0:00:00.064) 0:02:52.826 ****** 2026-02-24 21:58:22.270822 | controller | skipping: [instance] 2026-02-24 21:58:22.295930 | controller | 2026-02-24 21:58:22.295947 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 21:58:22.295955 | controller | Tuesday 24 February 2026 21:58:22 +0000 (0:00:00.057) 0:02:52.884 ****** 2026-02-24 21:58:22.295963 | controller | skipping: [instance] 2026-02-24 21:58:22.336171 | controller | 2026-02-24 21:58:22.336190 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2026-02-24 21:58:22.336198 | controller | Tuesday 24 February 2026 21:58:22 +0000 (0:00:00.025) 0:02:52.909 ****** 2026-02-24 21:58:22.336213 | controller | 2026-02-24 21:58:22.421167 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 21:58:22.421190 | controller | Tuesday 24 February 2026 21:58:22 +0000 (0:00:00.040) 0:02:52.949 ****** 2026-02-24 21:58:22.421202 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-24 21:58:22.421344 | controller | 2026-02-24 21:58:22.421480 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 21:58:22.421620 | controller | Tuesday 24 February 2026 21:58:22 +0000 (0:00:00.085) 0:02:53.034 ****** 2026-02-24 21:58:22.652739 | controller | ok: [instance] 2026-02-24 21:58:22.885948 | controller | 2026-02-24 21:58:22.885992 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 21:58:22.886001 | controller | Tuesday 24 February 2026 21:58:22 +0000 (0:00:00.230) 0:02:53.265 ****** 2026-02-24 21:58:22.886013 | controller | ok: [instance] 2026-02-24 21:58:23.333303 | controller | 2026-02-24 21:58:23.333343 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2026-02-24 21:58:23.333350 | controller | Tuesday 24 February 2026 21:58:22 +0000 (0:00:00.233) 0:02:53.499 ****** 2026-02-24 21:58:23.333360 | controller | changed: [instance] 2026-02-24 21:58:23.363466 | controller | 2026-02-24 21:58:23.363494 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2026-02-24 21:58:23.363503 | controller | Tuesday 24 February 2026 21:58:23 +0000 (0:00:00.447) 0:02:53.946 ****** 2026-02-24 21:58:23.363514 | controller | skipping: [instance] 2026-02-24 21:58:23.400853 | controller | 2026-02-24 21:58:23.400878 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 21:58:23.400886 | controller | Tuesday 24 February 2026 21:58:23 +0000 (0:00:00.029) 0:02:53.976 ****** 2026-02-24 21:58:23.400897 | controller | skipping: [instance] 2026-02-24 21:58:25.204547 | controller | 2026-02-24 21:58:25.204593 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2026-02-24 21:58:25.204601 | controller | Tuesday 24 February 2026 21:58:23 +0000 (0:00:00.038) 0:02:54.014 ****** 2026-02-24 21:58:25.204615 | controller | changed: [instance -> controller-0.instance] 2026-02-24 21:58:26.458701 | controller | 2026-02-24 21:58:26.458753 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2026-02-24 21:58:26.458762 | controller | Tuesday 24 February 2026 21:58:25 +0000 (0:00:01.802) 0:02:55.817 ****** 2026-02-24 21:58:26.458776 | controller | changed: [instance -> controller-0.instance] 2026-02-24 21:58:26.502931 | controller | 2026-02-24 21:58:26.502966 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 21:58:26.502974 | controller | Tuesday 24 February 2026 21:58:26 +0000 (0:00:01.254) 0:02:57.071 ****** 2026-02-24 21:58:26.502984 | controller | 2026-02-24 21:58:26.707833 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-24 21:58:26.707867 | controller | Tuesday 24 February 2026 21:58:26 +0000 (0:00:00.044) 0:02:57.116 ****** 2026-02-24 21:58:26.707879 | controller | ok: [instance] 2026-02-24 21:58:26.734063 | controller | 2026-02-24 21:58:26.734094 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-24 21:58:26.734104 | controller | Tuesday 24 February 2026 21:58:26 +0000 (0:00:00.204) 0:02:57.321 ****** 2026-02-24 21:58:26.734116 | controller | ok: [instance] 2026-02-24 21:58:26.764593 | controller | 2026-02-24 21:58:26.764615 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-24 21:58:26.764623 | controller | Tuesday 24 February 2026 21:58:26 +0000 (0:00:00.026) 0:02:57.347 ****** 2026-02-24 21:58:26.764632 | controller | skipping: [instance] 2026-02-24 21:58:26.812443 | controller | 2026-02-24 21:58:26.812464 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2026-02-24 21:58:26.812472 | controller | Tuesday 24 February 2026 21:58:26 +0000 (0:00:00.030) 0:02:57.378 ****** 2026-02-24 21:58:26.812482 | controller | 2026-02-24 21:58:26.895841 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 21:58:26.895862 | controller | Tuesday 24 February 2026 21:58:26 +0000 (0:00:00.047) 0:02:57.426 ****** 2026-02-24 21:58:26.895874 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2026-02-24 21:58:27.113907 | controller | 2026-02-24 21:58:27.113936 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 21:58:27.113945 | controller | Tuesday 24 February 2026 21:58:26 +0000 (0:00:00.083) 0:02:57.509 ****** 2026-02-24 21:58:27.113955 | controller | ok: [instance] 2026-02-24 21:58:27.333315 | controller | 2026-02-24 21:58:27.333383 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 21:58:27.333399 | controller | Tuesday 24 February 2026 21:58:27 +0000 (0:00:00.217) 0:02:57.727 ****** 2026-02-24 21:58:27.333416 | controller | ok: [instance] 2026-02-24 21:58:27.772873 | controller | 2026-02-24 21:58:27.772907 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2026-02-24 21:58:27.772914 | controller | Tuesday 24 February 2026 21:58:27 +0000 (0:00:00.218) 0:02:57.946 ****** 2026-02-24 21:58:27.772924 | controller | changed: [instance] 2026-02-24 21:58:27.776199 | controller | 2026-02-24 21:58:27.776542 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2026-02-24 21:58:27.776654 | controller | Tuesday 24 February 2026 21:58:27 +0000 (0:00:00.439) 0:02:58.385 ****** 2026-02-24 21:58:28.574142 | controller | changed: [instance] 2026-02-24 21:58:28.603235 | controller | 2026-02-24 21:58:28.603320 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 21:58:28.603339 | controller | Tuesday 24 February 2026 21:58:28 +0000 (0:00:00.801) 0:02:59.187 ****** 2026-02-24 21:58:28.603360 | controller | skipping: [instance] 2026-02-24 21:58:28.603468 | controller | 2026-02-24 21:58:28.603514 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2026-02-24 21:58:28.603529 | controller | Tuesday 24 February 2026 21:58:28 +0000 (0:00:00.029) 0:02:59.216 ****** 2026-02-24 21:58:28.666126 | controller | skipping: [instance] 2026-02-24 21:58:28.666290 | controller | 2026-02-24 21:58:28.666303 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2026-02-24 21:58:28.666313 | controller | Tuesday 24 February 2026 21:58:28 +0000 (0:00:00.062) 0:02:59.279 ****** 2026-02-24 21:58:28.724483 | controller | skipping: [instance] 2026-02-24 21:58:28.783044 | controller | 2026-02-24 21:58:28.783065 | controller | TASK [Create VBMC entity] ****************************************************** 2026-02-24 21:58:28.783073 | controller | Tuesday 24 February 2026 21:58:28 +0000 (0:00:00.058) 0:02:59.338 ****** 2026-02-24 21:58:28.783082 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 21:58:29.063676 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 21:58:29.063710 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 21:58:29.063720 | controller | skipping: [instance] 2026-02-24 21:58:29.063728 | controller | 2026-02-24 21:58:29.063736 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2026-02-24 21:58:29.063743 | controller | Tuesday 24 February 2026 21:58:28 +0000 (0:00:00.058) 0:02:59.396 ****** 2026-02-24 21:58:29.063754 | controller | ok: [instance] 2026-02-24 21:58:29.487364 | controller | 2026-02-24 21:58:29.487412 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2026-02-24 21:58:29.487422 | controller | Tuesday 24 February 2026 21:58:29 +0000 (0:00:00.280) 0:02:59.676 ****** 2026-02-24 21:58:29.487436 | controller | changed: [instance] 2026-02-24 21:58:29.528813 | controller | 2026-02-24 21:58:29.528835 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2026-02-24 21:58:29.528842 | controller | Tuesday 24 February 2026 21:58:29 +0000 (0:00:00.423) 0:03:00.100 ****** 2026-02-24 21:58:29.528851 | controller | skipping: [instance] 2026-02-24 21:58:29.567962 | controller | 2026-02-24 21:58:29.567980 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2026-02-24 21:58:29.567987 | controller | Tuesday 24 February 2026 21:58:29 +0000 (0:00:00.041) 0:03:00.142 ****** 2026-02-24 21:58:29.567995 | controller | skipping: [instance] 2026-02-24 21:58:29.611302 | controller | 2026-02-24 21:58:29.611321 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2026-02-24 21:58:29.611328 | controller | Tuesday 24 February 2026 21:58:29 +0000 (0:00:00.039) 0:03:00.181 ****** 2026-02-24 21:58:29.611347 | controller | skipping: [instance] 2026-02-24 21:58:30.396777 | controller | 2026-02-24 21:58:30.396828 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2026-02-24 21:58:30.396836 | controller | Tuesday 24 February 2026 21:58:29 +0000 (0:00:00.043) 0:03:00.224 ****** 2026-02-24 21:58:30.396848 | controller | changed: [instance] 2026-02-24 21:58:31.125408 | controller | 2026-02-24 21:58:31.125449 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2026-02-24 21:58:31.125457 | controller | Tuesday 24 February 2026 21:58:30 +0000 (0:00:00.784) 0:03:01.009 ****** 2026-02-24 21:58:31.125467 | controller | changed: [instance] 2026-02-24 21:58:31.169775 | controller | 2026-02-24 21:58:31.169808 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2026-02-24 21:58:31.169817 | controller | Tuesday 24 February 2026 21:58:31 +0000 (0:00:00.728) 0:03:01.737 ****** 2026-02-24 21:58:31.169828 | controller | skipping: [instance] 2026-02-24 21:58:31.232111 | controller | 2026-02-24 21:58:31.232139 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2026-02-24 21:58:31.232148 | controller | Tuesday 24 February 2026 21:58:31 +0000 (0:00:00.045) 0:03:01.783 ****** 2026-02-24 21:58:31.232163 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2026-02-24 21:58:31.277062 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2026-02-24 21:58:31.277091 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2026-02-24 21:58:31.277099 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2026-02-24 21:58:31.277105 | controller | 2026-02-24 21:58:31.277111 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2026-02-24 21:58:31.277117 | controller | Tuesday 24 February 2026 21:58:31 +0000 (0:00:00.062) 0:03:01.845 ****** 2026-02-24 21:58:31.277133 | controller | skipping: [instance] 2026-02-24 21:58:31.316662 | controller | 2026-02-24 21:58:31.316684 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2026-02-24 21:58:31.316691 | controller | Tuesday 24 February 2026 21:58:31 +0000 (0:00:00.045) 0:03:01.890 ****** 2026-02-24 21:58:31.316701 | controller | skipping: [instance] 2026-02-24 21:58:31.353873 | controller | 2026-02-24 21:58:31.353895 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2026-02-24 21:58:31.353903 | controller | Tuesday 24 February 2026 21:58:31 +0000 (0:00:00.039) 0:03:01.930 ****** 2026-02-24 21:58:31.353912 | controller | skipping: [instance] 2026-02-24 21:58:31.391977 | controller | 2026-02-24 21:58:31.392000 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2026-02-24 21:58:31.392010 | controller | Tuesday 24 February 2026 21:58:31 +0000 (0:00:00.037) 0:03:01.967 ****** 2026-02-24 21:58:31.392043 | controller | skipping: [instance] 2026-02-24 21:58:32.099795 | controller | 2026-02-24 21:58:32.099829 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2026-02-24 21:58:32.099837 | controller | Tuesday 24 February 2026 21:58:31 +0000 (0:00:00.037) 0:03:02.005 ****** 2026-02-24 21:58:32.099846 | controller | changed: [instance] 2026-02-24 21:58:32.130150 | controller | 2026-02-24 21:58:32.130172 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2026-02-24 21:58:32.130179 | controller | Tuesday 24 February 2026 21:58:32 +0000 (0:00:00.707) 0:03:02.712 ****** 2026-02-24 21:58:32.130188 | controller | skipping: [instance] 2026-02-24 21:58:32.171867 | controller | 2026-02-24 21:58:32.171889 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2026-02-24 21:58:32.171896 | controller | Tuesday 24 February 2026 21:58:32 +0000 (0:00:00.030) 0:03:02.743 ****** 2026-02-24 21:58:32.171904 | controller | skipping: [instance] 2026-02-24 21:58:32.211381 | controller | 2026-02-24 21:58:32.211402 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2026-02-24 21:58:32.211410 | controller | Tuesday 24 February 2026 21:58:32 +0000 (0:00:00.041) 0:03:02.785 ****** 2026-02-24 21:58:32.211419 | controller | skipping: [instance] 2026-02-24 21:58:32.249506 | controller | 2026-02-24 21:58:32.249524 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-24 21:58:32.249531 | controller | Tuesday 24 February 2026 21:58:32 +0000 (0:00:00.039) 0:03:02.824 ****** 2026-02-24 21:58:32.249540 | controller | skipping: [instance] 2026-02-24 21:58:32.292064 | controller | 2026-02-24 21:58:32.292083 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-24 21:58:32.292091 | controller | Tuesday 24 February 2026 21:58:32 +0000 (0:00:00.038) 0:03:02.863 ****** 2026-02-24 21:58:32.292100 | controller | skipping: [instance] 2026-02-24 21:58:32.334050 | controller | 2026-02-24 21:58:32.334070 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-24 21:58:32.334078 | controller | Tuesday 24 February 2026 21:58:32 +0000 (0:00:00.042) 0:03:02.905 ****** 2026-02-24 21:58:32.334087 | controller | skipping: [instance] 2026-02-24 21:58:32.374381 | controller | 2026-02-24 21:58:32.374398 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-24 21:58:32.374405 | controller | Tuesday 24 February 2026 21:58:32 +0000 (0:00:00.042) 0:03:02.947 ****** 2026-02-24 21:58:32.374413 | controller | skipping: [instance] 2026-02-24 21:58:32.412487 | controller | 2026-02-24 21:58:32.412549 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-24 21:58:32.412558 | controller | Tuesday 24 February 2026 21:58:32 +0000 (0:00:00.040) 0:03:02.987 ****** 2026-02-24 21:58:32.412571 | controller | skipping: [instance] 2026-02-24 21:58:32.448471 | controller | 2026-02-24 21:58:32.448510 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-24 21:58:32.448517 | controller | Tuesday 24 February 2026 21:58:32 +0000 (0:00:00.037) 0:03:03.025 ****** 2026-02-24 21:58:32.448528 | controller | skipping: [instance] 2026-02-24 21:58:32.501822 | controller | 2026-02-24 21:58:32.501841 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-24 21:58:32.501859 | controller | Tuesday 24 February 2026 21:58:32 +0000 (0:00:00.036) 0:03:03.061 ****** 2026-02-24 21:58:32.501868 | controller | skipping: [instance] 2026-02-24 21:58:32.538861 | controller | 2026-02-24 21:58:32.538880 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2026-02-24 21:58:32.538893 | controller | Tuesday 24 February 2026 21:58:32 +0000 (0:00:00.053) 0:03:03.115 ****** 2026-02-24 21:58:32.538902 | controller | skipping: [instance] 2026-02-24 21:58:32.771995 | controller | 2026-02-24 21:58:32.772566 | controller | TASK [reproducer : Configure Controller node] ********************************** 2026-02-24 21:58:32.772578 | controller | Tuesday 24 February 2026 21:58:32 +0000 (0:00:00.036) 0:03:03.152 ****** 2026-02-24 21:58:32.772592 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2026-02-24 21:58:32.772749 | controller | 2026-02-24 21:58:32.772762 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-24 21:58:32.772883 | controller | Tuesday 24 February 2026 21:58:32 +0000 (0:00:00.226) 0:03:03.378 ****** 2026-02-24 21:58:34.373893 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-24 21:58:34.403105 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-24 21:58:34.403136 | controller | 2026-02-24 21:58:34.403144 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-24 21:58:34.403150 | controller | Tuesday 24 February 2026 21:58:34 +0000 (0:00:01.607) 0:03:04.986 ****** 2026-02-24 21:58:34.403160 | controller | skipping: [instance] 2026-02-24 21:58:35.103695 | controller | 2026-02-24 21:58:35.103758 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-24 21:58:35.103768 | controller | Tuesday 24 February 2026 21:58:34 +0000 (0:00:00.029) 0:03:05.016 ****** 2026-02-24 21:58:35.103781 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:35.103985 | controller | 2026-02-24 21:58:35.152110 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-24 21:58:35.152168 | controller | Tuesday 24 February 2026 21:58:35 +0000 (0:00:00.700) 0:03:05.716 ****** 2026-02-24 21:58:35.152182 | controller | skipping: [instance] 2026-02-24 21:58:35.200539 | controller | 2026-02-24 21:58:35.200580 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-24 21:58:35.200589 | controller | Tuesday 24 February 2026 21:58:35 +0000 (0:00:00.048) 0:03:05.765 ****** 2026-02-24 21:58:35.200602 | controller | skipping: [instance] 2026-02-24 21:58:35.200638 | controller | 2026-02-24 21:58:35.200674 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-24 21:58:35.200849 | controller | Tuesday 24 February 2026 21:58:35 +0000 (0:00:00.048) 0:03:05.813 ****** 2026-02-24 21:58:35.249358 | controller | skipping: [instance] 2026-02-24 21:58:35.249430 | controller | 2026-02-24 21:58:35.249444 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-24 21:58:35.249539 | controller | Tuesday 24 February 2026 21:58:35 +0000 (0:00:00.048) 0:03:05.862 ****** 2026-02-24 21:58:35.304734 | controller | skipping: [instance] 2026-02-24 21:58:35.304816 | controller | 2026-02-24 21:58:35.304931 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2026-02-24 21:58:35.305060 | controller | Tuesday 24 February 2026 21:58:35 +0000 (0:00:00.055) 0:03:05.918 ****** 2026-02-24 21:58:35.350734 | controller | skipping: [instance] 2026-02-24 21:58:35.396343 | controller | 2026-02-24 21:58:35.396399 | controller | TASK [reproducer : Install repos] ********************************************** 2026-02-24 21:58:35.396409 | controller | Tuesday 24 February 2026 21:58:35 +0000 (0:00:00.045) 0:03:05.963 ****** 2026-02-24 21:58:35.396421 | controller | skipping: [instance] 2026-02-24 21:58:35.396465 | controller | 2026-02-24 21:58:35.396474 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2026-02-24 21:58:35.396591 | controller | Tuesday 24 February 2026 21:58:35 +0000 (0:00:00.045) 0:03:06.009 ****** 2026-02-24 21:58:35.443939 | controller | skipping: [instance] 2026-02-24 21:58:35.444012 | controller | 2026-02-24 21:58:35.444152 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2026-02-24 21:58:35.444246 | controller | Tuesday 24 February 2026 21:58:35 +0000 (0:00:00.047) 0:03:06.057 ****** 2026-02-24 21:58:35.488203 | controller | skipping: [instance] 2026-02-24 21:58:35.488294 | controller | 2026-02-24 21:58:35.488417 | controller | TASK [reproducer : Install some tools] ***************************************** 2026-02-24 21:58:35.488512 | controller | Tuesday 24 February 2026 21:58:35 +0000 (0:00:00.044) 0:03:06.101 ****** 2026-02-24 21:58:36.787569 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:37.992993 | controller | 2026-02-24 21:58:37.993046 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2026-02-24 21:58:37.993056 | controller | Tuesday 24 February 2026 21:58:36 +0000 (0:00:01.298) 0:03:07.400 ****** 2026-02-24 21:58:37.993067 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:38.727083 | controller | 2026-02-24 21:58:38.727125 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2026-02-24 21:58:38.727140 | controller | Tuesday 24 February 2026 21:58:37 +0000 (0:00:01.204) 0:03:08.605 ****** 2026-02-24 21:58:38.727151 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:39.812843 | controller | 2026-02-24 21:58:39.812901 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2026-02-24 21:58:39.812911 | controller | Tuesday 24 February 2026 21:58:38 +0000 (0:00:00.733) 0:03:09.339 ****** 2026-02-24 21:58:39.812925 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:39.812955 | controller | 2026-02-24 21:58:39.812965 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2026-02-24 21:58:41.093582 | controller | Tuesday 24 February 2026 21:58:39 +0000 (0:00:01.086) 0:03:10.426 ****** 2026-02-24 21:58:41.093630 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-24 21:58:41.801925 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 21:58:41.801967 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 21:58:41.801974 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 21:58:41.801979 | controller | 2026-02-24 21:58:41.801985 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2026-02-24 21:58:41.801990 | controller | Tuesday 24 February 2026 21:58:41 +0000 (0:00:01.280) 0:03:11.706 ****** 2026-02-24 21:58:41.802000 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-24 21:58:43.770233 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 21:58:43.770271 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 21:58:43.770278 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 21:58:43.770284 | controller | 2026-02-24 21:58:43.770290 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2026-02-24 21:58:43.770296 | controller | Tuesday 24 February 2026 21:58:41 +0000 (0:00:00.708) 0:03:12.414 ****** 2026-02-24 21:58:43.770307 | controller | skipping: [instance] => (item=instance) 2026-02-24 21:58:44.403056 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2026-02-24 21:58:44.403100 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-24 21:58:44.403108 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2026-02-24 21:58:44.403114 | controller | 2026-02-24 21:58:44.403119 | controller | TASK [reproducer : Create kube directory] ************************************** 2026-02-24 21:58:44.403125 | controller | Tuesday 24 February 2026 21:58:43 +0000 (0:00:01.966) 0:03:14.380 ****** 2026-02-24 21:58:44.403137 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:45.456172 | controller | 2026-02-24 21:58:45.456212 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2026-02-24 21:58:45.456221 | controller | Tuesday 24 February 2026 21:58:44 +0000 (0:00:00.634) 0:03:15.015 ****** 2026-02-24 21:58:45.456232 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:46.518392 | controller | 2026-02-24 21:58:46.518437 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2026-02-24 21:58:46.518446 | controller | Tuesday 24 February 2026 21:58:45 +0000 (0:00:01.053) 0:03:16.069 ****** 2026-02-24 21:58:46.518458 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:46.554898 | controller | 2026-02-24 21:58:46.554933 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2026-02-24 21:58:46.554941 | controller | Tuesday 24 February 2026 21:58:46 +0000 (0:00:01.062) 0:03:17.131 ****** 2026-02-24 21:58:46.554952 | controller | skipping: [instance] 2026-02-24 21:58:47.212867 | controller | 2026-02-24 21:58:47.212906 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2026-02-24 21:58:47.212915 | controller | Tuesday 24 February 2026 21:58:46 +0000 (0:00:00.036) 0:03:17.168 ****** 2026-02-24 21:58:47.212926 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:47.890103 | controller | 2026-02-24 21:58:47.890141 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2026-02-24 21:58:47.890149 | controller | Tuesday 24 February 2026 21:58:47 +0000 (0:00:00.657) 0:03:17.826 ****** 2026-02-24 21:58:47.890160 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:47.890369 | controller | 2026-02-24 21:58:47.890396 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2026-02-24 21:58:47.938985 | controller | Tuesday 24 February 2026 21:58:47 +0000 (0:00:00.677) 0:03:18.503 ****** 2026-02-24 21:58:47.939043 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:48.015632 | controller | 2026-02-24 21:58:48.015669 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2026-02-24 21:58:48.015677 | controller | Tuesday 24 February 2026 21:58:47 +0000 (0:00:00.048) 0:03:18.552 ****** 2026-02-24 21:58:48.015688 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2026-02-24 21:58:48.079089 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2026-02-24 21:58:48.079123 | controller | 2026-02-24 21:58:48.079131 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-24 21:58:48.079137 | controller | Tuesday 24 February 2026 21:58:48 +0000 (0:00:00.076) 0:03:18.628 ****** 2026-02-24 21:58:48.079147 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 21:58:48.079312 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2026-02-24 21:58:48.079323 | controller | 2026-02-24 21:58:48.079330 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-24 21:58:48.079337 | controller | Tuesday 24 February 2026 21:58:48 +0000 (0:00:00.063) 0:03:18.692 ****** 2026-02-24 21:58:48.149570 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 21:58:48.204264 | controller | _secret_file: '' 2026-02-24 21:58:48.204292 | controller | 2026-02-24 21:58:48.204300 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-24 21:58:48.204312 | controller | Tuesday 24 February 2026 21:58:48 +0000 (0:00:00.070) 0:03:18.762 ****** 2026-02-24 21:58:48.204322 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 21:58:48.257077 | controller | _secret_content: my-default-location-place 2026-02-24 21:58:48.257101 | controller | 2026-02-24 21:58:48.257109 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-24 21:58:48.257115 | controller | Tuesday 24 February 2026 21:58:48 +0000 (0:00:00.054) 0:03:18.817 ****** 2026-02-24 21:58:48.257124 | controller | skipping: [instance] 2026-02-24 21:58:48.257294 | controller | 2026-02-24 21:58:48.257307 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-24 21:58:48.310121 | controller | Tuesday 24 February 2026 21:58:48 +0000 (0:00:00.052) 0:03:18.870 ****** 2026-02-24 21:58:48.310149 | controller | skipping: [instance] 2026-02-24 21:58:48.310451 | controller | 2026-02-24 21:58:48.362783 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-24 21:58:48.362803 | controller | Tuesday 24 February 2026 21:58:48 +0000 (0:00:00.053) 0:03:18.923 ****** 2026-02-24 21:58:48.362813 | controller | skipping: [instance] 2026-02-24 21:58:49.470971 | controller | 2026-02-24 21:58:49.471011 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-24 21:58:49.471019 | controller | Tuesday 24 February 2026 21:58:48 +0000 (0:00:00.052) 0:03:18.976 ****** 2026-02-24 21:58:49.471048 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:49.559151 | controller | 2026-02-24 21:58:49.559194 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-24 21:58:49.559202 | controller | Tuesday 24 February 2026 21:58:49 +0000 (0:00:01.107) 0:03:20.084 ****** 2026-02-24 21:58:49.559213 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 21:58:49.612091 | controller | _secret_dest: /home/zuul/ipmi-things 2026-02-24 21:58:49.612121 | controller | 2026-02-24 21:58:49.612132 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-24 21:58:49.612140 | controller | Tuesday 24 February 2026 21:58:49 +0000 (0:00:00.088) 0:03:20.172 ****** 2026-02-24 21:58:49.612152 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 21:58:49.612661 | controller | _secret_file: /tmp/ipmi-things 2026-02-24 21:58:49.612682 | controller | 2026-02-24 21:58:49.665076 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-24 21:58:49.665099 | controller | Tuesday 24 February 2026 21:58:49 +0000 (0:00:00.053) 0:03:20.225 ****** 2026-02-24 21:58:49.665111 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 21:58:49.665489 | controller | _secret_content: '' 2026-02-24 21:58:49.665507 | controller | 2026-02-24 21:58:49.725936 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-24 21:58:49.725960 | controller | Tuesday 24 February 2026 21:58:49 +0000 (0:00:00.052) 0:03:20.278 ****** 2026-02-24 21:58:49.725972 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2026-02-24 21:58:50.343852 | controller | msg: All assertions passed 2026-02-24 21:58:50.343903 | controller | 2026-02-24 21:58:50.343912 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-24 21:58:50.343918 | controller | Tuesday 24 February 2026 21:58:49 +0000 (0:00:00.060) 0:03:20.339 ****** 2026-02-24 21:58:50.343929 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:51.482590 | controller | 2026-02-24 21:58:51.482640 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-24 21:58:51.482649 | controller | Tuesday 24 February 2026 21:58:50 +0000 (0:00:00.615) 0:03:20.955 ****** 2026-02-24 21:58:51.482660 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:51.545273 | controller | 2026-02-24 21:58:51.545302 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-24 21:58:51.545311 | controller | Tuesday 24 February 2026 21:58:51 +0000 (0:00:01.139) 0:03:22.094 ****** 2026-02-24 21:58:51.545321 | controller | skipping: [instance] 2026-02-24 21:58:52.253511 | controller | 2026-02-24 21:58:52.253572 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2026-02-24 21:58:52.253582 | controller | Tuesday 24 February 2026 21:58:51 +0000 (0:00:00.063) 0:03:22.158 ****** 2026-02-24 21:58:52.253595 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:58:52.253776 | controller | 2026-02-24 21:58:52.253924 | controller | TASK [reproducer : Check if async file is still available] ********************* 2026-02-24 21:58:52.254085 | controller | Tuesday 24 February 2026 21:58:52 +0000 (0:00:00.702) 0:03:22.860 ****** 2026-02-24 21:58:52.961250 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:59:32.691916 | controller | 2026-02-24 21:59:32.692675 | controller | TASK [reproducer : Check package install status] ******************************* 2026-02-24 21:59:32.692697 | controller | Tuesday 24 February 2026 21:58:52 +0000 (0:00:00.712) 0:03:23.573 ****** 2026-02-24 21:59:32.692709 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2026-02-24 21:59:32.692788 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2026-02-24 21:59:32.692797 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2026-02-24 21:59:32.692819 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2026-02-24 21:59:32.692991 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2026-02-24 21:59:32.693156 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2026-02-24 21:59:32.693302 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2026-02-24 21:59:32.693449 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:59:32.693575 | controller | 2026-02-24 21:59:32.693703 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2026-02-24 21:59:32.693827 | controller | Tuesday 24 February 2026 21:59:32 +0000 (0:00:39.727) 0:04:03.300 ****** 2026-02-24 21:59:33.552456 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:59:33.552675 | controller | 2026-02-24 21:59:33.552887 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2026-02-24 21:59:33.553120 | controller | Tuesday 24 February 2026 21:59:33 +0000 (0:00:00.864) 0:04:04.165 ****** 2026-02-24 21:59:40.723842 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:59:40.772230 | controller | 2026-02-24 21:59:40.772262 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2026-02-24 21:59:40.772270 | controller | Tuesday 24 February 2026 21:59:40 +0000 (0:00:07.171) 0:04:11.337 ****** 2026-02-24 21:59:40.772281 | controller | skipping: [instance] 2026-02-24 21:59:40.822959 | controller | 2026-02-24 21:59:40.822994 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2026-02-24 21:59:40.823003 | controller | Tuesday 24 February 2026 21:59:40 +0000 (0:00:00.048) 0:04:11.385 ****** 2026-02-24 21:59:40.823013 | controller | skipping: [instance] 2026-02-24 21:59:41.584534 | controller | 2026-02-24 21:59:41.584573 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2026-02-24 21:59:41.584581 | controller | Tuesday 24 February 2026 21:59:40 +0000 (0:00:00.050) 0:04:11.436 ****** 2026-02-24 21:59:41.584592 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:59:42.237784 | controller | 2026-02-24 21:59:42.237828 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2026-02-24 21:59:42.237836 | controller | Tuesday 24 February 2026 21:59:41 +0000 (0:00:00.761) 0:04:12.197 ****** 2026-02-24 21:59:42.237848 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:59:42.570138 | controller | 2026-02-24 21:59:42.570174 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2026-02-24 21:59:42.570183 | controller | Tuesday 24 February 2026 21:59:42 +0000 (0:00:00.653) 0:04:12.850 ****** 2026-02-24 21:59:42.570194 | controller | changed: [instance] 2026-02-24 21:59:43.316761 | controller | 2026-02-24 21:59:43.316799 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2026-02-24 21:59:43.316807 | controller | Tuesday 24 February 2026 21:59:42 +0000 (0:00:00.332) 0:04:13.182 ****** 2026-02-24 21:59:43.316818 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:59:44.412627 | controller | 2026-02-24 21:59:44.412679 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2026-02-24 21:59:44.412687 | controller | Tuesday 24 February 2026 21:59:43 +0000 (0:00:00.746) 0:04:13.929 ****** 2026-02-24 21:59:44.412699 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:59:44.474622 | controller | 2026-02-24 21:59:44.474657 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 21:59:44.474674 | controller | Tuesday 24 February 2026 21:59:44 +0000 (0:00:01.095) 0:04:15.025 ****** 2026-02-24 21:59:44.474688 | controller | skipping: [instance] 2026-02-24 21:59:44.531847 | controller | 2026-02-24 21:59:44.531879 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 21:59:44.531887 | controller | Tuesday 24 February 2026 21:59:44 +0000 (0:00:00.062) 0:04:15.087 ****** 2026-02-24 21:59:44.531898 | controller | skipping: [instance] 2026-02-24 21:59:44.578388 | controller | 2026-02-24 21:59:44.578425 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 21:59:44.578433 | controller | Tuesday 24 February 2026 21:59:44 +0000 (0:00:00.057) 0:04:15.145 ****** 2026-02-24 21:59:44.578445 | controller | skipping: [instance] 2026-02-24 21:59:44.636452 | controller | 2026-02-24 21:59:44.636474 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2026-02-24 21:59:44.636482 | controller | Tuesday 24 February 2026 21:59:44 +0000 (0:00:00.046) 0:04:15.191 ****** 2026-02-24 21:59:44.636491 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:59:44.683085 | controller | 2026-02-24 21:59:44.683108 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2026-02-24 21:59:44.683115 | controller | Tuesday 24 February 2026 21:59:44 +0000 (0:00:00.058) 0:04:15.249 ****** 2026-02-24 21:59:44.683124 | controller | skipping: [instance] 2026-02-24 21:59:44.683310 | controller | 2026-02-24 21:59:44.683323 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2026-02-24 21:59:44.725553 | controller | Tuesday 24 February 2026 21:59:44 +0000 (0:00:00.046) 0:04:15.296 ****** 2026-02-24 21:59:44.725579 | controller | skipping: [instance] 2026-02-24 21:59:44.766793 | controller | 2026-02-24 21:59:44.766813 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2026-02-24 21:59:44.766821 | controller | Tuesday 24 February 2026 21:59:44 +0000 (0:00:00.042) 0:04:15.339 ****** 2026-02-24 21:59:44.766830 | controller | skipping: [instance] 2026-02-24 21:59:45.417455 | controller | 2026-02-24 21:59:45.417496 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2026-02-24 21:59:45.417506 | controller | Tuesday 24 February 2026 21:59:44 +0000 (0:00:00.041) 0:04:15.380 ****** 2026-02-24 21:59:45.417516 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:59:45.521587 | controller | 2026-02-24 21:59:45.521620 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2026-02-24 21:59:45.521629 | controller | Tuesday 24 February 2026 21:59:45 +0000 (0:00:00.650) 0:04:16.030 ****** 2026-02-24 21:59:45.521640 | controller | skipping: [instance] => (item=secret) 2026-02-24 21:59:46.577341 | controller | skipping: [instance] => (item=configmap) 2026-02-24 21:59:46.578118 | controller | skipping: [instance] => (item=pod) 2026-02-24 21:59:46.578134 | controller | skipping: [instance] => (item=service) 2026-02-24 21:59:46.578140 | controller | skipping: [instance] => (item=route) 2026-02-24 21:59:46.578146 | controller | skipping: [instance] 2026-02-24 21:59:46.578159 | controller | 2026-02-24 21:59:46.578168 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2026-02-24 21:59:46.578175 | controller | Tuesday 24 February 2026 21:59:45 +0000 (0:00:00.104) 0:04:16.134 ****** 2026-02-24 21:59:46.578186 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:59:47.670622 | controller | 2026-02-24 21:59:47.670661 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2026-02-24 21:59:47.670669 | controller | Tuesday 24 February 2026 21:59:46 +0000 (0:00:01.052) 0:04:17.186 ****** 2026-02-24 21:59:47.670680 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:59:47.709494 | controller | 2026-02-24 21:59:47.709530 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2026-02-24 21:59:47.709543 | controller | Tuesday 24 February 2026 21:59:47 +0000 (0:00:01.095) 0:04:18.282 ****** 2026-02-24 21:59:47.709559 | controller | skipping: [instance] 2026-02-24 21:59:47.747511 | controller | 2026-02-24 21:59:47.747541 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2026-02-24 21:59:47.747563 | controller | Tuesday 24 February 2026 21:59:47 +0000 (0:00:00.040) 0:04:18.322 ****** 2026-02-24 21:59:47.747577 | controller | skipping: [instance] 2026-02-24 21:59:47.828543 | controller | 2026-02-24 21:59:47.828577 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2026-02-24 21:59:47.828590 | controller | Tuesday 24 February 2026 21:59:47 +0000 (0:00:00.038) 0:04:18.360 ****** 2026-02-24 21:59:47.828605 | controller | skipping: [instance] => (item=secret) 2026-02-24 21:59:47.828864 | controller | skipping: [instance] => (item=configmap) 2026-02-24 21:59:47.829155 | controller | skipping: [instance] => (item=service) 2026-02-24 21:59:47.829294 | controller | skipping: [instance] => (item=route) 2026-02-24 21:59:47.829429 | controller | skipping: [instance] 2026-02-24 21:59:47.829551 | controller | 2026-02-24 21:59:47.829676 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2026-02-24 21:59:47.829799 | controller | Tuesday 24 February 2026 21:59:47 +0000 (0:00:00.081) 0:04:18.442 ****** 2026-02-24 21:59:47.879453 | controller | skipping: [instance] 2026-02-24 21:59:47.879716 | controller | 2026-02-24 21:59:47.879961 | controller | TASK [podman : Ensure podman is installed] ************************************* 2026-02-24 21:59:47.880254 | controller | Tuesday 24 February 2026 21:59:47 +0000 (0:00:00.050) 0:04:18.493 ****** 2026-02-24 21:59:49.528222 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:59:50.446543 | controller | 2026-02-24 21:59:50.446581 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2026-02-24 21:59:50.446590 | controller | Tuesday 24 February 2026 21:59:49 +0000 (0:00:01.644) 0:04:20.137 ****** 2026-02-24 21:59:50.446602 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 21:59:50.492869 | controller | 2026-02-24 21:59:50.492891 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2026-02-24 21:59:50.492898 | controller | Tuesday 24 February 2026 21:59:50 +0000 (0:00:00.921) 0:04:21.059 ****** 2026-02-24 21:59:50.492908 | controller | skipping: [instance] 2026-02-24 21:59:50.534062 | controller | 2026-02-24 21:59:50.534088 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2026-02-24 21:59:50.534098 | controller | Tuesday 24 February 2026 21:59:50 +0000 (0:00:00.046) 0:04:21.106 ****** 2026-02-24 21:59:50.534109 | controller | skipping: [instance] 2026-02-24 21:59:50.583503 | controller | 2026-02-24 21:59:50.583520 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2026-02-24 21:59:50.583527 | controller | Tuesday 24 February 2026 21:59:50 +0000 (0:00:00.040) 0:04:21.147 ****** 2026-02-24 21:59:50.583535 | controller | skipping: [instance] 2026-02-24 22:00:01.586569 | controller | 2026-02-24 22:00:01.586624 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2026-02-24 22:00:01.586634 | controller | Tuesday 24 February 2026 21:59:50 +0000 (0:00:00.049) 0:04:21.196 ****** 2026-02-24 22:00:01.586645 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:03.212485 | controller | 2026-02-24 22:00:03.212528 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2026-02-24 22:00:03.212542 | controller | Tuesday 24 February 2026 22:00:01 +0000 (0:00:11.002) 0:04:32.199 ****** 2026-02-24 22:00:03.212553 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:04.515880 | controller | 2026-02-24 22:00:04.515915 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-24 22:00:04.515923 | controller | Tuesday 24 February 2026 22:00:03 +0000 (0:00:01.626) 0:04:33.825 ****** 2026-02-24 22:00:04.515934 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-24 22:00:04.666561 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-24 22:00:04.666592 | controller | 2026-02-24 22:00:04.666603 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2026-02-24 22:00:04.666611 | controller | Tuesday 24 February 2026 22:00:04 +0000 (0:00:01.303) 0:04:35.128 ****** 2026-02-24 22:00:04.666624 | controller | skipping: [instance] 2026-02-24 22:00:05.359245 | controller | 2026-02-24 22:00:05.359283 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2026-02-24 22:00:05.359291 | controller | Tuesday 24 February 2026 22:00:04 +0000 (0:00:00.151) 0:04:35.279 ****** 2026-02-24 22:00:05.359302 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:05.410600 | controller | 2026-02-24 22:00:05.410627 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2026-02-24 22:00:05.410635 | controller | Tuesday 24 February 2026 22:00:05 +0000 (0:00:00.692) 0:04:35.972 ****** 2026-02-24 22:00:05.410646 | controller | skipping: [instance] 2026-02-24 22:00:05.461792 | controller | 2026-02-24 22:00:05.461843 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2026-02-24 22:00:05.461859 | controller | Tuesday 24 February 2026 22:00:05 +0000 (0:00:00.051) 0:04:36.023 ****** 2026-02-24 22:00:05.461878 | controller | skipping: [instance] 2026-02-24 22:00:05.512053 | controller | 2026-02-24 22:00:05.512078 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-24 22:00:05.512088 | controller | Tuesday 24 February 2026 22:00:05 +0000 (0:00:00.051) 0:04:36.075 ****** 2026-02-24 22:00:05.512101 | controller | skipping: [instance] 2026-02-24 22:00:05.559711 | controller | 2026-02-24 22:00:05.559730 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-24 22:00:05.559738 | controller | Tuesday 24 February 2026 22:00:05 +0000 (0:00:00.050) 0:04:36.125 ****** 2026-02-24 22:00:05.559747 | controller | skipping: [instance] 2026-02-24 22:00:05.713189 | controller | 2026-02-24 22:00:05.713209 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2026-02-24 22:00:05.713216 | controller | Tuesday 24 February 2026 22:00:05 +0000 (0:00:00.047) 0:04:36.172 ****** 2026-02-24 22:00:05.713224 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) 2026-02-24 22:00:06.921080 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) 2026-02-24 22:00:06.921121 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) 2026-02-24 22:00:06.921131 | controller | 2026-02-24 22:00:06.921138 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2026-02-24 22:00:06.921145 | controller | Tuesday 24 February 2026 22:00:05 +0000 (0:00:00.153) 0:04:36.326 ****** 2026-02-24 22:00:06.921157 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:06.967338 | controller | 2026-02-24 22:00:06.967369 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2026-02-24 22:00:06.967377 | controller | Tuesday 24 February 2026 22:00:06 +0000 (0:00:01.207) 0:04:37.534 ****** 2026-02-24 22:00:06.967388 | controller | skipping: [instance] 2026-02-24 22:00:07.123094 | controller | 2026-02-24 22:00:07.123119 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2026-02-24 22:00:07.123128 | controller | Tuesday 24 February 2026 22:00:06 +0000 (0:00:00.046) 0:04:37.580 ****** 2026-02-24 22:00:07.123139 | controller | 2026-02-24 22:00:07.181862 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2026-02-24 22:00:07.181884 | controller | Tuesday 24 February 2026 22:00:07 +0000 (0:00:00.155) 0:04:37.736 ****** 2026-02-24 22:00:07.181896 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:07.233441 | controller | 2026-02-24 22:00:07.233472 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-24 22:00:07.233484 | controller | Tuesday 24 February 2026 22:00:07 +0000 (0:00:00.058) 0:04:37.795 ****** 2026-02-24 22:00:07.233497 | controller | skipping: [instance] 2026-02-24 22:00:07.284299 | controller | 2026-02-24 22:00:07.284327 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-24 22:00:07.284340 | controller | Tuesday 24 February 2026 22:00:07 +0000 (0:00:00.051) 0:04:37.846 ****** 2026-02-24 22:00:07.284352 | controller | skipping: [instance] 2026-02-24 22:00:08.779275 | controller | 2026-02-24 22:00:08.779307 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2026-02-24 22:00:08.779315 | controller | Tuesday 24 February 2026 22:00:07 +0000 (0:00:00.050) 0:04:37.897 ****** 2026-02-24 22:00:08.779325 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:16.799156 | controller | 2026-02-24 22:00:16.799195 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2026-02-24 22:00:16.799204 | controller | Tuesday 24 February 2026 22:00:08 +0000 (0:00:01.495) 0:04:39.392 ****** 2026-02-24 22:00:16.799216 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1) 2026-02-24 22:00:16.914803 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b) 2026-02-24 22:00:16.914839 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282) 2026-02-24 22:00:16.914847 | controller | 2026-02-24 22:00:16.914854 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2026-02-24 22:00:16.914860 | controller | Tuesday 24 February 2026 22:00:16 +0000 (0:00:08.019) 0:04:47.411 ****** 2026-02-24 22:00:16.914876 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2026-02-24 22:00:17.162095 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2026-02-24 22:00:17.162140 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2026-02-24 22:00:17.162149 | controller | 2026-02-24 22:00:17.162155 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2026-02-24 22:00:17.162161 | controller | Tuesday 24 February 2026 22:00:16 +0000 (0:00:00.115) 0:04:47.527 ****** 2026-02-24 22:00:17.162172 | controller | ok: [instance -> localhost] 2026-02-24 22:00:19.344891 | controller | 2026-02-24 22:00:19.344934 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2026-02-24 22:00:19.344943 | controller | Tuesday 24 February 2026 22:00:17 +0000 (0:00:00.247) 0:04:47.775 ****** 2026-02-24 22:00:19.344954 | controller | changed: [instance -> localhost] => (item=controller-0) 2026-02-24 22:00:20.064670 | controller | 2026-02-24 22:00:20.064708 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2026-02-24 22:00:20.064717 | controller | Tuesday 24 February 2026 22:00:19 +0000 (0:00:02.182) 0:04:49.957 ****** 2026-02-24 22:00:20.064729 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:20.914274 | controller | 2026-02-24 22:00:20.914330 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2026-02-24 22:00:20.914339 | controller | Tuesday 24 February 2026 22:00:20 +0000 (0:00:00.719) 0:04:50.677 ****** 2026-02-24 22:00:20.914356 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:22.218225 | controller | 2026-02-24 22:00:22.218284 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2026-02-24 22:00:22.218293 | controller | Tuesday 24 February 2026 22:00:20 +0000 (0:00:00.848) 0:04:51.526 ****** 2026-02-24 22:00:22.218308 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:22.218326 | controller | 2026-02-24 22:00:22.218333 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2026-02-24 22:00:22.218340 | controller | Tuesday 24 February 2026 22:00:22 +0000 (0:00:01.304) 0:04:52.830 ****** 2026-02-24 22:00:22.917073 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:24.077958 | controller | 2026-02-24 22:00:24.078034 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2026-02-24 22:00:24.078048 | controller | Tuesday 24 February 2026 22:00:22 +0000 (0:00:00.698) 0:04:53.529 ****** 2026-02-24 22:00:24.078060 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:24.078340 | controller | 2026-02-24 22:00:24.078513 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2026-02-24 22:00:24.078527 | controller | Tuesday 24 February 2026 22:00:24 +0000 (0:00:01.161) 0:04:54.690 ****** 2026-02-24 22:00:24.728859 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:25.396260 | controller | 2026-02-24 22:00:25.396297 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2026-02-24 22:00:25.396305 | controller | Tuesday 24 February 2026 22:00:24 +0000 (0:00:00.651) 0:04:55.342 ****** 2026-02-24 22:00:25.396315 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:26.827305 | controller | 2026-02-24 22:00:26.827363 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2026-02-24 22:00:26.827372 | controller | Tuesday 24 February 2026 22:00:25 +0000 (0:00:00.667) 0:04:56.009 ****** 2026-02-24 22:00:26.827385 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-24 22:00:26.869863 | controller | 2026-02-24 22:00:26.869916 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 22:00:26.869925 | controller | Tuesday 24 February 2026 22:00:26 +0000 (0:00:01.427) 0:04:57.436 ****** 2026-02-24 22:00:26.869939 | controller | skipping: [instance] 2026-02-24 22:00:26.914708 | controller | 2026-02-24 22:00:26.914770 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 22:00:26.914779 | controller | Tuesday 24 February 2026 22:00:26 +0000 (0:00:00.046) 0:04:57.483 ****** 2026-02-24 22:00:26.914793 | controller | skipping: [instance] 2026-02-24 22:00:26.956784 | controller | 2026-02-24 22:00:26.956830 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 22:00:26.956839 | controller | Tuesday 24 February 2026 22:00:26 +0000 (0:00:00.043) 0:04:57.527 ****** 2026-02-24 22:00:26.956852 | controller | skipping: [instance] 2026-02-24 22:00:27.006766 | controller | 2026-02-24 22:00:27.006807 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 22:00:27.006816 | controller | Tuesday 24 February 2026 22:00:26 +0000 (0:00:00.042) 0:04:57.570 ****** 2026-02-24 22:00:27.006827 | controller | skipping: [instance] 2026-02-24 22:00:27.044956 | controller | 2026-02-24 22:00:27.045194 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 22:00:27.045215 | controller | Tuesday 24 February 2026 22:00:27 +0000 (0:00:00.048) 0:04:57.618 ****** 2026-02-24 22:00:27.045228 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:27.045731 | controller | 2026-02-24 22:00:27.156506 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 22:00:27.156537 | controller | Tuesday 24 February 2026 22:00:27 +0000 (0:00:00.040) 0:04:57.658 ****** 2026-02-24 22:00:27.156560 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-24 22:00:27.211910 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2026-02-24 22:00:27.211935 | controller | 2026-02-24 22:00:27.211943 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 22:00:27.211949 | controller | Tuesday 24 February 2026 22:00:27 +0000 (0:00:00.111) 0:04:57.769 ****** 2026-02-24 22:00:27.211959 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2026-02-24 22:00:30.954298 | controller | 2026-02-24 22:00:30.954362 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2026-02-24 22:00:30.954372 | controller | Tuesday 24 February 2026 22:00:27 +0000 (0:00:00.055) 0:04:57.825 ****** 2026-02-24 22:00:30.954387 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-24 22:00:31.994666 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2026-02-24 22:00:31.994720 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-24 22:00:31.994727 | controller | 2026-02-24 22:00:31.994734 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2026-02-24 22:00:31.994741 | controller | Tuesday 24 February 2026 22:00:30 +0000 (0:00:03.741) 0:05:01.567 ****** 2026-02-24 22:00:31.994752 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:32.478874 | controller | 2026-02-24 22:00:32.478927 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 22:00:32.478935 | controller | Tuesday 24 February 2026 22:00:31 +0000 (0:00:01.038) 0:05:02.605 ****** 2026-02-24 22:00:32.478953 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:33.661684 | controller | 2026-02-24 22:00:33.661735 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 22:00:33.661744 | controller | Tuesday 24 February 2026 22:00:32 +0000 (0:00:00.486) 0:05:03.091 ****** 2026-02-24 22:00:33.661756 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:33.757868 | controller | 2026-02-24 22:00:33.757928 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 22:00:33.757937 | controller | Tuesday 24 February 2026 22:00:33 +0000 (0:00:01.182) 0:05:04.274 ****** 2026-02-24 22:00:33.757950 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:33.826756 | controller | 2026-02-24 22:00:33.826810 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 22:00:33.826819 | controller | Tuesday 24 February 2026 22:00:33 +0000 (0:00:00.096) 0:05:04.370 ****** 2026-02-24 22:00:33.826833 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:34.894984 | controller | 2026-02-24 22:00:34.895061 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 22:00:34.895071 | controller | Tuesday 24 February 2026 22:00:33 +0000 (0:00:00.068) 0:05:04.439 ****** 2026-02-24 22:00:34.895084 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:35.849016 | controller | 2026-02-24 22:00:35.849091 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2026-02-24 22:00:35.849099 | controller | Tuesday 24 February 2026 22:00:34 +0000 (0:00:01.068) 0:05:05.507 ****** 2026-02-24 22:00:35.849111 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:41.956727 | controller | 2026-02-24 22:00:41.956787 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2026-02-24 22:00:41.956795 | controller | Tuesday 24 February 2026 22:00:35 +0000 (0:00:00.953) 0:05:06.461 ****** 2026-02-24 22:00:41.956808 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2026-02-24 22:00:42.171538 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:42.171593 | controller | 2026-02-24 22:00:42.171601 | controller | TASK [Configure ntp service] *************************************************** 2026-02-24 22:00:42.171607 | controller | Tuesday 24 February 2026 22:00:41 +0000 (0:00:06.107) 0:05:12.569 ****** 2026-02-24 22:00:42.171619 | controller | 2026-02-24 22:00:43.233126 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2026-02-24 22:00:43.233179 | controller | Tuesday 24 February 2026 22:00:42 +0000 (0:00:00.214) 0:05:12.784 ****** 2026-02-24 22:00:43.233194 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:44.300294 | controller | 2026-02-24 22:00:44.300356 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2026-02-24 22:00:44.300367 | controller | Tuesday 24 February 2026 22:00:43 +0000 (0:00:01.061) 0:05:13.845 ****** 2026-02-24 22:00:44.300384 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2026-02-24 22:00:45.350255 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2026-02-24 22:00:45.350317 | controller | 2026-02-24 22:00:45.350326 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2026-02-24 22:00:45.350332 | controller | Tuesday 24 February 2026 22:00:44 +0000 (0:00:01.066) 0:05:14.912 ****** 2026-02-24 22:00:45.350353 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:46.063071 | controller | 2026-02-24 22:00:46.063115 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2026-02-24 22:00:46.063123 | controller | Tuesday 24 February 2026 22:00:45 +0000 (0:00:01.049) 0:05:15.962 ****** 2026-02-24 22:00:46.063134 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:46.274076 | controller | 2026-02-24 22:00:46.274124 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2026-02-24 22:00:46.274132 | controller | Tuesday 24 February 2026 22:00:46 +0000 (0:00:00.706) 0:05:16.668 ****** 2026-02-24 22:00:46.274143 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2026-02-24 22:00:46.798240 | controller | 2026-02-24 22:00:46.798298 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2026-02-24 22:00:46.798307 | controller | Tuesday 24 February 2026 22:00:46 +0000 (0:00:00.218) 0:05:16.887 ****** 2026-02-24 22:00:46.798320 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:47.350744 | controller | 2026-02-24 22:00:47.350807 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2026-02-24 22:00:47.350816 | controller | Tuesday 24 February 2026 22:00:46 +0000 (0:00:00.523) 0:05:17.410 ****** 2026-02-24 22:00:47.350828 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-24 22:00:48.027454 | controller | 2026-02-24 22:00:48.027513 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2026-02-24 22:00:48.027521 | controller | Tuesday 24 February 2026 22:00:47 +0000 (0:00:00.552) 0:05:17.963 ****** 2026-02-24 22:00:48.027533 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-24 22:00:48.027671 | controller | 2026-02-24 22:00:48.027800 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2026-02-24 22:00:48.027944 | controller | Tuesday 24 February 2026 22:00:48 +0000 (0:00:00.677) 0:05:18.640 ****** 2026-02-24 22:00:48.596018 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-24 22:00:48.596233 | controller | 2026-02-24 22:00:48.596377 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2026-02-24 22:00:48.596516 | controller | Tuesday 24 February 2026 22:00:48 +0000 (0:00:00.568) 0:05:19.209 ****** 2026-02-24 22:00:48.653700 | controller | 2026-02-24 22:00:48.653854 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2026-02-24 22:00:48.654012 | controller | Tuesday 24 February 2026 22:00:48 +0000 (0:00:00.057) 0:05:19.267 ****** 2026-02-24 22:00:49.194369 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-24 22:00:50.122135 | controller | 2026-02-24 22:00:50.122199 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2026-02-24 22:00:50.122207 | controller | Tuesday 24 February 2026 22:00:49 +0000 (0:00:00.539) 0:05:19.807 ****** 2026-02-24 22:00:50.122218 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-24 22:00:50.164695 | controller | 2026-02-24 22:00:50.164724 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2026-02-24 22:00:50.164737 | controller | Tuesday 24 February 2026 22:00:50 +0000 (0:00:00.927) 0:05:20.734 ****** 2026-02-24 22:00:50.164746 | controller | skipping: [instance] 2026-02-24 22:00:50.210478 | controller | 2026-02-24 22:00:50.210496 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2026-02-24 22:00:50.210503 | controller | Tuesday 24 February 2026 22:00:50 +0000 (0:00:00.043) 0:05:20.777 ****** 2026-02-24 22:00:50.210512 | controller | skipping: [instance] 2026-02-24 22:00:50.490924 | controller | 2026-02-24 22:00:50.490979 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2026-02-24 22:00:50.490987 | controller | Tuesday 24 February 2026 22:00:50 +0000 (0:00:00.045) 0:05:20.823 ****** 2026-02-24 22:00:50.490999 | controller | changed: [instance] 2026-02-24 22:00:50.579009 | controller | 2026-02-24 22:00:50.579071 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2026-02-24 22:00:50.579079 | controller | Tuesday 24 February 2026 22:00:50 +0000 (0:00:00.279) 0:05:21.103 ****** 2026-02-24 22:00:50.579091 | controller | skipping: [instance] => (item=) 2026-02-24 22:00:50.625225 | controller | 2026-02-24 22:00:50.625259 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2026-02-24 22:00:50.625266 | controller | Tuesday 24 February 2026 22:00:50 +0000 (0:00:00.088) 0:05:21.192 ****** 2026-02-24 22:00:50.625277 | controller | ok: [instance] 2026-02-24 22:00:50.718304 | controller | 2026-02-24 22:00:50.718347 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 22:00:50.718355 | controller | Tuesday 24 February 2026 22:00:50 +0000 (0:00:00.046) 0:05:21.238 ****** 2026-02-24 22:00:50.718366 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-24 22:00:51.008338 | controller | 2026-02-24 22:00:51.008377 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 22:00:51.008392 | controller | Tuesday 24 February 2026 22:00:50 +0000 (0:00:00.092) 0:05:21.331 ****** 2026-02-24 22:00:51.008412 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-24 22:00:51.073765 | controller | 2026-02-24 22:00:51.073799 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2026-02-24 22:00:51.073807 | controller | Tuesday 24 February 2026 22:00:51 +0000 (0:00:00.290) 0:05:21.621 ****** 2026-02-24 22:00:51.073817 | controller | 2026-02-24 22:00:51.163845 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 22:00:51.163886 | controller | Tuesday 24 February 2026 22:00:51 +0000 (0:00:00.065) 0:05:21.686 ****** 2026-02-24 22:00:51.163903 | controller | ok: [instance] 2026-02-24 22:00:51.229044 | controller | 2026-02-24 22:00:51.229074 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 22:00:51.229096 | controller | Tuesday 24 February 2026 22:00:51 +0000 (0:00:00.089) 0:05:21.776 ****** 2026-02-24 22:00:51.229109 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-24 22:00:51.534796 | controller | 2026-02-24 22:00:51.534853 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 22:00:51.534863 | controller | Tuesday 24 February 2026 22:00:51 +0000 (0:00:00.065) 0:05:21.842 ****** 2026-02-24 22:00:51.534877 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-24 22:00:51.599162 | controller | 2026-02-24 22:00:51.599181 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 22:00:51.599188 | controller | Tuesday 24 February 2026 22:00:51 +0000 (0:00:00.305) 0:05:22.147 ****** 2026-02-24 22:00:51.599203 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-24 22:00:52.065684 | controller | skipping: [instance] 2026-02-24 22:00:52.065740 | controller | 2026-02-24 22:00:52.065749 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2026-02-24 22:00:52.065756 | controller | Tuesday 24 February 2026 22:00:51 +0000 (0:00:00.064) 0:05:22.212 ****** 2026-02-24 22:00:52.065768 | controller | changed: [instance] 2026-02-24 22:00:52.821946 | controller | 2026-02-24 22:00:52.822000 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-24 22:00:52.822009 | controller | Tuesday 24 February 2026 22:00:52 +0000 (0:00:00.448) 0:05:22.661 ****** 2026-02-24 22:00:52.822015 | controller | 2026-02-24 22:00:52.822046 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2026-02-24 22:00:52.822056 | controller | Tuesday 24 February 2026 22:00:52 +0000 (0:00:00.016) 0:05:22.678 ****** 2026-02-24 22:00:52.822068 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:53.249513 | controller | 2026-02-24 22:00:53.249556 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 22:00:53.249566 | controller | Tuesday 24 February 2026 22:00:52 +0000 (0:00:00.756) 0:05:23.434 ****** 2026-02-24 22:00:53.249579 | controller | changed: [instance] 2026-02-24 22:00:53.433128 | controller | 2026-02-24 22:00:53.433193 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2026-02-24 22:00:53.433204 | controller | Tuesday 24 February 2026 22:00:53 +0000 (0:00:00.427) 0:05:23.862 ****** 2026-02-24 22:00:53.433219 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 22:00:55.003554 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 22:00:55.003601 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2026-02-24 22:00:55.003610 | controller | 2026-02-24 22:00:55.003618 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2026-02-24 22:00:55.003625 | controller | Tuesday 24 February 2026 22:00:53 +0000 (0:00:00.183) 0:05:24.045 ****** 2026-02-24 22:00:55.003831 | controller | changed: [instance -> compute-0(compute-0.instance)] 2026-02-24 22:00:55.035211 | controller | 2026-02-24 22:00:55.035252 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-24 22:00:55.035263 | controller | Tuesday 24 February 2026 22:00:55 +0000 (0:00:01.570) 0:05:25.616 ****** 2026-02-24 22:00:55.035275 | controller | skipping: [instance] 2026-02-24 22:00:55.035307 | controller | 2026-02-24 22:00:55.035358 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-24 22:00:55.035577 | controller | Tuesday 24 February 2026 22:00:55 +0000 (0:00:00.032) 0:05:25.648 ****** 2026-02-24 22:00:55.616959 | controller | ok: [instance -> compute-0(compute-0.instance)] 2026-02-24 22:00:55.666653 | controller | 2026-02-24 22:00:55.666672 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-24 22:00:55.666680 | controller | Tuesday 24 February 2026 22:00:55 +0000 (0:00:00.580) 0:05:26.229 ****** 2026-02-24 22:00:55.666696 | controller | skipping: [instance] 2026-02-24 22:00:55.712168 | controller | 2026-02-24 22:00:55.712229 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-24 22:00:55.712238 | controller | Tuesday 24 February 2026 22:00:55 +0000 (0:00:00.050) 0:05:26.279 ****** 2026-02-24 22:00:55.712255 | controller | skipping: [instance] 2026-02-24 22:00:55.712315 | controller | 2026-02-24 22:00:55.712434 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-24 22:00:55.712473 | controller | Tuesday 24 February 2026 22:00:55 +0000 (0:00:00.045) 0:05:26.325 ****** 2026-02-24 22:00:55.759092 | controller | skipping: [instance] 2026-02-24 22:00:55.813328 | controller | 2026-02-24 22:00:55.813357 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-24 22:00:55.813366 | controller | Tuesday 24 February 2026 22:00:55 +0000 (0:00:00.046) 0:05:26.372 ****** 2026-02-24 22:00:55.813375 | controller | skipping: [instance] 2026-02-24 22:00:55.859043 | controller | 2026-02-24 22:00:55.859089 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2026-02-24 22:00:55.859099 | controller | Tuesday 24 February 2026 22:00:55 +0000 (0:00:00.053) 0:05:26.426 ****** 2026-02-24 22:00:55.859112 | controller | skipping: [instance] 2026-02-24 22:00:55.882844 | controller | 2026-02-24 22:00:55.882872 | controller | TASK [reproducer : Create repositories on computes] **************************** 2026-02-24 22:00:55.882881 | controller | Tuesday 24 February 2026 22:00:55 +0000 (0:00:00.045) 0:05:26.472 ****** 2026-02-24 22:00:55.882892 | controller | skipping: [instance] 2026-02-24 22:00:55.920343 | controller | 2026-02-24 22:00:55.920369 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2026-02-24 22:00:55.920377 | controller | Tuesday 24 February 2026 22:00:55 +0000 (0:00:00.024) 0:05:26.496 ****** 2026-02-24 22:00:55.920386 | controller | skipping: [instance] 2026-02-24 22:00:55.980698 | controller | 2026-02-24 22:00:55.980716 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2026-02-24 22:00:55.980724 | controller | Tuesday 24 February 2026 22:00:55 +0000 (0:00:00.037) 0:05:26.533 ****** 2026-02-24 22:00:55.980732 | controller | ok: [instance] 2026-02-24 22:00:56.090313 | controller | 2026-02-24 22:00:56.090348 | controller | TASK [reproducer : Push local code] ******************************************** 2026-02-24 22:00:56.090362 | controller | Tuesday 24 February 2026 22:00:55 +0000 (0:00:00.060) 0:05:26.594 ****** 2026-02-24 22:00:56.090379 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2026-02-24 22:00:56.138201 | controller | 2026-02-24 22:00:56.138221 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2026-02-24 22:00:56.138230 | controller | Tuesday 24 February 2026 22:00:56 +0000 (0:00:00.108) 0:05:26.703 ****** 2026-02-24 22:00:56.138241 | controller | skipping: [instance] 2026-02-24 22:00:56.184535 | controller | 2026-02-24 22:00:56.184554 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2026-02-24 22:00:56.184561 | controller | Tuesday 24 February 2026 22:00:56 +0000 (0:00:00.048) 0:05:26.751 ****** 2026-02-24 22:00:56.184569 | controller | skipping: [instance] 2026-02-24 22:00:56.230978 | controller | 2026-02-24 22:00:56.231226 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2026-02-24 22:00:56.231236 | controller | Tuesday 24 February 2026 22:00:56 +0000 (0:00:00.046) 0:05:26.797 ****** 2026-02-24 22:00:56.231247 | controller | skipping: [instance] 2026-02-24 22:00:56.277777 | controller | 2026-02-24 22:00:56.277842 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2026-02-24 22:00:56.277852 | controller | Tuesday 24 February 2026 22:00:56 +0000 (0:00:00.046) 0:05:26.844 ****** 2026-02-24 22:00:56.277866 | controller | skipping: [instance] 2026-02-24 22:00:56.277888 | controller | 2026-02-24 22:00:56.277895 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2026-02-24 22:00:56.277904 | controller | Tuesday 24 February 2026 22:00:56 +0000 (0:00:00.046) 0:05:26.891 ****** 2026-02-24 22:00:56.318062 | controller | skipping: [instance] 2026-02-24 22:00:56.906415 | controller | 2026-02-24 22:00:56.906496 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2026-02-24 22:00:56.906506 | controller | Tuesday 24 February 2026 22:00:56 +0000 (0:00:00.039) 0:05:26.931 ****** 2026-02-24 22:00:56.906523 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2026-02-24 22:00:57.520908 | controller | 2026-02-24 22:00:57.520972 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2026-02-24 22:00:57.520981 | controller | Tuesday 24 February 2026 22:00:56 +0000 (0:00:00.588) 0:05:27.519 ****** 2026-02-24 22:00:57.520997 | controller | ok: [instance -> localhost] => (item=ci-framework) 2026-02-24 22:00:57.521049 | controller | 2026-02-24 22:00:57.521066 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2026-02-24 22:00:57.521167 | controller | Tuesday 24 February 2026 22:00:57 +0000 (0:00:00.614) 0:05:28.133 ****** 2026-02-24 22:00:57.574631 | controller | skipping: [instance] => (item=ci-framework) 2026-02-24 22:00:57.574743 | controller | skipping: [instance] 2026-02-24 22:00:57.574851 | controller | 2026-02-24 22:00:57.574979 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2026-02-24 22:00:57.575132 | controller | Tuesday 24 February 2026 22:00:57 +0000 (0:00:00.054) 0:05:28.188 ****** 2026-02-24 22:00:57.668942 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2026-02-24 22:00:57.669089 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2026-02-24 22:00:57.669201 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2026-02-24 22:00:57.669331 | controller | 2026-02-24 22:00:57.669478 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2026-02-24 22:00:57.669640 | controller | Tuesday 24 February 2026 22:00:57 +0000 (0:00:00.094) 0:05:28.282 ****** 2026-02-24 22:00:58.221079 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:58.221183 | controller | 2026-02-24 22:00:58.221199 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2026-02-24 22:00:58.221271 | controller | Tuesday 24 February 2026 22:00:58 +0000 (0:00:00.552) 0:05:28.834 ****** 2026-02-24 22:00:58.269898 | controller | skipping: [instance] 2026-02-24 22:00:58.269941 | controller | 2026-02-24 22:00:58.270089 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2026-02-24 22:00:58.270177 | controller | Tuesday 24 February 2026 22:00:58 +0000 (0:00:00.049) 0:05:28.883 ****** 2026-02-24 22:00:58.826594 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:58.826714 | controller | 2026-02-24 22:00:58.875884 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2026-02-24 22:00:58.875929 | controller | Tuesday 24 February 2026 22:00:58 +0000 (0:00:00.556) 0:05:29.439 ****** 2026-02-24 22:00:58.875943 | controller | skipping: [instance] 2026-02-24 22:00:58.875977 | controller | 2026-02-24 22:00:58.876302 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2026-02-24 22:00:59.422123 | controller | Tuesday 24 February 2026 22:00:58 +0000 (0:00:00.049) 0:05:29.489 ****** 2026-02-24 22:00:59.422195 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:00:59.422396 | controller | 2026-02-24 22:00:59.422426 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2026-02-24 22:01:01.838896 | controller | Tuesday 24 February 2026 22:00:59 +0000 (0:00:00.545) 0:05:30.035 ****** 2026-02-24 22:01:01.838977 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:22.618254 | controller | 2026-02-24 22:01:22.618331 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2026-02-24 22:01:22.618340 | controller | Tuesday 24 February 2026 22:01:01 +0000 (0:00:02.416) 0:05:32.451 ****** 2026-02-24 22:01:22.618362 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:23.697390 | controller | 2026-02-24 22:01:23.697447 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2026-02-24 22:01:23.697456 | controller | Tuesday 24 February 2026 22:01:22 +0000 (0:00:20.777) 0:05:53.229 ****** 2026-02-24 22:01:23.697469 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:23.697490 | controller | 2026-02-24 22:01:23.697497 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2026-02-24 22:01:23.804859 | controller | Tuesday 24 February 2026 22:01:23 +0000 (0:00:01.080) 0:05:54.310 ****** 2026-02-24 22:01:23.804932 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2026-02-24 22:01:24.297780 | controller | 2026-02-24 22:01:24.297839 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2026-02-24 22:01:24.297851 | controller | Tuesday 24 February 2026 22:01:23 +0000 (0:00:00.107) 0:05:54.418 ****** 2026-02-24 22:01:24.297868 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:24.348890 | controller | 2026-02-24 22:01:24.348933 | controller | TASK [reproducer : Rotate log if present] ************************************** 2026-02-24 22:01:24.348943 | controller | Tuesday 24 February 2026 22:01:24 +0000 (0:00:00.492) 0:05:54.910 ****** 2026-02-24 22:01:24.348956 | controller | skipping: [instance] 2026-02-24 22:01:24.399908 | controller | 2026-02-24 22:01:24.399961 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2026-02-24 22:01:24.399971 | controller | Tuesday 24 February 2026 22:01:24 +0000 (0:00:00.051) 0:05:54.962 ****** 2026-02-24 22:01:24.399985 | controller | skipping: [instance] 2026-02-24 22:01:24.499237 | controller | 2026-02-24 22:01:24.499300 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2026-02-24 22:01:24.499311 | controller | Tuesday 24 February 2026 22:01:24 +0000 (0:00:00.051) 0:05:55.013 ****** 2026-02-24 22:01:24.499327 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:25.034984 | controller | 2026-02-24 22:01:25.035083 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-24 22:01:25.035097 | controller | Tuesday 24 February 2026 22:01:24 +0000 (0:00:00.098) 0:05:55.112 ****** 2026-02-24 22:01:25.035114 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:25.035145 | controller | 2026-02-24 22:01:25.035155 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-24 22:01:25.035165 | controller | Tuesday 24 February 2026 22:01:25 +0000 (0:00:00.535) 0:05:55.647 ****** 2026-02-24 22:01:25.082068 | controller | skipping: [instance] 2026-02-24 22:01:25.082144 | controller | 2026-02-24 22:01:25.082257 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-24 22:01:25.082362 | controller | Tuesday 24 February 2026 22:01:25 +0000 (0:00:00.047) 0:05:55.695 ****** 2026-02-24 22:01:25.127264 | controller | skipping: [instance] 2026-02-24 22:01:25.127305 | controller | 2026-02-24 22:01:25.127402 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-24 22:01:25.127491 | controller | Tuesday 24 February 2026 22:01:25 +0000 (0:00:00.045) 0:05:55.740 ****** 2026-02-24 22:01:25.172678 | controller | skipping: [instance] 2026-02-24 22:01:25.172778 | controller | 2026-02-24 22:01:25.172894 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-24 22:01:25.173005 | controller | Tuesday 24 February 2026 22:01:25 +0000 (0:00:00.045) 0:05:55.786 ****** 2026-02-24 22:01:25.228699 | controller | skipping: [instance] 2026-02-24 22:01:25.228765 | controller | 2026-02-24 22:01:25.228880 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-24 22:01:25.228978 | controller | Tuesday 24 February 2026 22:01:25 +0000 (0:00:00.055) 0:05:55.842 ****** 2026-02-24 22:01:26.766396 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:01:26.766503 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:01:26.766621 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:01:26.766714 | controller | changed: [instance -> controller-0] 2026-02-24 22:01:26.766795 | controller | 2026-02-24 22:01:26.766877 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-24 22:01:26.766963 | controller | Tuesday 24 February 2026 22:01:26 +0000 (0:00:01.537) 0:05:57.379 ****** 2026-02-24 22:01:27.837163 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:27.837277 | controller | 2026-02-24 22:01:27.837319 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-24 22:01:27.837343 | controller | Tuesday 24 February 2026 22:01:27 +0000 (0:00:01.070) 0:05:58.450 ****** 2026-02-24 22:01:29.673317 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:29.673385 | controller | 2026-02-24 22:01:29.673436 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-24 22:01:29.673553 | controller | Tuesday 24 February 2026 22:01:29 +0000 (0:00:01.836) 0:06:00.286 ****** 2026-02-24 22:01:37.448313 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:38.559207 | controller | 2026-02-24 22:01:38.559261 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-24 22:01:38.559270 | controller | Tuesday 24 February 2026 22:01:37 +0000 (0:00:07.774) 0:06:08.061 ****** 2026-02-24 22:01:38.559285 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:38.559326 | controller | 2026-02-24 22:01:38.559549 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-24 22:01:38.613566 | controller | Tuesday 24 February 2026 22:01:38 +0000 (0:00:01.111) 0:06:09.172 ****** 2026-02-24 22:01:38.613639 | controller | skipping: [instance] 2026-02-24 22:01:38.613672 | controller | 2026-02-24 22:01:38.613682 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-24 22:01:38.613807 | controller | Tuesday 24 February 2026 22:01:38 +0000 (0:00:00.054) 0:06:09.227 ****** 2026-02-24 22:01:39.818157 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:39.818221 | controller | 2026-02-24 22:01:39.818232 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-24 22:01:39.818323 | controller | Tuesday 24 February 2026 22:01:39 +0000 (0:00:01.204) 0:06:10.431 ****** 2026-02-24 22:01:39.868944 | controller | skipping: [instance] 2026-02-24 22:01:39.868992 | controller | 2026-02-24 22:01:39.869102 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-24 22:01:39.869191 | controller | Tuesday 24 February 2026 22:01:39 +0000 (0:00:00.051) 0:06:10.482 ****** 2026-02-24 22:01:39.933836 | controller | skipping: [instance] 2026-02-24 22:01:39.933945 | controller | 2026-02-24 22:01:39.934140 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-24 22:01:39.934268 | controller | Tuesday 24 February 2026 22:01:39 +0000 (0:00:00.064) 0:06:10.547 ****** 2026-02-24 22:01:39.996995 | controller | skipping: [instance] 2026-02-24 22:01:39.997271 | controller | 2026-02-24 22:01:39.997480 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-24 22:01:39.997633 | controller | Tuesday 24 February 2026 22:01:39 +0000 (0:00:00.062) 0:06:10.610 ****** 2026-02-24 22:01:40.933142 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:40.933214 | controller | 2026-02-24 22:01:40.933224 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-24 22:01:40.933235 | controller | Tuesday 24 February 2026 22:01:40 +0000 (0:00:00.935) 0:06:11.545 ****** 2026-02-24 22:01:41.948873 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:41.998791 | controller | 2026-02-24 22:01:41.998839 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-24 22:01:41.998852 | controller | Tuesday 24 February 2026 22:01:41 +0000 (0:00:01.015) 0:06:12.561 ****** 2026-02-24 22:01:41.998868 | controller | skipping: [instance] 2026-02-24 22:01:41.998922 | controller | 2026-02-24 22:01:41.998938 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-24 22:01:41.999064 | controller | Tuesday 24 February 2026 22:01:41 +0000 (0:00:00.050) 0:06:12.612 ****** 2026-02-24 22:01:42.042640 | controller | skipping: [instance] 2026-02-24 22:01:42.042747 | controller | 2026-02-24 22:01:42.042877 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-24 22:01:42.043009 | controller | Tuesday 24 February 2026 22:01:42 +0000 (0:00:00.044) 0:06:12.656 ****** 2026-02-24 22:01:42.090100 | controller | skipping: [instance] 2026-02-24 22:01:42.090315 | controller | 2026-02-24 22:01:42.090539 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-24 22:01:42.090691 | controller | Tuesday 24 February 2026 22:01:42 +0000 (0:00:00.047) 0:06:12.703 ****** 2026-02-24 22:01:42.157224 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:42.157339 | controller | 2026-02-24 22:01:42.157475 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-24 22:01:42.157605 | controller | Tuesday 24 February 2026 22:01:42 +0000 (0:00:00.067) 0:06:12.770 ****** 2026-02-24 22:01:42.206617 | controller | skipping: [instance] 2026-02-24 22:01:42.206745 | controller | 2026-02-24 22:01:42.206843 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-24 22:01:42.206939 | controller | Tuesday 24 February 2026 22:01:42 +0000 (0:00:00.049) 0:06:12.820 ****** 2026-02-24 22:01:42.251728 | controller | skipping: [instance] 2026-02-24 22:01:42.251864 | controller | 2026-02-24 22:01:42.251960 | controller | TASK [Download the RPM] ******************************************************** 2026-02-24 22:01:42.252063 | controller | Tuesday 24 February 2026 22:01:42 +0000 (0:00:00.044) 0:06:12.864 ****** 2026-02-24 22:01:42.296992 | controller | skipping: [instance] 2026-02-24 22:01:42.297321 | controller | 2026-02-24 22:01:42.297509 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-24 22:01:42.297669 | controller | Tuesday 24 February 2026 22:01:42 +0000 (0:00:00.045) 0:06:12.910 ****** 2026-02-24 22:01:42.342747 | controller | skipping: [instance] 2026-02-24 22:01:42.342786 | controller | 2026-02-24 22:01:42.342910 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-24 22:01:42.342996 | controller | Tuesday 24 February 2026 22:01:42 +0000 (0:00:00.046) 0:06:12.956 ****** 2026-02-24 22:01:42.388599 | controller | skipping: [instance] 2026-02-24 22:01:42.388634 | controller | 2026-02-24 22:01:42.388651 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-24 22:01:42.388742 | controller | Tuesday 24 February 2026 22:01:42 +0000 (0:00:00.045) 0:06:13.001 ****** 2026-02-24 22:01:42.442072 | controller | skipping: [instance] 2026-02-24 22:01:42.442152 | controller | 2026-02-24 22:01:42.442248 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-24 22:01:42.442358 | controller | Tuesday 24 February 2026 22:01:42 +0000 (0:00:00.053) 0:06:13.055 ****** 2026-02-24 22:01:42.495038 | controller | skipping: [instance] 2026-02-24 22:01:42.495160 | controller | 2026-02-24 22:01:42.495286 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-24 22:01:42.495396 | controller | Tuesday 24 February 2026 22:01:42 +0000 (0:00:00.052) 0:06:13.107 ****** 2026-02-24 22:01:43.011492 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:43.011586 | controller | 2026-02-24 22:01:43.012084 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-24 22:01:43.077698 | controller | Tuesday 24 February 2026 22:01:43 +0000 (0:00:00.516) 0:06:13.624 ****** 2026-02-24 22:01:43.077727 | controller | skipping: [instance] 2026-02-24 22:01:43.077816 | controller | 2026-02-24 22:01:43.077962 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-24 22:01:43.078124 | controller | Tuesday 24 February 2026 22:01:43 +0000 (0:00:00.066) 0:06:13.691 ****** 2026-02-24 22:01:43.142043 | controller | skipping: [instance] 2026-02-24 22:01:43.142150 | controller | 2026-02-24 22:01:43.142304 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-24 22:01:43.142442 | controller | Tuesday 24 February 2026 22:01:43 +0000 (0:00:00.064) 0:06:13.755 ****** 2026-02-24 22:01:43.187552 | controller | skipping: [instance] 2026-02-24 22:01:43.187653 | controller | 2026-02-24 22:01:43.187775 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-24 22:01:43.187893 | controller | Tuesday 24 February 2026 22:01:43 +0000 (0:00:00.045) 0:06:13.801 ****** 2026-02-24 22:01:43.241234 | controller | skipping: [instance] 2026-02-24 22:01:43.241367 | controller | 2026-02-24 22:01:43.241502 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-24 22:01:43.241629 | controller | Tuesday 24 February 2026 22:01:43 +0000 (0:00:00.053) 0:06:13.854 ****** 2026-02-24 22:01:43.305571 | controller | skipping: [instance] 2026-02-24 22:01:43.305614 | controller | 2026-02-24 22:01:43.305723 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-24 22:01:43.305811 | controller | Tuesday 24 February 2026 22:01:43 +0000 (0:00:00.064) 0:06:13.918 ****** 2026-02-24 22:01:43.358444 | controller | skipping: [instance] 2026-02-24 22:01:43.358550 | controller | 2026-02-24 22:01:43.358689 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-24 22:01:43.358828 | controller | Tuesday 24 February 2026 22:01:43 +0000 (0:00:00.053) 0:06:13.972 ****** 2026-02-24 22:01:43.408266 | controller | skipping: [instance] 2026-02-24 22:01:43.408347 | controller | 2026-02-24 22:01:43.408437 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-24 22:01:43.408527 | controller | Tuesday 24 February 2026 22:01:43 +0000 (0:00:00.050) 0:06:14.022 ****** 2026-02-24 22:01:43.463265 | controller | skipping: [instance] 2026-02-24 22:01:43.463362 | controller | 2026-02-24 22:01:43.463475 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-24 22:01:43.463615 | controller | Tuesday 24 February 2026 22:01:43 +0000 (0:00:00.054) 0:06:14.076 ****** 2026-02-24 22:01:44.162626 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:44.162678 | controller | 2026-02-24 22:01:44.162770 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-24 22:01:44.162889 | controller | Tuesday 24 February 2026 22:01:44 +0000 (0:00:00.698) 0:06:14.775 ****** 2026-02-24 22:01:45.390128 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:01:45.390189 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:01:45.390197 | controller | changed: [instance -> controller-0] 2026-02-24 22:01:45.390207 | controller | 2026-02-24 22:01:45.390249 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-24 22:01:45.390405 | controller | Tuesday 24 February 2026 22:01:45 +0000 (0:00:01.226) 0:06:16.002 ****** 2026-02-24 22:01:46.219772 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:46.837560 | controller | 2026-02-24 22:01:46.837601 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-24 22:01:46.837610 | controller | Tuesday 24 February 2026 22:01:46 +0000 (0:00:00.830) 0:06:16.832 ****** 2026-02-24 22:01:46.837622 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:46.903172 | controller | 2026-02-24 22:01:46.903238 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-24 22:01:46.903248 | controller | Tuesday 24 February 2026 22:01:46 +0000 (0:00:00.617) 0:06:17.450 ****** 2026-02-24 22:01:46.903264 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:01:46.903346 | controller | ok: [instance -> controller-0] 2026-02-24 22:01:46.903359 | controller | 2026-02-24 22:01:46.903369 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-24 22:01:46.903393 | controller | Tuesday 24 February 2026 22:01:46 +0000 (0:00:00.065) 0:06:17.516 ****** 2026-02-24 22:01:46.952273 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:01:46.952376 | controller | 2026-02-24 22:01:46.952483 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-24 22:01:46.952590 | controller | Tuesday 24 February 2026 22:01:46 +0000 (0:00:00.048) 0:06:17.565 ****** 2026-02-24 22:02:18.007145 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:18.521484 | controller | 2026-02-24 22:02:18.521549 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-24 22:02:18.521559 | controller | Tuesday 24 February 2026 22:02:18 +0000 (0:00:31.050) 0:06:48.616 ****** 2026-02-24 22:02:18.521574 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:18.521652 | controller | 2026-02-24 22:02:18.521669 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-24 22:02:18.521746 | controller | Tuesday 24 February 2026 22:02:18 +0000 (0:00:00.518) 0:06:49.134 ****** 2026-02-24 22:02:19.047590 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:19.047630 | controller | 2026-02-24 22:02:19.047744 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-24 22:02:19.047850 | controller | Tuesday 24 February 2026 22:02:19 +0000 (0:00:00.526) 0:06:49.661 ****** 2026-02-24 22:02:25.007656 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:25.059398 | controller | 2026-02-24 22:02:25.059427 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-24 22:02:25.059437 | controller | Tuesday 24 February 2026 22:02:24 +0000 (0:00:05.953) 0:06:55.614 ****** 2026-02-24 22:02:25.059452 | controller | skipping: [instance] 2026-02-24 22:02:25.059566 | controller | 2026-02-24 22:02:25.059720 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-24 22:02:25.059871 | controller | Tuesday 24 February 2026 22:02:25 +0000 (0:00:00.058) 0:06:55.673 ****** 2026-02-24 22:02:25.706712 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:26.255106 | controller | 2026-02-24 22:02:26.255170 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-24 22:02:26.255180 | controller | Tuesday 24 February 2026 22:02:25 +0000 (0:00:00.645) 0:06:56.318 ****** 2026-02-24 22:02:26.255207 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:26.303748 | controller | 2026-02-24 22:02:26.303793 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-24 22:02:26.303802 | controller | Tuesday 24 February 2026 22:02:26 +0000 (0:00:00.549) 0:06:56.867 ****** 2026-02-24 22:02:26.303817 | controller | skipping: [instance] 2026-02-24 22:02:26.352092 | controller | 2026-02-24 22:02:26.352127 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-24 22:02:26.352147 | controller | Tuesday 24 February 2026 22:02:26 +0000 (0:00:00.049) 0:06:56.917 ****** 2026-02-24 22:02:26.352163 | controller | skipping: [instance] 2026-02-24 22:02:26.352264 | controller | 2026-02-24 22:02:26.352278 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-24 22:02:26.352378 | controller | Tuesday 24 February 2026 22:02:26 +0000 (0:00:00.048) 0:06:56.965 ****** 2026-02-24 22:02:26.394819 | controller | skipping: [instance] 2026-02-24 22:02:26.394854 | controller | 2026-02-24 22:02:26.394969 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-24 22:02:26.395080 | controller | Tuesday 24 February 2026 22:02:26 +0000 (0:00:00.043) 0:06:57.008 ****** 2026-02-24 22:02:26.442349 | controller | skipping: [instance] 2026-02-24 22:02:26.442524 | controller | 2026-02-24 22:02:26.442633 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-24 22:02:26.442724 | controller | Tuesday 24 February 2026 22:02:26 +0000 (0:00:00.046) 0:06:57.055 ****** 2026-02-24 22:02:26.491252 | controller | skipping: [instance] 2026-02-24 22:02:26.491358 | controller | 2026-02-24 22:02:26.491485 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-24 22:02:26.491596 | controller | Tuesday 24 February 2026 22:02:26 +0000 (0:00:00.049) 0:06:57.104 ****** 2026-02-24 22:02:26.543877 | controller | skipping: [instance] 2026-02-24 22:02:26.543966 | controller | 2026-02-24 22:02:26.544099 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-24 22:02:26.544220 | controller | Tuesday 24 February 2026 22:02:26 +0000 (0:00:00.052) 0:06:57.157 ****** 2026-02-24 22:02:29.205085 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:02:29.205416 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:02:29.205785 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:02:29.205797 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:02:29.205804 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:02:29.205815 | controller | changed: [instance -> controller-0] 2026-02-24 22:02:29.380775 | controller | 2026-02-24 22:02:29.380807 | controller | TASK [Prepare install_yamls make targets] ************************************** 2026-02-24 22:02:29.380816 | controller | Tuesday 24 February 2026 22:02:29 +0000 (0:00:02.660) 0:06:59.818 ****** 2026-02-24 22:02:29.380829 | controller | 2026-02-24 22:02:31.005723 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2026-02-24 22:02:31.005789 | controller | Tuesday 24 February 2026 22:02:29 +0000 (0:00:00.175) 0:06:59.993 ****** 2026-02-24 22:02:31.005807 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:02:31.005929 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:02:31.005945 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:02:31.005952 | controller | changed: [instance -> controller-0] 2026-02-24 22:02:31.005974 | controller | 2026-02-24 22:02:31.005992 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2026-02-24 22:02:31.005999 | controller | Tuesday 24 February 2026 22:02:31 +0000 (0:00:01.624) 0:07:01.618 ****** 2026-02-24 22:02:31.072235 | controller | 2026-02-24 22:02:31.072305 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2026-02-24 22:02:31.072321 | controller | Tuesday 24 February 2026 22:02:31 +0000 (0:00:00.067) 0:07:01.685 ****** 2026-02-24 22:02:31.121939 | controller | skipping: [instance] 2026-02-24 22:02:31.121994 | controller | 2026-02-24 22:02:31.122257 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2026-02-24 22:02:31.122319 | controller | Tuesday 24 February 2026 22:02:31 +0000 (0:00:00.049) 0:07:01.735 ****** 2026-02-24 22:02:31.177844 | controller | skipping: [instance] 2026-02-24 22:02:31.254970 | controller | 2026-02-24 22:02:31.255046 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2026-02-24 22:02:31.255059 | controller | Tuesday 24 February 2026 22:02:31 +0000 (0:00:00.055) 0:07:01.790 ****** 2026-02-24 22:02:31.255072 | controller | 2026-02-24 22:02:31.255100 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 22:02:31.303320 | controller | Tuesday 24 February 2026 22:02:31 +0000 (0:00:00.077) 0:07:01.868 ****** 2026-02-24 22:02:31.303353 | controller | skipping: [instance] 2026-02-24 22:02:31.303377 | controller | 2026-02-24 22:02:31.303480 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 22:02:31.303568 | controller | Tuesday 24 February 2026 22:02:31 +0000 (0:00:00.048) 0:07:01.916 ****** 2026-02-24 22:02:31.350104 | controller | skipping: [instance] 2026-02-24 22:02:31.350214 | controller | 2026-02-24 22:02:31.350321 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 22:02:31.350407 | controller | Tuesday 24 February 2026 22:02:31 +0000 (0:00:00.046) 0:07:01.963 ****** 2026-02-24 22:02:31.392688 | controller | skipping: [instance] 2026-02-24 22:02:31.392816 | controller | 2026-02-24 22:02:31.392831 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 22:02:31.392844 | controller | Tuesday 24 February 2026 22:02:31 +0000 (0:00:00.042) 0:07:02.006 ****** 2026-02-24 22:02:31.442626 | controller | skipping: [instance] 2026-02-24 22:02:31.442750 | controller | 2026-02-24 22:02:31.442885 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2026-02-24 22:02:31.443019 | controller | Tuesday 24 February 2026 22:02:31 +0000 (0:00:00.050) 0:07:02.056 ****** 2026-02-24 22:02:31.547151 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 22:02:31.547241 | controller | ok: [instance -> controller-0] 2026-02-24 22:02:31.547347 | controller | 2026-02-24 22:02:31.547983 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2026-02-24 22:02:31.617630 | controller | Tuesday 24 February 2026 22:02:31 +0000 (0:00:00.104) 0:07:02.160 ****** 2026-02-24 22:02:31.617668 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:31.617709 | controller | 2026-02-24 22:02:31.617832 | controller | TASK [install_yamls : Get environment structure] ******************************* 2026-02-24 22:02:31.617940 | controller | Tuesday 24 February 2026 22:02:31 +0000 (0:00:00.070) 0:07:02.231 ****** 2026-02-24 22:02:32.625294 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:32.625358 | controller | 2026-02-24 22:02:32.625453 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2026-02-24 22:02:32.625547 | controller | Tuesday 24 February 2026 22:02:32 +0000 (0:00:01.007) 0:07:03.238 ****** 2026-02-24 22:02:32.672401 | controller | skipping: [instance] 2026-02-24 22:02:32.672551 | controller | 2026-02-24 22:02:32.672695 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2026-02-24 22:02:32.672923 | controller | Tuesday 24 February 2026 22:02:32 +0000 (0:00:00.047) 0:07:03.286 ****** 2026-02-24 22:02:32.732499 | controller | skipping: [instance] 2026-02-24 22:02:32.732524 | controller | 2026-02-24 22:02:32.732666 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2026-02-24 22:02:32.732766 | controller | Tuesday 24 February 2026 22:02:32 +0000 (0:00:00.059) 0:07:03.345 ****** 2026-02-24 22:02:32.779964 | controller | skipping: [instance] 2026-02-24 22:02:32.780136 | controller | 2026-02-24 22:02:32.780152 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2026-02-24 22:02:32.780234 | controller | Tuesday 24 February 2026 22:02:32 +0000 (0:00:00.047) 0:07:03.393 ****** 2026-02-24 22:02:32.845965 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:32.846120 | controller | 2026-02-24 22:02:32.846269 | controller | TASK [install_yamls : Show the env structure] ********************************** 2026-02-24 22:02:32.846417 | controller | Tuesday 24 February 2026 22:02:32 +0000 (0:00:00.065) 0:07:03.459 ****** 2026-02-24 22:02:32.899759 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:32.899807 | controller | 2026-02-24 22:02:32.899919 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2026-02-24 22:02:32.900006 | controller | Tuesday 24 February 2026 22:02:32 +0000 (0:00:00.053) 0:07:03.513 ****** 2026-02-24 22:02:32.964672 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:32.964782 | controller | 2026-02-24 22:02:32.964927 | controller | TASK [install_yamls : Generate make targets] *********************************** 2026-02-24 22:02:32.965039 | controller | Tuesday 24 February 2026 22:02:32 +0000 (0:00:00.065) 0:07:03.578 ****** 2026-02-24 22:02:33.675296 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:33.675378 | controller | 2026-02-24 22:02:33.675391 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2026-02-24 22:02:33.675460 | controller | Tuesday 24 February 2026 22:02:33 +0000 (0:00:00.710) 0:07:04.288 ****** 2026-02-24 22:02:33.732142 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:33.732195 | controller | 2026-02-24 22:02:33.732319 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2026-02-24 22:02:33.732417 | controller | Tuesday 24 February 2026 22:02:33 +0000 (0:00:00.057) 0:07:04.345 ****** 2026-02-24 22:02:34.758793 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:34.759158 | controller | 2026-02-24 22:02:34.821940 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2026-02-24 22:02:34.821996 | controller | Tuesday 24 February 2026 22:02:34 +0000 (0:00:01.025) 0:07:05.371 ****** 2026-02-24 22:02:34.822014 | controller | skipping: [instance] 2026-02-24 22:02:35.637159 | controller | 2026-02-24 22:02:35.637214 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-24 22:02:35.637230 | controller | Tuesday 24 February 2026 22:02:34 +0000 (0:00:00.062) 0:07:05.434 ****** 2026-02-24 22:02:35.637246 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:35.694135 | controller | 2026-02-24 22:02:35.694193 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-24 22:02:35.694203 | controller | Tuesday 24 February 2026 22:02:35 +0000 (0:00:00.815) 0:07:06.250 ****** 2026-02-24 22:02:35.694217 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:36.761930 | controller | 2026-02-24 22:02:36.761980 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2026-02-24 22:02:36.761990 | controller | Tuesday 24 February 2026 22:02:35 +0000 (0:00:00.056) 0:07:06.307 ****** 2026-02-24 22:02:36.762004 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:37.297630 | controller | 2026-02-24 22:02:37.297681 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2026-02-24 22:02:37.297690 | controller | Tuesday 24 February 2026 22:02:36 +0000 (0:00:01.067) 0:07:07.374 ****** 2026-02-24 22:02:37.297713 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 22:02:37.453444 | controller | 2026-02-24 22:02:37.453489 | controller | TASK [Configure CRC network if needed] ***************************************** 2026-02-24 22:02:37.453498 | controller | Tuesday 24 February 2026 22:02:37 +0000 (0:00:00.535) 0:07:07.910 ****** 2026-02-24 22:02:37.453511 | controller | 2026-02-24 22:02:38.721131 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2026-02-24 22:02:38.721197 | controller | Tuesday 24 February 2026 22:02:37 +0000 (0:00:00.155) 0:07:08.066 ****** 2026-02-24 22:02:38.721214 | controller | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-24 22:02:38.722707 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false 2026-02-24 22:02:38.722781 | controller | module_stderr: |- 2026-02-24 22:02:38.722793 | controller | Shared connection to controller-0.utility closed. 2026-02-24 22:02:38.723108 | controller | module_stdout: |- 2026-02-24 22:02:38.723121 | controller | Traceback (most recent call last): 2026-02-24 22:02:38.723154 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 700, in urlopen 2026-02-24 22:02:38.723161 | controller | httplib_response = self._make_request( 2026-02-24 22:02:38.723168 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 383, in _make_request 2026-02-24 22:02:38.724200 | controller | self._validate_conn(conn) 2026-02-24 22:02:38.724750 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1015, in _validate_conn 2026-02-24 22:02:38.724768 | controller | conn.connect() 2026-02-24 22:02:38.724775 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connection.py", line 411, in connect 2026-02-24 22:02:38.724781 | controller | self.sock = ssl_wrap_socket( 2026-02-24 22:02:38.724787 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket 2026-02-24 22:02:38.724800 | controller | ssl_sock = _ssl_wrap_socket_impl( 2026-02-24 22:02:38.724806 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl 2026-02-24 22:02:38.724811 | controller | return ssl_context.wrap_socket(sock, server_hostname=server_hostname) 2026-02-24 22:02:38.724816 | controller | File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket 2026-02-24 22:02:38.724821 | controller | return self.sslsocket_class._create( 2026-02-24 22:02:38.724827 | controller | File "/usr/lib64/python3.9/ssl.py", line 1076, in _create 2026-02-24 22:02:38.724835 | controller | self.do_handshake() 2026-02-24 22:02:38.724854 | controller | File "/usr/lib64/python3.9/ssl.py", line 1345, in do_handshake 2026-02-24 22:02:38.724866 | controller | self._sslobj.do_handshake() 2026-02-24 22:02:38.724871 | controller | ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147) 2026-02-24 22:02:38.724884 | controller | 2026-02-24 22:02:38.724890 | controller | During handling of the above exception, another exception occurred: 2026-02-24 22:02:38.724895 | controller | 2026-02-24 22:02:38.724900 | controller | Traceback (most recent call last): 2026-02-24 22:02:38.724907 | controller | File "/tmp/ansible-tmp-1771970557.4968245-28198-145475589741526/AnsiballZ_k8s_info.py", line 107, in 2026-02-24 22:02:38.724928 | controller | _ansiballz_main() 2026-02-24 22:02:38.725010 | controller | File "/tmp/ansible-tmp-1771970557.4968245-28198-145475589741526/AnsiballZ_k8s_info.py", line 99, in _ansiballz_main 2026-02-24 22:02:38.725114 | controller | invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS) 2026-02-24 22:02:38.725199 | controller | File "/tmp/ansible-tmp-1771970557.4968245-28198-145475589741526/AnsiballZ_k8s_info.py", line 47, in invoke_module 2026-02-24 22:02:38.725291 | controller | runpy.run_module(mod_name='ansible_collections.kubernetes.core.plugins.modules.k8s_info', init_globals=dict(_module_fqn='ansible_collections.kubernetes.core.plugins.modules.k8s_info', _modlib_path=modlib_path), 2026-02-24 22:02:38.725380 | controller | File "/usr/lib64/python3.9/runpy.py", line 225, in run_module 2026-02-24 22:02:38.725449 | controller | return _run_module_code(code, init_globals, run_name, mod_spec) 2026-02-24 22:02:38.725544 | controller | File "/usr/lib64/python3.9/runpy.py", line 97, in _run_module_code 2026-02-24 22:02:38.725619 | controller | _run_code(code, mod_globals, init_globals, 2026-02-24 22:02:38.725725 | controller | File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-24 22:02:38.725805 | controller | exec(code, run_globals) 2026-02-24 22:02:38.725879 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_sjlt243l/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 229, in 2026-02-24 22:02:38.725974 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_sjlt243l/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 221, in main 2026-02-24 22:02:38.726088 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_sjlt243l/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 352, in get_api_client 2026-02-24 22:02:38.726166 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_sjlt243l/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 246, in wrapper 2026-02-24 22:02:38.726250 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_sjlt243l/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 259, in create_api_client 2026-02-24 22:02:38.726367 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 84, in __init__ 2026-02-24 22:02:38.726441 | controller | self.__discoverer = discoverer(self, cache_file) 2026-02-24 22:02:38.726521 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_sjlt243l/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 190, in __init__ 2026-02-24 22:02:38.726626 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_sjlt243l/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 45, in __init__ 2026-02-24 22:02:38.726712 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_sjlt243l/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 92, in __init_cache 2026-02-24 22:02:38.726799 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/discovery.py", line 146, in _load_server_info 2026-02-24 22:02:38.727013 | controller | 'kubernetes': self.client.request('get', '/version', serializer=just_json) 2026-02-24 22:02:38.727149 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-24 22:02:38.727225 | controller | resp = func(self, *args, **kwargs) 2026-02-24 22:02:38.727322 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 277, in request 2026-02-24 22:02:38.727412 | controller | api_response = self.client.call_api( 2026-02-24 22:02:38.727492 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-24 22:02:38.727571 | controller | return self.__call_api(resource_path, method, 2026-02-24 22:02:38.727664 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-24 22:02:38.727748 | controller | response_data = self.request( 2026-02-24 22:02:38.727824 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-24 22:02:38.727909 | controller | return self.rest_client.GET(url, 2026-02-24 22:02:38.728013 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-24 22:02:38.728110 | controller | return self.request("GET", url, 2026-02-24 22:02:38.728184 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 217, in request 2026-02-24 22:02:38.728271 | controller | r = self.pool_manager.request(method, url, 2026-02-24 22:02:38.728374 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 74, in request 2026-02-24 22:02:38.728430 | controller | return self.request_encode_url( 2026-02-24 22:02:38.728516 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 96, in request_encode_url 2026-02-24 22:02:38.728596 | controller | return self.urlopen(method, url, **extra_kw) 2026-02-24 22:02:38.728684 | controller | File "/usr/lib/python3.9/site-packages/urllib3/poolmanager.py", line 376, in urlopen 2026-02-24 22:02:38.728764 | controller | response = conn.urlopen(method, u.request_uri, **kw) 2026-02-24 22:02:38.728845 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-24 22:02:38.728942 | controller | return self.urlopen( 2026-02-24 22:02:38.729036 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-24 22:02:38.729113 | controller | return self.urlopen( 2026-02-24 22:02:38.729200 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-24 22:02:38.729341 | controller | return self.urlopen( 2026-02-24 22:02:38.729431 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 756, in urlopen 2026-02-24 22:02:38.729502 | controller | retries = retries.increment( 2026-02-24 22:02:38.729601 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 576, in increment 2026-02-24 22:02:38.729676 | controller | raise MaxRetryError(_pool, url, error or ResponseError(cause)) 2026-02-24 22:02:38.729763 | controller | urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-24 22:02:38.729856 | controller | msg: |- 2026-02-24 22:02:38.729938 | controller | MODULE FAILURE 2026-02-24 22:02:38.730009 | controller | See stdout/stderr for the exact error 2026-02-24 22:02:38.730117 | controller | rc: 1 2026-02-24 22:02:38.731812 | controller | 2026-02-24 22:02:38.731905 | controller | TASK [Create dnsmasq dir] ****************************************************** 2026-02-24 22:02:38.731999 | controller | Tuesday 24 February 2026 22:02:38 +0000 (0:00:01.279) 0:07:09.345 ****** 2026-02-24 22:02:38.983988 | controller | changed: [instance] 2026-02-24 22:02:38.984085 | controller | 2026-02-24 22:02:38.984199 | controller | TASK [Get journalctl in a file] ************************************************ 2026-02-24 22:02:38.984216 | controller | Tuesday 24 February 2026 22:02:38 +0000 (0:00:00.251) 0:07:09.597 ****** 2026-02-24 22:02:39.262049 | controller | changed: [instance] 2026-02-24 22:02:39.262115 | controller | 2026-02-24 22:02:39.262235 | controller | TASK [Dump journalctl output] ************************************************** 2026-02-24 22:02:39.262347 | controller | Tuesday 24 February 2026 22:02:39 +0000 (0:00:00.277) 0:07:09.874 ****** 2026-02-24 22:02:39.744353 | controller | changed: [instance] 2026-02-24 22:02:39.744414 | controller | 2026-02-24 22:02:39.744547 | controller | TASK [Copy all dnsmasq config] ************************************************* 2026-02-24 22:02:39.744642 | controller | Tuesday 24 February 2026 22:02:39 +0000 (0:00:00.482) 0:07:10.357 ****** 2026-02-24 22:02:40.339704 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-24 22:02:40.339766 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2026-02-24 22:02:40.339864 | controller | 2026-02-24 22:02:40.339966 | controller | TASK [Create log directory] **************************************************** 2026-02-24 22:02:40.340084 | controller | Tuesday 24 February 2026 22:02:40 +0000 (0:00:00.595) 0:07:10.952 ****** 2026-02-24 22:02:40.581551 | controller | changed: [instance] 2026-02-24 22:02:40.581619 | controller | 2026-02-24 22:02:40.581714 | controller | TASK [Sync logs from controller-0] ********************************************* 2026-02-24 22:02:40.581804 | controller | Tuesday 24 February 2026 22:02:40 +0000 (0:00:00.242) 0:07:11.194 ****** 2026-02-24 22:02:41.509874 | controller | changed: [instance] 2026-02-24 22:02:41.509973 | controller | 2026-02-24 22:02:41.510009 | controller | PLAY RECAP ********************************************************************* 2026-02-24 22:02:41.510454 | controller | instance : ok=541 changed=208 unreachable=0 failed=1 skipped=230 rescued=0 ignored=0 2026-02-24 22:02:41.510974 | controller | 2026-02-24 22:02:41.510996 | controller | Tuesday 24 February 2026 22:02:41 +0000 (0:00:00.926) 0:07:12.121 ****** 2026-02-24 22:02:41.511003 | controller | =============================================================================== 2026-02-24 22:02:41.511011 | controller | reproducer : Check package install status ------------------------------ 39.73s 2026-02-24 22:02:41.511170 | controller | libvirt_manager : Download base image ---------------------------------- 32.14s 2026-02-24 22:02:41.511230 | controller | ci_setup : Install needed packages ------------------------------------- 31.05s 2026-02-24 22:02:41.511238 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 23.00s 2026-02-24 22:02:41.511244 | controller | reproducer : Install collections on controller-0 ----------------------- 20.78s 2026-02-24 22:02:41.511249 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 11.00s 2026-02-24 22:02:41.511261 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 8.02s 2026-02-24 22:02:41.511502 | controller | libvirt_manager : Install packages required for using KVM --------------- 7.92s 2026-02-24 22:02:41.512180 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.77s 2026-02-24 22:02:41.512234 | controller | sushy_emulator : Install required packages ------------------------------ 7.17s 2026-02-24 22:02:41.512242 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.11s 2026-02-24 22:02:41.512248 | controller | ci_setup : Install openshift client ------------------------------------- 5.95s 2026-02-24 22:02:41.512260 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.07s 2026-02-24 22:02:41.696399 | controller | networking_mapper : Gather the facts ------------------------------------ 3.74s 2026-02-24 22:02:41.696447 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.62s 2026-02-24 22:02:41.696456 | controller | dnsmasq : Add/Remove address -------------------------------------------- 2.97s 2026-02-24 22:02:41.696462 | controller | ci_setup : Manage directories ------------------------------------------- 2.66s 2026-02-24 22:02:41.696468 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.42s 2026-02-24 22:02:41.696474 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.18s 2026-02-24 22:02:41.696485 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2026-02-24 22:02:41.696496 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2026-02-24 22:02:41.696964 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2026-02-24 22:02:41.706457 | controller | INFO Running crc_layout > cleanup 2026-02-24 22:02:41.706902 | controller | WARNING Skipping, cleanup playbook not configured. 2026-02-24 22:02:41.714104 | controller | INFO Running crc_layout > destroy 2026-02-24 22:02:41.714443 | controller | WARNING Skipping, instances are delegated. 2026-02-24 22:02:41.714758 | controller | INFO Pruning extra files from scenario ephemeral directory 2026-02-24 22:02:41.716336 | controller | INFO Writing /tmp/report.html report. 2026-02-24 22:02:41.917221 | [controller] Waiting on logger 2026-02-24 22:02:47.099762 | [controller] Waiting on logger 2026-02-24 22:02:57.531788 | [controller] Waiting on logger 2026-02-24 22:03:07.963747 | [controller] Waiting on logger 2026-02-24 22:03:11.835720 | [Zuul] Log Stream did not terminate 2026-02-24 22:03:11.836120 | controller | ERROR 2026-02-24 22:03:11.836257 | controller | { 2026-02-24 22:03:11.836357 | controller | "delta": "0:09:08.771402", 2026-02-24 22:03:11.836402 | controller | "end": "2026-02-24 22:02:41.796160", 2026-02-24 22:03:11.836453 | controller | "msg": "non-zero return code", 2026-02-24 22:03:11.836482 | controller | "rc": 1, 2026-02-24 22:03:11.836511 | controller | "start": "2026-02-24 21:53:33.024758" 2026-02-24 22:03:11.836538 | controller | } failure 2026-02-24 22:03:12.132341 | 2026-02-24 22:03:12.132464 | PLAY RECAP 2026-02-24 22:03:12.132528 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2026-02-24 22:03:12.132554 | 2026-02-24 22:03:12.194610 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-24 22:03:12.195318 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-24 22:03:12.687144 | 2026-02-24 22:03:12.687254 | PLAY [Run ci/playbooks/collect-logs.yml] 2026-02-24 22:03:12.706501 | 2026-02-24 22:03:12.706568 | TASK [Filter out host if needed] 2026-02-24 22:03:12.714282 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2026-02-24 22:03:12.718515 | 2026-02-24 22:03:12.718577 | TASK [Ensure file is present] 2026-02-24 22:03:13.142882 | controller | ok 2026-02-24 22:03:13.148386 | 2026-02-24 22:03:13.148464 | TASK [Manage molecule report file] 2026-02-24 22:03:13.168623 | [controller] Waiting on logger 2026-02-24 22:03:22.555887 | [controller] Waiting on logger 2026-02-24 22:03:31.936682 | [controller] Waiting on logger 2026-02-24 22:03:42.331898 | [controller] Waiting on logger 2026-02-24 22:03:43.562236 | [Zuul] Log Stream did not terminate 2026-02-24 22:03:43.562513 | controller | changed 2026-02-24 22:03:43.567316 | 2026-02-24 22:03:43.567378 | TASK [Check if we get ci-framework-data basedir] 2026-02-24 22:03:43.839710 | controller | ok 2026-02-24 22:03:43.844544 | 2026-02-24 22:03:43.844603 | TASK [Create ci-framework-data log directory for zuul] 2026-02-24 22:03:44.217090 | controller | changed 2026-02-24 22:03:44.222476 | 2026-02-24 22:03:44.222536 | TASK [Copy ci-framework interesting files] 2026-02-24 22:03:44.245446 | [controller] Waiting on logger 2026-02-24 22:03:54.683880 | [controller] Waiting on logger 2026-02-24 22:04:04.064614 | [controller] Waiting on logger 2026-02-24 22:04:14.459946 | [controller] Waiting on logger 2026-02-24 22:04:14.543872 | [Zuul] Log Stream did not terminate 2026-02-24 22:04:14.544093 | controller | changed 2026-02-24 22:04:14.548943 | 2026-02-24 22:04:14.549003 | TASK [Get SELinux listing] 2026-02-24 22:04:15.611962 | [controller] Waiting on logger 2026-02-24 22:04:30.139852 | [controller] Waiting on logger 2026-02-24 22:04:40.571878 | [controller] Waiting on logger 2026-02-24 22:04:44.869667 | [Zuul] Log Stream did not terminate 2026-02-24 22:04:44.869906 | controller | changed 2026-02-24 22:04:44.876282 | 2026-02-24 22:04:44.876377 | TASK [Generate log index] 2026-02-24 22:04:46.034057 | controller | changed 2026-02-24 22:04:46.038970 | 2026-02-24 22:04:46.039037 | TASK [Get some env related data] 2026-02-24 22:04:46.059705 | [controller] Waiting on logger 2026-02-24 22:04:56.443828 | [controller] Waiting on logger 2026-02-24 22:05:06.875972 | [controller] Waiting on logger 2026-02-24 22:05:16.220088 | [controller] Waiting on logger 2026-02-24 22:05:17.301235 | [Zuul] Log Stream did not terminate 2026-02-24 22:05:17.301583 | controller | changed 2026-02-24 22:05:17.307216 | 2026-02-24 22:05:17.307281 | TASK [Generate list of logs to collect in home directory] 2026-02-24 22:05:17.690576 | controller | ok: All paths examined 2026-02-24 22:05:17.695662 | 2026-02-24 22:05:17.695720 | LOOP [Copy logs from home directory] 2026-02-24 22:05:18.346514 | controller | changed: 2026-02-24 22:05:18.346709 | controller | { 2026-02-24 22:05:18.346740 | controller | "atime": 1743544925.4788878, 2026-02-24 22:05:18.346760 | controller | "ctime": 1743545329.1409318, 2026-02-24 22:05:18.346782 | controller | "dev": 64513, 2026-02-24 22:05:18.346800 | controller | "gid": 1000, 2026-02-24 22:05:18.346816 | controller | "gr_name": "zuul", 2026-02-24 22:05:18.346833 | controller | "inode": 4518807, 2026-02-24 22:05:18.346850 | controller | "isblk": false, 2026-02-24 22:05:18.346866 | controller | "ischr": false, 2026-02-24 22:05:18.346882 | controller | "isdir": false, 2026-02-24 22:05:18.346897 | controller | "isfifo": false, 2026-02-24 22:05:18.346914 | controller | "isgid": false, 2026-02-24 22:05:18.346930 | controller | "islnk": false, 2026-02-24 22:05:18.346944 | controller | "isreg": true, 2026-02-24 22:05:18.346959 | controller | "issock": false, 2026-02-24 22:05:18.346973 | controller | "isuid": false, 2026-02-24 22:05:18.346988 | controller | "mode": "0644", 2026-02-24 22:05:18.347001 | controller | "mtime": 1743545329.1409318, 2026-02-24 22:05:18.347016 | controller | "nlink": 1, 2026-02-24 22:05:18.347031 | controller | "path": "/home/zuul/crc-setup.log", 2026-02-24 22:05:18.347047 | controller | "pw_name": "zuul", 2026-02-24 22:05:18.347062 | controller | "rgrp": true, 2026-02-24 22:05:18.347078 | controller | "roth": true, 2026-02-24 22:05:18.347093 | controller | "rusr": true, 2026-02-24 22:05:18.347107 | controller | "size": 4108, 2026-02-24 22:05:18.347122 | controller | "uid": 1000, 2026-02-24 22:05:18.347136 | controller | "wgrp": false, 2026-02-24 22:05:18.347150 | controller | "woth": false, 2026-02-24 22:05:18.347163 | controller | "wusr": true, 2026-02-24 22:05:18.347177 | controller | "xgrp": false, 2026-02-24 22:05:18.347192 | controller | "xoth": false, 2026-02-24 22:05:18.347206 | controller | "xusr": false 2026-02-24 22:05:18.347226 | controller | } 2026-02-24 22:05:18.971758 | controller | changed: 2026-02-24 22:05:18.971846 | controller | { 2026-02-24 22:05:18.971870 | controller | "atime": 1743545331.0429637, 2026-02-24 22:05:18.971889 | controller | "ctime": 1743545842.0111232, 2026-02-24 22:05:18.971906 | controller | "dev": 64513, 2026-02-24 22:05:18.971922 | controller | "gid": 1000, 2026-02-24 22:05:18.971936 | controller | "gr_name": "zuul", 2026-02-24 22:05:18.971950 | controller | "inode": 4194437, 2026-02-24 22:05:18.971963 | controller | "isblk": false, 2026-02-24 22:05:18.971976 | controller | "ischr": false, 2026-02-24 22:05:18.971989 | controller | "isdir": false, 2026-02-24 22:05:18.972001 | controller | "isfifo": false, 2026-02-24 22:05:18.972013 | controller | "isgid": false, 2026-02-24 22:05:18.972025 | controller | "islnk": false, 2026-02-24 22:05:18.972037 | controller | "isreg": true, 2026-02-24 22:05:18.972049 | controller | "issock": false, 2026-02-24 22:05:18.972062 | controller | "isuid": false, 2026-02-24 22:05:18.972074 | controller | "mode": "0644", 2026-02-24 22:05:18.972085 | controller | "mtime": 1743545842.0111232, 2026-02-24 22:05:18.972098 | controller | "nlink": 1, 2026-02-24 22:05:18.972111 | controller | "path": "/home/zuul/crc-start.log", 2026-02-24 22:05:18.972124 | controller | "pw_name": "zuul", 2026-02-24 22:05:18.972138 | controller | "rgrp": true, 2026-02-24 22:05:18.972151 | controller | "roth": true, 2026-02-24 22:05:18.972165 | controller | "rusr": true, 2026-02-24 22:05:18.972179 | controller | "size": 4023, 2026-02-24 22:05:18.972193 | controller | "uid": 1000, 2026-02-24 22:05:18.972207 | controller | "wgrp": false, 2026-02-24 22:05:18.972221 | controller | "woth": false, 2026-02-24 22:05:18.972235 | controller | "wusr": true, 2026-02-24 22:05:18.972248 | controller | "xgrp": false, 2026-02-24 22:05:18.972262 | controller | "xoth": false, 2026-02-24 22:05:18.972275 | controller | "xusr": false 2026-02-24 22:05:18.972288 | controller | } 2026-02-24 22:05:19.611857 | controller | changed: 2026-02-24 22:05:19.611944 | controller | { 2026-02-24 22:05:19.611970 | controller | "atime": 1771969994.4370823, 2026-02-24 22:05:19.611990 | controller | "ctime": 1771970010.7011797, 2026-02-24 22:05:19.612006 | controller | "dev": 64513, 2026-02-24 22:05:19.612023 | controller | "gid": 1000, 2026-02-24 22:05:19.612039 | controller | "gr_name": "zuul", 2026-02-24 22:05:19.612056 | controller | "inode": 4518912, 2026-02-24 22:05:19.612072 | controller | "isblk": false, 2026-02-24 22:05:19.612086 | controller | "ischr": false, 2026-02-24 22:05:19.612101 | controller | "isdir": false, 2026-02-24 22:05:19.612115 | controller | "isfifo": false, 2026-02-24 22:05:19.612129 | controller | "isgid": false, 2026-02-24 22:05:19.612142 | controller | "islnk": false, 2026-02-24 22:05:19.612156 | controller | "isreg": true, 2026-02-24 22:05:19.612169 | controller | "issock": false, 2026-02-24 22:05:19.612183 | controller | "isuid": false, 2026-02-24 22:05:19.612196 | controller | "mode": "0644", 2026-02-24 22:05:19.612209 | controller | "mtime": 1771970010.7011797, 2026-02-24 22:05:19.612223 | controller | "nlink": 1, 2026-02-24 22:05:19.612238 | controller | "path": "/home/zuul/ansible.log", 2026-02-24 22:05:19.612253 | controller | "pw_name": "zuul", 2026-02-24 22:05:19.612268 | controller | "rgrp": true, 2026-02-24 22:05:19.612282 | controller | "roth": true, 2026-02-24 22:05:19.612312 | controller | "rusr": true, 2026-02-24 22:05:19.612333 | controller | "size": 6749, 2026-02-24 22:05:19.612349 | controller | "uid": 1000, 2026-02-24 22:05:19.612364 | controller | "wgrp": false, 2026-02-24 22:05:19.612378 | controller | "woth": false, 2026-02-24 22:05:19.612392 | controller | "wusr": true, 2026-02-24 22:05:19.612416 | controller | "xgrp": false, 2026-02-24 22:05:19.612432 | controller | "xoth": false, 2026-02-24 22:05:19.612446 | controller | "xusr": false 2026-02-24 22:05:19.612460 | controller | } 2026-02-24 22:05:19.624407 | 2026-02-24 22:05:19.624509 | TASK [Copy crio stats log file] 2026-02-24 22:05:19.637377 | controller | skipping: Conditional result was False 2026-02-24 22:05:19.642094 | 2026-02-24 22:05:19.642159 | TASK [Get SELinux related data] 2026-02-24 22:05:19.661907 | [controller] Waiting on logger 2026-02-24 22:05:29.056218 | [controller] Waiting on logger 2026-02-24 22:05:39.451707 | [controller] Waiting on logger 2026-02-24 22:05:49.883840 | [controller] Waiting on logger 2026-02-24 22:05:49.982905 | [Zuul] Log Stream did not terminate 2026-02-24 22:05:49.983214 | controller | ERROR 2026-02-24 22:05:49.983351 | controller | { 2026-02-24 22:05:49.983390 | controller | "delta": "0:00:00.012474", 2026-02-24 22:05:49.983428 | controller | "end": "2026-02-24 22:05:19.953769", 2026-02-24 22:05:49.983449 | controller | "msg": "non-zero return code", 2026-02-24 22:05:49.983468 | controller | "rc": 1, 2026-02-24 22:05:49.983486 | controller | "start": "2026-02-24 22:05:19.941295" 2026-02-24 22:05:49.983504 | controller | } 2026-02-24 22:05:49.983528 | controller | ERROR: Ignoring Errors 2026-02-24 22:05:49.988700 | 2026-02-24 22:05:49.988760 | TASK [Create system configuration directory] 2026-02-24 22:05:50.290955 | controller | changed 2026-02-24 22:05:50.295745 | 2026-02-24 22:05:50.295812 | TASK [Get some of the system configurations] 2026-02-24 22:05:55.321435 | controller | changed 2026-02-24 22:05:55.326703 | 2026-02-24 22:05:55.326770 | TASK [Copy generated documentation if available] 2026-02-24 22:05:55.340001 | controller | skipping: Conditional result was False 2026-02-24 22:05:55.345284 | 2026-02-24 22:05:55.345363 | TASK [Copy generated AsciiDoc documentation if available] 2026-02-24 22:05:55.358474 | controller | skipping: Conditional result was False 2026-02-24 22:05:55.363561 | 2026-02-24 22:05:55.363624 | TASK [Compress logs bigger than 2MB] 2026-02-24 22:05:55.384537 | [controller] Waiting on logger 2026-02-24 22:06:05.820236 | [controller] Waiting on logger 2026-02-24 22:06:15.163751 | [controller] Waiting on logger 2026-02-24 22:06:25.596403 | [controller] Waiting on logger 2026-02-24 22:06:25.685940 | [Zuul] Log Stream did not terminate 2026-02-24 22:06:25.686058 | controller | changed 2026-02-24 22:06:25.691211 | 2026-02-24 22:06:25.691276 | TASK [Copy files from workspace on node] 2026-02-24 22:06:25.708854 | controller | ok 2026-02-24 22:06:25.730526 | 2026-02-24 22:06:25.730602 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-24 22:06:25.743315 | controller | skipping: Conditional result was False 2026-02-24 22:06:25.748820 | 2026-02-24 22:06:25.748890 | TASK [fetch-output : Set log path for single node] 2026-02-24 22:06:25.776466 | controller | ok 2026-02-24 22:06:25.781232 | 2026-02-24 22:06:25.781312 | LOOP [fetch-output : Ensure local output dirs] 2026-02-24 22:06:25.966454 | controller -> localhost | ok: "/var/lib/zuul/builds/32f5a9506601437c8d9723a1fdd3db21/work/logs" 2026-02-24 22:06:25.966734 | controller -> localhost | changed: All items complete 2026-02-24 22:06:25.966776 | 2026-02-24 22:06:26.137629 | controller -> localhost | changed: "/var/lib/zuul/builds/32f5a9506601437c8d9723a1fdd3db21/work/artifacts" 2026-02-24 22:06:26.310691 | controller -> localhost | changed: "/var/lib/zuul/builds/32f5a9506601437c8d9723a1fdd3db21/work/docs" 2026-02-24 22:06:26.328351 | 2026-02-24 22:06:26.328441 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-24 22:06:26.946266 | controller | changed: 2026-02-24 22:06:26.946461 | controller | .d..t...... ./ 2026-02-24 22:06:26.946494 | controller | >f+++++++++ README.html 2026-02-24 22:06:26.946517 | controller | >f+++++++++ ansible-execution.log 2026-02-24 22:06:26.946538 | controller | >f+++++++++ ansible.log 2026-02-24 22:06:26.946557 | controller | >f+++++++++ crc-setup.log 2026-02-24 22:06:26.946576 | controller | >f+++++++++ crc-start.log 2026-02-24 22:06:26.946595 | controller | >f+++++++++ dmesg.log 2026-02-24 22:06:26.946613 | controller | >f+++++++++ installed-pkgs.log 2026-02-24 22:06:26.946636 | controller | >f+++++++++ python.log 2026-02-24 22:06:26.946657 | controller | >f+++++++++ registries.conf 2026-02-24 22:06:26.946675 | controller | >f+++++++++ report.html 2026-02-24 22:06:26.946692 | controller | >f+++++++++ selinux-denials.log 2026-02-24 22:06:26.946709 | controller | >f+++++++++ selinux-listing.log 2026-02-24 22:06:26.946725 | controller | cd+++++++++ ci-framework-data/ 2026-02-24 22:06:26.946741 | controller | cd+++++++++ ci-framework-data/artifacts/ 2026-02-24 22:06:26.946759 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2026-02-24 22:06:26.946776 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2026-02-24 22:06:26.946793 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2026-02-24 22:06:26.946809 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2026-02-24 22:06:26.946826 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2026-02-24 22:06:26.946843 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2026-02-24 22:06:26.946860 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2026-02-24 22:06:26.946878 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2026-02-24 22:06:26.946895 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2026-02-24 22:06:26.946912 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2026-02-24 22:06:26.946928 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2026-02-24 22:06:26.946945 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2026-02-24 22:06:26.946961 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2026-02-24 22:06:26.946978 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:b4:57:13 2026-02-24 22:06:26.946995 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:69:82:7f 2026-02-24 22:06:26.947012 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:aa:9c:cb 2026-02-24 22:06:26.947029 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:ce:94:7b 2026-02-24 22:06:26.947046 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:17:10:87 2026-02-24 22:06:26.947063 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:e1:07:ea 2026-02-24 22:06:26.947080 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2026-02-24 22:06:26.947097 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2026-02-24 22:06:26.947114 | controller | cd+++++++++ ci-framework-data/logs/ 2026-02-24 22:06:26.947130 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2026-02-24 22:06:26.947147 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2026-02-24 22:06:26.947163 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2026-02-24 22:06:26.947180 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2026-02-24 22:06:26.947197 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2026-02-24 22:06:26.947216 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2026-02-24 22:06:26.947234 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2026-02-24 22:06:26.947252 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2026-02-24 22:06:26.947269 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2026-02-24 22:06:26.947286 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2026-02-24 22:06:26.947328 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2026-02-24 22:06:26.947351 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2026-02-24 22:06:26.947370 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2026-02-24 22:06:26.947388 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2026-02-24 22:06:26.947419 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2026-02-24 22:06:26.947439 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2026-02-24 22:06:26.947458 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2026-02-24 22:06:26.947476 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2026-02-24 22:06:26.947494 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2026-02-24 22:06:26.947511 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2026-02-24 22:06:26.947528 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2026-02-24 22:06:26.947545 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2026-02-24 22:06:26.947562 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2026-02-24 22:06:26.947579 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2026-02-24 22:06:26.947597 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2026-02-24 22:06:26.947614 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2026-02-24 22:06:26.947631 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2026-02-24 22:06:26.947648 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2026-02-24 22:06:26.947665 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2026-02-24 22:06:26.947683 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2026-02-24 22:06:26.947700 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2026-02-24 22:06:26.947717 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2026-02-24 22:06:26.947733 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2026-02-24 22:06:26.947750 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2026-02-24 22:06:26.947767 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2026-02-24 22:06:26.947783 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2026-02-24 22:06:26.947800 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2026-02-24 22:06:26.947817 | controller | cd+++++++++ registries.conf.d/ 2026-02-24 22:06:26.947833 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2026-02-24 22:06:26.947851 | controller | cd+++++++++ system-config/ 2026-02-24 22:06:26.947867 | controller | cd+++++++++ system-config/libvirt/ 2026-02-24 22:06:26.947887 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2026-02-24 22:06:26.947905 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2026-02-24 22:06:26.947922 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2026-02-24 22:06:26.947938 | controller | >f+++++++++ system-config/libvirt/network.conf 2026-02-24 22:06:26.947955 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2026-02-24 22:06:26.947971 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2026-02-24 22:06:26.947988 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2026-02-24 22:06:26.948004 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2026-02-24 22:06:26.948020 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2026-02-24 22:06:26.948037 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2026-02-24 22:06:26.948053 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2026-02-24 22:06:26.948070 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2026-02-24 22:06:26.948087 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2026-02-24 22:06:26.948103 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2026-02-24 22:06:26.948119 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2026-02-24 22:06:26.948135 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2026-02-24 22:06:27.394690 | controller | changed: .d..t...... ./ 2026-02-24 22:06:27.835477 | controller | changed: .d..t...... ./ 2026-02-24 22:06:27.846901 | 2026-02-24 22:06:27.846983 | TASK [Return artifact to Zuul] 2026-02-24 22:06:27.874808 | controller | ok 2026-02-24 22:06:27.892809 | 2026-02-24 22:06:27.892860 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2026-02-24 22:06:27.892957 | 2026-02-24 22:06:27.892984 | PLAY RECAP 2026-02-24 22:06:27.893019 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2026-02-24 22:06:27.893040 | 2026-02-24 22:06:27.970992 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-24 22:06:27.971766 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-24 22:06:28.467124 | 2026-02-24 22:06:28.467219 | PLAY [all] 2026-02-24 22:06:28.485242 | 2026-02-24 22:06:28.485351 | TASK [include_role : fetch-output] 2026-02-24 22:06:28.513371 | controller | ok 2026-02-24 22:06:28.529863 | 2026-02-24 22:06:28.529960 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-24 22:06:28.563981 | controller | skipping: Conditional result was False 2026-02-24 22:06:28.569611 | 2026-02-24 22:06:28.569688 | TASK [fetch-output : Set log path for single node] 2026-02-24 22:06:28.597386 | controller | ok 2026-02-24 22:06:28.602189 | 2026-02-24 22:06:28.602262 | LOOP [fetch-output : Ensure local output dirs] 2026-02-24 22:06:28.911371 | controller -> localhost | ok: "/var/lib/zuul/builds/32f5a9506601437c8d9723a1fdd3db21/work/logs" 2026-02-24 22:06:29.095826 | controller -> localhost | ok: "/var/lib/zuul/builds/32f5a9506601437c8d9723a1fdd3db21/work/artifacts" 2026-02-24 22:06:29.275337 | controller -> localhost | ok: "/var/lib/zuul/builds/32f5a9506601437c8d9723a1fdd3db21/work/docs" 2026-02-24 22:06:29.290975 | 2026-02-24 22:06:29.291078 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-24 22:06:29.889153 | controller | ok 2026-02-24 22:06:29.889373 | controller | ok: All items complete 2026-02-24 22:06:29.889420 | 2026-02-24 22:06:30.351986 | controller | ok 2026-02-24 22:06:30.812259 | controller | ok 2026-02-24 22:06:30.826273 | 2026-02-24 22:06:30.826398 | TASK [include_role : fetch-output-openshift] 2026-02-24 22:06:30.839325 | controller | skipping: Conditional result was False 2026-02-24 22:06:30.844817 | 2026-02-24 22:06:30.844882 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-02-24 22:06:31.164780 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006163 2026-02-24 22:06:31.345656 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006417 2026-02-24 22:06:31.378234 | 2026-02-24 22:06:31.378335 | PLAY [all] 2026-02-24 22:06:31.392057 | 2026-02-24 22:06:31.392124 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-02-24 22:06:31.899396 | controller | changed 2026-02-24 22:06:31.920218 | 2026-02-24 22:06:31.920272 | PLAY RECAP 2026-02-24 22:06:31.920336 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-02-24 22:06:31.920364 | 2026-02-24 22:06:31.985098 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-24 22:06:31.985819 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2026-02-24 22:06:32.507655 | 2026-02-24 22:06:32.507756 | PLAY [localhost] 2026-02-24 22:06:32.523938 | 2026-02-24 22:06:32.524011 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-02-24 22:06:32.814525 | localhost | changed 2026-02-24 22:06:32.818988 | 2026-02-24 22:06:32.819076 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-02-24 22:06:32.836157 | localhost | ok 2026-02-24 22:06:32.843784 | 2026-02-24 22:06:32.843850 | TASK [add-fileserver : Create SSH private key tempfile] 2026-02-24 22:06:33.133977 | localhost | changed 2026-02-24 22:06:33.139698 | 2026-02-24 22:06:33.139788 | TASK [add-fileserver : Create SSH private key from secret] 2026-02-24 22:06:33.665194 | localhost | changed 2026-02-24 22:06:33.669994 | 2026-02-24 22:06:33.670062 | TASK [add-fileserver : Add fileserver ssh key] 2026-02-24 22:06:33.991167 | localhost | Identity added: /var/lib/zuul/builds/32f5a9506601437c8d9723a1fdd3db21/work/tmp/ansible.mfelvxdz (/var/lib/zuul/builds/32f5a9506601437c8d9723a1fdd3db21/work/tmp/ansible.mfelvxdz) 2026-02-24 22:06:33.991357 | localhost | ok: Runtime: 0:00:00.006135 2026-02-24 22:06:33.995470 | 2026-02-24 22:06:33.995537 | TASK [add-fileserver : Remove SSH private key from disk] 2026-02-24 22:06:34.205463 | localhost | ok: Runtime: 0:00:00.004437 2026-02-24 22:06:34.209820 | 2026-02-24 22:06:34.209886 | TASK [add-fileserver : Add fileserver to inventory] 2026-02-24 22:06:34.257837 | localhost | changed 2026-02-24 22:06:34.262583 | 2026-02-24 22:06:34.262647 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-02-24 22:06:34.563958 | localhost | changed 2026-02-24 22:06:34.582543 | 2026-02-24 22:06:34.582600 | PLAY [localhost] 2026-02-24 22:06:34.593479 | 2026-02-24 22:06:34.593540 | TASK [Generate bulk log download script] 2026-02-24 22:06:34.611572 | localhost | ok 2026-02-24 22:06:34.622350 | 2026-02-24 22:06:34.622426 | TASK [local-log-download : Check API endpoint is defined] 2026-02-24 22:06:34.649651 | localhost | ok: All assertions passed 2026-02-24 22:06:34.653991 | 2026-02-24 22:06:34.654052 | TASK [local-log-download : Create download script] 2026-02-24 22:06:34.991542 | localhost -> localhost | changed 2026-02-24 22:06:34.999971 | 2026-02-24 22:06:35.000040 | TASK [Register quick-download link] 2026-02-24 22:06:35.016842 | localhost | ok 2026-02-24 22:06:35.051442 | 2026-02-24 22:06:35.051509 | PLAY [logserver.rdoproject.org] 2026-02-24 22:06:35.060775 | 2026-02-24 22:06:35.060838 | TASK [Set zuul-log-path fact] 2026-02-24 22:06:35.076273 | logserver.rdoproject.org | ok 2026-02-24 22:06:35.084821 | 2026-02-24 22:06:35.084887 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-24 22:06:35.100155 | logserver.rdoproject.org | ok 2026-02-24 22:06:35.105238 | 2026-02-24 22:06:35.105318 | TASK [upload-logs : Create log directories] 2026-02-24 22:06:36.820090 | logserver.rdoproject.org | changed 2026-02-24 22:06:36.823093 | 2026-02-24 22:06:36.823156 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-02-24 22:06:37.028786 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004509 2026-02-24 22:06:37.032976 | 2026-02-24 22:06:37.033042 | TASK [upload-logs : Upload logs to log server] 2026-02-24 22:06:38.587876 | logserver.rdoproject.org | Output suppressed because no_log was given 2026-02-24 22:06:38.590709 | 2026-02-24 22:06:38.590775 | LOOP [upload-logs : Compress console log and json output] 2026-02-24 22:06:38.626343 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 22:06:38.634424 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 22:06:38.647420 | 2026-02-24 22:06:38.647519 | LOOP [upload-logs : Upload compressed console log and json output] 2026-02-24 22:06:38.679679 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 22:06:38.679878 | 2026-02-24 22:06:38.683043 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 22:06:38.693752 | 2026-02-24 22:06:38.693844 | LOOP [upload-logs : Upload console log and json output]