2026-02-23 21:05:45.150902 | Job console starting... 2026-02-23 21:05:45.367504 | Updating repositories 2026-02-23 21:05:46.121413 | Preparing job workspace 2026-02-23 21:05:53.070750 | Running Ansible setup... 2026-02-23 21:05:56.607911 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-23 21:05:57.113390 | 2026-02-23 21:05:57.113498 | PLAY [localhost] 2026-02-23 21:05:57.121923 | 2026-02-23 21:05:57.121994 | TASK [Gathering Facts] 2026-02-23 21:05:57.896006 | localhost | ok 2026-02-23 21:05:57.908539 | 2026-02-23 21:05:57.908635 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-02-23 21:05:58.205884 | localhost -> localhost | changed 2026-02-23 21:05:58.211144 | 2026-02-23 21:05:58.211217 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-02-23 21:05:58.872289 | localhost -> localhost | changed 2026-02-23 21:05:58.880391 | 2026-02-23 21:05:58.880474 | TASK [Setup log path fact] 2026-02-23 21:05:58.897129 | localhost | ok 2026-02-23 21:05:58.907805 | 2026-02-23 21:05:58.907871 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-23 21:05:58.924902 | localhost | ok 2026-02-23 21:05:58.931939 | 2026-02-23 21:05:58.932003 | TASK [emit-job-header : Print job information] 2026-02-23 21:05:58.968829 | # Job Information 2026-02-23 21:05:58.968941 | Ansible Version: 2.15.12 2026-02-23 21:05:58.968969 | Job: cifmw-molecule-reproducer 2026-02-23 21:05:58.968990 | Pipeline: github-check 2026-02-23 21:05:58.969009 | Executor: ibm-bm4-ze.softwarefactory-project.io 2026-02-23 21:05:58.969027 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3704 2026-02-23 21:05:58.969044 | Log URL (when completed): https://logserver.rdoproject.org/f61/rdoproject.org/f613925b0b454ba2b6e3440fd4399eb0/ 2026-02-23 21:05:58.969061 | Event ID: 4528e620-10fb-11f1-9502-2c01099298f1 2026-02-23 21:05:58.972626 | 2026-02-23 21:05:58.972692 | LOOP [emit-job-header : Print node information] 2026-02-23 21:05:59.054215 | localhost | ok: 2026-02-23 21:05:59.054420 | localhost | # Node Information 2026-02-23 21:05:59.054452 | localhost | Inventory Hostname: controller 2026-02-23 21:05:59.054476 | localhost | Hostname: np0005627310 2026-02-23 21:05:59.054495 | localhost | Username: zuul 2026-02-23 21:05:59.054515 | localhost | Distro: CentOS 9 2026-02-23 21:05:59.054532 | localhost | Provider: ibm-bm4-nodepool 2026-02-23 21:05:59.054547 | localhost | Region: regionOne 2026-02-23 21:05:59.054562 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2026-02-23 21:05:59.054578 | localhost | Product Name: OpenStack Compute 2026-02-23 21:05:59.054592 | localhost | Interface IP: 192.168.26.179 2026-02-23 21:05:59.074178 | 2026-02-23 21:05:59.074251 | PLAY [all] 2026-02-23 21:05:59.080355 | 2026-02-23 21:05:59.080416 | TASK [Gather network facts] 2026-02-23 21:05:59.528742 | controller | ok 2026-02-23 21:05:59.542330 | 2026-02-23 21:05:59.542396 | TASK [include_role : start-zuul-console] 2026-02-23 21:05:59.559886 | controller | ok 2026-02-23 21:05:59.571211 | 2026-02-23 21:05:59.571277 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-02-23 21:05:59.943232 | controller | ok 2026-02-23 21:05:59.951356 | 2026-02-23 21:05:59.951418 | TASK [include_role : add-build-sshkey] 2026-02-23 21:05:59.969396 | controller | ok 2026-02-23 21:05:59.981374 | 2026-02-23 21:05:59.981435 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-02-23 21:06:00.166508 | controller -> localhost | ok 2026-02-23 21:06:00.171424 | 2026-02-23 21:06:00.171484 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-02-23 21:06:00.189276 | controller | ok 2026-02-23 21:06:00.201617 | controller | included: /var/lib/zuul/builds/f613925b0b454ba2b6e3440fd4399eb0/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-23 21:06:00.206982 | 2026-02-23 21:06:00.207043 | TASK [add-build-sshkey : Create Temp SSH key] 2026-02-23 21:06:00.604505 | controller -> localhost | Generating public/private rsa key pair. 2026-02-23 21:06:00.604689 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/f613925b0b454ba2b6e3440fd4399eb0/work/f613925b0b454ba2b6e3440fd4399eb0_id_rsa. 2026-02-23 21:06:00.604726 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/f613925b0b454ba2b6e3440fd4399eb0/work/f613925b0b454ba2b6e3440fd4399eb0_id_rsa.pub. 2026-02-23 21:06:00.604749 | controller -> localhost | The key fingerprint is: 2026-02-23 21:06:00.604769 | controller -> localhost | SHA256:cPhZga/4NnwCC9EEZzJfmsGKPVVJ1ti3pPrRiBqPYRs zuul-build-sshkey 2026-02-23 21:06:00.604786 | controller -> localhost | The key's randomart image is: 2026-02-23 21:06:00.604803 | controller -> localhost | +---[RSA 3072]----+ 2026-02-23 21:06:00.604820 | controller -> localhost | | +o+o=*. | 2026-02-23 21:06:00.604838 | controller -> localhost | | *+B+ o.o | 2026-02-23 21:06:00.604856 | controller -> localhost | | o =* ...+ . | 2026-02-23 21:06:00.604874 | controller -> localhost | | . = .+ oo . | 2026-02-23 21:06:00.604891 | controller -> localhost | | o .S+ o | 2026-02-23 21:06:00.604907 | controller -> localhost | | . E + o . | 2026-02-23 21:06:00.604923 | controller -> localhost | | o & . . | 2026-02-23 21:06:00.604939 | controller -> localhost | | = B o | 2026-02-23 21:06:00.604955 | controller -> localhost | | . + | 2026-02-23 21:06:00.604970 | controller -> localhost | +----[SHA256]-----+ 2026-02-23 21:06:00.605011 | controller -> localhost | ok: Runtime: 0:00:00.093832 2026-02-23 21:06:00.610511 | 2026-02-23 21:06:00.610579 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-02-23 21:06:00.627812 | controller | ok 2026-02-23 21:06:00.636673 | controller | included: /var/lib/zuul/builds/f613925b0b454ba2b6e3440fd4399eb0/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-23 21:06:00.643864 | 2026-02-23 21:06:00.643927 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-02-23 21:06:00.656827 | controller | skipping: Conditional result was False 2026-02-23 21:06:00.661762 | 2026-02-23 21:06:00.661822 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-02-23 21:06:01.125754 | controller | changed 2026-02-23 21:06:01.130311 | 2026-02-23 21:06:01.130373 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-02-23 21:06:01.401140 | controller | ok 2026-02-23 21:06:01.405731 | 2026-02-23 21:06:01.405795 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-02-23 21:06:02.549980 | controller | changed 2026-02-23 21:06:02.554643 | 2026-02-23 21:06:02.554704 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-02-23 21:06:03.721760 | controller | changed 2026-02-23 21:06:03.726417 | 2026-02-23 21:06:03.726478 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-02-23 21:06:03.739603 | controller | skipping: Conditional result was False 2026-02-23 21:06:03.744667 | 2026-02-23 21:06:03.744733 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-02-23 21:06:04.050947 | controller -> localhost | changed 2026-02-23 21:06:04.060256 | 2026-02-23 21:06:04.060349 | TASK [add-build-sshkey : Add back temp key] 2026-02-23 21:06:04.275633 | controller -> localhost | Identity added: /var/lib/zuul/builds/f613925b0b454ba2b6e3440fd4399eb0/work/f613925b0b454ba2b6e3440fd4399eb0_id_rsa (zuul-build-sshkey) 2026-02-23 21:06:04.275774 | controller -> localhost | ok: Runtime: 0:00:00.006473 2026-02-23 21:06:04.280720 | 2026-02-23 21:06:04.280778 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-02-23 21:06:04.633587 | controller | ok 2026-02-23 21:06:04.637855 | 2026-02-23 21:06:04.637917 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-02-23 21:06:04.661757 | controller | skipping: Conditional result was False 2026-02-23 21:06:04.670681 | 2026-02-23 21:06:04.670744 | TASK [include_role : validate-host] 2026-02-23 21:06:04.688181 | controller | ok 2026-02-23 21:06:04.705352 | 2026-02-23 21:06:04.705422 | TASK [validate-host : Define zuul_info_dir fact] 2026-02-23 21:06:04.733217 | controller | ok 2026-02-23 21:06:04.737578 | 2026-02-23 21:06:04.737640 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-02-23 21:06:04.933931 | controller -> localhost | ok 2026-02-23 21:06:04.939239 | 2026-02-23 21:06:04.939322 | TASK [validate-host : Collect information about the host] 2026-02-23 21:06:05.656018 | controller | ok 2026-02-23 21:06:05.663561 | 2026-02-23 21:06:05.663618 | TASK [validate-host : Sanitize hostname] 2026-02-23 21:06:05.701290 | controller | ok 2026-02-23 21:06:05.705524 | 2026-02-23 21:06:05.705587 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-02-23 21:06:06.063177 | controller -> localhost | changed 2026-02-23 21:06:06.068960 | 2026-02-23 21:06:06.069043 | TASK [validate-host : Collect information about zuul worker] 2026-02-23 21:06:06.461695 | controller | ok 2026-02-23 21:06:06.466388 | 2026-02-23 21:06:06.466459 | TASK [validate-host : Write out all zuul information for each host] 2026-02-23 21:06:06.813949 | controller -> localhost | changed 2026-02-23 21:06:06.823466 | 2026-02-23 21:06:06.823545 | TASK [include_role : prepare-workspace-openshift] 2026-02-23 21:06:06.836718 | controller | skipping: Conditional result was False 2026-02-23 21:06:06.841403 | 2026-02-23 21:06:06.841468 | TASK [include_role : remove-zuul-sshkey] 2026-02-23 21:06:06.854661 | controller | skipping: Conditional result was False 2026-02-23 21:06:06.860068 | 2026-02-23 21:06:06.860143 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-02-23 21:06:07.124758 | controller | ok: "logs" 2026-02-23 21:06:07.124977 | controller | ok: All items complete 2026-02-23 21:06:07.125009 | 2026-02-23 21:06:07.360058 | controller | ok: "artifacts" 2026-02-23 21:06:07.595994 | controller | ok: "docs" 2026-02-23 21:06:07.610462 | 2026-02-23 21:06:07.610576 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-02-23 21:06:07.881791 | controller | changed: "logs" 2026-02-23 21:06:08.121507 | controller | changed: "artifacts" 2026-02-23 21:06:08.375909 | controller | changed: "docs" 2026-02-23 21:06:08.405616 | 2026-02-23 21:06:08.405751 | PLAY RECAP 2026-02-23 21:06:08.405818 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-23 21:06:08.405852 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-23 21:06:08.405876 | 2026-02-23 21:06:08.479538 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-23 21:06:08.480245 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-23 21:06:09.001251 | 2026-02-23 21:06:09.001421 | PLAY [all] 2026-02-23 21:06:09.020598 | 2026-02-23 21:06:09.020675 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-23 21:06:09.069425 | controller | ok 2026-02-23 21:06:09.074252 | 2026-02-23 21:06:09.074350 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-23 21:06:09.508991 | controller | changed 2026-02-23 21:06:09.514651 | 2026-02-23 21:06:09.514723 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-23 21:06:10.811097 | controller | changed 2026-02-23 21:06:10.821576 | 2026-02-23 21:06:10.821663 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2026-02-23 21:06:11.262008 | controller | changed: 2026-02-23 21:06:11.262460 | controller | { 2026-02-23 21:06:11.262502 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2026-02-23 21:06:11.262537 | controller | } 2026-02-23 21:06:11.563847 | controller | changed: 2026-02-23 21:06:11.563901 | controller | { 2026-02-23 21:06:11.563930 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2026-02-23 21:06:11.563952 | controller | } 2026-02-23 21:06:11.862717 | controller | changed: 2026-02-23 21:06:11.862871 | controller | { 2026-02-23 21:06:11.862909 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2026-02-23 21:06:11.862932 | controller | } 2026-02-23 21:06:12.163467 | controller | changed: 2026-02-23 21:06:12.163520 | controller | { 2026-02-23 21:06:12.163547 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2026-02-23 21:06:12.163567 | controller | } 2026-02-23 21:06:12.467921 | controller | changed: 2026-02-23 21:06:12.467975 | controller | { 2026-02-23 21:06:12.468000 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2026-02-23 21:06:12.468020 | controller | } 2026-02-23 21:06:12.776244 | controller | changed: 2026-02-23 21:06:12.776312 | controller | { 2026-02-23 21:06:12.776343 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2026-02-23 21:06:12.776364 | controller | } 2026-02-23 21:06:13.098414 | controller | changed: 2026-02-23 21:06:13.098467 | controller | { 2026-02-23 21:06:13.098495 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2026-02-23 21:06:13.098516 | controller | } 2026-02-23 21:06:13.402219 | controller | changed: 2026-02-23 21:06:13.402269 | controller | { 2026-02-23 21:06:13.402311 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2026-02-23 21:06:13.402338 | controller | } 2026-02-23 21:06:13.703334 | controller | changed: 2026-02-23 21:06:13.703411 | controller | { 2026-02-23 21:06:13.703439 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2026-02-23 21:06:13.703460 | controller | } 2026-02-23 21:06:14.006469 | controller | changed: 2026-02-23 21:06:14.006530 | controller | { 2026-02-23 21:06:14.006556 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2026-02-23 21:06:14.006576 | controller | } 2026-02-23 21:06:14.309287 | controller | changed: 2026-02-23 21:06:14.309355 | controller | { 2026-02-23 21:06:14.309382 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2026-02-23 21:06:14.309401 | controller | } 2026-02-23 21:06:14.611019 | controller | changed: 2026-02-23 21:06:14.611069 | controller | { 2026-02-23 21:06:14.611095 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2026-02-23 21:06:14.611125 | controller | } 2026-02-23 21:06:14.910929 | controller | changed: 2026-02-23 21:06:14.910988 | controller | { 2026-02-23 21:06:14.911013 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com" 2026-02-23 21:06:14.911033 | controller | } 2026-02-23 21:06:15.222389 | controller | changed: 2026-02-23 21:06:15.222440 | controller | { 2026-02-23 21:06:15.222466 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2026-02-23 21:06:15.222485 | controller | } 2026-02-23 21:06:15.520099 | controller | changed: 2026-02-23 21:06:15.520170 | controller | { 2026-02-23 21:06:15.520196 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2026-02-23 21:06:15.520215 | controller | } 2026-02-23 21:06:15.826154 | controller | changed: 2026-02-23 21:06:15.826387 | controller | { 2026-02-23 21:06:15.826431 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2026-02-23 21:06:15.826455 | controller | } 2026-02-23 21:06:16.139081 | controller | changed: 2026-02-23 21:06:16.139181 | controller | { 2026-02-23 21:06:16.139209 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2026-02-23 21:06:16.139230 | controller | } 2026-02-23 21:06:16.448419 | controller | changed: 2026-02-23 21:06:16.448509 | controller | { 2026-02-23 21:06:16.448535 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2026-02-23 21:06:16.448564 | controller | } 2026-02-23 21:06:16.753934 | controller | changed: 2026-02-23 21:06:16.754027 | controller | { 2026-02-23 21:06:16.754052 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2026-02-23 21:06:16.754071 | controller | } 2026-02-23 21:06:17.062778 | controller | changed: 2026-02-23 21:06:17.062862 | controller | { 2026-02-23 21:06:17.062889 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2026-02-23 21:06:17.062912 | controller | } 2026-02-23 21:06:17.367849 | controller | changed: 2026-02-23 21:06:17.367903 | controller | { 2026-02-23 21:06:17.367929 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2026-02-23 21:06:17.367948 | controller | } 2026-02-23 21:06:17.668620 | controller | changed: 2026-02-23 21:06:17.668670 | controller | { 2026-02-23 21:06:17.668695 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2026-02-23 21:06:17.668715 | controller | } 2026-02-23 21:06:17.984430 | controller | changed: 2026-02-23 21:06:17.984480 | controller | { 2026-02-23 21:06:17.984506 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2026-02-23 21:06:17.984527 | controller | } 2026-02-23 21:06:18.290992 | controller | changed: 2026-02-23 21:06:18.291043 | controller | { 2026-02-23 21:06:18.291068 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2026-02-23 21:06:18.291088 | controller | } 2026-02-23 21:06:18.598946 | controller | changed: 2026-02-23 21:06:18.599002 | controller | { 2026-02-23 21:06:18.599029 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2026-02-23 21:06:18.599048 | controller | } 2026-02-23 21:06:18.907927 | controller | changed: 2026-02-23 21:06:18.907988 | controller | { 2026-02-23 21:06:18.908022 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2026-02-23 21:06:18.908048 | controller | } 2026-02-23 21:06:18.933096 | 2026-02-23 21:06:18.933210 | TASK [Set timezone to UTC] 2026-02-23 21:06:19.430354 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2026-02-23 21:06:19.435021 | 2026-02-23 21:06:19.435083 | TASK [Create nodepool directory] 2026-02-23 21:06:19.728568 | controller | changed 2026-02-23 21:06:19.733669 | 2026-02-23 21:06:19.733731 | TASK [Create nodepool sub_nodes file] 2026-02-23 21:06:20.837192 | controller | changed 2026-02-23 21:06:20.842333 | 2026-02-23 21:06:20.842426 | TASK [Create nodepool sub_nodes_private file] 2026-02-23 21:06:21.876729 | controller | changed 2026-02-23 21:06:21.881954 | 2026-02-23 21:06:21.882033 | LOOP [Populate nodepool sub_nodes file] 2026-02-23 21:06:21.911698 | 2026-02-23 21:06:21.911846 | LOOP [Populate nodepool sub_nodes_private file] 2026-02-23 21:06:21.941145 | 2026-02-23 21:06:21.941274 | TASK [Create nodepool primary file] 2026-02-23 21:06:21.964837 | controller | skipping: Conditional result was False 2026-02-23 21:06:21.970161 | 2026-02-23 21:06:21.970237 | TASK [Create nodepool node_private for this node] 2026-02-23 21:06:23.085321 | controller | changed 2026-02-23 21:06:23.090659 | 2026-02-23 21:06:23.090723 | LOOP [Copy ssh keys to nodepool directory] 2026-02-23 21:06:23.482486 | controller | ok: Item: id_rsa Runtime: 0:00:00.004724 2026-02-23 21:06:23.482667 | 2026-02-23 21:06:23.733289 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.005440 2026-02-23 21:06:23.739926 | 2026-02-23 21:06:23.740039 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2026-02-23 21:06:24.880437 | controller | changed 2026-02-23 21:06:24.885574 | 2026-02-23 21:06:24.885654 | TASK [Validate sudoers config after edits] 2026-02-23 21:06:25.215855 | controller | /etc/sudoers: parsed OK 2026-02-23 21:06:25.215923 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2026-02-23 21:06:25.215933 | controller | /etc/sudoers.d/zuul: parsed OK 2026-02-23 21:06:25.215938 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2026-02-23 21:06:25.412695 | controller | ok: Runtime: 0:00:00.007014 2026-02-23 21:06:25.417772 | 2026-02-23 21:06:25.417837 | TASK [Show the environment passed in to job shell scripts] 2026-02-23 21:06:25.719648 | controller | SHELL=/bin/bash 2026-02-23 21:06:25.719792 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2026-02-23 21:06:25.719806 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2026-02-23 21:06:25.719814 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/04/3704/38a6f91dd2e65e5f7e79de23209bb1b345e24684 2026-02-23 21:06:25.719820 | controller | PWD=/home/zuul 2026-02-23 21:06:25.719826 | controller | ZUUL_PIPELINE=github-check 2026-02-23 21:06:25.719832 | controller | LOGNAME=zuul 2026-02-23 21:06:25.719838 | controller | XDG_SESSION_TYPE=tty 2026-02-23 21:06:25.719844 | controller | _=/usr/bin/env 2026-02-23 21:06:25.719849 | controller | MOTD_SHOWN=pam 2026-02-23 21:06:25.719854 | controller | HOME=/home/zuul 2026-02-23 21:06:25.719859 | controller | LANG=en_US.UTF-8 2026-02-23 21:06:25.719865 | controller | SSH_CONNECTION=192.168.26.12 39976 192.168.26.179 22 2026-02-23 21:06:25.719871 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2026-02-23 21:06:25.719880 | controller | ZUUL_CHANGE_IDS=3704,38a6f91dd2e65e5f7e79de23209bb1b345e24684 2026-02-23 21:06:25.719886 | controller | WORKSPACE=/home/zuul/workspace 2026-02-23 21:06:25.719891 | controller | XDG_SESSION_CLASS=user 2026-02-23 21:06:25.719898 | controller | SELINUX_ROLE_REQUESTED= 2026-02-23 21:06:25.719903 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2026-02-23 21:06:25.719908 | controller | USER=zuul 2026-02-23 21:06:25.719924 | controller | ZUUL_VOTING=True 2026-02-23 21:06:25.719930 | controller | BUILD_TIMEOUT=5400000 2026-02-23 21:06:25.719935 | controller | SELINUX_USE_CURRENT_RANGE= 2026-02-23 21:06:25.719940 | controller | SHLVL=1 2026-02-23 21:06:25.719945 | controller | ZUUL_PATCHSET=38a6f91dd2e65e5f7e79de23209bb1b345e24684 2026-02-23 21:06:25.719951 | controller | XDG_SESSION_ID=1 2026-02-23 21:06:25.719956 | controller | ZUUL_BRANCH=main 2026-02-23 21:06:25.719962 | controller | XDG_RUNTIME_DIR=/run/user/1000 2026-02-23 21:06:25.719968 | controller | SSH_CLIENT=192.168.26.12 39976 22 2026-02-23 21:06:25.719975 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2026-02-23 21:06:25.719981 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2026-02-23 21:06:25.719986 | controller | which_declare=declare -f 2026-02-23 21:06:25.719993 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2026-02-23 21:06:25.719999 | controller | SELINUX_LEVEL_REQUESTED= 2026-02-23 21:06:25.720005 | controller | ZUUL_CHANGE=3704 2026-02-23 21:06:25.720010 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2026-02-23 21:06:25.720015 | controller | ZUUL_UUID=f613925b0b454ba2b6e3440fd4399eb0 2026-02-23 21:06:25.720021 | controller | BASH_FUNC_which%%=() { ( alias; 2026-02-23 21:06:25.720027 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2026-02-23 21:06:25.720033 | controller | } 2026-02-23 21:06:25.945621 | controller | ok: Runtime: 0:00:00.008147 2026-02-23 21:06:25.951359 | 2026-02-23 21:06:25.951426 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2026-02-23 21:06:25.965505 | controller | skipping: Conditional result was False 2026-02-23 21:06:25.971389 | 2026-02-23 21:06:25.971454 | TASK [Symlink /home/zuul-worker/workspace] 2026-02-23 21:06:26.520381 | controller | skipping: Conditional result was False 2026-02-23 21:06:26.526276 | 2026-02-23 21:06:26.526365 | TASK [Ensure legacy workspace directory] 2026-02-23 21:06:26.808370 | controller | changed 2026-02-23 21:06:26.825979 | 2026-02-23 21:06:26.826033 | PLAY RECAP 2026-02-23 21:06:26.826078 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-23 21:06:26.826101 | 2026-02-23 21:06:26.894190 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-23 21:06:26.894909 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-23 21:06:27.395185 | 2026-02-23 21:06:27.395285 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2026-02-23 21:06:27.415208 | 2026-02-23 21:06:27.415281 | TASK [Create zuul-output directory] 2026-02-23 21:06:27.809545 | controller | changed 2026-02-23 21:06:27.814402 | 2026-02-23 21:06:27.814476 | TASK [Slurp Zuul inventory test] 2026-02-23 21:06:28.081555 | controller -> localhost | ok 2026-02-23 21:06:28.087422 | 2026-02-23 21:06:28.087488 | TASK [Save zuul inventory] 2026-02-23 21:06:29.424060 | controller | changed 2026-02-23 21:06:29.429417 | 2026-02-23 21:06:29.429481 | TASK [Save zuul vars without the change_message] 2026-02-23 21:06:30.634165 | controller | changed 2026-02-23 21:06:30.652149 | 2026-02-23 21:06:30.652216 | PLAY RECAP 2026-02-23 21:06:30.652260 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-23 21:06:30.652284 | 2026-02-23 21:06:30.715018 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-23 21:06:30.715724 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-23 21:06:31.253982 | 2026-02-23 21:06:31.254085 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2026-02-23 21:06:31.274708 | 2026-02-23 21:06:31.274780 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2026-02-23 21:06:31.293335 | controller | ok 2026-02-23 21:06:31.309860 | 2026-02-23 21:06:31.309941 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-23 21:06:31.336753 | controller | skipping: Conditional result was False 2026-02-23 21:06:31.342597 | 2026-02-23 21:06:31.342683 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-23 21:06:31.756844 | controller | ok 2026-02-23 21:06:31.762373 | 2026-02-23 21:06:31.762441 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-23 21:06:32.816233 | controller | ok 2026-02-23 21:06:32.825429 | 2026-02-23 21:06:32.825491 | TASK [Prepare workspace] 2026-02-23 21:06:32.843203 | controller | ok 2026-02-23 21:06:32.860511 | 2026-02-23 21:06:32.860582 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-02-23 21:06:33.234082 | controller | ok 2026-02-23 21:06:33.239668 | 2026-02-23 21:06:33.239739 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-02-23 21:06:35.677709 | controller | Output suppressed because no_log was given 2026-02-23 21:06:35.686684 | 2026-02-23 21:06:35.686749 | LOOP [Create zuul-output directory] 2026-02-23 21:06:35.973287 | controller | changed: "/home/zuul/ci-framework-data/logs" 2026-02-23 21:06:36.218664 | controller | ok: "/home/zuul/zuul-output/logs" 2026-02-23 21:06:36.234368 | 2026-02-23 21:06:36.234430 | TASK [Install required packages] 2026-02-23 21:07:01.062681 | controller | ok: Nothing to do 2026-02-23 21:07:01.067699 | 2026-02-23 21:07:01.067769 | TASK [Install venv] 2026-02-23 21:08:01.779217 | controller | changed 2026-02-23 21:08:01.801717 | 2026-02-23 21:08:01.801779 | PLAY RECAP 2026-02-23 21:08:01.801821 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-23 21:08:01.801845 | 2026-02-23 21:08:01.868908 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-23 21:08:01.869832 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-23 21:08:02.349758 | 2026-02-23 21:08:02.349846 | PLAY [Run ci/playbooks/molecule-test.yml] 2026-02-23 21:08:02.368648 | 2026-02-23 21:08:02.368717 | TASK [Gather required facts] 2026-02-23 21:08:02.895014 | controller | ok 2026-02-23 21:08:02.900208 | 2026-02-23 21:08:02.900282 | TASK [Load environment var if instructed to] 2026-02-23 21:08:02.924014 | controller | skipping: Conditional result was False 2026-02-23 21:08:02.929196 | 2026-02-23 21:08:02.929265 | TASK [Ensure group_vars dir exists] 2026-02-23 21:08:03.303373 | controller | ok 2026-02-23 21:08:03.307943 | 2026-02-23 21:08:03.308007 | TASK [Print related variables] 2026-02-23 21:08:03.336119 | controller | ok: 2026-02-23 21:08:03.336224 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2026-02-23 21:08:03.336251 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2026-02-23 21:08:03.340521 | 2026-02-23 21:08:03.340583 | TASK [Run molecule] 2026-02-23 21:08:04.356133 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2026-02-23 21:08:04.621694 | controller | INFO Performing prerun with role_name_check=0... 2026-02-23 21:08:21.991192 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:21.991531 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:21.991955 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:21.992315 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:21.992754 | controller | WARNING Another version of 'cifmw.general' 1.0.0+38a6f91d was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+38a6f91d (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:21.993162 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:21.993554 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:21.993961 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:21.994350 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:21.994759 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:21.995156 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:21.995533 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:21.995933 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:21.996326 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:21.996735 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-23 21:08:22.007409 | controller | INFO Running crc_layout > prepare 2026-02-23 21:08:22.661998 | controller | 2026-02-23 21:08:22.662047 | controller | PLAY [Prepare] ***************************************************************** 2026-02-23 21:08:22.662125 | controller | 2026-02-23 21:08:22.662212 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-23 21:08:22.662299 | controller | Monday 23 February 2026 21:08:22 +0000 (0:00:00.018) 0:00:00.018 ******* 2026-02-23 21:08:23.526302 | controller | ok: [instance] 2026-02-23 21:08:23.526410 | controller | 2026-02-23 21:08:23.526541 | controller | TASK [Create custom basedir] *************************************************** 2026-02-23 21:08:23.526626 | controller | Monday 23 February 2026 21:08:23 +0000 (0:00:00.865) 0:00:00.883 ******* 2026-02-23 21:08:23.837270 | controller | changed: [instance] 2026-02-23 21:08:23.837331 | controller | 2026-02-23 21:08:23.837455 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2026-02-23 21:08:23.837560 | controller | Monday 23 February 2026 21:08:23 +0000 (0:00:00.310) 0:00:01.194 ******* 2026-02-23 21:08:23.858251 | controller | skipping: [instance] 2026-02-23 21:08:23.858431 | controller | 2026-02-23 21:08:23.858597 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2026-02-23 21:08:23.858794 | controller | Monday 23 February 2026 21:08:23 +0000 (0:00:00.021) 0:00:01.216 ******* 2026-02-23 21:08:23.901765 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2026-02-23 21:08:23.901873 | controller | 2026-02-23 21:08:23.901982 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2026-02-23 21:08:23.902087 | controller | Monday 23 February 2026 21:08:23 +0000 (0:00:00.043) 0:00:01.259 ******* 2026-02-23 21:08:24.196633 | controller | ok: [instance] 2026-02-23 21:08:24.196691 | controller | 2026-02-23 21:08:24.196798 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2026-02-23 21:08:24.196892 | controller | Monday 23 February 2026 21:08:24 +0000 (0:00:00.294) 0:00:01.554 ******* 2026-02-23 21:08:24.415051 | controller | ok: [instance] 2026-02-23 21:08:24.415141 | controller | 2026-02-23 21:08:24.415157 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2026-02-23 21:08:24.415259 | controller | Monday 23 February 2026 21:08:24 +0000 (0:00:00.218) 0:00:01.772 ******* 2026-02-23 21:08:25.118738 | controller | ok: [instance] => (item=ubi-9-appstream) 2026-02-23 21:08:25.118784 | controller | ok: [instance] => (item=ubi-9-baseos) 2026-02-23 21:08:25.118896 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2026-02-23 21:08:25.118984 | controller | 2026-02-23 21:08:25.119077 | controller | TASK [Deploy repo-setup] ******************************************************* 2026-02-23 21:08:25.119162 | controller | Monday 23 February 2026 21:08:25 +0000 (0:00:00.703) 0:00:02.476 ******* 2026-02-23 21:08:25.182099 | controller | 2026-02-23 21:08:25.182247 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-23 21:08:25.182465 | controller | Monday 23 February 2026 21:08:25 +0000 (0:00:00.063) 0:00:02.539 ******* 2026-02-23 21:08:25.711154 | controller | changed: [instance] => (item=tmp) 2026-02-23 21:08:25.711198 | controller | changed: [instance] => (item=artifacts/repositories) 2026-02-23 21:08:25.711370 | controller | changed: [instance] => (item=venv/repo_setup) 2026-02-23 21:08:25.711468 | controller | 2026-02-23 21:08:25.711579 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-23 21:08:25.711696 | controller | Monday 23 February 2026 21:08:25 +0000 (0:00:00.529) 0:00:03.068 ******* 2026-02-23 21:08:26.548554 | controller | ok: [instance] 2026-02-23 21:08:26.548593 | controller | 2026-02-23 21:08:26.548750 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-23 21:08:26.548828 | controller | Monday 23 February 2026 21:08:26 +0000 (0:00:00.837) 0:00:03.905 ******* 2026-02-23 21:08:27.647883 | controller | changed: [instance] 2026-02-23 21:08:35.003757 | controller | 2026-02-23 21:08:35.003803 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-23 21:08:35.003811 | controller | Monday 23 February 2026 21:08:27 +0000 (0:00:01.099) 0:00:05.005 ******* 2026-02-23 21:08:35.003822 | controller | changed: [instance] 2026-02-23 21:08:35.671819 | controller | 2026-02-23 21:08:35.671862 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-23 21:08:35.671871 | controller | Monday 23 February 2026 21:08:35 +0000 (0:00:07.355) 0:00:12.360 ******* 2026-02-23 21:08:35.671883 | controller | changed: [instance] 2026-02-23 21:08:35.695533 | controller | 2026-02-23 21:08:35.695554 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-23 21:08:35.695563 | controller | Monday 23 February 2026 21:08:35 +0000 (0:00:00.668) 0:00:13.028 ******* 2026-02-23 21:08:35.695573 | controller | skipping: [instance] 2026-02-23 21:08:36.508216 | controller | 2026-02-23 21:08:36.508251 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-23 21:08:36.508259 | controller | Monday 23 February 2026 21:08:35 +0000 (0:00:00.024) 0:00:13.053 ******* 2026-02-23 21:08:36.508269 | controller | changed: [instance] 2026-02-23 21:08:36.545796 | controller | 2026-02-23 21:08:36.545846 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-23 21:08:36.545856 | controller | Monday 23 February 2026 21:08:36 +0000 (0:00:00.812) 0:00:13.865 ******* 2026-02-23 21:08:36.545869 | controller | skipping: [instance] 2026-02-23 21:08:36.583463 | controller | 2026-02-23 21:08:36.583491 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-23 21:08:36.583498 | controller | Monday 23 February 2026 21:08:36 +0000 (0:00:00.037) 0:00:13.903 ******* 2026-02-23 21:08:36.583509 | controller | skipping: [instance] 2026-02-23 21:08:36.621720 | controller | 2026-02-23 21:08:36.621751 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-23 21:08:36.621759 | controller | Monday 23 February 2026 21:08:36 +0000 (0:00:00.037) 0:00:13.940 ******* 2026-02-23 21:08:36.621768 | controller | skipping: [instance] 2026-02-23 21:08:37.164983 | controller | 2026-02-23 21:08:37.165020 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-23 21:08:37.165028 | controller | Monday 23 February 2026 21:08:36 +0000 (0:00:00.038) 0:00:13.979 ******* 2026-02-23 21:08:37.165039 | controller | changed: [instance] 2026-02-23 21:08:37.595825 | controller | 2026-02-23 21:08:37.595849 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-23 21:08:37.595857 | controller | Monday 23 February 2026 21:08:37 +0000 (0:00:00.542) 0:00:14.522 ******* 2026-02-23 21:08:37.595866 | controller | changed: [instance] 2026-02-23 21:08:37.627310 | controller | 2026-02-23 21:08:37.627330 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-23 21:08:37.627338 | controller | Monday 23 February 2026 21:08:37 +0000 (0:00:00.431) 0:00:14.953 ******* 2026-02-23 21:08:37.627346 | controller | skipping: [instance] 2026-02-23 21:08:37.694832 | controller | 2026-02-23 21:08:37.694873 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-23 21:08:37.694882 | controller | Monday 23 February 2026 21:08:37 +0000 (0:00:00.031) 0:00:14.984 ******* 2026-02-23 21:08:37.694899 | controller | skipping: [instance] 2026-02-23 21:08:37.726116 | controller | 2026-02-23 21:08:37.726153 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-23 21:08:37.726162 | controller | Monday 23 February 2026 21:08:37 +0000 (0:00:00.067) 0:00:15.052 ******* 2026-02-23 21:08:37.726171 | controller | skipping: [instance] 2026-02-23 21:08:37.764795 | controller | 2026-02-23 21:08:37.764821 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-23 21:08:37.764831 | controller | Monday 23 February 2026 21:08:37 +0000 (0:00:00.031) 0:00:15.083 ******* 2026-02-23 21:08:37.764842 | controller | ok: [instance] 2026-02-23 21:08:37.764870 | controller | 2026-02-23 21:08:37.764880 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-23 21:08:37.764969 | controller | Monday 23 February 2026 21:08:37 +0000 (0:00:00.039) 0:00:15.122 ******* 2026-02-23 21:08:37.792692 | controller | skipping: [instance] 2026-02-23 21:08:37.820122 | controller | 2026-02-23 21:08:37.820143 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-23 21:08:37.820152 | controller | Monday 23 February 2026 21:08:37 +0000 (0:00:00.027) 0:00:15.150 ******* 2026-02-23 21:08:37.820162 | controller | skipping: [instance] 2026-02-23 21:08:37.848341 | controller | 2026-02-23 21:08:37.848361 | controller | TASK [Download the RPM] ******************************************************** 2026-02-23 21:08:37.848370 | controller | Monday 23 February 2026 21:08:37 +0000 (0:00:00.027) 0:00:15.177 ******* 2026-02-23 21:08:37.848381 | controller | skipping: [instance] 2026-02-23 21:08:37.848532 | controller | 2026-02-23 21:08:37.848712 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-23 21:08:37.848868 | controller | Monday 23 February 2026 21:08:37 +0000 (0:00:00.028) 0:00:15.206 ******* 2026-02-23 21:08:37.876173 | controller | skipping: [instance] 2026-02-23 21:08:37.876338 | controller | 2026-02-23 21:08:37.876489 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-23 21:08:37.876611 | controller | Monday 23 February 2026 21:08:37 +0000 (0:00:00.027) 0:00:15.234 ******* 2026-02-23 21:08:37.902812 | controller | skipping: [instance] 2026-02-23 21:08:37.902978 | controller | 2026-02-23 21:08:37.903144 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-23 21:08:37.903293 | controller | Monday 23 February 2026 21:08:37 +0000 (0:00:00.026) 0:00:15.260 ******* 2026-02-23 21:08:37.933991 | controller | skipping: [instance] 2026-02-23 21:08:37.934186 | controller | 2026-02-23 21:08:37.934358 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-23 21:08:37.934518 | controller | Monday 23 February 2026 21:08:37 +0000 (0:00:00.031) 0:00:15.291 ******* 2026-02-23 21:08:37.961923 | controller | skipping: [instance] 2026-02-23 21:08:37.962117 | controller | 2026-02-23 21:08:37.962290 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-23 21:08:37.962450 | controller | Monday 23 February 2026 21:08:37 +0000 (0:00:00.027) 0:00:15.319 ******* 2026-02-23 21:08:38.150633 | controller | ok: [instance] 2026-02-23 21:08:38.150842 | controller | 2026-02-23 21:08:38.150996 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-23 21:08:38.151143 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.188) 0:00:15.508 ******* 2026-02-23 21:08:38.356167 | controller | changed: [instance] 2026-02-23 21:08:38.580524 | controller | 2026-02-23 21:08:38.580559 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-23 21:08:38.580568 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.204) 0:00:15.713 ******* 2026-02-23 21:08:38.580580 | controller | changed: [instance] 2026-02-23 21:08:38.601225 | controller | 2026-02-23 21:08:38.601250 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-23 21:08:38.601259 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.224) 0:00:15.937 ******* 2026-02-23 21:08:38.601270 | controller | skipping: [instance] 2026-02-23 21:08:38.621593 | controller | 2026-02-23 21:08:38.621616 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-23 21:08:38.621625 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.020) 0:00:15.958 ******* 2026-02-23 21:08:38.621641 | controller | skipping: [instance] 2026-02-23 21:08:38.621714 | controller | 2026-02-23 21:08:38.621729 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-23 21:08:38.621748 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.020) 0:00:15.979 ******* 2026-02-23 21:08:38.644310 | controller | skipping: [instance] 2026-02-23 21:08:38.666712 | controller | 2026-02-23 21:08:38.666730 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-23 21:08:38.666737 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.022) 0:00:16.001 ******* 2026-02-23 21:08:38.666746 | controller | skipping: [instance] 2026-02-23 21:08:38.667035 | controller | 2026-02-23 21:08:38.690121 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-23 21:08:38.690148 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.022) 0:00:16.024 ******* 2026-02-23 21:08:38.690160 | controller | skipping: [instance] 2026-02-23 21:08:38.713258 | controller | 2026-02-23 21:08:38.713281 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-23 21:08:38.713290 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.023) 0:00:16.047 ******* 2026-02-23 21:08:38.713304 | controller | skipping: [instance] 2026-02-23 21:08:38.731376 | controller | 2026-02-23 21:08:38.731398 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-23 21:08:38.731407 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.022) 0:00:16.070 ******* 2026-02-23 21:08:38.731418 | controller | skipping: [instance] 2026-02-23 21:08:38.731584 | controller | 2026-02-23 21:08:38.731790 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-23 21:08:38.731957 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.018) 0:00:16.089 ******* 2026-02-23 21:08:38.762060 | controller | skipping: [instance] 2026-02-23 21:08:38.762257 | controller | 2026-02-23 21:08:38.762426 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-23 21:08:38.762596 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.030) 0:00:16.119 ******* 2026-02-23 21:08:38.780063 | controller | skipping: [instance] 2026-02-23 21:08:38.780257 | controller | 2026-02-23 21:08:38.780434 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-23 21:08:38.780600 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.018) 0:00:16.138 ******* 2026-02-23 21:08:38.802640 | controller | skipping: [instance] 2026-02-23 21:08:38.802856 | controller | 2026-02-23 21:08:38.803041 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2026-02-23 21:08:38.803205 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.022) 0:00:16.160 ******* 2026-02-23 21:08:38.835828 | controller | skipping: [instance] 2026-02-23 21:08:38.836006 | controller | 2026-02-23 21:08:38.836193 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2026-02-23 21:08:38.836331 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.033) 0:00:16.193 ******* 2026-02-23 21:08:38.869512 | controller | skipping: [instance] 2026-02-23 21:08:38.869699 | controller | 2026-02-23 21:08:38.869864 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2026-02-23 21:08:38.870013 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.033) 0:00:16.227 ******* 2026-02-23 21:08:38.899957 | controller | skipping: [instance] 2026-02-23 21:08:38.900140 | controller | 2026-02-23 21:08:38.900296 | controller | TASK [test_deps : Install additional packages] ********************************* 2026-02-23 21:08:38.900428 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.030) 0:00:16.257 ******* 2026-02-23 21:08:38.929121 | controller | skipping: [instance] 2026-02-23 21:08:38.929289 | controller | 2026-02-23 21:08:38.929436 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2026-02-23 21:08:38.929565 | controller | Monday 23 February 2026 21:08:38 +0000 (0:00:00.029) 0:00:16.287 ******* 2026-02-23 21:09:34.282070 | controller | ok: [instance] 2026-02-23 21:09:35.448287 | controller | 2026-02-23 21:09:35.448311 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2026-02-23 21:09:35.448319 | controller | Monday 23 February 2026 21:09:34 +0000 (0:00:55.352) 0:01:11.639 ******* 2026-02-23 21:09:35.448328 | controller | ok: [instance] 2026-02-23 21:09:35.478862 | controller | 2026-02-23 21:09:35.478897 | controller | TASK [test_deps : Install extra packages] ************************************** 2026-02-23 21:09:35.478910 | controller | Monday 23 February 2026 21:09:35 +0000 (0:00:01.166) 0:01:12.805 ******* 2026-02-23 21:09:35.478927 | controller | skipping: [instance] 2026-02-23 21:09:35.519579 | controller | 2026-02-23 21:09:35.519596 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-23 21:09:35.519603 | controller | Monday 23 February 2026 21:09:35 +0000 (0:00:00.030) 0:01:12.836 ******* 2026-02-23 21:09:35.519612 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2026-02-23 21:09:35.536850 | controller | 2026-02-23 21:09:35.536890 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-23 21:09:35.536909 | controller | Monday 23 February 2026 21:09:35 +0000 (0:00:00.040) 0:01:12.876 ******* 2026-02-23 21:09:35.536925 | controller | ok: [instance] => 2026-02-23 21:09:35.536973 | controller | cifmw_ci_setup_packages: 2026-02-23 21:09:35.536983 | controller | - bash-completion 2026-02-23 21:09:35.536991 | controller | - ca-certificates 2026-02-23 21:09:35.536998 | controller | - git-core 2026-02-23 21:09:35.537006 | controller | - make 2026-02-23 21:09:35.537016 | controller | - tar 2026-02-23 21:09:35.537044 | controller | - tmux 2026-02-23 21:09:35.537053 | controller | - python3-pip 2026-02-23 21:09:35.537303 | controller | 2026-02-23 21:09:44.380454 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-23 21:09:44.380486 | controller | Monday 23 February 2026 21:09:35 +0000 (0:00:00.017) 0:01:12.894 ******* 2026-02-23 21:09:44.380498 | controller | changed: [instance] 2026-02-23 21:09:44.380579 | controller | 2026-02-23 21:09:44.380760 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-23 21:09:44.994501 | controller | Monday 23 February 2026 21:09:44 +0000 (0:00:08.843) 0:01:21.737 ******* 2026-02-23 21:09:44.994536 | controller | ok: [instance] 2026-02-23 21:09:44.994561 | controller | 2026-02-23 21:09:44.994694 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-23 21:09:44.994773 | controller | Monday 23 February 2026 21:09:44 +0000 (0:00:00.614) 0:01:22.352 ******* 2026-02-23 21:09:45.207275 | controller | changed: [instance] 2026-02-23 21:09:45.207327 | controller | 2026-02-23 21:09:45.207337 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-23 21:09:45.207420 | controller | Monday 23 February 2026 21:09:45 +0000 (0:00:00.212) 0:01:22.564 ******* 2026-02-23 21:09:51.137341 | controller | changed: [instance] 2026-02-23 21:09:51.171759 | controller | 2026-02-23 21:09:51.171810 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-23 21:09:51.171823 | controller | Monday 23 February 2026 21:09:51 +0000 (0:00:05.929) 0:01:28.494 ******* 2026-02-23 21:09:51.171839 | controller | ok: [instance] 2026-02-23 21:09:51.433723 | controller | 2026-02-23 21:09:51.433758 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-23 21:09:51.433766 | controller | Monday 23 February 2026 21:09:51 +0000 (0:00:00.034) 0:01:28.529 ******* 2026-02-23 21:09:51.433777 | controller | changed: [instance] 2026-02-23 21:09:51.694536 | controller | 2026-02-23 21:09:51.694555 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-23 21:09:51.694563 | controller | Monday 23 February 2026 21:09:51 +0000 (0:00:00.261) 0:01:28.790 ******* 2026-02-23 21:09:51.694572 | controller | changed: [instance] 2026-02-23 21:09:51.711598 | controller | 2026-02-23 21:09:51.711617 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-23 21:09:51.711625 | controller | Monday 23 February 2026 21:09:51 +0000 (0:00:00.261) 0:01:29.052 ******* 2026-02-23 21:09:51.711634 | controller | skipping: [instance] 2026-02-23 21:09:51.729635 | controller | 2026-02-23 21:09:51.729675 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-23 21:09:51.729688 | controller | Monday 23 February 2026 21:09:51 +0000 (0:00:00.017) 0:01:29.069 ******* 2026-02-23 21:09:51.729699 | controller | skipping: [instance] 2026-02-23 21:09:51.746789 | controller | 2026-02-23 21:09:51.746827 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-23 21:09:51.746837 | controller | Monday 23 February 2026 21:09:51 +0000 (0:00:00.017) 0:01:29.087 ******* 2026-02-23 21:09:51.746850 | controller | skipping: [instance] 2026-02-23 21:09:51.746879 | controller | 2026-02-23 21:09:51.747258 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-23 21:09:51.763253 | controller | Monday 23 February 2026 21:09:51 +0000 (0:00:00.017) 0:01:29.104 ******* 2026-02-23 21:09:51.763278 | controller | skipping: [instance] 2026-02-23 21:09:51.779741 | controller | 2026-02-23 21:09:51.779775 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-23 21:09:51.779792 | controller | Monday 23 February 2026 21:09:51 +0000 (0:00:00.016) 0:01:29.120 ******* 2026-02-23 21:09:51.779804 | controller | skipping: [instance] 2026-02-23 21:09:51.779833 | controller | 2026-02-23 21:09:51.780037 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-23 21:09:51.800789 | controller | Monday 23 February 2026 21:09:51 +0000 (0:00:00.016) 0:01:29.137 ******* 2026-02-23 21:09:51.800826 | controller | skipping: [instance] 2026-02-23 21:09:51.801091 | controller | 2026-02-23 21:09:51.801121 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-23 21:09:52.729623 | controller | Monday 23 February 2026 21:09:51 +0000 (0:00:00.020) 0:01:29.158 ******* 2026-02-23 21:09:52.729674 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2026-02-23 21:09:53.064240 | controller | changed: [instance] => (item=/opt/basedir/logs) 2026-02-23 21:09:53.064271 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2026-02-23 21:09:53.064279 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2026-02-23 21:09:53.064285 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2026-02-23 21:09:53.064290 | controller | 2026-02-23 21:09:53.064296 | controller | TASK [Create secret file] ****************************************************** 2026-02-23 21:09:53.064302 | controller | Monday 23 February 2026 21:09:52 +0000 (0:00:00.928) 0:01:30.086 ******* 2026-02-23 21:09:53.064317 | controller | changed: [instance] 2026-02-23 21:09:53.123984 | controller | 2026-02-23 21:09:53.124027 | controller | PLAY RECAP ********************************************************************* 2026-02-23 21:09:53.124037 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2026-02-23 21:09:53.124043 | controller | 2026-02-23 21:09:53.124049 | controller | Monday 23 February 2026 21:09:53 +0000 (0:00:00.332) 0:01:30.419 ******* 2026-02-23 21:09:53.124054 | controller | =============================================================================== 2026-02-23 21:09:53.124059 | controller | test_deps : Install selinux python libs -------------------------------- 55.35s 2026-02-23 21:09:53.124065 | controller | ci_setup : Install needed packages -------------------------------------- 8.84s 2026-02-23 21:09:53.124070 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.36s 2026-02-23 21:09:53.124075 | controller | ci_setup : Install openshift client ------------------------------------- 5.93s 2026-02-23 21:09:53.124080 | controller | test_deps : Install python yaml libs ------------------------------------ 1.17s 2026-02-23 21:09:53.124085 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.10s 2026-02-23 21:09:53.124091 | controller | ci_setup : Manage directories ------------------------------------------- 0.93s 2026-02-23 21:09:53.124096 | controller | Gathering Facts --------------------------------------------------------- 0.87s 2026-02-23 21:09:53.124101 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.84s 2026-02-23 21:09:53.124106 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.81s 2026-02-23 21:09:53.124112 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.70s 2026-02-23 21:09:53.124117 | controller | repo_setup : Install repo-setup package --------------------------------- 0.67s 2026-02-23 21:09:53.124122 | controller | ci_setup : Gather version of openshift client --------------------------- 0.61s 2026-02-23 21:09:53.124127 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.54s 2026-02-23 21:09:53.124132 | controller | repo_setup : Ensure directories are present ----------------------------- 0.53s 2026-02-23 21:09:53.124138 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.43s 2026-02-23 21:09:53.124143 | controller | Create secret file ------------------------------------------------------ 0.33s 2026-02-23 21:09:53.124148 | controller | Create custom basedir --------------------------------------------------- 0.31s 2026-02-23 21:09:53.124153 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.29s 2026-02-23 21:09:53.124164 | controller | ci_setup : Create completion file --------------------------------------- 0.26s 2026-02-23 21:09:53.124174 | controller | INFO Running crc_layout > converge 2026-02-23 21:09:53.700463 | controller | 2026-02-23 21:09:53.700741 | controller | PLAY [Converge] **************************************************************** 2026-02-23 21:09:53.700920 | controller | 2026-02-23 21:09:53.701062 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-23 21:09:53.701186 | controller | Monday 23 February 2026 21:09:53 +0000 (0:00:00.025) 0:00:00.025 ******* 2026-02-23 21:09:54.498185 | controller | ok: [instance] 2026-02-23 21:09:54.519746 | controller | 2026-02-23 21:09:54.519769 | controller | TASK [Load networking definition from scenario file] *************************** 2026-02-23 21:09:54.519778 | controller | Monday 23 February 2026 21:09:54 +0000 (0:00:00.797) 0:00:00.823 ******* 2026-02-23 21:09:54.519789 | controller | ok: [instance] 2026-02-23 21:09:56.023735 | controller | 2026-02-23 21:09:56.023766 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-23 21:09:56.023774 | controller | Monday 23 February 2026 21:09:54 +0000 (0:00:00.021) 0:00:00.845 ******* 2026-02-23 21:09:56.023784 | controller | changed: [instance] 2026-02-23 21:09:56.049765 | controller | 2026-02-23 21:09:56.049786 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-23 21:09:56.049801 | controller | Monday 23 February 2026 21:09:56 +0000 (0:00:01.503) 0:00:02.349 ******* 2026-02-23 21:09:56.049812 | controller | ok: [instance] 2026-02-23 21:09:56.049972 | controller | 2026-02-23 21:09:56.049990 | controller | TASK [reproducer : Load CI job environment] ************************************ 2026-02-23 21:09:56.070599 | controller | Monday 23 February 2026 21:09:56 +0000 (0:00:00.026) 0:00:02.375 ******* 2026-02-23 21:09:56.070621 | controller | skipping: [instance] 2026-02-23 21:09:56.119159 | controller | 2026-02-23 21:09:56.119181 | controller | TASK [Build final libvirt layout] ********************************************** 2026-02-23 21:09:56.119190 | controller | Monday 23 February 2026 21:09:56 +0000 (0:00:00.020) 0:00:02.396 ******* 2026-02-23 21:09:56.119200 | controller | 2026-02-23 21:09:56.196595 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2026-02-23 21:09:56.196617 | controller | Monday 23 February 2026 21:09:56 +0000 (0:00:00.048) 0:00:02.444 ******* 2026-02-23 21:09:56.196630 | controller | ok: [instance] 2026-02-23 21:09:56.261770 | controller | 2026-02-23 21:09:56.261793 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2026-02-23 21:09:56.261802 | controller | Monday 23 February 2026 21:09:56 +0000 (0:00:00.077) 0:00:02.521 ******* 2026-02-23 21:09:56.261813 | controller | skipping: [instance] 2026-02-23 21:09:56.261840 | controller | 2026-02-23 21:09:56.261850 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2026-02-23 21:09:56.261924 | controller | Monday 23 February 2026 21:09:56 +0000 (0:00:00.065) 0:00:02.587 ******* 2026-02-23 21:09:56.286082 | controller | ok: [instance] 2026-02-23 21:09:56.307403 | controller | 2026-02-23 21:09:56.307425 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2026-02-23 21:09:56.307433 | controller | Monday 23 February 2026 21:09:56 +0000 (0:00:00.024) 0:00:02.611 ******* 2026-02-23 21:09:56.307443 | controller | ok: [instance] => changed=false 2026-02-23 21:09:56.307603 | controller | msg: All assertions passed 2026-02-23 21:09:56.307772 | controller | 2026-02-23 21:09:56.307926 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2026-02-23 21:09:56.309183 | controller | Monday 23 February 2026 21:09:56 +0000 (0:00:00.021) 0:00:02.633 ******* 2026-02-23 21:09:56.349100 | controller | ok: [instance] 2026-02-23 21:09:56.349263 | controller | 2026-02-23 21:09:56.349415 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2026-02-23 21:09:56.349561 | controller | Monday 23 February 2026 21:09:56 +0000 (0:00:00.041) 0:00:02.674 ******* 2026-02-23 21:09:56.758742 | controller | ok: [instance] => (item=artifacts) 2026-02-23 21:09:56.758773 | controller | ok: [instance] => (item=logs) 2026-02-23 21:09:56.758781 | controller | 2026-02-23 21:09:56.758786 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2026-02-23 21:09:56.758800 | controller | Monday 23 February 2026 21:09:56 +0000 (0:00:00.409) 0:00:03.084 ******* 2026-02-23 21:09:56.831314 | controller | 2026-02-23 21:09:57.015627 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2026-02-23 21:09:57.015720 | controller | Monday 23 February 2026 21:09:56 +0000 (0:00:00.072) 0:00:03.156 ******* 2026-02-23 21:09:57.015739 | controller | ok: [instance] 2026-02-23 21:09:57.297087 | controller | 2026-02-23 21:09:57.297116 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2026-02-23 21:09:57.297124 | controller | Monday 23 February 2026 21:09:57 +0000 (0:00:00.183) 0:00:03.340 ******* 2026-02-23 21:09:57.297135 | controller | changed: [instance] 2026-02-23 21:09:57.583821 | controller | 2026-02-23 21:09:57.583863 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2026-02-23 21:09:57.583873 | controller | Monday 23 February 2026 21:09:57 +0000 (0:00:00.281) 0:00:03.622 ******* 2026-02-23 21:09:57.583886 | controller | ok: [instance] 2026-02-23 21:09:57.611727 | controller | 2026-02-23 21:09:57.611751 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2026-02-23 21:09:57.611759 | controller | Monday 23 February 2026 21:09:57 +0000 (0:00:00.286) 0:00:03.909 ******* 2026-02-23 21:09:57.611770 | controller | skipping: [instance] 2026-02-23 21:09:57.628397 | controller | 2026-02-23 21:09:57.628427 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2026-02-23 21:09:57.628436 | controller | Monday 23 February 2026 21:09:57 +0000 (0:00:00.028) 0:00:03.937 ******* 2026-02-23 21:09:57.628446 | controller | skipping: [instance] 2026-02-23 21:09:57.648453 | controller | 2026-02-23 21:09:57.648473 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2026-02-23 21:09:57.648480 | controller | Monday 23 February 2026 21:09:57 +0000 (0:00:00.016) 0:00:03.954 ******* 2026-02-23 21:09:57.648490 | controller | ok: [instance] 2026-02-23 21:09:57.674455 | controller | 2026-02-23 21:09:57.674475 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2026-02-23 21:09:57.674488 | controller | Monday 23 February 2026 21:09:57 +0000 (0:00:00.019) 0:00:03.973 ******* 2026-02-23 21:09:57.674497 | controller | skipping: [instance] 2026-02-23 21:10:05.720412 | controller | 2026-02-23 21:10:05.720441 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2026-02-23 21:10:05.720449 | controller | Monday 23 February 2026 21:09:57 +0000 (0:00:00.025) 0:00:03.999 ******* 2026-02-23 21:10:05.720460 | controller | changed: [instance] 2026-02-23 21:10:05.720485 | controller | 2026-02-23 21:10:05.720618 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2026-02-23 21:10:05.720650 | controller | Monday 23 February 2026 21:10:05 +0000 (0:00:08.045) 0:00:12.045 ******* 2026-02-23 21:10:05.932863 | controller | changed: [instance] 2026-02-23 21:10:05.933085 | controller | 2026-02-23 21:10:05.933118 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2026-02-23 21:10:06.423920 | controller | Monday 23 February 2026 21:10:05 +0000 (0:00:00.212) 0:00:12.258 ******* 2026-02-23 21:10:06.423958 | controller | changed: [instance] 2026-02-23 21:10:07.021211 | controller | 2026-02-23 21:10:07.021242 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2026-02-23 21:10:07.021249 | controller | Monday 23 February 2026 21:10:06 +0000 (0:00:00.490) 0:00:12.749 ******* 2026-02-23 21:10:07.021259 | controller | changed: [instance] 2026-02-23 21:10:07.210804 | controller | 2026-02-23 21:10:07.210833 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2026-02-23 21:10:07.210842 | controller | Monday 23 February 2026 21:10:07 +0000 (0:00:00.597) 0:00:13.346 ******* 2026-02-23 21:10:07.210853 | controller | ok: [instance] 2026-02-23 21:10:07.210880 | controller | 2026-02-23 21:10:07.210889 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2026-02-23 21:10:07.210943 | controller | Monday 23 February 2026 21:10:07 +0000 (0:00:00.189) 0:00:13.536 ******* 2026-02-23 21:10:07.823793 | controller | ok: [instance] 2026-02-23 21:10:08.568100 | controller | 2026-02-23 21:10:08.568132 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2026-02-23 21:10:08.568148 | controller | Monday 23 February 2026 21:10:07 +0000 (0:00:00.612) 0:00:14.149 ******* 2026-02-23 21:10:08.568158 | controller | changed: [instance] 2026-02-23 21:10:08.669820 | controller | 2026-02-23 21:10:08.669854 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2026-02-23 21:10:08.669864 | controller | Monday 23 February 2026 21:10:08 +0000 (0:00:00.744) 0:00:14.893 ******* 2026-02-23 21:10:08.669876 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2026-02-23 21:10:08.669905 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2026-02-23 21:10:08.669913 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2026-02-23 21:10:08.669920 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2026-02-23 21:10:08.669926 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2026-02-23 21:10:08.669932 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2026-02-23 21:10:08.669938 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2026-02-23 21:10:08.669946 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2026-02-23 21:10:08.670102 | controller | 2026-02-23 21:10:08.670125 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2026-02-23 21:10:08.976070 | controller | Monday 23 February 2026 21:10:08 +0000 (0:00:00.101) 0:00:14.994 ******* 2026-02-23 21:10:08.976106 | controller | ok: [instance] 2026-02-23 21:10:09.281549 | controller | 2026-02-23 21:10:09.281573 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2026-02-23 21:10:09.281581 | controller | Monday 23 February 2026 21:10:08 +0000 (0:00:00.306) 0:00:15.301 ******* 2026-02-23 21:10:09.281590 | controller | ok: [instance] 2026-02-23 21:10:09.583055 | controller | 2026-02-23 21:10:09.583077 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2026-02-23 21:10:09.583084 | controller | Monday 23 February 2026 21:10:09 +0000 (0:00:00.305) 0:00:15.607 ******* 2026-02-23 21:10:09.583094 | controller | ok: [instance] 2026-02-23 21:10:09.884018 | controller | 2026-02-23 21:10:09.884047 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2026-02-23 21:10:09.884055 | controller | Monday 23 February 2026 21:10:09 +0000 (0:00:00.301) 0:00:15.908 ******* 2026-02-23 21:10:09.884065 | controller | ok: [instance] 2026-02-23 21:10:10.188595 | controller | 2026-02-23 21:10:10.188618 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2026-02-23 21:10:10.188626 | controller | Monday 23 February 2026 21:10:09 +0000 (0:00:00.300) 0:00:16.209 ******* 2026-02-23 21:10:10.188634 | controller | ok: [instance] 2026-02-23 21:10:11.499446 | controller | 2026-02-23 21:10:11.499475 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2026-02-23 21:10:11.499483 | controller | Monday 23 February 2026 21:10:10 +0000 (0:00:00.304) 0:00:16.514 ******* 2026-02-23 21:10:11.499493 | controller | ok: [instance] 2026-02-23 21:10:11.800161 | controller | 2026-02-23 21:10:11.800189 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2026-02-23 21:10:11.800197 | controller | Monday 23 February 2026 21:10:11 +0000 (0:00:01.310) 0:00:17.824 ******* 2026-02-23 21:10:11.800213 | controller | ok: [instance] 2026-02-23 21:10:12.099467 | controller | 2026-02-23 21:10:12.099497 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2026-02-23 21:10:12.099504 | controller | Monday 23 February 2026 21:10:11 +0000 (0:00:00.300) 0:00:18.125 ******* 2026-02-23 21:10:12.099520 | controller | ok: [instance] 2026-02-23 21:10:12.405437 | controller | 2026-02-23 21:10:12.405468 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2026-02-23 21:10:12.405475 | controller | Monday 23 February 2026 21:10:12 +0000 (0:00:00.299) 0:00:18.424 ******* 2026-02-23 21:10:12.405485 | controller | ok: [instance] 2026-02-23 21:10:12.709024 | controller | 2026-02-23 21:10:12.709059 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2026-02-23 21:10:12.709067 | controller | Monday 23 February 2026 21:10:12 +0000 (0:00:00.305) 0:00:18.730 ******* 2026-02-23 21:10:12.709076 | controller | ok: [instance] 2026-02-23 21:10:13.007390 | controller | 2026-02-23 21:10:13.007415 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2026-02-23 21:10:13.007422 | controller | Monday 23 February 2026 21:10:12 +0000 (0:00:00.303) 0:00:19.034 ******* 2026-02-23 21:10:13.007432 | controller | ok: [instance] 2026-02-23 21:10:13.303536 | controller | 2026-02-23 21:10:13.303559 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2026-02-23 21:10:13.303566 | controller | Monday 23 February 2026 21:10:13 +0000 (0:00:00.298) 0:00:19.332 ******* 2026-02-23 21:10:13.303576 | controller | ok: [instance] 2026-02-23 21:10:13.599375 | controller | 2026-02-23 21:10:13.599404 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2026-02-23 21:10:13.599412 | controller | Monday 23 February 2026 21:10:13 +0000 (0:00:00.296) 0:00:19.629 ******* 2026-02-23 21:10:13.599422 | controller | ok: [instance] 2026-02-23 21:10:13.904799 | controller | 2026-02-23 21:10:13.904833 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2026-02-23 21:10:13.904842 | controller | Monday 23 February 2026 21:10:13 +0000 (0:00:00.295) 0:00:19.924 ******* 2026-02-23 21:10:13.904854 | controller | ok: [instance] 2026-02-23 21:10:13.904884 | controller | 2026-02-23 21:10:13.904894 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2026-02-23 21:10:13.905015 | controller | Monday 23 February 2026 21:10:13 +0000 (0:00:00.305) 0:00:20.230 ******* 2026-02-23 21:10:14.207115 | controller | ok: [instance] 2026-02-23 21:10:14.509757 | controller | 2026-02-23 21:10:14.509791 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2026-02-23 21:10:14.509800 | controller | Monday 23 February 2026 21:10:14 +0000 (0:00:00.302) 0:00:20.532 ******* 2026-02-23 21:10:14.509811 | controller | ok: [instance] 2026-02-23 21:10:14.807444 | controller | 2026-02-23 21:10:14.807479 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2026-02-23 21:10:14.807488 | controller | Monday 23 February 2026 21:10:14 +0000 (0:00:00.302) 0:00:20.835 ******* 2026-02-23 21:10:14.807497 | controller | ok: [instance] 2026-02-23 21:10:15.112075 | controller | 2026-02-23 21:10:15.112098 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2026-02-23 21:10:15.112106 | controller | Monday 23 February 2026 21:10:14 +0000 (0:00:00.297) 0:00:21.132 ******* 2026-02-23 21:10:15.112115 | controller | ok: [instance] 2026-02-23 21:10:15.414331 | controller | 2026-02-23 21:10:15.414352 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2026-02-23 21:10:15.414360 | controller | Monday 23 February 2026 21:10:15 +0000 (0:00:00.304) 0:00:21.437 ******* 2026-02-23 21:10:15.414368 | controller | ok: [instance] 2026-02-23 21:10:15.713467 | controller | 2026-02-23 21:10:15.713495 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2026-02-23 21:10:15.713502 | controller | Monday 23 February 2026 21:10:15 +0000 (0:00:00.302) 0:00:21.739 ******* 2026-02-23 21:10:15.713512 | controller | ok: [instance] 2026-02-23 21:10:16.019442 | controller | 2026-02-23 21:10:16.019467 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2026-02-23 21:10:16.019475 | controller | Monday 23 February 2026 21:10:15 +0000 (0:00:00.298) 0:00:22.038 ******* 2026-02-23 21:10:16.019485 | controller | ok: [instance] 2026-02-23 21:10:16.319730 | controller | 2026-02-23 21:10:16.319769 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2026-02-23 21:10:16.319777 | controller | Monday 23 February 2026 21:10:16 +0000 (0:00:00.306) 0:00:22.344 ******* 2026-02-23 21:10:16.319793 | controller | ok: [instance] 2026-02-23 21:10:16.319810 | controller | 2026-02-23 21:10:16.319816 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2026-02-23 21:10:16.319827 | controller | Monday 23 February 2026 21:10:16 +0000 (0:00:00.300) 0:00:22.645 ******* 2026-02-23 21:10:16.622696 | controller | ok: [instance] 2026-02-23 21:10:16.622780 | controller | 2026-02-23 21:10:16.622884 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2026-02-23 21:10:16.623023 | controller | Monday 23 February 2026 21:10:16 +0000 (0:00:00.303) 0:00:22.948 ******* 2026-02-23 21:10:16.923358 | controller | ok: [instance] 2026-02-23 21:10:16.942270 | controller | 2026-02-23 21:10:16.942287 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2026-02-23 21:10:16.942294 | controller | Monday 23 February 2026 21:10:16 +0000 (0:00:00.300) 0:00:23.248 ******* 2026-02-23 21:10:16.942303 | controller | skipping: [instance] 2026-02-23 21:10:17.206100 | controller | 2026-02-23 21:10:17.206119 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2026-02-23 21:10:17.206127 | controller | Monday 23 February 2026 21:10:16 +0000 (0:00:00.019) 0:00:23.267 ******* 2026-02-23 21:10:17.206136 | controller | ok: [instance] 2026-02-23 21:10:17.565396 | controller | 2026-02-23 21:10:17.565417 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2026-02-23 21:10:17.565425 | controller | Monday 23 February 2026 21:10:17 +0000 (0:00:00.263) 0:00:23.531 ******* 2026-02-23 21:10:17.565435 | controller | ok: [instance] 2026-02-23 21:10:17.856281 | controller | 2026-02-23 21:10:17.856313 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2026-02-23 21:10:17.856321 | controller | Monday 23 February 2026 21:10:17 +0000 (0:00:00.359) 0:00:23.890 ******* 2026-02-23 21:10:17.856332 | controller | changed: [instance] 2026-02-23 21:10:18.131021 | controller | 2026-02-23 21:10:18.131068 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2026-02-23 21:10:18.131078 | controller | Monday 23 February 2026 21:10:17 +0000 (0:00:00.290) 0:00:24.181 ******* 2026-02-23 21:10:18.131090 | controller | [WARNING]: Reset is not implemented for this connection 2026-02-23 21:10:18.140388 | controller | changed: [instance] 2026-02-23 21:10:18.210603 | controller | 2026-02-23 21:10:18.210623 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2026-02-23 21:10:18.210631 | controller | Monday 23 February 2026 21:10:18 +0000 (0:00:00.269) 0:00:24.451 ******* 2026-02-23 21:10:18.210637 | controller | 2026-02-23 21:10:18.210643 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2026-02-23 21:10:18.210648 | controller | Monday 23 February 2026 21:10:18 +0000 (0:00:00.014) 0:00:24.465 ******* 2026-02-23 21:10:18.210674 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2026-02-23 21:10:18.252004 | controller | 2026-02-23 21:10:18.252035 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2026-02-23 21:10:18.252066 | controller | Monday 23 February 2026 21:10:18 +0000 (0:00:00.070) 0:00:24.536 ******* 2026-02-23 21:10:18.252087 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2026-02-23 21:10:18.298607 | controller | 2026-02-23 21:10:18.298630 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-02-23 21:10:18.298640 | controller | Monday 23 February 2026 21:10:18 +0000 (0:00:00.041) 0:00:24.577 ******* 2026-02-23 21:10:18.298651 | controller | ok: [instance] => (item=compute) 2026-02-23 21:10:18.340653 | controller | ok: [instance] => (item=controller) 2026-02-23 21:10:18.340690 | controller | ok: [instance] => (item=crc) 2026-02-23 21:10:18.340697 | controller | 2026-02-23 21:10:18.340703 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-02-23 21:10:18.340708 | controller | Monday 23 February 2026 21:10:18 +0000 (0:00:00.046) 0:00:24.623 ******* 2026-02-23 21:10:18.340717 | controller | ok: [instance] 2026-02-23 21:10:18.402805 | controller | 2026-02-23 21:10:18.402828 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-02-23 21:10:18.402842 | controller | Monday 23 February 2026 21:10:18 +0000 (0:00:00.042) 0:00:24.666 ******* 2026-02-23 21:10:18.402852 | controller | ok: [instance] => changed=false 2026-02-23 21:10:18.444729 | controller | msg: All assertions passed 2026-02-23 21:10:18.444762 | controller | 2026-02-23 21:10:18.444775 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2026-02-23 21:10:18.444785 | controller | Monday 23 February 2026 21:10:18 +0000 (0:00:00.061) 0:00:24.727 ******* 2026-02-23 21:10:18.444801 | controller | 2026-02-23 21:10:18.444980 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2026-02-23 21:10:18.445130 | controller | Monday 23 February 2026 21:10:18 +0000 (0:00:00.042) 0:00:24.770 ******* 2026-02-23 21:10:18.522155 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.49', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2026-02-23 21:10:18.522338 | controller | ok: [instance] => (item={}) 2026-02-23 21:10:18.522481 | controller | 2026-02-23 21:10:18.522631 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2026-02-23 21:10:18.522802 | controller | Monday 23 February 2026 21:10:18 +0000 (0:00:00.077) 0:00:24.847 ******* 2026-02-23 21:10:18.540417 | controller | skipping: [instance] 2026-02-23 21:10:18.540721 | controller | 2026-02-23 21:10:18.541005 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2026-02-23 21:10:18.541275 | controller | Monday 23 February 2026 21:10:18 +0000 (0:00:00.018) 0:00:24.866 ******* 2026-02-23 21:10:18.756497 | controller | ok: [instance] 2026-02-23 21:10:19.085347 | controller | 2026-02-23 21:10:19.085377 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2026-02-23 21:10:19.085384 | controller | Monday 23 February 2026 21:10:18 +0000 (0:00:00.215) 0:00:25.081 ******* 2026-02-23 21:10:19.085394 | controller | changed: [instance] 2026-02-23 21:10:19.807761 | controller | 2026-02-23 21:10:19.807798 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2026-02-23 21:10:19.807808 | controller | Monday 23 February 2026 21:10:19 +0000 (0:00:00.328) 0:00:25.410 ******* 2026-02-23 21:10:19.807821 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2026-02-23 21:10:19.807860 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2026-02-23 21:10:19.807868 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2026-02-23 21:10:19.807875 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2026-02-23 21:10:19.807883 | controller | 2026-02-23 21:10:19.807988 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2026-02-23 21:10:19.808020 | controller | Monday 23 February 2026 21:10:19 +0000 (0:00:00.722) 0:00:26.133 ******* 2026-02-23 21:10:19.832155 | controller | skipping: [instance] 2026-02-23 21:10:20.175801 | controller | 2026-02-23 21:10:20.175841 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2026-02-23 21:10:20.175852 | controller | Monday 23 February 2026 21:10:19 +0000 (0:00:00.024) 0:00:26.157 ******* 2026-02-23 21:10:20.175867 | controller | changed: [instance] 2026-02-23 21:10:20.175900 | controller | 2026-02-23 21:10:20.175911 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2026-02-23 21:10:20.176206 | controller | Monday 23 February 2026 21:10:20 +0000 (0:00:00.335) 0:00:26.492 ******* 2026-02-23 21:10:20.176240 | controller | 2026-02-23 21:10:20.608023 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-23 21:10:20.608065 | controller | Monday 23 February 2026 21:10:20 +0000 (0:00:00.008) 0:00:26.501 ******* 2026-02-23 21:10:20.608085 | controller | changed: [instance] 2026-02-23 21:10:20.681654 | controller | 2026-02-23 21:10:20.681706 | controller | TASK [Ensure no default networks exists] *************************************** 2026-02-23 21:10:20.681716 | controller | Monday 23 February 2026 21:10:20 +0000 (0:00:00.432) 0:00:26.933 ******* 2026-02-23 21:10:20.681728 | controller | 2026-02-23 21:10:21.816814 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2026-02-23 21:10:21.816844 | controller | Monday 23 February 2026 21:10:20 +0000 (0:00:00.073) 0:00:27.007 ******* 2026-02-23 21:10:21.816856 | controller | ok: [instance] 2026-02-23 21:10:22.036586 | controller | 2026-02-23 21:10:22.036614 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2026-02-23 21:10:22.036622 | controller | Monday 23 February 2026 21:10:21 +0000 (0:00:01.134) 0:00:28.142 ******* 2026-02-23 21:10:22.036632 | controller | ok: [instance] 2026-02-23 21:10:22.513229 | controller | 2026-02-23 21:10:22.513260 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2026-02-23 21:10:22.513268 | controller | Monday 23 February 2026 21:10:22 +0000 (0:00:00.219) 0:00:28.362 ******* 2026-02-23 21:10:22.513279 | controller | ok: [instance] 2026-02-23 21:10:22.726193 | controller | 2026-02-23 21:10:22.726221 | controller | TASK [libvirt_manager : Removing default] ************************************** 2026-02-23 21:10:22.726229 | controller | Monday 23 February 2026 21:10:22 +0000 (0:00:00.476) 0:00:28.838 ******* 2026-02-23 21:10:22.726238 | controller | ok: [instance] 2026-02-23 21:10:23.864759 | controller | 2026-02-23 21:10:23.864784 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2026-02-23 21:10:23.864791 | controller | Monday 23 February 2026 21:10:22 +0000 (0:00:00.213) 0:00:29.051 ******* 2026-02-23 21:10:23.864800 | controller | ok: [instance] 2026-02-23 21:10:24.155155 | controller | 2026-02-23 21:10:24.155181 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2026-02-23 21:10:24.155189 | controller | Monday 23 February 2026 21:10:23 +0000 (0:00:01.138) 0:00:30.190 ******* 2026-02-23 21:10:24.155200 | controller | ok: [instance] 2026-02-23 21:10:24.446750 | controller | 2026-02-23 21:10:24.446785 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2026-02-23 21:10:24.446795 | controller | Monday 23 February 2026 21:10:24 +0000 (0:00:00.290) 0:00:30.480 ******* 2026-02-23 21:10:24.446806 | controller | changed: [instance] 2026-02-23 21:10:24.446829 | controller | 2026-02-23 21:10:24.446841 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2026-02-23 21:10:24.446849 | controller | Monday 23 February 2026 21:10:24 +0000 (0:00:00.291) 0:00:30.772 ******* 2026-02-23 21:10:24.733025 | controller | changed: [instance] 2026-02-23 21:10:26.270801 | controller | 2026-02-23 21:10:26.270830 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2026-02-23 21:10:26.270838 | controller | Monday 23 February 2026 21:10:24 +0000 (0:00:00.286) 0:00:31.058 ******* 2026-02-23 21:10:26.270848 | controller | changed: [instance] => (item=arptables) 2026-02-23 21:10:26.270876 | controller | changed: [instance] => (item=iptables) 2026-02-23 21:10:26.270883 | controller | changed: [instance] => (item=ip6tables) 2026-02-23 21:10:26.270887 | controller | 2026-02-23 21:10:26.270894 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2026-02-23 21:10:26.270978 | controller | Monday 23 February 2026 21:10:26 +0000 (0:00:01.537) 0:00:32.596 ******* 2026-02-23 21:10:26.570778 | controller | ok: [instance] 2026-02-23 21:10:26.570839 | controller | 2026-02-23 21:10:26.570851 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2026-02-23 21:10:26.570918 | controller | Monday 23 February 2026 21:10:26 +0000 (0:00:00.299) 0:00:32.896 ******* 2026-02-23 21:10:26.677708 | controller | ok: [instance] 2026-02-23 21:10:26.677796 | controller | 2026-02-23 21:10:26.677811 | controller | TASK [Ensure the required network configurations are applied] ****************** 2026-02-23 21:10:26.677819 | controller | Monday 23 February 2026 21:10:26 +0000 (0:00:00.106) 0:00:33.003 ******* 2026-02-23 21:10:26.736208 | controller | 2026-02-23 21:10:26.756713 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2026-02-23 21:10:26.756741 | controller | Monday 23 February 2026 21:10:26 +0000 (0:00:00.058) 0:00:33.062 ******* 2026-02-23 21:10:26.756753 | controller | skipping: [instance] 2026-02-23 21:10:26.757089 | controller | 2026-02-23 21:10:26.757110 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2026-02-23 21:10:26.776408 | controller | Monday 23 February 2026 21:10:26 +0000 (0:00:00.020) 0:00:33.082 ******* 2026-02-23 21:10:26.776431 | controller | skipping: [instance] 2026-02-23 21:10:26.797404 | controller | 2026-02-23 21:10:26.797421 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-23 21:10:26.797428 | controller | Monday 23 February 2026 21:10:26 +0000 (0:00:00.019) 0:00:33.101 ******* 2026-02-23 21:10:26.797436 | controller | skipping: [instance] 2026-02-23 21:10:26.823364 | controller | 2026-02-23 21:10:26.823394 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2026-02-23 21:10:26.823407 | controller | Monday 23 February 2026 21:10:26 +0000 (0:00:00.021) 0:00:33.123 ******* 2026-02-23 21:10:26.823422 | controller | skipping: [instance] 2026-02-23 21:10:26.857532 | controller | 2026-02-23 21:10:26.857555 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2026-02-23 21:10:26.857564 | controller | Monday 23 February 2026 21:10:26 +0000 (0:00:00.025) 0:00:33.148 ******* 2026-02-23 21:10:26.857574 | controller | ok: [instance] 2026-02-23 21:10:26.889187 | controller | 2026-02-23 21:10:26.889212 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2026-02-23 21:10:26.889219 | controller | Monday 23 February 2026 21:10:26 +0000 (0:00:00.034) 0:00:33.183 ******* 2026-02-23 21:10:26.889228 | controller | skipping: [instance] 2026-02-23 21:10:26.909268 | controller | 2026-02-23 21:10:26.909288 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2026-02-23 21:10:26.909297 | controller | Monday 23 February 2026 21:10:26 +0000 (0:00:00.031) 0:00:33.214 ******* 2026-02-23 21:10:26.909307 | controller | skipping: [instance] 2026-02-23 21:10:26.909458 | controller | 2026-02-23 21:10:26.909616 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2026-02-23 21:10:26.909790 | controller | Monday 23 February 2026 21:10:26 +0000 (0:00:00.020) 0:00:33.235 ******* 2026-02-23 21:10:26.960273 | controller | ok: [instance] 2026-02-23 21:10:26.960434 | controller | 2026-02-23 21:10:26.960587 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2026-02-23 21:10:26.960764 | controller | Monday 23 February 2026 21:10:26 +0000 (0:00:00.051) 0:00:33.286 ******* 2026-02-23 21:10:26.979965 | controller | skipping: [instance] 2026-02-23 21:10:26.980159 | controller | 2026-02-23 21:10:26.980325 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2026-02-23 21:10:26.980487 | controller | Monday 23 February 2026 21:10:26 +0000 (0:00:00.019) 0:00:33.305 ******* 2026-02-23 21:10:27.025231 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2026-02-23 21:10:27.025397 | controller | 2026-02-23 21:10:27.025549 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-23 21:10:27.025721 | controller | Monday 23 February 2026 21:10:27 +0000 (0:00:00.045) 0:00:33.351 ******* 2026-02-23 21:10:27.328182 | controller | ok: [instance -> localhost] 2026-02-23 21:10:32.406296 | controller | 2026-02-23 21:10:32.406327 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2026-02-23 21:10:32.406335 | controller | Monday 23 February 2026 21:10:27 +0000 (0:00:00.302) 0:00:33.653 ******* 2026-02-23 21:10:32.406345 | controller | changed: [instance -> localhost] 2026-02-23 21:10:32.621331 | controller | 2026-02-23 21:10:32.621360 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-23 21:10:32.621367 | controller | Monday 23 February 2026 21:10:32 +0000 (0:00:05.078) 0:00:38.731 ******* 2026-02-23 21:10:32.621376 | controller | changed: [instance] 2026-02-23 21:10:32.978781 | controller | 2026-02-23 21:10:32.978817 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2026-02-23 21:10:32.978826 | controller | Monday 23 February 2026 21:10:32 +0000 (0:00:00.215) 0:00:38.946 ******* 2026-02-23 21:10:32.978847 | controller | changed: [instance] 2026-02-23 21:10:34.573310 | controller | 2026-02-23 21:10:34.573348 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2026-02-23 21:10:34.573357 | controller | Monday 23 February 2026 21:10:32 +0000 (0:00:00.357) 0:00:39.304 ******* 2026-02-23 21:10:34.573368 | controller | changed: [instance -> localhost] 2026-02-23 21:10:34.926540 | controller | 2026-02-23 21:10:34.926569 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2026-02-23 21:10:34.926576 | controller | Monday 23 February 2026 21:10:34 +0000 (0:00:01.594) 0:00:40.898 ******* 2026-02-23 21:10:34.926586 | controller | changed: [instance] 2026-02-23 21:10:34.956836 | controller | 2026-02-23 21:10:34.956907 | controller | TASK [reproducer : Select right domain] **************************************** 2026-02-23 21:10:34.956917 | controller | Monday 23 February 2026 21:10:34 +0000 (0:00:00.353) 0:00:41.252 ******* 2026-02-23 21:10:34.956932 | controller | ok: [instance] 2026-02-23 21:10:34.956971 | controller | 2026-02-23 21:10:34.956980 | controller | TASK [Create the virtual networks] ********************************************* 2026-02-23 21:10:34.957005 | controller | Monday 23 February 2026 21:10:34 +0000 (0:00:00.030) 0:00:41.282 ******* 2026-02-23 21:10:35.089127 | controller | 2026-02-23 21:10:35.114753 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2026-02-23 21:10:35.114788 | controller | Monday 23 February 2026 21:10:35 +0000 (0:00:00.132) 0:00:41.414 ******* 2026-02-23 21:10:35.114800 | controller | ok: [instance] 2026-02-23 21:10:35.114827 | controller | 2026-02-23 21:10:35.115159 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2026-02-23 21:10:35.306162 | controller | Monday 23 February 2026 21:10:35 +0000 (0:00:00.025) 0:00:41.440 ******* 2026-02-23 21:10:35.306197 | controller | ok: [instance] 2026-02-23 21:10:35.336651 | controller | 2026-02-23 21:10:35.336698 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2026-02-23 21:10:35.336709 | controller | Monday 23 February 2026 21:10:35 +0000 (0:00:00.191) 0:00:41.631 ******* 2026-02-23 21:10:35.336721 | controller | skipping: [instance] 2026-02-23 21:10:35.375804 | controller | 2026-02-23 21:10:35.375834 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2026-02-23 21:10:35.375847 | controller | Monday 23 February 2026 21:10:35 +0000 (0:00:00.030) 0:00:41.662 ******* 2026-02-23 21:10:35.375861 | controller | skipping: [instance] 2026-02-23 21:10:35.376045 | controller | 2026-02-23 21:10:35.376184 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2026-02-23 21:10:35.376305 | controller | Monday 23 February 2026 21:10:35 +0000 (0:00:00.039) 0:00:41.701 ******* 2026-02-23 21:10:35.441014 | controller | ok: [instance] 2026-02-23 21:10:35.441194 | controller | 2026-02-23 21:10:35.441360 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2026-02-23 21:10:35.441509 | controller | Monday 23 February 2026 21:10:35 +0000 (0:00:00.065) 0:00:41.766 ******* 2026-02-23 21:10:35.569033 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-23 21:10:35.569331 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-23 21:10:35.569495 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-23 21:10:35.569606 | controller | 2026-02-23 21:10:35.569748 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2026-02-23 21:10:35.569872 | controller | Monday 23 February 2026 21:10:35 +0000 (0:00:00.127) 0:00:41.894 ******* 2026-02-23 21:10:35.605631 | controller | skipping: [instance] 2026-02-23 21:10:35.605796 | controller | 2026-02-23 21:10:35.605926 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2026-02-23 21:10:35.606045 | controller | Monday 23 February 2026 21:10:35 +0000 (0:00:00.036) 0:00:41.931 ******* 2026-02-23 21:10:35.968891 | controller | changed: [instance] 2026-02-23 21:10:36.060642 | controller | 2026-02-23 21:10:36.060693 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2026-02-23 21:10:36.060701 | controller | Monday 23 February 2026 21:10:35 +0000 (0:00:00.362) 0:00:42.294 ******* 2026-02-23 21:10:36.060722 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2026-02-23 21:10:36.113306 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2026-02-23 21:10:36.113332 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2026-02-23 21:10:36.113340 | controller | 2026-02-23 21:10:36.113346 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-23 21:10:36.113351 | controller | Monday 23 February 2026 21:10:36 +0000 (0:00:00.091) 0:00:42.385 ******* 2026-02-23 21:10:36.113360 | controller | changed: [instance] 2026-02-23 21:10:36.433654 | controller | 2026-02-23 21:10:36.433719 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-23 21:10:36.433730 | controller | Monday 23 February 2026 21:10:36 +0000 (0:00:00.052) 0:00:42.438 ******* 2026-02-23 21:10:36.433743 | controller | changed: [instance] 2026-02-23 21:10:36.665517 | controller | 2026-02-23 21:10:36.665541 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-23 21:10:36.665549 | controller | Monday 23 February 2026 21:10:36 +0000 (0:00:00.320) 0:00:42.758 ******* 2026-02-23 21:10:36.665559 | controller | changed: [instance] 2026-02-23 21:10:36.717870 | controller | 2026-02-23 21:10:36.717919 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-23 21:10:36.717933 | controller | Monday 23 February 2026 21:10:36 +0000 (0:00:00.231) 0:00:42.990 ******* 2026-02-23 21:10:36.717952 | controller | changed: [instance] 2026-02-23 21:10:36.948799 | controller | 2026-02-23 21:10:36.948833 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-23 21:10:36.948843 | controller | Monday 23 February 2026 21:10:36 +0000 (0:00:00.052) 0:00:43.043 ******* 2026-02-23 21:10:36.948854 | controller | changed: [instance] 2026-02-23 21:10:36.948882 | controller | 2026-02-23 21:10:36.948891 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-23 21:10:36.948984 | controller | Monday 23 February 2026 21:10:36 +0000 (0:00:00.231) 0:00:43.274 ******* 2026-02-23 21:10:37.156507 | controller | changed: [instance] 2026-02-23 21:10:37.207510 | controller | 2026-02-23 21:10:37.207528 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-23 21:10:37.207535 | controller | Monday 23 February 2026 21:10:37 +0000 (0:00:00.207) 0:00:43.481 ******* 2026-02-23 21:10:37.207544 | controller | changed: [instance] 2026-02-23 21:10:37.398706 | controller | 2026-02-23 21:10:37.398725 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-23 21:10:37.398732 | controller | Monday 23 February 2026 21:10:37 +0000 (0:00:00.050) 0:00:43.532 ******* 2026-02-23 21:10:37.398741 | controller | changed: [instance] 2026-02-23 21:10:37.399022 | controller | 2026-02-23 21:10:37.605143 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-23 21:10:37.605164 | controller | Monday 23 February 2026 21:10:37 +0000 (0:00:00.191) 0:00:43.724 ******* 2026-02-23 21:10:37.605174 | controller | changed: [instance] 2026-02-23 21:10:37.793720 | controller | 2026-02-23 21:10:37.793759 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2026-02-23 21:10:37.793769 | controller | Monday 23 February 2026 21:10:37 +0000 (0:00:00.206) 0:00:43.930 ******* 2026-02-23 21:10:37.793783 | controller | ok: [instance] 2026-02-23 21:10:38.279731 | controller | 2026-02-23 21:10:38.279752 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2026-02-23 21:10:38.279759 | controller | Monday 23 February 2026 21:10:37 +0000 (0:00:00.188) 0:00:44.119 ******* 2026-02-23 21:10:38.279771 | controller | changed: [instance] 2026-02-23 21:10:38.457373 | controller | 2026-02-23 21:10:38.457413 | controller | TASK [libvirt_manager : Remove ini file after conversion] ********************** 2026-02-23 21:10:38.457423 | controller | Monday 23 February 2026 21:10:38 +0000 (0:00:00.486) 0:00:44.605 ******* 2026-02-23 21:10:38.457442 | controller | changed: [instance] 2026-02-23 21:10:38.481450 | controller | 2026-02-23 21:10:38.481473 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-23 21:10:38.481481 | controller | Monday 23 February 2026 21:10:38 +0000 (0:00:00.177) 0:00:44.782 ******* 2026-02-23 21:10:38.481492 | controller | skipping: [instance] 2026-02-23 21:10:38.505809 | controller | 2026-02-23 21:10:38.505841 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-23 21:10:38.505856 | controller | Monday 23 February 2026 21:10:38 +0000 (0:00:00.024) 0:00:44.806 ******* 2026-02-23 21:10:38.505867 | controller | skipping: [instance] 2026-02-23 21:10:38.505931 | controller | 2026-02-23 21:10:38.505950 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-23 21:10:38.505961 | controller | Monday 23 February 2026 21:10:38 +0000 (0:00:00.024) 0:00:44.831 ******* 2026-02-23 21:10:38.528146 | controller | skipping: [instance] 2026-02-23 21:10:38.550756 | controller | 2026-02-23 21:10:38.550786 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-23 21:10:38.550796 | controller | Monday 23 February 2026 21:10:38 +0000 (0:00:00.022) 0:00:44.853 ******* 2026-02-23 21:10:38.550807 | controller | skipping: [instance] 2026-02-23 21:10:38.550853 | controller | 2026-02-23 21:10:38.550873 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-23 21:10:38.550998 | controller | Monday 23 February 2026 21:10:38 +0000 (0:00:00.022) 0:00:44.876 ******* 2026-02-23 21:10:38.569783 | controller | ok: [instance] 2026-02-23 21:10:38.569944 | controller | 2026-02-23 21:10:38.570098 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-23 21:10:38.570221 | controller | Monday 23 February 2026 21:10:38 +0000 (0:00:00.019) 0:00:44.895 ******* 2026-02-23 21:10:38.650494 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-23 21:10:38.650691 | controller | 2026-02-23 21:10:38.650869 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-23 21:10:38.651021 | controller | Monday 23 February 2026 21:10:38 +0000 (0:00:00.080) 0:00:44.976 ******* 2026-02-23 21:10:38.669348 | controller | skipping: [instance] 2026-02-23 21:10:38.669524 | controller | 2026-02-23 21:10:38.669728 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-23 21:10:38.669899 | controller | Monday 23 February 2026 21:10:38 +0000 (0:00:00.018) 0:00:44.995 ******* 2026-02-23 21:10:38.868559 | controller | changed: [instance] 2026-02-23 21:10:39.248434 | controller | 2026-02-23 21:10:39.248464 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-23 21:10:39.248471 | controller | Monday 23 February 2026 21:10:38 +0000 (0:00:00.198) 0:00:45.194 ******* 2026-02-23 21:10:39.248480 | controller | changed: [instance] 2026-02-23 21:10:39.303059 | controller | 2026-02-23 21:10:39.303109 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-23 21:10:39.303122 | controller | Monday 23 February 2026 21:10:39 +0000 (0:00:00.379) 0:00:45.573 ******* 2026-02-23 21:10:39.303137 | controller | ok: [instance] 2026-02-23 21:10:39.332733 | controller | 2026-02-23 21:10:39.332756 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-23 21:10:39.332765 | controller | Monday 23 February 2026 21:10:39 +0000 (0:00:00.054) 0:00:45.628 ******* 2026-02-23 21:10:39.332776 | controller | ok: [instance] 2026-02-23 21:10:39.701178 | controller | 2026-02-23 21:10:39.701196 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-23 21:10:39.701204 | controller | Monday 23 February 2026 21:10:39 +0000 (0:00:00.029) 0:00:45.658 ******* 2026-02-23 21:10:39.701213 | controller | changed: [instance] 2026-02-23 21:10:39.786184 | controller | 2026-02-23 21:10:39.786201 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2026-02-23 21:10:39.786208 | controller | Monday 23 February 2026 21:10:39 +0000 (0:00:00.368) 0:00:46.026 ******* 2026-02-23 21:10:39.786216 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2026-02-23 21:10:39.875695 | controller | 2026-02-23 21:10:39.875712 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2026-02-23 21:10:39.875719 | controller | Monday 23 February 2026 21:10:39 +0000 (0:00:00.085) 0:00:46.111 ******* 2026-02-23 21:10:39.875727 | controller | ok: [instance] => (item=public) 2026-02-23 21:10:40.293643 | controller | ok: [instance] => (item=osp_trunk) 2026-02-23 21:10:40.293687 | controller | 2026-02-23 21:10:40.293695 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2026-02-23 21:10:40.293701 | controller | Monday 23 February 2026 21:10:39 +0000 (0:00:00.089) 0:00:46.200 ******* 2026-02-23 21:10:40.293710 | controller | changed: [instance] => (item=cifmw-public) 2026-02-23 21:10:40.860735 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-23 21:10:40.860777 | controller | 2026-02-23 21:10:40.860788 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2026-02-23 21:10:40.860795 | controller | Monday 23 February 2026 21:10:40 +0000 (0:00:00.417) 0:00:46.618 ******* 2026-02-23 21:10:40.860808 | controller | ok: [instance] => (item=cifmw-public) 2026-02-23 21:10:40.861125 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-23 21:10:40.861161 | controller | 2026-02-23 21:10:41.276470 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2026-02-23 21:10:41.276499 | controller | Monday 23 February 2026 21:10:40 +0000 (0:00:00.567) 0:00:47.186 ******* 2026-02-23 21:10:41.276517 | controller | ok: [instance] => (item=cifmw-public) 2026-02-23 21:10:41.687705 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-23 21:10:41.687739 | controller | 2026-02-23 21:10:41.687747 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2026-02-23 21:10:41.687754 | controller | Monday 23 February 2026 21:10:41 +0000 (0:00:00.415) 0:00:47.601 ******* 2026-02-23 21:10:41.687765 | controller | changed: [instance] => (item=cifmw-public) 2026-02-23 21:10:41.742736 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-23 21:10:41.742778 | controller | 2026-02-23 21:10:41.742791 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2026-02-23 21:10:41.742802 | controller | Monday 23 February 2026 21:10:41 +0000 (0:00:00.411) 0:00:48.012 ******* 2026-02-23 21:10:41.742817 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2026-02-23 21:10:41.918240 | controller | 2026-02-23 21:10:41.918269 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2026-02-23 21:10:41.918278 | controller | Monday 23 February 2026 21:10:41 +0000 (0:00:00.055) 0:00:48.067 ******* 2026-02-23 21:10:41.918289 | controller | ok: [instance] 2026-02-23 21:10:42.277750 | controller | 2026-02-23 21:10:42.277773 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2026-02-23 21:10:42.277781 | controller | Monday 23 February 2026 21:10:41 +0000 (0:00:00.175) 0:00:48.243 ******* 2026-02-23 21:10:42.277790 | controller | ok: [instance] => (item=cifmw-public) 2026-02-23 21:10:42.342323 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-23 21:10:42.342340 | controller | 2026-02-23 21:10:42.342347 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2026-02-23 21:10:42.342353 | controller | Monday 23 February 2026 21:10:42 +0000 (0:00:00.359) 0:00:48.602 ******* 2026-02-23 21:10:42.342361 | controller | 2026-02-23 21:10:42.375887 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-23 21:10:42.375919 | controller | Monday 23 February 2026 21:10:42 +0000 (0:00:00.064) 0:00:48.667 ******* 2026-02-23 21:10:42.375938 | controller | skipping: [instance] 2026-02-23 21:10:43.560186 | controller | 2026-02-23 21:10:43.560211 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2026-02-23 21:10:43.560219 | controller | Monday 23 February 2026 21:10:42 +0000 (0:00:00.033) 0:00:48.701 ******* 2026-02-23 21:10:43.560228 | controller | ok: [instance] 2026-02-23 21:10:43.739710 | controller | 2026-02-23 21:10:43.739735 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-23 21:10:43.739744 | controller | Monday 23 February 2026 21:10:43 +0000 (0:00:01.184) 0:00:49.885 ******* 2026-02-23 21:10:43.739756 | controller | ok: [instance] 2026-02-23 21:10:43.739935 | controller | 2026-02-23 21:10:43.740116 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2026-02-23 21:10:43.740278 | controller | Monday 23 February 2026 21:10:43 +0000 (0:00:00.179) 0:00:50.065 ******* 2026-02-23 21:10:44.098777 | controller | changed: [instance] 2026-02-23 21:10:45.759808 | controller | 2026-02-23 21:10:45.759859 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2026-02-23 21:10:45.759871 | controller | Monday 23 February 2026 21:10:44 +0000 (0:00:00.358) 0:00:50.423 ******* 2026-02-23 21:10:45.759885 | controller | changed: [instance] 2026-02-23 21:10:45.759924 | controller | 2026-02-23 21:10:45.759936 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2026-02-23 21:10:46.121738 | controller | Monday 23 February 2026 21:10:45 +0000 (0:00:01.661) 0:00:52.085 ******* 2026-02-23 21:10:46.121792 | controller | changed: [instance] 2026-02-23 21:10:46.121902 | controller | 2026-02-23 21:10:46.121926 | controller | TASK [Create extra network configuration] ************************************** 2026-02-23 21:10:46.122026 | controller | Monday 23 February 2026 21:10:46 +0000 (0:00:00.362) 0:00:52.447 ******* 2026-02-23 21:10:46.152920 | controller | skipping: [instance] 2026-02-23 21:10:46.153466 | controller | 2026-02-23 21:10:46.153697 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2026-02-23 21:10:46.189621 | controller | Monday 23 February 2026 21:10:46 +0000 (0:00:00.031) 0:00:52.478 ******* 2026-02-23 21:10:46.189645 | controller | skipping: [instance] 2026-02-23 21:10:46.654822 | controller | 2026-02-23 21:10:46.654860 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2026-02-23 21:10:46.654870 | controller | Monday 23 February 2026 21:10:46 +0000 (0:00:00.036) 0:00:52.515 ******* 2026-02-23 21:10:46.654882 | controller | ok: [instance] 2026-02-23 21:10:46.655004 | controller | 2026-02-23 21:10:46.655037 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2026-02-23 21:10:46.655056 | controller | Monday 23 February 2026 21:10:46 +0000 (0:00:00.464) 0:00:52.980 ******* 2026-02-23 21:10:46.797640 | controller | ok: [instance] => (item=cifmw-public) 2026-02-23 21:10:47.974129 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-23 21:10:47.974151 | controller | 2026-02-23 21:10:47.974158 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2026-02-23 21:10:47.974169 | controller | Monday 23 February 2026 21:10:46 +0000 (0:00:00.142) 0:00:53.122 ******* 2026-02-23 21:10:47.974178 | controller | ok: [instance] 2026-02-23 21:10:51.568775 | controller | 2026-02-23 21:10:51.568811 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2026-02-23 21:10:51.568821 | controller | Monday 23 February 2026 21:10:47 +0000 (0:00:01.176) 0:00:54.299 ******* 2026-02-23 21:10:51.568834 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2026-02-23 21:10:51.568860 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2026-02-23 21:10:51.568867 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2026-02-23 21:10:51.568876 | controller | 2026-02-23 21:10:51.568964 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2026-02-23 21:10:51.568982 | controller | Monday 23 February 2026 21:10:51 +0000 (0:00:03.594) 0:00:57.893 ******* 2026-02-23 21:10:51.786106 | controller | changed: [instance] 2026-02-23 21:10:52.135782 | controller | 2026-02-23 21:10:52.135815 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2026-02-23 21:10:52.135824 | controller | Monday 23 February 2026 21:10:51 +0000 (0:00:00.217) 0:00:58.111 ******* 2026-02-23 21:10:52.135836 | controller | changed: [instance] 2026-02-23 21:10:52.135862 | controller | 2026-02-23 21:10:52.135871 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2026-02-23 21:10:52.509191 | controller | Monday 23 February 2026 21:10:52 +0000 (0:00:00.349) 0:00:58.461 ******* 2026-02-23 21:10:52.509223 | controller | changed: [instance] 2026-02-23 21:10:52.541810 | controller | 2026-02-23 21:10:52.541832 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2026-02-23 21:10:52.541841 | controller | Monday 23 February 2026 21:10:52 +0000 (0:00:00.373) 0:00:58.834 ******* 2026-02-23 21:10:52.541852 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2026-02-23 21:10:52.542020 | controller | 2026-02-23 21:10:52.542040 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2026-02-23 21:10:52.953595 | controller | Monday 23 February 2026 21:10:52 +0000 (0:00:00.032) 0:00:58.867 ******* 2026-02-23 21:10:52.953626 | controller | changed: [instance] 2026-02-23 21:10:52.975245 | controller | 2026-02-23 21:10:52.975267 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2026-02-23 21:10:52.975276 | controller | Monday 23 February 2026 21:10:52 +0000 (0:00:00.411) 0:00:59.279 ******* 2026-02-23 21:10:52.975286 | controller | skipping: [instance] 2026-02-23 21:10:53.010419 | controller | 2026-02-23 21:10:53.010436 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2026-02-23 21:10:53.010443 | controller | Monday 23 February 2026 21:10:52 +0000 (0:00:00.021) 0:00:59.300 ******* 2026-02-23 21:10:53.010451 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2026-02-23 21:10:53.370715 | controller | 2026-02-23 21:10:53.370742 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2026-02-23 21:10:53.370750 | controller | Monday 23 February 2026 21:10:53 +0000 (0:00:00.034) 0:00:59.335 ******* 2026-02-23 21:10:53.370759 | controller | changed: [instance] 2026-02-23 21:10:53.370779 | controller | 2026-02-23 21:10:53.370786 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2026-02-23 21:10:53.370849 | controller | Monday 23 February 2026 21:10:53 +0000 (0:00:00.360) 0:00:59.696 ******* 2026-02-23 21:10:53.390472 | controller | skipping: [instance] 2026-02-23 21:10:53.595989 | controller | 2026-02-23 21:10:53.596009 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2026-02-23 21:10:53.596016 | controller | Monday 23 February 2026 21:10:53 +0000 (0:00:00.019) 0:00:59.716 ******* 2026-02-23 21:10:53.596025 | controller | ok: [instance] => (item=127.0.0.2) 2026-02-23 21:10:54.244240 | controller | 2026-02-23 21:10:54.244274 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2026-02-23 21:10:54.244282 | controller | Monday 23 February 2026 21:10:53 +0000 (0:00:00.205) 0:00:59.921 ******* 2026-02-23 21:10:54.244293 | controller | changed: [instance] 2026-02-23 21:10:54.265346 | controller | 2026-02-23 21:10:54.265368 | controller | TASK [dnsmasq : Stop service] ************************************************** 2026-02-23 21:10:54.265376 | controller | Monday 23 February 2026 21:10:54 +0000 (0:00:00.647) 0:01:00.569 ******* 2026-02-23 21:10:54.265386 | controller | skipping: [instance] 2026-02-23 21:10:54.285379 | controller | 2026-02-23 21:10:54.285398 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2026-02-23 21:10:54.285406 | controller | Monday 23 February 2026 21:10:54 +0000 (0:00:00.021) 0:01:00.590 ******* 2026-02-23 21:10:54.285415 | controller | skipping: [instance] 2026-02-23 21:10:54.315470 | controller | 2026-02-23 21:10:54.315491 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2026-02-23 21:10:54.315499 | controller | Monday 23 February 2026 21:10:54 +0000 (0:00:00.020) 0:01:00.610 ******* 2026-02-23 21:10:54.315514 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-23 21:10:54.427580 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2026-02-23 21:10:54.427602 | controller | skipping: [instance] 2026-02-23 21:10:54.427611 | controller | 2026-02-23 21:10:54.427618 | controller | TASK [Create dnsmasq networks] ************************************************* 2026-02-23 21:10:54.427624 | controller | Monday 23 February 2026 21:10:54 +0000 (0:00:00.029) 0:01:00.640 ******* 2026-02-23 21:10:54.427634 | controller | 2026-02-23 21:10:54.458287 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-23 21:10:54.458304 | controller | Monday 23 February 2026 21:10:54 +0000 (0:00:00.112) 0:01:00.753 ******* 2026-02-23 21:10:54.458313 | controller | ok: [instance] => changed=false 2026-02-23 21:10:54.496308 | controller | msg: All assertions passed 2026-02-23 21:10:54.496325 | controller | 2026-02-23 21:10:54.496332 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-23 21:10:54.496338 | controller | Monday 23 February 2026 21:10:54 +0000 (0:00:00.030) 0:01:00.783 ******* 2026-02-23 21:10:54.496345 | controller | ok: [instance] => changed=false 2026-02-23 21:10:54.924376 | controller | msg: All assertions passed 2026-02-23 21:10:54.924397 | controller | 2026-02-23 21:10:54.924406 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-23 21:10:54.924413 | controller | Monday 23 February 2026 21:10:54 +0000 (0:00:00.038) 0:01:00.821 ******* 2026-02-23 21:10:54.924423 | controller | changed: [instance] 2026-02-23 21:10:54.943813 | controller | 2026-02-23 21:10:54.943847 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-23 21:10:54.943861 | controller | Monday 23 February 2026 21:10:54 +0000 (0:00:00.427) 0:01:01.249 ******* 2026-02-23 21:10:54.943876 | controller | skipping: [instance] 2026-02-23 21:10:54.943919 | controller | 2026-02-23 21:10:54.943930 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-23 21:10:54.943943 | controller | Monday 23 February 2026 21:10:54 +0000 (0:00:00.019) 0:01:01.269 ******* 2026-02-23 21:10:54.967109 | controller | skipping: [instance] 2026-02-23 21:10:54.996609 | controller | 2026-02-23 21:10:54.996642 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-23 21:10:54.996699 | controller | Monday 23 February 2026 21:10:54 +0000 (0:00:00.023) 0:01:01.292 ******* 2026-02-23 21:10:54.996725 | controller | ok: [instance] => changed=false 2026-02-23 21:10:55.032478 | controller | msg: All assertions passed 2026-02-23 21:10:55.032495 | controller | 2026-02-23 21:10:55.032502 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-23 21:10:55.032511 | controller | Monday 23 February 2026 21:10:54 +0000 (0:00:00.029) 0:01:01.321 ******* 2026-02-23 21:10:55.032519 | controller | ok: [instance] => changed=false 2026-02-23 21:10:55.454261 | controller | msg: All assertions passed 2026-02-23 21:10:55.454282 | controller | 2026-02-23 21:10:55.454290 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-23 21:10:55.454296 | controller | Monday 23 February 2026 21:10:55 +0000 (0:00:00.035) 0:01:01.357 ******* 2026-02-23 21:10:55.454305 | controller | changed: [instance] 2026-02-23 21:10:55.473680 | controller | 2026-02-23 21:10:55.473715 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-23 21:10:55.473730 | controller | Monday 23 February 2026 21:10:55 +0000 (0:00:00.421) 0:01:01.779 ******* 2026-02-23 21:10:55.473745 | controller | skipping: [instance] 2026-02-23 21:10:55.498799 | controller | 2026-02-23 21:10:55.498842 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-23 21:10:55.498856 | controller | Monday 23 February 2026 21:10:55 +0000 (0:00:00.019) 0:01:01.798 ******* 2026-02-23 21:10:55.498873 | controller | skipping: [instance] 2026-02-23 21:10:55.498954 | controller | 2026-02-23 21:10:55.498984 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2026-02-23 21:10:55.499002 | controller | Monday 23 February 2026 21:10:55 +0000 (0:00:00.025) 0:01:01.824 ******* 2026-02-23 21:10:55.530514 | controller | skipping: [instance] 2026-02-23 21:10:56.008009 | controller | 2026-02-23 21:10:56.008038 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2026-02-23 21:10:56.008047 | controller | Monday 23 February 2026 21:10:55 +0000 (0:00:00.031) 0:01:01.855 ******* 2026-02-23 21:10:56.008057 | controller | changed: [instance] => (item=cifmw-public) 2026-02-23 21:10:56.046796 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-23 21:10:56.046818 | controller | 2026-02-23 21:10:56.046826 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-23 21:10:56.046832 | controller | Monday 23 February 2026 21:10:56 +0000 (0:00:00.477) 0:01:02.333 ******* 2026-02-23 21:10:56.046841 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2026-02-23 21:10:56.389761 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2026-02-23 21:10:56.389799 | controller | 2026-02-23 21:10:56.389808 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-23 21:10:56.389814 | controller | Monday 23 February 2026 21:10:56 +0000 (0:00:00.038) 0:01:02.372 ******* 2026-02-23 21:10:56.389824 | controller | ok: [instance] 2026-02-23 21:10:56.389842 | controller | 2026-02-23 21:10:56.389850 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-23 21:10:56.389940 | controller | Monday 23 February 2026 21:10:56 +0000 (0:00:00.343) 0:01:02.715 ******* 2026-02-23 21:10:56.425437 | controller | ok: [instance] 2026-02-23 21:10:56.627101 | controller | 2026-02-23 21:10:56.627127 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-23 21:10:56.627136 | controller | Monday 23 February 2026 21:10:56 +0000 (0:00:00.035) 0:01:02.750 ******* 2026-02-23 21:10:56.627145 | controller | ok: [instance] 2026-02-23 21:10:56.661752 | controller | 2026-02-23 21:10:56.661785 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-23 21:10:56.661792 | controller | Monday 23 February 2026 21:10:56 +0000 (0:00:00.201) 0:01:02.952 ******* 2026-02-23 21:10:56.661804 | controller | ok: [instance] 2026-02-23 21:10:56.662265 | controller | 2026-02-23 21:10:56.991276 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2026-02-23 21:10:56.991303 | controller | Monday 23 February 2026 21:10:56 +0000 (0:00:00.034) 0:01:02.987 ******* 2026-02-23 21:10:56.991314 | controller | changed: [instance] 2026-02-23 21:10:57.313797 | controller | 2026-02-23 21:10:57.313835 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2026-02-23 21:10:57.313850 | controller | Monday 23 February 2026 21:10:56 +0000 (0:00:00.329) 0:01:03.316 ******* 2026-02-23 21:10:57.313862 | controller | changed: [instance] 2026-02-23 21:10:57.637447 | controller | 2026-02-23 21:10:57.637480 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2026-02-23 21:10:57.637488 | controller | Monday 23 February 2026 21:10:57 +0000 (0:00:00.322) 0:01:03.639 ******* 2026-02-23 21:10:57.637498 | controller | changed: [instance] 2026-02-23 21:10:57.729247 | controller | 2026-02-23 21:10:57.729273 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2026-02-23 21:10:57.729282 | controller | Monday 23 February 2026 21:10:57 +0000 (0:00:00.323) 0:01:03.962 ******* 2026-02-23 21:10:57.729295 | controller | ok: [instance] 2026-02-23 21:10:58.053240 | controller | 2026-02-23 21:10:58.053260 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2026-02-23 21:10:58.053267 | controller | Monday 23 February 2026 21:10:57 +0000 (0:00:00.091) 0:01:04.054 ******* 2026-02-23 21:10:58.053276 | controller | changed: [instance] 2026-02-23 21:10:58.078811 | controller | 2026-02-23 21:10:58.078847 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-23 21:10:58.078857 | controller | Monday 23 February 2026 21:10:58 +0000 (0:00:00.323) 0:01:04.378 ******* 2026-02-23 21:10:58.078869 | controller | skipping: [instance] 2026-02-23 21:10:58.078979 | controller | 2026-02-23 21:10:58.079006 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-23 21:10:58.079016 | controller | Monday 23 February 2026 21:10:58 +0000 (0:00:00.025) 0:01:04.404 ******* 2026-02-23 21:10:58.103295 | controller | skipping: [instance] 2026-02-23 21:10:58.126475 | controller | 2026-02-23 21:10:58.126491 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-23 21:10:58.126498 | controller | Monday 23 February 2026 21:10:58 +0000 (0:00:00.024) 0:01:04.428 ******* 2026-02-23 21:10:58.126506 | controller | skipping: [instance] 2026-02-23 21:10:58.150805 | controller | 2026-02-23 21:10:58.150838 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-23 21:10:58.150847 | controller | Monday 23 February 2026 21:10:58 +0000 (0:00:00.023) 0:01:04.452 ******* 2026-02-23 21:10:58.150859 | controller | skipping: [instance] 2026-02-23 21:10:58.150888 | controller | 2026-02-23 21:10:58.150898 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-23 21:10:58.151127 | controller | Monday 23 February 2026 21:10:58 +0000 (0:00:00.024) 0:01:04.476 ******* 2026-02-23 21:10:58.170430 | controller | ok: [instance] 2026-02-23 21:10:58.285783 | controller | 2026-02-23 21:10:58.285816 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-23 21:10:58.285824 | controller | Monday 23 February 2026 21:10:58 +0000 (0:00:00.019) 0:01:04.495 ******* 2026-02-23 21:10:58.285837 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-23 21:10:58.286489 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-23 21:10:58.304803 | controller | 2026-02-23 21:10:58.304831 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-23 21:10:58.304840 | controller | Monday 23 February 2026 21:10:58 +0000 (0:00:00.115) 0:01:04.611 ******* 2026-02-23 21:10:58.304851 | controller | skipping: [instance] 2026-02-23 21:10:58.304879 | controller | 2026-02-23 21:10:58.304888 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-23 21:10:58.305075 | controller | Monday 23 February 2026 21:10:58 +0000 (0:00:00.018) 0:01:04.630 ******* 2026-02-23 21:10:58.500641 | controller | ok: [instance] 2026-02-23 21:10:58.882780 | controller | 2026-02-23 21:10:58.882821 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-23 21:10:58.882832 | controller | Monday 23 February 2026 21:10:58 +0000 (0:00:00.196) 0:01:04.826 ******* 2026-02-23 21:10:58.882845 | controller | changed: [instance] 2026-02-23 21:10:58.944717 | controller | 2026-02-23 21:10:58.944755 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-23 21:10:58.944763 | controller | Monday 23 February 2026 21:10:58 +0000 (0:00:00.382) 0:01:05.208 ******* 2026-02-23 21:10:58.944774 | controller | ok: [instance] 2026-02-23 21:10:58.982133 | controller | 2026-02-23 21:10:58.982164 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-23 21:10:58.982172 | controller | Monday 23 February 2026 21:10:58 +0000 (0:00:00.061) 0:01:05.269 ******* 2026-02-23 21:10:58.982182 | controller | ok: [instance] 2026-02-23 21:10:59.424285 | controller | 2026-02-23 21:10:59.424317 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-23 21:10:59.424328 | controller | Monday 23 February 2026 21:10:58 +0000 (0:00:00.037) 0:01:05.307 ******* 2026-02-23 21:10:59.424341 | controller | changed: [instance] 2026-02-23 21:10:59.453062 | controller | 2026-02-23 21:10:59.453085 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2026-02-23 21:10:59.453092 | controller | Monday 23 February 2026 21:10:59 +0000 (0:00:00.442) 0:01:05.749 ******* 2026-02-23 21:10:59.453113 | controller | ok: [instance] 2026-02-23 21:10:59.472470 | controller | 2026-02-23 21:10:59.472491 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2026-02-23 21:10:59.472499 | controller | Monday 23 February 2026 21:10:59 +0000 (0:00:00.029) 0:01:05.778 ******* 2026-02-23 21:10:59.472509 | controller | ok: [instance] 2026-02-23 21:10:59.492482 | controller | 2026-02-23 21:10:59.492500 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2026-02-23 21:10:59.492508 | controller | Monday 23 February 2026 21:10:59 +0000 (0:00:00.019) 0:01:05.797 ******* 2026-02-23 21:10:59.492517 | controller | ok: [instance] 2026-02-23 21:10:59.567808 | controller | 2026-02-23 21:10:59.567845 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2026-02-23 21:10:59.567861 | controller | Monday 23 February 2026 21:10:59 +0000 (0:00:00.020) 0:01:05.818 ******* 2026-02-23 21:10:59.567875 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2026-02-23 21:10:59.567907 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2026-02-23 21:10:59.567915 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2026-02-23 21:10:59.567924 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2026-02-23 21:10:59.567950 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2026-02-23 21:10:59.568413 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2026-02-23 21:10:59.707207 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2026-02-23 21:10:59.707232 | controller | 2026-02-23 21:10:59.707240 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-23 21:10:59.707247 | controller | Monday 23 February 2026 21:10:59 +0000 (0:00:00.075) 0:01:05.893 ******* 2026-02-23 21:10:59.707256 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2026-02-23 21:10:59.790653 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2026-02-23 21:10:59.790695 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2026-02-23 21:10:59.790703 | controller | 2026-02-23 21:10:59.790710 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-23 21:10:59.790715 | controller | Monday 23 February 2026 21:10:59 +0000 (0:00:00.138) 0:01:06.032 ******* 2026-02-23 21:10:59.790724 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2026-02-23 21:10:59.790874 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2026-02-23 21:10:59.791010 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2026-02-23 21:10:59.791149 | controller | skipping: [instance] 2026-02-23 21:10:59.791269 | controller | 2026-02-23 21:10:59.791400 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-23 21:10:59.791525 | controller | Monday 23 February 2026 21:10:59 +0000 (0:00:00.084) 0:01:06.116 ******* 2026-02-23 21:10:59.869710 | controller | skipping: [instance] => (item=compute-0 - storage) 2026-02-23 21:10:59.869894 | controller | skipping: [instance] => (item=controller-0 - storage) 2026-02-23 21:10:59.870045 | controller | skipping: [instance] => (item=crc-0 - storage) 2026-02-23 21:10:59.870207 | controller | skipping: [instance] 2026-02-23 21:10:59.870342 | controller | 2026-02-23 21:10:59.870482 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-23 21:10:59.870603 | controller | Monday 23 February 2026 21:10:59 +0000 (0:00:00.079) 0:01:06.195 ******* 2026-02-23 21:10:59.950144 | controller | skipping: [instance] => (item=compute-0 - tenant) 2026-02-23 21:10:59.950316 | controller | skipping: [instance] => (item=controller-0 - tenant) 2026-02-23 21:10:59.950464 | controller | skipping: [instance] => (item=crc-0 - tenant) 2026-02-23 21:10:59.950603 | controller | skipping: [instance] 2026-02-23 21:10:59.950739 | controller | 2026-02-23 21:10:59.950861 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-23 21:10:59.950977 | controller | Monday 23 February 2026 21:10:59 +0000 (0:00:00.080) 0:01:06.276 ******* 2026-02-23 21:11:00.027819 | controller | skipping: [instance] => (item=compute-0 - external) 2026-02-23 21:11:00.027988 | controller | skipping: [instance] => (item=controller-0 - external) 2026-02-23 21:11:00.028155 | controller | skipping: [instance] => (item=crc-0 - external) 2026-02-23 21:11:00.028296 | controller | skipping: [instance] 2026-02-23 21:11:00.028427 | controller | 2026-02-23 21:11:00.028565 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-23 21:11:00.028748 | controller | Monday 23 February 2026 21:11:00 +0000 (0:00:00.077) 0:01:06.353 ******* 2026-02-23 21:11:00.109963 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2026-02-23 21:11:00.110150 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2026-02-23 21:11:00.110301 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2026-02-23 21:11:00.110442 | controller | skipping: [instance] 2026-02-23 21:11:00.110576 | controller | 2026-02-23 21:11:00.110745 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-23 21:11:00.110897 | controller | Monday 23 February 2026 21:11:00 +0000 (0:00:00.082) 0:01:06.435 ******* 2026-02-23 21:11:00.245153 | controller | ok: [instance] => (item=compute-0 - public) 2026-02-23 21:11:00.245339 | controller | ok: [instance] => (item=controller-0 - public) 2026-02-23 21:11:00.245485 | controller | ok: [instance] => (item=crc-0 - public) 2026-02-23 21:11:00.245621 | controller | 2026-02-23 21:11:00.245797 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2026-02-23 21:11:00.245952 | controller | Monday 23 February 2026 21:11:00 +0000 (0:00:00.135) 0:01:06.571 ******* 2026-02-23 21:11:00.353430 | controller | 2026-02-23 21:11:00.353604 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2026-02-23 21:11:00.353789 | controller | Monday 23 February 2026 21:11:00 +0000 (0:00:00.108) 0:01:06.679 ******* 2026-02-23 21:11:00.391469 | controller | ok: [instance] 2026-02-23 21:11:00.391629 | controller | 2026-02-23 21:11:00.391809 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2026-02-23 21:11:00.391960 | controller | Monday 23 February 2026 21:11:00 +0000 (0:00:00.038) 0:01:06.717 ******* 2026-02-23 21:11:00.486373 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:56:dd:4d', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-23 21:11:00.486555 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:46:e4:24', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-23 21:11:00.486738 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:bc:d4:5b', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-23 21:11:00.486889 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:c2:af:ce', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-23 21:11:00.487033 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:4d:9b:c6', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-23 21:11:00.487193 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:10:59:37', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-23 21:11:00.487326 | controller | 2026-02-23 21:11:00.487465 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2026-02-23 21:11:00.487595 | controller | Monday 23 February 2026 21:11:00 +0000 (0:00:00.094) 0:01:06.812 ******* 2026-02-23 21:11:00.536956 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2026-02-23 21:11:00.537155 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2026-02-23 21:11:00.537306 | controller | 2026-02-23 21:11:00.537455 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-23 21:11:00.537600 | controller | Monday 23 February 2026 21:11:00 +0000 (0:00:00.050) 0:01:06.862 ******* 2026-02-23 21:11:00.704652 | controller | ok: [instance] 2026-02-23 21:11:00.728317 | controller | 2026-02-23 21:11:00.728339 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-23 21:11:00.728349 | controller | Monday 23 February 2026 21:11:00 +0000 (0:00:00.167) 0:01:07.029 ******* 2026-02-23 21:11:00.728360 | controller | ok: [instance] 2026-02-23 21:11:00.896543 | controller | 2026-02-23 21:11:00.896571 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-23 21:11:00.896579 | controller | Monday 23 February 2026 21:11:00 +0000 (0:00:00.023) 0:01:07.053 ******* 2026-02-23 21:11:00.896589 | controller | ok: [instance] 2026-02-23 21:11:00.921086 | controller | 2026-02-23 21:11:00.921118 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-23 21:11:00.921126 | controller | Monday 23 February 2026 21:11:00 +0000 (0:00:00.168) 0:01:07.221 ******* 2026-02-23 21:11:00.921136 | controller | ok: [instance] 2026-02-23 21:11:00.940881 | controller | 2026-02-23 21:11:00.940929 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2026-02-23 21:11:00.940944 | controller | Monday 23 February 2026 21:11:00 +0000 (0:00:00.024) 0:01:07.246 ******* 2026-02-23 21:11:00.940962 | controller | ok: [instance] 2026-02-23 21:11:01.108830 | controller | 2026-02-23 21:11:01.108857 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2026-02-23 21:11:01.108865 | controller | Monday 23 February 2026 21:11:00 +0000 (0:00:00.019) 0:01:07.266 ******* 2026-02-23 21:11:01.108881 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:56:dd:4d', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-23 21:11:01.144439 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:46:e4:24', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-23 21:11:01.144464 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:bc:d4:5b', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-23 21:11:01.144473 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:c2:af:ce', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-23 21:11:01.144480 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:4d:9b:c6', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-23 21:11:01.144486 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:10:59:37', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-23 21:11:01.144493 | controller | 2026-02-23 21:11:01.144499 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2026-02-23 21:11:01.144506 | controller | Monday 23 February 2026 21:11:01 +0000 (0:00:00.167) 0:01:07.433 ******* 2026-02-23 21:11:01.144516 | controller | ok: [instance] 2026-02-23 21:11:01.144694 | controller | 2026-02-23 21:11:01.144851 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2026-02-23 21:11:01.144975 | controller | Monday 23 February 2026 21:11:01 +0000 (0:00:00.036) 0:01:07.470 ******* 2026-02-23 21:11:03.113808 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:56:dd:4d', 'entry': 'set:compute,52:54:00:56:dd:4d,192.168.140.100,compute-0', 'state': 'present'}) 2026-02-23 21:11:03.113862 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:46:e4:24', 'entry': 'set:controller,52:54:01:46:e4:24,192.168.140.9,controller-0', 'state': 'present'}) 2026-02-23 21:11:03.113872 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:bc:d4:5b', 'entry': 'set:ocp,52:54:02:bc:d4:5b,192.168.140.10,crc-0', 'state': 'present'}) 2026-02-23 21:11:03.113879 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:c2:af:ce', 'entry': 'set:compute,52:54:00:c2:af:ce,192.168.101.100,compute-0', 'state': 'present'}) 2026-02-23 21:11:03.113886 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:4d:9b:c6', 'entry': 'set:controller,52:54:01:4d:9b:c6,192.168.101.9,controller-0', 'state': 'present'}) 2026-02-23 21:11:03.113892 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:10:59:37', 'entry': 'set:ocp,52:54:02:10:59:37,192.168.101.10,crc-0', 'state': 'present'}) 2026-02-23 21:11:03.113898 | controller | 2026-02-23 21:11:03.113907 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2026-02-23 21:11:03.113975 | controller | Monday 23 February 2026 21:11:03 +0000 (0:00:01.968) 0:01:09.438 ******* 2026-02-23 21:11:03.135622 | controller | skipping: [instance] 2026-02-23 21:11:03.343834 | controller | 2026-02-23 21:11:03.343873 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2026-02-23 21:11:03.343888 | controller | Monday 23 February 2026 21:11:03 +0000 (0:00:00.022) 0:01:09.461 ******* 2026-02-23 21:11:03.343905 | controller | ok: [instance] => (item=compute-0) 2026-02-23 21:11:03.343949 | controller | ok: [instance] => (item=controller-0) 2026-02-23 21:11:03.343964 | controller | ok: [instance] => (item=crc-0) 2026-02-23 21:11:03.344002 | controller | 2026-02-23 21:11:03.344183 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2026-02-23 21:11:03.459245 | controller | Monday 23 February 2026 21:11:03 +0000 (0:00:00.208) 0:01:09.669 ******* 2026-02-23 21:11:03.459271 | controller | 2026-02-23 21:11:03.525082 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-23 21:11:03.525117 | controller | Monday 23 February 2026 21:11:03 +0000 (0:00:00.115) 0:01:09.784 ******* 2026-02-23 21:11:03.525136 | controller | ok: [instance] 2026-02-23 21:11:03.717772 | controller | 2026-02-23 21:11:03.717804 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-23 21:11:03.717814 | controller | Monday 23 February 2026 21:11:03 +0000 (0:00:00.065) 0:01:09.850 ******* 2026-02-23 21:11:03.717825 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-23 21:11:03.717863 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-23 21:11:03.717871 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-23 21:11:03.717878 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-23 21:11:03.717887 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-23 21:11:03.717917 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-23 21:11:03.719020 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-23 21:11:06.712752 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-23 21:11:06.712783 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-23 21:11:06.712790 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-23 21:11:06.712796 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-23 21:11:06.712801 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-23 21:11:06.712807 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-23 21:11:06.712812 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-23 21:11:06.712817 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-23 21:11:06.712827 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-23 21:11:06.712832 | controller | 2026-02-23 21:11:06.712838 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-23 21:11:06.712843 | controller | Monday 23 February 2026 21:11:03 +0000 (0:00:00.192) 0:01:10.043 ******* 2026-02-23 21:11:06.712852 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-23 21:11:06.712875 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-23 21:11:06.712886 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-23 21:11:06.712892 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-23 21:11:06.712897 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-23 21:11:06.712902 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-23 21:11:06.712907 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-23 21:11:06.712912 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-23 21:11:06.712918 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-23 21:11:06.713633 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-23 21:11:06.713682 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-23 21:11:07.048642 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-23 21:11:07.048690 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-23 21:11:07.048702 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-23 21:11:07.048709 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-23 21:11:07.048716 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-23 21:11:07.048722 | controller | 2026-02-23 21:11:07.048729 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-23 21:11:07.048736 | controller | Monday 23 February 2026 21:11:06 +0000 (0:00:02.994) 0:01:13.037 ******* 2026-02-23 21:11:07.048747 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-23 21:11:07.050318 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-23 21:11:07.050339 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-23 21:11:07.050350 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-23 21:11:07.050379 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-23 21:11:07.050394 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-23 21:11:07.050401 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-23 21:11:07.050406 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-23 21:11:07.050411 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-23 21:11:07.050416 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-23 21:11:07.050421 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-23 21:11:07.050426 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-23 21:11:07.050431 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-23 21:11:07.050436 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-23 21:11:07.050441 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-23 21:11:07.050447 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-23 21:11:07.050455 | controller | 2026-02-23 21:11:07.050460 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2026-02-23 21:11:07.050469 | controller | Monday 23 February 2026 21:11:07 +0000 (0:00:00.336) 0:01:13.374 ******* 2026-02-23 21:11:07.068401 | controller | ok: [instance] 2026-02-23 21:11:07.109778 | controller | 2026-02-23 21:11:07.109811 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2026-02-23 21:11:07.109821 | controller | Monday 23 February 2026 21:11:07 +0000 (0:00:00.019) 0:01:13.394 ******* 2026-02-23 21:11:07.109833 | controller | skipping: [instance] => (item=compute) 2026-02-23 21:11:07.109862 | controller | skipping: [instance] => (item=controller) 2026-02-23 21:11:07.109870 | controller | skipping: [instance] => (item=crc) 2026-02-23 21:11:07.109877 | controller | skipping: [instance] 2026-02-23 21:11:07.109883 | controller | 2026-02-23 21:11:07.109892 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2026-02-23 21:11:07.139640 | controller | Monday 23 February 2026 21:11:07 +0000 (0:00:00.041) 0:01:13.435 ******* 2026-02-23 21:11:07.139689 | controller | skipping: [instance] 2026-02-23 21:11:07.511563 | controller | 2026-02-23 21:11:07.511593 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2026-02-23 21:11:07.511601 | controller | Monday 23 February 2026 21:11:07 +0000 (0:00:00.029) 0:01:13.465 ******* 2026-02-23 21:11:07.511615 | controller | changed: [instance] 2026-02-23 21:11:08.137555 | controller | 2026-02-23 21:11:08.137586 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2026-02-23 21:11:08.137594 | controller | Monday 23 February 2026 21:11:07 +0000 (0:00:00.360) 0:01:13.825 ******* 2026-02-23 21:11:08.137600 | controller | 2026-02-23 21:11:08.137606 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-23 21:11:08.137611 | controller | Monday 23 February 2026 21:11:07 +0000 (0:00:00.010) 0:01:13.836 ******* 2026-02-23 21:11:08.137621 | controller | changed: [instance] 2026-02-23 21:11:08.486469 | controller | 2026-02-23 21:11:08.486500 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-23 21:11:08.486508 | controller | Monday 23 February 2026 21:11:08 +0000 (0:00:00.626) 0:01:14.462 ******* 2026-02-23 21:11:08.486519 | controller | changed: [instance] 2026-02-23 21:11:08.486541 | controller | 2026-02-23 21:11:08.486550 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2026-02-23 21:11:08.486652 | controller | Monday 23 February 2026 21:11:08 +0000 (0:00:00.348) 0:01:14.811 ******* 2026-02-23 21:11:08.831802 | controller | changed: [instance] 2026-02-23 21:11:09.183740 | controller | 2026-02-23 21:11:09.183771 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2026-02-23 21:11:09.183779 | controller | Monday 23 February 2026 21:11:08 +0000 (0:00:00.345) 0:01:15.156 ******* 2026-02-23 21:11:09.183789 | controller | changed: [instance] 2026-02-23 21:11:09.183815 | controller | 2026-02-23 21:11:09.184002 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2026-02-23 21:11:09.542786 | controller | Monday 23 February 2026 21:11:09 +0000 (0:00:00.352) 0:01:15.509 ******* 2026-02-23 21:11:09.542825 | controller | changed: [instance] 2026-02-23 21:11:09.573761 | controller | 2026-02-23 21:11:09.573798 | controller | TASK [Build utility records dataset] ******************************************* 2026-02-23 21:11:09.573812 | controller | Monday 23 February 2026 21:11:09 +0000 (0:00:00.358) 0:01:15.868 ******* 2026-02-23 21:11:09.573828 | controller | 2026-02-23 21:11:09.660545 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-23 21:11:09.660583 | controller | Monday 23 February 2026 21:11:09 +0000 (0:00:00.031) 0:01:15.899 ******* 2026-02-23 21:11:09.660597 | controller | ok: [instance] 2026-02-23 21:11:09.754741 | controller | 2026-02-23 21:11:09.754768 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-23 21:11:09.754777 | controller | Monday 23 February 2026 21:11:09 +0000 (0:00:00.086) 0:01:15.986 ******* 2026-02-23 21:11:09.754793 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-23 21:11:10.194750 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-23 21:11:10.194783 | controller | 2026-02-23 21:11:10.194791 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-23 21:11:10.194798 | controller | Monday 23 February 2026 21:11:09 +0000 (0:00:00.094) 0:01:16.080 ******* 2026-02-23 21:11:10.194808 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-23 21:11:10.478862 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-23 21:11:10.478908 | controller | 2026-02-23 21:11:10.478923 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-23 21:11:10.478933 | controller | Monday 23 February 2026 21:11:10 +0000 (0:00:00.439) 0:01:16.520 ******* 2026-02-23 21:11:10.478951 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-23 21:11:10.478994 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-23 21:11:10.479020 | controller | 2026-02-23 21:11:10.479578 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-23 21:11:10.954293 | controller | Monday 23 February 2026 21:11:10 +0000 (0:00:00.273) 0:01:16.793 ******* 2026-02-23 21:11:10.954327 | controller | 2026-02-23 21:11:10.954336 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-23 21:11:10.954343 | controller | Monday 23 February 2026 21:11:10 +0000 (0:00:00.010) 0:01:16.804 ******* 2026-02-23 21:11:10.954353 | controller | changed: [instance] 2026-02-23 21:11:11.300427 | controller | 2026-02-23 21:11:11.300454 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-23 21:11:11.300462 | controller | Monday 23 February 2026 21:11:10 +0000 (0:00:00.474) 0:01:17.279 ******* 2026-02-23 21:11:11.300472 | controller | changed: [instance] 2026-02-23 21:11:11.332451 | controller | 2026-02-23 21:11:11.332485 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2026-02-23 21:11:11.332494 | controller | Monday 23 February 2026 21:11:11 +0000 (0:00:00.346) 0:01:17.625 ******* 2026-02-23 21:11:11.332504 | controller | skipping: [instance] 2026-02-23 21:11:11.406844 | controller | 2026-02-23 21:11:11.406883 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2026-02-23 21:11:11.406895 | controller | Monday 23 February 2026 21:11:11 +0000 (0:00:00.031) 0:01:17.657 ******* 2026-02-23 21:11:11.406909 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2026-02-23 21:11:11.407180 | controller | 2026-02-23 21:11:11.407215 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2026-02-23 21:11:11.590283 | controller | Monday 23 February 2026 21:11:11 +0000 (0:00:00.074) 0:01:17.732 ******* 2026-02-23 21:11:11.590309 | controller | ok: [instance] 2026-02-23 21:11:11.610235 | controller | 2026-02-23 21:11:11.610257 | controller | TASK [Deploy CRC if needed] **************************************************** 2026-02-23 21:11:11.610266 | controller | Monday 23 February 2026 21:11:11 +0000 (0:00:00.183) 0:01:17.915 ******* 2026-02-23 21:11:11.610276 | controller | skipping: [instance] 2026-02-23 21:11:11.948487 | controller | 2026-02-23 21:11:11.948508 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2026-02-23 21:11:11.948516 | controller | Monday 23 February 2026 21:11:11 +0000 (0:00:00.019) 0:01:17.935 ******* 2026-02-23 21:11:11.948525 | controller | ok: [instance] 2026-02-23 21:11:12.171848 | controller | 2026-02-23 21:11:12.171897 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2026-02-23 21:11:12.171912 | controller | Monday 23 February 2026 21:11:11 +0000 (0:00:00.338) 0:01:18.274 ******* 2026-02-23 21:11:12.171930 | controller | ok: [instance] 2026-02-23 21:11:12.381078 | controller | 2026-02-23 21:11:12.381111 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2026-02-23 21:11:12.381132 | controller | Monday 23 February 2026 21:11:12 +0000 (0:00:00.222) 0:01:18.497 ******* 2026-02-23 21:11:12.381143 | controller | ok: [instance] 2026-02-23 21:11:12.594573 | controller | 2026-02-23 21:11:12.594591 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2026-02-23 21:11:12.594599 | controller | Monday 23 February 2026 21:11:12 +0000 (0:00:00.209) 0:01:18.706 ******* 2026-02-23 21:11:12.594607 | controller | ok: [instance] 2026-02-23 21:11:12.812496 | controller | 2026-02-23 21:11:12.812519 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2026-02-23 21:11:12.812528 | controller | Monday 23 February 2026 21:11:12 +0000 (0:00:00.213) 0:01:18.920 ******* 2026-02-23 21:11:12.812538 | controller | ok: [instance] 2026-02-23 21:11:12.851179 | controller | 2026-02-23 21:11:12.851213 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-23 21:11:12.851227 | controller | Monday 23 February 2026 21:11:12 +0000 (0:00:00.217) 0:01:19.137 ******* 2026-02-23 21:11:12.851242 | controller | 2026-02-23 21:11:13.038808 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-23 21:11:13.038875 | controller | Monday 23 February 2026 21:11:12 +0000 (0:00:00.038) 0:01:19.176 ******* 2026-02-23 21:11:13.038906 | controller | ok: [instance] 2026-02-23 21:11:13.062168 | controller | 2026-02-23 21:11:13.062201 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-23 21:11:13.062216 | controller | Monday 23 February 2026 21:11:13 +0000 (0:00:00.187) 0:01:19.364 ******* 2026-02-23 21:11:13.062228 | controller | ok: [instance] 2026-02-23 21:11:13.062246 | controller | 2026-02-23 21:11:13.062327 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-23 21:11:13.062417 | controller | Monday 23 February 2026 21:11:13 +0000 (0:00:00.023) 0:01:19.388 ******* 2026-02-23 21:11:13.087337 | controller | skipping: [instance] 2026-02-23 21:11:13.087402 | controller | 2026-02-23 21:11:13.087517 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2026-02-23 21:11:13.087592 | controller | Monday 23 February 2026 21:11:13 +0000 (0:00:00.025) 0:01:19.413 ******* 2026-02-23 21:11:13.332784 | controller | ok: [instance] 2026-02-23 21:11:13.332842 | controller | 2026-02-23 21:11:13.332890 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2026-02-23 21:11:13.333004 | controller | Monday 23 February 2026 21:11:13 +0000 (0:00:00.245) 0:01:19.658 ******* 2026-02-23 21:11:13.548926 | controller | ok: [instance] 2026-02-23 21:11:13.549002 | controller | 2026-02-23 21:11:13.549090 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2026-02-23 21:11:13.549187 | controller | Monday 23 February 2026 21:11:13 +0000 (0:00:00.216) 0:01:19.874 ******* 2026-02-23 21:11:13.715856 | controller | ok: [instance] 2026-02-23 21:11:13.715909 | controller | 2026-02-23 21:11:13.716021 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2026-02-23 21:11:13.716149 | controller | Monday 23 February 2026 21:11:13 +0000 (0:00:00.166) 0:01:20.041 ******* 2026-02-23 21:11:13.772353 | controller | 2026-02-23 21:11:13.772405 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-23 21:11:13.772467 | controller | Monday 23 February 2026 21:11:13 +0000 (0:00:00.056) 0:01:20.098 ******* 2026-02-23 21:11:13.814494 | controller | ok: [instance] => changed=false 2026-02-23 21:11:13.814545 | controller | msg: All assertions passed 2026-02-23 21:11:13.814604 | controller | 2026-02-23 21:11:13.814715 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-23 21:11:13.814830 | controller | Monday 23 February 2026 21:11:13 +0000 (0:00:00.042) 0:01:20.140 ******* 2026-02-23 21:11:13.987878 | controller | ok: [instance] 2026-02-23 21:11:13.987942 | controller | 2026-02-23 21:11:13.987953 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-23 21:11:13.988043 | controller | Monday 23 February 2026 21:11:13 +0000 (0:00:00.173) 0:01:20.313 ******* 2026-02-23 21:11:14.171896 | controller | ok: [instance] 2026-02-23 21:11:14.194481 | controller | 2026-02-23 21:11:14.194502 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-23 21:11:14.194511 | controller | Monday 23 February 2026 21:11:14 +0000 (0:00:00.183) 0:01:20.497 ******* 2026-02-23 21:11:14.194522 | controller | ok: [instance] => changed=false 2026-02-23 21:11:14.375816 | controller | msg: All assertions passed 2026-02-23 21:11:14.375852 | controller | 2026-02-23 21:11:14.375866 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-23 21:11:14.375876 | controller | Monday 23 February 2026 21:11:14 +0000 (0:00:00.022) 0:01:20.519 ******* 2026-02-23 21:11:14.375892 | controller | ok: [instance] 2026-02-23 21:11:14.375933 | controller | 2026-02-23 21:11:14.375942 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-23 21:11:14.376034 | controller | Monday 23 February 2026 21:11:14 +0000 (0:00:00.181) 0:01:20.701 ******* 2026-02-23 21:11:14.545739 | controller | ok: [instance] 2026-02-23 21:11:14.545925 | controller | 2026-02-23 21:11:14.545956 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-23 21:11:14.545974 | controller | Monday 23 February 2026 21:11:14 +0000 (0:00:00.169) 0:01:20.871 ******* 2026-02-23 21:11:14.591767 | controller | ok: [instance] 2026-02-23 21:11:14.591836 | controller | 2026-02-23 21:11:14.592180 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2026-02-23 21:11:14.956105 | controller | Monday 23 February 2026 21:11:14 +0000 (0:00:00.046) 0:01:20.917 ******* 2026-02-23 21:11:14.956137 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2026-02-23 21:11:14.974787 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2026-02-23 21:11:14.974824 | controller | 2026-02-23 21:11:14.974835 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2026-02-23 21:11:14.974844 | controller | Monday 23 February 2026 21:11:14 +0000 (0:00:00.364) 0:01:21.281 ******* 2026-02-23 21:11:14.974857 | controller | skipping: [instance] 2026-02-23 21:11:14.974906 | controller | 2026-02-23 21:11:14.974918 | controller | TASK [Load the architecture local kustomize patches] *************************** 2026-02-23 21:11:14.974951 | controller | Monday 23 February 2026 21:11:14 +0000 (0:00:00.018) 0:01:21.300 ******* 2026-02-23 21:11:14.998182 | controller | skipping: [instance] 2026-02-23 21:11:15.124624 | controller | 2026-02-23 21:11:15.124646 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2026-02-23 21:11:15.124672 | controller | Monday 23 February 2026 21:11:14 +0000 (0:00:00.023) 0:01:21.323 ******* 2026-02-23 21:11:15.124687 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2026-02-23 21:11:15.149544 | controller | 2026-02-23 21:11:15.149561 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2026-02-23 21:11:15.149568 | controller | Monday 23 February 2026 21:11:15 +0000 (0:00:00.126) 0:01:21.450 ******* 2026-02-23 21:11:15.149576 | controller | skipping: [instance] 2026-02-23 21:11:15.548369 | controller | 2026-02-23 21:11:15.548407 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2026-02-23 21:11:15.548416 | controller | Monday 23 February 2026 21:11:15 +0000 (0:00:00.024) 0:01:21.474 ******* 2026-02-23 21:11:15.548426 | controller | changed: [instance] 2026-02-23 21:11:16.042363 | controller | 2026-02-23 21:11:16.042391 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2026-02-23 21:11:16.042399 | controller | Monday 23 February 2026 21:11:15 +0000 (0:00:00.398) 0:01:21.873 ******* 2026-02-23 21:11:16.042410 | controller | changed: [instance] 2026-02-23 21:11:16.462221 | controller | 2026-02-23 21:11:16.462252 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2026-02-23 21:11:16.462260 | controller | Monday 23 February 2026 21:11:16 +0000 (0:00:00.482) 0:01:22.356 ******* 2026-02-23 21:11:16.462266 | controller | 2026-02-23 21:11:16.462271 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-23 21:11:16.462276 | controller | Monday 23 February 2026 21:11:16 +0000 (0:00:00.010) 0:01:22.367 ******* 2026-02-23 21:11:16.462285 | controller | changed: [instance] 2026-02-23 21:11:17.083293 | controller | 2026-02-23 21:11:17.083324 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-23 21:11:17.083333 | controller | Monday 23 February 2026 21:11:16 +0000 (0:00:00.419) 0:01:22.787 ******* 2026-02-23 21:11:17.083343 | controller | changed: [instance] 2026-02-23 21:11:17.113276 | controller | 2026-02-23 21:11:17.113314 | controller | TASK [Deploy virtualbmc] ******************************************************* 2026-02-23 21:11:17.113322 | controller | Monday 23 February 2026 21:11:17 +0000 (0:00:00.621) 0:01:23.408 ******* 2026-02-23 21:11:17.113332 | controller | skipping: [instance] 2026-02-23 21:11:17.113476 | controller | 2026-02-23 21:11:17.113495 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2026-02-23 21:11:17.179274 | controller | Monday 23 February 2026 21:11:17 +0000 (0:00:00.030) 0:01:23.439 ******* 2026-02-23 21:11:17.179309 | controller | skipping: [instance] 2026-02-23 21:11:17.713818 | controller | 2026-02-23 21:11:17.713853 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2026-02-23 21:11:17.713861 | controller | Monday 23 February 2026 21:11:17 +0000 (0:00:00.065) 0:01:23.504 ******* 2026-02-23 21:11:17.713872 | controller | changed: [instance] => (item=workload) 2026-02-23 21:11:17.713896 | controller | changed: [instance] => (item=reproducer-inventory) 2026-02-23 21:11:17.713907 | controller | ok: [instance] => (item=volumes) 2026-02-23 21:11:17.713916 | controller | 2026-02-23 21:11:17.713923 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2026-02-23 21:11:17.713980 | controller | Monday 23 February 2026 21:11:17 +0000 (0:00:00.534) 0:01:24.039 ******* 2026-02-23 21:11:18.103792 | controller | changed: [instance] => (item=workload) 2026-02-23 21:11:18.103965 | controller | changed: [instance] => (item=volumes) 2026-02-23 21:11:18.103982 | controller | 2026-02-23 21:11:18.103992 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2026-02-23 21:11:18.130024 | controller | Monday 23 February 2026 21:11:18 +0000 (0:00:00.390) 0:01:24.429 ******* 2026-02-23 21:11:18.130043 | controller | skipping: [instance] 2026-02-23 21:11:19.112792 | controller | 2026-02-23 21:11:19.112832 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2026-02-23 21:11:19.112844 | controller | Monday 23 February 2026 21:11:18 +0000 (0:00:00.026) 0:01:24.455 ******* 2026-02-23 21:11:19.112857 | controller | changed: [instance] => (item=compute) 2026-02-23 21:11:19.112892 | controller | changed: [instance] => (item=controller) 2026-02-23 21:11:19.112901 | controller | changed: [instance] => (item=crc) 2026-02-23 21:11:19.112909 | controller | 2026-02-23 21:11:19.112919 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2026-02-23 21:11:19.144792 | controller | Monday 23 February 2026 21:11:19 +0000 (0:00:00.982) 0:01:25.437 ******* 2026-02-23 21:11:19.144842 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance 2026-02-23 21:11:19.309972 | controller | 2026-02-23 21:11:19.310003 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] ***************** 2026-02-23 21:11:19.310012 | controller | Monday 23 February 2026 21:11:19 +0000 (0:00:00.032) 0:01:25.470 ******* 2026-02-23 21:11:19.310033 | controller | ok: [instance] 2026-02-23 21:11:19.310053 | controller | 2026-02-23 21:11:19.310156 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* 2026-02-23 21:11:19.310254 | controller | Monday 23 February 2026 21:11:19 +0000 (0:00:00.165) 0:01:25.635 ******* 2026-02-23 21:11:19.329595 | controller | skipping: [instance] 2026-02-23 21:11:19.329697 | controller | 2026-02-23 21:11:19.329803 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] *** 2026-02-23 21:11:19.329900 | controller | Monday 23 February 2026 21:11:19 +0000 (0:00:00.019) 0:01:25.655 ******* 2026-02-23 21:11:19.683577 | controller | changed: [instance] 2026-02-23 21:11:19.683620 | controller | 2026-02-23 21:11:19.683748 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* 2026-02-23 21:11:19.683864 | controller | Monday 23 February 2026 21:11:19 +0000 (0:00:00.353) 0:01:26.009 ******* 2026-02-23 21:11:19.704356 | controller | skipping: [instance] 2026-02-23 21:11:19.724624 | controller | 2026-02-23 21:11:19.724643 | controller | TASK [libvirt_manager : Write merged all-group.yml] **************************** 2026-02-23 21:11:19.724650 | controller | Monday 23 February 2026 21:11:19 +0000 (0:00:00.020) 0:01:26.030 ******* 2026-02-23 21:11:19.724677 | controller | skipping: [instance] 2026-02-23 21:11:19.763333 | controller | 2026-02-23 21:11:19.763351 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2026-02-23 21:11:19.763357 | controller | Monday 23 February 2026 21:11:19 +0000 (0:00:00.020) 0:01:26.050 ******* 2026-02-23 21:11:19.763365 | controller | skipping: [instance] 2026-02-23 21:11:19.826450 | controller | 2026-02-23 21:11:19.826468 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2026-02-23 21:11:19.826475 | controller | Monday 23 February 2026 21:11:19 +0000 (0:00:00.038) 0:01:26.088 ******* 2026-02-23 21:11:19.826483 | controller | skipping: [instance] => (item=crc) 2026-02-23 21:11:20.032801 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2026-02-23 21:11:20.032859 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2026-02-23 21:11:20.032882 | controller | 2026-02-23 21:11:20.032894 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-23 21:11:20.032905 | controller | Monday 23 February 2026 21:11:19 +0000 (0:00:00.063) 0:01:26.151 ******* 2026-02-23 21:11:20.032922 | controller | changed: [instance] 2026-02-23 21:11:20.032952 | controller | 2026-02-23 21:11:20.032963 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-23 21:11:20.032976 | controller | Monday 23 February 2026 21:11:20 +0000 (0:00:00.206) 0:01:26.358 ******* 2026-02-23 21:11:20.206039 | controller | ok: [instance] 2026-02-23 21:11:20.206096 | controller | 2026-02-23 21:11:20.206162 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-23 21:11:20.206280 | controller | Monday 23 February 2026 21:11:20 +0000 (0:00:00.173) 0:01:26.531 ******* 2026-02-23 21:11:48.330345 | controller | changed: [instance] 2026-02-23 21:11:48.521436 | controller | 2026-02-23 21:11:48.521462 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-23 21:11:48.521472 | controller | Monday 23 February 2026 21:11:48 +0000 (0:00:28.123) 0:01:54.655 ******* 2026-02-23 21:11:48.521482 | controller | ok: [instance] 2026-02-23 21:11:48.562180 | controller | 2026-02-23 21:11:48.562212 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-23 21:11:48.562220 | controller | Monday 23 February 2026 21:11:48 +0000 (0:00:00.191) 0:01:54.846 ******* 2026-02-23 21:11:48.562229 | controller | ok: [instance] => changed=false 2026-02-23 21:11:48.759782 | controller | msg: All assertions passed 2026-02-23 21:11:48.759816 | controller | 2026-02-23 21:11:48.759830 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-23 21:11:48.759840 | controller | Monday 23 February 2026 21:11:48 +0000 (0:00:00.040) 0:01:54.887 ******* 2026-02-23 21:11:48.759856 | controller | changed: [instance] 2026-02-23 21:11:48.760230 | controller | 2026-02-23 21:11:48.958000 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-23 21:11:48.958022 | controller | Monday 23 February 2026 21:11:48 +0000 (0:00:00.197) 0:01:55.085 ******* 2026-02-23 21:11:48.958035 | controller | ok: [instance] 2026-02-23 21:11:49.145276 | controller | 2026-02-23 21:11:49.145297 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-23 21:11:49.145306 | controller | Monday 23 February 2026 21:11:48 +0000 (0:00:00.198) 0:01:55.283 ******* 2026-02-23 21:11:49.145316 | controller | ok: [instance] 2026-02-23 21:11:49.166814 | controller | 2026-02-23 21:11:49.166858 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-23 21:11:49.166870 | controller | Monday 23 February 2026 21:11:49 +0000 (0:00:00.187) 0:01:55.470 ******* 2026-02-23 21:11:49.166884 | controller | skipping: [instance] 2026-02-23 21:11:49.166918 | controller | 2026-02-23 21:11:49.166929 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-23 21:11:49.166986 | controller | Monday 23 February 2026 21:11:49 +0000 (0:00:00.021) 0:01:55.492 ******* 2026-02-23 21:11:49.357227 | controller | ok: [instance] 2026-02-23 21:11:49.357435 | controller | 2026-02-23 21:11:49.357461 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-23 21:11:49.396737 | controller | Monday 23 February 2026 21:11:49 +0000 (0:00:00.190) 0:01:55.682 ******* 2026-02-23 21:11:49.396773 | controller | ok: [instance] => changed=false 2026-02-23 21:11:49.396799 | controller | msg: All assertions passed 2026-02-23 21:11:49.396807 | controller | 2026-02-23 21:11:49.397173 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-23 21:11:49.593274 | controller | Monday 23 February 2026 21:11:49 +0000 (0:00:00.039) 0:01:55.722 ******* 2026-02-23 21:11:49.593296 | controller | ok: [instance] 2026-02-23 21:11:49.763318 | controller | 2026-02-23 21:11:49.763336 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2026-02-23 21:11:49.763344 | controller | Monday 23 February 2026 21:11:49 +0000 (0:00:00.196) 0:01:55.918 ******* 2026-02-23 21:11:49.763352 | controller | ok: [instance] 2026-02-23 21:11:50.139509 | controller | 2026-02-23 21:11:50.139541 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2026-02-23 21:11:50.139558 | controller | Monday 23 February 2026 21:11:49 +0000 (0:00:00.169) 0:01:56.088 ******* 2026-02-23 21:11:50.139569 | controller | changed: [instance] 2026-02-23 21:11:50.310065 | controller | 2026-02-23 21:11:50.310087 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2026-02-23 21:11:50.310095 | controller | Monday 23 February 2026 21:11:50 +0000 (0:00:00.375) 0:01:56.464 ******* 2026-02-23 21:11:50.310105 | controller | ok: [instance] 2026-02-23 21:11:50.478814 | controller | 2026-02-23 21:11:50.478848 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2026-02-23 21:11:50.478856 | controller | Monday 23 February 2026 21:11:50 +0000 (0:00:00.170) 0:01:56.635 ******* 2026-02-23 21:11:50.478866 | controller | ok: [instance] 2026-02-23 21:11:50.478889 | controller | 2026-02-23 21:11:50.478897 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2026-02-23 21:11:50.478999 | controller | Monday 23 February 2026 21:11:50 +0000 (0:00:00.168) 0:01:56.804 ******* 2026-02-23 21:11:50.861741 | controller | changed: [instance] 2026-02-23 21:11:50.862062 | controller | 2026-02-23 21:11:50.882337 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2026-02-23 21:11:50.882353 | controller | Monday 23 February 2026 21:11:50 +0000 (0:00:00.383) 0:01:57.187 ******* 2026-02-23 21:11:50.882363 | controller | ok: [instance] 2026-02-23 21:11:51.092784 | controller | 2026-02-23 21:11:51.092818 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2026-02-23 21:11:51.092827 | controller | Monday 23 February 2026 21:11:50 +0000 (0:00:00.020) 0:01:57.208 ******* 2026-02-23 21:11:51.092838 | controller | ok: [instance] 2026-02-23 21:11:51.092866 | controller | 2026-02-23 21:11:51.092889 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2026-02-23 21:11:51.093016 | controller | Monday 23 February 2026 21:11:51 +0000 (0:00:00.210) 0:01:57.418 ******* 2026-02-23 21:11:51.550872 | controller | ok: [instance] 2026-02-23 21:11:51.550965 | controller | 2026-02-23 21:11:51.550982 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2026-02-23 21:11:51.550998 | controller | Monday 23 February 2026 21:11:51 +0000 (0:00:00.457) 0:01:57.876 ******* 2026-02-23 21:11:51.672793 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-23 21:11:51.673065 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-23 21:11:51.673094 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-23 21:11:51.673107 | controller | 2026-02-23 21:11:51.952780 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2026-02-23 21:11:51.952806 | controller | Monday 23 February 2026 21:11:51 +0000 (0:00:00.121) 0:01:57.998 ******* 2026-02-23 21:11:51.952817 | controller | changed: [instance] 2026-02-23 21:11:51.952920 | controller | 2026-02-23 21:11:51.952959 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2026-02-23 21:11:51.952979 | controller | Monday 23 February 2026 21:11:51 +0000 (0:00:00.279) 0:01:58.277 ******* 2026-02-23 21:11:52.168784 | controller | changed: [instance] 2026-02-23 21:11:52.168969 | controller | 2026-02-23 21:11:52.168989 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2026-02-23 21:11:52.452704 | controller | Monday 23 February 2026 21:11:52 +0000 (0:00:00.216) 0:01:58.494 ******* 2026-02-23 21:11:52.452729 | controller | changed: [instance] 2026-02-23 21:11:52.482461 | controller | 2026-02-23 21:11:52.482480 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2026-02-23 21:11:52.482487 | controller | Monday 23 February 2026 21:11:52 +0000 (0:00:00.283) 0:01:58.778 ******* 2026-02-23 21:11:52.482496 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-23 21:11:52.527706 | controller | 2026-02-23 21:11:52.527727 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-23 21:11:52.527736 | controller | Monday 23 February 2026 21:11:52 +0000 (0:00:00.029) 0:01:58.808 ******* 2026-02-23 21:11:52.527745 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-23 21:11:52.528030 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-23 21:11:52.528048 | controller | 2026-02-23 21:11:52.755410 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-23 21:11:52.755433 | controller | Monday 23 February 2026 21:11:52 +0000 (0:00:00.045) 0:01:58.853 ******* 2026-02-23 21:11:52.755446 | controller | ok: [instance] 2026-02-23 21:11:52.799863 | controller | 2026-02-23 21:11:52.799914 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-23 21:11:52.799929 | controller | Monday 23 February 2026 21:11:52 +0000 (0:00:00.227) 0:01:59.080 ******* 2026-02-23 21:11:52.799947 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-23 21:11:53.022452 | controller | ok: [instance] => (item=cifmw-public) 2026-02-23 21:11:53.022477 | controller | 2026-02-23 21:11:53.022485 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-23 21:11:53.022492 | controller | Monday 23 February 2026 21:11:52 +0000 (0:00:00.044) 0:01:59.125 ******* 2026-02-23 21:11:53.022501 | controller | ok: [instance] 2026-02-23 21:11:53.214259 | controller | 2026-02-23 21:11:53.214281 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-23 21:11:53.214290 | controller | Monday 23 February 2026 21:11:53 +0000 (0:00:00.222) 0:01:59.347 ******* 2026-02-23 21:11:53.214300 | controller | ok: [instance] 2026-02-23 21:11:53.490165 | controller | 2026-02-23 21:11:53.490188 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2026-02-23 21:11:53.490196 | controller | Monday 23 February 2026 21:11:53 +0000 (0:00:00.192) 0:01:59.539 ******* 2026-02-23 21:11:53.490216 | controller | changed: [instance] 2026-02-23 21:11:53.714289 | controller | 2026-02-23 21:11:53.714314 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-23 21:11:53.714323 | controller | Monday 23 February 2026 21:11:53 +0000 (0:00:00.275) 0:01:59.815 ******* 2026-02-23 21:11:53.714334 | controller | ok: [instance] 2026-02-23 21:11:53.755980 | controller | 2026-02-23 21:11:53.755997 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-23 21:11:53.756004 | controller | Monday 23 February 2026 21:11:53 +0000 (0:00:00.224) 0:02:00.039 ******* 2026-02-23 21:11:53.756013 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-23 21:11:53.978255 | controller | ok: [instance] => (item=cifmw-public) 2026-02-23 21:11:53.978276 | controller | 2026-02-23 21:11:53.978285 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-23 21:11:53.978291 | controller | Monday 23 February 2026 21:11:53 +0000 (0:00:00.041) 0:02:00.081 ******* 2026-02-23 21:11:53.978301 | controller | ok: [instance] 2026-02-23 21:11:54.172736 | controller | 2026-02-23 21:11:54.172769 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-23 21:11:54.172777 | controller | Monday 23 February 2026 21:11:53 +0000 (0:00:00.222) 0:02:00.303 ******* 2026-02-23 21:11:54.172788 | controller | ok: [instance] 2026-02-23 21:11:54.172812 | controller | 2026-02-23 21:11:54.172821 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2026-02-23 21:11:54.172946 | controller | Monday 23 February 2026 21:11:54 +0000 (0:00:00.194) 0:02:00.498 ******* 2026-02-23 21:11:54.446762 | controller | changed: [instance] 2026-02-23 21:11:54.446956 | controller | 2026-02-23 21:11:54.446978 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2026-02-23 21:11:54.468796 | controller | Monday 23 February 2026 21:11:54 +0000 (0:00:00.274) 0:02:00.772 ******* 2026-02-23 21:11:54.468825 | controller | skipping: [instance] 2026-02-23 21:11:54.469007 | controller | 2026-02-23 21:11:54.469033 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2026-02-23 21:11:54.497527 | controller | Monday 23 February 2026 21:11:54 +0000 (0:00:00.022) 0:02:00.794 ******* 2026-02-23 21:11:54.497563 | controller | skipping: [instance] 2026-02-23 21:11:54.524712 | controller | 2026-02-23 21:11:54.524752 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2026-02-23 21:11:54.524767 | controller | Monday 23 February 2026 21:11:54 +0000 (0:00:00.028) 0:02:00.822 ******* 2026-02-23 21:11:54.524801 | controller | skipping: [instance] 2026-02-23 21:11:54.550231 | controller | 2026-02-23 21:11:54.550249 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2026-02-23 21:11:54.550256 | controller | Monday 23 February 2026 21:11:54 +0000 (0:00:00.027) 0:02:00.849 ******* 2026-02-23 21:11:54.550264 | controller | skipping: [instance] 2026-02-23 21:11:54.754675 | controller | 2026-02-23 21:11:54.754698 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-23 21:11:54.754710 | controller | Monday 23 February 2026 21:11:54 +0000 (0:00:00.025) 0:02:00.875 ******* 2026-02-23 21:11:54.754722 | controller | changed: [instance] 2026-02-23 21:11:54.791930 | controller | 2026-02-23 21:11:54.791951 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-23 21:11:54.791960 | controller | Monday 23 February 2026 21:11:54 +0000 (0:00:00.204) 0:02:01.080 ******* 2026-02-23 21:11:54.791969 | controller | ok: [instance] 2026-02-23 21:11:54.792119 | controller | 2026-02-23 21:11:54.792286 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-23 21:11:54.792433 | controller | Monday 23 February 2026 21:11:54 +0000 (0:00:00.037) 0:02:01.117 ******* 2026-02-23 21:11:54.844323 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-23 21:11:54.844586 | controller | 2026-02-23 21:11:54.844873 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-23 21:11:54.845128 | controller | Monday 23 February 2026 21:11:54 +0000 (0:00:00.052) 0:02:01.170 ******* 2026-02-23 21:11:55.034927 | controller | ok: [instance] 2026-02-23 21:11:55.035080 | controller | 2026-02-23 21:11:55.035245 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-23 21:11:55.035391 | controller | Monday 23 February 2026 21:11:55 +0000 (0:00:00.190) 0:02:01.360 ******* 2026-02-23 21:11:55.097459 | controller | ok: [instance] 2026-02-23 21:11:55.097754 | controller | 2026-02-23 21:11:55.098012 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-23 21:11:55.098216 | controller | Monday 23 February 2026 21:11:55 +0000 (0:00:00.062) 0:02:01.423 ******* 2026-02-23 21:11:55.143590 | controller | ok: [instance] 2026-02-23 21:11:55.143888 | controller | 2026-02-23 21:11:55.144139 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-23 21:11:55.144317 | controller | Monday 23 February 2026 21:11:55 +0000 (0:00:00.046) 0:02:01.469 ******* 2026-02-23 21:11:55.186052 | controller | skipping: [instance] 2026-02-23 21:11:55.186301 | controller | 2026-02-23 21:11:55.186440 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-23 21:11:55.186568 | controller | Monday 23 February 2026 21:11:55 +0000 (0:00:00.042) 0:02:01.511 ******* 2026-02-23 21:11:55.227274 | controller | skipping: [instance] 2026-02-23 21:11:55.227478 | controller | 2026-02-23 21:11:55.227602 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-23 21:11:55.227746 | controller | Monday 23 February 2026 21:11:55 +0000 (0:00:00.041) 0:02:01.553 ******* 2026-02-23 21:11:55.285369 | controller | 2026-02-23 21:11:55.285591 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-23 21:11:55.285749 | controller | Monday 23 February 2026 21:11:55 +0000 (0:00:00.058) 0:02:01.611 ******* 2026-02-23 21:11:55.668432 | controller | ok: [instance] => (item=artifacts) 2026-02-23 21:11:56.825173 | controller | ok: [instance] => (item=logs) 2026-02-23 21:11:56.825202 | controller | 2026-02-23 21:11:56.825211 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-23 21:11:56.825233 | controller | Monday 23 February 2026 21:11:55 +0000 (0:00:00.382) 0:02:01.993 ******* 2026-02-23 21:11:56.825243 | controller | ok: [instance] 2026-02-23 21:11:57.033303 | controller | 2026-02-23 21:11:57.033325 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-23 21:11:57.033334 | controller | Monday 23 February 2026 21:11:56 +0000 (0:00:01.156) 0:02:03.150 ******* 2026-02-23 21:11:57.033344 | controller | changed: [instance] 2026-02-23 21:11:57.388083 | controller | 2026-02-23 21:11:57.388104 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-23 21:11:57.388112 | controller | Monday 23 February 2026 21:11:57 +0000 (0:00:00.208) 0:02:03.358 ******* 2026-02-23 21:11:57.388121 | controller | changed: [instance] 2026-02-23 21:11:57.751603 | controller | 2026-02-23 21:11:57.751624 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-23 21:11:57.751631 | controller | Monday 23 February 2026 21:11:57 +0000 (0:00:00.354) 0:02:03.713 ******* 2026-02-23 21:11:57.751639 | controller | changed: [instance] 2026-02-23 21:11:57.794721 | controller | 2026-02-23 21:11:57.794745 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-23 21:11:57.794754 | controller | Monday 23 February 2026 21:11:57 +0000 (0:00:00.363) 0:02:04.077 ******* 2026-02-23 21:11:57.794764 | controller | skipping: [instance] 2026-02-23 21:11:57.994611 | controller | 2026-02-23 21:11:57.994629 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-23 21:11:57.994637 | controller | Monday 23 February 2026 21:11:57 +0000 (0:00:00.043) 0:02:04.120 ******* 2026-02-23 21:11:57.994649 | controller | ok: [instance] 2026-02-23 21:11:58.037878 | controller | 2026-02-23 21:11:58.037921 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-23 21:11:58.037935 | controller | Monday 23 February 2026 21:11:57 +0000 (0:00:00.199) 0:02:04.319 ******* 2026-02-23 21:11:58.037951 | controller | skipping: [instance] 2026-02-23 21:11:58.037988 | controller | 2026-02-23 21:11:58.038002 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-23 21:11:58.274917 | controller | Monday 23 February 2026 21:11:58 +0000 (0:00:00.043) 0:02:04.363 ******* 2026-02-23 21:11:58.274944 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2026-02-23 21:11:58.274998 | controller | changed: [instance] 2026-02-23 21:11:58.275101 | controller | 2026-02-23 21:11:58.275198 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-23 21:11:58.275314 | controller | Monday 23 February 2026 21:11:58 +0000 (0:00:00.237) 0:02:04.600 ******* 2026-02-23 21:11:58.558626 | controller | changed: [instance] 2026-02-23 21:11:58.604833 | controller | 2026-02-23 21:11:58.604870 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-23 21:11:58.604886 | controller | Monday 23 February 2026 21:11:58 +0000 (0:00:00.283) 0:02:04.884 ******* 2026-02-23 21:11:58.604896 | controller | skipping: [instance] 2026-02-23 21:11:58.604913 | controller | 2026-02-23 21:11:58.604921 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2026-02-23 21:11:58.604996 | controller | Monday 23 February 2026 21:11:58 +0000 (0:00:00.046) 0:02:04.930 ******* 2026-02-23 21:11:58.633408 | controller | skipping: [instance] 2026-02-23 21:11:58.633496 | controller | 2026-02-23 21:11:58.633590 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2026-02-23 21:11:58.633694 | controller | Monday 23 February 2026 21:11:58 +0000 (0:00:00.028) 0:02:04.959 ******* 2026-02-23 21:11:58.866278 | controller | changed: [instance] 2026-02-23 21:11:58.866354 | controller | 2026-02-23 21:11:58.866450 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2026-02-23 21:11:58.866542 | controller | Monday 23 February 2026 21:11:58 +0000 (0:00:00.232) 0:02:05.192 ******* 2026-02-23 21:11:59.106365 | controller | changed: [instance] 2026-02-23 21:11:59.427053 | controller | 2026-02-23 21:11:59.427083 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2026-02-23 21:11:59.427091 | controller | Monday 23 February 2026 21:11:59 +0000 (0:00:00.239) 0:02:05.431 ******* 2026-02-23 21:11:59.427104 | controller | changed: [instance] 2026-02-23 21:11:59.457449 | controller | 2026-02-23 21:11:59.457471 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2026-02-23 21:11:59.457478 | controller | Monday 23 February 2026 21:11:59 +0000 (0:00:00.320) 0:02:05.752 ******* 2026-02-23 21:11:59.457488 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-23 21:11:59.500575 | controller | 2026-02-23 21:11:59.500593 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-23 21:11:59.500600 | controller | Monday 23 February 2026 21:11:59 +0000 (0:00:00.030) 0:02:05.782 ******* 2026-02-23 21:11:59.500608 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-23 21:11:59.747081 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-23 21:11:59.747111 | controller | 2026-02-23 21:11:59.747119 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-23 21:11:59.747125 | controller | Monday 23 February 2026 21:11:59 +0000 (0:00:00.043) 0:02:05.826 ******* 2026-02-23 21:11:59.747134 | controller | ok: [instance] 2026-02-23 21:11:59.791830 | controller | 2026-02-23 21:11:59.791862 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-23 21:11:59.791872 | controller | Monday 23 February 2026 21:11:59 +0000 (0:00:00.246) 0:02:06.072 ******* 2026-02-23 21:11:59.791883 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-23 21:12:00.012555 | controller | ok: [instance] => (item=cifmw-public) 2026-02-23 21:12:00.012585 | controller | 2026-02-23 21:12:00.012593 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-23 21:12:00.012599 | controller | Monday 23 February 2026 21:11:59 +0000 (0:00:00.044) 0:02:06.117 ******* 2026-02-23 21:12:00.012608 | controller | ok: [instance] 2026-02-23 21:12:00.206484 | controller | 2026-02-23 21:12:00.206512 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-23 21:12:00.206520 | controller | Monday 23 February 2026 21:12:00 +0000 (0:00:00.220) 0:02:06.337 ******* 2026-02-23 21:12:00.206529 | controller | ok: [instance] 2026-02-23 21:12:00.487307 | controller | 2026-02-23 21:12:00.487341 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2026-02-23 21:12:00.487351 | controller | Monday 23 February 2026 21:12:00 +0000 (0:00:00.194) 0:02:06.531 ******* 2026-02-23 21:12:00.487366 | controller | changed: [instance] 2026-02-23 21:12:00.712652 | controller | 2026-02-23 21:12:00.712705 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-23 21:12:00.712714 | controller | Monday 23 February 2026 21:12:00 +0000 (0:00:00.280) 0:02:06.812 ******* 2026-02-23 21:12:00.712725 | controller | ok: [instance] 2026-02-23 21:12:00.756822 | controller | 2026-02-23 21:12:00.756853 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-23 21:12:00.756866 | controller | Monday 23 February 2026 21:12:00 +0000 (0:00:00.225) 0:02:07.037 ******* 2026-02-23 21:12:00.756881 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-23 21:12:00.756960 | controller | ok: [instance] => (item=cifmw-public) 2026-02-23 21:12:00.756975 | controller | 2026-02-23 21:12:00.756982 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-23 21:12:00.756990 | controller | Monday 23 February 2026 21:12:00 +0000 (0:00:00.044) 0:02:07.082 ******* 2026-02-23 21:12:00.984729 | controller | ok: [instance] 2026-02-23 21:12:01.196291 | controller | 2026-02-23 21:12:01.196323 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-23 21:12:01.196331 | controller | Monday 23 February 2026 21:12:00 +0000 (0:00:00.227) 0:02:07.310 ******* 2026-02-23 21:12:01.196341 | controller | ok: [instance] 2026-02-23 21:12:01.493086 | controller | 2026-02-23 21:12:01.493117 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2026-02-23 21:12:01.493125 | controller | Monday 23 February 2026 21:12:01 +0000 (0:00:00.211) 0:02:07.521 ******* 2026-02-23 21:12:01.493138 | controller | changed: [instance] 2026-02-23 21:12:01.514492 | controller | 2026-02-23 21:12:01.514525 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2026-02-23 21:12:01.514535 | controller | Monday 23 February 2026 21:12:01 +0000 (0:00:00.296) 0:02:07.818 ******* 2026-02-23 21:12:01.514545 | controller | skipping: [instance] 2026-02-23 21:12:01.541874 | controller | 2026-02-23 21:12:01.541921 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2026-02-23 21:12:01.541931 | controller | Monday 23 February 2026 21:12:01 +0000 (0:00:00.021) 0:02:07.839 ******* 2026-02-23 21:12:01.541945 | controller | skipping: [instance] 2026-02-23 21:12:01.570465 | controller | 2026-02-23 21:12:01.570489 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2026-02-23 21:12:01.570497 | controller | Monday 23 February 2026 21:12:01 +0000 (0:00:00.027) 0:02:07.867 ******* 2026-02-23 21:12:01.570507 | controller | skipping: [instance] 2026-02-23 21:12:01.595759 | controller | 2026-02-23 21:12:01.595787 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2026-02-23 21:12:01.595796 | controller | Monday 23 February 2026 21:12:01 +0000 (0:00:00.028) 0:02:07.896 ******* 2026-02-23 21:12:01.595806 | controller | skipping: [instance] 2026-02-23 21:12:01.595838 | controller | 2026-02-23 21:12:01.595847 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-23 21:12:01.595968 | controller | Monday 23 February 2026 21:12:01 +0000 (0:00:00.025) 0:02:07.921 ******* 2026-02-23 21:12:01.812769 | controller | changed: [instance] 2026-02-23 21:12:01.812997 | controller | 2026-02-23 21:12:01.813018 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-23 21:12:01.850746 | controller | Monday 23 February 2026 21:12:01 +0000 (0:00:00.216) 0:02:08.138 ******* 2026-02-23 21:12:01.850785 | controller | ok: [instance] 2026-02-23 21:12:01.902419 | controller | 2026-02-23 21:12:01.902452 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-23 21:12:01.902465 | controller | Monday 23 February 2026 21:12:01 +0000 (0:00:00.037) 0:02:08.175 ******* 2026-02-23 21:12:01.902482 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-23 21:12:02.096704 | controller | 2026-02-23 21:12:02.096723 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-23 21:12:02.096731 | controller | Monday 23 February 2026 21:12:01 +0000 (0:00:00.051) 0:02:08.227 ******* 2026-02-23 21:12:02.096740 | controller | ok: [instance] 2026-02-23 21:12:02.157232 | controller | 2026-02-23 21:12:02.157251 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-23 21:12:02.157258 | controller | Monday 23 February 2026 21:12:02 +0000 (0:00:00.194) 0:02:08.421 ******* 2026-02-23 21:12:02.157267 | controller | ok: [instance] 2026-02-23 21:12:02.205562 | controller | 2026-02-23 21:12:02.205595 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-23 21:12:02.205609 | controller | Monday 23 February 2026 21:12:02 +0000 (0:00:00.060) 0:02:08.482 ******* 2026-02-23 21:12:02.205625 | controller | ok: [instance] 2026-02-23 21:12:02.205782 | controller | 2026-02-23 21:12:02.205909 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-23 21:12:02.206037 | controller | Monday 23 February 2026 21:12:02 +0000 (0:00:00.048) 0:02:08.531 ******* 2026-02-23 21:12:02.248334 | controller | skipping: [instance] 2026-02-23 21:12:02.248606 | controller | 2026-02-23 21:12:02.248813 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-23 21:12:02.248940 | controller | Monday 23 February 2026 21:12:02 +0000 (0:00:00.042) 0:02:08.574 ******* 2026-02-23 21:12:02.291052 | controller | skipping: [instance] 2026-02-23 21:12:02.291198 | controller | 2026-02-23 21:12:02.291341 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-23 21:12:02.291460 | controller | Monday 23 February 2026 21:12:02 +0000 (0:00:00.042) 0:02:08.616 ******* 2026-02-23 21:12:02.348009 | controller | 2026-02-23 21:12:02.348188 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-23 21:12:02.348355 | controller | Monday 23 February 2026 21:12:02 +0000 (0:00:00.057) 0:02:08.673 ******* 2026-02-23 21:12:02.737402 | controller | ok: [instance] => (item=artifacts) 2026-02-23 21:12:03.896765 | controller | ok: [instance] => (item=logs) 2026-02-23 21:12:03.896803 | controller | 2026-02-23 21:12:03.896812 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-23 21:12:03.896818 | controller | Monday 23 February 2026 21:12:02 +0000 (0:00:00.388) 0:02:09.062 ******* 2026-02-23 21:12:03.896828 | controller | ok: [instance] 2026-02-23 21:12:03.896847 | controller | 2026-02-23 21:12:03.896976 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-23 21:12:03.897006 | controller | Monday 23 February 2026 21:12:03 +0000 (0:00:01.159) 0:02:10.222 ******* 2026-02-23 21:12:04.108746 | controller | changed: [instance] 2026-02-23 21:12:04.108787 | controller | 2026-02-23 21:12:04.108795 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-23 21:12:04.108804 | controller | Monday 23 February 2026 21:12:04 +0000 (0:00:00.211) 0:02:10.434 ******* 2026-02-23 21:12:04.464053 | controller | changed: [instance] 2026-02-23 21:12:04.464104 | controller | 2026-02-23 21:12:04.464219 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-23 21:12:04.464339 | controller | Monday 23 February 2026 21:12:04 +0000 (0:00:00.355) 0:02:10.789 ******* 2026-02-23 21:12:04.821462 | controller | changed: [instance] 2026-02-23 21:12:04.821517 | controller | 2026-02-23 21:12:04.821629 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-23 21:12:04.821800 | controller | Monday 23 February 2026 21:12:04 +0000 (0:00:00.357) 0:02:11.147 ******* 2026-02-23 21:12:04.868427 | controller | skipping: [instance] 2026-02-23 21:12:05.061150 | controller | 2026-02-23 21:12:05.061168 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-23 21:12:05.061175 | controller | Monday 23 February 2026 21:12:04 +0000 (0:00:00.046) 0:02:11.193 ******* 2026-02-23 21:12:05.061183 | controller | ok: [instance] 2026-02-23 21:12:05.101836 | controller | 2026-02-23 21:12:05.101880 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-23 21:12:05.101894 | controller | Monday 23 February 2026 21:12:05 +0000 (0:00:00.192) 0:02:11.386 ******* 2026-02-23 21:12:05.101910 | controller | skipping: [instance] 2026-02-23 21:12:05.335473 | controller | 2026-02-23 21:12:05.335496 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-23 21:12:05.335505 | controller | Monday 23 February 2026 21:12:05 +0000 (0:00:00.040) 0:02:11.426 ******* 2026-02-23 21:12:05.335514 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2026-02-23 21:12:05.601331 | controller | changed: [instance] 2026-02-23 21:12:05.601353 | controller | 2026-02-23 21:12:05.601361 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-23 21:12:05.601367 | controller | Monday 23 February 2026 21:12:05 +0000 (0:00:00.233) 0:02:11.660 ******* 2026-02-23 21:12:05.601375 | controller | changed: [instance] 2026-02-23 21:12:05.644818 | controller | 2026-02-23 21:12:05.644860 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-23 21:12:05.644871 | controller | Monday 23 February 2026 21:12:05 +0000 (0:00:00.265) 0:02:11.926 ******* 2026-02-23 21:12:05.644886 | controller | skipping: [instance] 2026-02-23 21:12:05.644950 | controller | 2026-02-23 21:12:05.644988 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2026-02-23 21:12:05.645007 | controller | Monday 23 February 2026 21:12:05 +0000 (0:00:00.043) 0:02:11.970 ******* 2026-02-23 21:12:05.670805 | controller | skipping: [instance] 2026-02-23 21:12:05.902360 | controller | 2026-02-23 21:12:05.902383 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2026-02-23 21:12:05.902391 | controller | Monday 23 February 2026 21:12:05 +0000 (0:00:00.026) 0:02:11.996 ******* 2026-02-23 21:12:05.902402 | controller | changed: [instance] 2026-02-23 21:12:06.117799 | controller | 2026-02-23 21:12:06.117840 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2026-02-23 21:12:06.117864 | controller | Monday 23 February 2026 21:12:05 +0000 (0:00:00.231) 0:02:12.228 ******* 2026-02-23 21:12:06.117881 | controller | changed: [instance] 2026-02-23 21:12:06.393870 | controller | 2026-02-23 21:12:06.393896 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2026-02-23 21:12:06.393904 | controller | Monday 23 February 2026 21:12:06 +0000 (0:00:00.214) 0:02:12.442 ******* 2026-02-23 21:12:06.393913 | controller | changed: [instance] 2026-02-23 21:12:06.422161 | controller | 2026-02-23 21:12:06.422185 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2026-02-23 21:12:06.422195 | controller | Monday 23 February 2026 21:12:06 +0000 (0:00:00.276) 0:02:12.719 ******* 2026-02-23 21:12:06.422207 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-23 21:12:06.463555 | controller | 2026-02-23 21:12:06.463578 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-23 21:12:06.463588 | controller | Monday 23 February 2026 21:12:06 +0000 (0:00:00.028) 0:02:12.747 ******* 2026-02-23 21:12:06.463600 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-23 21:12:06.688389 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-23 21:12:06.688409 | controller | 2026-02-23 21:12:06.688416 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-23 21:12:06.688421 | controller | Monday 23 February 2026 21:12:06 +0000 (0:00:00.041) 0:02:12.788 ******* 2026-02-23 21:12:06.688429 | controller | ok: [instance] 2026-02-23 21:12:06.732759 | controller | 2026-02-23 21:12:06.732799 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-23 21:12:06.732811 | controller | Monday 23 February 2026 21:12:06 +0000 (0:00:00.224) 0:02:13.013 ******* 2026-02-23 21:12:06.732826 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-23 21:12:06.732859 | controller | ok: [instance] => (item=cifmw-public) 2026-02-23 21:12:06.732868 | controller | 2026-02-23 21:12:06.732878 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-23 21:12:06.733058 | controller | Monday 23 February 2026 21:12:06 +0000 (0:00:00.044) 0:02:13.058 ******* 2026-02-23 21:12:06.951821 | controller | ok: [instance] 2026-02-23 21:12:07.143277 | controller | 2026-02-23 21:12:07.143300 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-23 21:12:07.143307 | controller | Monday 23 February 2026 21:12:06 +0000 (0:00:00.218) 0:02:13.276 ******* 2026-02-23 21:12:07.143316 | controller | ok: [instance] 2026-02-23 21:12:08.461771 | controller | 2026-02-23 21:12:08.461814 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2026-02-23 21:12:08.461825 | controller | Monday 23 February 2026 21:12:07 +0000 (0:00:00.191) 0:02:13.468 ******* 2026-02-23 21:12:08.461839 | controller | changed: [instance] 2026-02-23 21:12:08.462297 | controller | 2026-02-23 21:12:08.681450 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-23 21:12:08.681470 | controller | Monday 23 February 2026 21:12:08 +0000 (0:00:01.318) 0:02:14.787 ******* 2026-02-23 21:12:08.681480 | controller | ok: [instance] 2026-02-23 21:12:08.724793 | controller | 2026-02-23 21:12:08.724828 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-23 21:12:08.724838 | controller | Monday 23 February 2026 21:12:08 +0000 (0:00:00.219) 0:02:15.007 ******* 2026-02-23 21:12:08.724850 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-23 21:12:08.724857 | controller | ok: [instance] => (item=cifmw-public) 2026-02-23 21:12:08.724864 | controller | 2026-02-23 21:12:08.724870 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-23 21:12:08.724879 | controller | Monday 23 February 2026 21:12:08 +0000 (0:00:00.043) 0:02:15.050 ******* 2026-02-23 21:12:08.944465 | controller | ok: [instance] 2026-02-23 21:12:09.139059 | controller | 2026-02-23 21:12:09.139076 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-23 21:12:09.139084 | controller | Monday 23 February 2026 21:12:08 +0000 (0:00:00.219) 0:02:15.269 ******* 2026-02-23 21:12:09.139092 | controller | ok: [instance] 2026-02-23 21:12:09.416629 | controller | 2026-02-23 21:12:09.416647 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2026-02-23 21:12:09.416654 | controller | Monday 23 February 2026 21:12:09 +0000 (0:00:00.194) 0:02:15.464 ******* 2026-02-23 21:12:09.416681 | controller | changed: [instance] 2026-02-23 21:12:09.437688 | controller | 2026-02-23 21:12:09.437724 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2026-02-23 21:12:09.437738 | controller | Monday 23 February 2026 21:12:09 +0000 (0:00:00.277) 0:02:15.741 ******* 2026-02-23 21:12:09.437760 | controller | skipping: [instance] 2026-02-23 21:12:09.465388 | controller | 2026-02-23 21:12:09.465409 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2026-02-23 21:12:09.465416 | controller | Monday 23 February 2026 21:12:09 +0000 (0:00:00.021) 0:02:15.763 ******* 2026-02-23 21:12:09.465423 | controller | skipping: [instance] 2026-02-23 21:12:09.492804 | controller | 2026-02-23 21:12:09.492841 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2026-02-23 21:12:09.492851 | controller | Monday 23 February 2026 21:12:09 +0000 (0:00:00.027) 0:02:15.790 ******* 2026-02-23 21:12:09.492863 | controller | skipping: [instance] 2026-02-23 21:12:09.518746 | controller | 2026-02-23 21:12:09.518760 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2026-02-23 21:12:09.518767 | controller | Monday 23 February 2026 21:12:09 +0000 (0:00:00.027) 0:02:15.818 ******* 2026-02-23 21:12:09.518775 | controller | skipping: [instance] 2026-02-23 21:12:09.518905 | controller | 2026-02-23 21:12:09.518936 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-23 21:12:09.518955 | controller | Monday 23 February 2026 21:12:09 +0000 (0:00:00.025) 0:02:15.844 ******* 2026-02-23 21:12:09.723781 | controller | changed: [instance] 2026-02-23 21:12:09.723896 | controller | 2026-02-23 21:12:09.724016 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-23 21:12:09.724128 | controller | Monday 23 February 2026 21:12:09 +0000 (0:00:00.205) 0:02:16.049 ******* 2026-02-23 21:12:09.760057 | controller | ok: [instance] 2026-02-23 21:12:09.760283 | controller | 2026-02-23 21:12:09.760515 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-23 21:12:09.760714 | controller | Monday 23 February 2026 21:12:09 +0000 (0:00:00.036) 0:02:16.085 ******* 2026-02-23 21:12:09.785829 | controller | skipping: [instance] 2026-02-23 21:12:09.786053 | controller | 2026-02-23 21:12:09.786135 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-23 21:12:09.786235 | controller | Monday 23 February 2026 21:12:09 +0000 (0:00:00.025) 0:02:16.111 ******* 2026-02-23 21:12:09.813672 | controller | skipping: [instance] 2026-02-23 21:12:09.813888 | controller | 2026-02-23 21:12:09.814090 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-23 21:12:09.814197 | controller | Monday 23 February 2026 21:12:09 +0000 (0:00:00.027) 0:02:16.139 ******* 2026-02-23 21:12:09.858960 | controller | skipping: [instance] 2026-02-23 21:12:09.859185 | controller | 2026-02-23 21:12:09.859284 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2026-02-23 21:12:09.859388 | controller | Monday 23 February 2026 21:12:09 +0000 (0:00:00.045) 0:02:16.184 ******* 2026-02-23 21:12:09.885519 | controller | skipping: [instance] 2026-02-23 21:12:09.885772 | controller | 2026-02-23 21:12:09.885999 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2026-02-23 21:12:09.886201 | controller | Monday 23 February 2026 21:12:09 +0000 (0:00:00.026) 0:02:16.211 ******* 2026-02-23 21:12:09.946233 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2026-02-23 21:12:09.946401 | controller | 2026-02-23 21:12:09.946501 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2026-02-23 21:12:09.946602 | controller | Monday 23 February 2026 21:12:09 +0000 (0:00:00.060) 0:02:16.271 ******* 2026-02-23 21:12:10.180786 | controller | ok: [instance] => (item=crc) 2026-02-23 21:12:12.251845 | controller | 2026-02-23 21:12:12.251900 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2026-02-23 21:12:12.251914 | controller | Monday 23 February 2026 21:12:10 +0000 (0:00:00.234) 0:02:16.506 ******* 2026-02-23 21:12:12.251932 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-23 21:12:12.252136 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-23 21:12:12.252152 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-23 21:12:12.252163 | controller | 2026-02-23 21:12:12.252176 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-23 21:12:13.075754 | controller | Monday 23 February 2026 21:12:12 +0000 (0:00:02.070) 0:02:18.576 ******* 2026-02-23 21:12:13.075802 | controller | changed: [instance] 2026-02-23 21:12:13.075836 | controller | 2026-02-23 21:12:13.075846 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-23 21:12:13.075922 | controller | Monday 23 February 2026 21:12:13 +0000 (0:00:00.824) 0:02:19.401 ******* 2026-02-23 21:12:13.839817 | controller | changed: [instance] 2026-02-23 21:12:14.636391 | controller | 2026-02-23 21:12:14.636423 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-23 21:12:14.636431 | controller | Monday 23 February 2026 21:12:13 +0000 (0:00:00.763) 0:02:20.165 ******* 2026-02-23 21:12:14.636442 | controller | changed: [instance] 2026-02-23 21:12:15.334167 | controller | 2026-02-23 21:12:15.334195 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2026-02-23 21:12:15.334208 | controller | Monday 23 February 2026 21:12:14 +0000 (0:00:00.792) 0:02:20.957 ******* 2026-02-23 21:12:15.334218 | controller | changed: [instance] => (item=compute-0.utility) 2026-02-23 21:12:38.254004 | controller | changed: [instance] => (item=controller-0.utility) 2026-02-23 21:12:38.254039 | controller | changed: [instance] => (item=crc-0.utility) 2026-02-23 21:12:38.254048 | controller | 2026-02-23 21:12:38.254054 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2026-02-23 21:12:38.254060 | controller | Monday 23 February 2026 21:12:15 +0000 (0:00:00.701) 0:02:21.659 ******* 2026-02-23 21:12:38.254071 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-02-23 21:12:38.373401 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2026-02-23 21:12:38.373430 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2026-02-23 21:12:38.373438 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2026-02-23 21:12:38.373444 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2026-02-23 21:12:38.373449 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2026-02-23 21:12:38.373454 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). 2026-02-23 21:12:38.373460 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j724417707268.24431', 'results_file': '/home/zuul/.ansible_async/j724417707268.24431', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2026-02-23 21:12:38.373473 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j884767370483.24448', 'results_file': '/home/zuul/.ansible_async/j884767370483.24448', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2026-02-23 21:12:38.373479 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j417677169368.24464', 'results_file': '/home/zuul/.ansible_async/j417677169368.24464', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2026-02-23 21:12:38.373490 | controller | 2026-02-23 21:12:38.373496 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2026-02-23 21:12:38.373501 | controller | Monday 23 February 2026 21:12:38 +0000 (0:00:22.918) 0:02:44.578 ******* 2026-02-23 21:12:38.373511 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-23 21:12:38.396918 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-23 21:12:38.396962 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-23 21:12:38.396970 | controller | 2026-02-23 21:12:38.396977 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-23 21:12:38.396983 | controller | Monday 23 February 2026 21:12:38 +0000 (0:00:00.120) 0:02:44.698 ******* 2026-02-23 21:12:38.396993 | controller | skipping: [instance] 2026-02-23 21:12:38.397011 | controller | 2026-02-23 21:12:38.397017 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2026-02-23 21:12:38.397024 | controller | Monday 23 February 2026 21:12:38 +0000 (0:00:00.023) 0:02:44.722 ******* 2026-02-23 21:12:38.436017 | controller | 2026-02-23 21:12:38.436075 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-23 21:12:38.436177 | controller | Monday 23 February 2026 21:12:38 +0000 (0:00:00.039) 0:02:44.761 ******* 2026-02-23 21:12:38.522974 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-23 21:12:38.523046 | controller | 2026-02-23 21:12:38.523146 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-23 21:12:38.523237 | controller | Monday 23 February 2026 21:12:38 +0000 (0:00:00.086) 0:02:44.848 ******* 2026-02-23 21:12:38.739045 | controller | changed: [instance] 2026-02-23 21:12:38.739093 | controller | 2026-02-23 21:12:38.739211 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-23 21:12:38.739311 | controller | Monday 23 February 2026 21:12:38 +0000 (0:00:00.215) 0:02:45.064 ******* 2026-02-23 21:12:38.981072 | controller | changed: [instance] 2026-02-23 21:12:38.981125 | controller | 2026-02-23 21:12:38.981219 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2026-02-23 21:12:38.981317 | controller | Monday 23 February 2026 21:12:38 +0000 (0:00:00.241) 0:02:45.306 ******* 2026-02-23 21:12:39.375983 | controller | changed: [instance] 2026-02-23 21:12:39.376048 | controller | 2026-02-23 21:12:39.376141 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2026-02-23 21:12:39.376234 | controller | Monday 23 February 2026 21:12:39 +0000 (0:00:00.394) 0:02:45.701 ******* 2026-02-23 21:12:39.402275 | controller | skipping: [instance] 2026-02-23 21:12:39.402379 | controller | 2026-02-23 21:12:39.402473 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-23 21:12:39.402578 | controller | Monday 23 February 2026 21:12:39 +0000 (0:00:00.026) 0:02:45.728 ******* 2026-02-23 21:12:39.428767 | controller | skipping: [instance] 2026-02-23 21:12:39.428851 | controller | 2026-02-23 21:12:39.428939 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2026-02-23 21:12:39.429037 | controller | Monday 23 February 2026 21:12:39 +0000 (0:00:00.026) 0:02:45.754 ******* 2026-02-23 21:12:39.473504 | controller | skipping: [instance] 2026-02-23 21:12:39.473575 | controller | 2026-02-23 21:12:39.473686 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2026-02-23 21:12:39.473773 | controller | Monday 23 February 2026 21:12:39 +0000 (0:00:00.044) 0:02:45.799 ******* 2026-02-23 21:12:39.517697 | controller | skipping: [instance] 2026-02-23 21:12:39.517780 | controller | 2026-02-23 21:12:39.517873 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-23 21:12:39.517961 | controller | Monday 23 February 2026 21:12:39 +0000 (0:00:00.044) 0:02:45.843 ******* 2026-02-23 21:12:39.541118 | controller | skipping: [instance] 2026-02-23 21:12:39.541210 | controller | 2026-02-23 21:12:39.541328 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2026-02-23 21:12:39.541430 | controller | Monday 23 February 2026 21:12:39 +0000 (0:00:00.023) 0:02:45.866 ******* 2026-02-23 21:12:39.578031 | controller | 2026-02-23 21:12:39.578110 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-23 21:12:39.578200 | controller | Monday 23 February 2026 21:12:39 +0000 (0:00:00.036) 0:02:45.903 ******* 2026-02-23 21:12:39.657291 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-23 21:12:39.657373 | controller | 2026-02-23 21:12:39.657476 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-23 21:12:39.657568 | controller | Monday 23 February 2026 21:12:39 +0000 (0:00:00.079) 0:02:45.983 ******* 2026-02-23 21:12:39.881265 | controller | ok: [instance] 2026-02-23 21:12:39.881322 | controller | 2026-02-23 21:12:39.881423 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-23 21:12:39.881527 | controller | Monday 23 February 2026 21:12:39 +0000 (0:00:00.223) 0:02:46.206 ******* 2026-02-23 21:12:40.110510 | controller | ok: [instance] 2026-02-23 21:12:40.110566 | controller | 2026-02-23 21:12:40.110704 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2026-02-23 21:12:40.110800 | controller | Monday 23 February 2026 21:12:40 +0000 (0:00:00.229) 0:02:46.436 ******* 2026-02-23 21:12:40.508170 | controller | changed: [instance] 2026-02-23 21:12:40.508220 | controller | 2026-02-23 21:12:40.508337 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2026-02-23 21:12:40.508424 | controller | Monday 23 February 2026 21:12:40 +0000 (0:00:00.397) 0:02:46.833 ******* 2026-02-23 21:12:40.534795 | controller | skipping: [instance] 2026-02-23 21:12:40.534853 | controller | 2026-02-23 21:12:40.534953 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-23 21:12:40.535067 | controller | Monday 23 February 2026 21:12:40 +0000 (0:00:00.026) 0:02:46.860 ******* 2026-02-23 21:12:40.561854 | controller | skipping: [instance] 2026-02-23 21:12:40.561934 | controller | 2026-02-23 21:12:40.562020 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2026-02-23 21:12:40.562130 | controller | Monday 23 February 2026 21:12:40 +0000 (0:00:00.027) 0:02:46.887 ******* 2026-02-23 21:12:42.192426 | controller | changed: [instance -> controller-0.instance] 2026-02-23 21:12:42.192475 | controller | 2026-02-23 21:12:42.192573 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2026-02-23 21:12:42.192678 | controller | Monday 23 February 2026 21:12:42 +0000 (0:00:01.630) 0:02:48.517 ******* 2026-02-23 21:12:43.370168 | controller | changed: [instance -> controller-0.instance] 2026-02-23 21:12:43.370226 | controller | 2026-02-23 21:12:43.370337 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-23 21:12:43.370434 | controller | Monday 23 February 2026 21:12:43 +0000 (0:00:01.177) 0:02:49.695 ******* 2026-02-23 21:12:43.420802 | controller | 2026-02-23 21:12:43.420900 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-23 21:12:43.421032 | controller | Monday 23 February 2026 21:12:43 +0000 (0:00:00.050) 0:02:49.746 ******* 2026-02-23 21:12:43.650819 | controller | ok: [instance] 2026-02-23 21:12:43.687120 | controller | 2026-02-23 21:12:43.687149 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-23 21:12:43.687157 | controller | Monday 23 February 2026 21:12:43 +0000 (0:00:00.229) 0:02:49.975 ******* 2026-02-23 21:12:43.687174 | controller | ok: [instance] 2026-02-23 21:12:43.687192 | controller | 2026-02-23 21:12:43.687310 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-23 21:12:43.687412 | controller | Monday 23 February 2026 21:12:43 +0000 (0:00:00.037) 0:02:50.012 ******* 2026-02-23 21:12:43.725045 | controller | skipping: [instance] 2026-02-23 21:12:43.725110 | controller | 2026-02-23 21:12:43.725222 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2026-02-23 21:12:43.725311 | controller | Monday 23 February 2026 21:12:43 +0000 (0:00:00.038) 0:02:50.050 ******* 2026-02-23 21:12:43.778388 | controller | 2026-02-23 21:12:43.778494 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-23 21:12:43.778579 | controller | Monday 23 February 2026 21:12:43 +0000 (0:00:00.053) 0:02:50.104 ******* 2026-02-23 21:12:43.874880 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2026-02-23 21:12:43.874958 | controller | 2026-02-23 21:12:43.875042 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-23 21:12:43.875134 | controller | Monday 23 February 2026 21:12:43 +0000 (0:00:00.096) 0:02:50.200 ******* 2026-02-23 21:12:44.122859 | controller | ok: [instance] 2026-02-23 21:12:44.122909 | controller | 2026-02-23 21:12:44.123007 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-23 21:12:44.123095 | controller | Monday 23 February 2026 21:12:44 +0000 (0:00:00.247) 0:02:50.448 ******* 2026-02-23 21:12:44.376736 | controller | ok: [instance] 2026-02-23 21:12:44.377006 | controller | 2026-02-23 21:12:44.806855 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2026-02-23 21:12:44.806899 | controller | Monday 23 February 2026 21:12:44 +0000 (0:00:00.253) 0:02:50.702 ******* 2026-02-23 21:12:44.806911 | controller | changed: [instance] 2026-02-23 21:12:45.733429 | controller | 2026-02-23 21:12:45.733473 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2026-02-23 21:12:45.733482 | controller | Monday 23 February 2026 21:12:44 +0000 (0:00:00.429) 0:02:51.132 ******* 2026-02-23 21:12:45.733494 | controller | changed: [instance] 2026-02-23 21:12:45.733802 | controller | 2026-02-23 21:12:45.733875 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-23 21:12:45.733980 | controller | Monday 23 February 2026 21:12:45 +0000 (0:00:00.926) 0:02:52.058 ******* 2026-02-23 21:12:45.772475 | controller | skipping: [instance] 2026-02-23 21:12:45.772756 | controller | 2026-02-23 21:12:45.822797 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2026-02-23 21:12:45.822834 | controller | Monday 23 February 2026 21:12:45 +0000 (0:00:00.039) 0:02:52.098 ******* 2026-02-23 21:12:45.822845 | controller | skipping: [instance] 2026-02-23 21:12:45.875579 | controller | 2026-02-23 21:12:45.875599 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2026-02-23 21:12:45.875606 | controller | Monday 23 February 2026 21:12:45 +0000 (0:00:00.050) 0:02:52.148 ******* 2026-02-23 21:12:45.875614 | controller | skipping: [instance] 2026-02-23 21:12:45.928897 | controller | 2026-02-23 21:12:45.928916 | controller | TASK [Create VBMC entity] ****************************************************** 2026-02-23 21:12:45.928923 | controller | Monday 23 February 2026 21:12:45 +0000 (0:00:00.052) 0:02:52.201 ******* 2026-02-23 21:12:45.928937 | controller | skipping: [instance] => (item=compute-0) 2026-02-23 21:12:46.168448 | controller | skipping: [instance] => (item=controller-0) 2026-02-23 21:12:46.168529 | controller | skipping: [instance] => (item=crc-0) 2026-02-23 21:12:46.168538 | controller | skipping: [instance] 2026-02-23 21:12:46.168546 | controller | 2026-02-23 21:12:46.168552 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2026-02-23 21:12:46.168559 | controller | Monday 23 February 2026 21:12:45 +0000 (0:00:00.053) 0:02:52.254 ******* 2026-02-23 21:12:46.168574 | controller | ok: [instance] 2026-02-23 21:12:46.168595 | controller | 2026-02-23 21:12:46.168603 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2026-02-23 21:12:46.569879 | controller | Monday 23 February 2026 21:12:46 +0000 (0:00:00.239) 0:02:52.494 ******* 2026-02-23 21:12:46.569947 | controller | changed: [instance] 2026-02-23 21:12:46.569974 | controller | 2026-02-23 21:12:46.570022 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2026-02-23 21:12:46.570031 | controller | Monday 23 February 2026 21:12:46 +0000 (0:00:00.401) 0:02:52.895 ******* 2026-02-23 21:12:46.606552 | controller | skipping: [instance] 2026-02-23 21:12:46.606605 | controller | 2026-02-23 21:12:46.606712 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2026-02-23 21:12:46.606799 | controller | Monday 23 February 2026 21:12:46 +0000 (0:00:00.036) 0:02:52.932 ******* 2026-02-23 21:12:46.643369 | controller | skipping: [instance] 2026-02-23 21:12:46.643470 | controller | 2026-02-23 21:12:46.643577 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2026-02-23 21:12:46.643688 | controller | Monday 23 February 2026 21:12:46 +0000 (0:00:00.036) 0:02:52.969 ******* 2026-02-23 21:12:46.682700 | controller | skipping: [instance] 2026-02-23 21:12:46.682767 | controller | 2026-02-23 21:12:46.682867 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2026-02-23 21:12:46.682953 | controller | Monday 23 February 2026 21:12:46 +0000 (0:00:00.039) 0:02:53.008 ******* 2026-02-23 21:12:47.520860 | controller | changed: [instance] 2026-02-23 21:12:47.520926 | controller | 2026-02-23 21:12:47.520962 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2026-02-23 21:12:47.521063 | controller | Monday 23 February 2026 21:12:47 +0000 (0:00:00.834) 0:02:53.842 ******* 2026-02-23 21:12:48.477871 | controller | changed: [instance] 2026-02-23 21:12:48.477952 | controller | 2026-02-23 21:12:48.478063 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2026-02-23 21:12:48.478080 | controller | Monday 23 February 2026 21:12:48 +0000 (0:00:00.960) 0:02:54.803 ******* 2026-02-23 21:12:48.520930 | controller | skipping: [instance] 2026-02-23 21:12:48.521011 | controller | 2026-02-23 21:12:48.521114 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2026-02-23 21:12:48.521216 | controller | Monday 23 February 2026 21:12:48 +0000 (0:00:00.043) 0:02:54.846 ******* 2026-02-23 21:12:48.584676 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2026-02-23 21:12:48.628805 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2026-02-23 21:12:48.628840 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2026-02-23 21:12:48.628848 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2026-02-23 21:12:48.628854 | controller | 2026-02-23 21:12:48.628861 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2026-02-23 21:12:48.628868 | controller | Monday 23 February 2026 21:12:48 +0000 (0:00:00.062) 0:02:54.909 ******* 2026-02-23 21:12:48.628882 | controller | skipping: [instance] 2026-02-23 21:12:48.667714 | controller | 2026-02-23 21:12:48.667742 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2026-02-23 21:12:48.667750 | controller | Monday 23 February 2026 21:12:48 +0000 (0:00:00.044) 0:02:54.954 ******* 2026-02-23 21:12:48.667764 | controller | skipping: [instance] 2026-02-23 21:12:48.706368 | controller | 2026-02-23 21:12:48.706391 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2026-02-23 21:12:48.706401 | controller | Monday 23 February 2026 21:12:48 +0000 (0:00:00.038) 0:02:54.993 ******* 2026-02-23 21:12:48.706412 | controller | skipping: [instance] 2026-02-23 21:12:48.742922 | controller | 2026-02-23 21:12:48.742941 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2026-02-23 21:12:48.742948 | controller | Monday 23 February 2026 21:12:48 +0000 (0:00:00.038) 0:02:55.031 ******* 2026-02-23 21:12:48.742958 | controller | skipping: [instance] 2026-02-23 21:12:49.347919 | controller | 2026-02-23 21:12:49.347977 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2026-02-23 21:12:49.347991 | controller | Monday 23 February 2026 21:12:48 +0000 (0:00:00.036) 0:02:55.068 ******* 2026-02-23 21:12:49.348012 | controller | changed: [instance] 2026-02-23 21:12:49.380808 | controller | 2026-02-23 21:12:49.380831 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2026-02-23 21:12:49.380840 | controller | Monday 23 February 2026 21:12:49 +0000 (0:00:00.605) 0:02:55.673 ******* 2026-02-23 21:12:49.380851 | controller | skipping: [instance] 2026-02-23 21:12:49.380873 | controller | 2026-02-23 21:12:49.381170 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2026-02-23 21:12:49.414810 | controller | Monday 23 February 2026 21:12:49 +0000 (0:00:00.033) 0:02:55.706 ******* 2026-02-23 21:12:49.414858 | controller | skipping: [instance] 2026-02-23 21:12:49.414971 | controller | 2026-02-23 21:12:49.414989 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2026-02-23 21:12:49.415003 | controller | Monday 23 February 2026 21:12:49 +0000 (0:00:00.034) 0:02:55.740 ******* 2026-02-23 21:12:49.447822 | controller | skipping: [instance] 2026-02-23 21:12:49.448217 | controller | 2026-02-23 21:12:49.448258 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-23 21:12:49.479815 | controller | Monday 23 February 2026 21:12:49 +0000 (0:00:00.032) 0:02:55.773 ******* 2026-02-23 21:12:49.479864 | controller | skipping: [instance] 2026-02-23 21:12:49.479929 | controller | 2026-02-23 21:12:49.480304 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-23 21:12:49.511833 | controller | Monday 23 February 2026 21:12:49 +0000 (0:00:00.032) 0:02:55.805 ******* 2026-02-23 21:12:49.511872 | controller | skipping: [instance] 2026-02-23 21:12:49.512050 | controller | 2026-02-23 21:12:49.512084 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-23 21:12:49.512105 | controller | Monday 23 February 2026 21:12:49 +0000 (0:00:00.031) 0:02:55.837 ******* 2026-02-23 21:12:49.541648 | controller | skipping: [instance] 2026-02-23 21:12:49.541914 | controller | 2026-02-23 21:12:49.542133 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-23 21:12:49.542346 | controller | Monday 23 February 2026 21:12:49 +0000 (0:00:00.030) 0:02:55.867 ******* 2026-02-23 21:12:49.572776 | controller | skipping: [instance] 2026-02-23 21:12:49.572884 | controller | 2026-02-23 21:12:49.573009 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-23 21:12:49.573127 | controller | Monday 23 February 2026 21:12:49 +0000 (0:00:00.031) 0:02:55.898 ******* 2026-02-23 21:12:49.610255 | controller | skipping: [instance] 2026-02-23 21:12:49.642604 | controller | 2026-02-23 21:12:49.642627 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-23 21:12:49.642635 | controller | Monday 23 February 2026 21:12:49 +0000 (0:00:00.037) 0:02:55.935 ******* 2026-02-23 21:12:49.642645 | controller | skipping: [instance] 2026-02-23 21:12:49.685806 | controller | 2026-02-23 21:12:49.685839 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-23 21:12:49.685850 | controller | Monday 23 February 2026 21:12:49 +0000 (0:00:00.032) 0:02:55.968 ******* 2026-02-23 21:12:49.685864 | controller | skipping: [instance] 2026-02-23 21:12:49.685885 | controller | 2026-02-23 21:12:49.685893 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2026-02-23 21:12:49.685910 | controller | Monday 23 February 2026 21:12:49 +0000 (0:00:00.043) 0:02:56.011 ******* 2026-02-23 21:12:49.717028 | controller | skipping: [instance] 2026-02-23 21:12:49.717078 | controller | 2026-02-23 21:12:49.717224 | controller | TASK [reproducer : Configure Controller node] ********************************** 2026-02-23 21:12:49.717306 | controller | Monday 23 February 2026 21:12:49 +0000 (0:00:00.031) 0:02:56.042 ******* 2026-02-23 21:12:49.866598 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2026-02-23 21:12:51.175381 | controller | 2026-02-23 21:12:51.175419 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-23 21:12:51.175426 | controller | Monday 23 February 2026 21:12:49 +0000 (0:00:00.148) 0:02:56.191 ******* 2026-02-23 21:12:51.175438 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-23 21:12:51.203797 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-23 21:12:51.203828 | controller | 2026-02-23 21:12:51.203838 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-23 21:12:51.203846 | controller | Monday 23 February 2026 21:12:51 +0000 (0:00:01.308) 0:02:57.500 ******* 2026-02-23 21:12:51.203859 | controller | skipping: [instance] 2026-02-23 21:12:51.203960 | controller | 2026-02-23 21:12:51.203996 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-23 21:12:51.204013 | controller | Monday 23 February 2026 21:12:51 +0000 (0:00:00.028) 0:02:57.529 ******* 2026-02-23 21:12:51.859385 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:12:51.859576 | controller | 2026-02-23 21:12:51.859620 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-23 21:12:51.859641 | controller | Monday 23 February 2026 21:12:51 +0000 (0:00:00.654) 0:02:58.184 ******* 2026-02-23 21:12:51.901754 | controller | skipping: [instance] 2026-02-23 21:12:51.949810 | controller | 2026-02-23 21:12:51.949878 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-23 21:12:51.949888 | controller | Monday 23 February 2026 21:12:51 +0000 (0:00:00.043) 0:02:58.227 ******* 2026-02-23 21:12:51.949901 | controller | skipping: [instance] 2026-02-23 21:12:51.949934 | controller | 2026-02-23 21:12:51.950032 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-23 21:12:51.950061 | controller | Monday 23 February 2026 21:12:51 +0000 (0:00:00.047) 0:02:58.274 ******* 2026-02-23 21:12:51.993274 | controller | skipping: [instance] 2026-02-23 21:12:52.043270 | controller | 2026-02-23 21:12:52.043287 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-23 21:12:52.043294 | controller | Monday 23 February 2026 21:12:51 +0000 (0:00:00.043) 0:02:58.318 ******* 2026-02-23 21:12:52.043302 | controller | skipping: [instance] 2026-02-23 21:12:52.082303 | controller | 2026-02-23 21:12:52.082328 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2026-02-23 21:12:52.082342 | controller | Monday 23 February 2026 21:12:52 +0000 (0:00:00.049) 0:02:58.368 ******* 2026-02-23 21:12:52.082351 | controller | skipping: [instance] 2026-02-23 21:12:52.124740 | controller | 2026-02-23 21:12:52.124774 | controller | TASK [reproducer : Install repos] ********************************************** 2026-02-23 21:12:52.124788 | controller | Monday 23 February 2026 21:12:52 +0000 (0:00:00.038) 0:02:58.407 ******* 2026-02-23 21:12:52.124803 | controller | skipping: [instance] 2026-02-23 21:12:52.125057 | controller | 2026-02-23 21:12:52.125306 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2026-02-23 21:12:52.125437 | controller | Monday 23 February 2026 21:12:52 +0000 (0:00:00.042) 0:02:58.450 ******* 2026-02-23 21:12:52.161838 | controller | skipping: [instance] 2026-02-23 21:12:52.161971 | controller | 2026-02-23 21:12:52.162244 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2026-02-23 21:12:52.162403 | controller | Monday 23 February 2026 21:12:52 +0000 (0:00:00.037) 0:02:58.487 ******* 2026-02-23 21:12:52.204055 | controller | skipping: [instance] 2026-02-23 21:12:52.204122 | controller | 2026-02-23 21:12:52.204135 | controller | TASK [reproducer : Install some tools] ***************************************** 2026-02-23 21:12:52.204366 | controller | Monday 23 February 2026 21:12:52 +0000 (0:00:00.041) 0:02:58.529 ******* 2026-02-23 21:12:53.445716 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:12:53.447072 | controller | 2026-02-23 21:12:53.447286 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2026-02-23 21:12:53.447452 | controller | Monday 23 February 2026 21:12:53 +0000 (0:00:01.236) 0:02:59.765 ******* 2026-02-23 21:12:54.694093 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:12:55.361161 | controller | 2026-02-23 21:12:55.361206 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2026-02-23 21:12:55.361215 | controller | Monday 23 February 2026 21:12:54 +0000 (0:00:01.251) 0:03:01.017 ******* 2026-02-23 21:12:55.361228 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:12:56.493074 | controller | 2026-02-23 21:12:56.493138 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2026-02-23 21:12:56.493156 | controller | Monday 23 February 2026 21:12:55 +0000 (0:00:00.667) 0:03:01.685 ******* 2026-02-23 21:12:56.493172 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:12:57.681322 | controller | 2026-02-23 21:12:57.681397 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2026-02-23 21:12:57.681407 | controller | Monday 23 February 2026 21:12:56 +0000 (0:00:01.132) 0:03:02.817 ******* 2026-02-23 21:12:57.681421 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-23 21:12:58.446428 | controller | skipping: [instance] => (item=compute-0) 2026-02-23 21:12:58.446485 | controller | skipping: [instance] => (item=controller-0) 2026-02-23 21:12:58.446493 | controller | skipping: [instance] => (item=crc-0) 2026-02-23 21:12:58.446498 | controller | 2026-02-23 21:12:58.446516 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2026-02-23 21:12:58.446524 | controller | Monday 23 February 2026 21:12:57 +0000 (0:00:01.188) 0:03:04.005 ******* 2026-02-23 21:12:58.446537 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-23 21:13:00.326329 | controller | skipping: [instance] => (item=compute-0) 2026-02-23 21:13:00.326395 | controller | skipping: [instance] => (item=controller-0) 2026-02-23 21:13:00.326402 | controller | skipping: [instance] => (item=crc-0) 2026-02-23 21:13:00.326408 | controller | 2026-02-23 21:13:00.326415 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2026-02-23 21:13:00.326422 | controller | Monday 23 February 2026 21:12:58 +0000 (0:00:00.765) 0:03:04.771 ******* 2026-02-23 21:13:00.326435 | controller | skipping: [instance] => (item=instance) 2026-02-23 21:13:00.901307 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2026-02-23 21:13:00.901383 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-23 21:13:00.901392 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2026-02-23 21:13:00.901399 | controller | 2026-02-23 21:13:00.901406 | controller | TASK [reproducer : Create kube directory] ************************************** 2026-02-23 21:13:00.901412 | controller | Monday 23 February 2026 21:13:00 +0000 (0:00:01.873) 0:03:06.644 ******* 2026-02-23 21:13:00.901427 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:13:01.902503 | controller | 2026-02-23 21:13:01.902560 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2026-02-23 21:13:01.902569 | controller | Monday 23 February 2026 21:13:00 +0000 (0:00:00.581) 0:03:07.225 ******* 2026-02-23 21:13:01.902583 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:13:02.900145 | controller | 2026-02-23 21:13:02.900188 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2026-02-23 21:13:02.900198 | controller | Monday 23 February 2026 21:13:01 +0000 (0:00:01.001) 0:03:08.227 ******* 2026-02-23 21:13:02.900210 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:13:02.936821 | controller | 2026-02-23 21:13:02.936857 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2026-02-23 21:13:02.936866 | controller | Monday 23 February 2026 21:13:02 +0000 (0:00:00.997) 0:03:09.225 ******* 2026-02-23 21:13:02.936877 | controller | skipping: [instance] 2026-02-23 21:13:03.512225 | controller | 2026-02-23 21:13:03.512282 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2026-02-23 21:13:03.512292 | controller | Monday 23 February 2026 21:13:02 +0000 (0:00:00.036) 0:03:09.261 ******* 2026-02-23 21:13:03.512307 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:13:03.512329 | controller | 2026-02-23 21:13:03.512434 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2026-02-23 21:13:03.512445 | controller | Monday 23 February 2026 21:13:03 +0000 (0:00:00.575) 0:03:09.837 ******* 2026-02-23 21:13:04.085943 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:13:04.086005 | controller | 2026-02-23 21:13:04.086041 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2026-02-23 21:13:04.086146 | controller | Monday 23 February 2026 21:13:04 +0000 (0:00:00.573) 0:03:10.410 ******* 2026-02-23 21:13:04.131803 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:13:04.131854 | controller | 2026-02-23 21:13:04.131946 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2026-02-23 21:13:04.132043 | controller | Monday 23 February 2026 21:13:04 +0000 (0:00:00.046) 0:03:10.457 ******* 2026-02-23 21:13:04.211478 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2026-02-23 21:13:04.211609 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2026-02-23 21:13:04.211795 | controller | 2026-02-23 21:13:04.211813 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-23 21:13:04.211904 | controller | Monday 23 February 2026 21:13:04 +0000 (0:00:00.079) 0:03:10.537 ******* 2026-02-23 21:13:04.280193 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-23 21:13:04.280266 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2026-02-23 21:13:04.280366 | controller | 2026-02-23 21:13:04.280470 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-23 21:13:04.280571 | controller | Monday 23 February 2026 21:13:04 +0000 (0:00:00.068) 0:03:10.605 ******* 2026-02-23 21:13:04.333032 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-23 21:13:04.333107 | controller | _secret_file: '' 2026-02-23 21:13:04.333192 | controller | 2026-02-23 21:13:04.333305 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-23 21:13:04.333491 | controller | Monday 23 February 2026 21:13:04 +0000 (0:00:00.053) 0:03:10.658 ******* 2026-02-23 21:13:04.389186 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-23 21:13:04.389281 | controller | _secret_content: my-default-location-place 2026-02-23 21:13:04.389381 | controller | 2026-02-23 21:13:04.389486 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-23 21:13:04.389601 | controller | Monday 23 February 2026 21:13:04 +0000 (0:00:00.056) 0:03:10.714 ******* 2026-02-23 21:13:04.443678 | controller | skipping: [instance] 2026-02-23 21:13:04.443764 | controller | 2026-02-23 21:13:04.443851 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-23 21:13:04.443939 | controller | Monday 23 February 2026 21:13:04 +0000 (0:00:00.054) 0:03:10.769 ******* 2026-02-23 21:13:04.497334 | controller | skipping: [instance] 2026-02-23 21:13:04.497479 | controller | 2026-02-23 21:13:04.497578 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-23 21:13:04.497687 | controller | Monday 23 February 2026 21:13:04 +0000 (0:00:00.053) 0:03:10.823 ******* 2026-02-23 21:13:04.555275 | controller | skipping: [instance] 2026-02-23 21:13:04.555332 | controller | 2026-02-23 21:13:04.555442 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-23 21:13:04.555530 | controller | Monday 23 February 2026 21:13:04 +0000 (0:00:00.057) 0:03:10.880 ******* 2026-02-23 21:13:05.737478 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:13:05.737557 | controller | 2026-02-23 21:13:05.737671 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-23 21:13:05.737694 | controller | Monday 23 February 2026 21:13:05 +0000 (0:00:01.181) 0:03:12.062 ******* 2026-02-23 21:13:05.794797 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-23 21:13:05.795261 | controller | _secret_dest: /home/zuul/ipmi-things 2026-02-23 21:13:05.795352 | controller | 2026-02-23 21:13:05.796358 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-23 21:13:05.796905 | controller | Monday 23 February 2026 21:13:05 +0000 (0:00:00.055) 0:03:12.118 ******* 2026-02-23 21:13:05.843958 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-23 21:13:05.844050 | controller | _secret_file: /tmp/ipmi-things 2026-02-23 21:13:05.844131 | controller | 2026-02-23 21:13:05.844229 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-23 21:13:05.844309 | controller | Monday 23 February 2026 21:13:05 +0000 (0:00:00.051) 0:03:12.169 ******* 2026-02-23 21:13:05.894777 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-23 21:13:05.894863 | controller | _secret_content: '' 2026-02-23 21:13:05.894947 | controller | 2026-02-23 21:13:05.895039 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-23 21:13:05.895130 | controller | Monday 23 February 2026 21:13:05 +0000 (0:00:00.050) 0:03:12.220 ******* 2026-02-23 21:13:05.971407 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2026-02-23 21:13:05.971490 | controller | msg: All assertions passed 2026-02-23 21:13:05.971626 | controller | 2026-02-23 21:13:05.971837 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-23 21:13:05.971941 | controller | Monday 23 February 2026 21:13:05 +0000 (0:00:00.076) 0:03:12.296 ******* 2026-02-23 21:13:06.757683 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:13:06.757780 | controller | 2026-02-23 21:13:06.757822 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-23 21:13:06.757941 | controller | Monday 23 February 2026 21:13:06 +0000 (0:00:00.785) 0:03:13.082 ******* 2026-02-23 21:13:07.853551 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:13:07.853904 | controller | 2026-02-23 21:13:07.910445 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-23 21:13:07.910469 | controller | Monday 23 February 2026 21:13:07 +0000 (0:00:01.096) 0:03:14.178 ******* 2026-02-23 21:13:07.910481 | controller | skipping: [instance] 2026-02-23 21:13:08.559184 | controller | 2026-02-23 21:13:08.559240 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2026-02-23 21:13:08.559251 | controller | Monday 23 February 2026 21:13:07 +0000 (0:00:00.057) 0:03:14.235 ******* 2026-02-23 21:13:08.559266 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:13:09.203566 | controller | 2026-02-23 21:13:09.203623 | controller | TASK [reproducer : Check if async file is still available] ********************* 2026-02-23 21:13:09.203632 | controller | Monday 23 February 2026 21:13:08 +0000 (0:00:00.647) 0:03:14.883 ******* 2026-02-23 21:13:09.203646 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:00.011696 | controller | 2026-02-23 21:14:00.011771 | controller | TASK [reproducer : Check package install status] ******************************* 2026-02-23 21:14:00.011785 | controller | Monday 23 February 2026 21:13:09 +0000 (0:00:00.644) 0:03:15.528 ******* 2026-02-23 21:14:00.011803 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2026-02-23 21:14:00.011914 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2026-02-23 21:14:00.011933 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2026-02-23 21:14:00.011938 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2026-02-23 21:14:00.011944 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2026-02-23 21:14:00.011955 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2026-02-23 21:14:00.011961 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2026-02-23 21:14:00.011966 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2026-02-23 21:14:00.011974 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2026-02-23 21:14:00.012083 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:00.012093 | controller | 2026-02-23 21:14:00.012169 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2026-02-23 21:14:00.012253 | controller | Monday 23 February 2026 21:14:00 +0000 (0:00:50.808) 0:04:06.336 ******* 2026-02-23 21:14:00.705672 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:00.705713 | controller | 2026-02-23 21:14:00.705798 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2026-02-23 21:14:00.705885 | controller | Monday 23 February 2026 21:14:00 +0000 (0:00:00.694) 0:04:07.030 ******* 2026-02-23 21:14:03.191430 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:03.251717 | controller | 2026-02-23 21:14:03.251845 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2026-02-23 21:14:03.251859 | controller | Monday 23 February 2026 21:14:03 +0000 (0:00:02.485) 0:04:09.516 ******* 2026-02-23 21:14:03.251872 | controller | skipping: [instance] 2026-02-23 21:14:03.315738 | controller | 2026-02-23 21:14:03.315766 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2026-02-23 21:14:03.315774 | controller | Monday 23 February 2026 21:14:03 +0000 (0:00:00.060) 0:04:09.576 ******* 2026-02-23 21:14:03.315785 | controller | skipping: [instance] 2026-02-23 21:14:04.068853 | controller | 2026-02-23 21:14:04.068907 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2026-02-23 21:14:04.068916 | controller | Monday 23 February 2026 21:14:03 +0000 (0:00:00.063) 0:04:09.640 ******* 2026-02-23 21:14:04.068930 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:04.735516 | controller | 2026-02-23 21:14:04.735559 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2026-02-23 21:14:04.735567 | controller | Monday 23 February 2026 21:14:04 +0000 (0:00:00.753) 0:04:10.393 ******* 2026-02-23 21:14:04.735578 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:05.086712 | controller | 2026-02-23 21:14:05.086745 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2026-02-23 21:14:05.086753 | controller | Monday 23 February 2026 21:14:04 +0000 (0:00:00.666) 0:04:11.060 ******* 2026-02-23 21:14:05.086762 | controller | changed: [instance] 2026-02-23 21:14:05.828504 | controller | 2026-02-23 21:14:05.828542 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2026-02-23 21:14:05.828550 | controller | Monday 23 February 2026 21:14:05 +0000 (0:00:00.351) 0:04:11.411 ******* 2026-02-23 21:14:05.828559 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:06.947619 | controller | 2026-02-23 21:14:06.947680 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2026-02-23 21:14:06.947693 | controller | Monday 23 February 2026 21:14:05 +0000 (0:00:00.741) 0:04:12.153 ******* 2026-02-23 21:14:06.947704 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:07.004590 | controller | 2026-02-23 21:14:07.004615 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-23 21:14:07.004637 | controller | Monday 23 February 2026 21:14:06 +0000 (0:00:01.118) 0:04:13.272 ******* 2026-02-23 21:14:07.004650 | controller | skipping: [instance] 2026-02-23 21:14:07.060258 | controller | 2026-02-23 21:14:07.060283 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-23 21:14:07.060293 | controller | Monday 23 February 2026 21:14:07 +0000 (0:00:00.057) 0:04:13.329 ******* 2026-02-23 21:14:07.060305 | controller | skipping: [instance] 2026-02-23 21:14:07.108409 | controller | 2026-02-23 21:14:07.108435 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-23 21:14:07.108463 | controller | Monday 23 February 2026 21:14:07 +0000 (0:00:00.055) 0:04:13.385 ******* 2026-02-23 21:14:07.108475 | controller | skipping: [instance] 2026-02-23 21:14:07.169139 | controller | 2026-02-23 21:14:07.169165 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2026-02-23 21:14:07.169175 | controller | Monday 23 February 2026 21:14:07 +0000 (0:00:00.048) 0:04:13.433 ******* 2026-02-23 21:14:07.169187 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:07.213712 | controller | 2026-02-23 21:14:07.213731 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2026-02-23 21:14:07.213738 | controller | Monday 23 February 2026 21:14:07 +0000 (0:00:00.060) 0:04:13.494 ******* 2026-02-23 21:14:07.213746 | controller | skipping: [instance] 2026-02-23 21:14:07.263899 | controller | 2026-02-23 21:14:07.263920 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2026-02-23 21:14:07.263929 | controller | Monday 23 February 2026 21:14:07 +0000 (0:00:00.044) 0:04:13.538 ******* 2026-02-23 21:14:07.263944 | controller | skipping: [instance] 2026-02-23 21:14:07.264097 | controller | 2026-02-23 21:14:07.264264 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2026-02-23 21:14:07.264414 | controller | Monday 23 February 2026 21:14:07 +0000 (0:00:00.050) 0:04:13.589 ******* 2026-02-23 21:14:07.310877 | controller | skipping: [instance] 2026-02-23 21:14:07.311011 | controller | 2026-02-23 21:14:07.311136 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2026-02-23 21:14:07.311255 | controller | Monday 23 February 2026 21:14:07 +0000 (0:00:00.046) 0:04:13.636 ******* 2026-02-23 21:14:07.975970 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:07.976171 | controller | 2026-02-23 21:14:07.976329 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2026-02-23 21:14:07.976472 | controller | Monday 23 February 2026 21:14:07 +0000 (0:00:00.659) 0:04:14.295 ******* 2026-02-23 21:14:08.089735 | controller | skipping: [instance] => (item=secret) 2026-02-23 21:14:08.089888 | controller | skipping: [instance] => (item=configmap) 2026-02-23 21:14:08.090028 | controller | skipping: [instance] => (item=pod) 2026-02-23 21:14:08.090150 | controller | skipping: [instance] => (item=service) 2026-02-23 21:14:08.090271 | controller | skipping: [instance] => (item=route) 2026-02-23 21:14:08.090390 | controller | skipping: [instance] 2026-02-23 21:14:08.090523 | controller | 2026-02-23 21:14:08.090645 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2026-02-23 21:14:08.090787 | controller | Monday 23 February 2026 21:14:08 +0000 (0:00:00.119) 0:04:14.415 ******* 2026-02-23 21:14:09.150168 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:09.150375 | controller | 2026-02-23 21:14:09.150559 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2026-02-23 21:14:09.150729 | controller | Monday 23 February 2026 21:14:09 +0000 (0:00:01.055) 0:04:15.470 ******* 2026-02-23 21:14:10.308361 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:10.348818 | controller | 2026-02-23 21:14:10.348851 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2026-02-23 21:14:10.348859 | controller | Monday 23 February 2026 21:14:10 +0000 (0:00:01.162) 0:04:16.633 ******* 2026-02-23 21:14:10.348869 | controller | skipping: [instance] 2026-02-23 21:14:10.388949 | controller | 2026-02-23 21:14:10.388969 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2026-02-23 21:14:10.388982 | controller | Monday 23 February 2026 21:14:10 +0000 (0:00:00.041) 0:04:16.674 ******* 2026-02-23 21:14:10.388991 | controller | skipping: [instance] 2026-02-23 21:14:10.468050 | controller | 2026-02-23 21:14:10.468072 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2026-02-23 21:14:10.468079 | controller | Monday 23 February 2026 21:14:10 +0000 (0:00:00.040) 0:04:16.714 ******* 2026-02-23 21:14:10.468088 | controller | skipping: [instance] => (item=secret) 2026-02-23 21:14:10.512324 | controller | skipping: [instance] => (item=configmap) 2026-02-23 21:14:10.512350 | controller | skipping: [instance] => (item=service) 2026-02-23 21:14:10.512360 | controller | skipping: [instance] => (item=route) 2026-02-23 21:14:10.512368 | controller | skipping: [instance] 2026-02-23 21:14:10.512375 | controller | 2026-02-23 21:14:10.512382 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2026-02-23 21:14:10.512390 | controller | Monday 23 February 2026 21:14:10 +0000 (0:00:00.078) 0:04:16.792 ******* 2026-02-23 21:14:10.512401 | controller | skipping: [instance] 2026-02-23 21:14:12.304876 | controller | 2026-02-23 21:14:12.304917 | controller | TASK [podman : Ensure podman is installed] ************************************* 2026-02-23 21:14:12.304925 | controller | Monday 23 February 2026 21:14:10 +0000 (0:00:00.044) 0:04:16.837 ******* 2026-02-23 21:14:12.304935 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:13.228001 | controller | 2026-02-23 21:14:13.228037 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2026-02-23 21:14:13.228050 | controller | Monday 23 February 2026 21:14:12 +0000 (0:00:01.792) 0:04:18.629 ******* 2026-02-23 21:14:13.228061 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:13.273138 | controller | 2026-02-23 21:14:13.273161 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2026-02-23 21:14:13.273168 | controller | Monday 23 February 2026 21:14:13 +0000 (0:00:00.922) 0:04:19.552 ******* 2026-02-23 21:14:13.273177 | controller | skipping: [instance] 2026-02-23 21:14:13.316692 | controller | 2026-02-23 21:14:13.316711 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2026-02-23 21:14:13.316718 | controller | Monday 23 February 2026 21:14:13 +0000 (0:00:00.046) 0:04:19.598 ******* 2026-02-23 21:14:13.316726 | controller | skipping: [instance] 2026-02-23 21:14:13.369475 | controller | 2026-02-23 21:14:13.369501 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2026-02-23 21:14:13.369511 | controller | Monday 23 February 2026 21:14:13 +0000 (0:00:00.042) 0:04:19.641 ******* 2026-02-23 21:14:13.369524 | controller | skipping: [instance] 2026-02-23 21:14:24.785850 | controller | 2026-02-23 21:14:24.785887 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2026-02-23 21:14:24.785895 | controller | Monday 23 February 2026 21:14:13 +0000 (0:00:00.053) 0:04:19.694 ******* 2026-02-23 21:14:24.785906 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:24.786064 | controller | 2026-02-23 21:14:24.786209 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2026-02-23 21:14:24.786356 | controller | Monday 23 February 2026 21:14:24 +0000 (0:00:11.411) 0:04:31.105 ******* 2026-02-23 21:14:26.407311 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:27.670037 | controller | 2026-02-23 21:14:27.670099 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-23 21:14:27.670108 | controller | Monday 23 February 2026 21:14:26 +0000 (0:00:01.626) 0:04:32.732 ******* 2026-02-23 21:14:27.670121 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-23 21:14:27.710181 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-23 21:14:27.710215 | controller | 2026-02-23 21:14:27.710224 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2026-02-23 21:14:27.710229 | controller | Monday 23 February 2026 21:14:27 +0000 (0:00:01.262) 0:04:33.994 ******* 2026-02-23 21:14:27.710239 | controller | skipping: [instance] 2026-02-23 21:14:28.416758 | controller | 2026-02-23 21:14:28.416805 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2026-02-23 21:14:28.416813 | controller | Monday 23 February 2026 21:14:27 +0000 (0:00:00.040) 0:04:34.035 ******* 2026-02-23 21:14:28.416824 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:28.464775 | controller | 2026-02-23 21:14:28.464809 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2026-02-23 21:14:28.464817 | controller | Monday 23 February 2026 21:14:28 +0000 (0:00:00.705) 0:04:34.741 ******* 2026-02-23 21:14:28.464826 | controller | skipping: [instance] 2026-02-23 21:14:28.518130 | controller | 2026-02-23 21:14:28.518167 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2026-02-23 21:14:28.518176 | controller | Monday 23 February 2026 21:14:28 +0000 (0:00:00.047) 0:04:34.789 ******* 2026-02-23 21:14:28.518187 | controller | skipping: [instance] 2026-02-23 21:14:28.571092 | controller | 2026-02-23 21:14:28.571113 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-23 21:14:28.571121 | controller | Monday 23 February 2026 21:14:28 +0000 (0:00:00.054) 0:04:34.843 ******* 2026-02-23 21:14:28.571130 | controller | skipping: [instance] 2026-02-23 21:14:28.620887 | controller | 2026-02-23 21:14:28.620907 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-23 21:14:28.620914 | controller | Monday 23 February 2026 21:14:28 +0000 (0:00:00.053) 0:04:34.896 ******* 2026-02-23 21:14:28.620923 | controller | skipping: [instance] 2026-02-23 21:14:28.753005 | controller | 2026-02-23 21:14:28.753025 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2026-02-23 21:14:28.753032 | controller | Monday 23 February 2026 21:14:28 +0000 (0:00:00.048) 0:04:34.945 ******* 2026-02-23 21:14:28.753041 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) 2026-02-23 21:14:29.921477 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) 2026-02-23 21:14:29.921521 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) 2026-02-23 21:14:29.921529 | controller | 2026-02-23 21:14:29.921536 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2026-02-23 21:14:29.921542 | controller | Monday 23 February 2026 21:14:28 +0000 (0:00:00.133) 0:04:35.078 ******* 2026-02-23 21:14:29.921552 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:29.967749 | controller | 2026-02-23 21:14:29.967778 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2026-02-23 21:14:29.967786 | controller | Monday 23 February 2026 21:14:29 +0000 (0:00:01.168) 0:04:36.246 ******* 2026-02-23 21:14:29.967797 | controller | skipping: [instance] 2026-02-23 21:14:30.104526 | controller | 2026-02-23 21:14:30.104560 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2026-02-23 21:14:30.104572 | controller | Monday 23 February 2026 21:14:29 +0000 (0:00:00.046) 0:04:36.293 ******* 2026-02-23 21:14:30.104585 | controller | 2026-02-23 21:14:30.162361 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2026-02-23 21:14:30.162386 | controller | Monday 23 February 2026 21:14:30 +0000 (0:00:00.136) 0:04:36.429 ******* 2026-02-23 21:14:30.162398 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:30.216874 | controller | 2026-02-23 21:14:30.216915 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-23 21:14:30.216924 | controller | Monday 23 February 2026 21:14:30 +0000 (0:00:00.057) 0:04:36.486 ******* 2026-02-23 21:14:30.216934 | controller | skipping: [instance] 2026-02-23 21:14:30.271725 | controller | 2026-02-23 21:14:30.271750 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-23 21:14:30.271757 | controller | Monday 23 February 2026 21:14:30 +0000 (0:00:00.055) 0:04:36.541 ******* 2026-02-23 21:14:30.271774 | controller | skipping: [instance] 2026-02-23 21:14:31.870403 | controller | 2026-02-23 21:14:31.870442 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2026-02-23 21:14:31.870451 | controller | Monday 23 February 2026 21:14:30 +0000 (0:00:00.055) 0:04:36.597 ******* 2026-02-23 21:14:31.870463 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:40.025630 | controller | 2026-02-23 21:14:40.025701 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2026-02-23 21:14:40.025711 | controller | Monday 23 February 2026 21:14:31 +0000 (0:00:01.598) 0:04:38.195 ******* 2026-02-23 21:14:40.025723 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1) 2026-02-23 21:14:40.161041 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b) 2026-02-23 21:14:40.161075 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282) 2026-02-23 21:14:40.161083 | controller | 2026-02-23 21:14:40.161090 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2026-02-23 21:14:40.161096 | controller | Monday 23 February 2026 21:14:40 +0000 (0:00:08.152) 0:04:46.347 ******* 2026-02-23 21:14:40.161111 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2026-02-23 21:14:40.413559 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2026-02-23 21:14:40.413600 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2026-02-23 21:14:40.413608 | controller | 2026-02-23 21:14:40.413615 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2026-02-23 21:14:40.413620 | controller | Monday 23 February 2026 21:14:40 +0000 (0:00:00.137) 0:04:46.485 ******* 2026-02-23 21:14:40.413630 | controller | ok: [instance -> localhost] 2026-02-23 21:14:42.391197 | controller | 2026-02-23 21:14:42.391246 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2026-02-23 21:14:42.391256 | controller | Monday 23 February 2026 21:14:40 +0000 (0:00:00.252) 0:04:46.738 ******* 2026-02-23 21:14:42.391269 | controller | changed: [instance -> localhost] => (item=controller-0) 2026-02-23 21:14:43.185069 | controller | 2026-02-23 21:14:43.185114 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2026-02-23 21:14:43.185123 | controller | Monday 23 February 2026 21:14:42 +0000 (0:00:01.977) 0:04:48.715 ******* 2026-02-23 21:14:43.185135 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:43.959214 | controller | 2026-02-23 21:14:43.959258 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2026-02-23 21:14:43.959266 | controller | Monday 23 February 2026 21:14:43 +0000 (0:00:00.794) 0:04:49.509 ******* 2026-02-23 21:14:43.959278 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:45.108571 | controller | 2026-02-23 21:14:45.108642 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2026-02-23 21:14:45.108651 | controller | Monday 23 February 2026 21:14:43 +0000 (0:00:00.773) 0:04:50.283 ******* 2026-02-23 21:14:45.108695 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:45.854803 | controller | 2026-02-23 21:14:45.854867 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2026-02-23 21:14:45.854880 | controller | Monday 23 February 2026 21:14:45 +0000 (0:00:01.148) 0:04:51.432 ******* 2026-02-23 21:14:45.854900 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:45.854929 | controller | 2026-02-23 21:14:45.854981 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2026-02-23 21:14:45.854994 | controller | Monday 23 February 2026 21:14:45 +0000 (0:00:00.742) 0:04:52.174 ******* 2026-02-23 21:14:46.919738 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:46.919944 | controller | 2026-02-23 21:14:46.920043 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2026-02-23 21:14:46.920145 | controller | Monday 23 February 2026 21:14:46 +0000 (0:00:01.069) 0:04:53.243 ******* 2026-02-23 21:14:47.554801 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:47.554858 | controller | 2026-02-23 21:14:47.554931 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2026-02-23 21:14:47.555022 | controller | Monday 23 February 2026 21:14:47 +0000 (0:00:00.636) 0:04:53.880 ******* 2026-02-23 21:14:48.169730 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:48.169801 | controller | 2026-02-23 21:14:48.169892 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2026-02-23 21:14:48.169989 | controller | Monday 23 February 2026 21:14:48 +0000 (0:00:00.614) 0:04:54.494 ******* 2026-02-23 21:14:49.571335 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-23 21:14:49.571394 | controller | 2026-02-23 21:14:49.571483 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-23 21:14:49.571589 | controller | Monday 23 February 2026 21:14:49 +0000 (0:00:01.401) 0:04:55.896 ******* 2026-02-23 21:14:49.613070 | controller | skipping: [instance] 2026-02-23 21:14:49.613122 | controller | 2026-02-23 21:14:49.613227 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-23 21:14:49.613319 | controller | Monday 23 February 2026 21:14:49 +0000 (0:00:00.042) 0:04:55.938 ******* 2026-02-23 21:14:49.651123 | controller | skipping: [instance] 2026-02-23 21:14:49.651195 | controller | 2026-02-23 21:14:49.651296 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-23 21:14:49.651388 | controller | Monday 23 February 2026 21:14:49 +0000 (0:00:00.038) 0:04:55.976 ******* 2026-02-23 21:14:49.690913 | controller | skipping: [instance] 2026-02-23 21:14:49.690971 | controller | 2026-02-23 21:14:49.691073 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-23 21:14:49.691162 | controller | Monday 23 February 2026 21:14:49 +0000 (0:00:00.039) 0:04:56.016 ******* 2026-02-23 21:14:49.736202 | controller | skipping: [instance] 2026-02-23 21:14:49.736272 | controller | 2026-02-23 21:14:49.736367 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-23 21:14:49.736469 | controller | Monday 23 February 2026 21:14:49 +0000 (0:00:00.045) 0:04:56.062 ******* 2026-02-23 21:14:49.779266 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:49.779341 | controller | 2026-02-23 21:14:49.779436 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-23 21:14:49.779564 | controller | Monday 23 February 2026 21:14:49 +0000 (0:00:00.043) 0:04:56.105 ******* 2026-02-23 21:14:49.887437 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-23 21:14:49.887515 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2026-02-23 21:14:49.887612 | controller | 2026-02-23 21:14:49.887731 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-23 21:14:49.887828 | controller | Monday 23 February 2026 21:14:49 +0000 (0:00:00.108) 0:04:56.213 ******* 2026-02-23 21:14:49.938560 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2026-02-23 21:14:49.938614 | controller | 2026-02-23 21:14:49.938751 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2026-02-23 21:14:49.938836 | controller | Monday 23 February 2026 21:14:49 +0000 (0:00:00.051) 0:04:56.264 ******* 2026-02-23 21:14:53.500477 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-23 21:14:53.500559 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2026-02-23 21:14:53.500592 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-23 21:14:53.500703 | controller | 2026-02-23 21:14:53.500814 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2026-02-23 21:14:53.500908 | controller | Monday 23 February 2026 21:14:53 +0000 (0:00:03.560) 0:04:59.825 ******* 2026-02-23 21:14:54.523740 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:55.021624 | controller | 2026-02-23 21:14:55.021699 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-23 21:14:55.021709 | controller | Monday 23 February 2026 21:14:54 +0000 (0:00:01.022) 0:05:00.848 ******* 2026-02-23 21:14:55.021728 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:55.021752 | controller | 2026-02-23 21:14:55.021758 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-23 21:14:55.021765 | controller | Monday 23 February 2026 21:14:55 +0000 (0:00:00.498) 0:05:01.346 ******* 2026-02-23 21:14:56.008215 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:56.102708 | controller | 2026-02-23 21:14:56.102750 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-23 21:14:56.102759 | controller | Monday 23 February 2026 21:14:56 +0000 (0:00:00.986) 0:05:02.332 ******* 2026-02-23 21:14:56.102771 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:56.169531 | controller | 2026-02-23 21:14:56.169572 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-23 21:14:56.169581 | controller | Monday 23 February 2026 21:14:56 +0000 (0:00:00.095) 0:05:02.427 ******* 2026-02-23 21:14:56.169593 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:57.330305 | controller | 2026-02-23 21:14:57.330348 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-23 21:14:57.330356 | controller | Monday 23 February 2026 21:14:56 +0000 (0:00:00.066) 0:05:02.494 ******* 2026-02-23 21:14:57.330368 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:14:58.359342 | controller | 2026-02-23 21:14:58.359382 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2026-02-23 21:14:58.359395 | controller | Monday 23 February 2026 21:14:57 +0000 (0:00:01.160) 0:05:03.655 ******* 2026-02-23 21:14:58.359406 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:04.452288 | controller | 2026-02-23 21:15:04.452378 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2026-02-23 21:15:04.452390 | controller | Monday 23 February 2026 21:14:58 +0000 (0:00:01.028) 0:05:04.684 ******* 2026-02-23 21:15:04.452411 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2026-02-23 21:15:04.452438 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:04.452447 | controller | 2026-02-23 21:15:04.452456 | controller | TASK [Configure ntp service] *************************************************** 2026-02-23 21:15:04.667345 | controller | Monday 23 February 2026 21:15:04 +0000 (0:00:06.092) 0:05:10.776 ******* 2026-02-23 21:15:04.667401 | controller | 2026-02-23 21:15:04.667434 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2026-02-23 21:15:04.667467 | controller | Monday 23 February 2026 21:15:04 +0000 (0:00:00.215) 0:05:10.992 ******* 2026-02-23 21:15:05.732386 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:06.732696 | controller | 2026-02-23 21:15:06.732736 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2026-02-23 21:15:06.732745 | controller | Monday 23 February 2026 21:15:05 +0000 (0:00:01.064) 0:05:12.057 ******* 2026-02-23 21:15:06.732762 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2026-02-23 21:15:06.732785 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2026-02-23 21:15:06.732884 | controller | 2026-02-23 21:15:06.732985 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2026-02-23 21:15:06.733082 | controller | Monday 23 February 2026 21:15:06 +0000 (0:00:01.000) 0:05:13.058 ******* 2026-02-23 21:15:07.774547 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:07.774600 | controller | 2026-02-23 21:15:07.774687 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2026-02-23 21:15:07.774785 | controller | Monday 23 February 2026 21:15:07 +0000 (0:00:01.038) 0:05:14.096 ******* 2026-02-23 21:15:08.432370 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:08.432423 | controller | 2026-02-23 21:15:08.432524 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2026-02-23 21:15:08.432624 | controller | Monday 23 February 2026 21:15:08 +0000 (0:00:00.661) 0:05:14.757 ******* 2026-02-23 21:15:08.624941 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2026-02-23 21:15:08.625007 | controller | 2026-02-23 21:15:08.625018 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2026-02-23 21:15:08.625202 | controller | Monday 23 February 2026 21:15:08 +0000 (0:00:00.192) 0:05:14.950 ******* 2026-02-23 21:15:09.097750 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:09.097863 | controller | 2026-02-23 21:15:09.097875 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2026-02-23 21:15:09.097884 | controller | Monday 23 February 2026 21:15:09 +0000 (0:00:00.472) 0:05:15.422 ******* 2026-02-23 21:15:09.590127 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-23 21:15:10.194490 | controller | 2026-02-23 21:15:10.194543 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2026-02-23 21:15:10.194552 | controller | Monday 23 February 2026 21:15:09 +0000 (0:00:00.492) 0:05:15.915 ******* 2026-02-23 21:15:10.194564 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-23 21:15:10.748108 | controller | 2026-02-23 21:15:10.748142 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2026-02-23 21:15:10.748161 | controller | Monday 23 February 2026 21:15:10 +0000 (0:00:00.604) 0:05:16.519 ******* 2026-02-23 21:15:10.748172 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-23 21:15:10.806056 | controller | 2026-02-23 21:15:10.806086 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2026-02-23 21:15:10.806097 | controller | Monday 23 February 2026 21:15:10 +0000 (0:00:00.553) 0:05:17.073 ******* 2026-02-23 21:15:10.806111 | controller | 2026-02-23 21:15:11.312586 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2026-02-23 21:15:11.312626 | controller | Monday 23 February 2026 21:15:10 +0000 (0:00:00.058) 0:05:17.131 ******* 2026-02-23 21:15:11.312639 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-23 21:15:12.068475 | controller | 2026-02-23 21:15:12.068526 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2026-02-23 21:15:12.068536 | controller | Monday 23 February 2026 21:15:11 +0000 (0:00:00.506) 0:05:17.637 ******* 2026-02-23 21:15:12.068548 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-23 21:15:12.102998 | controller | 2026-02-23 21:15:12.103026 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2026-02-23 21:15:12.103035 | controller | Monday 23 February 2026 21:15:12 +0000 (0:00:00.755) 0:05:18.393 ******* 2026-02-23 21:15:12.103046 | controller | skipping: [instance] 2026-02-23 21:15:12.139823 | controller | 2026-02-23 21:15:12.139847 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2026-02-23 21:15:12.139855 | controller | Monday 23 February 2026 21:15:12 +0000 (0:00:00.035) 0:05:18.428 ******* 2026-02-23 21:15:12.139865 | controller | skipping: [instance] 2026-02-23 21:15:12.367017 | controller | 2026-02-23 21:15:12.367044 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2026-02-23 21:15:12.367052 | controller | Monday 23 February 2026 21:15:12 +0000 (0:00:00.036) 0:05:18.465 ******* 2026-02-23 21:15:12.367062 | controller | changed: [instance] 2026-02-23 21:15:12.441560 | controller | 2026-02-23 21:15:12.441586 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2026-02-23 21:15:12.441594 | controller | Monday 23 February 2026 21:15:12 +0000 (0:00:00.226) 0:05:18.692 ******* 2026-02-23 21:15:12.441604 | controller | skipping: [instance] => (item=) 2026-02-23 21:15:12.477168 | controller | 2026-02-23 21:15:12.477195 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2026-02-23 21:15:12.477203 | controller | Monday 23 February 2026 21:15:12 +0000 (0:00:00.074) 0:05:18.767 ******* 2026-02-23 21:15:12.477219 | controller | ok: [instance] 2026-02-23 21:15:12.555023 | controller | 2026-02-23 21:15:12.555050 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-23 21:15:12.555058 | controller | Monday 23 February 2026 21:15:12 +0000 (0:00:00.035) 0:05:18.802 ******* 2026-02-23 21:15:12.555069 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-23 21:15:12.817862 | controller | 2026-02-23 21:15:12.817893 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-23 21:15:12.817905 | controller | Monday 23 February 2026 21:15:12 +0000 (0:00:00.077) 0:05:18.880 ******* 2026-02-23 21:15:12.817916 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-23 21:15:12.866093 | controller | 2026-02-23 21:15:12.866122 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2026-02-23 21:15:12.866129 | controller | Monday 23 February 2026 21:15:12 +0000 (0:00:00.262) 0:05:19.143 ******* 2026-02-23 21:15:12.866139 | controller | 2026-02-23 21:15:12.925986 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-23 21:15:12.926009 | controller | Monday 23 February 2026 21:15:12 +0000 (0:00:00.048) 0:05:19.191 ******* 2026-02-23 21:15:12.926019 | controller | ok: [instance] 2026-02-23 21:15:12.979138 | controller | 2026-02-23 21:15:12.979159 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-23 21:15:12.979166 | controller | Monday 23 February 2026 21:15:12 +0000 (0:00:00.059) 0:05:19.251 ******* 2026-02-23 21:15:12.979180 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-23 21:15:13.243498 | controller | 2026-02-23 21:15:13.243557 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-23 21:15:13.243566 | controller | Monday 23 February 2026 21:15:12 +0000 (0:00:00.053) 0:05:19.304 ******* 2026-02-23 21:15:13.243579 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-23 21:15:13.302044 | controller | 2026-02-23 21:15:13.302073 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-23 21:15:13.302081 | controller | Monday 23 February 2026 21:15:13 +0000 (0:00:00.263) 0:05:19.568 ******* 2026-02-23 21:15:13.302097 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-23 21:15:13.302188 | controller | skipping: [instance] 2026-02-23 21:15:13.302197 | controller | 2026-02-23 21:15:13.302202 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2026-02-23 21:15:13.302210 | controller | Monday 23 February 2026 21:15:13 +0000 (0:00:00.058) 0:05:19.626 ******* 2026-02-23 21:15:13.726770 | controller | changed: [instance] 2026-02-23 21:15:14.487064 | controller | 2026-02-23 21:15:14.487109 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-23 21:15:14.487118 | controller | Monday 23 February 2026 21:15:13 +0000 (0:00:00.412) 0:05:20.039 ******* 2026-02-23 21:15:14.487124 | controller | 2026-02-23 21:15:14.487130 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2026-02-23 21:15:14.487135 | controller | Monday 23 February 2026 21:15:13 +0000 (0:00:00.012) 0:05:20.051 ******* 2026-02-23 21:15:14.487146 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:15.883797 | controller | 2026-02-23 21:15:15.883843 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-23 21:15:15.883851 | controller | Monday 23 February 2026 21:15:14 +0000 (0:00:00.760) 0:05:20.812 ******* 2026-02-23 21:15:15.883864 | controller | changed: [instance] 2026-02-23 21:15:16.060351 | controller | 2026-02-23 21:15:16.060395 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2026-02-23 21:15:16.060403 | controller | Monday 23 February 2026 21:15:15 +0000 (0:00:01.396) 0:05:22.208 ******* 2026-02-23 21:15:16.060414 | controller | skipping: [instance] => (item=controller-0) 2026-02-23 21:15:17.592193 | controller | skipping: [instance] => (item=crc-0) 2026-02-23 21:15:17.592240 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2026-02-23 21:15:17.592250 | controller | 2026-02-23 21:15:17.592257 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2026-02-23 21:15:17.592263 | controller | Monday 23 February 2026 21:15:16 +0000 (0:00:00.176) 0:05:22.384 ******* 2026-02-23 21:15:17.592276 | controller | changed: [instance -> compute-0(compute-0.instance)] 2026-02-23 21:15:17.613888 | controller | 2026-02-23 21:15:17.613927 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-23 21:15:17.613936 | controller | Monday 23 February 2026 21:15:17 +0000 (0:00:01.532) 0:05:23.917 ******* 2026-02-23 21:15:17.613948 | controller | skipping: [instance] 2026-02-23 21:15:18.133362 | controller | 2026-02-23 21:15:18.133403 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-23 21:15:18.133411 | controller | Monday 23 February 2026 21:15:17 +0000 (0:00:00.022) 0:05:23.939 ******* 2026-02-23 21:15:18.133422 | controller | ok: [instance -> compute-0(compute-0.instance)] 2026-02-23 21:15:18.167369 | controller | 2026-02-23 21:15:18.167406 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-23 21:15:18.167415 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.519) 0:05:24.458 ******* 2026-02-23 21:15:18.167426 | controller | skipping: [instance] 2026-02-23 21:15:18.201314 | controller | 2026-02-23 21:15:18.201343 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-23 21:15:18.201351 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.034) 0:05:24.492 ******* 2026-02-23 21:15:18.201361 | controller | skipping: [instance] 2026-02-23 21:15:18.238080 | controller | 2026-02-23 21:15:18.238109 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-23 21:15:18.238122 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.034) 0:05:24.526 ******* 2026-02-23 21:15:18.238133 | controller | skipping: [instance] 2026-02-23 21:15:18.279480 | controller | 2026-02-23 21:15:18.279510 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-23 21:15:18.279518 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.036) 0:05:24.563 ******* 2026-02-23 21:15:18.279541 | controller | skipping: [instance] 2026-02-23 21:15:18.317324 | controller | 2026-02-23 21:15:18.317376 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2026-02-23 21:15:18.317398 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.041) 0:05:24.605 ******* 2026-02-23 21:15:18.317414 | controller | skipping: [instance] 2026-02-23 21:15:18.317441 | controller | 2026-02-23 21:15:18.317569 | controller | TASK [reproducer : Create repositories on computes] **************************** 2026-02-23 21:15:18.317740 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.037) 0:05:24.642 ******* 2026-02-23 21:15:18.338449 | controller | skipping: [instance] 2026-02-23 21:15:18.338562 | controller | 2026-02-23 21:15:18.338739 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2026-02-23 21:15:18.338875 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.021) 0:05:24.664 ******* 2026-02-23 21:15:18.368204 | controller | skipping: [instance] 2026-02-23 21:15:18.368291 | controller | 2026-02-23 21:15:18.368383 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2026-02-23 21:15:18.368476 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.029) 0:05:24.693 ******* 2026-02-23 21:15:18.425503 | controller | ok: [instance] 2026-02-23 21:15:18.425625 | controller | 2026-02-23 21:15:18.425787 | controller | TASK [reproducer : Push local code] ******************************************** 2026-02-23 21:15:18.425918 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.057) 0:05:24.751 ******* 2026-02-23 21:15:18.521632 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2026-02-23 21:15:18.521747 | controller | 2026-02-23 21:15:18.521846 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2026-02-23 21:15:18.521940 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.096) 0:05:24.847 ******* 2026-02-23 21:15:18.560569 | controller | skipping: [instance] 2026-02-23 21:15:18.560634 | controller | 2026-02-23 21:15:18.560788 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2026-02-23 21:15:18.560877 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.038) 0:05:24.886 ******* 2026-02-23 21:15:18.602152 | controller | skipping: [instance] 2026-02-23 21:15:18.602236 | controller | 2026-02-23 21:15:18.602337 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2026-02-23 21:15:18.602438 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.041) 0:05:24.927 ******* 2026-02-23 21:15:18.643449 | controller | skipping: [instance] 2026-02-23 21:15:18.643584 | controller | 2026-02-23 21:15:18.643754 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2026-02-23 21:15:18.643888 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.041) 0:05:24.969 ******* 2026-02-23 21:15:18.681544 | controller | skipping: [instance] 2026-02-23 21:15:18.681644 | controller | 2026-02-23 21:15:18.681812 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2026-02-23 21:15:18.681941 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.037) 0:05:25.007 ******* 2026-02-23 21:15:18.718545 | controller | skipping: [instance] 2026-02-23 21:15:18.718683 | controller | 2026-02-23 21:15:18.718832 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2026-02-23 21:15:18.718960 | controller | Monday 23 February 2026 21:15:18 +0000 (0:00:00.036) 0:05:25.044 ******* 2026-02-23 21:15:19.188311 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2026-02-23 21:15:19.188363 | controller | 2026-02-23 21:15:19.188459 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2026-02-23 21:15:19.188553 | controller | Monday 23 February 2026 21:15:19 +0000 (0:00:00.469) 0:05:25.513 ******* 2026-02-23 21:15:19.753281 | controller | ok: [instance -> localhost] => (item=ci-framework) 2026-02-23 21:15:19.753579 | controller | 2026-02-23 21:15:19.794984 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2026-02-23 21:15:19.795027 | controller | Monday 23 February 2026 21:15:19 +0000 (0:00:00.564) 0:05:26.078 ******* 2026-02-23 21:15:19.795040 | controller | skipping: [instance] => (item=ci-framework) 2026-02-23 21:15:19.795139 | controller | skipping: [instance] 2026-02-23 21:15:19.795155 | controller | 2026-02-23 21:15:19.795258 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2026-02-23 21:15:19.795289 | controller | Monday 23 February 2026 21:15:19 +0000 (0:00:00.041) 0:05:26.120 ******* 2026-02-23 21:15:19.873860 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2026-02-23 21:15:20.331541 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2026-02-23 21:15:20.331584 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2026-02-23 21:15:20.331592 | controller | 2026-02-23 21:15:20.331599 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2026-02-23 21:15:20.331609 | controller | Monday 23 February 2026 21:15:19 +0000 (0:00:00.078) 0:05:26.199 ******* 2026-02-23 21:15:20.331630 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:20.331650 | controller | 2026-02-23 21:15:20.331740 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2026-02-23 21:15:20.331867 | controller | Monday 23 February 2026 21:15:20 +0000 (0:00:00.458) 0:05:26.657 ******* 2026-02-23 21:15:20.370995 | controller | skipping: [instance] 2026-02-23 21:15:20.371054 | controller | 2026-02-23 21:15:20.371072 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2026-02-23 21:15:20.371091 | controller | Monday 23 February 2026 21:15:20 +0000 (0:00:00.039) 0:05:26.696 ******* 2026-02-23 21:15:20.842650 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:20.842730 | controller | 2026-02-23 21:15:20.842838 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2026-02-23 21:15:20.842940 | controller | Monday 23 February 2026 21:15:20 +0000 (0:00:00.471) 0:05:27.168 ******* 2026-02-23 21:15:20.881318 | controller | skipping: [instance] 2026-02-23 21:15:20.881397 | controller | 2026-02-23 21:15:20.881502 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2026-02-23 21:15:20.881616 | controller | Monday 23 February 2026 21:15:20 +0000 (0:00:00.038) 0:05:27.206 ******* 2026-02-23 21:15:21.343816 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:21.343878 | controller | 2026-02-23 21:15:21.343913 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2026-02-23 21:15:21.344025 | controller | Monday 23 February 2026 21:15:21 +0000 (0:00:00.462) 0:05:27.669 ******* 2026-02-23 21:15:23.677773 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:23.677858 | controller | 2026-02-23 21:15:23.677871 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2026-02-23 21:15:23.677995 | controller | Monday 23 February 2026 21:15:23 +0000 (0:00:02.333) 0:05:30.003 ******* 2026-02-23 21:15:43.258353 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:44.236758 | controller | 2026-02-23 21:15:44.236802 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2026-02-23 21:15:44.236811 | controller | Monday 23 February 2026 21:15:43 +0000 (0:00:19.579) 0:05:49.583 ******* 2026-02-23 21:15:44.236823 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:44.236912 | controller | 2026-02-23 21:15:44.237028 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2026-02-23 21:15:44.237071 | controller | Monday 23 February 2026 21:15:44 +0000 (0:00:00.979) 0:05:50.562 ******* 2026-02-23 21:15:44.331806 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2026-02-23 21:15:44.331882 | controller | 2026-02-23 21:15:44.331895 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2026-02-23 21:15:44.331976 | controller | Monday 23 February 2026 21:15:44 +0000 (0:00:00.094) 0:05:50.657 ******* 2026-02-23 21:15:44.780332 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:44.780389 | controller | 2026-02-23 21:15:44.780707 | controller | TASK [reproducer : Rotate log if present] ************************************** 2026-02-23 21:15:44.815597 | controller | Monday 23 February 2026 21:15:44 +0000 (0:00:00.448) 0:05:51.105 ******* 2026-02-23 21:15:44.815630 | controller | skipping: [instance] 2026-02-23 21:15:44.859525 | controller | 2026-02-23 21:15:44.859563 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2026-02-23 21:15:44.859573 | controller | Monday 23 February 2026 21:15:44 +0000 (0:00:00.035) 0:05:51.141 ******* 2026-02-23 21:15:44.859585 | controller | skipping: [instance] 2026-02-23 21:15:44.948300 | controller | 2026-02-23 21:15:44.948328 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2026-02-23 21:15:44.948338 | controller | Monday 23 February 2026 21:15:44 +0000 (0:00:00.043) 0:05:51.184 ******* 2026-02-23 21:15:44.948351 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:45.429174 | controller | 2026-02-23 21:15:45.429219 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-23 21:15:45.429228 | controller | Monday 23 February 2026 21:15:44 +0000 (0:00:00.088) 0:05:51.273 ******* 2026-02-23 21:15:45.429240 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:45.468012 | controller | 2026-02-23 21:15:45.468037 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-23 21:15:45.468045 | controller | Monday 23 February 2026 21:15:45 +0000 (0:00:00.480) 0:05:51.754 ******* 2026-02-23 21:15:45.468056 | controller | skipping: [instance] 2026-02-23 21:15:45.506791 | controller | 2026-02-23 21:15:45.506832 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-23 21:15:45.506842 | controller | Monday 23 February 2026 21:15:45 +0000 (0:00:00.039) 0:05:51.793 ******* 2026-02-23 21:15:45.506859 | controller | skipping: [instance] 2026-02-23 21:15:45.507091 | controller | 2026-02-23 21:15:45.546105 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-23 21:15:45.546139 | controller | Monday 23 February 2026 21:15:45 +0000 (0:00:00.039) 0:05:51.832 ******* 2026-02-23 21:15:45.546154 | controller | skipping: [instance] 2026-02-23 21:15:45.546164 | controller | 2026-02-23 21:15:45.546287 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-23 21:15:45.546371 | controller | Monday 23 February 2026 21:15:45 +0000 (0:00:00.039) 0:05:51.871 ******* 2026-02-23 21:15:45.592568 | controller | skipping: [instance] 2026-02-23 21:15:45.592701 | controller | 2026-02-23 21:15:45.592850 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-23 21:15:45.592986 | controller | Monday 23 February 2026 21:15:45 +0000 (0:00:00.046) 0:05:51.918 ******* 2026-02-23 21:15:46.902676 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:15:46.902753 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:15:46.902858 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:15:46.902958 | controller | changed: [instance -> controller-0] 2026-02-23 21:15:46.903050 | controller | 2026-02-23 21:15:46.903127 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-23 21:15:46.903236 | controller | Monday 23 February 2026 21:15:46 +0000 (0:00:01.309) 0:05:53.227 ******* 2026-02-23 21:15:47.861249 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:47.861441 | controller | 2026-02-23 21:15:47.861532 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-23 21:15:47.861544 | controller | Monday 23 February 2026 21:15:47 +0000 (0:00:00.958) 0:05:54.186 ******* 2026-02-23 21:15:49.117116 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:49.117310 | controller | 2026-02-23 21:15:49.117469 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-23 21:15:49.117516 | controller | Monday 23 February 2026 21:15:49 +0000 (0:00:01.255) 0:05:55.442 ******* 2026-02-23 21:15:56.381814 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:56.381883 | controller | 2026-02-23 21:15:56.381896 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-23 21:15:56.381906 | controller | Monday 23 February 2026 21:15:56 +0000 (0:00:07.264) 0:06:02.707 ******* 2026-02-23 21:15:57.289342 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:57.328299 | controller | 2026-02-23 21:15:57.328344 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-23 21:15:57.328353 | controller | Monday 23 February 2026 21:15:57 +0000 (0:00:00.907) 0:06:03.614 ******* 2026-02-23 21:15:57.328367 | controller | skipping: [instance] 2026-02-23 21:15:58.487810 | controller | 2026-02-23 21:15:58.487859 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-23 21:15:58.487867 | controller | Monday 23 February 2026 21:15:57 +0000 (0:00:00.039) 0:06:03.653 ******* 2026-02-23 21:15:58.487879 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:58.487910 | controller | 2026-02-23 21:15:58.487933 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-23 21:15:58.488126 | controller | Monday 23 February 2026 21:15:58 +0000 (0:00:01.159) 0:06:04.813 ******* 2026-02-23 21:15:58.543175 | controller | skipping: [instance] 2026-02-23 21:15:58.599307 | controller | 2026-02-23 21:15:58.599351 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-23 21:15:58.599360 | controller | Monday 23 February 2026 21:15:58 +0000 (0:00:00.054) 0:06:04.867 ******* 2026-02-23 21:15:58.599372 | controller | skipping: [instance] 2026-02-23 21:15:58.649205 | controller | 2026-02-23 21:15:58.649245 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-23 21:15:58.649256 | controller | Monday 23 February 2026 21:15:58 +0000 (0:00:00.056) 0:06:04.924 ******* 2026-02-23 21:15:58.649269 | controller | skipping: [instance] 2026-02-23 21:15:59.481855 | controller | 2026-02-23 21:15:59.481898 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-23 21:15:59.481908 | controller | Monday 23 February 2026 21:15:58 +0000 (0:00:00.050) 0:06:04.974 ******* 2026-02-23 21:15:59.481919 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:15:59.481945 | controller | 2026-02-23 21:15:59.481953 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-23 21:15:59.482096 | controller | Monday 23 February 2026 21:15:59 +0000 (0:00:00.832) 0:06:05.807 ******* 2026-02-23 21:16:00.378171 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:00.378232 | controller | 2026-02-23 21:16:00.378316 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-23 21:16:00.378372 | controller | Monday 23 February 2026 21:16:00 +0000 (0:00:00.896) 0:06:06.703 ******* 2026-02-23 21:16:00.418174 | controller | skipping: [instance] 2026-02-23 21:16:00.418215 | controller | 2026-02-23 21:16:00.418224 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-23 21:16:00.418241 | controller | Monday 23 February 2026 21:16:00 +0000 (0:00:00.040) 0:06:06.743 ******* 2026-02-23 21:16:00.461033 | controller | skipping: [instance] 2026-02-23 21:16:00.461076 | controller | 2026-02-23 21:16:00.461318 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-23 21:16:00.500998 | controller | Monday 23 February 2026 21:16:00 +0000 (0:00:00.042) 0:06:06.786 ******* 2026-02-23 21:16:00.501054 | controller | skipping: [instance] 2026-02-23 21:16:00.501075 | controller | 2026-02-23 21:16:00.501118 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-23 21:16:00.501217 | controller | Monday 23 February 2026 21:16:00 +0000 (0:00:00.040) 0:06:06.826 ******* 2026-02-23 21:16:00.558467 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:00.605762 | controller | 2026-02-23 21:16:00.605874 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-23 21:16:00.606238 | controller | Monday 23 February 2026 21:16:00 +0000 (0:00:00.057) 0:06:06.883 ******* 2026-02-23 21:16:00.606272 | controller | skipping: [instance] 2026-02-23 21:16:00.606292 | controller | 2026-02-23 21:16:00.646033 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-23 21:16:00.646073 | controller | Monday 23 February 2026 21:16:00 +0000 (0:00:00.047) 0:06:06.931 ******* 2026-02-23 21:16:00.646086 | controller | skipping: [instance] 2026-02-23 21:16:00.685796 | controller | 2026-02-23 21:16:00.685842 | controller | TASK [Download the RPM] ******************************************************** 2026-02-23 21:16:00.685853 | controller | Monday 23 February 2026 21:16:00 +0000 (0:00:00.040) 0:06:06.971 ******* 2026-02-23 21:16:00.685867 | controller | skipping: [instance] 2026-02-23 21:16:00.685902 | controller | 2026-02-23 21:16:00.685912 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-23 21:16:00.686067 | controller | Monday 23 February 2026 21:16:00 +0000 (0:00:00.039) 0:06:07.011 ******* 2026-02-23 21:16:00.722259 | controller | skipping: [instance] 2026-02-23 21:16:00.758806 | controller | 2026-02-23 21:16:00.758852 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-23 21:16:00.758863 | controller | Monday 23 February 2026 21:16:00 +0000 (0:00:00.036) 0:06:07.047 ******* 2026-02-23 21:16:00.758875 | controller | skipping: [instance] 2026-02-23 21:16:00.758919 | controller | 2026-02-23 21:16:00.758931 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-23 21:16:00.759085 | controller | Monday 23 February 2026 21:16:00 +0000 (0:00:00.036) 0:06:07.084 ******* 2026-02-23 21:16:00.796819 | controller | skipping: [instance] 2026-02-23 21:16:00.796876 | controller | 2026-02-23 21:16:00.796888 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-23 21:16:00.796930 | controller | Monday 23 February 2026 21:16:00 +0000 (0:00:00.037) 0:06:07.122 ******* 2026-02-23 21:16:00.834202 | controller | skipping: [instance] 2026-02-23 21:16:01.281813 | controller | 2026-02-23 21:16:01.281859 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-23 21:16:01.281869 | controller | Monday 23 February 2026 21:16:00 +0000 (0:00:00.037) 0:06:07.159 ******* 2026-02-23 21:16:01.281884 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:01.327244 | controller | 2026-02-23 21:16:01.327291 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-23 21:16:01.327299 | controller | Monday 23 February 2026 21:16:01 +0000 (0:00:00.447) 0:06:07.606 ******* 2026-02-23 21:16:01.327311 | controller | skipping: [instance] 2026-02-23 21:16:01.375795 | controller | 2026-02-23 21:16:01.375827 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-23 21:16:01.375840 | controller | Monday 23 February 2026 21:16:01 +0000 (0:00:00.045) 0:06:07.652 ******* 2026-02-23 21:16:01.375854 | controller | skipping: [instance] 2026-02-23 21:16:01.414455 | controller | 2026-02-23 21:16:01.414481 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-23 21:16:01.414491 | controller | Monday 23 February 2026 21:16:01 +0000 (0:00:00.048) 0:06:07.701 ******* 2026-02-23 21:16:01.414511 | controller | skipping: [instance] 2026-02-23 21:16:01.465195 | controller | 2026-02-23 21:16:01.465215 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-23 21:16:01.465223 | controller | Monday 23 February 2026 21:16:01 +0000 (0:00:00.038) 0:06:07.739 ******* 2026-02-23 21:16:01.465232 | controller | skipping: [instance] 2026-02-23 21:16:01.513317 | controller | 2026-02-23 21:16:01.513335 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-23 21:16:01.513342 | controller | Monday 23 February 2026 21:16:01 +0000 (0:00:00.049) 0:06:07.789 ******* 2026-02-23 21:16:01.513351 | controller | skipping: [instance] 2026-02-23 21:16:01.558201 | controller | 2026-02-23 21:16:01.558224 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-23 21:16:01.558235 | controller | Monday 23 February 2026 21:16:01 +0000 (0:00:00.049) 0:06:07.838 ******* 2026-02-23 21:16:01.558246 | controller | skipping: [instance] 2026-02-23 21:16:01.558384 | controller | 2026-02-23 21:16:01.558518 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-23 21:16:01.558677 | controller | Monday 23 February 2026 21:16:01 +0000 (0:00:00.045) 0:06:07.884 ******* 2026-02-23 21:16:01.605555 | controller | skipping: [instance] 2026-02-23 21:16:01.605735 | controller | 2026-02-23 21:16:01.605869 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-23 21:16:01.606005 | controller | Monday 23 February 2026 21:16:01 +0000 (0:00:00.047) 0:06:07.931 ******* 2026-02-23 21:16:01.655545 | controller | skipping: [instance] 2026-02-23 21:16:01.655756 | controller | 2026-02-23 21:16:01.655921 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-23 21:16:01.656074 | controller | Monday 23 February 2026 21:16:01 +0000 (0:00:00.050) 0:06:07.981 ******* 2026-02-23 21:16:02.275814 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:02.275888 | controller | 2026-02-23 21:16:02.275902 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-23 21:16:02.276012 | controller | Monday 23 February 2026 21:16:02 +0000 (0:00:00.619) 0:06:08.601 ******* 2026-02-23 21:16:03.318310 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:16:03.318468 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:16:03.318483 | controller | changed: [instance -> controller-0] 2026-02-23 21:16:03.318582 | controller | 2026-02-23 21:16:03.318752 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-23 21:16:03.318842 | controller | Monday 23 February 2026 21:16:03 +0000 (0:00:01.042) 0:06:09.643 ******* 2026-02-23 21:16:04.017120 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:04.017176 | controller | 2026-02-23 21:16:04.017266 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-23 21:16:04.017365 | controller | Monday 23 February 2026 21:16:04 +0000 (0:00:00.699) 0:06:10.342 ******* 2026-02-23 21:16:04.501611 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:04.501679 | controller | 2026-02-23 21:16:04.501780 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-23 21:16:04.501867 | controller | Monday 23 February 2026 21:16:04 +0000 (0:00:00.484) 0:06:10.827 ******* 2026-02-23 21:16:04.562113 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:16:04.562271 | controller | ok: [instance -> controller-0] 2026-02-23 21:16:04.562287 | controller | 2026-02-23 21:16:04.562432 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-23 21:16:04.562505 | controller | Monday 23 February 2026 21:16:04 +0000 (0:00:00.060) 0:06:10.887 ******* 2026-02-23 21:16:04.609645 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:04.609843 | controller | 2026-02-23 21:16:04.609862 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-23 21:16:04.609927 | controller | Monday 23 February 2026 21:16:04 +0000 (0:00:00.047) 0:06:10.935 ******* 2026-02-23 21:16:34.385986 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:34.386037 | controller | 2026-02-23 21:16:34.386110 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-23 21:16:34.386195 | controller | Monday 23 February 2026 21:16:34 +0000 (0:00:29.776) 0:06:40.711 ******* 2026-02-23 21:16:34.866449 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:34.866513 | controller | 2026-02-23 21:16:34.866624 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-23 21:16:34.866781 | controller | Monday 23 February 2026 21:16:34 +0000 (0:00:00.480) 0:06:41.191 ******* 2026-02-23 21:16:35.385535 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:35.385585 | controller | 2026-02-23 21:16:35.385735 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-23 21:16:35.385820 | controller | Monday 23 February 2026 21:16:35 +0000 (0:00:00.518) 0:06:41.710 ******* 2026-02-23 21:16:41.352018 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:41.352126 | controller | 2026-02-23 21:16:41.352265 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-23 21:16:41.352285 | controller | Monday 23 February 2026 21:16:41 +0000 (0:00:05.965) 0:06:47.676 ******* 2026-02-23 21:16:41.403584 | controller | skipping: [instance] 2026-02-23 21:16:41.992842 | controller | 2026-02-23 21:16:41.992927 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-23 21:16:41.992937 | controller | Monday 23 February 2026 21:16:41 +0000 (0:00:00.052) 0:06:47.729 ******* 2026-02-23 21:16:41.992955 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:41.992989 | controller | 2026-02-23 21:16:41.993000 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-23 21:16:42.504192 | controller | Monday 23 February 2026 21:16:41 +0000 (0:00:00.589) 0:06:48.318 ******* 2026-02-23 21:16:42.504263 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:42.504290 | controller | 2026-02-23 21:16:42.504338 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-23 21:16:42.504436 | controller | Monday 23 February 2026 21:16:42 +0000 (0:00:00.510) 0:06:48.828 ******* 2026-02-23 21:16:42.552799 | controller | skipping: [instance] 2026-02-23 21:16:42.552860 | controller | 2026-02-23 21:16:42.552965 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-23 21:16:42.553067 | controller | Monday 23 February 2026 21:16:42 +0000 (0:00:00.049) 0:06:48.878 ******* 2026-02-23 21:16:42.597804 | controller | skipping: [instance] 2026-02-23 21:16:42.597873 | controller | 2026-02-23 21:16:42.597984 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-23 21:16:42.598079 | controller | Monday 23 February 2026 21:16:42 +0000 (0:00:00.044) 0:06:48.923 ******* 2026-02-23 21:16:42.643318 | controller | skipping: [instance] 2026-02-23 21:16:42.643378 | controller | 2026-02-23 21:16:42.643494 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-23 21:16:42.643594 | controller | Monday 23 February 2026 21:16:42 +0000 (0:00:00.045) 0:06:48.969 ******* 2026-02-23 21:16:42.690206 | controller | skipping: [instance] 2026-02-23 21:16:42.690302 | controller | 2026-02-23 21:16:42.690420 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-23 21:16:42.690540 | controller | Monday 23 February 2026 21:16:42 +0000 (0:00:00.046) 0:06:49.015 ******* 2026-02-23 21:16:42.734688 | controller | skipping: [instance] 2026-02-23 21:16:42.734774 | controller | 2026-02-23 21:16:42.734876 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-23 21:16:42.734977 | controller | Monday 23 February 2026 21:16:42 +0000 (0:00:00.044) 0:06:49.060 ******* 2026-02-23 21:16:42.780387 | controller | skipping: [instance] 2026-02-23 21:16:42.780483 | controller | 2026-02-23 21:16:42.780606 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-23 21:16:42.780768 | controller | Monday 23 February 2026 21:16:42 +0000 (0:00:00.045) 0:06:49.105 ******* 2026-02-23 21:16:45.518010 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:16:45.518574 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:16:45.682566 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:16:45.682596 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:16:45.682611 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:16:45.682617 | controller | changed: [instance -> controller-0] 2026-02-23 21:16:45.682623 | controller | 2026-02-23 21:16:45.682630 | controller | TASK [Prepare install_yamls make targets] ************************************** 2026-02-23 21:16:45.682635 | controller | Monday 23 February 2026 21:16:45 +0000 (0:00:02.736) 0:06:51.841 ******* 2026-02-23 21:16:45.682647 | controller | 2026-02-23 21:16:45.682787 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2026-02-23 21:16:45.682803 | controller | Monday 23 February 2026 21:16:45 +0000 (0:00:00.166) 0:06:52.008 ******* 2026-02-23 21:16:47.143291 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:16:47.143377 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:16:47.143389 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:16:47.143813 | controller | changed: [instance -> controller-0] 2026-02-23 21:16:47.200980 | controller | 2026-02-23 21:16:47.201034 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2026-02-23 21:16:47.201043 | controller | Monday 23 February 2026 21:16:47 +0000 (0:00:01.460) 0:06:53.468 ******* 2026-02-23 21:16:47.201055 | controller | 2026-02-23 21:16:47.245205 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2026-02-23 21:16:47.245238 | controller | Monday 23 February 2026 21:16:47 +0000 (0:00:00.057) 0:06:53.526 ******* 2026-02-23 21:16:47.245252 | controller | skipping: [instance] 2026-02-23 21:16:47.245283 | controller | 2026-02-23 21:16:47.245455 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2026-02-23 21:16:47.297356 | controller | Monday 23 February 2026 21:16:47 +0000 (0:00:00.044) 0:06:53.570 ******* 2026-02-23 21:16:47.297391 | controller | skipping: [instance] 2026-02-23 21:16:47.297461 | controller | 2026-02-23 21:16:47.297488 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2026-02-23 21:16:47.297500 | controller | Monday 23 February 2026 21:16:47 +0000 (0:00:00.052) 0:06:53.622 ******* 2026-02-23 21:16:47.370195 | controller | 2026-02-23 21:16:47.370302 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-23 21:16:47.370317 | controller | Monday 23 February 2026 21:16:47 +0000 (0:00:00.072) 0:06:53.695 ******* 2026-02-23 21:16:47.409342 | controller | skipping: [instance] 2026-02-23 21:16:47.409629 | controller | 2026-02-23 21:16:47.409719 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-23 21:16:47.409819 | controller | Monday 23 February 2026 21:16:47 +0000 (0:00:00.039) 0:06:53.735 ******* 2026-02-23 21:16:47.455345 | controller | skipping: [instance] 2026-02-23 21:16:47.455434 | controller | 2026-02-23 21:16:47.455643 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-23 21:16:47.455753 | controller | Monday 23 February 2026 21:16:47 +0000 (0:00:00.045) 0:06:53.780 ******* 2026-02-23 21:16:47.499133 | controller | skipping: [instance] 2026-02-23 21:16:47.499238 | controller | 2026-02-23 21:16:47.499369 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-23 21:16:47.499521 | controller | Monday 23 February 2026 21:16:47 +0000 (0:00:00.044) 0:06:53.824 ******* 2026-02-23 21:16:47.549513 | controller | skipping: [instance] 2026-02-23 21:16:47.549630 | controller | 2026-02-23 21:16:47.549825 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2026-02-23 21:16:47.549962 | controller | Monday 23 February 2026 21:16:47 +0000 (0:00:00.050) 0:06:53.875 ******* 2026-02-23 21:16:47.646998 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-23 21:16:47.647061 | controller | ok: [instance -> controller-0] 2026-02-23 21:16:47.647157 | controller | 2026-02-23 21:16:47.647246 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2026-02-23 21:16:47.647335 | controller | Monday 23 February 2026 21:16:47 +0000 (0:00:00.097) 0:06:53.972 ******* 2026-02-23 21:16:47.713227 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:47.714107 | controller | 2026-02-23 21:16:48.682915 | controller | TASK [install_yamls : Get environment structure] ******************************* 2026-02-23 21:16:48.682986 | controller | Monday 23 February 2026 21:16:47 +0000 (0:00:00.065) 0:06:54.038 ******* 2026-02-23 21:16:48.683006 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:48.683066 | controller | 2026-02-23 21:16:48.683080 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2026-02-23 21:16:48.683163 | controller | Monday 23 February 2026 21:16:48 +0000 (0:00:00.969) 0:06:55.008 ******* 2026-02-23 21:16:48.736801 | controller | skipping: [instance] 2026-02-23 21:16:48.736920 | controller | 2026-02-23 21:16:48.737052 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2026-02-23 21:16:48.737222 | controller | Monday 23 February 2026 21:16:48 +0000 (0:00:00.054) 0:06:55.062 ******* 2026-02-23 21:16:48.796920 | controller | skipping: [instance] 2026-02-23 21:16:48.796998 | controller | 2026-02-23 21:16:48.797177 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2026-02-23 21:16:48.797194 | controller | Monday 23 February 2026 21:16:48 +0000 (0:00:00.060) 0:06:55.122 ******* 2026-02-23 21:16:48.843030 | controller | skipping: [instance] 2026-02-23 21:16:48.843086 | controller | 2026-02-23 21:16:48.843205 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2026-02-23 21:16:48.843294 | controller | Monday 23 February 2026 21:16:48 +0000 (0:00:00.046) 0:06:55.168 ******* 2026-02-23 21:16:48.909623 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:48.909708 | controller | 2026-02-23 21:16:48.909832 | controller | TASK [install_yamls : Show the env structure] ********************************** 2026-02-23 21:16:48.909920 | controller | Monday 23 February 2026 21:16:48 +0000 (0:00:00.066) 0:06:55.235 ******* 2026-02-23 21:16:48.957467 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:48.957597 | controller | 2026-02-23 21:16:48.957784 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2026-02-23 21:16:48.957912 | controller | Monday 23 February 2026 21:16:48 +0000 (0:00:00.047) 0:06:55.283 ******* 2026-02-23 21:16:49.014866 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:49.014977 | controller | 2026-02-23 21:16:49.015105 | controller | TASK [install_yamls : Generate make targets] *********************************** 2026-02-23 21:16:49.015233 | controller | Monday 23 February 2026 21:16:49 +0000 (0:00:00.057) 0:06:55.340 ******* 2026-02-23 21:16:49.661471 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:49.661553 | controller | 2026-02-23 21:16:49.661650 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2026-02-23 21:16:49.661774 | controller | Monday 23 February 2026 21:16:49 +0000 (0:00:00.646) 0:06:55.986 ******* 2026-02-23 21:16:49.722156 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:49.722235 | controller | 2026-02-23 21:16:49.722335 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2026-02-23 21:16:49.722445 | controller | Monday 23 February 2026 21:16:49 +0000 (0:00:00.059) 0:06:56.046 ******* 2026-02-23 21:16:50.630214 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:50.630283 | controller | 2026-02-23 21:16:50.630383 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2026-02-23 21:16:50.630500 | controller | Monday 23 February 2026 21:16:50 +0000 (0:00:00.908) 0:06:56.955 ******* 2026-02-23 21:16:50.682646 | controller | skipping: [instance] 2026-02-23 21:16:50.682890 | controller | 2026-02-23 21:16:50.682928 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-23 21:16:50.683041 | controller | Monday 23 February 2026 21:16:50 +0000 (0:00:00.052) 0:06:57.008 ******* 2026-02-23 21:16:51.665924 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:51.665980 | controller | 2026-02-23 21:16:51.666073 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-23 21:16:51.666204 | controller | Monday 23 February 2026 21:16:51 +0000 (0:00:00.982) 0:06:57.991 ******* 2026-02-23 21:16:51.729804 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:51.729894 | controller | 2026-02-23 21:16:51.730027 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2026-02-23 21:16:51.730129 | controller | Monday 23 February 2026 21:16:51 +0000 (0:00:00.064) 0:06:58.055 ******* 2026-02-23 21:16:52.678867 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:52.679136 | controller | 2026-02-23 21:16:53.183688 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2026-02-23 21:16:53.183731 | controller | Monday 23 February 2026 21:16:52 +0000 (0:00:00.948) 0:06:59.004 ******* 2026-02-23 21:16:53.183744 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-23 21:16:53.335485 | controller | 2026-02-23 21:16:53.335518 | controller | TASK [Configure CRC network if needed] ***************************************** 2026-02-23 21:16:53.335526 | controller | Monday 23 February 2026 21:16:53 +0000 (0:00:00.504) 0:06:59.508 ******* 2026-02-23 21:16:53.335537 | controller | 2026-02-23 21:16:54.484724 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2026-02-23 21:16:54.484763 | controller | Monday 23 February 2026 21:16:53 +0000 (0:00:00.151) 0:06:59.660 ******* 2026-02-23 21:16:54.484777 | controller | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-23 21:16:54.493499 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false 2026-02-23 21:16:54.493518 | controller | module_stderr: |- 2026-02-23 21:16:54.493526 | controller | Shared connection to controller-0.utility closed. 2026-02-23 21:16:54.493532 | controller | module_stdout: |- 2026-02-23 21:16:54.493538 | controller | Traceback (most recent call last): 2026-02-23 21:16:54.493543 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 700, in urlopen 2026-02-23 21:16:54.493549 | controller | httplib_response = self._make_request( 2026-02-23 21:16:54.493554 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 383, in _make_request 2026-02-23 21:16:54.493560 | controller | self._validate_conn(conn) 2026-02-23 21:16:54.493566 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1015, in _validate_conn 2026-02-23 21:16:54.493571 | controller | conn.connect() 2026-02-23 21:16:54.493577 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connection.py", line 411, in connect 2026-02-23 21:16:54.493582 | controller | self.sock = ssl_wrap_socket( 2026-02-23 21:16:54.493588 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket 2026-02-23 21:16:54.493593 | controller | ssl_sock = _ssl_wrap_socket_impl( 2026-02-23 21:16:54.493598 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl 2026-02-23 21:16:54.493604 | controller | return ssl_context.wrap_socket(sock, server_hostname=server_hostname) 2026-02-23 21:16:54.493617 | controller | File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket 2026-02-23 21:16:54.493623 | controller | return self.sslsocket_class._create( 2026-02-23 21:16:54.493629 | controller | File "/usr/lib64/python3.9/ssl.py", line 1076, in _create 2026-02-23 21:16:54.493635 | controller | self.do_handshake() 2026-02-23 21:16:54.493640 | controller | File "/usr/lib64/python3.9/ssl.py", line 1345, in do_handshake 2026-02-23 21:16:54.493651 | controller | self._sslobj.do_handshake() 2026-02-23 21:16:54.493722 | controller | ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147) 2026-02-23 21:16:54.493732 | controller | 2026-02-23 21:16:54.493738 | controller | During handling of the above exception, another exception occurred: 2026-02-23 21:16:54.493743 | controller | 2026-02-23 21:16:54.493747 | controller | Traceback (most recent call last): 2026-02-23 21:16:54.493753 | controller | File "/tmp/ansible-tmp-1771881413.3815486-28283-155667439003336/AnsiballZ_k8s_info.py", line 107, in 2026-02-23 21:16:54.493758 | controller | _ansiballz_main() 2026-02-23 21:16:54.493763 | controller | File "/tmp/ansible-tmp-1771881413.3815486-28283-155667439003336/AnsiballZ_k8s_info.py", line 99, in _ansiballz_main 2026-02-23 21:16:54.493768 | controller | invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS) 2026-02-23 21:16:54.493772 | controller | File "/tmp/ansible-tmp-1771881413.3815486-28283-155667439003336/AnsiballZ_k8s_info.py", line 47, in invoke_module 2026-02-23 21:16:54.493778 | controller | runpy.run_module(mod_name='ansible_collections.kubernetes.core.plugins.modules.k8s_info', init_globals=dict(_module_fqn='ansible_collections.kubernetes.core.plugins.modules.k8s_info', _modlib_path=modlib_path), 2026-02-23 21:16:54.493793 | controller | File "/usr/lib64/python3.9/runpy.py", line 225, in run_module 2026-02-23 21:16:54.493798 | controller | return _run_module_code(code, init_globals, run_name, mod_spec) 2026-02-23 21:16:54.493803 | controller | File "/usr/lib64/python3.9/runpy.py", line 97, in _run_module_code 2026-02-23 21:16:54.493808 | controller | _run_code(code, mod_globals, init_globals, 2026-02-23 21:16:54.493813 | controller | File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-23 21:16:54.493817 | controller | exec(code, run_globals) 2026-02-23 21:16:54.493823 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_hz3b0gae/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 229, in 2026-02-23 21:16:54.493833 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_hz3b0gae/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 221, in main 2026-02-23 21:16:54.493839 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_hz3b0gae/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 352, in get_api_client 2026-02-23 21:16:54.493844 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_hz3b0gae/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 246, in wrapper 2026-02-23 21:16:54.493849 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_hz3b0gae/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 259, in create_api_client 2026-02-23 21:16:54.493854 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 84, in __init__ 2026-02-23 21:16:54.493859 | controller | self.__discoverer = discoverer(self, cache_file) 2026-02-23 21:16:54.493864 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_hz3b0gae/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 190, in __init__ 2026-02-23 21:16:54.493873 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_hz3b0gae/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 45, in __init__ 2026-02-23 21:16:54.497051 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_hz3b0gae/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 92, in __init_cache 2026-02-23 21:16:54.497066 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/discovery.py", line 146, in _load_server_info 2026-02-23 21:16:54.497076 | controller | 'kubernetes': self.client.request('get', '/version', serializer=just_json) 2026-02-23 21:16:54.497082 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-23 21:16:54.497087 | controller | resp = func(self, *args, **kwargs) 2026-02-23 21:16:54.497092 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 277, in request 2026-02-23 21:16:54.497097 | controller | api_response = self.client.call_api( 2026-02-23 21:16:54.497102 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-23 21:16:54.497107 | controller | return self.__call_api(resource_path, method, 2026-02-23 21:16:54.497112 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-23 21:16:54.497117 | controller | response_data = self.request( 2026-02-23 21:16:54.497124 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-23 21:16:54.497129 | controller | return self.rest_client.GET(url, 2026-02-23 21:16:54.497134 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-23 21:16:54.497139 | controller | return self.request("GET", url, 2026-02-23 21:16:54.497144 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 217, in request 2026-02-23 21:16:54.497149 | controller | r = self.pool_manager.request(method, url, 2026-02-23 21:16:54.497154 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 74, in request 2026-02-23 21:16:54.497159 | controller | return self.request_encode_url( 2026-02-23 21:16:54.497164 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 96, in request_encode_url 2026-02-23 21:16:54.497169 | controller | return self.urlopen(method, url, **extra_kw) 2026-02-23 21:16:54.497173 | controller | File "/usr/lib/python3.9/site-packages/urllib3/poolmanager.py", line 376, in urlopen 2026-02-23 21:16:54.497178 | controller | response = conn.urlopen(method, u.request_uri, **kw) 2026-02-23 21:16:54.497183 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-23 21:16:54.497188 | controller | return self.urlopen( 2026-02-23 21:16:54.497193 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-23 21:16:54.497198 | controller | return self.urlopen( 2026-02-23 21:16:54.497203 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-23 21:16:54.497208 | controller | return self.urlopen( 2026-02-23 21:16:54.497213 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 756, in urlopen 2026-02-23 21:16:54.497217 | controller | retries = retries.increment( 2026-02-23 21:16:54.497222 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 576, in increment 2026-02-23 21:16:54.497227 | controller | raise MaxRetryError(_pool, url, error or ResponseError(cause)) 2026-02-23 21:16:54.497232 | controller | urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-23 21:16:54.497238 | controller | msg: |- 2026-02-23 21:16:54.497243 | controller | MODULE FAILURE 2026-02-23 21:16:54.497248 | controller | See stdout/stderr for the exact error 2026-02-23 21:16:54.497253 | controller | rc: 1 2026-02-23 21:16:54.497263 | controller | 2026-02-23 21:16:54.497401 | controller | TASK [Create dnsmasq dir] ****************************************************** 2026-02-23 21:16:54.497526 | controller | Monday 23 February 2026 21:16:54 +0000 (0:00:01.162) 0:07:00.822 ******* 2026-02-23 21:16:54.736278 | controller | changed: [instance] 2026-02-23 21:16:55.977053 | controller | 2026-02-23 21:16:55.977093 | controller | TASK [Get journalctl in a file] ************************************************ 2026-02-23 21:16:55.977110 | controller | Monday 23 February 2026 21:16:54 +0000 (0:00:00.238) 0:07:01.061 ******* 2026-02-23 21:16:55.977123 | controller | changed: [instance] 2026-02-23 21:16:55.977156 | controller | 2026-02-23 21:16:55.977183 | controller | TASK [Dump journalctl output] ************************************************** 2026-02-23 21:16:55.977293 | controller | Monday 23 February 2026 21:16:55 +0000 (0:00:01.240) 0:07:02.302 ******* 2026-02-23 21:16:56.393310 | controller | changed: [instance] 2026-02-23 21:16:56.393399 | controller | 2026-02-23 21:16:56.393411 | controller | TASK [Copy all dnsmasq config] ************************************************* 2026-02-23 21:16:56.393513 | controller | Monday 23 February 2026 21:16:56 +0000 (0:00:00.416) 0:07:02.718 ******* 2026-02-23 21:16:56.931153 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-23 21:16:57.151820 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2026-02-23 21:16:57.151862 | controller | 2026-02-23 21:16:57.151874 | controller | TASK [Create log directory] **************************************************** 2026-02-23 21:16:57.151882 | controller | Monday 23 February 2026 21:16:56 +0000 (0:00:00.537) 0:07:03.256 ******* 2026-02-23 21:16:57.151895 | controller | changed: [instance] 2026-02-23 21:16:58.084075 | controller | 2026-02-23 21:16:58.084118 | controller | TASK [Sync logs from controller-0] ********************************************* 2026-02-23 21:16:58.084134 | controller | Monday 23 February 2026 21:16:57 +0000 (0:00:00.221) 0:07:03.477 ******* 2026-02-23 21:16:58.084146 | controller | changed: [instance] 2026-02-23 21:16:58.084166 | controller | 2026-02-23 21:16:58.084319 | controller | PLAY RECAP ********************************************************************* 2026-02-23 21:16:58.084355 | controller | instance : ok=541 changed=208 unreachable=0 failed=1 skipped=229 rescued=0 ignored=0 2026-02-23 21:16:58.084446 | controller | 2026-02-23 21:16:58.084589 | controller | Monday 23 February 2026 21:16:58 +0000 (0:00:00.930) 0:07:04.407 ******* 2026-02-23 21:16:58.084702 | controller | =============================================================================== 2026-02-23 21:16:58.084789 | controller | reproducer : Check package install status ------------------------------ 50.81s 2026-02-23 21:16:58.084875 | controller | ci_setup : Install needed packages ------------------------------------- 29.78s 2026-02-23 21:16:58.084952 | controller | libvirt_manager : Download base image ---------------------------------- 28.12s 2026-02-23 21:16:58.085037 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 22.92s 2026-02-23 21:16:58.085124 | controller | reproducer : Install collections on controller-0 ----------------------- 19.58s 2026-02-23 21:16:58.085214 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 11.41s 2026-02-23 21:16:58.085302 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 8.15s 2026-02-23 21:16:58.085400 | controller | libvirt_manager : Install packages required for using KVM --------------- 8.05s 2026-02-23 21:16:58.085531 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.26s 2026-02-23 21:16:58.085621 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.09s 2026-02-23 21:16:58.085738 | controller | ci_setup : Install openshift client ------------------------------------- 5.97s 2026-02-23 21:16:58.085826 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.08s 2026-02-23 21:16:58.085913 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.59s 2026-02-23 21:16:58.086000 | controller | networking_mapper : Gather the facts ------------------------------------ 3.56s 2026-02-23 21:16:58.086159 | controller | dnsmasq : Add/Remove address -------------------------------------------- 2.99s 2026-02-23 21:16:58.086580 | controller | ci_setup : Manage directories ------------------------------------------- 2.74s 2026-02-23 21:16:58.212578 | controller | sushy_emulator : Install required packages ------------------------------ 2.49s 2026-02-23 21:16:58.212630 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.33s 2026-02-23 21:16:58.212640 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2026-02-23 21:16:58.212652 | controller | reproducer : Sync local repositories to other hosts if present ---------- 1.98s 2026-02-23 21:16:58.212680 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2026-02-23 21:16:58.213155 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2026-02-23 21:16:58.221209 | controller | INFO Running crc_layout > cleanup 2026-02-23 21:16:58.221630 | controller | WARNING Skipping, cleanup playbook not configured. 2026-02-23 21:16:58.228595 | controller | INFO Running crc_layout > destroy 2026-02-23 21:16:58.228963 | controller | WARNING Skipping, instances are delegated. 2026-02-23 21:16:58.229295 | controller | INFO Pruning extra files from scenario ephemeral directory 2026-02-23 21:16:58.230787 | controller | INFO Writing /tmp/report.html report. 2026-02-23 21:16:58.489996 | [controller] Waiting on logger 2026-02-23 21:17:03.675753 | [controller] Waiting on logger 2026-02-23 21:17:14.107859 | [controller] Waiting on logger 2026-02-23 21:17:23.488959 | [controller] Waiting on logger 2026-02-23 21:17:28.335796 | [Zuul] Log Stream did not terminate 2026-02-23 21:17:28.336350 | controller | ERROR 2026-02-23 21:17:28.336527 | controller | { 2026-02-23 21:17:28.336587 | controller | "delta": "0:08:54.570808", 2026-02-23 21:17:28.336625 | controller | "end": "2026-02-23 21:16:58.293636", 2026-02-23 21:17:28.336657 | controller | "msg": "non-zero return code", 2026-02-23 21:17:28.336685 | controller | "rc": 1, 2026-02-23 21:17:28.336713 | controller | "start": "2026-02-23 21:08:03.722828" 2026-02-23 21:17:28.336741 | controller | } failure 2026-02-23 21:17:28.386189 | 2026-02-23 21:17:28.386238 | PLAY RECAP 2026-02-23 21:17:28.386288 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2026-02-23 21:17:28.386334 | 2026-02-23 21:17:28.443079 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-23 21:17:28.443842 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-23 21:17:28.942552 | 2026-02-23 21:17:28.942646 | PLAY [Run ci/playbooks/collect-logs.yml] 2026-02-23 21:17:28.961180 | 2026-02-23 21:17:28.961248 | TASK [Filter out host if needed] 2026-02-23 21:17:28.969009 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2026-02-23 21:17:28.973053 | 2026-02-23 21:17:28.973114 | TASK [Ensure file is present] 2026-02-23 21:17:29.437279 | controller | ok 2026-02-23 21:17:29.442830 | 2026-02-23 21:17:29.442899 | TASK [Manage molecule report file] 2026-02-23 21:17:29.463192 | [controller] Waiting on logger 2026-02-23 21:17:38.811751 | [controller] Waiting on logger 2026-02-23 21:17:49.243861 | [controller] Waiting on logger 2026-02-23 21:17:58.624644 | [controller] Waiting on logger 2026-02-23 21:17:59.887223 | [Zuul] Log Stream did not terminate 2026-02-23 21:17:59.887473 | controller | changed 2026-02-23 21:17:59.892761 | 2026-02-23 21:17:59.892834 | TASK [Check if we get ci-framework-data basedir] 2026-02-23 21:18:00.165093 | controller | ok 2026-02-23 21:18:00.170112 | 2026-02-23 21:18:00.170177 | TASK [Create ci-framework-data log directory for zuul] 2026-02-23 21:18:00.562351 | controller | changed 2026-02-23 21:18:00.567828 | 2026-02-23 21:18:00.567971 | TASK [Copy ci-framework interesting files] 2026-02-23 21:18:00.587854 | [controller] Waiting on logger 2026-02-23 21:18:11.003820 | [controller] Waiting on logger 2026-02-23 21:18:21.436346 | [controller] Waiting on logger 2026-02-23 21:18:30.779877 | [controller] Waiting on logger 2026-02-23 21:18:30.951679 | [Zuul] Log Stream did not terminate 2026-02-23 21:18:30.951847 | controller | changed 2026-02-23 21:18:30.956708 | 2026-02-23 21:18:30.956774 | TASK [Get SELinux listing] 2026-02-23 21:18:34.043807 | [controller] Waiting on logger 2026-02-23 21:18:40.300112 | controller | changed 2026-02-23 21:18:40.305457 | 2026-02-23 21:18:40.305517 | TASK [Generate log index] 2026-02-23 21:18:41.554585 | controller | changed 2026-02-23 21:18:41.559124 | 2026-02-23 21:18:41.559182 | TASK [Get some env related data] 2026-02-23 21:18:41.578484 | [controller] Waiting on logger 2026-02-23 21:18:51.964148 | [controller] Waiting on logger 2026-02-23 21:19:02.395914 | [controller] Waiting on logger 2026-02-23 21:19:11.739962 | [controller] Waiting on logger 2026-02-23 21:19:12.814410 | [Zuul] Log Stream did not terminate 2026-02-23 21:19:12.814608 | controller | changed 2026-02-23 21:19:12.839025 | 2026-02-23 21:19:12.839149 | TASK [Generate list of logs to collect in home directory] 2026-02-23 21:19:13.181504 | controller | ok: All paths examined 2026-02-23 21:19:13.186858 | 2026-02-23 21:19:13.186921 | LOOP [Copy logs from home directory] 2026-02-23 21:19:13.735610 | controller | changed: 2026-02-23 21:19:13.735801 | controller | { 2026-02-23 21:19:13.735829 | controller | "atime": 1743544925.4788878, 2026-02-23 21:19:13.735850 | controller | "ctime": 1743545329.1409318, 2026-02-23 21:19:13.735866 | controller | "dev": 64513, 2026-02-23 21:19:13.735883 | controller | "gid": 1000, 2026-02-23 21:19:13.735898 | controller | "gr_name": "zuul", 2026-02-23 21:19:13.735914 | controller | "inode": 4518807, 2026-02-23 21:19:13.735929 | controller | "isblk": false, 2026-02-23 21:19:13.735943 | controller | "ischr": false, 2026-02-23 21:19:13.735981 | controller | "isdir": false, 2026-02-23 21:19:13.736002 | controller | "isfifo": false, 2026-02-23 21:19:13.736018 | controller | "isgid": false, 2026-02-23 21:19:13.736032 | controller | "islnk": false, 2026-02-23 21:19:13.736050 | controller | "isreg": true, 2026-02-23 21:19:13.736066 | controller | "issock": false, 2026-02-23 21:19:13.736081 | controller | "isuid": false, 2026-02-23 21:19:13.736095 | controller | "mode": "0644", 2026-02-23 21:19:13.736110 | controller | "mtime": 1743545329.1409318, 2026-02-23 21:19:13.736124 | controller | "nlink": 1, 2026-02-23 21:19:13.736139 | controller | "path": "/home/zuul/crc-setup.log", 2026-02-23 21:19:13.736155 | controller | "pw_name": "zuul", 2026-02-23 21:19:13.736170 | controller | "rgrp": true, 2026-02-23 21:19:13.736185 | controller | "roth": true, 2026-02-23 21:19:13.736199 | controller | "rusr": true, 2026-02-23 21:19:13.736213 | controller | "size": 4108, 2026-02-23 21:19:13.736228 | controller | "uid": 1000, 2026-02-23 21:19:13.736242 | controller | "wgrp": false, 2026-02-23 21:19:13.736256 | controller | "woth": false, 2026-02-23 21:19:13.736269 | controller | "wusr": true, 2026-02-23 21:19:13.736283 | controller | "xgrp": false, 2026-02-23 21:19:13.736326 | controller | "xoth": false, 2026-02-23 21:19:13.736347 | controller | "xusr": false 2026-02-23 21:19:13.736362 | controller | } 2026-02-23 21:19:14.295930 | controller | changed: 2026-02-23 21:19:14.296016 | controller | { 2026-02-23 21:19:14.296050 | controller | "atime": 1743545331.0429637, 2026-02-23 21:19:14.296070 | controller | "ctime": 1743545842.0111232, 2026-02-23 21:19:14.296095 | controller | "dev": 64513, 2026-02-23 21:19:14.296112 | controller | "gid": 1000, 2026-02-23 21:19:14.296127 | controller | "gr_name": "zuul", 2026-02-23 21:19:14.296141 | controller | "inode": 4194437, 2026-02-23 21:19:14.296156 | controller | "isblk": false, 2026-02-23 21:19:14.296171 | controller | "ischr": false, 2026-02-23 21:19:14.296186 | controller | "isdir": false, 2026-02-23 21:19:14.296200 | controller | "isfifo": false, 2026-02-23 21:19:14.296214 | controller | "isgid": false, 2026-02-23 21:19:14.296227 | controller | "islnk": false, 2026-02-23 21:19:14.296240 | controller | "isreg": true, 2026-02-23 21:19:14.296254 | controller | "issock": false, 2026-02-23 21:19:14.296267 | controller | "isuid": false, 2026-02-23 21:19:14.296280 | controller | "mode": "0644", 2026-02-23 21:19:14.296318 | controller | "mtime": 1743545842.0111232, 2026-02-23 21:19:14.296341 | controller | "nlink": 1, 2026-02-23 21:19:14.296357 | controller | "path": "/home/zuul/crc-start.log", 2026-02-23 21:19:14.296371 | controller | "pw_name": "zuul", 2026-02-23 21:19:14.296385 | controller | "rgrp": true, 2026-02-23 21:19:14.296398 | controller | "roth": true, 2026-02-23 21:19:14.296411 | controller | "rusr": true, 2026-02-23 21:19:14.296425 | controller | "size": 4023, 2026-02-23 21:19:14.296438 | controller | "uid": 1000, 2026-02-23 21:19:14.296450 | controller | "wgrp": false, 2026-02-23 21:19:14.296464 | controller | "woth": false, 2026-02-23 21:19:14.296478 | controller | "wusr": true, 2026-02-23 21:19:14.296492 | controller | "xgrp": false, 2026-02-23 21:19:14.296506 | controller | "xoth": false, 2026-02-23 21:19:14.296519 | controller | "xusr": false 2026-02-23 21:19:14.296533 | controller | } 2026-02-23 21:19:14.860010 | controller | changed: 2026-02-23 21:19:14.860095 | controller | { 2026-02-23 21:19:14.860121 | controller | "atime": 1771880862.9072533, 2026-02-23 21:19:14.860139 | controller | "ctime": 1771880881.2791874, 2026-02-23 21:19:14.860156 | controller | "dev": 64513, 2026-02-23 21:19:14.860172 | controller | "gid": 1000, 2026-02-23 21:19:14.860188 | controller | "gr_name": "zuul", 2026-02-23 21:19:14.860204 | controller | "inode": 4340279, 2026-02-23 21:19:14.860219 | controller | "isblk": false, 2026-02-23 21:19:14.860234 | controller | "ischr": false, 2026-02-23 21:19:14.860252 | controller | "isdir": false, 2026-02-23 21:19:14.860267 | controller | "isfifo": false, 2026-02-23 21:19:14.860282 | controller | "isgid": false, 2026-02-23 21:19:14.860332 | controller | "islnk": false, 2026-02-23 21:19:14.860355 | controller | "isreg": true, 2026-02-23 21:19:14.860371 | controller | "issock": false, 2026-02-23 21:19:14.860385 | controller | "isuid": false, 2026-02-23 21:19:14.860405 | controller | "mode": "0644", 2026-02-23 21:19:14.860419 | controller | "mtime": 1771880881.2791874, 2026-02-23 21:19:14.860433 | controller | "nlink": 1, 2026-02-23 21:19:14.860447 | controller | "path": "/home/zuul/ansible.log", 2026-02-23 21:19:14.860461 | controller | "pw_name": "zuul", 2026-02-23 21:19:14.860475 | controller | "rgrp": true, 2026-02-23 21:19:14.860489 | controller | "roth": true, 2026-02-23 21:19:14.860503 | controller | "rusr": true, 2026-02-23 21:19:14.860517 | controller | "size": 6749, 2026-02-23 21:19:14.860531 | controller | "uid": 1000, 2026-02-23 21:19:14.860544 | controller | "wgrp": false, 2026-02-23 21:19:14.860557 | controller | "woth": false, 2026-02-23 21:19:14.860571 | controller | "wusr": true, 2026-02-23 21:19:14.860584 | controller | "xgrp": false, 2026-02-23 21:19:14.860598 | controller | "xoth": false, 2026-02-23 21:19:14.860612 | controller | "xusr": false 2026-02-23 21:19:14.860625 | controller | } 2026-02-23 21:19:14.870785 | 2026-02-23 21:19:14.870851 | TASK [Copy crio stats log file] 2026-02-23 21:19:14.883591 | controller | skipping: Conditional result was False 2026-02-23 21:19:14.888646 | 2026-02-23 21:19:14.888714 | TASK [Get SELinux related data] 2026-02-23 21:19:14.909517 | [controller] Waiting on logger 2026-02-23 21:19:25.307989 | [controller] Waiting on logger 2026-02-23 21:19:34.651954 | [controller] Waiting on logger 2026-02-23 21:19:45.084019 | [controller] Waiting on logger 2026-02-23 21:19:45.221573 | [Zuul] Log Stream did not terminate 2026-02-23 21:19:45.221870 | controller | ERROR 2026-02-23 21:19:45.221963 | controller | { 2026-02-23 21:19:45.221990 | controller | "delta": "0:00:00.014111", 2026-02-23 21:19:45.222008 | controller | "end": "2026-02-23 21:19:15.196206", 2026-02-23 21:19:45.222023 | controller | "msg": "non-zero return code", 2026-02-23 21:19:45.222038 | controller | "rc": 1, 2026-02-23 21:19:45.222054 | controller | "start": "2026-02-23 21:19:15.182095" 2026-02-23 21:19:45.222069 | controller | } 2026-02-23 21:19:45.222090 | controller | ERROR: Ignoring Errors 2026-02-23 21:19:45.226901 | 2026-02-23 21:19:45.226963 | TASK [Create system configuration directory] 2026-02-23 21:19:45.487962 | controller | changed 2026-02-23 21:19:45.492488 | 2026-02-23 21:19:45.492547 | TASK [Get some of the system configurations] 2026-02-23 21:19:45.514457 | [controller] Waiting on logger 2026-02-23 21:19:55.899912 | [controller] Waiting on logger 2026-02-23 21:20:06.332947 | [controller] Waiting on logger 2026-02-23 21:20:15.675995 | [controller] Waiting on logger 2026-02-23 21:20:15.792806 | [Zuul] Log Stream did not terminate 2026-02-23 21:20:15.793056 | controller | changed 2026-02-23 21:20:15.798216 | 2026-02-23 21:20:15.798279 | TASK [Copy generated documentation if available] 2026-02-23 21:20:15.811530 | controller | skipping: Conditional result was False 2026-02-23 21:20:15.816938 | 2026-02-23 21:20:15.817001 | TASK [Copy generated AsciiDoc documentation if available] 2026-02-23 21:20:15.830031 | controller | skipping: Conditional result was False 2026-02-23 21:20:15.835135 | 2026-02-23 21:20:15.835196 | TASK [Compress logs bigger than 2MB] 2026-02-23 21:20:18.940156 | [controller] Waiting on logger 2026-02-23 21:20:35.387816 | [controller] Waiting on logger 2026-02-23 21:20:38.318953 | controller | changed 2026-02-23 21:20:38.323732 | 2026-02-23 21:20:38.323795 | TASK [Copy files from workspace on node] 2026-02-23 21:20:38.341052 | controller | ok 2026-02-23 21:20:38.360927 | 2026-02-23 21:20:38.360994 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-23 21:20:38.374046 | controller | skipping: Conditional result was False 2026-02-23 21:20:38.379113 | 2026-02-23 21:20:38.379177 | TASK [fetch-output : Set log path for single node] 2026-02-23 21:20:38.406429 | controller | ok 2026-02-23 21:20:38.410991 | 2026-02-23 21:20:38.411056 | LOOP [fetch-output : Ensure local output dirs] 2026-02-23 21:20:38.590746 | controller -> localhost | ok: "/var/lib/zuul/builds/f613925b0b454ba2b6e3440fd4399eb0/work/logs" 2026-02-23 21:20:38.590936 | controller -> localhost | changed: All items complete 2026-02-23 21:20:38.590966 | 2026-02-23 21:20:38.752640 | controller -> localhost | changed: "/var/lib/zuul/builds/f613925b0b454ba2b6e3440fd4399eb0/work/artifacts" 2026-02-23 21:20:38.918691 | controller -> localhost | changed: "/var/lib/zuul/builds/f613925b0b454ba2b6e3440fd4399eb0/work/docs" 2026-02-23 21:20:38.927112 | 2026-02-23 21:20:38.927198 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-23 21:20:39.551955 | controller | changed: 2026-02-23 21:20:39.552128 | controller | .d..t...... ./ 2026-02-23 21:20:39.552160 | controller | >f+++++++++ README.html 2026-02-23 21:20:39.552185 | controller | >f+++++++++ ansible-execution.log 2026-02-23 21:20:39.552206 | controller | >f+++++++++ ansible.log 2026-02-23 21:20:39.552226 | controller | >f+++++++++ crc-setup.log 2026-02-23 21:20:39.552244 | controller | >f+++++++++ crc-start.log 2026-02-23 21:20:39.552262 | controller | >f+++++++++ dmesg.log 2026-02-23 21:20:39.552280 | controller | >f+++++++++ installed-pkgs.log 2026-02-23 21:20:39.552320 | controller | >f+++++++++ python.log 2026-02-23 21:20:39.552353 | controller | >f+++++++++ registries.conf 2026-02-23 21:20:39.552377 | controller | >f+++++++++ report.html 2026-02-23 21:20:39.552395 | controller | >f+++++++++ selinux-denials.log 2026-02-23 21:20:39.552413 | controller | >f+++++++++ selinux-listing.log 2026-02-23 21:20:39.552429 | controller | cd+++++++++ ci-framework-data/ 2026-02-23 21:20:39.552446 | controller | cd+++++++++ ci-framework-data/artifacts/ 2026-02-23 21:20:39.552463 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2026-02-23 21:20:39.552481 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2026-02-23 21:20:39.552498 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2026-02-23 21:20:39.552514 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2026-02-23 21:20:39.552531 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2026-02-23 21:20:39.552547 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2026-02-23 21:20:39.552564 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2026-02-23 21:20:39.552582 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2026-02-23 21:20:39.552600 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2026-02-23 21:20:39.552618 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2026-02-23 21:20:39.552635 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2026-02-23 21:20:39.552652 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2026-02-23 21:20:39.552668 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2026-02-23 21:20:39.552684 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:56:dd:4d 2026-02-23 21:20:39.552701 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:46:e4:24 2026-02-23 21:20:39.552718 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:bc:d4:5b 2026-02-23 21:20:39.552734 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:c2:af:ce 2026-02-23 21:20:39.552750 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:4d:9b:c6 2026-02-23 21:20:39.552766 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:10:59:37 2026-02-23 21:20:39.552781 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2026-02-23 21:20:39.552797 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2026-02-23 21:20:39.552813 | controller | cd+++++++++ ci-framework-data/logs/ 2026-02-23 21:20:39.552829 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2026-02-23 21:20:39.552844 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2026-02-23 21:20:39.552860 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2026-02-23 21:20:39.552877 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2026-02-23 21:20:39.552892 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2026-02-23 21:20:39.552908 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2026-02-23 21:20:39.552927 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2026-02-23 21:20:39.552943 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2026-02-23 21:20:39.552959 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2026-02-23 21:20:39.552975 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2026-02-23 21:20:39.552990 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2026-02-23 21:20:39.553009 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2026-02-23 21:20:39.553026 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2026-02-23 21:20:39.553042 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2026-02-23 21:20:39.553059 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2026-02-23 21:20:39.553083 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2026-02-23 21:20:39.553099 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2026-02-23 21:20:39.553114 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2026-02-23 21:20:39.553130 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2026-02-23 21:20:39.553145 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2026-02-23 21:20:39.553161 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2026-02-23 21:20:39.553177 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2026-02-23 21:20:39.553193 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2026-02-23 21:20:39.553210 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2026-02-23 21:20:39.553225 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2026-02-23 21:20:39.553241 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2026-02-23 21:20:39.553257 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2026-02-23 21:20:39.553273 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2026-02-23 21:20:39.553289 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2026-02-23 21:20:39.553375 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2026-02-23 21:20:39.553400 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2026-02-23 21:20:39.553419 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2026-02-23 21:20:39.553436 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2026-02-23 21:20:39.553452 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2026-02-23 21:20:39.553469 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2026-02-23 21:20:39.553485 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2026-02-23 21:20:39.553502 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2026-02-23 21:20:39.553518 | controller | cd+++++++++ registries.conf.d/ 2026-02-23 21:20:39.553535 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2026-02-23 21:20:39.553552 | controller | cd+++++++++ system-config/ 2026-02-23 21:20:39.553568 | controller | cd+++++++++ system-config/libvirt/ 2026-02-23 21:20:39.553583 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2026-02-23 21:20:39.553603 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2026-02-23 21:20:39.553620 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2026-02-23 21:20:39.553636 | controller | >f+++++++++ system-config/libvirt/network.conf 2026-02-23 21:20:39.553652 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2026-02-23 21:20:39.553668 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2026-02-23 21:20:39.553684 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2026-02-23 21:20:39.553699 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2026-02-23 21:20:39.553715 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2026-02-23 21:20:39.553732 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2026-02-23 21:20:39.553748 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2026-02-23 21:20:39.553763 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2026-02-23 21:20:39.553779 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2026-02-23 21:20:39.553794 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2026-02-23 21:20:39.553810 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2026-02-23 21:20:39.553825 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2026-02-23 21:20:39.971646 | controller | changed: .d..t...... ./ 2026-02-23 21:20:40.389990 | controller | changed: .d..t...... ./ 2026-02-23 21:20:40.400771 | 2026-02-23 21:20:40.400832 | TASK [Return artifact to Zuul] 2026-02-23 21:20:40.428604 | controller | ok 2026-02-23 21:20:40.445016 | 2026-02-23 21:20:40.445098 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2026-02-23 21:20:40.445189 | 2026-02-23 21:20:40.445213 | PLAY RECAP 2026-02-23 21:20:40.445247 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2026-02-23 21:20:40.445266 | 2026-02-23 21:20:40.518378 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-23 21:20:40.519033 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-23 21:20:41.005163 | 2026-02-23 21:20:41.005262 | PLAY [all] 2026-02-23 21:20:41.023498 | 2026-02-23 21:20:41.023572 | TASK [include_role : fetch-output] 2026-02-23 21:20:41.052507 | controller | ok 2026-02-23 21:20:41.068916 | 2026-02-23 21:20:41.069000 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-23 21:20:41.113028 | controller | skipping: Conditional result was False 2026-02-23 21:20:41.118480 | 2026-02-23 21:20:41.118553 | TASK [fetch-output : Set log path for single node] 2026-02-23 21:20:41.146724 | controller | ok 2026-02-23 21:20:41.151614 | 2026-02-23 21:20:41.151683 | LOOP [fetch-output : Ensure local output dirs] 2026-02-23 21:20:41.462345 | controller -> localhost | ok: "/var/lib/zuul/builds/f613925b0b454ba2b6e3440fd4399eb0/work/logs" 2026-02-23 21:20:41.641621 | controller -> localhost | ok: "/var/lib/zuul/builds/f613925b0b454ba2b6e3440fd4399eb0/work/artifacts" 2026-02-23 21:20:41.809161 | controller -> localhost | ok: "/var/lib/zuul/builds/f613925b0b454ba2b6e3440fd4399eb0/work/docs" 2026-02-23 21:20:41.820911 | 2026-02-23 21:20:41.821016 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-23 21:20:42.395585 | controller | ok 2026-02-23 21:20:42.395772 | controller | ok: All items complete 2026-02-23 21:20:42.395802 | 2026-02-23 21:20:42.853914 | controller | ok 2026-02-23 21:20:43.291092 | controller | ok 2026-02-23 21:20:43.305434 | 2026-02-23 21:20:43.305542 | TASK [include_role : fetch-output-openshift] 2026-02-23 21:20:43.319240 | controller | skipping: Conditional result was False 2026-02-23 21:20:43.324604 | 2026-02-23 21:20:43.324674 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-02-23 21:20:43.641679 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006286 2026-02-23 21:20:43.818733 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006134 2026-02-23 21:20:43.847402 | 2026-02-23 21:20:43.847511 | PLAY [all] 2026-02-23 21:20:43.860411 | 2026-02-23 21:20:43.860482 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-02-23 21:20:44.305743 | controller | changed 2026-02-23 21:20:44.326939 | 2026-02-23 21:20:44.327008 | PLAY RECAP 2026-02-23 21:20:44.327053 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-02-23 21:20:44.327075 | 2026-02-23 21:20:44.392769 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-23 21:20:44.393502 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2026-02-23 21:20:44.899076 | 2026-02-23 21:20:44.899182 | PLAY [localhost] 2026-02-23 21:20:44.914941 | 2026-02-23 21:20:44.915011 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-02-23 21:20:45.195362 | localhost | changed 2026-02-23 21:20:45.199455 | 2026-02-23 21:20:45.199529 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-02-23 21:20:45.217409 | localhost | ok 2026-02-23 21:20:45.224756 | 2026-02-23 21:20:45.224828 | TASK [add-fileserver : Create SSH private key tempfile] 2026-02-23 21:20:45.505687 | localhost | changed 2026-02-23 21:20:45.511052 | 2026-02-23 21:20:45.511123 | TASK [add-fileserver : Create SSH private key from secret] 2026-02-23 21:20:46.015036 | localhost | changed 2026-02-23 21:20:46.019871 | 2026-02-23 21:20:46.019938 | TASK [add-fileserver : Add fileserver ssh key] 2026-02-23 21:20:46.340640 | localhost | Identity added: /var/lib/zuul/builds/f613925b0b454ba2b6e3440fd4399eb0/work/tmp/ansible.zrdla6km (/var/lib/zuul/builds/f613925b0b454ba2b6e3440fd4399eb0/work/tmp/ansible.zrdla6km) 2026-02-23 21:20:46.340807 | localhost | ok: Runtime: 0:00:00.005436 2026-02-23 21:20:46.344918 | 2026-02-23 21:20:46.344990 | TASK [add-fileserver : Remove SSH private key from disk] 2026-02-23 21:20:46.554451 | localhost | ok: Runtime: 0:00:00.003794 2026-02-23 21:20:46.559240 | 2026-02-23 21:20:46.559322 | TASK [add-fileserver : Add fileserver to inventory] 2026-02-23 21:20:46.607036 | localhost | changed 2026-02-23 21:20:46.612524 | 2026-02-23 21:20:46.612639 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-02-23 21:20:46.939998 | localhost | changed 2026-02-23 21:20:46.958120 | 2026-02-23 21:20:46.958177 | PLAY [localhost] 2026-02-23 21:20:46.968814 | 2026-02-23 21:20:46.968878 | TASK [Generate bulk log download script] 2026-02-23 21:20:46.986980 | localhost | ok 2026-02-23 21:20:46.997468 | 2026-02-23 21:20:46.997527 | TASK [local-log-download : Check API endpoint is defined] 2026-02-23 21:20:47.024723 | localhost | ok: All assertions passed 2026-02-23 21:20:47.028916 | 2026-02-23 21:20:47.028978 | TASK [local-log-download : Create download script] 2026-02-23 21:20:47.356106 | localhost -> localhost | changed 2026-02-23 21:20:47.364773 | 2026-02-23 21:20:47.364847 | TASK [Register quick-download link] 2026-02-23 21:20:47.381911 | localhost | ok 2026-02-23 21:20:47.415480 | 2026-02-23 21:20:47.415547 | PLAY [logserver.rdoproject.org] 2026-02-23 21:20:47.424780 | 2026-02-23 21:20:47.424841 | TASK [Set zuul-log-path fact] 2026-02-23 21:20:47.441230 | logserver.rdoproject.org | ok 2026-02-23 21:20:47.449755 | 2026-02-23 21:20:47.449821 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-23 21:20:47.466114 | logserver.rdoproject.org | ok 2026-02-23 21:20:47.471105 | 2026-02-23 21:20:47.471169 | TASK [upload-logs : Create log directories] 2026-02-23 21:20:50.107466 | logserver.rdoproject.org | changed 2026-02-23 21:20:50.110313 | 2026-02-23 21:20:50.110397 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-02-23 21:20:50.316893 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004851 2026-02-23 21:20:50.321406 | 2026-02-23 21:20:50.321485 | TASK [upload-logs : Upload logs to log server] 2026-02-23 21:20:51.820676 | logserver.rdoproject.org | Output suppressed because no_log was given 2026-02-23 21:20:51.823271 | 2026-02-23 21:20:51.823422 | LOOP [upload-logs : Compress console log and json output] 2026-02-23 21:20:51.857527 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-23 21:20:51.865659 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-23 21:20:51.869691 | 2026-02-23 21:20:51.869759 | LOOP [upload-logs : Upload compressed console log and json output] 2026-02-23 21:20:51.903146 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-23 21:20:51.903326 | 2026-02-23 21:20:51.906672 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-23 21:20:51.917276 | 2026-02-23 21:20:51.917419 | LOOP [upload-logs : Upload console log and json output]