2026-02-25 10:30:38.363772 | Job console starting... 2026-02-25 10:30:38.564553 | Updating repositories 2026-02-25 10:30:39.317508 | Preparing job workspace 2026-02-25 10:30:46.061253 | Running Ansible setup... 2026-02-25 10:30:49.524220 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-25 10:30:49.999053 | 2026-02-25 10:30:49.999194 | PLAY [localhost] 2026-02-25 10:30:50.007113 | 2026-02-25 10:30:50.007179 | TASK [Gathering Facts] 2026-02-25 10:30:50.792071 | localhost | ok 2026-02-25 10:30:50.804353 | 2026-02-25 10:30:50.804434 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-02-25 10:30:51.101532 | localhost -> localhost | changed 2026-02-25 10:30:51.106770 | 2026-02-25 10:30:51.106846 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-02-25 10:30:51.746960 | localhost -> localhost | changed 2026-02-25 10:30:51.754554 | 2026-02-25 10:30:51.754633 | TASK [Setup log path fact] 2026-02-25 10:30:51.770584 | localhost | ok 2026-02-25 10:30:51.780783 | 2026-02-25 10:30:51.780851 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-25 10:30:51.796636 | localhost | ok 2026-02-25 10:30:51.803427 | 2026-02-25 10:30:51.803492 | TASK [emit-job-header : Print job information] 2026-02-25 10:30:51.829418 | # Job Information 2026-02-25 10:30:51.829529 | Ansible Version: 2.15.12 2026-02-25 10:30:51.829557 | Job: cifmw-molecule-reproducer 2026-02-25 10:30:51.829578 | Pipeline: github-check 2026-02-25 10:30:51.829597 | Executor: ibm-bm4-ze.softwarefactory-project.io 2026-02-25 10:30:51.829614 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3678 2026-02-25 10:30:51.829632 | Log URL (when completed): https://logserver.rdoproject.org/d42/rdoproject.org/d42c11722db54e8c8924efe336e8e30b/ 2026-02-25 10:30:51.829649 | Event ID: e6a15c50-1234-11f1-93dd-4b1b8832b317 2026-02-25 10:30:51.833287 | 2026-02-25 10:30:51.833371 | LOOP [emit-job-header : Print node information] 2026-02-25 10:30:51.917832 | localhost | ok: 2026-02-25 10:30:51.917985 | localhost | # Node Information 2026-02-25 10:30:51.918015 | localhost | Inventory Hostname: controller 2026-02-25 10:30:51.918039 | localhost | Hostname: np0005629274 2026-02-25 10:30:51.918060 | localhost | Username: zuul 2026-02-25 10:30:51.918080 | localhost | Distro: CentOS 9 2026-02-25 10:30:51.918098 | localhost | Provider: ibm-bm4-nodepool 2026-02-25 10:30:51.918115 | localhost | Region: regionOne 2026-02-25 10:30:51.918131 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2026-02-25 10:30:51.918147 | localhost | Product Name: OpenStack Compute 2026-02-25 10:30:51.918172 | localhost | Interface IP: 192.168.26.243 2026-02-25 10:30:51.945627 | 2026-02-25 10:30:51.945708 | PLAY [all] 2026-02-25 10:30:51.951982 | 2026-02-25 10:30:51.952046 | TASK [Gather network facts] 2026-02-25 10:30:52.376254 | controller | ok 2026-02-25 10:30:52.389413 | 2026-02-25 10:30:52.389493 | TASK [include_role : start-zuul-console] 2026-02-25 10:30:52.407070 | controller | ok 2026-02-25 10:30:52.417368 | 2026-02-25 10:30:52.417433 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-02-25 10:30:52.798781 | controller | ok 2026-02-25 10:30:52.806252 | 2026-02-25 10:30:52.806333 | TASK [include_role : add-build-sshkey] 2026-02-25 10:30:52.823645 | controller | ok 2026-02-25 10:30:52.835116 | 2026-02-25 10:30:52.835178 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-02-25 10:30:53.010190 | controller -> localhost | ok 2026-02-25 10:30:53.015160 | 2026-02-25 10:30:53.015219 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-02-25 10:30:53.032898 | controller | ok 2026-02-25 10:30:53.044335 | controller | included: /var/lib/zuul/builds/d42c11722db54e8c8924efe336e8e30b/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-25 10:30:53.049206 | 2026-02-25 10:30:53.049275 | TASK [add-build-sshkey : Create Temp SSH key] 2026-02-25 10:30:53.609240 | controller -> localhost | Generating public/private rsa key pair. 2026-02-25 10:30:53.609455 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/d42c11722db54e8c8924efe336e8e30b/work/d42c11722db54e8c8924efe336e8e30b_id_rsa. 2026-02-25 10:30:53.609490 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/d42c11722db54e8c8924efe336e8e30b/work/d42c11722db54e8c8924efe336e8e30b_id_rsa.pub. 2026-02-25 10:30:53.609513 | controller -> localhost | The key fingerprint is: 2026-02-25 10:30:53.609534 | controller -> localhost | SHA256:vjU5MI9OlUGmbDjcBDsxAG+hp+FslQKMmn6lW1gZQFw zuul-build-sshkey 2026-02-25 10:30:53.609554 | controller -> localhost | The key's randomart image is: 2026-02-25 10:30:53.609574 | controller -> localhost | +---[RSA 3072]----+ 2026-02-25 10:30:53.609592 | controller -> localhost | |+ ++=E+.. o | 2026-02-25 10:30:53.609610 | controller -> localhost | |.o + = O + | 2026-02-25 10:30:53.609628 | controller -> localhost | |..+ * O = . | 2026-02-25 10:30:53.609646 | controller -> localhost | |oo B + + o | 2026-02-25 10:30:53.609664 | controller -> localhost | |. = = S o | 2026-02-25 10:30:53.609681 | controller -> localhost | | o + . . * . | 2026-02-25 10:30:53.609698 | controller -> localhost | | . o + * | 2026-02-25 10:30:53.609715 | controller -> localhost | | . o o o | 2026-02-25 10:30:53.609732 | controller -> localhost | | o | 2026-02-25 10:30:53.609749 | controller -> localhost | +----[SHA256]-----+ 2026-02-25 10:30:53.609794 | controller -> localhost | ok: Runtime: 0:00:00.252371 2026-02-25 10:30:53.615417 | 2026-02-25 10:30:53.615482 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-02-25 10:30:53.633453 | controller | ok 2026-02-25 10:30:53.641763 | controller | included: /var/lib/zuul/builds/d42c11722db54e8c8924efe336e8e30b/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-25 10:30:53.649531 | 2026-02-25 10:30:53.649590 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-02-25 10:30:53.662962 | controller | skipping: Conditional result was False 2026-02-25 10:30:53.668083 | 2026-02-25 10:30:53.668143 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-02-25 10:30:54.132961 | controller | changed 2026-02-25 10:30:54.137141 | 2026-02-25 10:30:54.137203 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-02-25 10:30:54.418128 | controller | ok 2026-02-25 10:30:54.422390 | 2026-02-25 10:30:54.422451 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-02-25 10:30:55.606841 | controller | changed 2026-02-25 10:30:55.611575 | 2026-02-25 10:30:55.611642 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-02-25 10:30:56.775895 | controller | changed 2026-02-25 10:30:56.780602 | 2026-02-25 10:30:56.780665 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-02-25 10:30:56.794163 | controller | skipping: Conditional result was False 2026-02-25 10:30:56.799308 | 2026-02-25 10:30:56.799371 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-02-25 10:30:57.076136 | controller -> localhost | changed 2026-02-25 10:30:57.084513 | 2026-02-25 10:30:57.084573 | TASK [add-build-sshkey : Add back temp key] 2026-02-25 10:30:57.300223 | controller -> localhost | Identity added: /var/lib/zuul/builds/d42c11722db54e8c8924efe336e8e30b/work/d42c11722db54e8c8924efe336e8e30b_id_rsa (zuul-build-sshkey) 2026-02-25 10:30:57.300413 | controller -> localhost | ok: Runtime: 0:00:00.006360 2026-02-25 10:30:57.305529 | 2026-02-25 10:30:57.305590 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-02-25 10:30:57.669056 | controller | ok 2026-02-25 10:30:57.674532 | 2026-02-25 10:30:57.674618 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-02-25 10:30:57.697943 | controller | skipping: Conditional result was False 2026-02-25 10:30:57.706798 | 2026-02-25 10:30:57.706857 | TASK [include_role : validate-host] 2026-02-25 10:30:57.723971 | controller | ok 2026-02-25 10:30:57.740904 | 2026-02-25 10:30:57.740975 | TASK [validate-host : Define zuul_info_dir fact] 2026-02-25 10:30:57.768716 | controller | ok 2026-02-25 10:30:57.774337 | 2026-02-25 10:30:57.774401 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-02-25 10:30:57.960441 | controller -> localhost | ok 2026-02-25 10:30:57.965454 | 2026-02-25 10:30:57.965519 | TASK [validate-host : Collect information about the host] 2026-02-25 10:30:58.699053 | controller | ok 2026-02-25 10:30:58.706021 | 2026-02-25 10:30:58.706077 | TASK [validate-host : Sanitize hostname] 2026-02-25 10:30:58.744254 | controller | ok 2026-02-25 10:30:58.748538 | 2026-02-25 10:30:58.748600 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-02-25 10:30:59.106715 | controller -> localhost | changed 2026-02-25 10:30:59.112041 | 2026-02-25 10:30:59.112125 | TASK [validate-host : Collect information about zuul worker] 2026-02-25 10:30:59.494605 | controller | ok 2026-02-25 10:30:59.499120 | 2026-02-25 10:30:59.499199 | TASK [validate-host : Write out all zuul information for each host] 2026-02-25 10:30:59.847221 | controller -> localhost | changed 2026-02-25 10:30:59.856510 | 2026-02-25 10:30:59.856573 | TASK [include_role : prepare-workspace-openshift] 2026-02-25 10:30:59.870002 | controller | skipping: Conditional result was False 2026-02-25 10:30:59.874781 | 2026-02-25 10:30:59.874843 | TASK [include_role : remove-zuul-sshkey] 2026-02-25 10:30:59.888126 | controller | skipping: Conditional result was False 2026-02-25 10:30:59.892994 | 2026-02-25 10:30:59.893056 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-02-25 10:31:00.157658 | controller | ok: "logs" 2026-02-25 10:31:00.157890 | controller | ok: All items complete 2026-02-25 10:31:00.157924 | 2026-02-25 10:31:00.391598 | controller | ok: "artifacts" 2026-02-25 10:31:00.628457 | controller | ok: "docs" 2026-02-25 10:31:00.640825 | 2026-02-25 10:31:00.640947 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-02-25 10:31:00.923046 | controller | changed: "logs" 2026-02-25 10:31:01.169105 | controller | changed: "artifacts" 2026-02-25 10:31:01.416193 | controller | changed: "docs" 2026-02-25 10:31:01.436062 | 2026-02-25 10:31:01.436114 | PLAY RECAP 2026-02-25 10:31:01.436156 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-25 10:31:01.436182 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-25 10:31:01.436199 | 2026-02-25 10:31:01.508629 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-25 10:31:01.509396 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-25 10:31:02.036974 | 2026-02-25 10:31:02.037123 | PLAY [all] 2026-02-25 10:31:02.056100 | 2026-02-25 10:31:02.056177 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-25 10:31:02.104698 | controller | ok 2026-02-25 10:31:02.109136 | 2026-02-25 10:31:02.109208 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-25 10:31:02.495068 | controller | changed 2026-02-25 10:31:02.500107 | 2026-02-25 10:31:02.500174 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-25 10:31:03.809468 | controller | changed 2026-02-25 10:31:03.818979 | 2026-02-25 10:31:03.819054 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2026-02-25 10:31:04.247581 | controller | changed: 2026-02-25 10:31:04.247732 | controller | { 2026-02-25 10:31:04.247762 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2026-02-25 10:31:04.247788 | controller | } 2026-02-25 10:31:04.550611 | controller | changed: 2026-02-25 10:31:04.550677 | controller | { 2026-02-25 10:31:04.550707 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2026-02-25 10:31:04.550730 | controller | } 2026-02-25 10:31:04.847903 | controller | changed: 2026-02-25 10:31:04.847954 | controller | { 2026-02-25 10:31:04.847979 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2026-02-25 10:31:04.847999 | controller | } 2026-02-25 10:31:05.139029 | controller | changed: 2026-02-25 10:31:05.139086 | controller | { 2026-02-25 10:31:05.139111 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2026-02-25 10:31:05.139132 | controller | } 2026-02-25 10:31:05.425985 | controller | changed: 2026-02-25 10:31:05.426055 | controller | { 2026-02-25 10:31:05.426082 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2026-02-25 10:31:05.426102 | controller | } 2026-02-25 10:31:05.717881 | controller | changed: 2026-02-25 10:31:05.717933 | controller | { 2026-02-25 10:31:05.717957 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2026-02-25 10:31:05.717976 | controller | } 2026-02-25 10:31:06.009575 | controller | changed: 2026-02-25 10:31:06.009623 | controller | { 2026-02-25 10:31:06.009647 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2026-02-25 10:31:06.009668 | controller | } 2026-02-25 10:31:06.293939 | controller | changed: 2026-02-25 10:31:06.293994 | controller | { 2026-02-25 10:31:06.294021 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2026-02-25 10:31:06.294042 | controller | } 2026-02-25 10:31:06.593707 | controller | changed: 2026-02-25 10:31:06.593765 | controller | { 2026-02-25 10:31:06.593792 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2026-02-25 10:31:06.593811 | controller | } 2026-02-25 10:31:06.900827 | controller | changed: 2026-02-25 10:31:06.900893 | controller | { 2026-02-25 10:31:06.900917 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2026-02-25 10:31:06.900935 | controller | } 2026-02-25 10:31:07.169221 | controller | changed: 2026-02-25 10:31:07.169289 | controller | { 2026-02-25 10:31:07.169337 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2026-02-25 10:31:07.169359 | controller | } 2026-02-25 10:31:07.472416 | controller | changed: 2026-02-25 10:31:07.472466 | controller | { 2026-02-25 10:31:07.472491 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2026-02-25 10:31:07.472510 | controller | } 2026-02-25 10:31:07.755510 | controller | changed: 2026-02-25 10:31:07.755575 | controller | { 2026-02-25 10:31:07.755602 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com" 2026-02-25 10:31:07.755623 | controller | } 2026-02-25 10:31:08.048274 | controller | changed: 2026-02-25 10:31:08.048437 | controller | { 2026-02-25 10:31:08.048471 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2026-02-25 10:31:08.048492 | controller | } 2026-02-25 10:31:08.350180 | controller | changed: 2026-02-25 10:31:08.350257 | controller | { 2026-02-25 10:31:08.350292 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2026-02-25 10:31:08.350333 | controller | } 2026-02-25 10:31:08.629613 | controller | changed: 2026-02-25 10:31:08.629665 | controller | { 2026-02-25 10:31:08.629691 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2026-02-25 10:31:08.629710 | controller | } 2026-02-25 10:31:08.912950 | controller | changed: 2026-02-25 10:31:08.912997 | controller | { 2026-02-25 10:31:08.913020 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2026-02-25 10:31:08.913039 | controller | } 2026-02-25 10:31:09.199713 | controller | changed: 2026-02-25 10:31:09.199761 | controller | { 2026-02-25 10:31:09.199784 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2026-02-25 10:31:09.199810 | controller | } 2026-02-25 10:31:09.485704 | controller | changed: 2026-02-25 10:31:09.485750 | controller | { 2026-02-25 10:31:09.485773 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2026-02-25 10:31:09.485792 | controller | } 2026-02-25 10:31:09.782571 | controller | changed: 2026-02-25 10:31:09.782618 | controller | { 2026-02-25 10:31:09.782640 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2026-02-25 10:31:09.782659 | controller | } 2026-02-25 10:31:10.075791 | controller | changed: 2026-02-25 10:31:10.075837 | controller | { 2026-02-25 10:31:10.075860 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2026-02-25 10:31:10.075879 | controller | } 2026-02-25 10:31:10.387207 | controller | changed: 2026-02-25 10:31:10.387271 | controller | { 2026-02-25 10:31:10.387316 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2026-02-25 10:31:10.387341 | controller | } 2026-02-25 10:31:10.690094 | controller | changed: 2026-02-25 10:31:10.690175 | controller | { 2026-02-25 10:31:10.690202 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2026-02-25 10:31:10.690223 | controller | } 2026-02-25 10:31:10.997999 | controller | changed: 2026-02-25 10:31:10.998081 | controller | { 2026-02-25 10:31:10.998108 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2026-02-25 10:31:10.998130 | controller | } 2026-02-25 10:31:11.294675 | controller | changed: 2026-02-25 10:31:11.294729 | controller | { 2026-02-25 10:31:11.294753 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2026-02-25 10:31:11.294771 | controller | } 2026-02-25 10:31:11.582144 | controller | changed: 2026-02-25 10:31:11.582212 | controller | { 2026-02-25 10:31:11.582235 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2026-02-25 10:31:11.582253 | controller | } 2026-02-25 10:31:11.601185 | 2026-02-25 10:31:11.601322 | TASK [Set timezone to UTC] 2026-02-25 10:31:12.085531 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2026-02-25 10:31:12.089904 | 2026-02-25 10:31:12.089964 | TASK [Create nodepool directory] 2026-02-25 10:31:12.365180 | controller | changed 2026-02-25 10:31:12.370135 | 2026-02-25 10:31:12.370196 | TASK [Create nodepool sub_nodes file] 2026-02-25 10:31:13.350816 | controller | changed 2026-02-25 10:31:13.355685 | 2026-02-25 10:31:13.355751 | TASK [Create nodepool sub_nodes_private file] 2026-02-25 10:31:14.375211 | controller | changed 2026-02-25 10:31:14.379969 | 2026-02-25 10:31:14.380037 | LOOP [Populate nodepool sub_nodes file] 2026-02-25 10:31:14.408803 | 2026-02-25 10:31:14.408918 | LOOP [Populate nodepool sub_nodes_private file] 2026-02-25 10:31:14.437388 | 2026-02-25 10:31:14.437503 | TASK [Create nodepool primary file] 2026-02-25 10:31:14.460955 | controller | skipping: Conditional result was False 2026-02-25 10:31:14.465956 | 2026-02-25 10:31:14.466029 | TASK [Create nodepool node_private for this node] 2026-02-25 10:31:15.488228 | controller | changed 2026-02-25 10:31:15.493313 | 2026-02-25 10:31:15.493376 | LOOP [Copy ssh keys to nodepool directory] 2026-02-25 10:31:15.865549 | controller | ok: Item: id_rsa Runtime: 0:00:00.005169 2026-02-25 10:31:15.865724 | 2026-02-25 10:31:16.083099 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004222 2026-02-25 10:31:16.089380 | 2026-02-25 10:31:16.089477 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2026-02-25 10:31:17.092883 | controller | changed 2026-02-25 10:31:17.097600 | 2026-02-25 10:31:17.097664 | TASK [Validate sudoers config after edits] 2026-02-25 10:31:17.374796 | controller | /etc/sudoers: parsed OK 2026-02-25 10:31:17.374871 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2026-02-25 10:31:17.374882 | controller | /etc/sudoers.d/zuul: parsed OK 2026-02-25 10:31:17.374888 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2026-02-25 10:31:17.622686 | controller | ok: Runtime: 0:00:00.005579 2026-02-25 10:31:17.627195 | 2026-02-25 10:31:17.627249 | TASK [Show the environment passed in to job shell scripts] 2026-02-25 10:31:17.883400 | controller | SHELL=/bin/bash 2026-02-25 10:31:17.883449 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2026-02-25 10:31:17.883459 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2026-02-25 10:31:17.883465 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/78/3678/94dc1b7a74bfc86eea515d4091fec5f6f9176cd4 2026-02-25 10:31:17.883470 | controller | PWD=/home/zuul 2026-02-25 10:31:17.883475 | controller | ZUUL_PIPELINE=github-check 2026-02-25 10:31:17.883480 | controller | LOGNAME=zuul 2026-02-25 10:31:17.883525 | controller | XDG_SESSION_TYPE=tty 2026-02-25 10:31:17.883533 | controller | _=/usr/bin/env 2026-02-25 10:31:17.883538 | controller | MOTD_SHOWN=pam 2026-02-25 10:31:17.883543 | controller | HOME=/home/zuul 2026-02-25 10:31:17.883547 | controller | LANG=en_US.UTF-8 2026-02-25 10:31:17.883553 | controller | SSH_CONNECTION=192.168.26.12 38016 192.168.26.243 22 2026-02-25 10:31:17.883558 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2026-02-25 10:31:17.883566 | controller | ZUUL_CHANGE_IDS=3678,94dc1b7a74bfc86eea515d4091fec5f6f9176cd4 2026-02-25 10:31:17.883571 | controller | WORKSPACE=/home/zuul/workspace 2026-02-25 10:31:17.883576 | controller | XDG_SESSION_CLASS=user 2026-02-25 10:31:17.883581 | controller | SELINUX_ROLE_REQUESTED= 2026-02-25 10:31:17.883585 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2026-02-25 10:31:17.883590 | controller | USER=zuul 2026-02-25 10:31:17.883595 | controller | ZUUL_VOTING=True 2026-02-25 10:31:17.883600 | controller | BUILD_TIMEOUT=5400000 2026-02-25 10:31:17.883605 | controller | SELINUX_USE_CURRENT_RANGE= 2026-02-25 10:31:17.883609 | controller | SHLVL=1 2026-02-25 10:31:17.883614 | controller | ZUUL_PATCHSET=94dc1b7a74bfc86eea515d4091fec5f6f9176cd4 2026-02-25 10:31:17.883619 | controller | XDG_SESSION_ID=1 2026-02-25 10:31:17.883624 | controller | ZUUL_BRANCH=main 2026-02-25 10:31:17.883629 | controller | XDG_RUNTIME_DIR=/run/user/1000 2026-02-25 10:31:17.883634 | controller | SSH_CLIENT=192.168.26.12 38016 22 2026-02-25 10:31:17.883639 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2026-02-25 10:31:17.883644 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2026-02-25 10:31:17.883650 | controller | which_declare=declare -f 2026-02-25 10:31:17.883656 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2026-02-25 10:31:17.883661 | controller | SELINUX_LEVEL_REQUESTED= 2026-02-25 10:31:17.883666 | controller | ZUUL_CHANGE=3678 2026-02-25 10:31:17.883671 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2026-02-25 10:31:17.883675 | controller | ZUUL_UUID=d42c11722db54e8c8924efe336e8e30b 2026-02-25 10:31:17.883680 | controller | BASH_FUNC_which%%=() { ( alias; 2026-02-25 10:31:17.883685 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2026-02-25 10:31:17.883690 | controller | } 2026-02-25 10:31:18.151823 | controller | ok: Runtime: 0:00:00.005913 2026-02-25 10:31:18.157250 | 2026-02-25 10:31:18.157341 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2026-02-25 10:31:18.171551 | controller | skipping: Conditional result was False 2026-02-25 10:31:18.177162 | 2026-02-25 10:31:18.177251 | TASK [Symlink /home/zuul-worker/workspace] 2026-02-25 10:31:18.724367 | controller | skipping: Conditional result was False 2026-02-25 10:31:18.729825 | 2026-02-25 10:31:18.729891 | TASK [Ensure legacy workspace directory] 2026-02-25 10:31:18.971283 | controller | changed 2026-02-25 10:31:18.988198 | 2026-02-25 10:31:18.988244 | PLAY RECAP 2026-02-25 10:31:18.988324 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-25 10:31:18.988356 | 2026-02-25 10:31:19.057283 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-25 10:31:19.058107 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-25 10:31:19.516377 | 2026-02-25 10:31:19.516458 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2026-02-25 10:31:19.534793 | 2026-02-25 10:31:19.534859 | TASK [Create zuul-output directory] 2026-02-25 10:31:19.888047 | controller | changed 2026-02-25 10:31:19.892960 | 2026-02-25 10:31:19.893027 | TASK [Slurp Zuul inventory test] 2026-02-25 10:31:20.148858 | controller -> localhost | ok 2026-02-25 10:31:20.155266 | 2026-02-25 10:31:20.155383 | TASK [Save zuul inventory] 2026-02-25 10:31:21.299804 | controller | changed 2026-02-25 10:31:21.304202 | 2026-02-25 10:31:21.304263 | TASK [Save zuul vars without the change_message] 2026-02-25 10:31:22.293850 | controller | changed 2026-02-25 10:31:22.309563 | 2026-02-25 10:31:22.309616 | PLAY RECAP 2026-02-25 10:31:22.309656 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-25 10:31:22.309676 | 2026-02-25 10:31:22.372438 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-25 10:31:22.373139 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-25 10:31:22.866971 | 2026-02-25 10:31:22.867067 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2026-02-25 10:31:22.885609 | 2026-02-25 10:31:22.885678 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2026-02-25 10:31:22.904394 | controller | ok 2026-02-25 10:31:22.919733 | 2026-02-25 10:31:22.919812 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-25 10:31:22.943799 | controller | skipping: Conditional result was False 2026-02-25 10:31:22.948979 | 2026-02-25 10:31:22.949045 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-25 10:31:23.311629 | controller | ok 2026-02-25 10:31:23.316866 | 2026-02-25 10:31:23.316932 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-25 10:31:24.241035 | controller | ok 2026-02-25 10:31:24.250087 | 2026-02-25 10:31:24.250147 | TASK [Prepare workspace] 2026-02-25 10:31:24.267596 | controller | ok 2026-02-25 10:31:24.282651 | 2026-02-25 10:31:24.282714 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-02-25 10:31:24.625822 | controller | ok 2026-02-25 10:31:24.630806 | 2026-02-25 10:31:24.630864 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-02-25 10:31:26.918283 | controller | Output suppressed because no_log was given 2026-02-25 10:31:26.927106 | 2026-02-25 10:31:26.927177 | LOOP [Create zuul-output directory] 2026-02-25 10:31:27.173652 | controller | changed: "/home/zuul/ci-framework-data/logs" 2026-02-25 10:31:27.391116 | controller | ok: "/home/zuul/zuul-output/logs" 2026-02-25 10:31:27.403937 | 2026-02-25 10:31:27.404019 | TASK [Install required packages] 2026-02-25 10:31:45.259012 | controller | ok: Nothing to do 2026-02-25 10:31:45.263435 | 2026-02-25 10:31:45.263495 | TASK [Install venv] 2026-02-25 10:32:40.692065 | controller | changed 2026-02-25 10:32:40.713931 | 2026-02-25 10:32:40.713990 | PLAY RECAP 2026-02-25 10:32:40.714029 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-25 10:32:40.714051 | 2026-02-25 10:32:40.778663 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-25 10:32:40.779429 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-25 10:32:41.260433 | 2026-02-25 10:32:41.260562 | PLAY [Run ci/playbooks/molecule-test.yml] 2026-02-25 10:32:41.280270 | 2026-02-25 10:32:41.280372 | TASK [Gather required facts] 2026-02-25 10:32:41.775723 | controller | ok 2026-02-25 10:32:41.780831 | 2026-02-25 10:32:41.780904 | TASK [Load environment var if instructed to] 2026-02-25 10:32:41.804922 | controller | skipping: Conditional result was False 2026-02-25 10:32:41.810053 | 2026-02-25 10:32:41.810117 | TASK [Ensure group_vars dir exists] 2026-02-25 10:32:42.153761 | controller | ok 2026-02-25 10:32:42.158725 | 2026-02-25 10:32:42.158789 | TASK [Print related variables] 2026-02-25 10:32:42.187243 | controller | ok: 2026-02-25 10:32:42.187381 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2026-02-25 10:32:42.187414 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2026-02-25 10:32:42.192264 | 2026-02-25 10:32:42.192345 | TASK [Run molecule] 2026-02-25 10:32:43.122581 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2026-02-25 10:32:43.381093 | controller | INFO Performing prerun with role_name_check=0... 2026-02-25 10:32:59.690986 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.691402 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.691425 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.691453 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.691845 | controller | WARNING Another version of 'cifmw.general' 1.0.0+94dc1b7a was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+94dc1b7a (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.692259 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.692660 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.693043 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.693452 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.693816 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.694209 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.694608 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.694981 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.695396 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.695807 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 10:32:59.704596 | controller | INFO Running crc_layout > prepare 2026-02-25 10:33:00.344207 | controller | 2026-02-25 10:33:00.344344 | controller | PLAY [Prepare] ***************************************************************** 2026-02-25 10:33:00.344462 | controller | 2026-02-25 10:33:00.344479 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-25 10:33:00.344495 | controller | Wednesday 25 February 2026 10:33:00 +0000 (0:00:00.018) 0:00:00.018 **** 2026-02-25 10:33:01.236033 | controller | ok: [instance] 2026-02-25 10:33:01.236099 | controller | 2026-02-25 10:33:01.236115 | controller | TASK [Create custom basedir] *************************************************** 2026-02-25 10:33:01.236209 | controller | Wednesday 25 February 2026 10:33:01 +0000 (0:00:00.892) 0:00:00.911 **** 2026-02-25 10:33:01.542354 | controller | changed: [instance] 2026-02-25 10:33:01.542451 | controller | 2026-02-25 10:33:01.542465 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2026-02-25 10:33:01.542545 | controller | Wednesday 25 February 2026 10:33:01 +0000 (0:00:00.305) 0:00:01.216 **** 2026-02-25 10:33:01.566426 | controller | skipping: [instance] 2026-02-25 10:33:01.566491 | controller | 2026-02-25 10:33:01.566626 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2026-02-25 10:33:01.566710 | controller | Wednesday 25 February 2026 10:33:01 +0000 (0:00:00.024) 0:00:01.241 **** 2026-02-25 10:33:01.620485 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2026-02-25 10:33:01.620587 | controller | 2026-02-25 10:33:01.620731 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2026-02-25 10:33:01.620791 | controller | Wednesday 25 February 2026 10:33:01 +0000 (0:00:00.054) 0:00:01.295 **** 2026-02-25 10:33:01.900139 | controller | ok: [instance] 2026-02-25 10:33:01.900243 | controller | 2026-02-25 10:33:01.900341 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2026-02-25 10:33:01.900432 | controller | Wednesday 25 February 2026 10:33:01 +0000 (0:00:00.279) 0:00:01.575 **** 2026-02-25 10:33:02.121848 | controller | ok: [instance] 2026-02-25 10:33:02.121886 | controller | 2026-02-25 10:33:02.121994 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2026-02-25 10:33:02.122080 | controller | Wednesday 25 February 2026 10:33:02 +0000 (0:00:00.221) 0:00:01.797 **** 2026-02-25 10:33:02.815188 | controller | ok: [instance] => (item=ubi-9-appstream) 2026-02-25 10:33:02.815266 | controller | ok: [instance] => (item=ubi-9-baseos) 2026-02-25 10:33:02.815369 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2026-02-25 10:33:02.815511 | controller | 2026-02-25 10:33:02.815579 | controller | TASK [Deploy repo-setup] ******************************************************* 2026-02-25 10:33:02.815685 | controller | Wednesday 25 February 2026 10:33:02 +0000 (0:00:00.693) 0:00:02.490 **** 2026-02-25 10:33:02.874373 | controller | 2026-02-25 10:33:02.874458 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-25 10:33:02.874556 | controller | Wednesday 25 February 2026 10:33:02 +0000 (0:00:00.059) 0:00:02.549 **** 2026-02-25 10:33:03.463088 | controller | changed: [instance] => (item=tmp) 2026-02-25 10:33:03.463223 | controller | changed: [instance] => (item=artifacts/repositories) 2026-02-25 10:33:03.463245 | controller | changed: [instance] => (item=venv/repo_setup) 2026-02-25 10:33:03.463307 | controller | 2026-02-25 10:33:03.463398 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-25 10:33:03.463508 | controller | Wednesday 25 February 2026 10:33:03 +0000 (0:00:00.588) 0:00:03.138 **** 2026-02-25 10:33:04.303173 | controller | ok: [instance] 2026-02-25 10:33:04.303218 | controller | 2026-02-25 10:33:04.303403 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-25 10:33:05.374667 | controller | Wednesday 25 February 2026 10:33:04 +0000 (0:00:00.840) 0:00:03.978 **** 2026-02-25 10:33:05.374713 | controller | changed: [instance] 2026-02-25 10:33:12.632964 | controller | 2026-02-25 10:33:12.633008 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-25 10:33:12.633016 | controller | Wednesday 25 February 2026 10:33:05 +0000 (0:00:01.071) 0:00:05.049 **** 2026-02-25 10:33:12.633027 | controller | changed: [instance] 2026-02-25 10:33:13.289464 | controller | 2026-02-25 10:33:13.289504 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-25 10:33:13.289513 | controller | Wednesday 25 February 2026 10:33:12 +0000 (0:00:07.258) 0:00:12.307 **** 2026-02-25 10:33:13.289525 | controller | changed: [instance] 2026-02-25 10:33:13.310595 | controller | 2026-02-25 10:33:13.310617 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-25 10:33:13.310626 | controller | Wednesday 25 February 2026 10:33:13 +0000 (0:00:00.656) 0:00:12.964 **** 2026-02-25 10:33:13.310636 | controller | skipping: [instance] 2026-02-25 10:33:14.107939 | controller | 2026-02-25 10:33:14.107975 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-25 10:33:14.107984 | controller | Wednesday 25 February 2026 10:33:13 +0000 (0:00:00.021) 0:00:12.985 **** 2026-02-25 10:33:14.107995 | controller | changed: [instance] 2026-02-25 10:33:14.145227 | controller | 2026-02-25 10:33:14.145248 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-25 10:33:14.145261 | controller | Wednesday 25 February 2026 10:33:14 +0000 (0:00:00.797) 0:00:13.782 **** 2026-02-25 10:33:14.145269 | controller | skipping: [instance] 2026-02-25 10:33:14.145286 | controller | 2026-02-25 10:33:14.145386 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-25 10:33:14.145498 | controller | Wednesday 25 February 2026 10:33:14 +0000 (0:00:00.037) 0:00:13.820 **** 2026-02-25 10:33:14.181285 | controller | skipping: [instance] 2026-02-25 10:33:14.181623 | controller | 2026-02-25 10:33:14.181837 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-25 10:33:14.220610 | controller | Wednesday 25 February 2026 10:33:14 +0000 (0:00:00.036) 0:00:13.856 **** 2026-02-25 10:33:14.220628 | controller | skipping: [instance] 2026-02-25 10:33:14.731743 | controller | 2026-02-25 10:33:14.731768 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-25 10:33:14.731776 | controller | Wednesday 25 February 2026 10:33:14 +0000 (0:00:00.038) 0:00:13.895 **** 2026-02-25 10:33:14.731785 | controller | changed: [instance] 2026-02-25 10:33:15.143302 | controller | 2026-02-25 10:33:15.143345 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-25 10:33:15.143355 | controller | Wednesday 25 February 2026 10:33:14 +0000 (0:00:00.510) 0:00:14.406 **** 2026-02-25 10:33:15.143368 | controller | changed: [instance] 2026-02-25 10:33:15.173244 | controller | 2026-02-25 10:33:15.173274 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-25 10:33:15.173283 | controller | Wednesday 25 February 2026 10:33:15 +0000 (0:00:00.411) 0:00:14.818 **** 2026-02-25 10:33:15.173295 | controller | skipping: [instance] 2026-02-25 10:33:15.173329 | controller | 2026-02-25 10:33:15.173337 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-25 10:33:15.173346 | controller | Wednesday 25 February 2026 10:33:15 +0000 (0:00:00.030) 0:00:14.848 **** 2026-02-25 10:33:15.201570 | controller | skipping: [instance] 2026-02-25 10:33:15.231005 | controller | 2026-02-25 10:33:15.231028 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-25 10:33:15.231038 | controller | Wednesday 25 February 2026 10:33:15 +0000 (0:00:00.028) 0:00:14.876 **** 2026-02-25 10:33:15.231050 | controller | skipping: [instance] 2026-02-25 10:33:15.268745 | controller | 2026-02-25 10:33:15.268775 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-25 10:33:15.268787 | controller | Wednesday 25 February 2026 10:33:15 +0000 (0:00:00.029) 0:00:14.906 **** 2026-02-25 10:33:15.268802 | controller | ok: [instance] 2026-02-25 10:33:15.294936 | controller | 2026-02-25 10:33:15.294957 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-25 10:33:15.294967 | controller | Wednesday 25 February 2026 10:33:15 +0000 (0:00:00.037) 0:00:14.943 **** 2026-02-25 10:33:15.294986 | controller | skipping: [instance] 2026-02-25 10:33:15.322875 | controller | 2026-02-25 10:33:15.322895 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-25 10:33:15.322903 | controller | Wednesday 25 February 2026 10:33:15 +0000 (0:00:00.026) 0:00:14.969 **** 2026-02-25 10:33:15.322913 | controller | skipping: [instance] 2026-02-25 10:33:15.323066 | controller | 2026-02-25 10:33:15.323255 | controller | TASK [Download the RPM] ******************************************************** 2026-02-25 10:33:15.323408 | controller | Wednesday 25 February 2026 10:33:15 +0000 (0:00:00.028) 0:00:14.998 **** 2026-02-25 10:33:15.350423 | controller | skipping: [instance] 2026-02-25 10:33:15.350603 | controller | 2026-02-25 10:33:15.350749 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-25 10:33:15.350878 | controller | Wednesday 25 February 2026 10:33:15 +0000 (0:00:00.027) 0:00:15.025 **** 2026-02-25 10:33:15.375850 | controller | skipping: [instance] 2026-02-25 10:33:15.376012 | controller | 2026-02-25 10:33:15.376196 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-25 10:33:15.376356 | controller | Wednesday 25 February 2026 10:33:15 +0000 (0:00:00.025) 0:00:15.051 **** 2026-02-25 10:33:15.401416 | controller | skipping: [instance] 2026-02-25 10:33:15.401600 | controller | 2026-02-25 10:33:15.401754 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-25 10:33:15.401884 | controller | Wednesday 25 February 2026 10:33:15 +0000 (0:00:00.025) 0:00:15.076 **** 2026-02-25 10:33:15.428206 | controller | skipping: [instance] 2026-02-25 10:33:15.428342 | controller | 2026-02-25 10:33:15.428479 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-25 10:33:15.428600 | controller | Wednesday 25 February 2026 10:33:15 +0000 (0:00:00.026) 0:00:15.103 **** 2026-02-25 10:33:15.453123 | controller | skipping: [instance] 2026-02-25 10:33:15.453414 | controller | 2026-02-25 10:33:15.453667 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-25 10:33:15.453883 | controller | Wednesday 25 February 2026 10:33:15 +0000 (0:00:00.024) 0:00:15.128 **** 2026-02-25 10:33:15.627669 | controller | ok: [instance] 2026-02-25 10:33:15.832180 | controller | 2026-02-25 10:33:15.832217 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-25 10:33:15.832225 | controller | Wednesday 25 February 2026 10:33:15 +0000 (0:00:00.174) 0:00:15.302 **** 2026-02-25 10:33:15.832237 | controller | changed: [instance] 2026-02-25 10:33:16.054232 | controller | 2026-02-25 10:33:16.054268 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-25 10:33:16.054276 | controller | Wednesday 25 February 2026 10:33:15 +0000 (0:00:00.204) 0:00:15.507 **** 2026-02-25 10:33:16.054287 | controller | changed: [instance] 2026-02-25 10:33:16.074297 | controller | 2026-02-25 10:33:16.074328 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-25 10:33:16.074340 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.222) 0:00:15.729 **** 2026-02-25 10:33:16.074355 | controller | skipping: [instance] 2026-02-25 10:33:16.074394 | controller | 2026-02-25 10:33:16.074407 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-25 10:33:16.074605 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.020) 0:00:15.749 **** 2026-02-25 10:33:16.093992 | controller | skipping: [instance] 2026-02-25 10:33:16.114680 | controller | 2026-02-25 10:33:16.114700 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-25 10:33:16.114709 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.019) 0:00:15.769 **** 2026-02-25 10:33:16.114718 | controller | skipping: [instance] 2026-02-25 10:33:16.135225 | controller | 2026-02-25 10:33:16.135262 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-25 10:33:16.135270 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.020) 0:00:15.789 **** 2026-02-25 10:33:16.135281 | controller | skipping: [instance] 2026-02-25 10:33:16.155221 | controller | 2026-02-25 10:33:16.155246 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-25 10:33:16.155260 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.020) 0:00:15.810 **** 2026-02-25 10:33:16.155269 | controller | skipping: [instance] 2026-02-25 10:33:16.175821 | controller | 2026-02-25 10:33:16.175844 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-25 10:33:16.175854 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.020) 0:00:15.830 **** 2026-02-25 10:33:16.175868 | controller | skipping: [instance] 2026-02-25 10:33:16.191305 | controller | 2026-02-25 10:33:16.191327 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-25 10:33:16.191336 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.020) 0:00:15.850 **** 2026-02-25 10:33:16.191347 | controller | skipping: [instance] 2026-02-25 10:33:16.191528 | controller | 2026-02-25 10:33:16.191696 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-25 10:33:16.191854 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.016) 0:00:15.866 **** 2026-02-25 10:33:16.218947 | controller | skipping: [instance] 2026-02-25 10:33:16.219118 | controller | 2026-02-25 10:33:16.219300 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-25 10:33:16.219441 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.027) 0:00:15.894 **** 2026-02-25 10:33:16.235022 | controller | skipping: [instance] 2026-02-25 10:33:16.235301 | controller | 2026-02-25 10:33:16.235570 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-25 10:33:16.235705 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.015) 0:00:15.910 **** 2026-02-25 10:33:16.254047 | controller | skipping: [instance] 2026-02-25 10:33:16.254243 | controller | 2026-02-25 10:33:16.254404 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2026-02-25 10:33:16.254544 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.019) 0:00:15.929 **** 2026-02-25 10:33:16.280669 | controller | skipping: [instance] 2026-02-25 10:33:16.280831 | controller | 2026-02-25 10:33:16.280982 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2026-02-25 10:33:16.281125 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.026) 0:00:15.956 **** 2026-02-25 10:33:16.308814 | controller | skipping: [instance] 2026-02-25 10:33:16.308975 | controller | 2026-02-25 10:33:16.309123 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2026-02-25 10:33:16.309296 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.028) 0:00:15.984 **** 2026-02-25 10:33:16.336346 | controller | skipping: [instance] 2026-02-25 10:33:16.336536 | controller | 2026-02-25 10:33:16.336672 | controller | TASK [test_deps : Install additional packages] ********************************* 2026-02-25 10:33:16.336794 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.027) 0:00:16.011 **** 2026-02-25 10:33:16.364434 | controller | skipping: [instance] 2026-02-25 10:33:16.364623 | controller | 2026-02-25 10:33:16.364754 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2026-02-25 10:33:16.364873 | controller | Wednesday 25 February 2026 10:33:16 +0000 (0:00:00.028) 0:00:16.039 **** 2026-02-25 10:34:00.576706 | controller | ok: [instance] 2026-02-25 10:34:01.729695 | controller | 2026-02-25 10:34:01.729728 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2026-02-25 10:34:01.729736 | controller | Wednesday 25 February 2026 10:34:00 +0000 (0:00:44.211) 0:01:00.251 **** 2026-02-25 10:34:01.729746 | controller | ok: [instance] 2026-02-25 10:34:01.760292 | controller | 2026-02-25 10:34:01.760326 | controller | TASK [test_deps : Install extra packages] ************************************** 2026-02-25 10:34:01.760335 | controller | Wednesday 25 February 2026 10:34:01 +0000 (0:00:01.153) 0:01:01.404 **** 2026-02-25 10:34:01.760348 | controller | skipping: [instance] 2026-02-25 10:34:01.760394 | controller | 2026-02-25 10:34:01.760418 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-25 10:34:01.760430 | controller | Wednesday 25 February 2026 10:34:01 +0000 (0:00:00.030) 0:01:01.435 **** 2026-02-25 10:34:01.800585 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2026-02-25 10:34:01.820250 | controller | 2026-02-25 10:34:01.820272 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-25 10:34:01.820286 | controller | Wednesday 25 February 2026 10:34:01 +0000 (0:00:00.040) 0:01:01.475 **** 2026-02-25 10:34:01.820297 | controller | ok: [instance] => 2026-02-25 10:34:01.820323 | controller | cifmw_ci_setup_packages: 2026-02-25 10:34:01.820331 | controller | - bash-completion 2026-02-25 10:34:01.820337 | controller | - ca-certificates 2026-02-25 10:34:01.820343 | controller | - git-core 2026-02-25 10:34:01.820349 | controller | - make 2026-02-25 10:34:01.820355 | controller | - tar 2026-02-25 10:34:01.820362 | controller | - tmux 2026-02-25 10:34:01.820367 | controller | - python3-pip 2026-02-25 10:34:01.820374 | controller | 2026-02-25 10:34:01.820381 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-25 10:34:01.820411 | controller | Wednesday 25 February 2026 10:34:01 +0000 (0:00:00.018) 0:01:01.494 **** 2026-02-25 10:34:09.786859 | controller | changed: [instance] 2026-02-25 10:34:10.367828 | controller | 2026-02-25 10:34:10.367871 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-25 10:34:10.367880 | controller | Wednesday 25 February 2026 10:34:09 +0000 (0:00:07.966) 0:01:09.461 **** 2026-02-25 10:34:10.367892 | controller | ok: [instance] 2026-02-25 10:34:10.367911 | controller | 2026-02-25 10:34:10.368134 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-25 10:34:10.575233 | controller | Wednesday 25 February 2026 10:34:10 +0000 (0:00:00.581) 0:01:10.043 **** 2026-02-25 10:34:10.575267 | controller | changed: [instance] 2026-02-25 10:34:10.575293 | controller | 2026-02-25 10:34:10.575525 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-25 10:34:16.460234 | controller | Wednesday 25 February 2026 10:34:10 +0000 (0:00:00.207) 0:01:10.250 **** 2026-02-25 10:34:16.460268 | controller | changed: [instance] 2026-02-25 10:34:16.494216 | controller | 2026-02-25 10:34:16.494239 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-25 10:34:16.494246 | controller | Wednesday 25 February 2026 10:34:16 +0000 (0:00:05.884) 0:01:16.135 **** 2026-02-25 10:34:16.494256 | controller | ok: [instance] 2026-02-25 10:34:16.766060 | controller | 2026-02-25 10:34:16.766088 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-25 10:34:16.766095 | controller | Wednesday 25 February 2026 10:34:16 +0000 (0:00:00.034) 0:01:16.169 **** 2026-02-25 10:34:16.766105 | controller | changed: [instance] 2026-02-25 10:34:17.018770 | controller | 2026-02-25 10:34:17.018791 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-25 10:34:17.018799 | controller | Wednesday 25 February 2026 10:34:16 +0000 (0:00:00.271) 0:01:16.441 **** 2026-02-25 10:34:17.018808 | controller | changed: [instance] 2026-02-25 10:34:17.035232 | controller | 2026-02-25 10:34:17.035272 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-25 10:34:17.035283 | controller | Wednesday 25 February 2026 10:34:17 +0000 (0:00:00.252) 0:01:16.694 **** 2026-02-25 10:34:17.035296 | controller | skipping: [instance] 2026-02-25 10:34:17.050310 | controller | 2026-02-25 10:34:17.050359 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-25 10:34:17.050374 | controller | Wednesday 25 February 2026 10:34:17 +0000 (0:00:00.016) 0:01:16.710 **** 2026-02-25 10:34:17.050392 | controller | skipping: [instance] 2026-02-25 10:34:17.050457 | controller | 2026-02-25 10:34:17.050474 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-25 10:34:17.050504 | controller | Wednesday 25 February 2026 10:34:17 +0000 (0:00:00.015) 0:01:16.725 **** 2026-02-25 10:34:17.065748 | controller | skipping: [instance] 2026-02-25 10:34:17.081762 | controller | 2026-02-25 10:34:17.081777 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-25 10:34:17.081785 | controller | Wednesday 25 February 2026 10:34:17 +0000 (0:00:00.015) 0:01:16.741 **** 2026-02-25 10:34:17.081793 | controller | skipping: [instance] 2026-02-25 10:34:17.096802 | controller | 2026-02-25 10:34:17.096818 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-25 10:34:17.096830 | controller | Wednesday 25 February 2026 10:34:17 +0000 (0:00:00.016) 0:01:16.757 **** 2026-02-25 10:34:17.096838 | controller | skipping: [instance] 2026-02-25 10:34:17.116960 | controller | 2026-02-25 10:34:17.116978 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-25 10:34:17.116986 | controller | Wednesday 25 February 2026 10:34:17 +0000 (0:00:00.015) 0:01:16.772 **** 2026-02-25 10:34:17.116995 | controller | skipping: [instance] 2026-02-25 10:34:18.010961 | controller | 2026-02-25 10:34:18.010991 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-25 10:34:18.010999 | controller | Wednesday 25 February 2026 10:34:17 +0000 (0:00:00.020) 0:01:16.792 **** 2026-02-25 10:34:18.011009 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2026-02-25 10:34:18.319336 | controller | changed: [instance] => (item=/opt/basedir/logs) 2026-02-25 10:34:18.319388 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2026-02-25 10:34:18.319401 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2026-02-25 10:34:18.319412 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2026-02-25 10:34:18.319421 | controller | 2026-02-25 10:34:18.319431 | controller | TASK [Create secret file] ****************************************************** 2026-02-25 10:34:18.319441 | controller | Wednesday 25 February 2026 10:34:18 +0000 (0:00:00.893) 0:01:17.685 **** 2026-02-25 10:34:18.319485 | controller | changed: [instance] 2026-02-25 10:34:18.319531 | controller | 2026-02-25 10:34:18.319543 | controller | PLAY RECAP ********************************************************************* 2026-02-25 10:34:18.319553 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2026-02-25 10:34:18.319563 | controller | 2026-02-25 10:34:18.319576 | controller | Wednesday 25 February 2026 10:34:18 +0000 (0:00:00.308) 0:01:17.994 **** 2026-02-25 10:34:18.319609 | controller | =============================================================================== 2026-02-25 10:34:18.319620 | controller | test_deps : Install selinux python libs -------------------------------- 44.21s 2026-02-25 10:34:18.319631 | controller | ci_setup : Install needed packages -------------------------------------- 7.97s 2026-02-25 10:34:18.320243 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.26s 2026-02-25 10:34:18.321008 | controller | ci_setup : Install openshift client ------------------------------------- 5.88s 2026-02-25 10:34:18.321037 | controller | test_deps : Install python yaml libs ------------------------------------ 1.15s 2026-02-25 10:34:18.321044 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.07s 2026-02-25 10:34:18.321049 | controller | ci_setup : Manage directories ------------------------------------------- 0.89s 2026-02-25 10:34:18.321054 | controller | Gathering Facts --------------------------------------------------------- 0.89s 2026-02-25 10:34:18.321059 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.84s 2026-02-25 10:34:18.321064 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.80s 2026-02-25 10:34:18.321073 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.69s 2026-02-25 10:34:18.375096 | controller | repo_setup : Install repo-setup package --------------------------------- 0.66s 2026-02-25 10:34:18.375119 | controller | repo_setup : Ensure directories are present ----------------------------- 0.59s 2026-02-25 10:34:18.375126 | controller | ci_setup : Gather version of openshift client --------------------------- 0.58s 2026-02-25 10:34:18.375132 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.51s 2026-02-25 10:34:18.375136 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.41s 2026-02-25 10:34:18.375141 | controller | Create secret file ------------------------------------------------------ 0.31s 2026-02-25 10:34:18.375169 | controller | Create custom basedir --------------------------------------------------- 0.31s 2026-02-25 10:34:18.375175 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.28s 2026-02-25 10:34:18.375185 | controller | ci_setup : Create completion file --------------------------------------- 0.27s 2026-02-25 10:34:18.375194 | controller | INFO Running crc_layout > converge 2026-02-25 10:34:18.924003 | controller | 2026-02-25 10:34:18.924225 | controller | PLAY [Converge] **************************************************************** 2026-02-25 10:34:18.924372 | controller | 2026-02-25 10:34:18.924514 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-25 10:34:18.924647 | controller | Wednesday 25 February 2026 10:34:18 +0000 (0:00:00.024) 0:00:00.024 **** 2026-02-25 10:34:19.695305 | controller | ok: [instance] 2026-02-25 10:34:19.695594 | controller | 2026-02-25 10:34:19.695628 | controller | TASK [Load networking definition from scenario file] *************************** 2026-02-25 10:34:19.717277 | controller | Wednesday 25 February 2026 10:34:19 +0000 (0:00:00.771) 0:00:00.795 **** 2026-02-25 10:34:19.717309 | controller | ok: [instance] 2026-02-25 10:34:19.717762 | controller | 2026-02-25 10:34:21.657312 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-25 10:34:21.657370 | controller | Wednesday 25 February 2026 10:34:19 +0000 (0:00:00.022) 0:00:00.818 **** 2026-02-25 10:34:21.657393 | controller | changed: [instance] 2026-02-25 10:34:21.657441 | controller | 2026-02-25 10:34:21.657463 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-25 10:34:21.683312 | controller | Wednesday 25 February 2026 10:34:21 +0000 (0:00:01.939) 0:00:02.757 **** 2026-02-25 10:34:21.683367 | controller | ok: [instance] 2026-02-25 10:34:21.683410 | controller | 2026-02-25 10:34:21.683424 | controller | TASK [reproducer : Load CI job environment] ************************************ 2026-02-25 10:34:21.683557 | controller | Wednesday 25 February 2026 10:34:21 +0000 (0:00:00.026) 0:00:02.783 **** 2026-02-25 10:34:21.704278 | controller | skipping: [instance] 2026-02-25 10:34:21.704345 | controller | 2026-02-25 10:34:21.704357 | controller | TASK [Build final libvirt layout] ********************************************** 2026-02-25 10:34:21.704525 | controller | Wednesday 25 February 2026 10:34:21 +0000 (0:00:00.020) 0:00:02.804 **** 2026-02-25 10:34:21.751286 | controller | 2026-02-25 10:34:21.827083 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2026-02-25 10:34:21.827108 | controller | Wednesday 25 February 2026 10:34:21 +0000 (0:00:00.047) 0:00:02.851 **** 2026-02-25 10:34:21.827120 | controller | ok: [instance] 2026-02-25 10:34:21.827357 | controller | 2026-02-25 10:34:21.827599 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2026-02-25 10:34:21.827779 | controller | Wednesday 25 February 2026 10:34:21 +0000 (0:00:00.076) 0:00:02.928 **** 2026-02-25 10:34:21.888983 | controller | skipping: [instance] 2026-02-25 10:34:21.889652 | controller | 2026-02-25 10:34:21.889872 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2026-02-25 10:34:21.890020 | controller | Wednesday 25 February 2026 10:34:21 +0000 (0:00:00.061) 0:00:02.989 **** 2026-02-25 10:34:21.915858 | controller | ok: [instance] 2026-02-25 10:34:21.916029 | controller | 2026-02-25 10:34:21.916112 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2026-02-25 10:34:21.916233 | controller | Wednesday 25 February 2026 10:34:21 +0000 (0:00:00.026) 0:00:03.016 **** 2026-02-25 10:34:21.940185 | controller | ok: [instance] => changed=false 2026-02-25 10:34:21.940461 | controller | msg: All assertions passed 2026-02-25 10:34:21.940680 | controller | 2026-02-25 10:34:21.940881 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2026-02-25 10:34:21.940999 | controller | Wednesday 25 February 2026 10:34:21 +0000 (0:00:00.024) 0:00:03.041 **** 2026-02-25 10:34:21.979821 | controller | ok: [instance] 2026-02-25 10:34:21.980043 | controller | 2026-02-25 10:34:21.980143 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2026-02-25 10:34:21.980266 | controller | Wednesday 25 February 2026 10:34:21 +0000 (0:00:00.039) 0:00:03.080 **** 2026-02-25 10:34:22.408139 | controller | ok: [instance] => (item=artifacts) 2026-02-25 10:34:22.480606 | controller | ok: [instance] => (item=logs) 2026-02-25 10:34:22.480630 | controller | 2026-02-25 10:34:22.480640 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2026-02-25 10:34:22.480656 | controller | Wednesday 25 February 2026 10:34:22 +0000 (0:00:00.427) 0:00:03.508 **** 2026-02-25 10:34:22.480668 | controller | 2026-02-25 10:34:22.659636 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2026-02-25 10:34:22.659655 | controller | Wednesday 25 February 2026 10:34:22 +0000 (0:00:00.072) 0:00:03.581 **** 2026-02-25 10:34:22.659665 | controller | ok: [instance] 2026-02-25 10:34:22.923930 | controller | 2026-02-25 10:34:22.923953 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2026-02-25 10:34:22.923960 | controller | Wednesday 25 February 2026 10:34:22 +0000 (0:00:00.178) 0:00:03.760 **** 2026-02-25 10:34:22.923970 | controller | changed: [instance] 2026-02-25 10:34:23.189301 | controller | 2026-02-25 10:34:23.189338 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2026-02-25 10:34:23.189347 | controller | Wednesday 25 February 2026 10:34:22 +0000 (0:00:00.264) 0:00:04.024 **** 2026-02-25 10:34:23.189361 | controller | ok: [instance] 2026-02-25 10:34:23.217136 | controller | 2026-02-25 10:34:23.217193 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2026-02-25 10:34:23.217204 | controller | Wednesday 25 February 2026 10:34:23 +0000 (0:00:00.265) 0:00:04.289 **** 2026-02-25 10:34:23.217218 | controller | skipping: [instance] 2026-02-25 10:34:23.233817 | controller | 2026-02-25 10:34:23.233835 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2026-02-25 10:34:23.233842 | controller | Wednesday 25 February 2026 10:34:23 +0000 (0:00:00.027) 0:00:04.317 **** 2026-02-25 10:34:23.233851 | controller | skipping: [instance] 2026-02-25 10:34:23.255035 | controller | 2026-02-25 10:34:23.255057 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2026-02-25 10:34:23.255066 | controller | Wednesday 25 February 2026 10:34:23 +0000 (0:00:00.016) 0:00:04.334 **** 2026-02-25 10:34:23.255078 | controller | ok: [instance] 2026-02-25 10:34:23.283670 | controller | 2026-02-25 10:34:23.283686 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2026-02-25 10:34:23.283699 | controller | Wednesday 25 February 2026 10:34:23 +0000 (0:00:00.020) 0:00:04.355 **** 2026-02-25 10:34:23.283707 | controller | skipping: [instance] 2026-02-25 10:34:32.221291 | controller | 2026-02-25 10:34:32.221323 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2026-02-25 10:34:32.221331 | controller | Wednesday 25 February 2026 10:34:23 +0000 (0:00:00.028) 0:00:04.384 **** 2026-02-25 10:34:32.221342 | controller | changed: [instance] 2026-02-25 10:34:32.221367 | controller | 2026-02-25 10:34:32.221376 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2026-02-25 10:34:32.221397 | controller | Wednesday 25 February 2026 10:34:32 +0000 (0:00:08.937) 0:00:13.321 **** 2026-02-25 10:34:32.440419 | controller | changed: [instance] 2026-02-25 10:34:32.440483 | controller | 2026-02-25 10:34:32.440724 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2026-02-25 10:34:32.946217 | controller | Wednesday 25 February 2026 10:34:32 +0000 (0:00:00.219) 0:00:13.541 **** 2026-02-25 10:34:32.946253 | controller | changed: [instance] 2026-02-25 10:34:33.524274 | controller | 2026-02-25 10:34:33.524316 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2026-02-25 10:34:33.524326 | controller | Wednesday 25 February 2026 10:34:32 +0000 (0:00:00.505) 0:00:14.046 **** 2026-02-25 10:34:33.524340 | controller | changed: [instance] 2026-02-25 10:34:33.712329 | controller | 2026-02-25 10:34:33.712477 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2026-02-25 10:34:33.712486 | controller | Wednesday 25 February 2026 10:34:33 +0000 (0:00:00.577) 0:00:14.624 **** 2026-02-25 10:34:33.712498 | controller | ok: [instance] 2026-02-25 10:34:34.337780 | controller | 2026-02-25 10:34:34.337812 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2026-02-25 10:34:34.337820 | controller | Wednesday 25 February 2026 10:34:33 +0000 (0:00:00.188) 0:00:14.812 **** 2026-02-25 10:34:34.337829 | controller | ok: [instance] 2026-02-25 10:34:35.101347 | controller | 2026-02-25 10:34:35.101377 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2026-02-25 10:34:35.101394 | controller | Wednesday 25 February 2026 10:34:34 +0000 (0:00:00.625) 0:00:15.438 **** 2026-02-25 10:34:35.101404 | controller | changed: [instance] 2026-02-25 10:34:35.204322 | controller | 2026-02-25 10:34:35.204362 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2026-02-25 10:34:35.204371 | controller | Wednesday 25 February 2026 10:34:35 +0000 (0:00:00.763) 0:00:16.201 **** 2026-02-25 10:34:35.204384 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2026-02-25 10:34:35.204414 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2026-02-25 10:34:35.204422 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2026-02-25 10:34:35.204429 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2026-02-25 10:34:35.204435 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2026-02-25 10:34:35.204458 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2026-02-25 10:34:35.204468 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2026-02-25 10:34:35.204494 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2026-02-25 10:34:35.204760 | controller | 2026-02-25 10:34:35.523117 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2026-02-25 10:34:35.523165 | controller | Wednesday 25 February 2026 10:34:35 +0000 (0:00:00.102) 0:00:16.304 **** 2026-02-25 10:34:35.523181 | controller | ok: [instance] 2026-02-25 10:34:35.833965 | controller | 2026-02-25 10:34:35.833987 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2026-02-25 10:34:35.833995 | controller | Wednesday 25 February 2026 10:34:35 +0000 (0:00:00.319) 0:00:16.623 **** 2026-02-25 10:34:35.834004 | controller | ok: [instance] 2026-02-25 10:34:36.132262 | controller | 2026-02-25 10:34:36.132296 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2026-02-25 10:34:36.132305 | controller | Wednesday 25 February 2026 10:34:35 +0000 (0:00:00.310) 0:00:16.934 **** 2026-02-25 10:34:36.132318 | controller | ok: [instance] 2026-02-25 10:34:36.441085 | controller | 2026-02-25 10:34:36.441108 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2026-02-25 10:34:36.441116 | controller | Wednesday 25 February 2026 10:34:36 +0000 (0:00:00.298) 0:00:17.232 **** 2026-02-25 10:34:36.441126 | controller | ok: [instance] 2026-02-25 10:34:36.737955 | controller | 2026-02-25 10:34:36.737972 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2026-02-25 10:34:36.737979 | controller | Wednesday 25 February 2026 10:34:36 +0000 (0:00:00.308) 0:00:17.541 **** 2026-02-25 10:34:36.737987 | controller | ok: [instance] 2026-02-25 10:34:37.034521 | controller | 2026-02-25 10:34:37.034545 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2026-02-25 10:34:37.034552 | controller | Wednesday 25 February 2026 10:34:36 +0000 (0:00:00.297) 0:00:17.838 **** 2026-02-25 10:34:37.034561 | controller | ok: [instance] 2026-02-25 10:34:37.331260 | controller | 2026-02-25 10:34:37.331289 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2026-02-25 10:34:37.331296 | controller | Wednesday 25 February 2026 10:34:37 +0000 (0:00:00.296) 0:00:18.135 **** 2026-02-25 10:34:37.331311 | controller | ok: [instance] 2026-02-25 10:34:37.629180 | controller | 2026-02-25 10:34:37.629215 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2026-02-25 10:34:37.629226 | controller | Wednesday 25 February 2026 10:34:37 +0000 (0:00:00.296) 0:00:18.431 **** 2026-02-25 10:34:37.629246 | controller | ok: [instance] 2026-02-25 10:34:37.925492 | controller | 2026-02-25 10:34:37.925509 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2026-02-25 10:34:37.925516 | controller | Wednesday 25 February 2026 10:34:37 +0000 (0:00:00.297) 0:00:18.729 **** 2026-02-25 10:34:37.925525 | controller | ok: [instance] 2026-02-25 10:34:38.227542 | controller | 2026-02-25 10:34:38.227568 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2026-02-25 10:34:38.227578 | controller | Wednesday 25 February 2026 10:34:37 +0000 (0:00:00.296) 0:00:19.026 **** 2026-02-25 10:34:38.227590 | controller | ok: [instance] 2026-02-25 10:34:38.524699 | controller | 2026-02-25 10:34:38.524724 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2026-02-25 10:34:38.524734 | controller | Wednesday 25 February 2026 10:34:38 +0000 (0:00:00.301) 0:00:19.328 **** 2026-02-25 10:34:38.524746 | controller | ok: [instance] 2026-02-25 10:34:38.827018 | controller | 2026-02-25 10:34:38.827036 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2026-02-25 10:34:38.827043 | controller | Wednesday 25 February 2026 10:34:38 +0000 (0:00:00.297) 0:00:19.625 **** 2026-02-25 10:34:38.827051 | controller | ok: [instance] 2026-02-25 10:34:39.129261 | controller | 2026-02-25 10:34:39.129303 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2026-02-25 10:34:39.129317 | controller | Wednesday 25 February 2026 10:34:38 +0000 (0:00:00.302) 0:00:19.927 **** 2026-02-25 10:34:39.129334 | controller | ok: [instance] 2026-02-25 10:34:39.424330 | controller | 2026-02-25 10:34:39.424379 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2026-02-25 10:34:39.424393 | controller | Wednesday 25 February 2026 10:34:39 +0000 (0:00:00.302) 0:00:20.229 **** 2026-02-25 10:34:39.424411 | controller | ok: [instance] 2026-02-25 10:34:39.424693 | controller | 2026-02-25 10:34:39.424729 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2026-02-25 10:34:39.719290 | controller | Wednesday 25 February 2026 10:34:39 +0000 (0:00:00.295) 0:00:20.525 **** 2026-02-25 10:34:39.719329 | controller | ok: [instance] 2026-02-25 10:34:40.013981 | controller | 2026-02-25 10:34:40.014018 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2026-02-25 10:34:40.014031 | controller | Wednesday 25 February 2026 10:34:39 +0000 (0:00:00.294) 0:00:20.819 **** 2026-02-25 10:34:40.014047 | controller | ok: [instance] 2026-02-25 10:34:40.308254 | controller | 2026-02-25 10:34:40.308305 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2026-02-25 10:34:40.308321 | controller | Wednesday 25 February 2026 10:34:40 +0000 (0:00:00.294) 0:00:21.114 **** 2026-02-25 10:34:40.308338 | controller | ok: [instance] 2026-02-25 10:34:40.601061 | controller | 2026-02-25 10:34:40.601128 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2026-02-25 10:34:40.601142 | controller | Wednesday 25 February 2026 10:34:40 +0000 (0:00:00.294) 0:00:21.408 **** 2026-02-25 10:34:40.601205 | controller | ok: [instance] 2026-02-25 10:34:40.896853 | controller | 2026-02-25 10:34:40.896879 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2026-02-25 10:34:40.896886 | controller | Wednesday 25 February 2026 10:34:40 +0000 (0:00:00.292) 0:00:21.701 **** 2026-02-25 10:34:40.896894 | controller | ok: [instance] 2026-02-25 10:34:41.194069 | controller | 2026-02-25 10:34:41.194122 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2026-02-25 10:34:41.194136 | controller | Wednesday 25 February 2026 10:34:40 +0000 (0:00:00.295) 0:00:21.997 **** 2026-02-25 10:34:41.194175 | controller | ok: [instance] 2026-02-25 10:34:41.490993 | controller | 2026-02-25 10:34:41.491010 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2026-02-25 10:34:41.491018 | controller | Wednesday 25 February 2026 10:34:41 +0000 (0:00:00.297) 0:00:22.294 **** 2026-02-25 10:34:41.491026 | controller | ok: [instance] 2026-02-25 10:34:41.794274 | controller | 2026-02-25 10:34:41.794311 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2026-02-25 10:34:41.794321 | controller | Wednesday 25 February 2026 10:34:41 +0000 (0:00:00.297) 0:00:22.591 **** 2026-02-25 10:34:41.794341 | controller | ok: [instance] 2026-02-25 10:34:42.092301 | controller | 2026-02-25 10:34:42.092337 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2026-02-25 10:34:42.092355 | controller | Wednesday 25 February 2026 10:34:41 +0000 (0:00:00.303) 0:00:22.895 **** 2026-02-25 10:34:42.092368 | controller | ok: [instance] 2026-02-25 10:34:42.403265 | controller | 2026-02-25 10:34:42.403300 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2026-02-25 10:34:42.403309 | controller | Wednesday 25 February 2026 10:34:42 +0000 (0:00:00.297) 0:00:23.192 **** 2026-02-25 10:34:42.403322 | controller | ok: [instance] 2026-02-25 10:34:42.403346 | controller | 2026-02-25 10:34:42.403354 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2026-02-25 10:34:42.403363 | controller | Wednesday 25 February 2026 10:34:42 +0000 (0:00:00.311) 0:00:23.503 **** 2026-02-25 10:34:42.423015 | controller | skipping: [instance] 2026-02-25 10:34:42.686549 | controller | 2026-02-25 10:34:42.686574 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2026-02-25 10:34:42.686581 | controller | Wednesday 25 February 2026 10:34:42 +0000 (0:00:00.019) 0:00:23.523 **** 2026-02-25 10:34:42.686590 | controller | ok: [instance] 2026-02-25 10:34:43.031295 | controller | 2026-02-25 10:34:43.031334 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2026-02-25 10:34:43.031343 | controller | Wednesday 25 February 2026 10:34:42 +0000 (0:00:00.263) 0:00:23.787 **** 2026-02-25 10:34:43.031355 | controller | ok: [instance] 2026-02-25 10:34:43.031376 | controller | 2026-02-25 10:34:43.031477 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2026-02-25 10:34:43.031498 | controller | Wednesday 25 February 2026 10:34:43 +0000 (0:00:00.344) 0:00:24.132 **** 2026-02-25 10:34:43.321192 | controller | changed: [instance] 2026-02-25 10:34:43.586731 | controller | 2026-02-25 10:34:43.586748 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2026-02-25 10:34:43.586755 | controller | Wednesday 25 February 2026 10:34:43 +0000 (0:00:00.289) 0:00:24.421 **** 2026-02-25 10:34:43.586763 | controller | [WARNING]: Reset is not implemented for this connection 2026-02-25 10:34:43.596274 | controller | changed: [instance] 2026-02-25 10:34:43.596310 | controller | 2026-02-25 10:34:43.596318 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2026-02-25 10:34:43.596325 | controller | Wednesday 25 February 2026 10:34:43 +0000 (0:00:00.260) 0:00:24.682 **** 2026-02-25 10:34:43.596332 | controller | 2026-02-25 10:34:43.596338 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2026-02-25 10:34:43.596346 | controller | Wednesday 25 February 2026 10:34:43 +0000 (0:00:00.014) 0:00:24.696 **** 2026-02-25 10:34:43.665253 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2026-02-25 10:34:43.665294 | controller | 2026-02-25 10:34:43.665304 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2026-02-25 10:34:43.665313 | controller | Wednesday 25 February 2026 10:34:43 +0000 (0:00:00.068) 0:00:24.765 **** 2026-02-25 10:34:43.704287 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2026-02-25 10:34:43.704379 | controller | 2026-02-25 10:34:43.704396 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-02-25 10:34:43.704406 | controller | Wednesday 25 February 2026 10:34:43 +0000 (0:00:00.039) 0:00:24.804 **** 2026-02-25 10:34:43.748252 | controller | ok: [instance] => (item=compute) 2026-02-25 10:34:43.748415 | controller | ok: [instance] => (item=controller) 2026-02-25 10:34:43.748432 | controller | ok: [instance] => (item=crc) 2026-02-25 10:34:43.748446 | controller | 2026-02-25 10:34:43.748455 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-02-25 10:34:43.785313 | controller | Wednesday 25 February 2026 10:34:43 +0000 (0:00:00.043) 0:00:24.848 **** 2026-02-25 10:34:43.785355 | controller | ok: [instance] 2026-02-25 10:34:43.785421 | controller | 2026-02-25 10:34:43.785433 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-02-25 10:34:43.785568 | controller | Wednesday 25 February 2026 10:34:43 +0000 (0:00:00.037) 0:00:24.885 **** 2026-02-25 10:34:43.823782 | controller | ok: [instance] => changed=false 2026-02-25 10:34:43.824019 | controller | msg: All assertions passed 2026-02-25 10:34:43.824177 | controller | 2026-02-25 10:34:43.824445 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2026-02-25 10:34:43.824521 | controller | Wednesday 25 February 2026 10:34:43 +0000 (0:00:00.038) 0:00:24.924 **** 2026-02-25 10:34:43.881269 | controller | 2026-02-25 10:34:43.881431 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2026-02-25 10:34:43.881565 | controller | Wednesday 25 February 2026 10:34:43 +0000 (0:00:00.057) 0:00:24.982 **** 2026-02-25 10:34:43.955614 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.49', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2026-02-25 10:34:43.955755 | controller | ok: [instance] => (item={}) 2026-02-25 10:34:43.955849 | controller | 2026-02-25 10:34:43.955951 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2026-02-25 10:34:43.956052 | controller | Wednesday 25 February 2026 10:34:43 +0000 (0:00:00.074) 0:00:25.056 **** 2026-02-25 10:34:43.973261 | controller | skipping: [instance] 2026-02-25 10:34:43.973495 | controller | 2026-02-25 10:34:43.973528 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2026-02-25 10:34:43.973548 | controller | Wednesday 25 February 2026 10:34:43 +0000 (0:00:00.017) 0:00:25.073 **** 2026-02-25 10:34:44.176037 | controller | ok: [instance] 2026-02-25 10:34:44.494006 | controller | 2026-02-25 10:34:44.494024 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2026-02-25 10:34:44.494031 | controller | Wednesday 25 February 2026 10:34:44 +0000 (0:00:00.203) 0:00:25.276 **** 2026-02-25 10:34:44.494040 | controller | changed: [instance] 2026-02-25 10:34:45.180025 | controller | 2026-02-25 10:34:45.180046 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2026-02-25 10:34:45.180054 | controller | Wednesday 25 February 2026 10:34:44 +0000 (0:00:00.318) 0:00:25.594 **** 2026-02-25 10:34:45.180064 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2026-02-25 10:34:45.206102 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2026-02-25 10:34:45.206118 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2026-02-25 10:34:45.206125 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2026-02-25 10:34:45.206130 | controller | 2026-02-25 10:34:45.206135 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2026-02-25 10:34:45.206141 | controller | Wednesday 25 February 2026 10:34:45 +0000 (0:00:00.685) 0:00:26.280 **** 2026-02-25 10:34:45.206171 | controller | skipping: [instance] 2026-02-25 10:34:45.552262 | controller | 2026-02-25 10:34:45.552284 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2026-02-25 10:34:45.552291 | controller | Wednesday 25 February 2026 10:34:45 +0000 (0:00:00.026) 0:00:26.307 **** 2026-02-25 10:34:45.552300 | controller | changed: [instance] 2026-02-25 10:34:45.951970 | controller | 2026-02-25 10:34:45.952001 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2026-02-25 10:34:45.952009 | controller | Wednesday 25 February 2026 10:34:45 +0000 (0:00:00.337) 0:00:26.644 **** 2026-02-25 10:34:45.952015 | controller | 2026-02-25 10:34:45.952020 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-25 10:34:45.952026 | controller | Wednesday 25 February 2026 10:34:45 +0000 (0:00:00.007) 0:00:26.652 **** 2026-02-25 10:34:45.952041 | controller | changed: [instance] 2026-02-25 10:34:45.952239 | controller | 2026-02-25 10:34:45.952330 | controller | TASK [Ensure no default networks exists] *************************************** 2026-02-25 10:34:45.952363 | controller | Wednesday 25 February 2026 10:34:45 +0000 (0:00:00.399) 0:00:27.052 **** 2026-02-25 10:34:46.028651 | controller | 2026-02-25 10:34:47.158559 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2026-02-25 10:34:47.158589 | controller | Wednesday 25 February 2026 10:34:46 +0000 (0:00:00.076) 0:00:27.129 **** 2026-02-25 10:34:47.158600 | controller | ok: [instance] 2026-02-25 10:34:47.385821 | controller | 2026-02-25 10:34:47.385847 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2026-02-25 10:34:47.385855 | controller | Wednesday 25 February 2026 10:34:47 +0000 (0:00:01.129) 0:00:28.259 **** 2026-02-25 10:34:47.385864 | controller | ok: [instance] 2026-02-25 10:34:47.885291 | controller | 2026-02-25 10:34:47.885329 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2026-02-25 10:34:47.885338 | controller | Wednesday 25 February 2026 10:34:47 +0000 (0:00:00.227) 0:00:28.486 **** 2026-02-25 10:34:47.885350 | controller | ok: [instance] 2026-02-25 10:34:47.885377 | controller | 2026-02-25 10:34:47.885386 | controller | TASK [libvirt_manager : Removing default] ************************************** 2026-02-25 10:34:47.885497 | controller | Wednesday 25 February 2026 10:34:47 +0000 (0:00:00.499) 0:00:28.986 **** 2026-02-25 10:34:48.096978 | controller | ok: [instance] 2026-02-25 10:34:49.266208 | controller | 2026-02-25 10:34:49.266235 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2026-02-25 10:34:49.266243 | controller | Wednesday 25 February 2026 10:34:48 +0000 (0:00:00.211) 0:00:29.197 **** 2026-02-25 10:34:49.266253 | controller | ok: [instance] 2026-02-25 10:34:49.562614 | controller | 2026-02-25 10:34:49.562637 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2026-02-25 10:34:49.562644 | controller | Wednesday 25 February 2026 10:34:49 +0000 (0:00:01.169) 0:00:30.366 **** 2026-02-25 10:34:49.562658 | controller | ok: [instance] 2026-02-25 10:34:49.852809 | controller | 2026-02-25 10:34:49.852837 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2026-02-25 10:34:49.852844 | controller | Wednesday 25 February 2026 10:34:49 +0000 (0:00:00.296) 0:00:30.663 **** 2026-02-25 10:34:49.852853 | controller | changed: [instance] 2026-02-25 10:34:50.137660 | controller | 2026-02-25 10:34:50.137685 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2026-02-25 10:34:50.137693 | controller | Wednesday 25 February 2026 10:34:49 +0000 (0:00:00.289) 0:00:30.953 **** 2026-02-25 10:34:50.137702 | controller | changed: [instance] 2026-02-25 10:34:51.672953 | controller | 2026-02-25 10:34:51.672981 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2026-02-25 10:34:51.672989 | controller | Wednesday 25 February 2026 10:34:50 +0000 (0:00:00.285) 0:00:31.238 **** 2026-02-25 10:34:51.672999 | controller | changed: [instance] => (item=arptables) 2026-02-25 10:34:51.972734 | controller | changed: [instance] => (item=iptables) 2026-02-25 10:34:51.972765 | controller | changed: [instance] => (item=ip6tables) 2026-02-25 10:34:51.972773 | controller | 2026-02-25 10:34:51.972779 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2026-02-25 10:34:51.972785 | controller | Wednesday 25 February 2026 10:34:51 +0000 (0:00:01.534) 0:00:32.773 **** 2026-02-25 10:34:51.972794 | controller | ok: [instance] 2026-02-25 10:34:52.085986 | controller | 2026-02-25 10:34:52.086019 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2026-02-25 10:34:52.086027 | controller | Wednesday 25 February 2026 10:34:51 +0000 (0:00:00.299) 0:00:33.073 **** 2026-02-25 10:34:52.086037 | controller | ok: [instance] 2026-02-25 10:34:52.126161 | controller | 2026-02-25 10:34:52.126180 | controller | TASK [Ensure the required network configurations are applied] ****************** 2026-02-25 10:34:52.126187 | controller | Wednesday 25 February 2026 10:34:52 +0000 (0:00:00.113) 0:00:33.186 **** 2026-02-25 10:34:52.126196 | controller | 2026-02-25 10:34:52.147066 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2026-02-25 10:34:52.147094 | controller | Wednesday 25 February 2026 10:34:52 +0000 (0:00:00.040) 0:00:33.226 **** 2026-02-25 10:34:52.147106 | controller | skipping: [instance] 2026-02-25 10:34:52.166249 | controller | 2026-02-25 10:34:52.166271 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2026-02-25 10:34:52.166285 | controller | Wednesday 25 February 2026 10:34:52 +0000 (0:00:00.020) 0:00:33.247 **** 2026-02-25 10:34:52.166294 | controller | skipping: [instance] 2026-02-25 10:34:52.166321 | controller | 2026-02-25 10:34:52.166328 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-25 10:34:52.166373 | controller | Wednesday 25 February 2026 10:34:52 +0000 (0:00:00.019) 0:00:33.267 **** 2026-02-25 10:34:52.185032 | controller | skipping: [instance] 2026-02-25 10:34:52.207749 | controller | 2026-02-25 10:34:52.207773 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2026-02-25 10:34:52.207782 | controller | Wednesday 25 February 2026 10:34:52 +0000 (0:00:00.018) 0:00:33.285 **** 2026-02-25 10:34:52.207791 | controller | skipping: [instance] 2026-02-25 10:34:52.242241 | controller | 2026-02-25 10:34:52.242261 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2026-02-25 10:34:52.242270 | controller | Wednesday 25 February 2026 10:34:52 +0000 (0:00:00.022) 0:00:33.308 **** 2026-02-25 10:34:52.242280 | controller | ok: [instance] 2026-02-25 10:34:52.242431 | controller | 2026-02-25 10:34:52.242600 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2026-02-25 10:34:52.242746 | controller | Wednesday 25 February 2026 10:34:52 +0000 (0:00:00.034) 0:00:33.343 **** 2026-02-25 10:34:52.273255 | controller | skipping: [instance] 2026-02-25 10:34:52.273349 | controller | 2026-02-25 10:34:52.273517 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2026-02-25 10:34:52.273578 | controller | Wednesday 25 February 2026 10:34:52 +0000 (0:00:00.030) 0:00:33.374 **** 2026-02-25 10:34:52.314310 | controller | skipping: [instance] 2026-02-25 10:34:52.314467 | controller | 2026-02-25 10:34:52.314554 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2026-02-25 10:34:52.314652 | controller | Wednesday 25 February 2026 10:34:52 +0000 (0:00:00.041) 0:00:33.415 **** 2026-02-25 10:34:52.366758 | controller | ok: [instance] 2026-02-25 10:34:52.366970 | controller | 2026-02-25 10:34:52.367186 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2026-02-25 10:34:52.367357 | controller | Wednesday 25 February 2026 10:34:52 +0000 (0:00:00.052) 0:00:33.467 **** 2026-02-25 10:34:52.386606 | controller | skipping: [instance] 2026-02-25 10:34:52.386754 | controller | 2026-02-25 10:34:52.386856 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2026-02-25 10:34:52.387035 | controller | Wednesday 25 February 2026 10:34:52 +0000 (0:00:00.019) 0:00:33.487 **** 2026-02-25 10:34:52.431043 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2026-02-25 10:34:52.431135 | controller | 2026-02-25 10:34:52.431350 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-25 10:34:52.431452 | controller | Wednesday 25 February 2026 10:34:52 +0000 (0:00:00.044) 0:00:33.531 **** 2026-02-25 10:34:52.729681 | controller | ok: [instance -> localhost] 2026-02-25 10:35:03.311254 | controller | 2026-02-25 10:35:03.311287 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2026-02-25 10:35:03.311295 | controller | Wednesday 25 February 2026 10:34:52 +0000 (0:00:00.298) 0:00:33.830 **** 2026-02-25 10:35:03.311305 | controller | changed: [instance -> localhost] 2026-02-25 10:35:03.311415 | controller | 2026-02-25 10:35:03.311426 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-25 10:35:03.311444 | controller | Wednesday 25 February 2026 10:35:03 +0000 (0:00:10.581) 0:00:44.411 **** 2026-02-25 10:35:03.491245 | controller | changed: [instance] 2026-02-25 10:35:03.805693 | controller | 2026-02-25 10:35:03.805723 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2026-02-25 10:35:03.805731 | controller | Wednesday 25 February 2026 10:35:03 +0000 (0:00:00.180) 0:00:44.591 **** 2026-02-25 10:35:03.805745 | controller | changed: [instance] 2026-02-25 10:35:05.367293 | controller | 2026-02-25 10:35:05.367327 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2026-02-25 10:35:05.367336 | controller | Wednesday 25 February 2026 10:35:03 +0000 (0:00:00.314) 0:00:44.906 **** 2026-02-25 10:35:05.367347 | controller | changed: [instance -> localhost] 2026-02-25 10:35:05.367374 | controller | 2026-02-25 10:35:05.367383 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2026-02-25 10:35:05.367442 | controller | Wednesday 25 February 2026 10:35:05 +0000 (0:00:01.561) 0:00:46.467 **** 2026-02-25 10:35:05.699224 | controller | changed: [instance] 2026-02-25 10:35:05.699578 | controller | 2026-02-25 10:35:05.729855 | controller | TASK [reproducer : Select right domain] **************************************** 2026-02-25 10:35:05.729875 | controller | Wednesday 25 February 2026 10:35:05 +0000 (0:00:00.332) 0:00:46.800 **** 2026-02-25 10:35:05.729887 | controller | ok: [instance] 2026-02-25 10:35:05.846076 | controller | 2026-02-25 10:35:05.846099 | controller | TASK [Create the virtual networks] ********************************************* 2026-02-25 10:35:05.846106 | controller | Wednesday 25 February 2026 10:35:05 +0000 (0:00:00.030) 0:00:46.830 **** 2026-02-25 10:35:05.846115 | controller | 2026-02-25 10:35:05.864624 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2026-02-25 10:35:05.864643 | controller | Wednesday 25 February 2026 10:35:05 +0000 (0:00:00.116) 0:00:46.946 **** 2026-02-25 10:35:05.864655 | controller | ok: [instance] 2026-02-25 10:35:06.051838 | controller | 2026-02-25 10:35:06.051869 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2026-02-25 10:35:06.051877 | controller | Wednesday 25 February 2026 10:35:05 +0000 (0:00:00.018) 0:00:46.965 **** 2026-02-25 10:35:06.051887 | controller | ok: [instance] 2026-02-25 10:35:06.080757 | controller | 2026-02-25 10:35:06.080787 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2026-02-25 10:35:06.080795 | controller | Wednesday 25 February 2026 10:35:06 +0000 (0:00:00.186) 0:00:47.152 **** 2026-02-25 10:35:06.080805 | controller | skipping: [instance] 2026-02-25 10:35:06.109126 | controller | 2026-02-25 10:35:06.109165 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2026-02-25 10:35:06.109177 | controller | Wednesday 25 February 2026 10:35:06 +0000 (0:00:00.028) 0:00:47.181 **** 2026-02-25 10:35:06.109186 | controller | skipping: [instance] 2026-02-25 10:35:06.162632 | controller | 2026-02-25 10:35:06.162652 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2026-02-25 10:35:06.162660 | controller | Wednesday 25 February 2026 10:35:06 +0000 (0:00:00.028) 0:00:47.209 **** 2026-02-25 10:35:06.162668 | controller | ok: [instance] 2026-02-25 10:35:06.287034 | controller | 2026-02-25 10:35:06.287064 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2026-02-25 10:35:06.287073 | controller | Wednesday 25 February 2026 10:35:06 +0000 (0:00:00.053) 0:00:47.263 **** 2026-02-25 10:35:06.287083 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-25 10:35:06.287106 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-25 10:35:06.287612 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-25 10:35:06.320763 | controller | 2026-02-25 10:35:06.320785 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2026-02-25 10:35:06.320793 | controller | Wednesday 25 February 2026 10:35:06 +0000 (0:00:00.124) 0:00:47.387 **** 2026-02-25 10:35:06.320812 | controller | skipping: [instance] 2026-02-25 10:35:06.652286 | controller | 2026-02-25 10:35:06.652318 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2026-02-25 10:35:06.652328 | controller | Wednesday 25 February 2026 10:35:06 +0000 (0:00:00.033) 0:00:47.421 **** 2026-02-25 10:35:06.652340 | controller | changed: [instance] 2026-02-25 10:35:06.652392 | controller | 2026-02-25 10:35:06.652420 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2026-02-25 10:35:06.652444 | controller | Wednesday 25 February 2026 10:35:06 +0000 (0:00:00.331) 0:00:47.752 **** 2026-02-25 10:35:06.742304 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2026-02-25 10:35:06.742560 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2026-02-25 10:35:06.742587 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2026-02-25 10:35:06.742597 | controller | 2026-02-25 10:35:06.742609 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-25 10:35:06.811240 | controller | Wednesday 25 February 2026 10:35:06 +0000 (0:00:00.089) 0:00:47.842 **** 2026-02-25 10:35:06.811280 | controller | changed: [instance] 2026-02-25 10:35:07.075086 | controller | 2026-02-25 10:35:07.075111 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-25 10:35:07.075118 | controller | Wednesday 25 February 2026 10:35:06 +0000 (0:00:00.069) 0:00:47.911 **** 2026-02-25 10:35:07.075127 | controller | changed: [instance] 2026-02-25 10:35:07.276987 | controller | 2026-02-25 10:35:07.277016 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-25 10:35:07.277023 | controller | Wednesday 25 February 2026 10:35:07 +0000 (0:00:00.263) 0:00:48.175 **** 2026-02-25 10:35:07.277032 | controller | changed: [instance] 2026-02-25 10:35:07.327714 | controller | 2026-02-25 10:35:07.327738 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-25 10:35:07.327746 | controller | Wednesday 25 February 2026 10:35:07 +0000 (0:00:00.201) 0:00:48.377 **** 2026-02-25 10:35:07.327757 | controller | changed: [instance] 2026-02-25 10:35:07.527306 | controller | 2026-02-25 10:35:07.527337 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-25 10:35:07.527346 | controller | Wednesday 25 February 2026 10:35:07 +0000 (0:00:00.050) 0:00:48.428 **** 2026-02-25 10:35:07.527358 | controller | changed: [instance] 2026-02-25 10:35:07.527385 | controller | 2026-02-25 10:35:07.527395 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-25 10:35:07.527518 | controller | Wednesday 25 February 2026 10:35:07 +0000 (0:00:00.199) 0:00:48.628 **** 2026-02-25 10:35:07.728297 | controller | changed: [instance] 2026-02-25 10:35:07.777836 | controller | 2026-02-25 10:35:07.777863 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-25 10:35:07.777871 | controller | Wednesday 25 February 2026 10:35:07 +0000 (0:00:00.200) 0:00:48.828 **** 2026-02-25 10:35:07.777880 | controller | changed: [instance] 2026-02-25 10:35:07.965597 | controller | 2026-02-25 10:35:07.965623 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-25 10:35:07.965631 | controller | Wednesday 25 February 2026 10:35:07 +0000 (0:00:00.049) 0:00:48.878 **** 2026-02-25 10:35:07.965639 | controller | changed: [instance] 2026-02-25 10:35:08.168939 | controller | 2026-02-25 10:35:08.168964 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-25 10:35:08.168971 | controller | Wednesday 25 February 2026 10:35:07 +0000 (0:00:00.187) 0:00:49.066 **** 2026-02-25 10:35:08.168980 | controller | changed: [instance] 2026-02-25 10:35:08.346838 | controller | 2026-02-25 10:35:08.346861 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2026-02-25 10:35:08.346869 | controller | Wednesday 25 February 2026 10:35:08 +0000 (0:00:00.203) 0:00:49.269 **** 2026-02-25 10:35:08.346878 | controller | ok: [instance] 2026-02-25 10:35:08.824276 | controller | 2026-02-25 10:35:08.824320 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2026-02-25 10:35:08.824329 | controller | Wednesday 25 February 2026 10:35:08 +0000 (0:00:00.177) 0:00:49.447 **** 2026-02-25 10:35:08.824340 | controller | changed: [instance] 2026-02-25 10:35:08.992229 | controller | 2026-02-25 10:35:08.992255 | controller | TASK [libvirt_manager : Remove ini file after conversion] ********************** 2026-02-25 10:35:08.992262 | controller | Wednesday 25 February 2026 10:35:08 +0000 (0:00:00.477) 0:00:49.924 **** 2026-02-25 10:35:08.992275 | controller | changed: [instance] 2026-02-25 10:35:08.992296 | controller | 2026-02-25 10:35:08.992485 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-25 10:35:09.015648 | controller | Wednesday 25 February 2026 10:35:08 +0000 (0:00:00.168) 0:00:50.093 **** 2026-02-25 10:35:09.015674 | controller | skipping: [instance] 2026-02-25 10:35:09.038095 | controller | 2026-02-25 10:35:09.038113 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-25 10:35:09.038128 | controller | Wednesday 25 February 2026 10:35:09 +0000 (0:00:00.023) 0:00:50.116 **** 2026-02-25 10:35:09.038139 | controller | skipping: [instance] 2026-02-25 10:35:09.061281 | controller | 2026-02-25 10:35:09.061303 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-25 10:35:09.061312 | controller | Wednesday 25 February 2026 10:35:09 +0000 (0:00:00.022) 0:00:50.138 **** 2026-02-25 10:35:09.061322 | controller | skipping: [instance] 2026-02-25 10:35:09.061344 | controller | 2026-02-25 10:35:09.061351 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-25 10:35:09.061359 | controller | Wednesday 25 February 2026 10:35:09 +0000 (0:00:00.023) 0:00:50.162 **** 2026-02-25 10:35:09.084325 | controller | skipping: [instance] 2026-02-25 10:35:09.102217 | controller | 2026-02-25 10:35:09.102242 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-25 10:35:09.102250 | controller | Wednesday 25 February 2026 10:35:09 +0000 (0:00:00.023) 0:00:50.185 **** 2026-02-25 10:35:09.102260 | controller | ok: [instance] 2026-02-25 10:35:09.102466 | controller | 2026-02-25 10:35:09.102486 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-25 10:35:09.180259 | controller | Wednesday 25 February 2026 10:35:09 +0000 (0:00:00.018) 0:00:50.203 **** 2026-02-25 10:35:09.180287 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-25 10:35:09.180505 | controller | 2026-02-25 10:35:09.180526 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-25 10:35:09.196705 | controller | Wednesday 25 February 2026 10:35:09 +0000 (0:00:00.077) 0:00:50.281 **** 2026-02-25 10:35:09.196727 | controller | skipping: [instance] 2026-02-25 10:35:09.390131 | controller | 2026-02-25 10:35:09.390175 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-25 10:35:09.390183 | controller | Wednesday 25 February 2026 10:35:09 +0000 (0:00:00.016) 0:00:50.297 **** 2026-02-25 10:35:09.390191 | controller | changed: [instance] 2026-02-25 10:35:09.764312 | controller | 2026-02-25 10:35:09.764348 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-25 10:35:09.764358 | controller | Wednesday 25 February 2026 10:35:09 +0000 (0:00:00.193) 0:00:50.490 **** 2026-02-25 10:35:09.764371 | controller | changed: [instance] 2026-02-25 10:35:09.764404 | controller | 2026-02-25 10:35:09.764413 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-25 10:35:09.764422 | controller | Wednesday 25 February 2026 10:35:09 +0000 (0:00:00.373) 0:00:50.864 **** 2026-02-25 10:35:09.818889 | controller | ok: [instance] 2026-02-25 10:35:09.847555 | controller | 2026-02-25 10:35:09.847576 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-25 10:35:09.847585 | controller | Wednesday 25 February 2026 10:35:09 +0000 (0:00:00.055) 0:00:50.919 **** 2026-02-25 10:35:09.847595 | controller | ok: [instance] 2026-02-25 10:35:10.203614 | controller | 2026-02-25 10:35:10.203645 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-25 10:35:10.203652 | controller | Wednesday 25 February 2026 10:35:09 +0000 (0:00:00.028) 0:00:50.948 **** 2026-02-25 10:35:10.203662 | controller | changed: [instance] 2026-02-25 10:35:10.283023 | controller | 2026-02-25 10:35:10.283046 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2026-02-25 10:35:10.283054 | controller | Wednesday 25 February 2026 10:35:10 +0000 (0:00:00.355) 0:00:51.304 **** 2026-02-25 10:35:10.283065 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2026-02-25 10:35:10.329784 | controller | 2026-02-25 10:35:10.329802 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2026-02-25 10:35:10.329808 | controller | Wednesday 25 February 2026 10:35:10 +0000 (0:00:00.079) 0:00:51.383 **** 2026-02-25 10:35:10.329816 | controller | ok: [instance] => (item=public) 2026-02-25 10:35:10.738073 | controller | ok: [instance] => (item=osp_trunk) 2026-02-25 10:35:10.738104 | controller | 2026-02-25 10:35:10.738112 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2026-02-25 10:35:10.738117 | controller | Wednesday 25 February 2026 10:35:10 +0000 (0:00:00.046) 0:00:51.430 **** 2026-02-25 10:35:10.738127 | controller | changed: [instance] => (item=cifmw-public) 2026-02-25 10:35:11.280163 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-25 10:35:11.280195 | controller | 2026-02-25 10:35:11.280203 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2026-02-25 10:35:11.280209 | controller | Wednesday 25 February 2026 10:35:10 +0000 (0:00:00.407) 0:00:51.838 **** 2026-02-25 10:35:11.280219 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 10:35:11.687105 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 10:35:11.687136 | controller | 2026-02-25 10:35:11.687161 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2026-02-25 10:35:11.687170 | controller | Wednesday 25 February 2026 10:35:11 +0000 (0:00:00.542) 0:00:52.380 **** 2026-02-25 10:35:11.687185 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 10:35:12.094882 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 10:35:12.094910 | controller | 2026-02-25 10:35:12.094918 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2026-02-25 10:35:12.094925 | controller | Wednesday 25 February 2026 10:35:11 +0000 (0:00:00.406) 0:00:52.787 **** 2026-02-25 10:35:12.094934 | controller | changed: [instance] => (item=cifmw-public) 2026-02-25 10:35:12.147893 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-25 10:35:12.147923 | controller | 2026-02-25 10:35:12.147935 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2026-02-25 10:35:12.147945 | controller | Wednesday 25 February 2026 10:35:12 +0000 (0:00:00.407) 0:00:53.195 **** 2026-02-25 10:35:12.147959 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2026-02-25 10:35:12.320033 | controller | 2026-02-25 10:35:12.320052 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2026-02-25 10:35:12.320059 | controller | Wednesday 25 February 2026 10:35:12 +0000 (0:00:00.052) 0:00:53.248 **** 2026-02-25 10:35:12.320068 | controller | ok: [instance] 2026-02-25 10:35:12.720856 | controller | 2026-02-25 10:35:12.720875 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2026-02-25 10:35:12.720883 | controller | Wednesday 25 February 2026 10:35:12 +0000 (0:00:00.172) 0:00:53.420 **** 2026-02-25 10:35:12.720891 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 10:35:12.788108 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 10:35:12.788141 | controller | 2026-02-25 10:35:12.788188 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2026-02-25 10:35:12.788200 | controller | Wednesday 25 February 2026 10:35:12 +0000 (0:00:00.400) 0:00:53.821 **** 2026-02-25 10:35:12.788215 | controller | 2026-02-25 10:35:12.822288 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-25 10:35:12.822313 | controller | Wednesday 25 February 2026 10:35:12 +0000 (0:00:00.067) 0:00:53.888 **** 2026-02-25 10:35:12.822327 | controller | skipping: [instance] 2026-02-25 10:35:14.020602 | controller | 2026-02-25 10:35:14.020622 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2026-02-25 10:35:14.020630 | controller | Wednesday 25 February 2026 10:35:12 +0000 (0:00:00.034) 0:00:53.923 **** 2026-02-25 10:35:14.020639 | controller | ok: [instance] 2026-02-25 10:35:14.197125 | controller | 2026-02-25 10:35:14.197157 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-25 10:35:14.197168 | controller | Wednesday 25 February 2026 10:35:14 +0000 (0:00:01.198) 0:00:55.121 **** 2026-02-25 10:35:14.197176 | controller | ok: [instance] 2026-02-25 10:35:14.543253 | controller | 2026-02-25 10:35:14.543286 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2026-02-25 10:35:14.543295 | controller | Wednesday 25 February 2026 10:35:14 +0000 (0:00:00.176) 0:00:55.297 **** 2026-02-25 10:35:14.543306 | controller | changed: [instance] 2026-02-25 10:35:14.543314 | controller | 2026-02-25 10:35:14.543320 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2026-02-25 10:35:14.543328 | controller | Wednesday 25 February 2026 10:35:14 +0000 (0:00:00.345) 0:00:55.643 **** 2026-02-25 10:35:16.170309 | controller | changed: [instance] 2026-02-25 10:35:16.170384 | controller | 2026-02-25 10:35:16.170397 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2026-02-25 10:35:16.170409 | controller | Wednesday 25 February 2026 10:35:16 +0000 (0:00:01.626) 0:00:57.270 **** 2026-02-25 10:35:16.507172 | controller | changed: [instance] 2026-02-25 10:35:16.540017 | controller | 2026-02-25 10:35:16.540050 | controller | TASK [Create extra network configuration] ************************************** 2026-02-25 10:35:16.540063 | controller | Wednesday 25 February 2026 10:35:16 +0000 (0:00:00.336) 0:00:57.607 **** 2026-02-25 10:35:16.540079 | controller | skipping: [instance] 2026-02-25 10:35:16.566122 | controller | 2026-02-25 10:35:16.566139 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2026-02-25 10:35:16.566163 | controller | Wednesday 25 February 2026 10:35:16 +0000 (0:00:00.032) 0:00:57.640 **** 2026-02-25 10:35:16.566175 | controller | skipping: [instance] 2026-02-25 10:35:16.978459 | controller | 2026-02-25 10:35:16.978490 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2026-02-25 10:35:16.978497 | controller | Wednesday 25 February 2026 10:35:16 +0000 (0:00:00.026) 0:00:57.667 **** 2026-02-25 10:35:16.978506 | controller | ok: [instance] 2026-02-25 10:35:17.113207 | controller | 2026-02-25 10:35:17.113230 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2026-02-25 10:35:17.113239 | controller | Wednesday 25 February 2026 10:35:16 +0000 (0:00:00.412) 0:00:58.079 **** 2026-02-25 10:35:17.113249 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 10:35:17.113275 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 10:35:17.113572 | controller | 2026-02-25 10:35:18.277638 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2026-02-25 10:35:18.277663 | controller | Wednesday 25 February 2026 10:35:17 +0000 (0:00:00.135) 0:00:58.214 **** 2026-02-25 10:35:18.277673 | controller | ok: [instance] 2026-02-25 10:35:21.797785 | controller | 2026-02-25 10:35:21.797818 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2026-02-25 10:35:21.797826 | controller | Wednesday 25 February 2026 10:35:18 +0000 (0:00:01.164) 0:00:59.378 **** 2026-02-25 10:35:21.797836 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2026-02-25 10:35:22.009891 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2026-02-25 10:35:22.009912 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2026-02-25 10:35:22.009919 | controller | 2026-02-25 10:35:22.009924 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2026-02-25 10:35:22.009930 | controller | Wednesday 25 February 2026 10:35:21 +0000 (0:00:03.519) 0:01:02.897 **** 2026-02-25 10:35:22.009938 | controller | changed: [instance] 2026-02-25 10:35:22.362673 | controller | 2026-02-25 10:35:22.362701 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2026-02-25 10:35:22.362709 | controller | Wednesday 25 February 2026 10:35:22 +0000 (0:00:00.212) 0:01:03.110 **** 2026-02-25 10:35:22.362719 | controller | changed: [instance] 2026-02-25 10:35:22.742141 | controller | 2026-02-25 10:35:22.742188 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2026-02-25 10:35:22.742196 | controller | Wednesday 25 February 2026 10:35:22 +0000 (0:00:00.352) 0:01:03.463 **** 2026-02-25 10:35:22.742206 | controller | changed: [instance] 2026-02-25 10:35:22.773090 | controller | 2026-02-25 10:35:22.773125 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2026-02-25 10:35:22.773135 | controller | Wednesday 25 February 2026 10:35:22 +0000 (0:00:00.379) 0:01:03.842 **** 2026-02-25 10:35:22.773170 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2026-02-25 10:35:23.138295 | controller | 2026-02-25 10:35:23.138324 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2026-02-25 10:35:23.138332 | controller | Wednesday 25 February 2026 10:35:22 +0000 (0:00:00.030) 0:01:03.873 **** 2026-02-25 10:35:23.138342 | controller | changed: [instance] 2026-02-25 10:35:23.157097 | controller | 2026-02-25 10:35:23.157132 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2026-02-25 10:35:23.157141 | controller | Wednesday 25 February 2026 10:35:23 +0000 (0:00:00.365) 0:01:04.238 **** 2026-02-25 10:35:23.157172 | controller | skipping: [instance] 2026-02-25 10:35:23.189117 | controller | 2026-02-25 10:35:23.189135 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2026-02-25 10:35:23.189142 | controller | Wednesday 25 February 2026 10:35:23 +0000 (0:00:00.019) 0:01:04.257 **** 2026-02-25 10:35:23.189167 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2026-02-25 10:35:23.539780 | controller | 2026-02-25 10:35:23.539817 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2026-02-25 10:35:23.539825 | controller | Wednesday 25 February 2026 10:35:23 +0000 (0:00:00.031) 0:01:04.289 **** 2026-02-25 10:35:23.539835 | controller | changed: [instance] 2026-02-25 10:35:23.558340 | controller | 2026-02-25 10:35:23.558381 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2026-02-25 10:35:23.558396 | controller | Wednesday 25 February 2026 10:35:23 +0000 (0:00:00.350) 0:01:04.640 **** 2026-02-25 10:35:23.558437 | controller | skipping: [instance] 2026-02-25 10:35:23.754989 | controller | 2026-02-25 10:35:23.755023 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2026-02-25 10:35:23.755032 | controller | Wednesday 25 February 2026 10:35:23 +0000 (0:00:00.018) 0:01:04.658 **** 2026-02-25 10:35:23.755042 | controller | ok: [instance] => (item=127.0.0.2) 2026-02-25 10:35:24.377689 | controller | 2026-02-25 10:35:24.377723 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2026-02-25 10:35:24.377732 | controller | Wednesday 25 February 2026 10:35:23 +0000 (0:00:00.196) 0:01:04.855 **** 2026-02-25 10:35:24.377742 | controller | changed: [instance] 2026-02-25 10:35:24.396253 | controller | 2026-02-25 10:35:24.396305 | controller | TASK [dnsmasq : Stop service] ************************************************** 2026-02-25 10:35:24.396318 | controller | Wednesday 25 February 2026 10:35:24 +0000 (0:00:00.622) 0:01:05.477 **** 2026-02-25 10:35:24.396334 | controller | skipping: [instance] 2026-02-25 10:35:24.413682 | controller | 2026-02-25 10:35:24.413713 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2026-02-25 10:35:24.413721 | controller | Wednesday 25 February 2026 10:35:24 +0000 (0:00:00.018) 0:01:05.496 **** 2026-02-25 10:35:24.413733 | controller | skipping: [instance] 2026-02-25 10:35:24.440760 | controller | 2026-02-25 10:35:24.440787 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2026-02-25 10:35:24.440797 | controller | Wednesday 25 February 2026 10:35:24 +0000 (0:00:00.017) 0:01:05.514 **** 2026-02-25 10:35:24.440813 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-25 10:35:24.576234 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2026-02-25 10:35:24.576270 | controller | skipping: [instance] 2026-02-25 10:35:24.576278 | controller | 2026-02-25 10:35:24.576285 | controller | TASK [Create dnsmasq networks] ************************************************* 2026-02-25 10:35:24.576291 | controller | Wednesday 25 February 2026 10:35:24 +0000 (0:00:00.026) 0:01:05.541 **** 2026-02-25 10:35:24.576302 | controller | 2026-02-25 10:35:24.576517 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-25 10:35:24.604014 | controller | Wednesday 25 February 2026 10:35:24 +0000 (0:00:00.135) 0:01:05.676 **** 2026-02-25 10:35:24.604039 | controller | ok: [instance] => changed=false 2026-02-25 10:35:24.638862 | controller | msg: All assertions passed 2026-02-25 10:35:24.638883 | controller | 2026-02-25 10:35:24.638891 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-25 10:35:24.638897 | controller | Wednesday 25 February 2026 10:35:24 +0000 (0:00:00.027) 0:01:05.704 **** 2026-02-25 10:35:24.638905 | controller | ok: [instance] => changed=false 2026-02-25 10:35:25.057795 | controller | msg: All assertions passed 2026-02-25 10:35:25.057826 | controller | 2026-02-25 10:35:25.057834 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-25 10:35:25.057840 | controller | Wednesday 25 February 2026 10:35:24 +0000 (0:00:00.034) 0:01:05.739 **** 2026-02-25 10:35:25.057850 | controller | changed: [instance] 2026-02-25 10:35:25.076886 | controller | 2026-02-25 10:35:25.076903 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-25 10:35:25.076910 | controller | Wednesday 25 February 2026 10:35:25 +0000 (0:00:00.418) 0:01:06.158 **** 2026-02-25 10:35:25.076918 | controller | skipping: [instance] 2026-02-25 10:35:25.102289 | controller | 2026-02-25 10:35:25.102338 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-25 10:35:25.102352 | controller | Wednesday 25 February 2026 10:35:25 +0000 (0:00:00.019) 0:01:06.177 **** 2026-02-25 10:35:25.102371 | controller | skipping: [instance] 2026-02-25 10:35:25.131021 | controller | 2026-02-25 10:35:25.131043 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-25 10:35:25.131052 | controller | Wednesday 25 February 2026 10:35:25 +0000 (0:00:00.025) 0:01:06.203 **** 2026-02-25 10:35:25.131062 | controller | ok: [instance] => changed=false 2026-02-25 10:35:25.167611 | controller | msg: All assertions passed 2026-02-25 10:35:25.167629 | controller | 2026-02-25 10:35:25.167636 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-25 10:35:25.167648 | controller | Wednesday 25 February 2026 10:35:25 +0000 (0:00:00.028) 0:01:06.231 **** 2026-02-25 10:35:25.167658 | controller | ok: [instance] => changed=false 2026-02-25 10:35:25.598274 | controller | msg: All assertions passed 2026-02-25 10:35:25.598317 | controller | 2026-02-25 10:35:25.598331 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-25 10:35:25.598342 | controller | Wednesday 25 February 2026 10:35:25 +0000 (0:00:00.036) 0:01:06.268 **** 2026-02-25 10:35:25.598359 | controller | changed: [instance] 2026-02-25 10:35:25.598391 | controller | 2026-02-25 10:35:25.598511 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-25 10:35:25.598547 | controller | Wednesday 25 February 2026 10:35:25 +0000 (0:00:00.430) 0:01:06.699 **** 2026-02-25 10:35:25.618260 | controller | skipping: [instance] 2026-02-25 10:35:25.643349 | controller | 2026-02-25 10:35:25.643391 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-25 10:35:25.643403 | controller | Wednesday 25 February 2026 10:35:25 +0000 (0:00:00.019) 0:01:06.718 **** 2026-02-25 10:35:25.643428 | controller | skipping: [instance] 2026-02-25 10:35:25.674691 | controller | 2026-02-25 10:35:25.674713 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2026-02-25 10:35:25.674720 | controller | Wednesday 25 February 2026 10:35:25 +0000 (0:00:00.025) 0:01:06.744 **** 2026-02-25 10:35:25.674729 | controller | skipping: [instance] 2026-02-25 10:35:26.129746 | controller | 2026-02-25 10:35:26.129778 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2026-02-25 10:35:26.129786 | controller | Wednesday 25 February 2026 10:35:25 +0000 (0:00:00.031) 0:01:06.775 **** 2026-02-25 10:35:26.129796 | controller | changed: [instance] => (item=cifmw-public) 2026-02-25 10:35:26.168838 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-25 10:35:26.168864 | controller | 2026-02-25 10:35:26.168871 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-25 10:35:26.168877 | controller | Wednesday 25 February 2026 10:35:26 +0000 (0:00:00.454) 0:01:07.230 **** 2026-02-25 10:35:26.168887 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2026-02-25 10:35:26.515112 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2026-02-25 10:35:26.515141 | controller | 2026-02-25 10:35:26.515165 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-25 10:35:26.515174 | controller | Wednesday 25 February 2026 10:35:26 +0000 (0:00:00.039) 0:01:07.269 **** 2026-02-25 10:35:26.515184 | controller | ok: [instance] 2026-02-25 10:35:26.550862 | controller | 2026-02-25 10:35:26.550885 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-25 10:35:26.550901 | controller | Wednesday 25 February 2026 10:35:26 +0000 (0:00:00.346) 0:01:07.615 **** 2026-02-25 10:35:26.550914 | controller | ok: [instance] 2026-02-25 10:35:26.742786 | controller | 2026-02-25 10:35:26.742805 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-25 10:35:26.742812 | controller | Wednesday 25 February 2026 10:35:26 +0000 (0:00:00.035) 0:01:07.651 **** 2026-02-25 10:35:26.742820 | controller | ok: [instance] 2026-02-25 10:35:26.776105 | controller | 2026-02-25 10:35:26.776126 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-25 10:35:26.776135 | controller | Wednesday 25 February 2026 10:35:26 +0000 (0:00:00.192) 0:01:07.843 **** 2026-02-25 10:35:26.776144 | controller | ok: [instance] 2026-02-25 10:35:27.100256 | controller | 2026-02-25 10:35:27.100291 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2026-02-25 10:35:27.100301 | controller | Wednesday 25 February 2026 10:35:26 +0000 (0:00:00.033) 0:01:07.876 **** 2026-02-25 10:35:27.100313 | controller | changed: [instance] 2026-02-25 10:35:27.100348 | controller | 2026-02-25 10:35:27.100360 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2026-02-25 10:35:27.100480 | controller | Wednesday 25 February 2026 10:35:27 +0000 (0:00:00.324) 0:01:08.201 **** 2026-02-25 10:35:27.425014 | controller | changed: [instance] 2026-02-25 10:35:27.751016 | controller | 2026-02-25 10:35:27.751049 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2026-02-25 10:35:27.751058 | controller | Wednesday 25 February 2026 10:35:27 +0000 (0:00:00.324) 0:01:08.525 **** 2026-02-25 10:35:27.751069 | controller | changed: [instance] 2026-02-25 10:35:27.841913 | controller | 2026-02-25 10:35:27.841939 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2026-02-25 10:35:27.841947 | controller | Wednesday 25 February 2026 10:35:27 +0000 (0:00:00.325) 0:01:08.851 **** 2026-02-25 10:35:27.841955 | controller | ok: [instance] 2026-02-25 10:35:28.163248 | controller | 2026-02-25 10:35:28.163281 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2026-02-25 10:35:28.163290 | controller | Wednesday 25 February 2026 10:35:27 +0000 (0:00:00.090) 0:01:08.942 **** 2026-02-25 10:35:28.163302 | controller | changed: [instance] 2026-02-25 10:35:28.163375 | controller | 2026-02-25 10:35:28.163394 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-25 10:35:28.163404 | controller | Wednesday 25 February 2026 10:35:28 +0000 (0:00:00.321) 0:01:09.264 **** 2026-02-25 10:35:28.186279 | controller | skipping: [instance] 2026-02-25 10:35:28.186451 | controller | 2026-02-25 10:35:28.186469 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-25 10:35:28.186479 | controller | Wednesday 25 February 2026 10:35:28 +0000 (0:00:00.022) 0:01:09.286 **** 2026-02-25 10:35:28.208270 | controller | skipping: [instance] 2026-02-25 10:35:28.208642 | controller | 2026-02-25 10:35:28.231286 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-25 10:35:28.231312 | controller | Wednesday 25 February 2026 10:35:28 +0000 (0:00:00.022) 0:01:09.309 **** 2026-02-25 10:35:28.231326 | controller | skipping: [instance] 2026-02-25 10:35:28.231571 | controller | 2026-02-25 10:35:28.231592 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-25 10:35:28.255270 | controller | Wednesday 25 February 2026 10:35:28 +0000 (0:00:00.022) 0:01:09.332 **** 2026-02-25 10:35:28.255293 | controller | skipping: [instance] 2026-02-25 10:35:28.255481 | controller | 2026-02-25 10:35:28.255510 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-25 10:35:28.255527 | controller | Wednesday 25 February 2026 10:35:28 +0000 (0:00:00.023) 0:01:09.355 **** 2026-02-25 10:35:28.274119 | controller | ok: [instance] 2026-02-25 10:35:28.364459 | controller | 2026-02-25 10:35:28.364490 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-25 10:35:28.364502 | controller | Wednesday 25 February 2026 10:35:28 +0000 (0:00:00.019) 0:01:09.374 **** 2026-02-25 10:35:28.364521 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-25 10:35:28.364794 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-25 10:35:28.364914 | controller | 2026-02-25 10:35:28.365034 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-25 10:35:28.365169 | controller | Wednesday 25 February 2026 10:35:28 +0000 (0:00:00.090) 0:01:09.465 **** 2026-02-25 10:35:28.383643 | controller | skipping: [instance] 2026-02-25 10:35:28.383878 | controller | 2026-02-25 10:35:28.384100 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-25 10:35:28.384253 | controller | Wednesday 25 February 2026 10:35:28 +0000 (0:00:00.019) 0:01:09.484 **** 2026-02-25 10:35:28.578631 | controller | ok: [instance] 2026-02-25 10:35:28.959951 | controller | 2026-02-25 10:35:28.959973 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-25 10:35:28.959981 | controller | Wednesday 25 February 2026 10:35:28 +0000 (0:00:00.194) 0:01:09.679 **** 2026-02-25 10:35:28.959990 | controller | changed: [instance] 2026-02-25 10:35:29.020334 | controller | 2026-02-25 10:35:29.020380 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-25 10:35:29.020394 | controller | Wednesday 25 February 2026 10:35:28 +0000 (0:00:00.381) 0:01:10.060 **** 2026-02-25 10:35:29.020411 | controller | ok: [instance] 2026-02-25 10:35:29.020470 | controller | 2026-02-25 10:35:29.020486 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-25 10:35:29.020570 | controller | Wednesday 25 February 2026 10:35:29 +0000 (0:00:00.060) 0:01:10.121 **** 2026-02-25 10:35:29.050946 | controller | ok: [instance] 2026-02-25 10:35:29.437586 | controller | 2026-02-25 10:35:29.437612 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-25 10:35:29.437621 | controller | Wednesday 25 February 2026 10:35:29 +0000 (0:00:00.030) 0:01:10.151 **** 2026-02-25 10:35:29.437631 | controller | changed: [instance] 2026-02-25 10:35:29.464624 | controller | 2026-02-25 10:35:29.464647 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2026-02-25 10:35:29.464656 | controller | Wednesday 25 February 2026 10:35:29 +0000 (0:00:00.386) 0:01:10.538 **** 2026-02-25 10:35:29.464666 | controller | ok: [instance] 2026-02-25 10:35:29.484025 | controller | 2026-02-25 10:35:29.484042 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2026-02-25 10:35:29.484049 | controller | Wednesday 25 February 2026 10:35:29 +0000 (0:00:00.027) 0:01:10.565 **** 2026-02-25 10:35:29.484057 | controller | ok: [instance] 2026-02-25 10:35:29.503543 | controller | 2026-02-25 10:35:29.503566 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2026-02-25 10:35:29.503575 | controller | Wednesday 25 February 2026 10:35:29 +0000 (0:00:00.019) 0:01:10.584 **** 2026-02-25 10:35:29.503586 | controller | ok: [instance] 2026-02-25 10:35:29.503748 | controller | 2026-02-25 10:35:29.503911 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2026-02-25 10:35:29.504036 | controller | Wednesday 25 February 2026 10:35:29 +0000 (0:00:00.019) 0:01:10.604 **** 2026-02-25 10:35:29.574431 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2026-02-25 10:35:29.574690 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2026-02-25 10:35:29.574920 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2026-02-25 10:35:29.575130 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2026-02-25 10:35:29.575273 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2026-02-25 10:35:29.575396 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2026-02-25 10:35:29.575523 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2026-02-25 10:35:29.575632 | controller | 2026-02-25 10:35:29.575744 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 10:35:29.575854 | controller | Wednesday 25 February 2026 10:35:29 +0000 (0:00:00.070) 0:01:10.675 **** 2026-02-25 10:35:29.731822 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2026-02-25 10:35:29.731992 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2026-02-25 10:35:29.732140 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2026-02-25 10:35:29.732329 | controller | 2026-02-25 10:35:29.732470 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 10:35:29.732589 | controller | Wednesday 25 February 2026 10:35:29 +0000 (0:00:00.157) 0:01:10.832 **** 2026-02-25 10:35:29.813160 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2026-02-25 10:35:29.895285 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2026-02-25 10:35:29.895326 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2026-02-25 10:35:29.895337 | controller | skipping: [instance] 2026-02-25 10:35:29.895345 | controller | 2026-02-25 10:35:29.895353 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 10:35:29.895362 | controller | Wednesday 25 February 2026 10:35:29 +0000 (0:00:00.080) 0:01:10.913 **** 2026-02-25 10:35:29.895375 | controller | skipping: [instance] => (item=compute-0 - storage) 2026-02-25 10:35:29.895408 | controller | skipping: [instance] => (item=controller-0 - storage) 2026-02-25 10:35:29.895429 | controller | skipping: [instance] => (item=crc-0 - storage) 2026-02-25 10:35:29.895440 | controller | skipping: [instance] 2026-02-25 10:35:29.895728 | controller | 2026-02-25 10:35:29.895748 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 10:35:29.977267 | controller | Wednesday 25 February 2026 10:35:29 +0000 (0:00:00.082) 0:01:10.995 **** 2026-02-25 10:35:29.977294 | controller | skipping: [instance] => (item=compute-0 - tenant) 2026-02-25 10:35:29.977349 | controller | skipping: [instance] => (item=controller-0 - tenant) 2026-02-25 10:35:29.977367 | controller | skipping: [instance] => (item=crc-0 - tenant) 2026-02-25 10:35:29.977374 | controller | skipping: [instance] 2026-02-25 10:35:29.977380 | controller | 2026-02-25 10:35:29.977385 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 10:35:29.977393 | controller | Wednesday 25 February 2026 10:35:29 +0000 (0:00:00.081) 0:01:11.077 **** 2026-02-25 10:35:30.055275 | controller | skipping: [instance] => (item=compute-0 - external) 2026-02-25 10:35:30.055588 | controller | skipping: [instance] => (item=controller-0 - external) 2026-02-25 10:35:30.055609 | controller | skipping: [instance] => (item=crc-0 - external) 2026-02-25 10:35:30.055617 | controller | skipping: [instance] 2026-02-25 10:35:30.055627 | controller | 2026-02-25 10:35:30.135294 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 10:35:30.135331 | controller | Wednesday 25 February 2026 10:35:30 +0000 (0:00:00.078) 0:01:11.155 **** 2026-02-25 10:35:30.135344 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2026-02-25 10:35:30.135351 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2026-02-25 10:35:30.135358 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2026-02-25 10:35:30.135364 | controller | skipping: [instance] 2026-02-25 10:35:30.135372 | controller | 2026-02-25 10:35:30.135490 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 10:35:30.135592 | controller | Wednesday 25 February 2026 10:35:30 +0000 (0:00:00.079) 0:01:11.235 **** 2026-02-25 10:35:30.266861 | controller | ok: [instance] => (item=compute-0 - public) 2026-02-25 10:35:30.267093 | controller | ok: [instance] => (item=controller-0 - public) 2026-02-25 10:35:30.267331 | controller | ok: [instance] => (item=crc-0 - public) 2026-02-25 10:35:30.267553 | controller | 2026-02-25 10:35:30.267736 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2026-02-25 10:35:30.267834 | controller | Wednesday 25 February 2026 10:35:30 +0000 (0:00:00.131) 0:01:11.367 **** 2026-02-25 10:35:30.375187 | controller | 2026-02-25 10:35:30.375478 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2026-02-25 10:35:30.375692 | controller | Wednesday 25 February 2026 10:35:30 +0000 (0:00:00.108) 0:01:11.476 **** 2026-02-25 10:35:30.416505 | controller | ok: [instance] 2026-02-25 10:35:30.416704 | controller | 2026-02-25 10:35:30.416808 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2026-02-25 10:35:30.416911 | controller | Wednesday 25 February 2026 10:35:30 +0000 (0:00:00.041) 0:01:11.517 **** 2026-02-25 10:35:30.511247 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:e8:26:31', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-25 10:35:30.511406 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:55:d0:76', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-25 10:35:30.511526 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:9c:f7:3e', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-25 10:35:30.511678 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:11:11:56', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-25 10:35:30.511760 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:2b:c2:66', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-25 10:35:30.511880 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:ef:6d:6c', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-25 10:35:30.511961 | controller | 2026-02-25 10:35:30.512055 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2026-02-25 10:35:30.512170 | controller | Wednesday 25 February 2026 10:35:30 +0000 (0:00:00.094) 0:01:11.612 **** 2026-02-25 10:35:30.562311 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2026-02-25 10:35:30.562557 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2026-02-25 10:35:30.562695 | controller | 2026-02-25 10:35:30.562933 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-25 10:35:30.563066 | controller | Wednesday 25 February 2026 10:35:30 +0000 (0:00:00.050) 0:01:11.663 **** 2026-02-25 10:35:30.736222 | controller | ok: [instance] 2026-02-25 10:35:30.760275 | controller | 2026-02-25 10:35:30.760300 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-25 10:35:30.760309 | controller | Wednesday 25 February 2026 10:35:30 +0000 (0:00:00.173) 0:01:11.836 **** 2026-02-25 10:35:30.760319 | controller | ok: [instance] 2026-02-25 10:35:30.760618 | controller | 2026-02-25 10:35:30.760652 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-25 10:35:30.931265 | controller | Wednesday 25 February 2026 10:35:30 +0000 (0:00:00.024) 0:01:11.861 **** 2026-02-25 10:35:30.931296 | controller | ok: [instance] 2026-02-25 10:35:30.954763 | controller | 2026-02-25 10:35:30.954784 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-25 10:35:30.954791 | controller | Wednesday 25 February 2026 10:35:30 +0000 (0:00:00.171) 0:01:12.032 **** 2026-02-25 10:35:30.954800 | controller | ok: [instance] 2026-02-25 10:35:30.974275 | controller | 2026-02-25 10:35:30.974306 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2026-02-25 10:35:30.974315 | controller | Wednesday 25 February 2026 10:35:30 +0000 (0:00:00.023) 0:01:12.055 **** 2026-02-25 10:35:30.974325 | controller | ok: [instance] 2026-02-25 10:35:30.974491 | controller | 2026-02-25 10:35:30.974520 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2026-02-25 10:35:30.974537 | controller | Wednesday 25 February 2026 10:35:30 +0000 (0:00:00.019) 0:01:12.074 **** 2026-02-25 10:35:31.145294 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:e8:26:31', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-25 10:35:31.145337 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:55:d0:76', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-25 10:35:31.145347 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:9c:f7:3e', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-25 10:35:31.145354 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:11:11:56', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-25 10:35:31.145360 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:2b:c2:66', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-25 10:35:31.145366 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:ef:6d:6c', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-25 10:35:31.145373 | controller | 2026-02-25 10:35:31.145379 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2026-02-25 10:35:31.145387 | controller | Wednesday 25 February 2026 10:35:31 +0000 (0:00:00.170) 0:01:12.245 **** 2026-02-25 10:35:31.184915 | controller | ok: [instance] 2026-02-25 10:35:33.160306 | controller | 2026-02-25 10:35:33.160348 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2026-02-25 10:35:33.160357 | controller | Wednesday 25 February 2026 10:35:31 +0000 (0:00:00.039) 0:01:12.285 **** 2026-02-25 10:35:33.160369 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:e8:26:31', 'entry': 'set:compute,52:54:00:e8:26:31,192.168.140.100,compute-0', 'state': 'present'}) 2026-02-25 10:35:33.181942 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:55:d0:76', 'entry': 'set:controller,52:54:01:55:d0:76,192.168.140.9,controller-0', 'state': 'present'}) 2026-02-25 10:35:33.181976 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:9c:f7:3e', 'entry': 'set:ocp,52:54:02:9c:f7:3e,192.168.140.10,crc-0', 'state': 'present'}) 2026-02-25 10:35:33.181985 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:11:11:56', 'entry': 'set:compute,52:54:00:11:11:56,192.168.101.100,compute-0', 'state': 'present'}) 2026-02-25 10:35:33.181991 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:2b:c2:66', 'entry': 'set:controller,52:54:01:2b:c2:66,192.168.101.9,controller-0', 'state': 'present'}) 2026-02-25 10:35:33.181997 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:ef:6d:6c', 'entry': 'set:ocp,52:54:02:ef:6d:6c,192.168.101.10,crc-0', 'state': 'present'}) 2026-02-25 10:35:33.182003 | controller | 2026-02-25 10:35:33.182009 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2026-02-25 10:35:33.182019 | controller | Wednesday 25 February 2026 10:35:33 +0000 (0:00:01.974) 0:01:14.260 **** 2026-02-25 10:35:33.182029 | controller | skipping: [instance] 2026-02-25 10:35:33.386367 | controller | 2026-02-25 10:35:33.386431 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2026-02-25 10:35:33.386447 | controller | Wednesday 25 February 2026 10:35:33 +0000 (0:00:00.022) 0:01:14.282 **** 2026-02-25 10:35:33.386465 | controller | ok: [instance] => (item=compute-0) 2026-02-25 10:35:33.386511 | controller | ok: [instance] => (item=controller-0) 2026-02-25 10:35:33.386522 | controller | ok: [instance] => (item=crc-0) 2026-02-25 10:35:33.386535 | controller | 2026-02-25 10:35:33.386559 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2026-02-25 10:35:33.386572 | controller | Wednesday 25 February 2026 10:35:33 +0000 (0:00:00.204) 0:01:14.486 **** 2026-02-25 10:35:33.502439 | controller | 2026-02-25 10:35:33.540882 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-25 10:35:33.540901 | controller | Wednesday 25 February 2026 10:35:33 +0000 (0:00:00.116) 0:01:14.602 **** 2026-02-25 10:35:33.540917 | controller | ok: [instance] 2026-02-25 10:35:33.732212 | controller | 2026-02-25 10:35:33.732234 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-25 10:35:33.732242 | controller | Wednesday 25 February 2026 10:35:33 +0000 (0:00:00.038) 0:01:14.641 **** 2026-02-25 10:35:33.732252 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 10:35:33.732432 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 10:35:33.732589 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-25 10:35:33.732735 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-25 10:35:33.732880 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-25 10:35:33.733014 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-25 10:35:33.733131 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-25 10:35:33.733295 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 10:35:33.733434 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 10:35:33.733555 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-25 10:35:33.733668 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 10:35:33.733779 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 10:35:33.733891 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-25 10:35:33.734001 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-25 10:35:33.734114 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-25 10:35:33.734300 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-25 10:35:33.734412 | controller | 2026-02-25 10:35:33.734540 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-25 10:35:33.734659 | controller | Wednesday 25 February 2026 10:35:33 +0000 (0:00:00.191) 0:01:14.833 **** 2026-02-25 10:35:36.644317 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 10:35:36.645358 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 10:35:36.645394 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-25 10:35:36.645402 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-25 10:35:36.645408 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-25 10:35:36.645421 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-25 10:35:36.645427 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-25 10:35:36.645438 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 10:35:37.012344 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 10:35:37.012388 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-25 10:35:37.012397 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 10:35:37.012404 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 10:35:37.012429 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-25 10:35:37.012437 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-25 10:35:37.012444 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-25 10:35:37.012451 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-25 10:35:37.012457 | controller | 2026-02-25 10:35:37.012465 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-25 10:35:37.012472 | controller | Wednesday 25 February 2026 10:35:36 +0000 (0:00:02.911) 0:01:17.744 **** 2026-02-25 10:35:37.012485 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 10:35:37.012519 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 10:35:37.012536 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-25 10:35:37.012542 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-25 10:35:37.012549 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-25 10:35:37.012556 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-25 10:35:37.012565 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-25 10:35:37.012589 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 10:35:37.012598 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 10:35:37.013440 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-25 10:35:37.033734 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 10:35:37.033759 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 10:35:37.033767 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-25 10:35:37.033773 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-25 10:35:37.033779 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-25 10:35:37.033785 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-25 10:35:37.033795 | controller | 2026-02-25 10:35:37.033800 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2026-02-25 10:35:37.033807 | controller | Wednesday 25 February 2026 10:35:37 +0000 (0:00:00.367) 0:01:18.111 **** 2026-02-25 10:35:37.033816 | controller | ok: [instance] 2026-02-25 10:35:37.081258 | controller | 2026-02-25 10:35:37.081284 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2026-02-25 10:35:37.081292 | controller | Wednesday 25 February 2026 10:35:37 +0000 (0:00:00.022) 0:01:18.134 **** 2026-02-25 10:35:37.081303 | controller | skipping: [instance] => (item=compute) 2026-02-25 10:35:37.081328 | controller | skipping: [instance] => (item=controller) 2026-02-25 10:35:37.081334 | controller | skipping: [instance] => (item=crc) 2026-02-25 10:35:37.081340 | controller | skipping: [instance] 2026-02-25 10:35:37.081346 | controller | 2026-02-25 10:35:37.081353 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2026-02-25 10:35:37.081426 | controller | Wednesday 25 February 2026 10:35:37 +0000 (0:00:00.047) 0:01:18.181 **** 2026-02-25 10:35:37.112991 | controller | skipping: [instance] 2026-02-25 10:35:37.113136 | controller | 2026-02-25 10:35:37.113302 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2026-02-25 10:35:37.113450 | controller | Wednesday 25 February 2026 10:35:37 +0000 (0:00:00.032) 0:01:18.214 **** 2026-02-25 10:35:37.490969 | controller | changed: [instance] 2026-02-25 10:35:38.106252 | controller | 2026-02-25 10:35:38.106285 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2026-02-25 10:35:38.106294 | controller | Wednesday 25 February 2026 10:35:37 +0000 (0:00:00.366) 0:01:18.580 **** 2026-02-25 10:35:38.106301 | controller | 2026-02-25 10:35:38.106308 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-25 10:35:38.106315 | controller | Wednesday 25 February 2026 10:35:37 +0000 (0:00:00.010) 0:01:18.591 **** 2026-02-25 10:35:38.106326 | controller | changed: [instance] 2026-02-25 10:35:38.106355 | controller | 2026-02-25 10:35:38.106380 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-25 10:35:38.106539 | controller | Wednesday 25 February 2026 10:35:38 +0000 (0:00:00.615) 0:01:19.207 **** 2026-02-25 10:35:38.458679 | controller | changed: [instance] 2026-02-25 10:35:38.458889 | controller | 2026-02-25 10:35:38.458922 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2026-02-25 10:35:38.784243 | controller | Wednesday 25 February 2026 10:35:38 +0000 (0:00:00.352) 0:01:19.559 **** 2026-02-25 10:35:38.784288 | controller | changed: [instance] 2026-02-25 10:35:39.132843 | controller | 2026-02-25 10:35:39.132880 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2026-02-25 10:35:39.132888 | controller | Wednesday 25 February 2026 10:35:38 +0000 (0:00:00.325) 0:01:19.884 **** 2026-02-25 10:35:39.132897 | controller | changed: [instance] 2026-02-25 10:35:39.485219 | controller | 2026-02-25 10:35:39.485251 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2026-02-25 10:35:39.485258 | controller | Wednesday 25 February 2026 10:35:39 +0000 (0:00:00.349) 0:01:20.233 **** 2026-02-25 10:35:39.485268 | controller | changed: [instance] 2026-02-25 10:35:39.485292 | controller | 2026-02-25 10:35:39.485558 | controller | TASK [Build utility records dataset] ******************************************* 2026-02-25 10:35:39.517329 | controller | Wednesday 25 February 2026 10:35:39 +0000 (0:00:00.352) 0:01:20.586 **** 2026-02-25 10:35:39.517368 | controller | 2026-02-25 10:35:39.517481 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-25 10:35:39.517516 | controller | Wednesday 25 February 2026 10:35:39 +0000 (0:00:00.031) 0:01:20.617 **** 2026-02-25 10:35:39.603459 | controller | ok: [instance] 2026-02-25 10:35:39.694282 | controller | 2026-02-25 10:35:39.694313 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-25 10:35:39.694323 | controller | Wednesday 25 February 2026 10:35:39 +0000 (0:00:00.086) 0:01:20.703 **** 2026-02-25 10:35:39.694338 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-25 10:35:39.694359 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 10:35:39.694366 | controller | 2026-02-25 10:35:39.694372 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-25 10:35:39.694381 | controller | Wednesday 25 February 2026 10:35:39 +0000 (0:00:00.090) 0:01:20.794 **** 2026-02-25 10:35:40.129239 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-25 10:35:40.129623 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 10:35:40.410283 | controller | 2026-02-25 10:35:40.410317 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-25 10:35:40.410326 | controller | Wednesday 25 February 2026 10:35:40 +0000 (0:00:00.434) 0:01:21.229 **** 2026-02-25 10:35:40.410338 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-25 10:35:40.410358 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 10:35:40.410375 | controller | 2026-02-25 10:35:40.410717 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-25 10:35:40.410749 | controller | Wednesday 25 February 2026 10:35:40 +0000 (0:00:00.271) 0:01:21.500 **** 2026-02-25 10:35:40.863179 | controller | 2026-02-25 10:35:40.863212 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-25 10:35:40.863220 | controller | Wednesday 25 February 2026 10:35:40 +0000 (0:00:00.010) 0:01:21.510 **** 2026-02-25 10:35:40.863230 | controller | changed: [instance] 2026-02-25 10:35:40.863377 | controller | 2026-02-25 10:35:40.863406 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-25 10:35:40.863428 | controller | Wednesday 25 February 2026 10:35:40 +0000 (0:00:00.452) 0:01:21.963 **** 2026-02-25 10:35:41.203233 | controller | changed: [instance] 2026-02-25 10:35:41.203332 | controller | 2026-02-25 10:35:41.203359 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2026-02-25 10:35:41.203371 | controller | Wednesday 25 February 2026 10:35:41 +0000 (0:00:00.339) 0:01:22.303 **** 2026-02-25 10:35:41.234828 | controller | skipping: [instance] 2026-02-25 10:35:41.307887 | controller | 2026-02-25 10:35:41.307907 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2026-02-25 10:35:41.307916 | controller | Wednesday 25 February 2026 10:35:41 +0000 (0:00:00.031) 0:01:22.335 **** 2026-02-25 10:35:41.307926 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2026-02-25 10:35:41.487624 | controller | 2026-02-25 10:35:41.487645 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2026-02-25 10:35:41.487653 | controller | Wednesday 25 February 2026 10:35:41 +0000 (0:00:00.073) 0:01:22.408 **** 2026-02-25 10:35:41.487661 | controller | ok: [instance] 2026-02-25 10:35:41.507005 | controller | 2026-02-25 10:35:41.507031 | controller | TASK [Deploy CRC if needed] **************************************************** 2026-02-25 10:35:41.507040 | controller | Wednesday 25 February 2026 10:35:41 +0000 (0:00:00.179) 0:01:22.588 **** 2026-02-25 10:35:41.507051 | controller | skipping: [instance] 2026-02-25 10:35:41.837020 | controller | 2026-02-25 10:35:41.837045 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2026-02-25 10:35:41.837053 | controller | Wednesday 25 February 2026 10:35:41 +0000 (0:00:00.019) 0:01:22.607 **** 2026-02-25 10:35:41.837062 | controller | ok: [instance] 2026-02-25 10:35:42.056309 | controller | 2026-02-25 10:35:42.056337 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2026-02-25 10:35:42.056345 | controller | Wednesday 25 February 2026 10:35:41 +0000 (0:00:00.330) 0:01:22.937 **** 2026-02-25 10:35:42.056355 | controller | ok: [instance] 2026-02-25 10:35:42.271007 | controller | 2026-02-25 10:35:42.271039 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2026-02-25 10:35:42.271048 | controller | Wednesday 25 February 2026 10:35:42 +0000 (0:00:00.219) 0:01:23.156 **** 2026-02-25 10:35:42.271058 | controller | ok: [instance] 2026-02-25 10:35:42.480058 | controller | 2026-02-25 10:35:42.480084 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2026-02-25 10:35:42.480092 | controller | Wednesday 25 February 2026 10:35:42 +0000 (0:00:00.214) 0:01:23.371 **** 2026-02-25 10:35:42.480102 | controller | ok: [instance] 2026-02-25 10:35:42.692212 | controller | 2026-02-25 10:35:42.692243 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2026-02-25 10:35:42.692256 | controller | Wednesday 25 February 2026 10:35:42 +0000 (0:00:00.209) 0:01:23.580 **** 2026-02-25 10:35:42.692265 | controller | ok: [instance] 2026-02-25 10:35:42.728759 | controller | 2026-02-25 10:35:42.728777 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-25 10:35:42.728785 | controller | Wednesday 25 February 2026 10:35:42 +0000 (0:00:00.212) 0:01:23.792 **** 2026-02-25 10:35:42.728795 | controller | 2026-02-25 10:35:42.910848 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-25 10:35:42.910886 | controller | Wednesday 25 February 2026 10:35:42 +0000 (0:00:00.036) 0:01:23.829 **** 2026-02-25 10:35:42.910903 | controller | ok: [instance] 2026-02-25 10:35:42.962085 | controller | 2026-02-25 10:35:42.962118 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-25 10:35:42.962131 | controller | Wednesday 25 February 2026 10:35:42 +0000 (0:00:00.181) 0:01:24.011 **** 2026-02-25 10:35:42.962175 | controller | ok: [instance] 2026-02-25 10:35:42.986343 | controller | 2026-02-25 10:35:42.986390 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-25 10:35:42.986404 | controller | Wednesday 25 February 2026 10:35:42 +0000 (0:00:00.051) 0:01:24.062 **** 2026-02-25 10:35:42.986437 | controller | skipping: [instance] 2026-02-25 10:35:42.987022 | controller | 2026-02-25 10:35:42.987040 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2026-02-25 10:35:42.987050 | controller | Wednesday 25 February 2026 10:35:42 +0000 (0:00:00.024) 0:01:24.086 **** 2026-02-25 10:35:43.227222 | controller | ok: [instance] 2026-02-25 10:35:43.227511 | controller | 2026-02-25 10:35:43.434781 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2026-02-25 10:35:43.434813 | controller | Wednesday 25 February 2026 10:35:43 +0000 (0:00:00.241) 0:01:24.328 **** 2026-02-25 10:35:43.434826 | controller | ok: [instance] 2026-02-25 10:35:43.599048 | controller | 2026-02-25 10:35:43.599080 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2026-02-25 10:35:43.599087 | controller | Wednesday 25 February 2026 10:35:43 +0000 (0:00:00.207) 0:01:24.535 **** 2026-02-25 10:35:43.599097 | controller | ok: [instance] 2026-02-25 10:35:43.653761 | controller | 2026-02-25 10:35:43.653789 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2026-02-25 10:35:43.653796 | controller | Wednesday 25 February 2026 10:35:43 +0000 (0:00:00.164) 0:01:24.699 **** 2026-02-25 10:35:43.653805 | controller | 2026-02-25 10:35:43.694230 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-25 10:35:43.694254 | controller | Wednesday 25 February 2026 10:35:43 +0000 (0:00:00.054) 0:01:24.754 **** 2026-02-25 10:35:43.694266 | controller | ok: [instance] => changed=false 2026-02-25 10:35:43.694546 | controller | msg: All assertions passed 2026-02-25 10:35:43.694566 | controller | 2026-02-25 10:35:43.866823 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-25 10:35:43.866852 | controller | Wednesday 25 February 2026 10:35:43 +0000 (0:00:00.040) 0:01:24.795 **** 2026-02-25 10:35:43.866863 | controller | ok: [instance] 2026-02-25 10:35:44.051247 | controller | 2026-02-25 10:35:44.051287 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-25 10:35:44.051297 | controller | Wednesday 25 February 2026 10:35:43 +0000 (0:00:00.172) 0:01:24.967 **** 2026-02-25 10:35:44.051310 | controller | ok: [instance] 2026-02-25 10:35:44.075337 | controller | 2026-02-25 10:35:44.075362 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-25 10:35:44.075371 | controller | Wednesday 25 February 2026 10:35:44 +0000 (0:00:00.184) 0:01:25.151 **** 2026-02-25 10:35:44.075382 | controller | ok: [instance] => changed=false 2026-02-25 10:35:44.250213 | controller | msg: All assertions passed 2026-02-25 10:35:44.250243 | controller | 2026-02-25 10:35:44.250251 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-25 10:35:44.250257 | controller | Wednesday 25 February 2026 10:35:44 +0000 (0:00:00.024) 0:01:25.175 **** 2026-02-25 10:35:44.250265 | controller | ok: [instance] 2026-02-25 10:35:44.250286 | controller | 2026-02-25 10:35:44.250294 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-25 10:35:44.250358 | controller | Wednesday 25 February 2026 10:35:44 +0000 (0:00:00.174) 0:01:25.350 **** 2026-02-25 10:35:44.415628 | controller | ok: [instance] 2026-02-25 10:35:44.463239 | controller | 2026-02-25 10:35:44.463274 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-25 10:35:44.463285 | controller | Wednesday 25 February 2026 10:35:44 +0000 (0:00:00.165) 0:01:25.515 **** 2026-02-25 10:35:44.463297 | controller | ok: [instance] 2026-02-25 10:35:44.825028 | controller | 2026-02-25 10:35:44.825058 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2026-02-25 10:35:44.825065 | controller | Wednesday 25 February 2026 10:35:44 +0000 (0:00:00.047) 0:01:25.563 **** 2026-02-25 10:35:44.825075 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2026-02-25 10:35:44.842898 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2026-02-25 10:35:44.842919 | controller | 2026-02-25 10:35:44.842926 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2026-02-25 10:35:44.842931 | controller | Wednesday 25 February 2026 10:35:44 +0000 (0:00:00.361) 0:01:25.925 **** 2026-02-25 10:35:44.842941 | controller | skipping: [instance] 2026-02-25 10:35:44.866591 | controller | 2026-02-25 10:35:44.866613 | controller | TASK [Load the architecture local kustomize patches] *************************** 2026-02-25 10:35:44.866626 | controller | Wednesday 25 February 2026 10:35:44 +0000 (0:00:00.018) 0:01:25.943 **** 2026-02-25 10:35:44.866636 | controller | skipping: [instance] 2026-02-25 10:35:44.990320 | controller | 2026-02-25 10:35:44.990359 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2026-02-25 10:35:44.990374 | controller | Wednesday 25 February 2026 10:35:44 +0000 (0:00:00.023) 0:01:25.967 **** 2026-02-25 10:35:44.990388 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2026-02-25 10:35:45.013325 | controller | 2026-02-25 10:35:45.013347 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2026-02-25 10:35:45.013355 | controller | Wednesday 25 February 2026 10:35:44 +0000 (0:00:00.123) 0:01:26.090 **** 2026-02-25 10:35:45.013364 | controller | skipping: [instance] 2026-02-25 10:35:45.401371 | controller | 2026-02-25 10:35:45.401426 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2026-02-25 10:35:45.401437 | controller | Wednesday 25 February 2026 10:35:45 +0000 (0:00:00.023) 0:01:26.114 **** 2026-02-25 10:35:45.401449 | controller | changed: [instance] 2026-02-25 10:35:45.401472 | controller | 2026-02-25 10:35:45.401535 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2026-02-25 10:35:45.401639 | controller | Wednesday 25 February 2026 10:35:45 +0000 (0:00:00.388) 0:01:26.502 **** 2026-02-25 10:35:45.893716 | controller | changed: [instance] 2026-02-25 10:35:45.893763 | controller | 2026-02-25 10:35:45.893876 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2026-02-25 10:35:45.893979 | controller | Wednesday 25 February 2026 10:35:45 +0000 (0:00:00.481) 0:01:26.983 **** 2026-02-25 10:35:45.894060 | controller | 2026-02-25 10:35:45.894136 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-25 10:35:45.894255 | controller | Wednesday 25 February 2026 10:35:45 +0000 (0:00:00.010) 0:01:26.994 **** 2026-02-25 10:35:46.325834 | controller | changed: [instance] 2026-02-25 10:35:46.325905 | controller | 2026-02-25 10:35:46.326206 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-25 10:35:46.933944 | controller | Wednesday 25 February 2026 10:35:46 +0000 (0:00:00.432) 0:01:27.426 **** 2026-02-25 10:35:46.933978 | controller | changed: [instance] 2026-02-25 10:35:46.965715 | controller | 2026-02-25 10:35:46.965740 | controller | TASK [Deploy virtualbmc] ******************************************************* 2026-02-25 10:35:46.965750 | controller | Wednesday 25 February 2026 10:35:46 +0000 (0:00:00.607) 0:01:28.034 **** 2026-02-25 10:35:46.965761 | controller | skipping: [instance] 2026-02-25 10:35:46.997246 | controller | 2026-02-25 10:35:46.997277 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2026-02-25 10:35:46.997285 | controller | Wednesday 25 February 2026 10:35:46 +0000 (0:00:00.031) 0:01:28.066 **** 2026-02-25 10:35:46.997295 | controller | skipping: [instance] 2026-02-25 10:35:46.997320 | controller | 2026-02-25 10:35:46.997532 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2026-02-25 10:35:47.511226 | controller | Wednesday 25 February 2026 10:35:46 +0000 (0:00:00.031) 0:01:28.098 **** 2026-02-25 10:35:47.511265 | controller | changed: [instance] => (item=workload) 2026-02-25 10:35:47.894286 | controller | changed: [instance] => (item=reproducer-inventory) 2026-02-25 10:35:47.894320 | controller | ok: [instance] => (item=volumes) 2026-02-25 10:35:47.894331 | controller | 2026-02-25 10:35:47.894337 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2026-02-25 10:35:47.894342 | controller | Wednesday 25 February 2026 10:35:47 +0000 (0:00:00.513) 0:01:28.611 **** 2026-02-25 10:35:47.894351 | controller | changed: [instance] => (item=workload) 2026-02-25 10:35:47.916770 | controller | changed: [instance] => (item=volumes) 2026-02-25 10:35:47.916800 | controller | 2026-02-25 10:35:47.916813 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2026-02-25 10:35:47.916823 | controller | Wednesday 25 February 2026 10:35:47 +0000 (0:00:00.383) 0:01:28.994 **** 2026-02-25 10:35:47.916838 | controller | skipping: [instance] 2026-02-25 10:35:48.879711 | controller | 2026-02-25 10:35:48.879746 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2026-02-25 10:35:48.879754 | controller | Wednesday 25 February 2026 10:35:47 +0000 (0:00:00.022) 0:01:29.017 **** 2026-02-25 10:35:48.879764 | controller | changed: [instance] => (item=compute) 2026-02-25 10:35:48.909999 | controller | changed: [instance] => (item=controller) 2026-02-25 10:35:48.910022 | controller | changed: [instance] => (item=crc) 2026-02-25 10:35:48.910033 | controller | 2026-02-25 10:35:48.910041 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2026-02-25 10:35:48.910049 | controller | Wednesday 25 February 2026 10:35:48 +0000 (0:00:00.962) 0:01:29.980 **** 2026-02-25 10:35:48.910061 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance 2026-02-25 10:35:49.079285 | controller | 2026-02-25 10:35:49.079317 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] ***************** 2026-02-25 10:35:49.079326 | controller | Wednesday 25 February 2026 10:35:48 +0000 (0:00:00.030) 0:01:30.010 **** 2026-02-25 10:35:49.079337 | controller | ok: [instance] 2026-02-25 10:35:49.079356 | controller | 2026-02-25 10:35:49.079365 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* 2026-02-25 10:35:49.079393 | controller | Wednesday 25 February 2026 10:35:49 +0000 (0:00:00.169) 0:01:30.180 **** 2026-02-25 10:35:49.098041 | controller | skipping: [instance] 2026-02-25 10:35:49.483258 | controller | 2026-02-25 10:35:49.483293 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] *** 2026-02-25 10:35:49.483303 | controller | Wednesday 25 February 2026 10:35:49 +0000 (0:00:00.018) 0:01:30.198 **** 2026-02-25 10:35:49.483315 | controller | changed: [instance] 2026-02-25 10:35:49.483344 | controller | 2026-02-25 10:35:49.483354 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* 2026-02-25 10:35:49.483380 | controller | Wednesday 25 February 2026 10:35:49 +0000 (0:00:00.385) 0:01:30.584 **** 2026-02-25 10:35:49.504225 | controller | skipping: [instance] 2026-02-25 10:35:49.525104 | controller | 2026-02-25 10:35:49.525127 | controller | TASK [libvirt_manager : Write merged all-group.yml] **************************** 2026-02-25 10:35:49.525136 | controller | Wednesday 25 February 2026 10:35:49 +0000 (0:00:00.020) 0:01:30.604 **** 2026-02-25 10:35:49.525166 | controller | skipping: [instance] 2026-02-25 10:35:49.564763 | controller | 2026-02-25 10:35:49.564786 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2026-02-25 10:35:49.564796 | controller | Wednesday 25 February 2026 10:35:49 +0000 (0:00:00.020) 0:01:30.625 **** 2026-02-25 10:35:49.564807 | controller | skipping: [instance] 2026-02-25 10:35:49.632275 | controller | 2026-02-25 10:35:49.632304 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2026-02-25 10:35:49.632314 | controller | Wednesday 25 February 2026 10:35:49 +0000 (0:00:00.039) 0:01:30.665 **** 2026-02-25 10:35:49.632326 | controller | skipping: [instance] => (item=crc) 2026-02-25 10:35:49.840014 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2026-02-25 10:35:49.840043 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2026-02-25 10:35:49.840060 | controller | 2026-02-25 10:35:49.840068 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-25 10:35:49.840075 | controller | Wednesday 25 February 2026 10:35:49 +0000 (0:00:00.066) 0:01:30.732 **** 2026-02-25 10:35:49.840087 | controller | changed: [instance] 2026-02-25 10:35:50.022647 | controller | 2026-02-25 10:35:50.022678 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-25 10:35:50.022689 | controller | Wednesday 25 February 2026 10:35:49 +0000 (0:00:00.207) 0:01:30.940 **** 2026-02-25 10:35:50.022699 | controller | ok: [instance] 2026-02-25 10:36:19.575374 | controller | 2026-02-25 10:36:19.575416 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-25 10:36:19.575425 | controller | Wednesday 25 February 2026 10:35:50 +0000 (0:00:00.182) 0:01:31.123 **** 2026-02-25 10:36:19.575436 | controller | changed: [instance] 2026-02-25 10:36:19.765490 | controller | 2026-02-25 10:36:19.765508 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-25 10:36:19.765515 | controller | Wednesday 25 February 2026 10:36:19 +0000 (0:00:29.552) 0:02:00.675 **** 2026-02-25 10:36:19.765523 | controller | ok: [instance] 2026-02-25 10:36:19.804798 | controller | 2026-02-25 10:36:19.804814 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-25 10:36:19.804821 | controller | Wednesday 25 February 2026 10:36:19 +0000 (0:00:00.190) 0:02:00.866 **** 2026-02-25 10:36:19.804829 | controller | ok: [instance] => changed=false 2026-02-25 10:36:20.003180 | controller | msg: All assertions passed 2026-02-25 10:36:20.003205 | controller | 2026-02-25 10:36:20.003212 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-25 10:36:20.003218 | controller | Wednesday 25 February 2026 10:36:19 +0000 (0:00:00.039) 0:02:00.905 **** 2026-02-25 10:36:20.003227 | controller | changed: [instance] 2026-02-25 10:36:20.199312 | controller | 2026-02-25 10:36:20.199355 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-25 10:36:20.199369 | controller | Wednesday 25 February 2026 10:36:20 +0000 (0:00:00.198) 0:02:01.103 **** 2026-02-25 10:36:20.199386 | controller | ok: [instance] 2026-02-25 10:36:20.386699 | controller | 2026-02-25 10:36:20.386730 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-25 10:36:20.386739 | controller | Wednesday 25 February 2026 10:36:20 +0000 (0:00:00.196) 0:02:01.299 **** 2026-02-25 10:36:20.386750 | controller | ok: [instance] 2026-02-25 10:36:20.408076 | controller | 2026-02-25 10:36:20.408099 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-25 10:36:20.408108 | controller | Wednesday 25 February 2026 10:36:20 +0000 (0:00:00.187) 0:02:01.487 **** 2026-02-25 10:36:20.408119 | controller | skipping: [instance] 2026-02-25 10:36:20.597111 | controller | 2026-02-25 10:36:20.597132 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-25 10:36:20.597142 | controller | Wednesday 25 February 2026 10:36:20 +0000 (0:00:00.021) 0:02:01.508 **** 2026-02-25 10:36:20.597166 | controller | ok: [instance] 2026-02-25 10:36:20.637884 | controller | 2026-02-25 10:36:20.637901 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-25 10:36:20.637908 | controller | Wednesday 25 February 2026 10:36:20 +0000 (0:00:00.189) 0:02:01.697 **** 2026-02-25 10:36:20.637916 | controller | ok: [instance] => changed=false 2026-02-25 10:36:20.840301 | controller | msg: All assertions passed 2026-02-25 10:36:20.840337 | controller | 2026-02-25 10:36:20.840347 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-25 10:36:20.840355 | controller | Wednesday 25 February 2026 10:36:20 +0000 (0:00:00.040) 0:02:01.738 **** 2026-02-25 10:36:20.840367 | controller | ok: [instance] 2026-02-25 10:36:20.840387 | controller | 2026-02-25 10:36:20.840410 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2026-02-25 10:36:21.013440 | controller | Wednesday 25 February 2026 10:36:20 +0000 (0:00:00.202) 0:02:01.941 **** 2026-02-25 10:36:21.013478 | controller | ok: [instance] 2026-02-25 10:36:21.386540 | controller | 2026-02-25 10:36:21.386568 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2026-02-25 10:36:21.386590 | controller | Wednesday 25 February 2026 10:36:21 +0000 (0:00:00.172) 0:02:02.113 **** 2026-02-25 10:36:21.386600 | controller | changed: [instance] 2026-02-25 10:36:21.386618 | controller | 2026-02-25 10:36:21.386696 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2026-02-25 10:36:21.386835 | controller | Wednesday 25 February 2026 10:36:21 +0000 (0:00:00.373) 0:02:02.487 **** 2026-02-25 10:36:21.557298 | controller | ok: [instance] 2026-02-25 10:36:21.557345 | controller | 2026-02-25 10:36:21.557357 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2026-02-25 10:36:21.557501 | controller | Wednesday 25 February 2026 10:36:21 +0000 (0:00:00.170) 0:02:02.658 **** 2026-02-25 10:36:21.725037 | controller | ok: [instance] 2026-02-25 10:36:22.100290 | controller | 2026-02-25 10:36:22.100329 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2026-02-25 10:36:22.100340 | controller | Wednesday 25 February 2026 10:36:21 +0000 (0:00:00.167) 0:02:02.825 **** 2026-02-25 10:36:22.100353 | controller | changed: [instance] 2026-02-25 10:36:22.120549 | controller | 2026-02-25 10:36:22.120573 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2026-02-25 10:36:22.120580 | controller | Wednesday 25 February 2026 10:36:22 +0000 (0:00:00.375) 0:02:03.201 **** 2026-02-25 10:36:22.120589 | controller | ok: [instance] 2026-02-25 10:36:22.329782 | controller | 2026-02-25 10:36:22.329809 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2026-02-25 10:36:22.329817 | controller | Wednesday 25 February 2026 10:36:22 +0000 (0:00:00.020) 0:02:03.221 **** 2026-02-25 10:36:22.329827 | controller | ok: [instance] 2026-02-25 10:36:22.766328 | controller | 2026-02-25 10:36:22.766373 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2026-02-25 10:36:22.766383 | controller | Wednesday 25 February 2026 10:36:22 +0000 (0:00:00.208) 0:02:03.430 **** 2026-02-25 10:36:22.766410 | controller | ok: [instance] 2026-02-25 10:36:22.879351 | controller | 2026-02-25 10:36:22.879388 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2026-02-25 10:36:22.879412 | controller | Wednesday 25 February 2026 10:36:22 +0000 (0:00:00.436) 0:02:03.866 **** 2026-02-25 10:36:22.879425 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-25 10:36:22.879457 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-25 10:36:22.879467 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-25 10:36:22.879674 | controller | 2026-02-25 10:36:22.879699 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2026-02-25 10:36:23.118259 | controller | Wednesday 25 February 2026 10:36:22 +0000 (0:00:00.113) 0:02:03.979 **** 2026-02-25 10:36:23.118298 | controller | changed: [instance] 2026-02-25 10:36:23.118329 | controller | 2026-02-25 10:36:23.118338 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2026-02-25 10:36:23.118440 | controller | Wednesday 25 February 2026 10:36:23 +0000 (0:00:00.239) 0:02:04.219 **** 2026-02-25 10:36:23.329230 | controller | changed: [instance] 2026-02-25 10:36:23.329273 | controller | 2026-02-25 10:36:23.329285 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2026-02-25 10:36:23.329436 | controller | Wednesday 25 February 2026 10:36:23 +0000 (0:00:00.210) 0:02:04.429 **** 2026-02-25 10:36:23.609091 | controller | changed: [instance] 2026-02-25 10:36:23.638698 | controller | 2026-02-25 10:36:23.638717 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2026-02-25 10:36:23.638725 | controller | Wednesday 25 February 2026 10:36:23 +0000 (0:00:00.279) 0:02:04.709 **** 2026-02-25 10:36:23.638738 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-25 10:36:23.682304 | controller | 2026-02-25 10:36:23.682346 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-25 10:36:23.682358 | controller | Wednesday 25 February 2026 10:36:23 +0000 (0:00:00.029) 0:02:04.739 **** 2026-02-25 10:36:23.682372 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-25 10:36:23.682421 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-25 10:36:23.682441 | controller | 2026-02-25 10:36:23.682707 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 10:36:23.903092 | controller | Wednesday 25 February 2026 10:36:23 +0000 (0:00:00.043) 0:02:04.782 **** 2026-02-25 10:36:23.903128 | controller | ok: [instance] 2026-02-25 10:36:23.946981 | controller | 2026-02-25 10:36:23.947001 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 10:36:23.947009 | controller | Wednesday 25 February 2026 10:36:23 +0000 (0:00:00.220) 0:02:05.003 **** 2026-02-25 10:36:23.947019 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 10:36:24.175319 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 10:36:24.175374 | controller | 2026-02-25 10:36:24.175388 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 10:36:24.175414 | controller | Wednesday 25 February 2026 10:36:23 +0000 (0:00:00.043) 0:02:05.047 **** 2026-02-25 10:36:24.175431 | controller | ok: [instance] 2026-02-25 10:36:24.363195 | controller | 2026-02-25 10:36:24.363213 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 10:36:24.363220 | controller | Wednesday 25 February 2026 10:36:24 +0000 (0:00:00.227) 0:02:05.275 **** 2026-02-25 10:36:24.363229 | controller | ok: [instance] 2026-02-25 10:36:24.363526 | controller | 2026-02-25 10:36:24.675842 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2026-02-25 10:36:24.675872 | controller | Wednesday 25 February 2026 10:36:24 +0000 (0:00:00.188) 0:02:05.464 **** 2026-02-25 10:36:24.675884 | controller | changed: [instance] 2026-02-25 10:36:24.892017 | controller | 2026-02-25 10:36:24.892043 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 10:36:24.892050 | controller | Wednesday 25 February 2026 10:36:24 +0000 (0:00:00.312) 0:02:05.776 **** 2026-02-25 10:36:24.892060 | controller | ok: [instance] 2026-02-25 10:36:24.934205 | controller | 2026-02-25 10:36:24.934229 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 10:36:24.934237 | controller | Wednesday 25 February 2026 10:36:24 +0000 (0:00:00.216) 0:02:05.992 **** 2026-02-25 10:36:24.934246 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 10:36:24.934336 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 10:36:24.934379 | controller | 2026-02-25 10:36:24.934412 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 10:36:24.934432 | controller | Wednesday 25 February 2026 10:36:24 +0000 (0:00:00.042) 0:02:06.034 **** 2026-02-25 10:36:25.174608 | controller | ok: [instance] 2026-02-25 10:36:25.368769 | controller | 2026-02-25 10:36:25.368797 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 10:36:25.368805 | controller | Wednesday 25 February 2026 10:36:25 +0000 (0:00:00.240) 0:02:06.275 **** 2026-02-25 10:36:25.368815 | controller | ok: [instance] 2026-02-25 10:36:25.641788 | controller | 2026-02-25 10:36:25.641817 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2026-02-25 10:36:25.641826 | controller | Wednesday 25 February 2026 10:36:25 +0000 (0:00:00.194) 0:02:06.469 **** 2026-02-25 10:36:25.641839 | controller | changed: [instance] 2026-02-25 10:36:25.662250 | controller | 2026-02-25 10:36:25.662276 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2026-02-25 10:36:25.662287 | controller | Wednesday 25 February 2026 10:36:25 +0000 (0:00:00.272) 0:02:06.742 **** 2026-02-25 10:36:25.662299 | controller | skipping: [instance] 2026-02-25 10:36:25.662335 | controller | 2026-02-25 10:36:25.662345 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2026-02-25 10:36:25.662460 | controller | Wednesday 25 February 2026 10:36:25 +0000 (0:00:00.020) 0:02:06.762 **** 2026-02-25 10:36:25.689123 | controller | skipping: [instance] 2026-02-25 10:36:25.718341 | controller | 2026-02-25 10:36:25.718374 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2026-02-25 10:36:25.718404 | controller | Wednesday 25 February 2026 10:36:25 +0000 (0:00:00.026) 0:02:06.789 **** 2026-02-25 10:36:25.718422 | controller | skipping: [instance] 2026-02-25 10:36:25.718583 | controller | 2026-02-25 10:36:25.718602 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2026-02-25 10:36:25.745106 | controller | Wednesday 25 February 2026 10:36:25 +0000 (0:00:00.028) 0:02:06.818 **** 2026-02-25 10:36:25.745132 | controller | skipping: [instance] 2026-02-25 10:36:25.954457 | controller | 2026-02-25 10:36:25.954482 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-25 10:36:25.954495 | controller | Wednesday 25 February 2026 10:36:25 +0000 (0:00:00.026) 0:02:06.845 **** 2026-02-25 10:36:25.954505 | controller | changed: [instance] 2026-02-25 10:36:25.989955 | controller | 2026-02-25 10:36:25.989981 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-25 10:36:25.989988 | controller | Wednesday 25 February 2026 10:36:25 +0000 (0:00:00.209) 0:02:07.055 **** 2026-02-25 10:36:25.989996 | controller | ok: [instance] 2026-02-25 10:36:26.042607 | controller | 2026-02-25 10:36:26.042631 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-25 10:36:26.042640 | controller | Wednesday 25 February 2026 10:36:25 +0000 (0:00:00.035) 0:02:07.090 **** 2026-02-25 10:36:26.042654 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-25 10:36:26.229559 | controller | 2026-02-25 10:36:26.229578 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-25 10:36:26.229585 | controller | Wednesday 25 February 2026 10:36:26 +0000 (0:00:00.052) 0:02:07.143 **** 2026-02-25 10:36:26.229593 | controller | ok: [instance] 2026-02-25 10:36:26.288351 | controller | 2026-02-25 10:36:26.288414 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-25 10:36:26.288428 | controller | Wednesday 25 February 2026 10:36:26 +0000 (0:00:00.187) 0:02:07.330 **** 2026-02-25 10:36:26.288445 | controller | ok: [instance] 2026-02-25 10:36:26.288486 | controller | 2026-02-25 10:36:26.288500 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-25 10:36:26.288536 | controller | Wednesday 25 February 2026 10:36:26 +0000 (0:00:00.058) 0:02:07.389 **** 2026-02-25 10:36:26.332892 | controller | ok: [instance] 2026-02-25 10:36:26.374977 | controller | 2026-02-25 10:36:26.375011 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-25 10:36:26.375025 | controller | Wednesday 25 February 2026 10:36:26 +0000 (0:00:00.044) 0:02:07.433 **** 2026-02-25 10:36:26.375040 | controller | skipping: [instance] 2026-02-25 10:36:26.375330 | controller | 2026-02-25 10:36:26.375605 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-25 10:36:26.375779 | controller | Wednesday 25 February 2026 10:36:26 +0000 (0:00:00.042) 0:02:07.475 **** 2026-02-25 10:36:26.417044 | controller | skipping: [instance] 2026-02-25 10:36:26.417348 | controller | 2026-02-25 10:36:26.417623 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-25 10:36:26.417871 | controller | Wednesday 25 February 2026 10:36:26 +0000 (0:00:00.042) 0:02:07.517 **** 2026-02-25 10:36:26.476605 | controller | 2026-02-25 10:36:26.476907 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-25 10:36:26.477087 | controller | Wednesday 25 February 2026 10:36:26 +0000 (0:00:00.059) 0:02:07.577 **** 2026-02-25 10:36:26.858906 | controller | ok: [instance] => (item=artifacts) 2026-02-25 10:36:28.039280 | controller | ok: [instance] => (item=logs) 2026-02-25 10:36:28.039312 | controller | 2026-02-25 10:36:28.039320 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-25 10:36:28.039332 | controller | Wednesday 25 February 2026 10:36:26 +0000 (0:00:00.381) 0:02:07.959 **** 2026-02-25 10:36:28.039342 | controller | ok: [instance] 2026-02-25 10:36:28.039359 | controller | 2026-02-25 10:36:28.039367 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-25 10:36:28.039409 | controller | Wednesday 25 February 2026 10:36:28 +0000 (0:00:01.179) 0:02:09.139 **** 2026-02-25 10:36:28.260699 | controller | changed: [instance] 2026-02-25 10:36:28.638008 | controller | 2026-02-25 10:36:28.638038 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-25 10:36:28.638046 | controller | Wednesday 25 February 2026 10:36:28 +0000 (0:00:00.221) 0:02:09.361 **** 2026-02-25 10:36:28.638056 | controller | changed: [instance] 2026-02-25 10:36:29.019911 | controller | 2026-02-25 10:36:29.019944 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-25 10:36:29.019952 | controller | Wednesday 25 February 2026 10:36:28 +0000 (0:00:00.377) 0:02:09.738 **** 2026-02-25 10:36:29.019962 | controller | changed: [instance] 2026-02-25 10:36:29.074109 | controller | 2026-02-25 10:36:29.074132 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-25 10:36:29.074141 | controller | Wednesday 25 February 2026 10:36:29 +0000 (0:00:00.381) 0:02:10.119 **** 2026-02-25 10:36:29.074171 | controller | skipping: [instance] 2026-02-25 10:36:29.280860 | controller | 2026-02-25 10:36:29.280883 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-25 10:36:29.280892 | controller | Wednesday 25 February 2026 10:36:29 +0000 (0:00:00.054) 0:02:10.174 **** 2026-02-25 10:36:29.280907 | controller | ok: [instance] 2026-02-25 10:36:29.331304 | controller | 2026-02-25 10:36:29.331326 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-25 10:36:29.331334 | controller | Wednesday 25 February 2026 10:36:29 +0000 (0:00:00.206) 0:02:10.381 **** 2026-02-25 10:36:29.331342 | controller | skipping: [instance] 2026-02-25 10:36:29.574572 | controller | 2026-02-25 10:36:29.574622 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-25 10:36:29.574637 | controller | Wednesday 25 February 2026 10:36:29 +0000 (0:00:00.050) 0:02:10.431 **** 2026-02-25 10:36:29.574655 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2026-02-25 10:36:29.574688 | controller | changed: [instance] 2026-02-25 10:36:29.574875 | controller | 2026-02-25 10:36:29.574905 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-25 10:36:29.867910 | controller | Wednesday 25 February 2026 10:36:29 +0000 (0:00:00.243) 0:02:10.675 **** 2026-02-25 10:36:29.867943 | controller | changed: [instance] 2026-02-25 10:36:29.921682 | controller | 2026-02-25 10:36:29.921699 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-25 10:36:29.921706 | controller | Wednesday 25 February 2026 10:36:29 +0000 (0:00:00.292) 0:02:10.967 **** 2026-02-25 10:36:29.921714 | controller | skipping: [instance] 2026-02-25 10:36:29.951289 | controller | 2026-02-25 10:36:29.951363 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2026-02-25 10:36:29.951377 | controller | Wednesday 25 February 2026 10:36:29 +0000 (0:00:00.054) 0:02:11.022 **** 2026-02-25 10:36:29.951414 | controller | skipping: [instance] 2026-02-25 10:36:30.190784 | controller | 2026-02-25 10:36:30.190819 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2026-02-25 10:36:30.190831 | controller | Wednesday 25 February 2026 10:36:29 +0000 (0:00:00.029) 0:02:11.051 **** 2026-02-25 10:36:30.190844 | controller | changed: [instance] 2026-02-25 10:36:30.410623 | controller | 2026-02-25 10:36:30.410642 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2026-02-25 10:36:30.410649 | controller | Wednesday 25 February 2026 10:36:30 +0000 (0:00:00.239) 0:02:11.291 **** 2026-02-25 10:36:30.410657 | controller | changed: [instance] 2026-02-25 10:36:30.706435 | controller | 2026-02-25 10:36:30.706498 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2026-02-25 10:36:30.706512 | controller | Wednesday 25 February 2026 10:36:30 +0000 (0:00:00.219) 0:02:11.510 **** 2026-02-25 10:36:30.706543 | controller | changed: [instance] 2026-02-25 10:36:30.706592 | controller | 2026-02-25 10:36:30.706608 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2026-02-25 10:36:30.736379 | controller | Wednesday 25 February 2026 10:36:30 +0000 (0:00:00.295) 0:02:11.806 **** 2026-02-25 10:36:30.736467 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-25 10:36:30.782214 | controller | 2026-02-25 10:36:30.782230 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-25 10:36:30.782237 | controller | Wednesday 25 February 2026 10:36:30 +0000 (0:00:00.030) 0:02:11.836 **** 2026-02-25 10:36:30.782246 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-25 10:36:31.020097 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-25 10:36:31.020133 | controller | 2026-02-25 10:36:31.020173 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 10:36:31.020190 | controller | Wednesday 25 February 2026 10:36:30 +0000 (0:00:00.045) 0:02:11.882 **** 2026-02-25 10:36:31.020206 | controller | ok: [instance] 2026-02-25 10:36:31.065357 | controller | 2026-02-25 10:36:31.065418 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 10:36:31.065430 | controller | Wednesday 25 February 2026 10:36:31 +0000 (0:00:00.237) 0:02:12.120 **** 2026-02-25 10:36:31.065445 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 10:36:31.065493 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 10:36:31.065793 | controller | 2026-02-25 10:36:31.290916 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 10:36:31.290939 | controller | Wednesday 25 February 2026 10:36:31 +0000 (0:00:00.045) 0:02:12.165 **** 2026-02-25 10:36:31.290949 | controller | ok: [instance] 2026-02-25 10:36:31.487008 | controller | 2026-02-25 10:36:31.487043 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 10:36:31.487056 | controller | Wednesday 25 February 2026 10:36:31 +0000 (0:00:00.225) 0:02:12.391 **** 2026-02-25 10:36:31.487072 | controller | ok: [instance] 2026-02-25 10:36:31.782917 | controller | 2026-02-25 10:36:31.782956 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2026-02-25 10:36:31.782967 | controller | Wednesday 25 February 2026 10:36:31 +0000 (0:00:00.195) 0:02:12.587 **** 2026-02-25 10:36:31.782981 | controller | changed: [instance] 2026-02-25 10:36:32.016397 | controller | 2026-02-25 10:36:32.016423 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 10:36:32.016431 | controller | Wednesday 25 February 2026 10:36:31 +0000 (0:00:00.295) 0:02:12.883 **** 2026-02-25 10:36:32.016440 | controller | ok: [instance] 2026-02-25 10:36:32.062260 | controller | 2026-02-25 10:36:32.062304 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 10:36:32.062315 | controller | Wednesday 25 February 2026 10:36:32 +0000 (0:00:00.233) 0:02:13.117 **** 2026-02-25 10:36:32.062330 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 10:36:32.062365 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 10:36:32.062654 | controller | 2026-02-25 10:36:32.295072 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 10:36:32.295095 | controller | Wednesday 25 February 2026 10:36:32 +0000 (0:00:00.045) 0:02:13.162 **** 2026-02-25 10:36:32.295106 | controller | ok: [instance] 2026-02-25 10:36:32.494724 | controller | 2026-02-25 10:36:32.494742 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 10:36:32.494750 | controller | Wednesday 25 February 2026 10:36:32 +0000 (0:00:00.232) 0:02:13.395 **** 2026-02-25 10:36:32.494758 | controller | ok: [instance] 2026-02-25 10:36:32.797942 | controller | 2026-02-25 10:36:32.797970 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2026-02-25 10:36:32.797978 | controller | Wednesday 25 February 2026 10:36:32 +0000 (0:00:00.199) 0:02:13.595 **** 2026-02-25 10:36:32.797990 | controller | changed: [instance] 2026-02-25 10:36:32.820347 | controller | 2026-02-25 10:36:32.820404 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2026-02-25 10:36:32.820417 | controller | Wednesday 25 February 2026 10:36:32 +0000 (0:00:00.303) 0:02:13.898 **** 2026-02-25 10:36:32.820431 | controller | skipping: [instance] 2026-02-25 10:36:32.848411 | controller | 2026-02-25 10:36:32.848458 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2026-02-25 10:36:32.848472 | controller | Wednesday 25 February 2026 10:36:32 +0000 (0:00:00.022) 0:02:13.921 **** 2026-02-25 10:36:32.848488 | controller | skipping: [instance] 2026-02-25 10:36:32.848532 | controller | 2026-02-25 10:36:32.848545 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2026-02-25 10:36:32.848637 | controller | Wednesday 25 February 2026 10:36:32 +0000 (0:00:00.028) 0:02:13.949 **** 2026-02-25 10:36:32.876260 | controller | skipping: [instance] 2026-02-25 10:36:32.876364 | controller | 2026-02-25 10:36:32.876402 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2026-02-25 10:36:32.876418 | controller | Wednesday 25 February 2026 10:36:32 +0000 (0:00:00.027) 0:02:13.976 **** 2026-02-25 10:36:32.902240 | controller | skipping: [instance] 2026-02-25 10:36:32.902622 | controller | 2026-02-25 10:36:33.139023 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-25 10:36:33.139059 | controller | Wednesday 25 February 2026 10:36:32 +0000 (0:00:00.026) 0:02:14.003 **** 2026-02-25 10:36:33.139077 | controller | changed: [instance] 2026-02-25 10:36:33.175770 | controller | 2026-02-25 10:36:33.175802 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-25 10:36:33.175816 | controller | Wednesday 25 February 2026 10:36:33 +0000 (0:00:00.236) 0:02:14.239 **** 2026-02-25 10:36:33.175832 | controller | ok: [instance] 2026-02-25 10:36:33.228891 | controller | 2026-02-25 10:36:33.228908 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-25 10:36:33.228915 | controller | Wednesday 25 February 2026 10:36:33 +0000 (0:00:00.036) 0:02:14.276 **** 2026-02-25 10:36:33.228923 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-25 10:36:33.421870 | controller | 2026-02-25 10:36:33.421891 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-25 10:36:33.421900 | controller | Wednesday 25 February 2026 10:36:33 +0000 (0:00:00.053) 0:02:14.329 **** 2026-02-25 10:36:33.421910 | controller | ok: [instance] 2026-02-25 10:36:33.482336 | controller | 2026-02-25 10:36:33.482403 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-25 10:36:33.482419 | controller | Wednesday 25 February 2026 10:36:33 +0000 (0:00:00.193) 0:02:14.522 **** 2026-02-25 10:36:33.482437 | controller | ok: [instance] 2026-02-25 10:36:33.539446 | controller | 2026-02-25 10:36:33.539487 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-25 10:36:33.539501 | controller | Wednesday 25 February 2026 10:36:33 +0000 (0:00:00.060) 0:02:14.582 **** 2026-02-25 10:36:33.539519 | controller | ok: [instance] 2026-02-25 10:36:33.539640 | controller | 2026-02-25 10:36:33.539894 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-25 10:36:33.540132 | controller | Wednesday 25 February 2026 10:36:33 +0000 (0:00:00.057) 0:02:14.640 **** 2026-02-25 10:36:33.689526 | controller | skipping: [instance] 2026-02-25 10:36:33.689662 | controller | 2026-02-25 10:36:33.689762 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-25 10:36:33.689862 | controller | Wednesday 25 February 2026 10:36:33 +0000 (0:00:00.149) 0:02:14.790 **** 2026-02-25 10:36:33.738570 | controller | skipping: [instance] 2026-02-25 10:36:33.738782 | controller | 2026-02-25 10:36:33.738936 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-25 10:36:33.739034 | controller | Wednesday 25 February 2026 10:36:33 +0000 (0:00:00.049) 0:02:14.839 **** 2026-02-25 10:36:33.799427 | controller | 2026-02-25 10:36:33.799674 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-25 10:36:33.799849 | controller | Wednesday 25 February 2026 10:36:33 +0000 (0:00:00.060) 0:02:14.900 **** 2026-02-25 10:36:34.244594 | controller | ok: [instance] => (item=artifacts) 2026-02-25 10:36:35.433998 | controller | ok: [instance] => (item=logs) 2026-02-25 10:36:35.434037 | controller | 2026-02-25 10:36:35.434045 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-25 10:36:35.434051 | controller | Wednesday 25 February 2026 10:36:34 +0000 (0:00:00.444) 0:02:15.345 **** 2026-02-25 10:36:35.434060 | controller | ok: [instance] 2026-02-25 10:36:35.645318 | controller | 2026-02-25 10:36:35.645347 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-25 10:36:35.645356 | controller | Wednesday 25 February 2026 10:36:35 +0000 (0:00:01.189) 0:02:16.534 **** 2026-02-25 10:36:35.645366 | controller | changed: [instance] 2026-02-25 10:36:36.013082 | controller | 2026-02-25 10:36:36.013115 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-25 10:36:36.013129 | controller | Wednesday 25 February 2026 10:36:35 +0000 (0:00:00.211) 0:02:16.745 **** 2026-02-25 10:36:36.013145 | controller | changed: [instance] 2026-02-25 10:36:36.391393 | controller | 2026-02-25 10:36:36.391412 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-25 10:36:36.391419 | controller | Wednesday 25 February 2026 10:36:36 +0000 (0:00:00.367) 0:02:17.113 **** 2026-02-25 10:36:36.391427 | controller | changed: [instance] 2026-02-25 10:36:36.439123 | controller | 2026-02-25 10:36:36.439181 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-25 10:36:36.439200 | controller | Wednesday 25 February 2026 10:36:36 +0000 (0:00:00.378) 0:02:17.492 **** 2026-02-25 10:36:36.439217 | controller | skipping: [instance] 2026-02-25 10:36:36.646521 | controller | 2026-02-25 10:36:36.646539 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-25 10:36:36.646545 | controller | Wednesday 25 February 2026 10:36:36 +0000 (0:00:00.047) 0:02:17.539 **** 2026-02-25 10:36:36.646554 | controller | ok: [instance] 2026-02-25 10:36:36.689020 | controller | 2026-02-25 10:36:36.689052 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-25 10:36:36.689066 | controller | Wednesday 25 February 2026 10:36:36 +0000 (0:00:00.207) 0:02:17.747 **** 2026-02-25 10:36:36.689081 | controller | skipping: [instance] 2026-02-25 10:36:36.923992 | controller | 2026-02-25 10:36:36.924012 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-25 10:36:36.924019 | controller | Wednesday 25 February 2026 10:36:36 +0000 (0:00:00.042) 0:02:17.789 **** 2026-02-25 10:36:36.924028 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2026-02-25 10:36:37.211341 | controller | changed: [instance] 2026-02-25 10:36:37.211481 | controller | 2026-02-25 10:36:37.211498 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-25 10:36:37.211510 | controller | Wednesday 25 February 2026 10:36:36 +0000 (0:00:00.235) 0:02:18.024 **** 2026-02-25 10:36:37.211538 | controller | changed: [instance] 2026-02-25 10:36:37.259368 | controller | 2026-02-25 10:36:37.259450 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-25 10:36:37.259465 | controller | Wednesday 25 February 2026 10:36:37 +0000 (0:00:00.287) 0:02:18.311 **** 2026-02-25 10:36:37.259485 | controller | skipping: [instance] 2026-02-25 10:36:37.288070 | controller | 2026-02-25 10:36:37.288096 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2026-02-25 10:36:37.288105 | controller | Wednesday 25 February 2026 10:36:37 +0000 (0:00:00.048) 0:02:18.359 **** 2026-02-25 10:36:37.288116 | controller | skipping: [instance] 2026-02-25 10:36:37.533645 | controller | 2026-02-25 10:36:37.533680 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2026-02-25 10:36:37.533695 | controller | Wednesday 25 February 2026 10:36:37 +0000 (0:00:00.028) 0:02:18.388 **** 2026-02-25 10:36:37.533708 | controller | changed: [instance] 2026-02-25 10:36:37.761214 | controller | 2026-02-25 10:36:37.761263 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2026-02-25 10:36:37.761277 | controller | Wednesday 25 February 2026 10:36:37 +0000 (0:00:00.245) 0:02:18.634 **** 2026-02-25 10:36:37.761291 | controller | changed: [instance] 2026-02-25 10:36:38.064863 | controller | 2026-02-25 10:36:38.064893 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2026-02-25 10:36:38.064902 | controller | Wednesday 25 February 2026 10:36:37 +0000 (0:00:00.227) 0:02:18.861 **** 2026-02-25 10:36:38.064912 | controller | changed: [instance] 2026-02-25 10:36:38.093932 | controller | 2026-02-25 10:36:38.093954 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2026-02-25 10:36:38.093963 | controller | Wednesday 25 February 2026 10:36:38 +0000 (0:00:00.303) 0:02:19.165 **** 2026-02-25 10:36:38.093974 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-25 10:36:38.139289 | controller | 2026-02-25 10:36:38.139327 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-25 10:36:38.139335 | controller | Wednesday 25 February 2026 10:36:38 +0000 (0:00:00.029) 0:02:19.194 **** 2026-02-25 10:36:38.139347 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-25 10:36:38.367268 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-25 10:36:38.367299 | controller | 2026-02-25 10:36:38.367307 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 10:36:38.367313 | controller | Wednesday 25 February 2026 10:36:38 +0000 (0:00:00.045) 0:02:19.239 **** 2026-02-25 10:36:38.367323 | controller | ok: [instance] 2026-02-25 10:36:38.412708 | controller | 2026-02-25 10:36:38.412726 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 10:36:38.412733 | controller | Wednesday 25 February 2026 10:36:38 +0000 (0:00:00.227) 0:02:19.467 **** 2026-02-25 10:36:38.412742 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 10:36:38.644547 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 10:36:38.644576 | controller | 2026-02-25 10:36:38.644584 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 10:36:38.644591 | controller | Wednesday 25 February 2026 10:36:38 +0000 (0:00:00.045) 0:02:19.513 **** 2026-02-25 10:36:38.644600 | controller | ok: [instance] 2026-02-25 10:36:38.846822 | controller | 2026-02-25 10:36:38.846854 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 10:36:38.846864 | controller | Wednesday 25 February 2026 10:36:38 +0000 (0:00:00.231) 0:02:19.744 **** 2026-02-25 10:36:38.846876 | controller | ok: [instance] 2026-02-25 10:36:39.121921 | controller | 2026-02-25 10:36:39.121949 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2026-02-25 10:36:39.121958 | controller | Wednesday 25 February 2026 10:36:38 +0000 (0:00:00.202) 0:02:19.947 **** 2026-02-25 10:36:39.121968 | controller | changed: [instance] 2026-02-25 10:36:39.353742 | controller | 2026-02-25 10:36:39.353768 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 10:36:39.353775 | controller | Wednesday 25 February 2026 10:36:39 +0000 (0:00:00.275) 0:02:20.222 **** 2026-02-25 10:36:39.353785 | controller | ok: [instance] 2026-02-25 10:36:39.398085 | controller | 2026-02-25 10:36:39.398117 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 10:36:39.398130 | controller | Wednesday 25 February 2026 10:36:39 +0000 (0:00:00.232) 0:02:20.454 **** 2026-02-25 10:36:39.398179 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 10:36:39.618886 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 10:36:39.618906 | controller | 2026-02-25 10:36:39.618913 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 10:36:39.618919 | controller | Wednesday 25 February 2026 10:36:39 +0000 (0:00:00.043) 0:02:20.498 **** 2026-02-25 10:36:39.618928 | controller | ok: [instance] 2026-02-25 10:36:39.816252 | controller | 2026-02-25 10:36:39.816282 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 10:36:39.816291 | controller | Wednesday 25 February 2026 10:36:39 +0000 (0:00:00.221) 0:02:20.719 **** 2026-02-25 10:36:39.816301 | controller | ok: [instance] 2026-02-25 10:36:39.816326 | controller | 2026-02-25 10:36:39.816335 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2026-02-25 10:36:39.816423 | controller | Wednesday 25 February 2026 10:36:39 +0000 (0:00:00.197) 0:02:20.917 **** 2026-02-25 10:36:40.094814 | controller | changed: [instance] 2026-02-25 10:36:40.116616 | controller | 2026-02-25 10:36:40.116639 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2026-02-25 10:36:40.116649 | controller | Wednesday 25 February 2026 10:36:40 +0000 (0:00:00.278) 0:02:21.195 **** 2026-02-25 10:36:40.116666 | controller | skipping: [instance] 2026-02-25 10:36:40.145240 | controller | 2026-02-25 10:36:40.145262 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2026-02-25 10:36:40.145272 | controller | Wednesday 25 February 2026 10:36:40 +0000 (0:00:00.021) 0:02:21.217 **** 2026-02-25 10:36:40.145283 | controller | skipping: [instance] 2026-02-25 10:36:40.145316 | controller | 2026-02-25 10:36:40.145548 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2026-02-25 10:36:40.172248 | controller | Wednesday 25 February 2026 10:36:40 +0000 (0:00:00.028) 0:02:21.246 **** 2026-02-25 10:36:40.172274 | controller | skipping: [instance] 2026-02-25 10:36:40.172308 | controller | 2026-02-25 10:36:40.172677 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2026-02-25 10:36:40.197012 | controller | Wednesday 25 February 2026 10:36:40 +0000 (0:00:00.026) 0:02:21.273 **** 2026-02-25 10:36:40.197031 | controller | skipping: [instance] 2026-02-25 10:36:41.405010 | controller | 2026-02-25 10:36:41.405047 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-25 10:36:41.405057 | controller | Wednesday 25 February 2026 10:36:40 +0000 (0:00:00.024) 0:02:21.297 **** 2026-02-25 10:36:41.405070 | controller | changed: [instance] 2026-02-25 10:36:41.439787 | controller | 2026-02-25 10:36:41.439805 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-25 10:36:41.439813 | controller | Wednesday 25 February 2026 10:36:41 +0000 (0:00:01.207) 0:02:22.505 **** 2026-02-25 10:36:41.439821 | controller | ok: [instance] 2026-02-25 10:36:41.439955 | controller | 2026-02-25 10:36:41.440087 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-25 10:36:41.440240 | controller | Wednesday 25 February 2026 10:36:41 +0000 (0:00:00.035) 0:02:22.540 **** 2026-02-25 10:36:41.464590 | controller | skipping: [instance] 2026-02-25 10:36:41.464766 | controller | 2026-02-25 10:36:41.464943 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-25 10:36:41.465101 | controller | Wednesday 25 February 2026 10:36:41 +0000 (0:00:00.024) 0:02:22.565 **** 2026-02-25 10:36:41.488861 | controller | skipping: [instance] 2026-02-25 10:36:41.489022 | controller | 2026-02-25 10:36:41.489198 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-25 10:36:41.489335 | controller | Wednesday 25 February 2026 10:36:41 +0000 (0:00:00.024) 0:02:22.589 **** 2026-02-25 10:36:41.529721 | controller | skipping: [instance] 2026-02-25 10:36:41.529980 | controller | 2026-02-25 10:36:41.530264 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2026-02-25 10:36:41.530505 | controller | Wednesday 25 February 2026 10:36:41 +0000 (0:00:00.040) 0:02:22.630 **** 2026-02-25 10:36:41.553188 | controller | skipping: [instance] 2026-02-25 10:36:41.553488 | controller | 2026-02-25 10:36:41.553625 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2026-02-25 10:36:41.553744 | controller | Wednesday 25 February 2026 10:36:41 +0000 (0:00:00.023) 0:02:22.654 **** 2026-02-25 10:36:41.611071 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2026-02-25 10:36:41.611262 | controller | 2026-02-25 10:36:41.611449 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2026-02-25 10:36:41.611600 | controller | Wednesday 25 February 2026 10:36:41 +0000 (0:00:00.058) 0:02:22.712 **** 2026-02-25 10:36:41.835410 | controller | ok: [instance] => (item=crc) 2026-02-25 10:36:41.835679 | controller | 2026-02-25 10:36:41.835922 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2026-02-25 10:36:41.836088 | controller | Wednesday 25 February 2026 10:36:41 +0000 (0:00:00.224) 0:02:22.936 **** 2026-02-25 10:36:43.904324 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-25 10:36:43.904553 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-25 10:36:43.904719 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-25 10:36:43.904853 | controller | 2026-02-25 10:36:43.904977 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-25 10:36:43.905102 | controller | Wednesday 25 February 2026 10:36:43 +0000 (0:00:02.068) 0:02:25.005 **** 2026-02-25 10:36:44.722272 | controller | changed: [instance] 2026-02-25 10:36:44.722325 | controller | 2026-02-25 10:36:44.722335 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-25 10:36:44.722346 | controller | Wednesday 25 February 2026 10:36:44 +0000 (0:00:00.817) 0:02:25.822 **** 2026-02-25 10:36:45.464450 | controller | changed: [instance] 2026-02-25 10:36:45.464746 | controller | 2026-02-25 10:36:46.251386 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-25 10:36:46.251420 | controller | Wednesday 25 February 2026 10:36:45 +0000 (0:00:00.742) 0:02:26.564 **** 2026-02-25 10:36:46.251432 | controller | changed: [instance] 2026-02-25 10:36:46.967286 | controller | 2026-02-25 10:36:46.967317 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2026-02-25 10:36:46.967329 | controller | Wednesday 25 February 2026 10:36:46 +0000 (0:00:00.786) 0:02:27.351 **** 2026-02-25 10:36:46.967339 | controller | changed: [instance] => (item=compute-0.utility) 2026-02-25 10:37:09.827351 | controller | changed: [instance] => (item=controller-0.utility) 2026-02-25 10:37:09.827392 | controller | changed: [instance] => (item=crc-0.utility) 2026-02-25 10:37:09.827400 | controller | 2026-02-25 10:37:09.827406 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2026-02-25 10:37:09.827412 | controller | Wednesday 25 February 2026 10:36:46 +0000 (0:00:00.715) 0:02:28.067 **** 2026-02-25 10:37:09.827423 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-02-25 10:37:09.940755 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2026-02-25 10:37:09.940783 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2026-02-25 10:37:09.940791 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2026-02-25 10:37:09.940797 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2026-02-25 10:37:09.940802 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2026-02-25 10:37:09.940807 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). 2026-02-25 10:37:09.940813 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j360789040880.24381', 'results_file': '/home/zuul/.ansible_async/j360789040880.24381', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2026-02-25 10:37:09.940823 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j110032388787.24398', 'results_file': '/home/zuul/.ansible_async/j110032388787.24398', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2026-02-25 10:37:09.940829 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j156812209693.24414', 'results_file': '/home/zuul/.ansible_async/j156812209693.24414', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2026-02-25 10:37:09.940840 | controller | 2026-02-25 10:37:09.940845 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2026-02-25 10:37:09.940851 | controller | Wednesday 25 February 2026 10:37:09 +0000 (0:00:22.859) 0:02:50.926 **** 2026-02-25 10:37:09.940860 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-25 10:37:09.963944 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-25 10:37:09.963972 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-25 10:37:09.963980 | controller | 2026-02-25 10:37:09.963985 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-25 10:37:09.963991 | controller | Wednesday 25 February 2026 10:37:09 +0000 (0:00:00.114) 0:02:51.041 **** 2026-02-25 10:37:09.964000 | controller | skipping: [instance] 2026-02-25 10:37:10.003985 | controller | 2026-02-25 10:37:10.004004 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2026-02-25 10:37:10.004012 | controller | Wednesday 25 February 2026 10:37:09 +0000 (0:00:00.023) 0:02:51.064 **** 2026-02-25 10:37:10.004020 | controller | 2026-02-25 10:37:10.092940 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-25 10:37:10.092961 | controller | Wednesday 25 February 2026 10:37:10 +0000 (0:00:00.040) 0:02:51.104 **** 2026-02-25 10:37:10.092977 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-25 10:37:10.343177 | controller | 2026-02-25 10:37:10.343210 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-25 10:37:10.343218 | controller | Wednesday 25 February 2026 10:37:10 +0000 (0:00:00.088) 0:02:51.193 **** 2026-02-25 10:37:10.343228 | controller | changed: [instance] 2026-02-25 10:37:10.570012 | controller | 2026-02-25 10:37:10.570049 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-25 10:37:10.570057 | controller | Wednesday 25 February 2026 10:37:10 +0000 (0:00:00.247) 0:02:51.440 **** 2026-02-25 10:37:10.570067 | controller | changed: [instance] 2026-02-25 10:37:10.570085 | controller | 2026-02-25 10:37:10.570143 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2026-02-25 10:37:10.570249 | controller | Wednesday 25 February 2026 10:37:10 +0000 (0:00:00.229) 0:02:51.670 **** 2026-02-25 10:37:10.966458 | controller | changed: [instance] 2026-02-25 10:37:10.966513 | controller | 2026-02-25 10:37:10.966618 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2026-02-25 10:37:10.966745 | controller | Wednesday 25 February 2026 10:37:10 +0000 (0:00:00.396) 0:02:52.067 **** 2026-02-25 10:37:10.996222 | controller | skipping: [instance] 2026-02-25 10:37:11.028107 | controller | 2026-02-25 10:37:11.028130 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-25 10:37:11.028138 | controller | Wednesday 25 February 2026 10:37:10 +0000 (0:00:00.029) 0:02:52.096 **** 2026-02-25 10:37:11.028162 | controller | skipping: [instance] 2026-02-25 10:37:11.028196 | controller | 2026-02-25 10:37:11.028290 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2026-02-25 10:37:11.028384 | controller | Wednesday 25 February 2026 10:37:11 +0000 (0:00:00.032) 0:02:52.129 **** 2026-02-25 10:37:11.080795 | controller | skipping: [instance] 2026-02-25 10:37:11.080884 | controller | 2026-02-25 10:37:11.080980 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2026-02-25 10:37:11.081073 | controller | Wednesday 25 February 2026 10:37:11 +0000 (0:00:00.052) 0:02:52.181 **** 2026-02-25 10:37:11.133998 | controller | skipping: [instance] 2026-02-25 10:37:11.134114 | controller | 2026-02-25 10:37:11.134188 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-25 10:37:11.134277 | controller | Wednesday 25 February 2026 10:37:11 +0000 (0:00:00.053) 0:02:52.234 **** 2026-02-25 10:37:11.165255 | controller | skipping: [instance] 2026-02-25 10:37:11.165333 | controller | 2026-02-25 10:37:11.165440 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2026-02-25 10:37:11.165521 | controller | Wednesday 25 February 2026 10:37:11 +0000 (0:00:00.031) 0:02:52.266 **** 2026-02-25 10:37:11.209132 | controller | 2026-02-25 10:37:11.209262 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-25 10:37:11.209380 | controller | Wednesday 25 February 2026 10:37:11 +0000 (0:00:00.043) 0:02:52.310 **** 2026-02-25 10:37:11.300106 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-25 10:37:11.300174 | controller | 2026-02-25 10:37:11.300281 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-25 10:37:11.300376 | controller | Wednesday 25 February 2026 10:37:11 +0000 (0:00:00.090) 0:02:52.400 **** 2026-02-25 10:37:11.519683 | controller | ok: [instance] 2026-02-25 10:37:11.519945 | controller | 2026-02-25 10:37:11.740098 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-25 10:37:11.740134 | controller | Wednesday 25 February 2026 10:37:11 +0000 (0:00:00.219) 0:02:52.620 **** 2026-02-25 10:37:11.740168 | controller | ok: [instance] 2026-02-25 10:37:12.124882 | controller | 2026-02-25 10:37:12.124920 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2026-02-25 10:37:12.124928 | controller | Wednesday 25 February 2026 10:37:11 +0000 (0:00:00.220) 0:02:52.840 **** 2026-02-25 10:37:12.124939 | controller | changed: [instance] 2026-02-25 10:37:12.153646 | controller | 2026-02-25 10:37:12.153674 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2026-02-25 10:37:12.153682 | controller | Wednesday 25 February 2026 10:37:12 +0000 (0:00:00.384) 0:02:53.225 **** 2026-02-25 10:37:12.153693 | controller | skipping: [instance] 2026-02-25 10:37:12.185549 | controller | 2026-02-25 10:37:12.185584 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-25 10:37:12.185593 | controller | Wednesday 25 February 2026 10:37:12 +0000 (0:00:00.028) 0:02:53.254 **** 2026-02-25 10:37:12.185603 | controller | skipping: [instance] 2026-02-25 10:37:13.883683 | controller | 2026-02-25 10:37:13.883716 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2026-02-25 10:37:13.883724 | controller | Wednesday 25 February 2026 10:37:12 +0000 (0:00:00.031) 0:02:53.285 **** 2026-02-25 10:37:13.883733 | controller | changed: [instance -> controller-0.instance] 2026-02-25 10:37:14.906733 | controller | 2026-02-25 10:37:14.906767 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2026-02-25 10:37:14.906775 | controller | Wednesday 25 February 2026 10:37:13 +0000 (0:00:01.698) 0:02:54.984 **** 2026-02-25 10:37:14.906784 | controller | changed: [instance -> controller-0.instance] 2026-02-25 10:37:14.953244 | controller | 2026-02-25 10:37:14.953265 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-25 10:37:14.953272 | controller | Wednesday 25 February 2026 10:37:14 +0000 (0:00:01.022) 0:02:56.006 **** 2026-02-25 10:37:14.953281 | controller | 2026-02-25 10:37:14.953334 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-25 10:37:14.953449 | controller | Wednesday 25 February 2026 10:37:14 +0000 (0:00:00.047) 0:02:56.054 **** 2026-02-25 10:37:15.196710 | controller | ok: [instance] 2026-02-25 10:37:15.196761 | controller | 2026-02-25 10:37:15.196866 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-25 10:37:15.196961 | controller | Wednesday 25 February 2026 10:37:15 +0000 (0:00:00.243) 0:02:56.297 **** 2026-02-25 10:37:15.223472 | controller | ok: [instance] 2026-02-25 10:37:15.223552 | controller | 2026-02-25 10:37:15.223667 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-25 10:37:15.223753 | controller | Wednesday 25 February 2026 10:37:15 +0000 (0:00:00.027) 0:02:56.324 **** 2026-02-25 10:37:15.252889 | controller | skipping: [instance] 2026-02-25 10:37:15.252988 | controller | 2026-02-25 10:37:15.253094 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2026-02-25 10:37:15.253227 | controller | Wednesday 25 February 2026 10:37:15 +0000 (0:00:00.029) 0:02:56.353 **** 2026-02-25 10:37:15.298731 | controller | 2026-02-25 10:37:15.298826 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-25 10:37:15.298913 | controller | Wednesday 25 February 2026 10:37:15 +0000 (0:00:00.045) 0:02:56.399 **** 2026-02-25 10:37:15.376835 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2026-02-25 10:37:15.597948 | controller | 2026-02-25 10:37:15.597980 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-25 10:37:15.597987 | controller | Wednesday 25 February 2026 10:37:15 +0000 (0:00:00.077) 0:02:56.477 **** 2026-02-25 10:37:15.597997 | controller | ok: [instance] 2026-02-25 10:37:15.808475 | controller | 2026-02-25 10:37:15.808503 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-25 10:37:15.808512 | controller | Wednesday 25 February 2026 10:37:15 +0000 (0:00:00.221) 0:02:56.698 **** 2026-02-25 10:37:15.808523 | controller | ok: [instance] 2026-02-25 10:37:16.197561 | controller | 2026-02-25 10:37:16.197589 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2026-02-25 10:37:16.197601 | controller | Wednesday 25 February 2026 10:37:15 +0000 (0:00:00.210) 0:02:56.909 **** 2026-02-25 10:37:16.197611 | controller | changed: [instance] 2026-02-25 10:37:17.009358 | controller | 2026-02-25 10:37:17.009399 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2026-02-25 10:37:17.009408 | controller | Wednesday 25 February 2026 10:37:16 +0000 (0:00:00.387) 0:02:57.297 **** 2026-02-25 10:37:17.009419 | controller | changed: [instance] 2026-02-25 10:37:17.036288 | controller | 2026-02-25 10:37:17.036307 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-25 10:37:17.036315 | controller | Wednesday 25 February 2026 10:37:17 +0000 (0:00:00.811) 0:02:58.108 **** 2026-02-25 10:37:17.036323 | controller | skipping: [instance] 2026-02-25 10:37:17.080358 | controller | 2026-02-25 10:37:17.080395 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2026-02-25 10:37:17.080406 | controller | Wednesday 25 February 2026 10:37:17 +0000 (0:00:00.028) 0:02:58.137 **** 2026-02-25 10:37:17.080418 | controller | skipping: [instance] 2026-02-25 10:37:17.196795 | controller | 2026-02-25 10:37:17.196835 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2026-02-25 10:37:17.196846 | controller | Wednesday 25 February 2026 10:37:17 +0000 (0:00:00.043) 0:02:58.180 **** 2026-02-25 10:37:17.196859 | controller | skipping: [instance] 2026-02-25 10:37:17.248695 | controller | 2026-02-25 10:37:17.248720 | controller | TASK [Create VBMC entity] ****************************************************** 2026-02-25 10:37:17.248731 | controller | Wednesday 25 February 2026 10:37:17 +0000 (0:00:00.116) 0:02:58.297 **** 2026-02-25 10:37:17.248750 | controller | skipping: [instance] => (item=compute-0) 2026-02-25 10:37:17.505067 | controller | skipping: [instance] => (item=controller-0) 2026-02-25 10:37:17.505094 | controller | skipping: [instance] => (item=crc-0) 2026-02-25 10:37:17.505102 | controller | skipping: [instance] 2026-02-25 10:37:17.505108 | controller | 2026-02-25 10:37:17.505113 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2026-02-25 10:37:17.505119 | controller | Wednesday 25 February 2026 10:37:17 +0000 (0:00:00.051) 0:02:58.348 **** 2026-02-25 10:37:17.505128 | controller | ok: [instance] 2026-02-25 10:37:17.876733 | controller | 2026-02-25 10:37:17.876759 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2026-02-25 10:37:17.876766 | controller | Wednesday 25 February 2026 10:37:17 +0000 (0:00:00.254) 0:02:58.603 **** 2026-02-25 10:37:17.876776 | controller | changed: [instance] 2026-02-25 10:37:17.917390 | controller | 2026-02-25 10:37:17.917408 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2026-02-25 10:37:17.917415 | controller | Wednesday 25 February 2026 10:37:17 +0000 (0:00:00.368) 0:02:58.972 **** 2026-02-25 10:37:17.917424 | controller | skipping: [instance] 2026-02-25 10:37:17.960943 | controller | 2026-02-25 10:37:17.960967 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2026-02-25 10:37:17.960978 | controller | Wednesday 25 February 2026 10:37:17 +0000 (0:00:00.045) 0:02:59.017 **** 2026-02-25 10:37:17.960989 | controller | skipping: [instance] 2026-02-25 10:37:18.000312 | controller | 2026-02-25 10:37:18.000329 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2026-02-25 10:37:18.000335 | controller | Wednesday 25 February 2026 10:37:17 +0000 (0:00:00.043) 0:02:59.061 **** 2026-02-25 10:37:18.000343 | controller | skipping: [instance] 2026-02-25 10:37:18.751225 | controller | 2026-02-25 10:37:18.751262 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2026-02-25 10:37:18.751270 | controller | Wednesday 25 February 2026 10:37:17 +0000 (0:00:00.039) 0:02:59.100 **** 2026-02-25 10:37:18.751280 | controller | changed: [instance] 2026-02-25 10:37:18.751654 | controller | 2026-02-25 10:37:19.489197 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2026-02-25 10:37:19.489231 | controller | Wednesday 25 February 2026 10:37:18 +0000 (0:00:00.750) 0:02:59.851 **** 2026-02-25 10:37:19.489243 | controller | changed: [instance] 2026-02-25 10:37:19.535273 | controller | 2026-02-25 10:37:19.535298 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2026-02-25 10:37:19.535306 | controller | Wednesday 25 February 2026 10:37:19 +0000 (0:00:00.737) 0:03:00.589 **** 2026-02-25 10:37:19.535316 | controller | skipping: [instance] 2026-02-25 10:37:19.602576 | controller | 2026-02-25 10:37:19.602598 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2026-02-25 10:37:19.602606 | controller | Wednesday 25 February 2026 10:37:19 +0000 (0:00:00.046) 0:03:00.635 **** 2026-02-25 10:37:19.602615 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2026-02-25 10:37:19.645510 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2026-02-25 10:37:19.645529 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2026-02-25 10:37:19.645536 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2026-02-25 10:37:19.645542 | controller | 2026-02-25 10:37:19.645547 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2026-02-25 10:37:19.645552 | controller | Wednesday 25 February 2026 10:37:19 +0000 (0:00:00.066) 0:03:00.702 **** 2026-02-25 10:37:19.645566 | controller | skipping: [instance] 2026-02-25 10:37:19.683245 | controller | 2026-02-25 10:37:19.683266 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2026-02-25 10:37:19.683273 | controller | Wednesday 25 February 2026 10:37:19 +0000 (0:00:00.043) 0:03:00.746 **** 2026-02-25 10:37:19.683289 | controller | skipping: [instance] 2026-02-25 10:37:19.725194 | controller | 2026-02-25 10:37:19.725215 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2026-02-25 10:37:19.725223 | controller | Wednesday 25 February 2026 10:37:19 +0000 (0:00:00.037) 0:03:00.783 **** 2026-02-25 10:37:19.725231 | controller | skipping: [instance] 2026-02-25 10:37:19.763867 | controller | 2026-02-25 10:37:19.763887 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2026-02-25 10:37:19.763894 | controller | Wednesday 25 February 2026 10:37:19 +0000 (0:00:00.041) 0:03:00.825 **** 2026-02-25 10:37:19.763902 | controller | skipping: [instance] 2026-02-25 10:37:20.429643 | controller | 2026-02-25 10:37:20.429671 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2026-02-25 10:37:20.429679 | controller | Wednesday 25 February 2026 10:37:19 +0000 (0:00:00.038) 0:03:00.864 **** 2026-02-25 10:37:20.429688 | controller | changed: [instance] 2026-02-25 10:37:20.463326 | controller | 2026-02-25 10:37:20.463350 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2026-02-25 10:37:20.463359 | controller | Wednesday 25 February 2026 10:37:20 +0000 (0:00:00.665) 0:03:01.530 **** 2026-02-25 10:37:20.463377 | controller | skipping: [instance] 2026-02-25 10:37:20.498698 | controller | 2026-02-25 10:37:20.498715 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2026-02-25 10:37:20.498722 | controller | Wednesday 25 February 2026 10:37:20 +0000 (0:00:00.033) 0:03:01.564 **** 2026-02-25 10:37:20.498730 | controller | skipping: [instance] 2026-02-25 10:37:20.540731 | controller | 2026-02-25 10:37:20.540750 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2026-02-25 10:37:20.540757 | controller | Wednesday 25 February 2026 10:37:20 +0000 (0:00:00.035) 0:03:01.599 **** 2026-02-25 10:37:20.540766 | controller | skipping: [instance] 2026-02-25 10:37:20.585528 | controller | 2026-02-25 10:37:20.585546 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-25 10:37:20.585553 | controller | Wednesday 25 February 2026 10:37:20 +0000 (0:00:00.041) 0:03:01.641 **** 2026-02-25 10:37:20.585561 | controller | skipping: [instance] 2026-02-25 10:37:20.625505 | controller | 2026-02-25 10:37:20.625525 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-25 10:37:20.625532 | controller | Wednesday 25 February 2026 10:37:20 +0000 (0:00:00.044) 0:03:01.686 **** 2026-02-25 10:37:20.625541 | controller | skipping: [instance] 2026-02-25 10:37:20.667080 | controller | 2026-02-25 10:37:20.667101 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-25 10:37:20.667108 | controller | Wednesday 25 February 2026 10:37:20 +0000 (0:00:00.039) 0:03:01.726 **** 2026-02-25 10:37:20.667117 | controller | skipping: [instance] 2026-02-25 10:37:20.708649 | controller | 2026-02-25 10:37:20.708686 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-25 10:37:20.708694 | controller | Wednesday 25 February 2026 10:37:20 +0000 (0:00:00.041) 0:03:01.767 **** 2026-02-25 10:37:20.708705 | controller | skipping: [instance] 2026-02-25 10:37:20.708742 | controller | 2026-02-25 10:37:20.708750 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-25 10:37:20.749296 | controller | Wednesday 25 February 2026 10:37:20 +0000 (0:00:00.041) 0:03:01.809 **** 2026-02-25 10:37:20.749322 | controller | skipping: [instance] 2026-02-25 10:37:20.749371 | controller | 2026-02-25 10:37:20.749484 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-25 10:37:20.749580 | controller | Wednesday 25 February 2026 10:37:20 +0000 (0:00:00.040) 0:03:01.850 **** 2026-02-25 10:37:20.787079 | controller | skipping: [instance] 2026-02-25 10:37:20.787193 | controller | 2026-02-25 10:37:20.787287 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-25 10:37:20.787386 | controller | Wednesday 25 February 2026 10:37:20 +0000 (0:00:00.037) 0:03:01.888 **** 2026-02-25 10:37:20.836045 | controller | skipping: [instance] 2026-02-25 10:37:20.836136 | controller | 2026-02-25 10:37:20.836168 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2026-02-25 10:37:20.836261 | controller | Wednesday 25 February 2026 10:37:20 +0000 (0:00:00.048) 0:03:01.936 **** 2026-02-25 10:37:20.875973 | controller | skipping: [instance] 2026-02-25 10:37:20.876057 | controller | 2026-02-25 10:37:20.876164 | controller | TASK [reproducer : Configure Controller node] ********************************** 2026-02-25 10:37:20.876247 | controller | Wednesday 25 February 2026 10:37:20 +0000 (0:00:00.040) 0:03:01.976 **** 2026-02-25 10:37:21.039692 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2026-02-25 10:37:21.039759 | controller | 2026-02-25 10:37:21.039852 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-25 10:37:21.039933 | controller | Wednesday 25 February 2026 10:37:21 +0000 (0:00:00.163) 0:03:02.140 **** 2026-02-25 10:37:22.553709 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-25 10:37:22.553768 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-25 10:37:22.553873 | controller | 2026-02-25 10:37:22.553957 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-25 10:37:22.554052 | controller | Wednesday 25 February 2026 10:37:22 +0000 (0:00:01.513) 0:03:03.654 **** 2026-02-25 10:37:22.579047 | controller | skipping: [instance] 2026-02-25 10:37:22.579136 | controller | 2026-02-25 10:37:22.579252 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-25 10:37:22.579344 | controller | Wednesday 25 February 2026 10:37:22 +0000 (0:00:00.025) 0:03:03.679 **** 2026-02-25 10:37:23.287091 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:23.287187 | controller | 2026-02-25 10:37:23.287339 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-25 10:37:23.287514 | controller | Wednesday 25 February 2026 10:37:23 +0000 (0:00:00.707) 0:03:04.387 **** 2026-02-25 10:37:23.332233 | controller | skipping: [instance] 2026-02-25 10:37:23.332344 | controller | 2026-02-25 10:37:23.332517 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-25 10:37:23.332624 | controller | Wednesday 25 February 2026 10:37:23 +0000 (0:00:00.045) 0:03:04.433 **** 2026-02-25 10:37:23.375647 | controller | skipping: [instance] 2026-02-25 10:37:23.375726 | controller | 2026-02-25 10:37:23.375812 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-25 10:37:23.375898 | controller | Wednesday 25 February 2026 10:37:23 +0000 (0:00:00.043) 0:03:04.476 **** 2026-02-25 10:37:23.417916 | controller | skipping: [instance] 2026-02-25 10:37:23.417993 | controller | 2026-02-25 10:37:23.418098 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-25 10:37:23.418190 | controller | Wednesday 25 February 2026 10:37:23 +0000 (0:00:00.042) 0:03:04.518 **** 2026-02-25 10:37:23.469170 | controller | skipping: [instance] 2026-02-25 10:37:23.469304 | controller | 2026-02-25 10:37:23.469453 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2026-02-25 10:37:23.469581 | controller | Wednesday 25 February 2026 10:37:23 +0000 (0:00:00.051) 0:03:04.569 **** 2026-02-25 10:37:23.509639 | controller | skipping: [instance] 2026-02-25 10:37:23.509749 | controller | 2026-02-25 10:37:23.509878 | controller | TASK [reproducer : Install repos] ********************************************** 2026-02-25 10:37:23.510005 | controller | Wednesday 25 February 2026 10:37:23 +0000 (0:00:00.040) 0:03:04.610 **** 2026-02-25 10:37:23.545386 | controller | skipping: [instance] 2026-02-25 10:37:23.545485 | controller | 2026-02-25 10:37:23.545597 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2026-02-25 10:37:23.545702 | controller | Wednesday 25 February 2026 10:37:23 +0000 (0:00:00.035) 0:03:04.646 **** 2026-02-25 10:37:23.582887 | controller | skipping: [instance] 2026-02-25 10:37:23.582943 | controller | 2026-02-25 10:37:23.583171 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2026-02-25 10:37:23.618326 | controller | Wednesday 25 February 2026 10:37:23 +0000 (0:00:00.037) 0:03:04.683 **** 2026-02-25 10:37:23.618383 | controller | skipping: [instance] 2026-02-25 10:37:23.618437 | controller | 2026-02-25 10:37:23.618455 | controller | TASK [reproducer : Install some tools] ***************************************** 2026-02-25 10:37:23.618567 | controller | Wednesday 25 February 2026 10:37:23 +0000 (0:00:00.035) 0:03:04.719 **** 2026-02-25 10:37:24.660346 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:24.660511 | controller | 2026-02-25 10:37:24.660550 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2026-02-25 10:37:25.749392 | controller | Wednesday 25 February 2026 10:37:24 +0000 (0:00:01.041) 0:03:05.760 **** 2026-02-25 10:37:25.749454 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:26.397340 | controller | 2026-02-25 10:37:26.397385 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2026-02-25 10:37:26.397393 | controller | Wednesday 25 February 2026 10:37:25 +0000 (0:00:01.088) 0:03:06.849 **** 2026-02-25 10:37:26.397403 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:27.421621 | controller | 2026-02-25 10:37:27.421659 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2026-02-25 10:37:27.421667 | controller | Wednesday 25 February 2026 10:37:26 +0000 (0:00:00.647) 0:03:07.497 **** 2026-02-25 10:37:27.421678 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:28.550222 | controller | 2026-02-25 10:37:28.550258 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2026-02-25 10:37:28.550266 | controller | Wednesday 25 February 2026 10:37:27 +0000 (0:00:01.024) 0:03:08.521 **** 2026-02-25 10:37:28.550276 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-25 10:37:28.550851 | controller | skipping: [instance] => (item=compute-0) 2026-02-25 10:37:29.207926 | controller | skipping: [instance] => (item=controller-0) 2026-02-25 10:37:29.207957 | controller | skipping: [instance] => (item=crc-0) 2026-02-25 10:37:29.207965 | controller | 2026-02-25 10:37:29.207980 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2026-02-25 10:37:29.207987 | controller | Wednesday 25 February 2026 10:37:28 +0000 (0:00:01.128) 0:03:09.650 **** 2026-02-25 10:37:29.207997 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-25 10:37:31.052119 | controller | skipping: [instance] => (item=compute-0) 2026-02-25 10:37:31.052166 | controller | skipping: [instance] => (item=controller-0) 2026-02-25 10:37:31.052177 | controller | skipping: [instance] => (item=crc-0) 2026-02-25 10:37:31.052183 | controller | 2026-02-25 10:37:31.052189 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2026-02-25 10:37:31.052196 | controller | Wednesday 25 February 2026 10:37:29 +0000 (0:00:00.657) 0:03:10.308 **** 2026-02-25 10:37:31.052205 | controller | skipping: [instance] => (item=instance) 2026-02-25 10:37:31.668128 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2026-02-25 10:37:31.668177 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-25 10:37:31.668185 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2026-02-25 10:37:31.668190 | controller | 2026-02-25 10:37:31.668196 | controller | TASK [reproducer : Create kube directory] ************************************** 2026-02-25 10:37:31.668201 | controller | Wednesday 25 February 2026 10:37:31 +0000 (0:00:01.844) 0:03:12.152 **** 2026-02-25 10:37:31.668211 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:32.690831 | controller | 2026-02-25 10:37:32.690865 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2026-02-25 10:37:32.690872 | controller | Wednesday 25 February 2026 10:37:31 +0000 (0:00:00.616) 0:03:12.768 **** 2026-02-25 10:37:32.690882 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:33.683419 | controller | 2026-02-25 10:37:33.683446 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2026-02-25 10:37:33.683454 | controller | Wednesday 25 February 2026 10:37:32 +0000 (0:00:01.022) 0:03:13.791 **** 2026-02-25 10:37:33.683463 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:33.715820 | controller | 2026-02-25 10:37:33.715838 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2026-02-25 10:37:33.715845 | controller | Wednesday 25 February 2026 10:37:33 +0000 (0:00:00.992) 0:03:14.784 **** 2026-02-25 10:37:33.715854 | controller | skipping: [instance] 2026-02-25 10:37:34.320287 | controller | 2026-02-25 10:37:34.320307 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2026-02-25 10:37:34.320315 | controller | Wednesday 25 February 2026 10:37:33 +0000 (0:00:00.032) 0:03:14.816 **** 2026-02-25 10:37:34.320323 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:34.971620 | controller | 2026-02-25 10:37:34.971641 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2026-02-25 10:37:34.971648 | controller | Wednesday 25 February 2026 10:37:34 +0000 (0:00:00.604) 0:03:15.420 **** 2026-02-25 10:37:34.971657 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:35.025467 | controller | 2026-02-25 10:37:35.025570 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2026-02-25 10:37:35.025583 | controller | Wednesday 25 February 2026 10:37:34 +0000 (0:00:00.651) 0:03:16.072 **** 2026-02-25 10:37:35.025604 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:35.025656 | controller | 2026-02-25 10:37:35.025668 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2026-02-25 10:37:35.095437 | controller | Wednesday 25 February 2026 10:37:35 +0000 (0:00:00.054) 0:03:16.126 **** 2026-02-25 10:37:35.095468 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2026-02-25 10:37:35.095510 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2026-02-25 10:37:35.095600 | controller | 2026-02-25 10:37:35.095698 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-25 10:37:35.095788 | controller | Wednesday 25 February 2026 10:37:35 +0000 (0:00:00.070) 0:03:16.196 **** 2026-02-25 10:37:35.166707 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 10:37:35.166776 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2026-02-25 10:37:35.166872 | controller | 2026-02-25 10:37:35.166971 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-25 10:37:35.167067 | controller | Wednesday 25 February 2026 10:37:35 +0000 (0:00:00.071) 0:03:16.267 **** 2026-02-25 10:37:35.237200 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 10:37:35.237292 | controller | _secret_file: '' 2026-02-25 10:37:35.237383 | controller | 2026-02-25 10:37:35.237489 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-25 10:37:35.237585 | controller | Wednesday 25 February 2026 10:37:35 +0000 (0:00:00.070) 0:03:16.338 **** 2026-02-25 10:37:35.307109 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 10:37:35.307265 | controller | _secret_content: my-default-location-place 2026-02-25 10:37:35.307308 | controller | 2026-02-25 10:37:35.307441 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-25 10:37:35.307539 | controller | Wednesday 25 February 2026 10:37:35 +0000 (0:00:00.068) 0:03:16.407 **** 2026-02-25 10:37:35.366115 | controller | skipping: [instance] 2026-02-25 10:37:35.366200 | controller | 2026-02-25 10:37:35.366212 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-25 10:37:35.366278 | controller | Wednesday 25 February 2026 10:37:35 +0000 (0:00:00.059) 0:03:16.466 **** 2026-02-25 10:37:35.421277 | controller | skipping: [instance] 2026-02-25 10:37:35.421391 | controller | 2026-02-25 10:37:35.421501 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-25 10:37:35.421625 | controller | Wednesday 25 February 2026 10:37:35 +0000 (0:00:00.055) 0:03:16.522 **** 2026-02-25 10:37:35.481281 | controller | skipping: [instance] 2026-02-25 10:37:36.645853 | controller | 2026-02-25 10:37:36.645893 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-25 10:37:36.645902 | controller | Wednesday 25 February 2026 10:37:35 +0000 (0:00:00.059) 0:03:16.581 **** 2026-02-25 10:37:36.645913 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:36.701957 | controller | 2026-02-25 10:37:36.701975 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-25 10:37:36.701982 | controller | Wednesday 25 February 2026 10:37:36 +0000 (0:00:01.164) 0:03:17.746 **** 2026-02-25 10:37:36.701991 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 10:37:36.752474 | controller | _secret_dest: /home/zuul/ipmi-things 2026-02-25 10:37:36.752493 | controller | 2026-02-25 10:37:36.752501 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-25 10:37:36.752507 | controller | Wednesday 25 February 2026 10:37:36 +0000 (0:00:00.056) 0:03:17.802 **** 2026-02-25 10:37:36.752515 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 10:37:36.799974 | controller | _secret_file: /tmp/ipmi-things 2026-02-25 10:37:36.799992 | controller | 2026-02-25 10:37:36.800000 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-25 10:37:36.800005 | controller | Wednesday 25 February 2026 10:37:36 +0000 (0:00:00.050) 0:03:17.853 **** 2026-02-25 10:37:36.800014 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 10:37:36.857563 | controller | _secret_content: '' 2026-02-25 10:37:36.857580 | controller | 2026-02-25 10:37:36.857587 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-25 10:37:36.857592 | controller | Wednesday 25 February 2026 10:37:36 +0000 (0:00:00.047) 0:03:17.900 **** 2026-02-25 10:37:36.857600 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2026-02-25 10:37:37.489784 | controller | msg: All assertions passed 2026-02-25 10:37:37.489836 | controller | 2026-02-25 10:37:37.489844 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-25 10:37:37.489850 | controller | Wednesday 25 February 2026 10:37:36 +0000 (0:00:00.057) 0:03:17.958 **** 2026-02-25 10:37:37.489862 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:38.569877 | controller | 2026-02-25 10:37:38.569922 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-25 10:37:38.569930 | controller | Wednesday 25 February 2026 10:37:37 +0000 (0:00:00.631) 0:03:18.590 **** 2026-02-25 10:37:38.569942 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:38.628515 | controller | 2026-02-25 10:37:38.628550 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-25 10:37:38.628560 | controller | Wednesday 25 February 2026 10:37:38 +0000 (0:00:01.079) 0:03:19.670 **** 2026-02-25 10:37:38.628573 | controller | skipping: [instance] 2026-02-25 10:37:39.245856 | controller | 2026-02-25 10:37:39.245902 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2026-02-25 10:37:39.245911 | controller | Wednesday 25 February 2026 10:37:38 +0000 (0:00:00.058) 0:03:19.728 **** 2026-02-25 10:37:39.245922 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:37:39.898774 | controller | 2026-02-25 10:37:39.898815 | controller | TASK [reproducer : Check if async file is still available] ********************* 2026-02-25 10:37:39.898824 | controller | Wednesday 25 February 2026 10:37:39 +0000 (0:00:00.617) 0:03:20.346 **** 2026-02-25 10:37:39.898838 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:19.609394 | controller | 2026-02-25 10:38:19.609449 | controller | TASK [reproducer : Check package install status] ******************************* 2026-02-25 10:38:19.609458 | controller | Wednesday 25 February 2026 10:37:39 +0000 (0:00:00.652) 0:03:20.998 **** 2026-02-25 10:38:19.609469 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2026-02-25 10:38:19.609716 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2026-02-25 10:38:19.609734 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2026-02-25 10:38:19.609740 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2026-02-25 10:38:19.609746 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2026-02-25 10:38:19.609755 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2026-02-25 10:38:19.609761 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2026-02-25 10:38:19.609767 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:19.609772 | controller | 2026-02-25 10:38:19.609780 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2026-02-25 10:38:20.418937 | controller | Wednesday 25 February 2026 10:38:19 +0000 (0:00:39.708) 0:04:00.706 **** 2026-02-25 10:38:20.418977 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:22.885414 | controller | 2026-02-25 10:38:22.885452 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2026-02-25 10:38:22.885461 | controller | Wednesday 25 February 2026 10:38:20 +0000 (0:00:00.812) 0:04:01.519 **** 2026-02-25 10:38:22.885472 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:22.945372 | controller | 2026-02-25 10:38:22.945402 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2026-02-25 10:38:22.945410 | controller | Wednesday 25 February 2026 10:38:22 +0000 (0:00:02.466) 0:04:03.985 **** 2026-02-25 10:38:22.945420 | controller | skipping: [instance] 2026-02-25 10:38:22.997178 | controller | 2026-02-25 10:38:22.997210 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2026-02-25 10:38:22.997218 | controller | Wednesday 25 February 2026 10:38:22 +0000 (0:00:00.054) 0:04:04.040 **** 2026-02-25 10:38:22.997228 | controller | skipping: [instance] 2026-02-25 10:38:23.723031 | controller | 2026-02-25 10:38:23.723062 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2026-02-25 10:38:23.723069 | controller | Wednesday 25 February 2026 10:38:22 +0000 (0:00:00.057) 0:04:04.097 **** 2026-02-25 10:38:23.723079 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:24.296292 | controller | 2026-02-25 10:38:24.296325 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2026-02-25 10:38:24.296351 | controller | Wednesday 25 February 2026 10:38:23 +0000 (0:00:00.725) 0:04:04.823 **** 2026-02-25 10:38:24.296363 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:24.602881 | controller | 2026-02-25 10:38:24.602916 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2026-02-25 10:38:24.602924 | controller | Wednesday 25 February 2026 10:38:24 +0000 (0:00:00.573) 0:04:05.396 **** 2026-02-25 10:38:24.602934 | controller | changed: [instance] 2026-02-25 10:38:25.305121 | controller | 2026-02-25 10:38:25.305174 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2026-02-25 10:38:25.305185 | controller | Wednesday 25 February 2026 10:38:24 +0000 (0:00:00.306) 0:04:05.703 **** 2026-02-25 10:38:25.305197 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:26.356515 | controller | 2026-02-25 10:38:26.356553 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2026-02-25 10:38:26.356562 | controller | Wednesday 25 February 2026 10:38:25 +0000 (0:00:00.701) 0:04:06.404 **** 2026-02-25 10:38:26.356572 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:26.400802 | controller | 2026-02-25 10:38:26.400827 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-25 10:38:26.400835 | controller | Wednesday 25 February 2026 10:38:26 +0000 (0:00:01.052) 0:04:07.456 **** 2026-02-25 10:38:26.400844 | controller | skipping: [instance] 2026-02-25 10:38:26.443652 | controller | 2026-02-25 10:38:26.443670 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-25 10:38:26.443682 | controller | Wednesday 25 February 2026 10:38:26 +0000 (0:00:00.044) 0:04:07.501 **** 2026-02-25 10:38:26.443691 | controller | skipping: [instance] 2026-02-25 10:38:26.536621 | controller | 2026-02-25 10:38:26.536658 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-25 10:38:26.536666 | controller | Wednesday 25 February 2026 10:38:26 +0000 (0:00:00.042) 0:04:07.544 **** 2026-02-25 10:38:26.536676 | controller | skipping: [instance] 2026-02-25 10:38:26.586307 | controller | 2026-02-25 10:38:26.586340 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2026-02-25 10:38:26.586349 | controller | Wednesday 25 February 2026 10:38:26 +0000 (0:00:00.092) 0:04:07.636 **** 2026-02-25 10:38:26.586358 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:26.586687 | controller | 2026-02-25 10:38:26.628197 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2026-02-25 10:38:26.628215 | controller | Wednesday 25 February 2026 10:38:26 +0000 (0:00:00.049) 0:04:07.687 **** 2026-02-25 10:38:26.628225 | controller | skipping: [instance] 2026-02-25 10:38:26.664108 | controller | 2026-02-25 10:38:26.664126 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2026-02-25 10:38:26.664134 | controller | Wednesday 25 February 2026 10:38:26 +0000 (0:00:00.041) 0:04:07.728 **** 2026-02-25 10:38:26.664166 | controller | skipping: [instance] 2026-02-25 10:38:26.699475 | controller | 2026-02-25 10:38:26.699494 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2026-02-25 10:38:26.699501 | controller | Wednesday 25 February 2026 10:38:26 +0000 (0:00:00.036) 0:04:07.764 **** 2026-02-25 10:38:26.699513 | controller | skipping: [instance] 2026-02-25 10:38:27.312980 | controller | 2026-02-25 10:38:27.313015 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2026-02-25 10:38:27.313023 | controller | Wednesday 25 February 2026 10:38:26 +0000 (0:00:00.035) 0:04:07.800 **** 2026-02-25 10:38:27.313033 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:27.411015 | controller | 2026-02-25 10:38:27.411041 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2026-02-25 10:38:27.411049 | controller | Wednesday 25 February 2026 10:38:27 +0000 (0:00:00.613) 0:04:08.413 **** 2026-02-25 10:38:27.411059 | controller | skipping: [instance] => (item=secret) 2026-02-25 10:38:28.557138 | controller | skipping: [instance] => (item=configmap) 2026-02-25 10:38:28.557190 | controller | skipping: [instance] => (item=pod) 2026-02-25 10:38:28.557198 | controller | skipping: [instance] => (item=service) 2026-02-25 10:38:28.557203 | controller | skipping: [instance] => (item=route) 2026-02-25 10:38:28.557208 | controller | skipping: [instance] 2026-02-25 10:38:28.557214 | controller | 2026-02-25 10:38:28.557219 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2026-02-25 10:38:28.557225 | controller | Wednesday 25 February 2026 10:38:27 +0000 (0:00:00.097) 0:04:08.511 **** 2026-02-25 10:38:28.557234 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:29.577687 | controller | 2026-02-25 10:38:29.577720 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2026-02-25 10:38:29.577728 | controller | Wednesday 25 February 2026 10:38:28 +0000 (0:00:01.146) 0:04:09.657 **** 2026-02-25 10:38:29.577738 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:29.614278 | controller | 2026-02-25 10:38:29.614306 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2026-02-25 10:38:29.614313 | controller | Wednesday 25 February 2026 10:38:29 +0000 (0:00:01.020) 0:04:10.677 **** 2026-02-25 10:38:29.614322 | controller | skipping: [instance] 2026-02-25 10:38:29.653112 | controller | 2026-02-25 10:38:29.653141 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2026-02-25 10:38:29.653174 | controller | Wednesday 25 February 2026 10:38:29 +0000 (0:00:00.037) 0:04:10.714 **** 2026-02-25 10:38:29.653187 | controller | skipping: [instance] 2026-02-25 10:38:29.727319 | controller | 2026-02-25 10:38:29.727355 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2026-02-25 10:38:29.727363 | controller | Wednesday 25 February 2026 10:38:29 +0000 (0:00:00.038) 0:04:10.753 **** 2026-02-25 10:38:29.727372 | controller | skipping: [instance] => (item=secret) 2026-02-25 10:38:29.762773 | controller | skipping: [instance] => (item=configmap) 2026-02-25 10:38:29.762795 | controller | skipping: [instance] => (item=service) 2026-02-25 10:38:29.762801 | controller | skipping: [instance] => (item=route) 2026-02-25 10:38:29.762807 | controller | skipping: [instance] 2026-02-25 10:38:29.762812 | controller | 2026-02-25 10:38:29.762817 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2026-02-25 10:38:29.762823 | controller | Wednesday 25 February 2026 10:38:29 +0000 (0:00:00.073) 0:04:10.827 **** 2026-02-25 10:38:29.762831 | controller | skipping: [instance] 2026-02-25 10:38:31.333279 | controller | 2026-02-25 10:38:31.333317 | controller | TASK [podman : Ensure podman is installed] ************************************* 2026-02-25 10:38:31.333325 | controller | Wednesday 25 February 2026 10:38:29 +0000 (0:00:00.035) 0:04:10.863 **** 2026-02-25 10:38:31.333347 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:32.148839 | controller | 2026-02-25 10:38:32.148875 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2026-02-25 10:38:32.148882 | controller | Wednesday 25 February 2026 10:38:31 +0000 (0:00:01.569) 0:04:12.433 **** 2026-02-25 10:38:32.148892 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:32.186872 | controller | 2026-02-25 10:38:32.186893 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2026-02-25 10:38:32.186902 | controller | Wednesday 25 February 2026 10:38:32 +0000 (0:00:00.815) 0:04:13.249 **** 2026-02-25 10:38:32.186912 | controller | skipping: [instance] 2026-02-25 10:38:32.226273 | controller | 2026-02-25 10:38:32.226292 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2026-02-25 10:38:32.226299 | controller | Wednesday 25 February 2026 10:38:32 +0000 (0:00:00.038) 0:04:13.287 **** 2026-02-25 10:38:32.226307 | controller | skipping: [instance] 2026-02-25 10:38:32.269895 | controller | 2026-02-25 10:38:32.269913 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2026-02-25 10:38:32.269919 | controller | Wednesday 25 February 2026 10:38:32 +0000 (0:00:00.039) 0:04:13.326 **** 2026-02-25 10:38:32.269928 | controller | skipping: [instance] 2026-02-25 10:38:42.864947 | controller | 2026-02-25 10:38:42.864985 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2026-02-25 10:38:42.864993 | controller | Wednesday 25 February 2026 10:38:32 +0000 (0:00:00.043) 0:04:13.370 **** 2026-02-25 10:38:42.865004 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:44.446723 | controller | 2026-02-25 10:38:44.446762 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2026-02-25 10:38:44.446770 | controller | Wednesday 25 February 2026 10:38:42 +0000 (0:00:10.593) 0:04:23.964 **** 2026-02-25 10:38:44.446788 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:45.638452 | controller | 2026-02-25 10:38:45.638484 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-25 10:38:45.638497 | controller | Wednesday 25 February 2026 10:38:44 +0000 (0:00:01.583) 0:04:25.547 **** 2026-02-25 10:38:45.638507 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-25 10:38:45.678599 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-25 10:38:45.678620 | controller | 2026-02-25 10:38:45.678628 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2026-02-25 10:38:45.678634 | controller | Wednesday 25 February 2026 10:38:45 +0000 (0:00:01.191) 0:04:26.738 **** 2026-02-25 10:38:45.678642 | controller | skipping: [instance] 2026-02-25 10:38:46.395644 | controller | 2026-02-25 10:38:46.395680 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2026-02-25 10:38:46.395688 | controller | Wednesday 25 February 2026 10:38:45 +0000 (0:00:00.040) 0:04:26.779 **** 2026-02-25 10:38:46.395699 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:46.445297 | controller | 2026-02-25 10:38:46.445315 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2026-02-25 10:38:46.445331 | controller | Wednesday 25 February 2026 10:38:46 +0000 (0:00:00.716) 0:04:27.495 **** 2026-02-25 10:38:46.445340 | controller | skipping: [instance] 2026-02-25 10:38:46.499634 | controller | 2026-02-25 10:38:46.499655 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2026-02-25 10:38:46.499662 | controller | Wednesday 25 February 2026 10:38:46 +0000 (0:00:00.050) 0:04:27.546 **** 2026-02-25 10:38:46.499670 | controller | skipping: [instance] 2026-02-25 10:38:46.550787 | controller | 2026-02-25 10:38:46.550805 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-25 10:38:46.550812 | controller | Wednesday 25 February 2026 10:38:46 +0000 (0:00:00.054) 0:04:27.600 **** 2026-02-25 10:38:46.550821 | controller | skipping: [instance] 2026-02-25 10:38:46.600481 | controller | 2026-02-25 10:38:46.600502 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-25 10:38:46.600511 | controller | Wednesday 25 February 2026 10:38:46 +0000 (0:00:00.051) 0:04:27.651 **** 2026-02-25 10:38:46.600521 | controller | skipping: [instance] 2026-02-25 10:38:46.742271 | controller | 2026-02-25 10:38:46.742290 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2026-02-25 10:38:46.742297 | controller | Wednesday 25 February 2026 10:38:46 +0000 (0:00:00.049) 0:04:27.701 **** 2026-02-25 10:38:46.742306 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) 2026-02-25 10:38:46.742456 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) 2026-02-25 10:38:46.742583 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) 2026-02-25 10:38:46.742710 | controller | 2026-02-25 10:38:46.742839 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2026-02-25 10:38:46.742958 | controller | Wednesday 25 February 2026 10:38:46 +0000 (0:00:00.142) 0:04:27.843 **** 2026-02-25 10:38:47.802578 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:47.850869 | controller | 2026-02-25 10:38:47.850899 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2026-02-25 10:38:47.850907 | controller | Wednesday 25 February 2026 10:38:47 +0000 (0:00:01.059) 0:04:28.902 **** 2026-02-25 10:38:47.850916 | controller | skipping: [instance] 2026-02-25 10:38:47.998895 | controller | 2026-02-25 10:38:47.998921 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2026-02-25 10:38:47.998932 | controller | Wednesday 25 February 2026 10:38:47 +0000 (0:00:00.048) 0:04:28.951 **** 2026-02-25 10:38:47.998943 | controller | 2026-02-25 10:38:48.064384 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2026-02-25 10:38:48.064409 | controller | Wednesday 25 February 2026 10:38:47 +0000 (0:00:00.147) 0:04:29.099 **** 2026-02-25 10:38:48.064423 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:48.115459 | controller | 2026-02-25 10:38:48.115476 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-25 10:38:48.115483 | controller | Wednesday 25 February 2026 10:38:48 +0000 (0:00:00.065) 0:04:29.164 **** 2026-02-25 10:38:48.115491 | controller | skipping: [instance] 2026-02-25 10:38:48.161014 | controller | 2026-02-25 10:38:48.161031 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-25 10:38:48.161038 | controller | Wednesday 25 February 2026 10:38:48 +0000 (0:00:00.051) 0:04:29.216 **** 2026-02-25 10:38:48.161046 | controller | skipping: [instance] 2026-02-25 10:38:49.685545 | controller | 2026-02-25 10:38:49.685581 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2026-02-25 10:38:49.685594 | controller | Wednesday 25 February 2026 10:38:48 +0000 (0:00:00.045) 0:04:29.261 **** 2026-02-25 10:38:49.685605 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:38:57.441167 | controller | 2026-02-25 10:38:57.441202 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2026-02-25 10:38:57.441210 | controller | Wednesday 25 February 2026 10:38:49 +0000 (0:00:01.523) 0:04:30.785 **** 2026-02-25 10:38:57.441220 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1) 2026-02-25 10:38:57.573165 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b) 2026-02-25 10:38:57.573202 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282) 2026-02-25 10:38:57.573210 | controller | 2026-02-25 10:38:57.573216 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2026-02-25 10:38:57.573222 | controller | Wednesday 25 February 2026 10:38:57 +0000 (0:00:07.755) 0:04:38.541 **** 2026-02-25 10:38:57.573232 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2026-02-25 10:38:57.838160 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2026-02-25 10:38:57.838194 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2026-02-25 10:38:57.838202 | controller | 2026-02-25 10:38:57.838212 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2026-02-25 10:38:57.838217 | controller | Wednesday 25 February 2026 10:38:57 +0000 (0:00:00.132) 0:04:38.673 **** 2026-02-25 10:38:57.838227 | controller | ok: [instance -> localhost] 2026-02-25 10:39:00.053159 | controller | 2026-02-25 10:39:00.053192 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2026-02-25 10:39:00.053200 | controller | Wednesday 25 February 2026 10:38:57 +0000 (0:00:00.265) 0:04:38.938 **** 2026-02-25 10:39:00.053210 | controller | changed: [instance -> localhost] => (item=controller-0) 2026-02-25 10:39:00.739446 | controller | 2026-02-25 10:39:00.739477 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2026-02-25 10:39:00.739486 | controller | Wednesday 25 February 2026 10:39:00 +0000 (0:00:02.215) 0:04:41.153 **** 2026-02-25 10:39:00.739496 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:01.562774 | controller | 2026-02-25 10:39:01.562804 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2026-02-25 10:39:01.562812 | controller | Wednesday 25 February 2026 10:39:00 +0000 (0:00:00.686) 0:04:41.839 **** 2026-02-25 10:39:01.562821 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:01.563093 | controller | 2026-02-25 10:39:02.706908 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2026-02-25 10:39:02.706938 | controller | Wednesday 25 February 2026 10:39:01 +0000 (0:00:00.823) 0:04:42.662 **** 2026-02-25 10:39:02.706950 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:03.359378 | controller | 2026-02-25 10:39:03.359412 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2026-02-25 10:39:03.359420 | controller | Wednesday 25 February 2026 10:39:02 +0000 (0:00:01.144) 0:04:43.807 **** 2026-02-25 10:39:03.359431 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:04.453447 | controller | 2026-02-25 10:39:04.453480 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2026-02-25 10:39:04.453487 | controller | Wednesday 25 February 2026 10:39:03 +0000 (0:00:00.652) 0:04:44.459 **** 2026-02-25 10:39:04.453497 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:05.013964 | controller | 2026-02-25 10:39:05.013995 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2026-02-25 10:39:05.014002 | controller | Wednesday 25 February 2026 10:39:04 +0000 (0:00:01.094) 0:04:45.553 **** 2026-02-25 10:39:05.014012 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:05.556769 | controller | 2026-02-25 10:39:05.556800 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2026-02-25 10:39:05.556809 | controller | Wednesday 25 February 2026 10:39:05 +0000 (0:00:00.560) 0:04:46.114 **** 2026-02-25 10:39:05.556821 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:07.004297 | controller | 2026-02-25 10:39:07.004352 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2026-02-25 10:39:07.004360 | controller | Wednesday 25 February 2026 10:39:05 +0000 (0:00:00.542) 0:04:46.657 **** 2026-02-25 10:39:07.004370 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-25 10:39:07.038560 | controller | 2026-02-25 10:39:07.038580 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-25 10:39:07.038588 | controller | Wednesday 25 February 2026 10:39:07 +0000 (0:00:01.447) 0:04:48.104 **** 2026-02-25 10:39:07.038600 | controller | skipping: [instance] 2026-02-25 10:39:07.072433 | controller | 2026-02-25 10:39:07.072450 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-25 10:39:07.072457 | controller | Wednesday 25 February 2026 10:39:07 +0000 (0:00:00.034) 0:04:48.139 **** 2026-02-25 10:39:07.072465 | controller | skipping: [instance] 2026-02-25 10:39:07.106225 | controller | 2026-02-25 10:39:07.106242 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-25 10:39:07.106248 | controller | Wednesday 25 February 2026 10:39:07 +0000 (0:00:00.033) 0:04:48.173 **** 2026-02-25 10:39:07.106256 | controller | skipping: [instance] 2026-02-25 10:39:07.138872 | controller | 2026-02-25 10:39:07.138889 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-25 10:39:07.138896 | controller | Wednesday 25 February 2026 10:39:07 +0000 (0:00:00.033) 0:04:48.207 **** 2026-02-25 10:39:07.138904 | controller | skipping: [instance] 2026-02-25 10:39:07.180541 | controller | 2026-02-25 10:39:07.180574 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-25 10:39:07.180582 | controller | Wednesday 25 February 2026 10:39:07 +0000 (0:00:00.032) 0:04:48.239 **** 2026-02-25 10:39:07.180593 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:07.284694 | controller | 2026-02-25 10:39:07.284721 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-25 10:39:07.284735 | controller | Wednesday 25 February 2026 10:39:07 +0000 (0:00:00.041) 0:04:48.281 **** 2026-02-25 10:39:07.284756 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-25 10:39:07.329101 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2026-02-25 10:39:07.329126 | controller | 2026-02-25 10:39:07.329135 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-25 10:39:07.329140 | controller | Wednesday 25 February 2026 10:39:07 +0000 (0:00:00.103) 0:04:48.384 **** 2026-02-25 10:39:07.329177 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2026-02-25 10:39:10.737874 | controller | 2026-02-25 10:39:10.737921 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2026-02-25 10:39:10.737929 | controller | Wednesday 25 February 2026 10:39:07 +0000 (0:00:00.044) 0:04:48.429 **** 2026-02-25 10:39:10.737940 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-25 10:39:11.861277 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2026-02-25 10:39:11.861328 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-25 10:39:11.861337 | controller | 2026-02-25 10:39:11.861344 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2026-02-25 10:39:11.861350 | controller | Wednesday 25 February 2026 10:39:10 +0000 (0:00:03.406) 0:04:51.836 **** 2026-02-25 10:39:11.861360 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:12.340257 | controller | 2026-02-25 10:39:12.340283 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-25 10:39:12.340291 | controller | Wednesday 25 February 2026 10:39:11 +0000 (0:00:01.125) 0:04:52.961 **** 2026-02-25 10:39:12.340306 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:13.410243 | controller | 2026-02-25 10:39:13.410276 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-25 10:39:13.410284 | controller | Wednesday 25 February 2026 10:39:12 +0000 (0:00:00.479) 0:04:53.440 **** 2026-02-25 10:39:13.410295 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:13.410338 | controller | 2026-02-25 10:39:13.410347 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-25 10:39:13.410467 | controller | Wednesday 25 February 2026 10:39:13 +0000 (0:00:01.069) 0:04:54.510 **** 2026-02-25 10:39:13.501295 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:13.501370 | controller | 2026-02-25 10:39:13.501483 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-25 10:39:13.501584 | controller | Wednesday 25 February 2026 10:39:13 +0000 (0:00:00.091) 0:04:54.601 **** 2026-02-25 10:39:13.558283 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:14.613611 | controller | 2026-02-25 10:39:14.613644 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-25 10:39:14.613651 | controller | Wednesday 25 February 2026 10:39:13 +0000 (0:00:00.056) 0:04:54.658 **** 2026-02-25 10:39:14.613661 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:15.697701 | controller | 2026-02-25 10:39:15.697731 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2026-02-25 10:39:15.697738 | controller | Wednesday 25 February 2026 10:39:14 +0000 (0:00:01.055) 0:04:55.713 **** 2026-02-25 10:39:15.697748 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:21.813661 | controller | 2026-02-25 10:39:21.813701 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2026-02-25 10:39:21.813709 | controller | Wednesday 25 February 2026 10:39:15 +0000 (0:00:01.084) 0:04:56.797 **** 2026-02-25 10:39:21.813719 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2026-02-25 10:39:22.016820 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:22.016857 | controller | 2026-02-25 10:39:22.016864 | controller | TASK [Configure ntp service] *************************************************** 2026-02-25 10:39:22.016871 | controller | Wednesday 25 February 2026 10:39:21 +0000 (0:00:06.115) 0:05:02.913 **** 2026-02-25 10:39:22.016881 | controller | 2026-02-25 10:39:23.153084 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2026-02-25 10:39:23.153119 | controller | Wednesday 25 February 2026 10:39:22 +0000 (0:00:00.203) 0:05:03.117 **** 2026-02-25 10:39:23.153131 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:24.202748 | controller | 2026-02-25 10:39:24.202781 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2026-02-25 10:39:24.202789 | controller | Wednesday 25 February 2026 10:39:23 +0000 (0:00:01.135) 0:05:04.253 **** 2026-02-25 10:39:24.202799 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2026-02-25 10:39:25.163698 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2026-02-25 10:39:25.163730 | controller | 2026-02-25 10:39:25.163738 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2026-02-25 10:39:25.163744 | controller | Wednesday 25 February 2026 10:39:24 +0000 (0:00:01.049) 0:05:05.302 **** 2026-02-25 10:39:25.163753 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:25.826241 | controller | 2026-02-25 10:39:25.826273 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2026-02-25 10:39:25.826280 | controller | Wednesday 25 February 2026 10:39:25 +0000 (0:00:00.961) 0:05:06.264 **** 2026-02-25 10:39:25.826294 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:25.970333 | controller | 2026-02-25 10:39:25.970370 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2026-02-25 10:39:25.970381 | controller | Wednesday 25 February 2026 10:39:25 +0000 (0:00:00.662) 0:05:06.926 **** 2026-02-25 10:39:25.970394 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2026-02-25 10:39:26.468890 | controller | 2026-02-25 10:39:26.468921 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2026-02-25 10:39:26.468928 | controller | Wednesday 25 February 2026 10:39:25 +0000 (0:00:00.144) 0:05:07.070 **** 2026-02-25 10:39:26.468938 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:26.951448 | controller | 2026-02-25 10:39:26.951484 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2026-02-25 10:39:26.951493 | controller | Wednesday 25 February 2026 10:39:26 +0000 (0:00:00.498) 0:05:07.568 **** 2026-02-25 10:39:26.951505 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-25 10:39:27.598769 | controller | 2026-02-25 10:39:27.598801 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2026-02-25 10:39:27.598809 | controller | Wednesday 25 February 2026 10:39:26 +0000 (0:00:00.482) 0:05:08.051 **** 2026-02-25 10:39:27.598819 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-25 10:39:28.134739 | controller | 2026-02-25 10:39:28.134771 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2026-02-25 10:39:28.134778 | controller | Wednesday 25 February 2026 10:39:27 +0000 (0:00:00.647) 0:05:08.699 **** 2026-02-25 10:39:28.134788 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-25 10:39:28.183510 | controller | 2026-02-25 10:39:28.183538 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2026-02-25 10:39:28.183561 | controller | Wednesday 25 February 2026 10:39:28 +0000 (0:00:00.536) 0:05:09.235 **** 2026-02-25 10:39:28.183574 | controller | 2026-02-25 10:39:28.681439 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2026-02-25 10:39:28.681471 | controller | Wednesday 25 February 2026 10:39:28 +0000 (0:00:00.049) 0:05:09.284 **** 2026-02-25 10:39:28.681482 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-25 10:39:29.433004 | controller | 2026-02-25 10:39:29.433036 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2026-02-25 10:39:29.433044 | controller | Wednesday 25 February 2026 10:39:28 +0000 (0:00:00.497) 0:05:09.781 **** 2026-02-25 10:39:29.433054 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-25 10:39:29.463804 | controller | 2026-02-25 10:39:29.463828 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2026-02-25 10:39:29.463836 | controller | Wednesday 25 February 2026 10:39:29 +0000 (0:00:00.751) 0:05:10.533 **** 2026-02-25 10:39:29.463845 | controller | skipping: [instance] 2026-02-25 10:39:29.498406 | controller | 2026-02-25 10:39:29.498432 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2026-02-25 10:39:29.498443 | controller | Wednesday 25 February 2026 10:39:29 +0000 (0:00:00.031) 0:05:10.564 **** 2026-02-25 10:39:29.498455 | controller | skipping: [instance] 2026-02-25 10:39:29.730798 | controller | 2026-02-25 10:39:29.730827 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2026-02-25 10:39:29.730835 | controller | Wednesday 25 February 2026 10:39:29 +0000 (0:00:00.034) 0:05:10.598 **** 2026-02-25 10:39:29.730845 | controller | changed: [instance] 2026-02-25 10:39:29.803207 | controller | 2026-02-25 10:39:29.803235 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2026-02-25 10:39:29.803243 | controller | Wednesday 25 February 2026 10:39:29 +0000 (0:00:00.232) 0:05:10.831 **** 2026-02-25 10:39:29.803253 | controller | skipping: [instance] => (item=) 2026-02-25 10:39:29.848252 | controller | 2026-02-25 10:39:29.848269 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2026-02-25 10:39:29.848276 | controller | Wednesday 25 February 2026 10:39:29 +0000 (0:00:00.072) 0:05:10.903 **** 2026-02-25 10:39:29.848284 | controller | ok: [instance] 2026-02-25 10:39:29.931915 | controller | 2026-02-25 10:39:29.931936 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-25 10:39:29.931944 | controller | Wednesday 25 February 2026 10:39:29 +0000 (0:00:00.045) 0:05:10.949 **** 2026-02-25 10:39:29.931954 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-25 10:39:30.205785 | controller | 2026-02-25 10:39:30.205815 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-25 10:39:30.205823 | controller | Wednesday 25 February 2026 10:39:29 +0000 (0:00:00.083) 0:05:11.032 **** 2026-02-25 10:39:30.205833 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-25 10:39:30.259618 | controller | 2026-02-25 10:39:30.259641 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2026-02-25 10:39:30.259652 | controller | Wednesday 25 February 2026 10:39:30 +0000 (0:00:00.274) 0:05:11.306 **** 2026-02-25 10:39:30.259662 | controller | 2026-02-25 10:39:30.440047 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-25 10:39:30.440074 | controller | Wednesday 25 February 2026 10:39:30 +0000 (0:00:00.054) 0:05:11.360 **** 2026-02-25 10:39:30.440088 | controller | ok: [instance] 2026-02-25 10:39:30.504961 | controller | 2026-02-25 10:39:30.504984 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-25 10:39:30.504992 | controller | Wednesday 25 February 2026 10:39:30 +0000 (0:00:00.179) 0:05:11.540 **** 2026-02-25 10:39:30.505002 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-25 10:39:30.891971 | controller | 2026-02-25 10:39:30.892013 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-25 10:39:30.892023 | controller | Wednesday 25 February 2026 10:39:30 +0000 (0:00:00.065) 0:05:11.605 **** 2026-02-25 10:39:30.892035 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-25 10:39:30.959866 | controller | 2026-02-25 10:39:30.959883 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-25 10:39:30.959890 | controller | Wednesday 25 February 2026 10:39:30 +0000 (0:00:00.386) 0:05:11.992 **** 2026-02-25 10:39:30.959902 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-25 10:39:31.437335 | controller | skipping: [instance] 2026-02-25 10:39:31.437365 | controller | 2026-02-25 10:39:31.437373 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2026-02-25 10:39:31.437379 | controller | Wednesday 25 February 2026 10:39:30 +0000 (0:00:00.068) 0:05:12.060 **** 2026-02-25 10:39:31.437388 | controller | changed: [instance] 2026-02-25 10:39:32.180837 | controller | 2026-02-25 10:39:32.180869 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-25 10:39:32.180877 | controller | Wednesday 25 February 2026 10:39:31 +0000 (0:00:00.463) 0:05:12.523 **** 2026-02-25 10:39:32.180883 | controller | 2026-02-25 10:39:32.180888 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2026-02-25 10:39:32.180893 | controller | Wednesday 25 February 2026 10:39:31 +0000 (0:00:00.013) 0:05:12.537 **** 2026-02-25 10:39:32.180902 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:32.625812 | controller | 2026-02-25 10:39:32.625900 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-25 10:39:32.625910 | controller | Wednesday 25 February 2026 10:39:32 +0000 (0:00:00.743) 0:05:13.281 **** 2026-02-25 10:39:32.625929 | controller | changed: [instance] 2026-02-25 10:39:32.808394 | controller | 2026-02-25 10:39:32.808444 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2026-02-25 10:39:32.808454 | controller | Wednesday 25 February 2026 10:39:32 +0000 (0:00:00.444) 0:05:13.725 **** 2026-02-25 10:39:32.808466 | controller | skipping: [instance] => (item=controller-0) 2026-02-25 10:39:34.257362 | controller | skipping: [instance] => (item=crc-0) 2026-02-25 10:39:34.257401 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2026-02-25 10:39:34.257409 | controller | 2026-02-25 10:39:34.257415 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2026-02-25 10:39:34.257421 | controller | Wednesday 25 February 2026 10:39:32 +0000 (0:00:00.182) 0:05:13.908 **** 2026-02-25 10:39:34.257432 | controller | changed: [instance -> compute-0(compute-0.instance)] 2026-02-25 10:39:34.275983 | controller | 2026-02-25 10:39:34.276018 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-25 10:39:34.276026 | controller | Wednesday 25 February 2026 10:39:34 +0000 (0:00:01.449) 0:05:15.357 **** 2026-02-25 10:39:34.276037 | controller | skipping: [instance] 2026-02-25 10:39:34.790324 | controller | 2026-02-25 10:39:34.790364 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-25 10:39:34.790374 | controller | Wednesday 25 February 2026 10:39:34 +0000 (0:00:00.019) 0:05:15.376 **** 2026-02-25 10:39:34.790387 | controller | ok: [instance -> compute-0(compute-0.instance)] 2026-02-25 10:39:34.790657 | controller | 2026-02-25 10:39:34.790691 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-25 10:39:34.835536 | controller | Wednesday 25 February 2026 10:39:34 +0000 (0:00:00.513) 0:05:15.890 **** 2026-02-25 10:39:34.835571 | controller | skipping: [instance] 2026-02-25 10:39:34.876238 | controller | 2026-02-25 10:39:34.876269 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-25 10:39:34.876280 | controller | Wednesday 25 February 2026 10:39:34 +0000 (0:00:00.045) 0:05:15.936 **** 2026-02-25 10:39:34.876311 | controller | skipping: [instance] 2026-02-25 10:39:34.912688 | controller | 2026-02-25 10:39:34.912719 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-25 10:39:34.912730 | controller | Wednesday 25 February 2026 10:39:34 +0000 (0:00:00.040) 0:05:15.976 **** 2026-02-25 10:39:34.912744 | controller | skipping: [instance] 2026-02-25 10:39:34.912823 | controller | 2026-02-25 10:39:34.912859 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-25 10:39:34.912984 | controller | Wednesday 25 February 2026 10:39:34 +0000 (0:00:00.036) 0:05:16.013 **** 2026-02-25 10:39:34.959258 | controller | skipping: [instance] 2026-02-25 10:39:34.959362 | controller | 2026-02-25 10:39:34.959390 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2026-02-25 10:39:34.959573 | controller | Wednesday 25 February 2026 10:39:34 +0000 (0:00:00.046) 0:05:16.059 **** 2026-02-25 10:39:34.995419 | controller | skipping: [instance] 2026-02-25 10:39:34.995568 | controller | 2026-02-25 10:39:34.995702 | controller | TASK [reproducer : Create repositories on computes] **************************** 2026-02-25 10:39:34.995830 | controller | Wednesday 25 February 2026 10:39:34 +0000 (0:00:00.036) 0:05:16.096 **** 2026-02-25 10:39:35.020853 | controller | skipping: [instance] 2026-02-25 10:39:35.053288 | controller | 2026-02-25 10:39:35.053346 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2026-02-25 10:39:35.053357 | controller | Wednesday 25 February 2026 10:39:35 +0000 (0:00:00.024) 0:05:16.121 **** 2026-02-25 10:39:35.053372 | controller | skipping: [instance] 2026-02-25 10:39:35.053380 | controller | 2026-02-25 10:39:35.053388 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2026-02-25 10:39:35.053398 | controller | Wednesday 25 February 2026 10:39:35 +0000 (0:00:00.032) 0:05:16.153 **** 2026-02-25 10:39:35.111045 | controller | ok: [instance] 2026-02-25 10:39:35.213610 | controller | 2026-02-25 10:39:35.213640 | controller | TASK [reproducer : Push local code] ******************************************** 2026-02-25 10:39:35.213648 | controller | Wednesday 25 February 2026 10:39:35 +0000 (0:00:00.057) 0:05:16.211 **** 2026-02-25 10:39:35.213658 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2026-02-25 10:39:35.258682 | controller | 2026-02-25 10:39:35.258718 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2026-02-25 10:39:35.258726 | controller | Wednesday 25 February 2026 10:39:35 +0000 (0:00:00.102) 0:05:16.313 **** 2026-02-25 10:39:35.258736 | controller | skipping: [instance] 2026-02-25 10:39:35.300968 | controller | 2026-02-25 10:39:35.300985 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2026-02-25 10:39:35.300992 | controller | Wednesday 25 February 2026 10:39:35 +0000 (0:00:00.044) 0:05:16.358 **** 2026-02-25 10:39:35.301000 | controller | skipping: [instance] 2026-02-25 10:39:35.344807 | controller | 2026-02-25 10:39:35.344951 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2026-02-25 10:39:35.344963 | controller | Wednesday 25 February 2026 10:39:35 +0000 (0:00:00.042) 0:05:16.401 **** 2026-02-25 10:39:35.344990 | controller | skipping: [instance] 2026-02-25 10:39:35.387282 | controller | 2026-02-25 10:39:35.387331 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2026-02-25 10:39:35.387340 | controller | Wednesday 25 February 2026 10:39:35 +0000 (0:00:00.044) 0:05:16.445 **** 2026-02-25 10:39:35.387351 | controller | skipping: [instance] 2026-02-25 10:39:35.387381 | controller | 2026-02-25 10:39:35.387388 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2026-02-25 10:39:35.387459 | controller | Wednesday 25 February 2026 10:39:35 +0000 (0:00:00.042) 0:05:16.488 **** 2026-02-25 10:39:35.437842 | controller | skipping: [instance] 2026-02-25 10:39:35.438035 | controller | 2026-02-25 10:39:35.438251 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2026-02-25 10:39:35.438455 | controller | Wednesday 25 February 2026 10:39:35 +0000 (0:00:00.050) 0:05:16.538 **** 2026-02-25 10:39:35.960711 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2026-02-25 10:39:35.960900 | controller | 2026-02-25 10:39:35.961042 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2026-02-25 10:39:35.961206 | controller | Wednesday 25 February 2026 10:39:35 +0000 (0:00:00.522) 0:05:17.061 **** 2026-02-25 10:39:36.546391 | controller | ok: [instance -> localhost] => (item=ci-framework) 2026-02-25 10:39:36.589097 | controller | 2026-02-25 10:39:36.589135 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2026-02-25 10:39:36.589143 | controller | Wednesday 25 February 2026 10:39:36 +0000 (0:00:00.585) 0:05:17.646 **** 2026-02-25 10:39:36.589170 | controller | skipping: [instance] => (item=ci-framework) 2026-02-25 10:39:36.589193 | controller | skipping: [instance] 2026-02-25 10:39:36.589408 | controller | 2026-02-25 10:39:36.589428 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2026-02-25 10:39:36.668208 | controller | Wednesday 25 February 2026 10:39:36 +0000 (0:00:00.043) 0:05:17.689 **** 2026-02-25 10:39:36.668255 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2026-02-25 10:39:36.668288 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2026-02-25 10:39:36.668304 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2026-02-25 10:39:36.668310 | controller | 2026-02-25 10:39:36.668317 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2026-02-25 10:39:36.668333 | controller | Wednesday 25 February 2026 10:39:36 +0000 (0:00:00.078) 0:05:17.768 **** 2026-02-25 10:39:37.151877 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:37.192945 | controller | 2026-02-25 10:39:37.192977 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2026-02-25 10:39:37.192991 | controller | Wednesday 25 February 2026 10:39:37 +0000 (0:00:00.483) 0:05:18.252 **** 2026-02-25 10:39:37.193002 | controller | skipping: [instance] 2026-02-25 10:39:37.193028 | controller | 2026-02-25 10:39:37.193251 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2026-02-25 10:39:37.693018 | controller | Wednesday 25 February 2026 10:39:37 +0000 (0:00:00.041) 0:05:18.293 **** 2026-02-25 10:39:37.693074 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:37.735864 | controller | 2026-02-25 10:39:37.735912 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2026-02-25 10:39:37.735923 | controller | Wednesday 25 February 2026 10:39:37 +0000 (0:00:00.499) 0:05:18.793 **** 2026-02-25 10:39:37.735937 | controller | skipping: [instance] 2026-02-25 10:39:37.735961 | controller | 2026-02-25 10:39:37.736052 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2026-02-25 10:39:37.736066 | controller | Wednesday 25 February 2026 10:39:37 +0000 (0:00:00.043) 0:05:18.836 **** 2026-02-25 10:39:38.241817 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:39:38.241887 | controller | 2026-02-25 10:39:38.242027 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2026-02-25 10:39:38.242064 | controller | Wednesday 25 February 2026 10:39:38 +0000 (0:00:00.505) 0:05:19.342 **** 2026-02-25 10:39:40.649113 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:00.141518 | controller | 2026-02-25 10:40:00.141563 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2026-02-25 10:40:00.141572 | controller | Wednesday 25 February 2026 10:39:40 +0000 (0:00:02.406) 0:05:21.748 **** 2026-02-25 10:40:00.141584 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:01.282282 | controller | 2026-02-25 10:40:01.282330 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2026-02-25 10:40:01.282341 | controller | Wednesday 25 February 2026 10:40:00 +0000 (0:00:19.490) 0:05:41.239 **** 2026-02-25 10:40:01.282365 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:01.382812 | controller | 2026-02-25 10:40:01.382841 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2026-02-25 10:40:01.382849 | controller | Wednesday 25 February 2026 10:40:01 +0000 (0:00:01.142) 0:05:42.382 **** 2026-02-25 10:40:01.382860 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2026-02-25 10:40:01.383065 | controller | 2026-02-25 10:40:01.383129 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2026-02-25 10:40:01.383201 | controller | Wednesday 25 February 2026 10:40:01 +0000 (0:00:00.101) 0:05:42.483 **** 2026-02-25 10:40:01.922629 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:01.962880 | controller | 2026-02-25 10:40:01.962902 | controller | TASK [reproducer : Rotate log if present] ************************************** 2026-02-25 10:40:01.962913 | controller | Wednesday 25 February 2026 10:40:01 +0000 (0:00:00.539) 0:05:43.022 **** 2026-02-25 10:40:01.962925 | controller | skipping: [instance] 2026-02-25 10:40:02.009727 | controller | 2026-02-25 10:40:02.009748 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2026-02-25 10:40:02.009759 | controller | Wednesday 25 February 2026 10:40:01 +0000 (0:00:00.040) 0:05:43.063 **** 2026-02-25 10:40:02.009770 | controller | skipping: [instance] 2026-02-25 10:40:02.103985 | controller | 2026-02-25 10:40:02.104052 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2026-02-25 10:40:02.104064 | controller | Wednesday 25 February 2026 10:40:02 +0000 (0:00:00.046) 0:05:43.110 **** 2026-02-25 10:40:02.104080 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:02.104119 | controller | 2026-02-25 10:40:02.104182 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-25 10:40:02.104197 | controller | Wednesday 25 February 2026 10:40:02 +0000 (0:00:00.094) 0:05:43.204 **** 2026-02-25 10:40:02.658503 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:02.658566 | controller | 2026-02-25 10:40:02.658576 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-25 10:40:02.658704 | controller | Wednesday 25 February 2026 10:40:02 +0000 (0:00:00.553) 0:05:43.758 **** 2026-02-25 10:40:02.695090 | controller | skipping: [instance] 2026-02-25 10:40:02.731320 | controller | 2026-02-25 10:40:02.731378 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-25 10:40:02.731388 | controller | Wednesday 25 February 2026 10:40:02 +0000 (0:00:00.037) 0:05:43.795 **** 2026-02-25 10:40:02.731400 | controller | skipping: [instance] 2026-02-25 10:40:02.731420 | controller | 2026-02-25 10:40:02.731428 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-25 10:40:02.766176 | controller | Wednesday 25 February 2026 10:40:02 +0000 (0:00:00.036) 0:05:43.832 **** 2026-02-25 10:40:02.766202 | controller | skipping: [instance] 2026-02-25 10:40:02.766265 | controller | 2026-02-25 10:40:02.766351 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-25 10:40:02.766439 | controller | Wednesday 25 February 2026 10:40:02 +0000 (0:00:00.034) 0:05:43.867 **** 2026-02-25 10:40:02.812929 | controller | skipping: [instance] 2026-02-25 10:40:02.812983 | controller | 2026-02-25 10:40:02.813079 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-25 10:40:02.813185 | controller | Wednesday 25 February 2026 10:40:02 +0000 (0:00:00.046) 0:05:43.913 **** 2026-02-25 10:40:04.299198 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:40:04.299283 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:40:04.299323 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:40:04.299458 | controller | changed: [instance -> controller-0] 2026-02-25 10:40:04.299510 | controller | 2026-02-25 10:40:04.299602 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-25 10:40:04.299686 | controller | Wednesday 25 February 2026 10:40:04 +0000 (0:00:01.485) 0:05:45.399 **** 2026-02-25 10:40:05.342252 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:05.342379 | controller | 2026-02-25 10:40:05.342697 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-25 10:40:06.924523 | controller | Wednesday 25 February 2026 10:40:05 +0000 (0:00:01.042) 0:05:46.442 **** 2026-02-25 10:40:06.924596 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:14.819872 | controller | 2026-02-25 10:40:14.819962 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-25 10:40:14.819973 | controller | Wednesday 25 February 2026 10:40:06 +0000 (0:00:01.581) 0:05:48.024 **** 2026-02-25 10:40:14.819988 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:15.778777 | controller | 2026-02-25 10:40:15.778831 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-25 10:40:15.778839 | controller | Wednesday 25 February 2026 10:40:14 +0000 (0:00:07.895) 0:05:55.919 **** 2026-02-25 10:40:15.778852 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:15.778858 | controller | 2026-02-25 10:40:15.778862 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-25 10:40:15.778870 | controller | Wednesday 25 February 2026 10:40:15 +0000 (0:00:00.959) 0:05:56.878 **** 2026-02-25 10:40:15.829666 | controller | skipping: [instance] 2026-02-25 10:40:15.829742 | controller | 2026-02-25 10:40:15.830020 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-25 10:40:17.009634 | controller | Wednesday 25 February 2026 10:40:15 +0000 (0:00:00.051) 0:05:56.930 **** 2026-02-25 10:40:17.009698 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:17.064163 | controller | 2026-02-25 10:40:17.064204 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-25 10:40:17.064213 | controller | Wednesday 25 February 2026 10:40:17 +0000 (0:00:01.179) 0:05:58.109 **** 2026-02-25 10:40:17.064225 | controller | skipping: [instance] 2026-02-25 10:40:17.123954 | controller | 2026-02-25 10:40:17.124011 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-25 10:40:17.124021 | controller | Wednesday 25 February 2026 10:40:17 +0000 (0:00:00.054) 0:05:58.164 **** 2026-02-25 10:40:17.124035 | controller | skipping: [instance] 2026-02-25 10:40:17.181009 | controller | 2026-02-25 10:40:17.181079 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-25 10:40:17.181091 | controller | Wednesday 25 February 2026 10:40:17 +0000 (0:00:00.060) 0:05:58.224 **** 2026-02-25 10:40:17.181109 | controller | skipping: [instance] 2026-02-25 10:40:17.181138 | controller | 2026-02-25 10:40:17.181275 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-25 10:40:17.181295 | controller | Wednesday 25 February 2026 10:40:17 +0000 (0:00:00.057) 0:05:58.281 **** 2026-02-25 10:40:18.126996 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:18.127307 | controller | 2026-02-25 10:40:18.127437 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-25 10:40:18.127485 | controller | Wednesday 25 February 2026 10:40:18 +0000 (0:00:00.945) 0:05:59.227 **** 2026-02-25 10:40:19.099818 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:19.099901 | controller | 2026-02-25 10:40:19.099912 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-25 10:40:19.146818 | controller | Wednesday 25 February 2026 10:40:19 +0000 (0:00:00.972) 0:06:00.199 **** 2026-02-25 10:40:19.146876 | controller | skipping: [instance] 2026-02-25 10:40:19.187318 | controller | 2026-02-25 10:40:19.187373 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-25 10:40:19.187382 | controller | Wednesday 25 February 2026 10:40:19 +0000 (0:00:00.047) 0:06:00.247 **** 2026-02-25 10:40:19.187396 | controller | skipping: [instance] 2026-02-25 10:40:19.187538 | controller | 2026-02-25 10:40:19.187554 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-25 10:40:19.187579 | controller | Wednesday 25 February 2026 10:40:19 +0000 (0:00:00.040) 0:06:00.287 **** 2026-02-25 10:40:19.232989 | controller | skipping: [instance] 2026-02-25 10:40:19.233203 | controller | 2026-02-25 10:40:19.233246 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-25 10:40:19.233278 | controller | Wednesday 25 February 2026 10:40:19 +0000 (0:00:00.045) 0:06:00.333 **** 2026-02-25 10:40:19.296117 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:19.296332 | controller | 2026-02-25 10:40:19.296350 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-25 10:40:19.296464 | controller | Wednesday 25 February 2026 10:40:19 +0000 (0:00:00.062) 0:06:00.396 **** 2026-02-25 10:40:19.350942 | controller | skipping: [instance] 2026-02-25 10:40:19.396715 | controller | 2026-02-25 10:40:19.396742 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-25 10:40:19.396750 | controller | Wednesday 25 February 2026 10:40:19 +0000 (0:00:00.054) 0:06:00.451 **** 2026-02-25 10:40:19.396764 | controller | skipping: [instance] 2026-02-25 10:40:19.396780 | controller | 2026-02-25 10:40:19.396879 | controller | TASK [Download the RPM] ******************************************************** 2026-02-25 10:40:19.397000 | controller | Wednesday 25 February 2026 10:40:19 +0000 (0:00:00.045) 0:06:00.497 **** 2026-02-25 10:40:19.443852 | controller | skipping: [instance] 2026-02-25 10:40:19.443937 | controller | 2026-02-25 10:40:19.444055 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-25 10:40:19.444186 | controller | Wednesday 25 February 2026 10:40:19 +0000 (0:00:00.047) 0:06:00.544 **** 2026-02-25 10:40:19.489426 | controller | skipping: [instance] 2026-02-25 10:40:19.489640 | controller | 2026-02-25 10:40:19.489737 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-25 10:40:19.489816 | controller | Wednesday 25 February 2026 10:40:19 +0000 (0:00:00.045) 0:06:00.590 **** 2026-02-25 10:40:19.537129 | controller | skipping: [instance] 2026-02-25 10:40:19.537254 | controller | 2026-02-25 10:40:19.537390 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-25 10:40:19.537478 | controller | Wednesday 25 February 2026 10:40:19 +0000 (0:00:00.047) 0:06:00.637 **** 2026-02-25 10:40:19.584731 | controller | skipping: [instance] 2026-02-25 10:40:19.584814 | controller | 2026-02-25 10:40:19.584920 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-25 10:40:19.585027 | controller | Wednesday 25 February 2026 10:40:19 +0000 (0:00:00.047) 0:06:00.685 **** 2026-02-25 10:40:19.629120 | controller | skipping: [instance] 2026-02-25 10:40:19.629173 | controller | 2026-02-25 10:40:19.629307 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-25 10:40:19.629391 | controller | Wednesday 25 February 2026 10:40:19 +0000 (0:00:00.044) 0:06:00.730 **** 2026-02-25 10:40:20.130319 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:20.130368 | controller | 2026-02-25 10:40:20.130461 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-25 10:40:20.130545 | controller | Wednesday 25 February 2026 10:40:20 +0000 (0:00:00.500) 0:06:01.230 **** 2026-02-25 10:40:20.183990 | controller | skipping: [instance] 2026-02-25 10:40:20.184085 | controller | 2026-02-25 10:40:20.184217 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-25 10:40:20.184346 | controller | Wednesday 25 February 2026 10:40:20 +0000 (0:00:00.054) 0:06:01.284 **** 2026-02-25 10:40:20.245398 | controller | skipping: [instance] 2026-02-25 10:40:20.245477 | controller | 2026-02-25 10:40:20.245588 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-25 10:40:20.245684 | controller | Wednesday 25 February 2026 10:40:20 +0000 (0:00:00.061) 0:06:01.346 **** 2026-02-25 10:40:20.289658 | controller | skipping: [instance] 2026-02-25 10:40:20.289749 | controller | 2026-02-25 10:40:20.289851 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-25 10:40:20.289936 | controller | Wednesday 25 February 2026 10:40:20 +0000 (0:00:00.044) 0:06:01.390 **** 2026-02-25 10:40:20.347876 | controller | skipping: [instance] 2026-02-25 10:40:20.348122 | controller | 2026-02-25 10:40:20.348139 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-25 10:40:20.348163 | controller | Wednesday 25 February 2026 10:40:20 +0000 (0:00:00.057) 0:06:01.448 **** 2026-02-25 10:40:20.402397 | controller | skipping: [instance] 2026-02-25 10:40:20.402477 | controller | 2026-02-25 10:40:20.402587 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-25 10:40:20.402689 | controller | Wednesday 25 February 2026 10:40:20 +0000 (0:00:00.054) 0:06:01.503 **** 2026-02-25 10:40:20.459700 | controller | skipping: [instance] 2026-02-25 10:40:20.459775 | controller | 2026-02-25 10:40:20.459884 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-25 10:40:20.459970 | controller | Wednesday 25 February 2026 10:40:20 +0000 (0:00:00.056) 0:06:01.560 **** 2026-02-25 10:40:20.515179 | controller | skipping: [instance] 2026-02-25 10:40:20.515251 | controller | 2026-02-25 10:40:20.515367 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-25 10:40:20.515456 | controller | Wednesday 25 February 2026 10:40:20 +0000 (0:00:00.055) 0:06:01.615 **** 2026-02-25 10:40:20.567792 | controller | skipping: [instance] 2026-02-25 10:40:20.567863 | controller | 2026-02-25 10:40:20.567953 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-25 10:40:20.568043 | controller | Wednesday 25 February 2026 10:40:20 +0000 (0:00:00.053) 0:06:01.668 **** 2026-02-25 10:40:21.209084 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:21.209140 | controller | 2026-02-25 10:40:21.209312 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-25 10:40:21.209355 | controller | Wednesday 25 February 2026 10:40:21 +0000 (0:00:00.640) 0:06:02.309 **** 2026-02-25 10:40:22.298737 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:40:22.298788 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:40:22.298796 | controller | changed: [instance -> controller-0] 2026-02-25 10:40:22.298803 | controller | 2026-02-25 10:40:22.298810 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-25 10:40:22.298839 | controller | Wednesday 25 February 2026 10:40:22 +0000 (0:00:01.089) 0:06:03.398 **** 2026-02-25 10:40:23.056546 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:23.056599 | controller | 2026-02-25 10:40:23.056713 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-25 10:40:23.056748 | controller | Wednesday 25 February 2026 10:40:23 +0000 (0:00:00.758) 0:06:04.157 **** 2026-02-25 10:40:23.562317 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:23.562398 | controller | 2026-02-25 10:40:23.562415 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-25 10:40:23.562427 | controller | Wednesday 25 February 2026 10:40:23 +0000 (0:00:00.505) 0:06:04.662 **** 2026-02-25 10:40:23.629327 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:40:23.680308 | controller | ok: [instance -> controller-0] 2026-02-25 10:40:23.680379 | controller | 2026-02-25 10:40:23.680392 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-25 10:40:23.680402 | controller | Wednesday 25 February 2026 10:40:23 +0000 (0:00:00.066) 0:06:04.729 **** 2026-02-25 10:40:23.680421 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:54.273750 | controller | 2026-02-25 10:40:54.273794 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-25 10:40:54.273803 | controller | Wednesday 25 February 2026 10:40:23 +0000 (0:00:00.051) 0:06:04.780 **** 2026-02-25 10:40:54.273814 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:54.738656 | controller | 2026-02-25 10:40:54.738696 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-25 10:40:54.738704 | controller | Wednesday 25 February 2026 10:40:54 +0000 (0:00:30.593) 0:06:35.374 **** 2026-02-25 10:40:54.738722 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:55.193105 | controller | 2026-02-25 10:40:55.193164 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-25 10:40:55.193177 | controller | Wednesday 25 February 2026 10:40:54 +0000 (0:00:00.464) 0:06:35.838 **** 2026-02-25 10:40:55.193189 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:40:55.193209 | controller | 2026-02-25 10:40:55.193398 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-25 10:41:01.226556 | controller | Wednesday 25 February 2026 10:40:55 +0000 (0:00:00.454) 0:06:36.293 **** 2026-02-25 10:41:01.226597 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:01.285525 | controller | 2026-02-25 10:41:01.285547 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-25 10:41:01.285555 | controller | Wednesday 25 February 2026 10:41:01 +0000 (0:00:06.033) 0:06:42.326 **** 2026-02-25 10:41:01.285564 | controller | skipping: [instance] 2026-02-25 10:41:01.285688 | controller | 2026-02-25 10:41:01.285784 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-25 10:41:01.285794 | controller | Wednesday 25 February 2026 10:41:01 +0000 (0:00:00.059) 0:06:42.386 **** 2026-02-25 10:41:01.887560 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:01.887690 | controller | 2026-02-25 10:41:01.887704 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-25 10:41:01.887785 | controller | Wednesday 25 February 2026 10:41:01 +0000 (0:00:00.601) 0:06:42.988 **** 2026-02-25 10:41:02.387641 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:02.387693 | controller | 2026-02-25 10:41:02.387757 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-25 10:41:02.387827 | controller | Wednesday 25 February 2026 10:41:02 +0000 (0:00:00.499) 0:06:43.488 **** 2026-02-25 10:41:02.434074 | controller | skipping: [instance] 2026-02-25 10:41:02.434098 | controller | 2026-02-25 10:41:02.434105 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-25 10:41:02.434112 | controller | Wednesday 25 February 2026 10:41:02 +0000 (0:00:00.046) 0:06:43.534 **** 2026-02-25 10:41:02.477257 | controller | skipping: [instance] 2026-02-25 10:41:02.477437 | controller | 2026-02-25 10:41:02.477449 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-25 10:41:02.523654 | controller | Wednesday 25 February 2026 10:41:02 +0000 (0:00:00.043) 0:06:43.577 **** 2026-02-25 10:41:02.523685 | controller | skipping: [instance] 2026-02-25 10:41:02.571847 | controller | 2026-02-25 10:41:02.571878 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-25 10:41:02.571888 | controller | Wednesday 25 February 2026 10:41:02 +0000 (0:00:00.046) 0:06:43.624 **** 2026-02-25 10:41:02.571901 | controller | skipping: [instance] 2026-02-25 10:41:02.572793 | controller | 2026-02-25 10:41:02.572814 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-25 10:41:02.572965 | controller | Wednesday 25 February 2026 10:41:02 +0000 (0:00:00.048) 0:06:43.672 **** 2026-02-25 10:41:02.616138 | controller | skipping: [instance] 2026-02-25 10:41:02.616203 | controller | 2026-02-25 10:41:02.616214 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-25 10:41:02.616369 | controller | Wednesday 25 February 2026 10:41:02 +0000 (0:00:00.044) 0:06:43.716 **** 2026-02-25 10:41:02.661892 | controller | skipping: [instance] 2026-02-25 10:41:05.315509 | controller | 2026-02-25 10:41:05.315556 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-25 10:41:05.315566 | controller | Wednesday 25 February 2026 10:41:02 +0000 (0:00:00.045) 0:06:43.762 **** 2026-02-25 10:41:05.315578 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:41:05.557674 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:41:05.557725 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:41:05.557741 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:41:05.557748 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:41:05.557754 | controller | changed: [instance -> controller-0] 2026-02-25 10:41:05.557766 | controller | 2026-02-25 10:41:05.557773 | controller | TASK [Prepare install_yamls make targets] ************************************** 2026-02-25 10:41:05.557779 | controller | Wednesday 25 February 2026 10:41:05 +0000 (0:00:02.653) 0:06:46.415 **** 2026-02-25 10:41:05.557793 | controller | 2026-02-25 10:41:06.999588 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2026-02-25 10:41:06.999632 | controller | Wednesday 25 February 2026 10:41:05 +0000 (0:00:00.243) 0:06:46.658 **** 2026-02-25 10:41:06.999646 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:41:06.999761 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:41:06.999769 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:41:06.999777 | controller | changed: [instance -> controller-0] 2026-02-25 10:41:06.999858 | controller | 2026-02-25 10:41:06.999962 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2026-02-25 10:41:07.000067 | controller | Wednesday 25 February 2026 10:41:06 +0000 (0:00:01.441) 0:06:48.100 **** 2026-02-25 10:41:07.058076 | controller | 2026-02-25 10:41:07.058167 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2026-02-25 10:41:07.058315 | controller | Wednesday 25 February 2026 10:41:07 +0000 (0:00:00.058) 0:06:48.158 **** 2026-02-25 10:41:07.101073 | controller | skipping: [instance] 2026-02-25 10:41:07.101133 | controller | 2026-02-25 10:41:07.101259 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2026-02-25 10:41:07.101344 | controller | Wednesday 25 February 2026 10:41:07 +0000 (0:00:00.042) 0:06:48.201 **** 2026-02-25 10:41:07.147928 | controller | skipping: [instance] 2026-02-25 10:41:07.148022 | controller | 2026-02-25 10:41:07.148139 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2026-02-25 10:41:07.148293 | controller | Wednesday 25 February 2026 10:41:07 +0000 (0:00:00.046) 0:06:48.248 **** 2026-02-25 10:41:07.214411 | controller | 2026-02-25 10:41:07.214485 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-25 10:41:07.214612 | controller | Wednesday 25 February 2026 10:41:07 +0000 (0:00:00.066) 0:06:48.315 **** 2026-02-25 10:41:07.256158 | controller | skipping: [instance] 2026-02-25 10:41:07.256249 | controller | 2026-02-25 10:41:07.256353 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-25 10:41:07.256459 | controller | Wednesday 25 February 2026 10:41:07 +0000 (0:00:00.041) 0:06:48.357 **** 2026-02-25 10:41:07.297667 | controller | skipping: [instance] 2026-02-25 10:41:07.297755 | controller | 2026-02-25 10:41:07.297862 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-25 10:41:07.297949 | controller | Wednesday 25 February 2026 10:41:07 +0000 (0:00:00.041) 0:06:48.398 **** 2026-02-25 10:41:07.338075 | controller | skipping: [instance] 2026-02-25 10:41:07.338139 | controller | 2026-02-25 10:41:07.338292 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-25 10:41:07.338407 | controller | Wednesday 25 February 2026 10:41:07 +0000 (0:00:00.040) 0:06:48.438 **** 2026-02-25 10:41:07.385798 | controller | skipping: [instance] 2026-02-25 10:41:07.385865 | controller | 2026-02-25 10:41:07.385961 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2026-02-25 10:41:07.386052 | controller | Wednesday 25 February 2026 10:41:07 +0000 (0:00:00.047) 0:06:48.486 **** 2026-02-25 10:41:07.485310 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 10:41:07.485384 | controller | ok: [instance -> controller-0] 2026-02-25 10:41:07.485464 | controller | 2026-02-25 10:41:07.485555 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2026-02-25 10:41:07.485642 | controller | Wednesday 25 February 2026 10:41:07 +0000 (0:00:00.099) 0:06:48.585 **** 2026-02-25 10:41:07.554609 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:07.554708 | controller | 2026-02-25 10:41:07.554829 | controller | TASK [install_yamls : Get environment structure] ******************************* 2026-02-25 10:41:07.554943 | controller | Wednesday 25 February 2026 10:41:07 +0000 (0:00:00.069) 0:06:48.655 **** 2026-02-25 10:41:08.467473 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:08.467669 | controller | 2026-02-25 10:41:08.467708 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2026-02-25 10:41:08.467719 | controller | Wednesday 25 February 2026 10:41:08 +0000 (0:00:00.912) 0:06:49.567 **** 2026-02-25 10:41:08.510284 | controller | skipping: [instance] 2026-02-25 10:41:08.510318 | controller | 2026-02-25 10:41:08.510336 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2026-02-25 10:41:08.510349 | controller | Wednesday 25 February 2026 10:41:08 +0000 (0:00:00.043) 0:06:49.610 **** 2026-02-25 10:41:08.559917 | controller | skipping: [instance] 2026-02-25 10:41:08.559955 | controller | 2026-02-25 10:41:08.559964 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2026-02-25 10:41:08.559973 | controller | Wednesday 25 February 2026 10:41:08 +0000 (0:00:00.049) 0:06:49.660 **** 2026-02-25 10:41:08.601794 | controller | skipping: [instance] 2026-02-25 10:41:08.663950 | controller | 2026-02-25 10:41:08.663997 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2026-02-25 10:41:08.664007 | controller | Wednesday 25 February 2026 10:41:08 +0000 (0:00:00.041) 0:06:49.702 **** 2026-02-25 10:41:08.664019 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:08.712310 | controller | 2026-02-25 10:41:08.712335 | controller | TASK [install_yamls : Show the env structure] ********************************** 2026-02-25 10:41:08.712344 | controller | Wednesday 25 February 2026 10:41:08 +0000 (0:00:00.062) 0:06:49.764 **** 2026-02-25 10:41:08.712355 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:08.712511 | controller | 2026-02-25 10:41:08.712647 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2026-02-25 10:41:08.712776 | controller | Wednesday 25 February 2026 10:41:08 +0000 (0:00:00.048) 0:06:49.812 **** 2026-02-25 10:41:08.765691 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:08.765834 | controller | 2026-02-25 10:41:08.765849 | controller | TASK [install_yamls : Generate make targets] *********************************** 2026-02-25 10:41:08.765873 | controller | Wednesday 25 February 2026 10:41:08 +0000 (0:00:00.053) 0:06:49.866 **** 2026-02-25 10:41:09.408187 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:09.408253 | controller | 2026-02-25 10:41:09.408353 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2026-02-25 10:41:09.408442 | controller | Wednesday 25 February 2026 10:41:09 +0000 (0:00:00.642) 0:06:50.508 **** 2026-02-25 10:41:09.453273 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:09.453358 | controller | 2026-02-25 10:41:09.453458 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2026-02-25 10:41:09.453564 | controller | Wednesday 25 February 2026 10:41:09 +0000 (0:00:00.045) 0:06:50.554 **** 2026-02-25 10:41:10.350018 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:10.350079 | controller | 2026-02-25 10:41:10.350235 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2026-02-25 10:41:10.350329 | controller | Wednesday 25 February 2026 10:41:10 +0000 (0:00:00.896) 0:06:51.450 **** 2026-02-25 10:41:10.397939 | controller | skipping: [instance] 2026-02-25 10:41:10.397999 | controller | 2026-02-25 10:41:10.398160 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-25 10:41:10.398254 | controller | Wednesday 25 February 2026 10:41:10 +0000 (0:00:00.048) 0:06:51.498 **** 2026-02-25 10:41:11.087600 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:11.087665 | controller | 2026-02-25 10:41:11.087742 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-25 10:41:11.087829 | controller | Wednesday 25 February 2026 10:41:11 +0000 (0:00:00.688) 0:06:52.187 **** 2026-02-25 10:41:11.142671 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:11.142715 | controller | 2026-02-25 10:41:11.142848 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2026-02-25 10:41:11.142955 | controller | Wednesday 25 February 2026 10:41:11 +0000 (0:00:00.056) 0:06:52.243 **** 2026-02-25 10:41:12.090607 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:12.090667 | controller | 2026-02-25 10:41:12.090880 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2026-02-25 10:41:12.582039 | controller | Wednesday 25 February 2026 10:41:12 +0000 (0:00:00.947) 0:06:53.191 **** 2026-02-25 10:41:12.582085 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 10:41:12.729996 | controller | 2026-02-25 10:41:12.730029 | controller | TASK [Configure CRC network if needed] ***************************************** 2026-02-25 10:41:12.730045 | controller | Wednesday 25 February 2026 10:41:12 +0000 (0:00:00.491) 0:06:53.682 **** 2026-02-25 10:41:12.730057 | controller | 2026-02-25 10:41:13.887769 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2026-02-25 10:41:13.887813 | controller | Wednesday 25 February 2026 10:41:12 +0000 (0:00:00.148) 0:06:53.830 **** 2026-02-25 10:41:13.887826 | controller | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-25 10:41:13.889561 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false 2026-02-25 10:41:13.889596 | controller | module_stderr: |- 2026-02-25 10:41:13.889607 | controller | Shared connection to controller-0.utility closed. 2026-02-25 10:41:13.889687 | controller | module_stdout: |- 2026-02-25 10:41:13.889774 | controller | Traceback (most recent call last): 2026-02-25 10:41:13.889864 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 700, in urlopen 2026-02-25 10:41:13.889955 | controller | httplib_response = self._make_request( 2026-02-25 10:41:13.890082 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 383, in _make_request 2026-02-25 10:41:13.890161 | controller | self._validate_conn(conn) 2026-02-25 10:41:13.890278 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1015, in _validate_conn 2026-02-25 10:41:13.890348 | controller | conn.connect() 2026-02-25 10:41:13.890425 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connection.py", line 411, in connect 2026-02-25 10:41:13.890536 | controller | self.sock = ssl_wrap_socket( 2026-02-25 10:41:13.890599 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket 2026-02-25 10:41:13.890681 | controller | ssl_sock = _ssl_wrap_socket_impl( 2026-02-25 10:41:13.890766 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl 2026-02-25 10:41:13.890853 | controller | return ssl_context.wrap_socket(sock, server_hostname=server_hostname) 2026-02-25 10:41:13.890940 | controller | File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket 2026-02-25 10:41:13.891049 | controller | return self.sslsocket_class._create( 2026-02-25 10:41:13.891160 | controller | File "/usr/lib64/python3.9/ssl.py", line 1076, in _create 2026-02-25 10:41:13.891264 | controller | self.do_handshake() 2026-02-25 10:41:13.891341 | controller | File "/usr/lib64/python3.9/ssl.py", line 1345, in do_handshake 2026-02-25 10:41:13.891425 | controller | self._sslobj.do_handshake() 2026-02-25 10:41:13.891533 | controller | ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147) 2026-02-25 10:41:13.891596 | controller | 2026-02-25 10:41:13.891679 | controller | During handling of the above exception, another exception occurred: 2026-02-25 10:41:13.891757 | controller | 2026-02-25 10:41:13.891841 | controller | Traceback (most recent call last): 2026-02-25 10:41:13.891930 | controller | File "/tmp/ansible-tmp-1772016072.762881-28237-248398797127071/AnsiballZ_k8s_info.py", line 107, in 2026-02-25 10:41:13.892037 | controller | _ansiballz_main() 2026-02-25 10:41:13.892120 | controller | File "/tmp/ansible-tmp-1772016072.762881-28237-248398797127071/AnsiballZ_k8s_info.py", line 99, in _ansiballz_main 2026-02-25 10:41:13.892247 | controller | invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS) 2026-02-25 10:41:13.892320 | controller | File "/tmp/ansible-tmp-1772016072.762881-28237-248398797127071/AnsiballZ_k8s_info.py", line 47, in invoke_module 2026-02-25 10:41:13.892407 | controller | runpy.run_module(mod_name='ansible_collections.kubernetes.core.plugins.modules.k8s_info', init_globals=dict(_module_fqn='ansible_collections.kubernetes.core.plugins.modules.k8s_info', _modlib_path=modlib_path), 2026-02-25 10:41:13.892515 | controller | File "/usr/lib64/python3.9/runpy.py", line 225, in run_module 2026-02-25 10:41:13.892588 | controller | return _run_module_code(code, init_globals, run_name, mod_spec) 2026-02-25 10:41:13.892661 | controller | File "/usr/lib64/python3.9/runpy.py", line 97, in _run_module_code 2026-02-25 10:41:13.892743 | controller | _run_code(code, mod_globals, init_globals, 2026-02-25 10:41:13.892827 | controller | File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-25 10:41:13.892909 | controller | exec(code, run_globals) 2026-02-25 10:41:13.893013 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_0mrcomdt/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 229, in 2026-02-25 10:41:13.893101 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_0mrcomdt/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 221, in main 2026-02-25 10:41:13.893205 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_0mrcomdt/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 352, in get_api_client 2026-02-25 10:41:13.893310 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_0mrcomdt/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 246, in wrapper 2026-02-25 10:41:13.893389 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_0mrcomdt/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 259, in create_api_client 2026-02-25 10:41:13.893507 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 84, in __init__ 2026-02-25 10:41:13.893581 | controller | self.__discoverer = discoverer(self, cache_file) 2026-02-25 10:41:13.893662 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_0mrcomdt/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 190, in __init__ 2026-02-25 10:41:13.893737 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_0mrcomdt/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 45, in __init__ 2026-02-25 10:41:13.893822 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_0mrcomdt/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 92, in __init_cache 2026-02-25 10:41:13.893919 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/discovery.py", line 146, in _load_server_info 2026-02-25 10:41:13.894016 | controller | 'kubernetes': self.client.request('get', '/version', serializer=just_json) 2026-02-25 10:41:13.894092 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-25 10:41:13.894188 | controller | resp = func(self, *args, **kwargs) 2026-02-25 10:41:13.894283 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 277, in request 2026-02-25 10:41:13.894364 | controller | api_response = self.client.call_api( 2026-02-25 10:41:13.894489 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-25 10:41:13.894549 | controller | return self.__call_api(resource_path, method, 2026-02-25 10:41:13.894635 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-25 10:41:13.894724 | controller | response_data = self.request( 2026-02-25 10:41:13.894805 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-25 10:41:13.894875 | controller | return self.rest_client.GET(url, 2026-02-25 10:41:13.894958 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-25 10:41:13.895063 | controller | return self.request("GET", url, 2026-02-25 10:41:13.895131 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 217, in request 2026-02-25 10:41:13.897727 | controller | r = self.pool_manager.request(method, url, 2026-02-25 10:41:13.897921 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 74, in request 2026-02-25 10:41:13.898007 | controller | return self.request_encode_url( 2026-02-25 10:41:13.898094 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 96, in request_encode_url 2026-02-25 10:41:13.898197 | controller | return self.urlopen(method, url, **extra_kw) 2026-02-25 10:41:13.898297 | controller | File "/usr/lib/python3.9/site-packages/urllib3/poolmanager.py", line 376, in urlopen 2026-02-25 10:41:13.898381 | controller | response = conn.urlopen(method, u.request_uri, **kw) 2026-02-25 10:41:13.898466 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-25 10:41:13.898745 | controller | return self.urlopen( 2026-02-25 10:41:13.898821 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-25 10:41:13.898905 | controller | return self.urlopen( 2026-02-25 10:41:13.898989 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-25 10:41:13.899075 | controller | return self.urlopen( 2026-02-25 10:41:13.899182 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 756, in urlopen 2026-02-25 10:41:13.899271 | controller | retries = retries.increment( 2026-02-25 10:41:13.899357 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 576, in increment 2026-02-25 10:41:13.899578 | controller | raise MaxRetryError(_pool, url, error or ResponseError(cause)) 2026-02-25 10:41:13.899674 | controller | urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-25 10:41:13.899762 | controller | msg: |- 2026-02-25 10:41:13.899845 | controller | MODULE FAILURE 2026-02-25 10:41:13.899929 | controller | See stdout/stderr for the exact error 2026-02-25 10:41:13.900013 | controller | rc: 1 2026-02-25 10:41:13.902603 | controller | 2026-02-25 10:41:13.902703 | controller | TASK [Create dnsmasq dir] ****************************************************** 2026-02-25 10:41:13.902784 | controller | Wednesday 25 February 2026 10:41:13 +0000 (0:00:01.171) 0:06:55.002 **** 2026-02-25 10:41:14.112080 | controller | changed: [instance] 2026-02-25 10:41:14.112130 | controller | 2026-02-25 10:41:14.112286 | controller | TASK [Get journalctl in a file] ************************************************ 2026-02-25 10:41:14.112382 | controller | Wednesday 25 February 2026 10:41:14 +0000 (0:00:00.210) 0:06:55.212 **** 2026-02-25 10:41:14.341089 | controller | changed: [instance] 2026-02-25 10:41:14.341193 | controller | 2026-02-25 10:41:14.341331 | controller | TASK [Dump journalctl output] ************************************************** 2026-02-25 10:41:14.341422 | controller | Wednesday 25 February 2026 10:41:14 +0000 (0:00:00.228) 0:06:55.441 **** 2026-02-25 10:41:14.749447 | controller | changed: [instance] 2026-02-25 10:41:14.749505 | controller | 2026-02-25 10:41:14.749580 | controller | TASK [Copy all dnsmasq config] ************************************************* 2026-02-25 10:41:14.749677 | controller | Wednesday 25 February 2026 10:41:14 +0000 (0:00:00.408) 0:06:55.850 **** 2026-02-25 10:41:15.246965 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-25 10:41:15.247019 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2026-02-25 10:41:15.247100 | controller | 2026-02-25 10:41:15.247227 | controller | TASK [Create log directory] **************************************************** 2026-02-25 10:41:15.247332 | controller | Wednesday 25 February 2026 10:41:15 +0000 (0:00:00.497) 0:06:56.347 **** 2026-02-25 10:41:15.456217 | controller | changed: [instance] 2026-02-25 10:41:15.456304 | controller | 2026-02-25 10:41:15.456401 | controller | TASK [Sync logs from controller-0] ********************************************* 2026-02-25 10:41:15.456491 | controller | Wednesday 25 February 2026 10:41:15 +0000 (0:00:00.209) 0:06:56.556 **** 2026-02-25 10:41:16.338806 | controller | changed: [instance] 2026-02-25 10:41:16.338868 | controller | 2026-02-25 10:41:16.339172 | controller | PLAY RECAP ********************************************************************* 2026-02-25 10:41:16.339205 | controller | instance : ok=541 changed=208 unreachable=0 failed=1 skipped=229 rescued=0 ignored=0 2026-02-25 10:41:16.339224 | controller | 2026-02-25 10:41:16.339300 | controller | Wednesday 25 February 2026 10:41:16 +0000 (0:00:00.880) 0:06:57.437 **** 2026-02-25 10:41:16.339447 | controller | =============================================================================== 2026-02-25 10:41:16.339475 | controller | reproducer : Check package install status ------------------------------ 39.71s 2026-02-25 10:41:16.339559 | controller | ci_setup : Install needed packages ------------------------------------- 30.59s 2026-02-25 10:41:16.339646 | controller | libvirt_manager : Download base image ---------------------------------- 29.55s 2026-02-25 10:41:16.339736 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 22.86s 2026-02-25 10:41:16.339826 | controller | reproducer : Install collections on controller-0 ----------------------- 19.49s 2026-02-25 10:41:16.339916 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.59s 2026-02-25 10:41:16.340052 | controller | ci_nmstate : Install required packages on localhost -------------------- 10.58s 2026-02-25 10:41:16.340108 | controller | libvirt_manager : Install packages required for using KVM --------------- 8.94s 2026-02-25 10:41:16.340231 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.90s 2026-02-25 10:41:16.340323 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 7.76s 2026-02-25 10:41:16.340443 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.12s 2026-02-25 10:41:16.340534 | controller | ci_setup : Install openshift client ------------------------------------- 6.03s 2026-02-25 10:41:16.340852 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.52s 2026-02-25 10:41:16.340885 | controller | networking_mapper : Gather the facts ------------------------------------ 3.41s 2026-02-25 10:41:16.340892 | controller | dnsmasq : Add/Remove address -------------------------------------------- 2.91s 2026-02-25 10:41:16.340900 | controller | ci_setup : Manage directories ------------------------------------------- 2.65s 2026-02-25 10:41:16.340979 | controller | sushy_emulator : Install required packages ------------------------------ 2.47s 2026-02-25 10:41:16.341068 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.41s 2026-02-25 10:41:16.341177 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.22s 2026-02-25 10:41:16.341278 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2026-02-25 10:41:16.475838 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2026-02-25 10:41:16.476312 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2026-02-25 10:41:16.485339 | controller | INFO Running crc_layout > cleanup 2026-02-25 10:41:16.485764 | controller | WARNING Skipping, cleanup playbook not configured. 2026-02-25 10:41:16.493374 | controller | INFO Running crc_layout > destroy 2026-02-25 10:41:16.493663 | controller | WARNING Skipping, instances are delegated. 2026-02-25 10:41:16.493966 | controller | INFO Pruning extra files from scenario ephemeral directory 2026-02-25 10:41:16.495457 | controller | INFO Writing /tmp/report.html report. 2026-02-25 10:41:16.815989 | [controller] Waiting on logger 2026-02-25 10:41:21.979840 | [controller] Waiting on logger 2026-02-25 10:41:32.411775 | [controller] Waiting on logger 2026-02-25 10:41:42.843809 | [controller] Waiting on logger 2026-02-25 10:41:46.607328 | [Zuul] Log Stream did not terminate 2026-02-25 10:41:46.607663 | controller | ERROR 2026-02-25 10:41:46.607786 | controller | { 2026-02-25 10:41:46.607834 | controller | "delta": "0:08:34.025898", 2026-02-25 10:41:46.607867 | controller | "end": "2026-02-25 10:41:16.563274", 2026-02-25 10:41:46.607889 | controller | "msg": "non-zero return code", 2026-02-25 10:41:46.607906 | controller | "rc": 1, 2026-02-25 10:41:46.607922 | controller | "start": "2026-02-25 10:32:42.537376" 2026-02-25 10:41:46.607937 | controller | } failure 2026-02-25 10:41:46.657538 | 2026-02-25 10:41:46.657637 | PLAY RECAP 2026-02-25 10:41:46.657680 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2026-02-25 10:41:46.657702 | 2026-02-25 10:41:46.727808 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-25 10:41:46.728591 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-25 10:41:47.248923 | 2026-02-25 10:41:47.249051 | PLAY [Run ci/playbooks/collect-logs.yml] 2026-02-25 10:41:47.269220 | 2026-02-25 10:41:47.269326 | TASK [Filter out host if needed] 2026-02-25 10:41:47.277788 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2026-02-25 10:41:47.282188 | 2026-02-25 10:41:47.282257 | TASK [Ensure file is present] 2026-02-25 10:41:47.666701 | controller | ok 2026-02-25 10:41:47.672043 | 2026-02-25 10:41:47.672107 | TASK [Manage molecule report file] 2026-02-25 10:41:47.692765 | [controller] Waiting on logger 2026-02-25 10:41:56.988196 | [controller] Waiting on logger 2026-02-25 10:42:07.420027 | [controller] Waiting on logger 2026-02-25 10:42:17.851860 | [controller] Waiting on logger 2026-02-25 10:42:18.074865 | [Zuul] Log Stream did not terminate 2026-02-25 10:42:18.075152 | controller | changed 2026-02-25 10:42:18.080029 | 2026-02-25 10:42:18.080088 | TASK [Check if we get ci-framework-data basedir] 2026-02-25 10:42:18.371944 | controller | ok 2026-02-25 10:42:18.376854 | 2026-02-25 10:42:18.376926 | TASK [Create ci-framework-data log directory for zuul] 2026-02-25 10:42:18.749200 | controller | changed 2026-02-25 10:42:18.754800 | 2026-02-25 10:42:18.754867 | TASK [Copy ci-framework interesting files] 2026-02-25 10:42:19.835792 | [controller] Waiting on logger 2026-02-25 10:42:30.267981 | [controller] Waiting on logger 2026-02-25 10:42:40.700059 | [controller] Waiting on logger 2026-02-25 10:42:49.065161 | [Zuul] Log Stream did not terminate 2026-02-25 10:42:49.065445 | controller | changed 2026-02-25 10:42:49.070525 | 2026-02-25 10:42:49.070590 | TASK [Get SELinux listing] 2026-02-25 10:42:50.044089 | [controller] Waiting on logger 2026-02-25 10:42:52.157802 | [controller] Waiting on logger 2026-02-25 10:43:08.667982 | [controller] Waiting on logger 2026-02-25 10:43:14.666667 | controller | changed 2026-02-25 10:43:14.672522 | 2026-02-25 10:43:14.672609 | TASK [Generate log index] 2026-02-25 10:43:15.919822 | controller | changed 2026-02-25 10:43:15.924966 | 2026-02-25 10:43:15.925039 | TASK [Get some env related data] 2026-02-25 10:43:15.945980 | [controller] Waiting on logger 2026-02-25 10:43:26.331863 | [controller] Waiting on logger 2026-02-25 10:43:36.763788 | [controller] Waiting on logger 2026-02-25 10:43:46.108000 | [controller] Waiting on logger 2026-02-25 10:43:47.261678 | [Zuul] Log Stream did not terminate 2026-02-25 10:43:47.261880 | controller | changed 2026-02-25 10:43:47.267056 | 2026-02-25 10:43:47.267116 | TASK [Generate list of logs to collect in home directory] 2026-02-25 10:43:47.607494 | controller | ok: All paths examined 2026-02-25 10:43:47.612556 | 2026-02-25 10:43:47.612615 | LOOP [Copy logs from home directory] 2026-02-25 10:43:48.170256 | controller | changed: 2026-02-25 10:43:48.170483 | controller | { 2026-02-25 10:43:48.170511 | controller | "atime": 1743544925.4788878, 2026-02-25 10:43:48.170530 | controller | "ctime": 1743545329.1409318, 2026-02-25 10:43:48.170546 | controller | "dev": 64513, 2026-02-25 10:43:48.170561 | controller | "gid": 1000, 2026-02-25 10:43:48.170581 | controller | "gr_name": "zuul", 2026-02-25 10:43:48.170597 | controller | "inode": 4518807, 2026-02-25 10:43:48.170610 | controller | "isblk": false, 2026-02-25 10:43:48.170623 | controller | "ischr": false, 2026-02-25 10:43:48.170636 | controller | "isdir": false, 2026-02-25 10:43:48.170648 | controller | "isfifo": false, 2026-02-25 10:43:48.170661 | controller | "isgid": false, 2026-02-25 10:43:48.170673 | controller | "islnk": false, 2026-02-25 10:43:48.170688 | controller | "isreg": true, 2026-02-25 10:43:48.170701 | controller | "issock": false, 2026-02-25 10:43:48.170713 | controller | "isuid": false, 2026-02-25 10:43:48.170725 | controller | "mode": "0644", 2026-02-25 10:43:48.170737 | controller | "mtime": 1743545329.1409318, 2026-02-25 10:43:48.170749 | controller | "nlink": 1, 2026-02-25 10:43:48.170762 | controller | "path": "/home/zuul/crc-setup.log", 2026-02-25 10:43:48.170774 | controller | "pw_name": "zuul", 2026-02-25 10:43:48.170787 | controller | "rgrp": true, 2026-02-25 10:43:48.170800 | controller | "roth": true, 2026-02-25 10:43:48.170814 | controller | "rusr": true, 2026-02-25 10:43:48.170827 | controller | "size": 4108, 2026-02-25 10:43:48.170839 | controller | "uid": 1000, 2026-02-25 10:43:48.170851 | controller | "wgrp": false, 2026-02-25 10:43:48.170863 | controller | "woth": false, 2026-02-25 10:43:48.170875 | controller | "wusr": true, 2026-02-25 10:43:48.170887 | controller | "xgrp": false, 2026-02-25 10:43:48.170899 | controller | "xoth": false, 2026-02-25 10:43:48.170911 | controller | "xusr": false 2026-02-25 10:43:48.170923 | controller | } 2026-02-25 10:43:48.717762 | controller | changed: 2026-02-25 10:43:48.717817 | controller | { 2026-02-25 10:43:48.717840 | controller | "atime": 1743545331.0429637, 2026-02-25 10:43:48.717857 | controller | "ctime": 1743545842.0111232, 2026-02-25 10:43:48.717873 | controller | "dev": 64513, 2026-02-25 10:43:48.717887 | controller | "gid": 1000, 2026-02-25 10:43:48.717901 | controller | "gr_name": "zuul", 2026-02-25 10:43:48.717914 | controller | "inode": 4194437, 2026-02-25 10:43:48.717933 | controller | "isblk": false, 2026-02-25 10:43:48.717947 | controller | "ischr": false, 2026-02-25 10:43:48.717959 | controller | "isdir": false, 2026-02-25 10:43:48.717986 | controller | "isfifo": false, 2026-02-25 10:43:48.718001 | controller | "isgid": false, 2026-02-25 10:43:48.718015 | controller | "islnk": false, 2026-02-25 10:43:48.718027 | controller | "isreg": true, 2026-02-25 10:43:48.718040 | controller | "issock": false, 2026-02-25 10:43:48.718053 | controller | "isuid": false, 2026-02-25 10:43:48.718066 | controller | "mode": "0644", 2026-02-25 10:43:48.718079 | controller | "mtime": 1743545842.0111232, 2026-02-25 10:43:48.718093 | controller | "nlink": 1, 2026-02-25 10:43:48.718107 | controller | "path": "/home/zuul/crc-start.log", 2026-02-25 10:43:48.718120 | controller | "pw_name": "zuul", 2026-02-25 10:43:48.718134 | controller | "rgrp": true, 2026-02-25 10:43:48.718147 | controller | "roth": true, 2026-02-25 10:43:48.718161 | controller | "rusr": true, 2026-02-25 10:43:48.718175 | controller | "size": 4023, 2026-02-25 10:43:48.718188 | controller | "uid": 1000, 2026-02-25 10:43:48.718201 | controller | "wgrp": false, 2026-02-25 10:43:48.718213 | controller | "woth": false, 2026-02-25 10:43:48.718226 | controller | "wusr": true, 2026-02-25 10:43:48.718238 | controller | "xgrp": false, 2026-02-25 10:43:48.718250 | controller | "xoth": false, 2026-02-25 10:43:48.718262 | controller | "xusr": false 2026-02-25 10:43:48.718274 | controller | } 2026-02-25 10:43:49.266633 | controller | changed: 2026-02-25 10:43:49.266718 | controller | { 2026-02-25 10:43:49.266745 | controller | "atime": 1772015544.5907357, 2026-02-25 10:43:49.266764 | controller | "ctime": 1772015560.2909572, 2026-02-25 10:43:49.266781 | controller | "dev": 64513, 2026-02-25 10:43:49.266797 | controller | "gid": 1000, 2026-02-25 10:43:49.266812 | controller | "gr_name": "zuul", 2026-02-25 10:43:49.266826 | controller | "inode": 4686299, 2026-02-25 10:43:49.266910 | controller | "isblk": false, 2026-02-25 10:43:49.266940 | controller | "ischr": false, 2026-02-25 10:43:49.266959 | controller | "isdir": false, 2026-02-25 10:43:49.267111 | controller | "isfifo": false, 2026-02-25 10:43:49.267131 | controller | "isgid": false, 2026-02-25 10:43:49.267147 | controller | "islnk": false, 2026-02-25 10:43:49.267161 | controller | "isreg": true, 2026-02-25 10:43:49.267176 | controller | "issock": false, 2026-02-25 10:43:49.267189 | controller | "isuid": false, 2026-02-25 10:43:49.267203 | controller | "mode": "0644", 2026-02-25 10:43:49.267216 | controller | "mtime": 1772015560.2909572, 2026-02-25 10:43:49.267230 | controller | "nlink": 1, 2026-02-25 10:43:49.267244 | controller | "path": "/home/zuul/ansible.log", 2026-02-25 10:43:49.267259 | controller | "pw_name": "zuul", 2026-02-25 10:43:49.267274 | controller | "rgrp": true, 2026-02-25 10:43:49.267288 | controller | "roth": true, 2026-02-25 10:43:49.267325 | controller | "rusr": true, 2026-02-25 10:43:49.267342 | controller | "size": 6749, 2026-02-25 10:43:49.267357 | controller | "uid": 1000, 2026-02-25 10:43:49.267370 | controller | "wgrp": false, 2026-02-25 10:43:49.267383 | controller | "woth": false, 2026-02-25 10:43:49.267395 | controller | "wusr": true, 2026-02-25 10:43:49.267407 | controller | "xgrp": false, 2026-02-25 10:43:49.267420 | controller | "xoth": false, 2026-02-25 10:43:49.267432 | controller | "xusr": false 2026-02-25 10:43:49.267445 | controller | } 2026-02-25 10:43:49.283157 | 2026-02-25 10:43:49.283223 | TASK [Copy crio stats log file] 2026-02-25 10:43:49.296553 | controller | skipping: Conditional result was False 2026-02-25 10:43:49.301579 | 2026-02-25 10:43:49.301651 | TASK [Get SELinux related data] 2026-02-25 10:43:49.322275 | [controller] Waiting on logger 2026-02-25 10:43:59.740028 | [controller] Waiting on logger 2026-02-25 10:44:09.083959 | [controller] Waiting on logger 2026-02-25 10:44:19.515854 | [controller] Waiting on logger 2026-02-25 10:44:19.592248 | [Zuul] Log Stream did not terminate 2026-02-25 10:44:19.592440 | controller | ERROR 2026-02-25 10:44:19.592549 | controller | { 2026-02-25 10:44:19.592583 | controller | "delta": "0:00:00.010374", 2026-02-25 10:44:19.592606 | controller | "end": "2026-02-25 10:43:49.565319", 2026-02-25 10:44:19.592626 | controller | "msg": "non-zero return code", 2026-02-25 10:44:19.592646 | controller | "rc": 1, 2026-02-25 10:44:19.592665 | controller | "start": "2026-02-25 10:43:49.554945" 2026-02-25 10:44:19.592685 | controller | } 2026-02-25 10:44:19.592711 | controller | ERROR: Ignoring Errors 2026-02-25 10:44:19.597728 | 2026-02-25 10:44:19.597792 | TASK [Create system configuration directory] 2026-02-25 10:44:19.860121 | controller | changed 2026-02-25 10:44:19.864475 | 2026-02-25 10:44:19.864538 | TASK [Get some of the system configurations] 2026-02-25 10:44:19.883386 | [controller] Waiting on logger 2026-02-25 10:44:30.267846 | [controller] Waiting on logger 2026-02-25 10:44:40.699905 | [controller] Waiting on logger 2026-02-25 10:44:50.043944 | [controller] Waiting on logger 2026-02-25 10:44:50.176552 | [Zuul] Log Stream did not terminate 2026-02-25 10:44:50.176713 | controller | changed 2026-02-25 10:44:50.181396 | 2026-02-25 10:44:50.181454 | TASK [Copy generated documentation if available] 2026-02-25 10:44:50.194684 | controller | skipping: Conditional result was False 2026-02-25 10:44:50.199911 | 2026-02-25 10:44:50.199973 | TASK [Copy generated AsciiDoc documentation if available] 2026-02-25 10:44:50.212992 | controller | skipping: Conditional result was False 2026-02-25 10:44:50.218054 | 2026-02-25 10:44:50.218119 | TASK [Compress logs bigger than 2MB] 2026-02-25 10:44:53.307829 | [controller] Waiting on logger 2026-02-25 10:45:07.872611 | [controller] Waiting on logger 2026-02-25 10:45:18.267835 | [controller] Waiting on logger 2026-02-25 10:45:20.527969 | [Zuul] Log Stream did not terminate 2026-02-25 10:45:20.528244 | controller | changed 2026-02-25 10:45:20.533123 | 2026-02-25 10:45:20.533182 | TASK [Copy files from workspace on node] 2026-02-25 10:45:20.550858 | controller | ok 2026-02-25 10:45:20.572333 | 2026-02-25 10:45:20.572408 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-25 10:45:20.585747 | controller | skipping: Conditional result was False 2026-02-25 10:45:20.591451 | 2026-02-25 10:45:20.591524 | TASK [fetch-output : Set log path for single node] 2026-02-25 10:45:20.619461 | controller | ok 2026-02-25 10:45:20.624281 | 2026-02-25 10:45:20.624364 | LOOP [fetch-output : Ensure local output dirs] 2026-02-25 10:45:20.806229 | controller -> localhost | ok: "/var/lib/zuul/builds/d42c11722db54e8c8924efe336e8e30b/work/logs" 2026-02-25 10:45:20.806552 | controller -> localhost | changed: All items complete 2026-02-25 10:45:20.806583 | 2026-02-25 10:45:20.968942 | controller -> localhost | changed: "/var/lib/zuul/builds/d42c11722db54e8c8924efe336e8e30b/work/artifacts" 2026-02-25 10:45:21.131116 | controller -> localhost | changed: "/var/lib/zuul/builds/d42c11722db54e8c8924efe336e8e30b/work/docs" 2026-02-25 10:45:21.140634 | 2026-02-25 10:45:21.140738 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-25 10:45:21.769366 | controller | changed: 2026-02-25 10:45:21.769536 | controller | .d..t...... ./ 2026-02-25 10:45:21.769567 | controller | >f+++++++++ README.html 2026-02-25 10:45:21.769590 | controller | >f+++++++++ ansible-execution.log 2026-02-25 10:45:21.769609 | controller | >f+++++++++ ansible.log 2026-02-25 10:45:21.769627 | controller | >f+++++++++ crc-setup.log 2026-02-25 10:45:21.769644 | controller | >f+++++++++ crc-start.log 2026-02-25 10:45:21.769659 | controller | >f+++++++++ dmesg.log 2026-02-25 10:45:21.769675 | controller | >f+++++++++ installed-pkgs.log 2026-02-25 10:45:21.769689 | controller | >f+++++++++ python.log 2026-02-25 10:45:21.769705 | controller | >f+++++++++ registries.conf 2026-02-25 10:45:21.769720 | controller | >f+++++++++ report.html 2026-02-25 10:45:21.769735 | controller | >f+++++++++ selinux-denials.log 2026-02-25 10:45:21.769753 | controller | >f+++++++++ selinux-listing.log 2026-02-25 10:45:21.769769 | controller | cd+++++++++ ci-framework-data/ 2026-02-25 10:45:21.769784 | controller | cd+++++++++ ci-framework-data/artifacts/ 2026-02-25 10:45:21.769800 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2026-02-25 10:45:21.769817 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2026-02-25 10:45:21.769832 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2026-02-25 10:45:21.769846 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2026-02-25 10:45:21.769861 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2026-02-25 10:45:21.769876 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2026-02-25 10:45:21.769891 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2026-02-25 10:45:21.769905 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2026-02-25 10:45:21.769920 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2026-02-25 10:45:21.769935 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2026-02-25 10:45:21.769950 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2026-02-25 10:45:21.769964 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2026-02-25 10:45:21.769978 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2026-02-25 10:45:21.769992 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:e8:26:31 2026-02-25 10:45:21.770007 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:55:d0:76 2026-02-25 10:45:21.770021 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:9c:f7:3e 2026-02-25 10:45:21.770035 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:11:11:56 2026-02-25 10:45:21.770049 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:2b:c2:66 2026-02-25 10:45:21.770076 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:ef:6d:6c 2026-02-25 10:45:21.770092 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2026-02-25 10:45:21.770107 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2026-02-25 10:45:21.770122 | controller | cd+++++++++ ci-framework-data/logs/ 2026-02-25 10:45:21.770136 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2026-02-25 10:45:21.770151 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2026-02-25 10:45:21.770165 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2026-02-25 10:45:21.770181 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2026-02-25 10:45:21.770196 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2026-02-25 10:45:21.770211 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2026-02-25 10:45:21.770226 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2026-02-25 10:45:21.770241 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2026-02-25 10:45:21.770256 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2026-02-25 10:45:21.770271 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2026-02-25 10:45:21.770285 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2026-02-25 10:45:21.770323 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2026-02-25 10:45:21.770344 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2026-02-25 10:45:21.770361 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2026-02-25 10:45:21.770377 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2026-02-25 10:45:21.770392 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2026-02-25 10:45:21.770406 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2026-02-25 10:45:21.770420 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2026-02-25 10:45:21.770435 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2026-02-25 10:45:21.770449 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2026-02-25 10:45:21.770463 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2026-02-25 10:45:21.770476 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2026-02-25 10:45:21.770490 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2026-02-25 10:45:21.770504 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2026-02-25 10:45:21.770517 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2026-02-25 10:45:21.770531 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2026-02-25 10:45:21.770545 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2026-02-25 10:45:21.770559 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2026-02-25 10:45:21.770573 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2026-02-25 10:45:21.770586 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2026-02-25 10:45:21.770600 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2026-02-25 10:45:21.770614 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2026-02-25 10:45:21.770627 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2026-02-25 10:45:21.770641 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2026-02-25 10:45:21.770655 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2026-02-25 10:45:21.770668 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2026-02-25 10:45:21.770682 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2026-02-25 10:45:21.770695 | controller | cd+++++++++ registries.conf.d/ 2026-02-25 10:45:21.770709 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2026-02-25 10:45:21.770722 | controller | cd+++++++++ system-config/ 2026-02-25 10:45:21.770735 | controller | cd+++++++++ system-config/libvirt/ 2026-02-25 10:45:21.770748 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2026-02-25 10:45:21.770762 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2026-02-25 10:45:21.770778 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2026-02-25 10:45:21.770793 | controller | >f+++++++++ system-config/libvirt/network.conf 2026-02-25 10:45:21.770807 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2026-02-25 10:45:21.770820 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2026-02-25 10:45:21.770834 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2026-02-25 10:45:21.770847 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2026-02-25 10:45:21.770861 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2026-02-25 10:45:21.770874 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2026-02-25 10:45:21.770888 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2026-02-25 10:45:21.770901 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2026-02-25 10:45:21.770915 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2026-02-25 10:45:21.770928 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2026-02-25 10:45:21.770942 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2026-02-25 10:45:21.770955 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2026-02-25 10:45:22.208137 | controller | changed: .d..t...... ./ 2026-02-25 10:45:22.631486 | controller | changed: .d..t...... ./ 2026-02-25 10:45:22.643917 | 2026-02-25 10:45:22.644067 | TASK [Return artifact to Zuul] 2026-02-25 10:45:22.672068 | controller | ok 2026-02-25 10:45:22.690376 | 2026-02-25 10:45:22.690440 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2026-02-25 10:45:22.690540 | 2026-02-25 10:45:22.690567 | PLAY RECAP 2026-02-25 10:45:22.690605 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2026-02-25 10:45:22.690626 | 2026-02-25 10:45:22.762753 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-25 10:45:22.763377 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-25 10:45:23.246114 | 2026-02-25 10:45:23.246199 | PLAY [all] 2026-02-25 10:45:23.262849 | 2026-02-25 10:45:23.262917 | TASK [include_role : fetch-output] 2026-02-25 10:45:23.290449 | controller | ok 2026-02-25 10:45:23.305502 | 2026-02-25 10:45:23.305575 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-25 10:45:23.339265 | controller | skipping: Conditional result was False 2026-02-25 10:45:23.344673 | 2026-02-25 10:45:23.344740 | TASK [fetch-output : Set log path for single node] 2026-02-25 10:45:23.372769 | controller | ok 2026-02-25 10:45:23.377254 | 2026-02-25 10:45:23.377335 | LOOP [fetch-output : Ensure local output dirs] 2026-02-25 10:45:23.684198 | controller -> localhost | ok: "/var/lib/zuul/builds/d42c11722db54e8c8924efe336e8e30b/work/logs" 2026-02-25 10:45:23.861544 | controller -> localhost | ok: "/var/lib/zuul/builds/d42c11722db54e8c8924efe336e8e30b/work/artifacts" 2026-02-25 10:45:24.031546 | controller -> localhost | ok: "/var/lib/zuul/builds/d42c11722db54e8c8924efe336e8e30b/work/docs" 2026-02-25 10:45:24.047748 | 2026-02-25 10:45:24.047865 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-25 10:45:24.623465 | controller | ok 2026-02-25 10:45:24.623657 | controller | ok: All items complete 2026-02-25 10:45:24.623690 | 2026-02-25 10:45:25.090841 | controller | ok 2026-02-25 10:45:25.547745 | controller | ok 2026-02-25 10:45:25.562612 | 2026-02-25 10:45:25.562718 | TASK [include_role : fetch-output-openshift] 2026-02-25 10:45:25.576012 | controller | skipping: Conditional result was False 2026-02-25 10:45:25.581408 | 2026-02-25 10:45:25.581481 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-02-25 10:45:25.911207 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006509 2026-02-25 10:45:26.099807 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006482 2026-02-25 10:45:26.125717 | 2026-02-25 10:45:26.125814 | PLAY [all] 2026-02-25 10:45:26.139477 | 2026-02-25 10:45:26.139547 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-02-25 10:45:26.614106 | controller | changed 2026-02-25 10:45:26.636067 | 2026-02-25 10:45:26.636118 | PLAY RECAP 2026-02-25 10:45:26.636163 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-02-25 10:45:26.636185 | 2026-02-25 10:45:26.701378 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-25 10:45:26.702028 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2026-02-25 10:45:27.228863 | 2026-02-25 10:45:27.228961 | PLAY [localhost] 2026-02-25 10:45:27.244754 | 2026-02-25 10:45:27.244823 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-02-25 10:45:27.546026 | localhost | changed 2026-02-25 10:45:27.550267 | 2026-02-25 10:45:27.550359 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-02-25 10:45:27.568717 | localhost | ok 2026-02-25 10:45:27.576226 | 2026-02-25 10:45:27.576315 | TASK [add-fileserver : Create SSH private key tempfile] 2026-02-25 10:45:27.867482 | localhost | changed 2026-02-25 10:45:27.873021 | 2026-02-25 10:45:27.873109 | TASK [add-fileserver : Create SSH private key from secret] 2026-02-25 10:45:28.385946 | localhost | changed 2026-02-25 10:45:28.390531 | 2026-02-25 10:45:28.390597 | TASK [add-fileserver : Add fileserver ssh key] 2026-02-25 10:45:28.731949 | localhost | Identity added: /var/lib/zuul/builds/d42c11722db54e8c8924efe336e8e30b/work/tmp/ansible.x5iygmtu (/var/lib/zuul/builds/d42c11722db54e8c8924efe336e8e30b/work/tmp/ansible.x5iygmtu) 2026-02-25 10:45:28.732110 | localhost | ok: Runtime: 0:00:00.005724 2026-02-25 10:45:28.736113 | 2026-02-25 10:45:28.736181 | TASK [add-fileserver : Remove SSH private key from disk] 2026-02-25 10:45:28.946147 | localhost | ok: Runtime: 0:00:00.003929 2026-02-25 10:45:28.950473 | 2026-02-25 10:45:28.950537 | TASK [add-fileserver : Add fileserver to inventory] 2026-02-25 10:45:28.998274 | localhost | changed 2026-02-25 10:45:29.003113 | 2026-02-25 10:45:29.003180 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-02-25 10:45:29.303683 | localhost | changed 2026-02-25 10:45:29.322209 | 2026-02-25 10:45:29.322272 | PLAY [localhost] 2026-02-25 10:45:29.333509 | 2026-02-25 10:45:29.333573 | TASK [Generate bulk log download script] 2026-02-25 10:45:29.352039 | localhost | ok 2026-02-25 10:45:29.363372 | 2026-02-25 10:45:29.363439 | TASK [local-log-download : Check API endpoint is defined] 2026-02-25 10:45:29.391377 | localhost | ok: All assertions passed 2026-02-25 10:45:29.395709 | 2026-02-25 10:45:29.395772 | TASK [local-log-download : Create download script] 2026-02-25 10:45:29.733960 | localhost -> localhost | changed 2026-02-25 10:45:29.742529 | 2026-02-25 10:45:29.742600 | TASK [Register quick-download link] 2026-02-25 10:45:29.759969 | localhost | ok 2026-02-25 10:45:29.795631 | 2026-02-25 10:45:29.795698 | PLAY [logserver.rdoproject.org] 2026-02-25 10:45:29.804783 | 2026-02-25 10:45:29.804840 | TASK [Set zuul-log-path fact] 2026-02-25 10:45:29.820649 | logserver.rdoproject.org | ok 2026-02-25 10:45:29.828978 | 2026-02-25 10:45:29.829039 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-25 10:45:29.845220 | logserver.rdoproject.org | ok 2026-02-25 10:45:29.849976 | 2026-02-25 10:45:29.850041 | TASK [upload-logs : Create log directories] 2026-02-25 10:45:31.861214 | logserver.rdoproject.org | changed 2026-02-25 10:45:31.864057 | 2026-02-25 10:45:31.864131 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-02-25 10:45:32.069542 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004837 2026-02-25 10:45:32.074150 | 2026-02-25 10:45:32.074228 | TASK [upload-logs : Upload logs to log server] 2026-02-25 10:45:33.580973 | logserver.rdoproject.org | Output suppressed because no_log was given 2026-02-25 10:45:33.584005 | 2026-02-25 10:45:33.584112 | LOOP [upload-logs : Compress console log and json output] 2026-02-25 10:45:33.626516 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-25 10:45:33.634818 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-25 10:45:33.644540 | 2026-02-25 10:45:33.644623 | LOOP [upload-logs : Upload compressed console log and json output] 2026-02-25 10:45:33.678262 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-25 10:45:33.678468 | 2026-02-25 10:45:33.681921 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-25 10:45:33.692050 | 2026-02-25 10:45:33.692137 | LOOP [upload-logs : Upload console log and json output]