2026-02-24 15:52:11.108210 | Job console starting... 2026-02-24 15:52:11.326376 | Updating repositories 2026-02-24 15:52:12.053650 | Preparing job workspace 2026-02-24 15:52:19.329643 | Running Ansible setup... 2026-02-24 15:52:22.955769 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-24 15:52:23.472484 | 2026-02-24 15:52:23.472601 | PLAY [localhost] 2026-02-24 15:52:23.480738 | 2026-02-24 15:52:23.480809 | TASK [Gathering Facts] 2026-02-24 15:52:24.288661 | localhost | ok 2026-02-24 15:52:24.302043 | 2026-02-24 15:52:24.302158 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-02-24 15:52:24.622975 | localhost -> localhost | changed 2026-02-24 15:52:24.628368 | 2026-02-24 15:52:24.628438 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-02-24 15:52:25.309711 | localhost -> localhost | changed 2026-02-24 15:52:25.317428 | 2026-02-24 15:52:25.317496 | TASK [Setup log path fact] 2026-02-24 15:52:25.334147 | localhost | ok 2026-02-24 15:52:25.344347 | 2026-02-24 15:52:25.344407 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-24 15:52:25.360876 | localhost | ok 2026-02-24 15:52:25.367589 | 2026-02-24 15:52:25.367652 | TASK [emit-job-header : Print job information] 2026-02-24 15:52:25.394042 | # Job Information 2026-02-24 15:52:25.394156 | Ansible Version: 2.15.12 2026-02-24 15:52:25.394185 | Job: cifmw-molecule-reproducer 2026-02-24 15:52:25.394205 | Pipeline: github-check 2026-02-24 15:52:25.394223 | Executor: ibm-bm4-ze.softwarefactory-project.io 2026-02-24 15:52:25.394240 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3686 2026-02-24 15:52:25.394258 | Log URL (when completed): https://logserver.rdoproject.org/933/rdoproject.org/9336e7fafca4452dbef6bad521dd34aa/ 2026-02-24 15:52:25.394275 | Event ID: a4a4c900-1198-11f1-9042-8414e2c3611c 2026-02-24 15:52:25.397639 | 2026-02-24 15:52:25.397699 | LOOP [emit-job-header : Print node information] 2026-02-24 15:52:25.482686 | localhost | ok: 2026-02-24 15:52:25.482968 | localhost | # Node Information 2026-02-24 15:52:25.483006 | localhost | Inventory Hostname: controller 2026-02-24 15:52:25.483036 | localhost | Hostname: np0005628330 2026-02-24 15:52:25.483061 | localhost | Username: zuul 2026-02-24 15:52:25.483085 | localhost | Distro: CentOS 9 2026-02-24 15:52:25.483107 | localhost | Provider: ibm-bm4-nodepool 2026-02-24 15:52:25.483129 | localhost | Region: regionOne 2026-02-24 15:52:25.483158 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2026-02-24 15:52:25.483180 | localhost | Product Name: OpenStack Compute 2026-02-24 15:52:25.483200 | localhost | Interface IP: 192.168.26.76 2026-02-24 15:52:25.512405 | 2026-02-24 15:52:25.512486 | PLAY [all] 2026-02-24 15:52:25.518672 | 2026-02-24 15:52:25.518740 | TASK [Gather network facts] 2026-02-24 15:52:25.931318 | controller | ok 2026-02-24 15:52:25.944872 | 2026-02-24 15:52:25.944966 | TASK [include_role : start-zuul-console] 2026-02-24 15:52:25.963456 | controller | ok 2026-02-24 15:52:25.975049 | 2026-02-24 15:52:25.975109 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-02-24 15:52:26.376365 | controller | ok 2026-02-24 15:52:26.384156 | 2026-02-24 15:52:26.384217 | TASK [include_role : add-build-sshkey] 2026-02-24 15:52:26.401377 | controller | ok 2026-02-24 15:52:26.422241 | 2026-02-24 15:52:26.422409 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-02-24 15:52:26.599524 | controller -> localhost | ok 2026-02-24 15:52:26.604683 | 2026-02-24 15:52:26.604754 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-02-24 15:52:26.624943 | controller | ok 2026-02-24 15:52:26.636560 | controller | included: /var/lib/zuul/builds/9336e7fafca4452dbef6bad521dd34aa/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-24 15:52:26.641702 | 2026-02-24 15:52:26.641761 | TASK [add-build-sshkey : Create Temp SSH key] 2026-02-24 15:52:27.080541 | controller -> localhost | Generating public/private rsa key pair. 2026-02-24 15:52:27.080748 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/9336e7fafca4452dbef6bad521dd34aa/work/9336e7fafca4452dbef6bad521dd34aa_id_rsa. 2026-02-24 15:52:27.080785 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/9336e7fafca4452dbef6bad521dd34aa/work/9336e7fafca4452dbef6bad521dd34aa_id_rsa.pub. 2026-02-24 15:52:27.080811 | controller -> localhost | The key fingerprint is: 2026-02-24 15:52:27.080833 | controller -> localhost | SHA256:XeTL0zeKOTrWuDz4qoXB8wYohKiO5ZZe2Q1bFlZ421M zuul-build-sshkey 2026-02-24 15:52:27.080853 | controller -> localhost | The key's randomart image is: 2026-02-24 15:52:27.080871 | controller -> localhost | +---[RSA 3072]----+ 2026-02-24 15:52:27.080889 | controller -> localhost | | .. . | 2026-02-24 15:52:27.080907 | controller -> localhost | |o ...o E | 2026-02-24 15:52:27.080925 | controller -> localhost | |o. o. oo. | 2026-02-24 15:52:27.080943 | controller -> localhost | |o o . o.ooo | 2026-02-24 15:52:27.080961 | controller -> localhost | |.... =. S . +....| 2026-02-24 15:52:27.080979 | controller -> localhost | |oo.. o** o....| 2026-02-24 15:52:27.080996 | controller -> localhost | |..+ o.o+o o+ . | 2026-02-24 15:52:27.081014 | controller -> localhost | | o . o..=... | 2026-02-24 15:52:27.081030 | controller -> localhost | | . ...+=+ | 2026-02-24 15:52:27.081047 | controller -> localhost | +----[SHA256]-----+ 2026-02-24 15:52:27.081093 | controller -> localhost | ok: Runtime: 0:00:00.109845 2026-02-24 15:52:27.086919 | 2026-02-24 15:52:27.086986 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-02-24 15:52:27.115403 | controller | ok 2026-02-24 15:52:27.124795 | controller | included: /var/lib/zuul/builds/9336e7fafca4452dbef6bad521dd34aa/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-24 15:52:27.132507 | 2026-02-24 15:52:27.132568 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-02-24 15:52:27.156329 | controller | skipping: Conditional result was False 2026-02-24 15:52:27.161557 | 2026-02-24 15:52:27.161618 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-02-24 15:52:27.671255 | controller | changed 2026-02-24 15:52:27.676282 | 2026-02-24 15:52:27.676366 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-02-24 15:52:27.948261 | controller | ok 2026-02-24 15:52:27.953101 | 2026-02-24 15:52:27.953176 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-02-24 15:52:29.113187 | controller | changed 2026-02-24 15:52:29.119441 | 2026-02-24 15:52:29.119511 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-02-24 15:52:30.300085 | controller | changed 2026-02-24 15:52:30.304895 | 2026-02-24 15:52:30.304961 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-02-24 15:52:30.319176 | controller | skipping: Conditional result was False 2026-02-24 15:52:30.324837 | 2026-02-24 15:52:30.324902 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-02-24 15:52:30.617394 | controller -> localhost | changed 2026-02-24 15:52:30.626042 | 2026-02-24 15:52:30.626140 | TASK [add-build-sshkey : Add back temp key] 2026-02-24 15:52:30.833027 | controller -> localhost | Identity added: /var/lib/zuul/builds/9336e7fafca4452dbef6bad521dd34aa/work/9336e7fafca4452dbef6bad521dd34aa_id_rsa (zuul-build-sshkey) 2026-02-24 15:52:30.833267 | controller -> localhost | ok: Runtime: 0:00:00.007557 2026-02-24 15:52:30.838708 | 2026-02-24 15:52:30.838775 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-02-24 15:52:31.194028 | controller | ok 2026-02-24 15:52:31.198106 | 2026-02-24 15:52:31.198177 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-02-24 15:52:31.221839 | controller | skipping: Conditional result was False 2026-02-24 15:52:31.230111 | 2026-02-24 15:52:31.230180 | TASK [include_role : validate-host] 2026-02-24 15:52:31.247768 | controller | ok 2026-02-24 15:52:31.264825 | 2026-02-24 15:52:31.264884 | TASK [validate-host : Define zuul_info_dir fact] 2026-02-24 15:52:31.292835 | controller | ok 2026-02-24 15:52:31.296934 | 2026-02-24 15:52:31.296992 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-02-24 15:52:31.481945 | controller -> localhost | ok 2026-02-24 15:52:31.487118 | 2026-02-24 15:52:31.487194 | TASK [validate-host : Collect information about the host] 2026-02-24 15:52:32.218140 | controller | ok 2026-02-24 15:52:32.225322 | 2026-02-24 15:52:32.225382 | TASK [validate-host : Sanitize hostname] 2026-02-24 15:52:32.263052 | controller | ok 2026-02-24 15:52:32.268185 | 2026-02-24 15:52:32.268252 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-02-24 15:52:32.618006 | controller -> localhost | changed 2026-02-24 15:52:32.623115 | 2026-02-24 15:52:32.623187 | TASK [validate-host : Collect information about zuul worker] 2026-02-24 15:52:33.033632 | controller | ok 2026-02-24 15:52:33.038156 | 2026-02-24 15:52:33.038229 | TASK [validate-host : Write out all zuul information for each host] 2026-02-24 15:52:33.398759 | controller -> localhost | changed 2026-02-24 15:52:33.407471 | 2026-02-24 15:52:33.407554 | TASK [include_role : prepare-workspace-openshift] 2026-02-24 15:52:33.422058 | controller | skipping: Conditional result was False 2026-02-24 15:52:33.427377 | 2026-02-24 15:52:33.427449 | TASK [include_role : remove-zuul-sshkey] 2026-02-24 15:52:33.440714 | controller | skipping: Conditional result was False 2026-02-24 15:52:33.445767 | 2026-02-24 15:52:33.445850 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-02-24 15:52:33.718774 | controller | ok: "logs" 2026-02-24 15:52:33.719014 | controller | ok: All items complete 2026-02-24 15:52:33.719043 | 2026-02-24 15:52:33.963971 | controller | ok: "artifacts" 2026-02-24 15:52:34.218046 | controller | ok: "docs" 2026-02-24 15:52:34.229163 | 2026-02-24 15:52:34.229292 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-02-24 15:52:34.505113 | controller | changed: "logs" 2026-02-24 15:52:34.744685 | controller | changed: "artifacts" 2026-02-24 15:52:34.989478 | controller | changed: "docs" 2026-02-24 15:52:35.021496 | 2026-02-24 15:52:35.021677 | PLAY RECAP 2026-02-24 15:52:35.021730 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-24 15:52:35.021759 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-24 15:52:35.021779 | 2026-02-24 15:52:35.125111 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-24 15:52:35.126559 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-24 15:52:35.663495 | 2026-02-24 15:52:35.663606 | PLAY [all] 2026-02-24 15:52:35.681499 | 2026-02-24 15:52:35.681570 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-24 15:52:35.741438 | controller | ok 2026-02-24 15:52:35.746066 | 2026-02-24 15:52:35.746157 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-24 15:52:36.196830 | controller | changed 2026-02-24 15:52:36.202287 | 2026-02-24 15:52:36.202397 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-24 15:52:37.582921 | controller | changed 2026-02-24 15:52:37.592587 | 2026-02-24 15:52:37.592666 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2026-02-24 15:52:38.053801 | controller | changed: 2026-02-24 15:52:38.053984 | controller | { 2026-02-24 15:52:38.054033 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2026-02-24 15:52:38.054264 | controller | } 2026-02-24 15:52:38.341520 | controller | changed: 2026-02-24 15:52:38.341828 | controller | { 2026-02-24 15:52:38.341857 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2026-02-24 15:52:38.341876 | controller | } 2026-02-24 15:52:38.639636 | controller | changed: 2026-02-24 15:52:38.639707 | controller | { 2026-02-24 15:52:38.639732 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2026-02-24 15:52:38.639751 | controller | } 2026-02-24 15:52:38.932470 | controller | changed: 2026-02-24 15:52:38.932546 | controller | { 2026-02-24 15:52:38.932581 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2026-02-24 15:52:38.932609 | controller | } 2026-02-24 15:52:39.232885 | controller | changed: 2026-02-24 15:52:39.232963 | controller | { 2026-02-24 15:52:39.232987 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2026-02-24 15:52:39.233006 | controller | } 2026-02-24 15:52:39.520180 | controller | changed: 2026-02-24 15:52:39.520242 | controller | { 2026-02-24 15:52:39.520270 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2026-02-24 15:52:39.520289 | controller | } 2026-02-24 15:52:39.820887 | controller | changed: 2026-02-24 15:52:39.820945 | controller | { 2026-02-24 15:52:39.820970 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2026-02-24 15:52:39.820990 | controller | } 2026-02-24 15:52:40.121087 | controller | changed: 2026-02-24 15:52:40.121153 | controller | { 2026-02-24 15:52:40.121180 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2026-02-24 15:52:40.121201 | controller | } 2026-02-24 15:52:40.416828 | controller | changed: 2026-02-24 15:52:40.416905 | controller | { 2026-02-24 15:52:40.416932 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2026-02-24 15:52:40.416952 | controller | } 2026-02-24 15:52:40.728402 | controller | changed: 2026-02-24 15:52:40.728482 | controller | { 2026-02-24 15:52:40.728509 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2026-02-24 15:52:40.728530 | controller | } 2026-02-24 15:52:41.048178 | controller | changed: 2026-02-24 15:52:41.048343 | controller | { 2026-02-24 15:52:41.048378 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2026-02-24 15:52:41.048401 | controller | } 2026-02-24 15:52:41.348626 | controller | changed: 2026-02-24 15:52:41.348706 | controller | { 2026-02-24 15:52:41.348731 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2026-02-24 15:52:41.348750 | controller | } 2026-02-24 15:52:41.651655 | controller | changed: 2026-02-24 15:52:41.651747 | controller | { 2026-02-24 15:52:41.651771 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com" 2026-02-24 15:52:41.651791 | controller | } 2026-02-24 15:52:41.943644 | controller | changed: 2026-02-24 15:52:41.943785 | controller | { 2026-02-24 15:52:41.943814 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2026-02-24 15:52:41.943835 | controller | } 2026-02-24 15:52:42.238623 | controller | changed: 2026-02-24 15:52:42.238730 | controller | { 2026-02-24 15:52:42.238758 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2026-02-24 15:52:42.238778 | controller | } 2026-02-24 15:52:42.546524 | controller | changed: 2026-02-24 15:52:42.546640 | controller | { 2026-02-24 15:52:42.546666 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2026-02-24 15:52:42.546687 | controller | } 2026-02-24 15:52:42.865342 | controller | changed: 2026-02-24 15:52:42.865457 | controller | { 2026-02-24 15:52:42.865484 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2026-02-24 15:52:42.865506 | controller | } 2026-02-24 15:52:43.150654 | controller | changed: 2026-02-24 15:52:43.150722 | controller | { 2026-02-24 15:52:43.150747 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2026-02-24 15:52:43.150775 | controller | } 2026-02-24 15:52:43.441572 | controller | changed: 2026-02-24 15:52:43.441655 | controller | { 2026-02-24 15:52:43.441679 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2026-02-24 15:52:43.441697 | controller | } 2026-02-24 15:52:43.731867 | controller | changed: 2026-02-24 15:52:43.731932 | controller | { 2026-02-24 15:52:43.731959 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2026-02-24 15:52:43.731979 | controller | } 2026-02-24 15:52:44.032406 | controller | changed: 2026-02-24 15:52:44.032472 | controller | { 2026-02-24 15:52:44.032499 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2026-02-24 15:52:44.032518 | controller | } 2026-02-24 15:52:44.327173 | controller | changed: 2026-02-24 15:52:44.327246 | controller | { 2026-02-24 15:52:44.327270 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2026-02-24 15:52:44.327289 | controller | } 2026-02-24 15:52:44.638844 | controller | changed: 2026-02-24 15:52:44.638931 | controller | { 2026-02-24 15:52:44.638956 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2026-02-24 15:52:44.638976 | controller | } 2026-02-24 15:52:44.988699 | controller | changed: 2026-02-24 15:52:44.988838 | controller | { 2026-02-24 15:52:44.988865 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2026-02-24 15:52:44.988885 | controller | } 2026-02-24 15:52:45.282944 | controller | changed: 2026-02-24 15:52:45.283065 | controller | { 2026-02-24 15:52:45.283089 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2026-02-24 15:52:45.283106 | controller | } 2026-02-24 15:52:45.590261 | controller | changed: 2026-02-24 15:52:45.590346 | controller | { 2026-02-24 15:52:45.590374 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2026-02-24 15:52:45.590392 | controller | } 2026-02-24 15:52:45.609280 | 2026-02-24 15:52:45.609430 | TASK [Set timezone to UTC] 2026-02-24 15:52:46.135717 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2026-02-24 15:52:46.140566 | 2026-02-24 15:52:46.140633 | TASK [Create nodepool directory] 2026-02-24 15:52:46.435138 | controller | changed 2026-02-24 15:52:46.441171 | 2026-02-24 15:52:46.441243 | TASK [Create nodepool sub_nodes file] 2026-02-24 15:52:47.445829 | controller | changed 2026-02-24 15:52:47.450758 | 2026-02-24 15:52:47.450823 | TASK [Create nodepool sub_nodes_private file] 2026-02-24 15:52:48.464627 | controller | changed 2026-02-24 15:52:48.469512 | 2026-02-24 15:52:48.469576 | LOOP [Populate nodepool sub_nodes file] 2026-02-24 15:52:48.499051 | 2026-02-24 15:52:48.499187 | LOOP [Populate nodepool sub_nodes_private file] 2026-02-24 15:52:48.528116 | 2026-02-24 15:52:48.528250 | TASK [Create nodepool primary file] 2026-02-24 15:52:48.551766 | controller | skipping: Conditional result was False 2026-02-24 15:52:48.557435 | 2026-02-24 15:52:48.557558 | TASK [Create nodepool node_private for this node] 2026-02-24 15:52:49.604616 | controller | changed 2026-02-24 15:52:49.610186 | 2026-02-24 15:52:49.610251 | LOOP [Copy ssh keys to nodepool directory] 2026-02-24 15:52:50.006711 | controller | ok: Item: id_rsa Runtime: 0:00:00.003962 2026-02-24 15:52:50.006915 | 2026-02-24 15:52:50.237099 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004095 2026-02-24 15:52:50.247869 | 2026-02-24 15:52:50.247945 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2026-02-24 15:52:51.317028 | controller | changed 2026-02-24 15:52:51.322105 | 2026-02-24 15:52:51.322219 | TASK [Validate sudoers config after edits] 2026-02-24 15:52:51.609041 | controller | /etc/sudoers: parsed OK 2026-02-24 15:52:51.609097 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2026-02-24 15:52:51.609105 | controller | /etc/sudoers.d/zuul: parsed OK 2026-02-24 15:52:51.609110 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2026-02-24 15:52:51.850724 | controller | ok: Runtime: 0:00:00.006029 2026-02-24 15:52:51.856107 | 2026-02-24 15:52:51.856180 | TASK [Show the environment passed in to job shell scripts] 2026-02-24 15:52:52.134654 | controller | SHELL=/bin/bash 2026-02-24 15:52:52.134800 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2026-02-24 15:52:52.134820 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2026-02-24 15:52:52.134828 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/86/3686/edea391541f248b9a020b4923150b31137b06c19 2026-02-24 15:52:52.134834 | controller | PWD=/home/zuul 2026-02-24 15:52:52.134840 | controller | ZUUL_PIPELINE=github-check 2026-02-24 15:52:52.134845 | controller | LOGNAME=zuul 2026-02-24 15:52:52.134850 | controller | XDG_SESSION_TYPE=tty 2026-02-24 15:52:52.134855 | controller | _=/usr/bin/env 2026-02-24 15:52:52.134860 | controller | MOTD_SHOWN=pam 2026-02-24 15:52:52.134865 | controller | HOME=/home/zuul 2026-02-24 15:52:52.134870 | controller | LANG=en_US.UTF-8 2026-02-24 15:52:52.134875 | controller | SSH_CONNECTION=192.168.26.12 54880 192.168.26.76 22 2026-02-24 15:52:52.134881 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2026-02-24 15:52:52.134892 | controller | ZUUL_CHANGE_IDS=3686,edea391541f248b9a020b4923150b31137b06c19 2026-02-24 15:52:52.134897 | controller | WORKSPACE=/home/zuul/workspace 2026-02-24 15:52:52.134903 | controller | XDG_SESSION_CLASS=user 2026-02-24 15:52:52.134909 | controller | SELINUX_ROLE_REQUESTED= 2026-02-24 15:52:52.134914 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2026-02-24 15:52:52.134919 | controller | USER=zuul 2026-02-24 15:52:52.134925 | controller | ZUUL_VOTING=True 2026-02-24 15:52:52.134930 | controller | BUILD_TIMEOUT=5400000 2026-02-24 15:52:52.134935 | controller | SELINUX_USE_CURRENT_RANGE= 2026-02-24 15:52:52.134940 | controller | SHLVL=1 2026-02-24 15:52:52.134945 | controller | ZUUL_PATCHSET=edea391541f248b9a020b4923150b31137b06c19 2026-02-24 15:52:52.134950 | controller | XDG_SESSION_ID=1 2026-02-24 15:52:52.134955 | controller | ZUUL_BRANCH=main 2026-02-24 15:52:52.134961 | controller | XDG_RUNTIME_DIR=/run/user/1000 2026-02-24 15:52:52.134966 | controller | SSH_CLIENT=192.168.26.12 54880 22 2026-02-24 15:52:52.134971 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2026-02-24 15:52:52.134976 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2026-02-24 15:52:52.134982 | controller | which_declare=declare -f 2026-02-24 15:52:52.134988 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2026-02-24 15:52:52.134993 | controller | SELINUX_LEVEL_REQUESTED= 2026-02-24 15:52:52.134999 | controller | ZUUL_CHANGE=3686 2026-02-24 15:52:52.135004 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2026-02-24 15:52:52.135009 | controller | ZUUL_UUID=9336e7fafca4452dbef6bad521dd34aa 2026-02-24 15:52:52.135014 | controller | BASH_FUNC_which%%=() { ( alias; 2026-02-24 15:52:52.135021 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2026-02-24 15:52:52.135026 | controller | } 2026-02-24 15:52:52.382565 | controller | ok: Runtime: 0:00:00.006439 2026-02-24 15:52:52.387620 | 2026-02-24 15:52:52.387689 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2026-02-24 15:52:52.412528 | controller | skipping: Conditional result was False 2026-02-24 15:52:52.417854 | 2026-02-24 15:52:52.417916 | TASK [Symlink /home/zuul-worker/workspace] 2026-02-24 15:52:52.974781 | controller | skipping: Conditional result was False 2026-02-24 15:52:52.981537 | 2026-02-24 15:52:52.981609 | TASK [Ensure legacy workspace directory] 2026-02-24 15:52:53.256521 | controller | changed 2026-02-24 15:52:53.274902 | 2026-02-24 15:52:53.274960 | PLAY RECAP 2026-02-24 15:52:53.275009 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-24 15:52:53.275033 | 2026-02-24 15:52:53.366506 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-24 15:52:53.367311 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-24 15:52:53.837567 | 2026-02-24 15:52:53.837688 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2026-02-24 15:52:53.856930 | 2026-02-24 15:52:53.856996 | TASK [Create zuul-output directory] 2026-02-24 15:52:54.284740 | controller | changed 2026-02-24 15:52:54.289813 | 2026-02-24 15:52:54.289894 | TASK [Slurp Zuul inventory test] 2026-02-24 15:52:54.548944 | controller -> localhost | ok 2026-02-24 15:52:54.555668 | 2026-02-24 15:52:54.555741 | TASK [Save zuul inventory] 2026-02-24 15:52:55.853395 | controller | changed 2026-02-24 15:52:55.859363 | 2026-02-24 15:52:55.859439 | TASK [Save zuul vars without the change_message] 2026-02-24 15:52:56.964593 | controller | changed 2026-02-24 15:52:56.984019 | 2026-02-24 15:52:56.984077 | PLAY RECAP 2026-02-24 15:52:56.984136 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-24 15:52:56.984162 | 2026-02-24 15:52:57.067342 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-24 15:52:57.068144 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-24 15:52:57.632840 | 2026-02-24 15:52:57.632991 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2026-02-24 15:52:57.654753 | 2026-02-24 15:52:57.654827 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2026-02-24 15:52:57.675826 | controller | ok 2026-02-24 15:52:57.692147 | 2026-02-24 15:52:57.692221 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-24 15:52:57.727670 | controller | skipping: Conditional result was False 2026-02-24 15:52:57.734015 | 2026-02-24 15:52:57.734101 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-24 15:52:58.151855 | controller | ok 2026-02-24 15:52:58.157229 | 2026-02-24 15:52:58.157315 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-24 15:52:59.165311 | controller | ok 2026-02-24 15:52:59.178774 | 2026-02-24 15:52:59.178860 | TASK [Prepare workspace] 2026-02-24 15:52:59.200827 | controller | ok 2026-02-24 15:52:59.217898 | 2026-02-24 15:52:59.217968 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-02-24 15:52:59.584660 | controller | ok 2026-02-24 15:52:59.590340 | 2026-02-24 15:52:59.590405 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-02-24 15:53:02.064062 | controller | Output suppressed because no_log was given 2026-02-24 15:53:02.073794 | 2026-02-24 15:53:02.073877 | LOOP [Create zuul-output directory] 2026-02-24 15:53:02.353686 | controller | changed: "/home/zuul/ci-framework-data/logs" 2026-02-24 15:53:02.587667 | controller | ok: "/home/zuul/zuul-output/logs" 2026-02-24 15:53:02.597942 | 2026-02-24 15:53:02.598150 | TASK [Install required packages] 2026-02-24 15:53:26.653752 | controller | ok: Nothing to do 2026-02-24 15:53:26.659090 | 2026-02-24 15:53:26.659163 | TASK [Install venv] 2026-02-24 15:54:23.326472 | controller | changed 2026-02-24 15:54:23.370869 | 2026-02-24 15:54:23.370953 | PLAY RECAP 2026-02-24 15:54:23.370991 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-24 15:54:23.371012 | 2026-02-24 15:54:23.438695 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-24 15:54:23.439578 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-24 15:54:23.933895 | 2026-02-24 15:54:23.933995 | PLAY [Run ci/playbooks/molecule-test.yml] 2026-02-24 15:54:23.953253 | 2026-02-24 15:54:23.953346 | TASK [Gather required facts] 2026-02-24 15:54:24.481844 | controller | ok 2026-02-24 15:54:24.487419 | 2026-02-24 15:54:24.487504 | TASK [Load environment var if instructed to] 2026-02-24 15:54:24.512596 | controller | skipping: Conditional result was False 2026-02-24 15:54:24.518638 | 2026-02-24 15:54:24.518708 | TASK [Ensure group_vars dir exists] 2026-02-24 15:54:24.936289 | controller | ok 2026-02-24 15:54:24.941778 | 2026-02-24 15:54:24.941850 | TASK [Print related variables] 2026-02-24 15:54:24.973644 | controller | ok: 2026-02-24 15:54:24.973786 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2026-02-24 15:54:24.973816 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2026-02-24 15:54:24.978540 | 2026-02-24 15:54:24.978607 | TASK [Run molecule] 2026-02-24 15:54:25.967703 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2026-02-24 15:54:26.234078 | controller | INFO Performing prerun with role_name_check=0... 2026-02-24 15:54:43.722432 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.722841 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.723254 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.723664 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.724111 | controller | WARNING Another version of 'cifmw.general' 1.0.0+d2cf934f was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+d2cf934f (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.724528 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.724948 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.725337 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.725724 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.726104 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.726490 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.726908 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.727295 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.727685 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.728111 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 15:54:43.737070 | controller | INFO Running crc_layout > prepare 2026-02-24 15:54:44.403563 | controller | 2026-02-24 15:54:44.403721 | controller | PLAY [Prepare] ***************************************************************** 2026-02-24 15:54:44.403741 | controller | 2026-02-24 15:54:44.403808 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-24 15:54:44.403833 | controller | Tuesday 24 February 2026 15:54:44 +0000 (0:00:00.018) 0:00:00.018 ****** 2026-02-24 15:54:45.261135 | controller | ok: [instance] 2026-02-24 15:54:45.261237 | controller | 2026-02-24 15:54:45.261346 | controller | TASK [Create custom basedir] *************************************************** 2026-02-24 15:54:45.261455 | controller | Tuesday 24 February 2026 15:54:45 +0000 (0:00:00.857) 0:00:00.876 ****** 2026-02-24 15:54:45.591175 | controller | changed: [instance] 2026-02-24 15:54:45.591225 | controller | 2026-02-24 15:54:45.591379 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2026-02-24 15:54:45.591498 | controller | Tuesday 24 February 2026 15:54:45 +0000 (0:00:00.330) 0:00:01.206 ****** 2026-02-24 15:54:45.611363 | controller | skipping: [instance] 2026-02-24 15:54:45.611383 | controller | 2026-02-24 15:54:45.611541 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2026-02-24 15:54:45.611658 | controller | Tuesday 24 February 2026 15:54:45 +0000 (0:00:00.020) 0:00:01.227 ****** 2026-02-24 15:54:45.654400 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2026-02-24 15:54:45.654621 | controller | 2026-02-24 15:54:45.654636 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2026-02-24 15:54:45.654647 | controller | Tuesday 24 February 2026 15:54:45 +0000 (0:00:00.043) 0:00:01.270 ****** 2026-02-24 15:54:45.957957 | controller | ok: [instance] 2026-02-24 15:54:45.958025 | controller | 2026-02-24 15:54:45.958111 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2026-02-24 15:54:45.958207 | controller | Tuesday 24 February 2026 15:54:45 +0000 (0:00:00.303) 0:00:01.573 ****** 2026-02-24 15:54:46.175210 | controller | ok: [instance] 2026-02-24 15:54:46.175305 | controller | 2026-02-24 15:54:46.175420 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2026-02-24 15:54:46.175541 | controller | Tuesday 24 February 2026 15:54:46 +0000 (0:00:00.217) 0:00:01.790 ****** 2026-02-24 15:54:46.894462 | controller | ok: [instance] => (item=ubi-9-appstream) 2026-02-24 15:54:46.894572 | controller | ok: [instance] => (item=ubi-9-baseos) 2026-02-24 15:54:46.894605 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2026-02-24 15:54:46.894699 | controller | 2026-02-24 15:54:46.894799 | controller | TASK [Deploy repo-setup] ******************************************************* 2026-02-24 15:54:46.894903 | controller | Tuesday 24 February 2026 15:54:46 +0000 (0:00:00.719) 0:00:02.510 ****** 2026-02-24 15:54:46.954487 | controller | 2026-02-24 15:54:47.498558 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-24 15:54:47.498611 | controller | Tuesday 24 February 2026 15:54:46 +0000 (0:00:00.059) 0:00:02.569 ****** 2026-02-24 15:54:47.498631 | controller | changed: [instance] => (item=tmp) 2026-02-24 15:54:47.498697 | controller | changed: [instance] => (item=artifacts/repositories) 2026-02-24 15:54:47.498711 | controller | changed: [instance] => (item=venv/repo_setup) 2026-02-24 15:54:47.498798 | controller | 2026-02-24 15:54:47.498902 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-24 15:54:47.498992 | controller | Tuesday 24 February 2026 15:54:47 +0000 (0:00:00.544) 0:00:03.114 ****** 2026-02-24 15:54:48.354728 | controller | ok: [instance] 2026-02-24 15:54:48.354811 | controller | 2026-02-24 15:54:48.355040 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-24 15:54:49.737945 | controller | Tuesday 24 February 2026 15:54:48 +0000 (0:00:00.856) 0:00:03.970 ****** 2026-02-24 15:54:49.738023 | controller | changed: [instance] 2026-02-24 15:54:49.738067 | controller | 2026-02-24 15:54:49.738087 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-24 15:54:49.738121 | controller | Tuesday 24 February 2026 15:54:49 +0000 (0:00:01.383) 0:00:05.353 ****** 2026-02-24 15:54:57.169466 | controller | changed: [instance] 2026-02-24 15:54:57.868440 | controller | 2026-02-24 15:54:57.868469 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-24 15:54:57.868477 | controller | Tuesday 24 February 2026 15:54:57 +0000 (0:00:07.431) 0:00:12.784 ****** 2026-02-24 15:54:57.868487 | controller | changed: [instance] 2026-02-24 15:54:57.897371 | controller | 2026-02-24 15:54:57.897387 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-24 15:54:57.897395 | controller | Tuesday 24 February 2026 15:54:57 +0000 (0:00:00.699) 0:00:13.483 ****** 2026-02-24 15:54:57.897403 | controller | skipping: [instance] 2026-02-24 15:54:58.922896 | controller | 2026-02-24 15:54:58.922946 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-24 15:54:58.922955 | controller | Tuesday 24 February 2026 15:54:57 +0000 (0:00:00.028) 0:00:13.512 ****** 2026-02-24 15:54:58.922966 | controller | changed: [instance] 2026-02-24 15:54:58.922992 | controller | 2026-02-24 15:54:58.923000 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-24 15:54:58.923024 | controller | Tuesday 24 February 2026 15:54:58 +0000 (0:00:01.025) 0:00:14.538 ****** 2026-02-24 15:54:58.961354 | controller | skipping: [instance] 2026-02-24 15:54:59.003859 | controller | 2026-02-24 15:54:59.003895 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-24 15:54:59.003903 | controller | Tuesday 24 February 2026 15:54:58 +0000 (0:00:00.038) 0:00:14.576 ****** 2026-02-24 15:54:59.003915 | controller | skipping: [instance] 2026-02-24 15:54:59.044914 | controller | 2026-02-24 15:54:59.044955 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-24 15:54:59.044965 | controller | Tuesday 24 February 2026 15:54:59 +0000 (0:00:00.042) 0:00:14.619 ****** 2026-02-24 15:54:59.044976 | controller | skipping: [instance] 2026-02-24 15:54:59.045006 | controller | 2026-02-24 15:54:59.045305 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-24 15:54:59.592615 | controller | Tuesday 24 February 2026 15:54:59 +0000 (0:00:00.041) 0:00:14.660 ****** 2026-02-24 15:54:59.592642 | controller | changed: [instance] 2026-02-24 15:55:00.069806 | controller | 2026-02-24 15:55:00.069831 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-24 15:55:00.069839 | controller | Tuesday 24 February 2026 15:54:59 +0000 (0:00:00.547) 0:00:15.208 ****** 2026-02-24 15:55:00.069849 | controller | changed: [instance] 2026-02-24 15:55:00.107258 | controller | 2026-02-24 15:55:00.107284 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-24 15:55:00.107293 | controller | Tuesday 24 February 2026 15:55:00 +0000 (0:00:00.476) 0:00:15.685 ****** 2026-02-24 15:55:00.107303 | controller | skipping: [instance] 2026-02-24 15:55:00.142413 | controller | 2026-02-24 15:55:00.142436 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-24 15:55:00.142445 | controller | Tuesday 24 February 2026 15:55:00 +0000 (0:00:00.037) 0:00:15.722 ****** 2026-02-24 15:55:00.142459 | controller | skipping: [instance] 2026-02-24 15:55:00.202913 | controller | 2026-02-24 15:55:00.202950 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-24 15:55:00.202959 | controller | Tuesday 24 February 2026 15:55:00 +0000 (0:00:00.034) 0:00:15.757 ****** 2026-02-24 15:55:00.202972 | controller | skipping: [instance] 2026-02-24 15:55:00.203003 | controller | 2026-02-24 15:55:00.203012 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-24 15:55:00.203152 | controller | Tuesday 24 February 2026 15:55:00 +0000 (0:00:00.060) 0:00:15.818 ****** 2026-02-24 15:55:00.244060 | controller | ok: [instance] 2026-02-24 15:55:00.244126 | controller | 2026-02-24 15:55:00.244137 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-24 15:55:00.244148 | controller | Tuesday 24 February 2026 15:55:00 +0000 (0:00:00.041) 0:00:15.859 ****** 2026-02-24 15:55:00.277267 | controller | skipping: [instance] 2026-02-24 15:55:00.307703 | controller | 2026-02-24 15:55:00.307732 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-24 15:55:00.307745 | controller | Tuesday 24 February 2026 15:55:00 +0000 (0:00:00.032) 0:00:15.892 ****** 2026-02-24 15:55:00.307759 | controller | skipping: [instance] 2026-02-24 15:55:00.339386 | controller | 2026-02-24 15:55:00.339408 | controller | TASK [Download the RPM] ******************************************************** 2026-02-24 15:55:00.339417 | controller | Tuesday 24 February 2026 15:55:00 +0000 (0:00:00.030) 0:00:15.923 ****** 2026-02-24 15:55:00.339428 | controller | skipping: [instance] 2026-02-24 15:55:00.339595 | controller | 2026-02-24 15:55:00.339762 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-24 15:55:00.339972 | controller | Tuesday 24 February 2026 15:55:00 +0000 (0:00:00.032) 0:00:15.955 ****** 2026-02-24 15:55:00.371906 | controller | skipping: [instance] 2026-02-24 15:55:00.372160 | controller | 2026-02-24 15:55:00.372285 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-24 15:55:00.372405 | controller | Tuesday 24 February 2026 15:55:00 +0000 (0:00:00.032) 0:00:15.987 ****** 2026-02-24 15:55:00.403593 | controller | skipping: [instance] 2026-02-24 15:55:00.403757 | controller | 2026-02-24 15:55:00.403945 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-24 15:55:00.404111 | controller | Tuesday 24 February 2026 15:55:00 +0000 (0:00:00.031) 0:00:16.019 ****** 2026-02-24 15:55:00.436343 | controller | skipping: [instance] 2026-02-24 15:55:00.436604 | controller | 2026-02-24 15:55:00.436912 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-24 15:55:00.437180 | controller | Tuesday 24 February 2026 15:55:00 +0000 (0:00:00.032) 0:00:16.052 ****** 2026-02-24 15:55:00.468566 | controller | skipping: [instance] 2026-02-24 15:55:00.468709 | controller | 2026-02-24 15:55:00.468867 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-24 15:55:00.468994 | controller | Tuesday 24 February 2026 15:55:00 +0000 (0:00:00.032) 0:00:16.084 ****** 2026-02-24 15:55:00.662063 | controller | ok: [instance] 2026-02-24 15:55:00.890881 | controller | 2026-02-24 15:55:00.890932 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-24 15:55:00.890941 | controller | Tuesday 24 February 2026 15:55:00 +0000 (0:00:00.192) 0:00:16.277 ****** 2026-02-24 15:55:00.890955 | controller | changed: [instance] 2026-02-24 15:55:00.890979 | controller | 2026-02-24 15:55:00.890987 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-24 15:55:00.891081 | controller | Tuesday 24 February 2026 15:55:00 +0000 (0:00:00.229) 0:00:16.506 ****** 2026-02-24 15:55:01.132751 | controller | changed: [instance] 2026-02-24 15:55:01.158543 | controller | 2026-02-24 15:55:01.158566 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-24 15:55:01.158575 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.241) 0:00:16.747 ****** 2026-02-24 15:55:01.158587 | controller | skipping: [instance] 2026-02-24 15:55:01.186943 | controller | 2026-02-24 15:55:01.186980 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-24 15:55:01.186992 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.026) 0:00:16.774 ****** 2026-02-24 15:55:01.187014 | controller | skipping: [instance] 2026-02-24 15:55:01.187060 | controller | 2026-02-24 15:55:01.187080 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-24 15:55:01.187093 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.028) 0:00:16.802 ****** 2026-02-24 15:55:01.212958 | controller | skipping: [instance] 2026-02-24 15:55:01.237469 | controller | 2026-02-24 15:55:01.237492 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-24 15:55:01.237502 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.025) 0:00:16.828 ****** 2026-02-24 15:55:01.237513 | controller | skipping: [instance] 2026-02-24 15:55:01.263457 | controller | 2026-02-24 15:55:01.263481 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-24 15:55:01.263499 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.024) 0:00:16.853 ****** 2026-02-24 15:55:01.263510 | controller | skipping: [instance] 2026-02-24 15:55:01.289924 | controller | 2026-02-24 15:55:01.289984 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-24 15:55:01.290000 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.025) 0:00:16.879 ****** 2026-02-24 15:55:01.290029 | controller | skipping: [instance] 2026-02-24 15:55:01.308304 | controller | 2026-02-24 15:55:01.308344 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-24 15:55:01.308359 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.026) 0:00:16.905 ****** 2026-02-24 15:55:01.308377 | controller | skipping: [instance] 2026-02-24 15:55:01.308391 | controller | 2026-02-24 15:55:01.308561 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-24 15:55:01.308698 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.018) 0:00:16.924 ****** 2026-02-24 15:55:01.338821 | controller | skipping: [instance] 2026-02-24 15:55:01.339008 | controller | 2026-02-24 15:55:01.339101 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-24 15:55:01.339232 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.030) 0:00:16.954 ****** 2026-02-24 15:55:01.360519 | controller | skipping: [instance] 2026-02-24 15:55:01.360729 | controller | 2026-02-24 15:55:01.360972 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-24 15:55:01.361104 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.021) 0:00:16.976 ****** 2026-02-24 15:55:01.388164 | controller | skipping: [instance] 2026-02-24 15:55:01.388298 | controller | 2026-02-24 15:55:01.388472 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2026-02-24 15:55:01.388583 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.027) 0:00:17.003 ****** 2026-02-24 15:55:01.424895 | controller | skipping: [instance] 2026-02-24 15:55:01.425004 | controller | 2026-02-24 15:55:01.425165 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2026-02-24 15:55:01.425275 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.036) 0:00:17.040 ****** 2026-02-24 15:55:01.462886 | controller | skipping: [instance] 2026-02-24 15:55:01.462987 | controller | 2026-02-24 15:55:01.463107 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2026-02-24 15:55:01.463234 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.038) 0:00:17.078 ****** 2026-02-24 15:55:01.497320 | controller | skipping: [instance] 2026-02-24 15:55:01.497449 | controller | 2026-02-24 15:55:01.497632 | controller | TASK [test_deps : Install additional packages] ********************************* 2026-02-24 15:55:01.497741 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.034) 0:00:17.113 ****** 2026-02-24 15:55:01.530903 | controller | skipping: [instance] 2026-02-24 15:55:01.531057 | controller | 2026-02-24 15:55:01.531223 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2026-02-24 15:55:01.531343 | controller | Tuesday 24 February 2026 15:55:01 +0000 (0:00:00.033) 0:00:17.146 ****** 2026-02-24 15:55:43.031911 | controller | ok: [instance] 2026-02-24 15:55:43.031954 | controller | 2026-02-24 15:55:43.031963 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2026-02-24 15:55:43.031974 | controller | Tuesday 24 February 2026 15:55:43 +0000 (0:00:41.500) 0:00:58.647 ****** 2026-02-24 15:55:44.259746 | controller | ok: [instance] 2026-02-24 15:55:44.299933 | controller | 2026-02-24 15:55:44.299977 | controller | TASK [test_deps : Install extra packages] ************************************** 2026-02-24 15:55:44.299988 | controller | Tuesday 24 February 2026 15:55:44 +0000 (0:00:01.227) 0:00:59.875 ****** 2026-02-24 15:55:44.300002 | controller | skipping: [instance] 2026-02-24 15:55:44.346582 | controller | 2026-02-24 15:55:44.346606 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-24 15:55:44.346623 | controller | Tuesday 24 February 2026 15:55:44 +0000 (0:00:00.040) 0:00:59.915 ****** 2026-02-24 15:55:44.346637 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2026-02-24 15:55:44.346847 | controller | 2026-02-24 15:55:44.346884 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-24 15:55:44.373020 | controller | Tuesday 24 February 2026 15:55:44 +0000 (0:00:00.046) 0:00:59.962 ****** 2026-02-24 15:55:44.373043 | controller | ok: [instance] => 2026-02-24 15:55:44.373080 | controller | cifmw_ci_setup_packages: 2026-02-24 15:55:44.373088 | controller | - bash-completion 2026-02-24 15:55:44.373095 | controller | - ca-certificates 2026-02-24 15:55:44.373102 | controller | - git-core 2026-02-24 15:55:44.373109 | controller | - make 2026-02-24 15:55:44.373116 | controller | - tar 2026-02-24 15:55:44.373124 | controller | - tmux 2026-02-24 15:55:44.373131 | controller | - python3-pip 2026-02-24 15:55:44.373138 | controller | 2026-02-24 15:55:44.373145 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-24 15:55:44.373154 | controller | Tuesday 24 February 2026 15:55:44 +0000 (0:00:00.025) 0:00:59.987 ****** 2026-02-24 15:55:52.628457 | controller | changed: [instance] 2026-02-24 15:55:52.628519 | controller | 2026-02-24 15:55:52.628777 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-24 15:55:53.239500 | controller | Tuesday 24 February 2026 15:55:52 +0000 (0:00:08.255) 0:01:08.243 ****** 2026-02-24 15:55:53.239552 | controller | ok: [instance] 2026-02-24 15:55:53.239578 | controller | 2026-02-24 15:55:53.239587 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-24 15:55:53.239696 | controller | Tuesday 24 February 2026 15:55:53 +0000 (0:00:00.610) 0:01:08.854 ****** 2026-02-24 15:55:53.451168 | controller | changed: [instance] 2026-02-24 15:55:53.451353 | controller | 2026-02-24 15:55:53.451379 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-24 15:55:59.466928 | controller | Tuesday 24 February 2026 15:55:53 +0000 (0:00:00.211) 0:01:09.066 ****** 2026-02-24 15:55:59.466972 | controller | changed: [instance] 2026-02-24 15:55:59.467007 | controller | 2026-02-24 15:55:59.467018 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-24 15:55:59.467090 | controller | Tuesday 24 February 2026 15:55:59 +0000 (0:00:06.015) 0:01:15.082 ****** 2026-02-24 15:55:59.503644 | controller | ok: [instance] 2026-02-24 15:55:59.803785 | controller | 2026-02-24 15:55:59.803824 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-24 15:55:59.803835 | controller | Tuesday 24 February 2026 15:55:59 +0000 (0:00:00.036) 0:01:15.118 ****** 2026-02-24 15:55:59.803847 | controller | changed: [instance] 2026-02-24 15:56:00.075405 | controller | 2026-02-24 15:56:00.075443 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-24 15:56:00.075453 | controller | Tuesday 24 February 2026 15:55:59 +0000 (0:00:00.299) 0:01:15.418 ****** 2026-02-24 15:56:00.075465 | controller | changed: [instance] 2026-02-24 15:56:00.092171 | controller | 2026-02-24 15:56:00.092193 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-24 15:56:00.092202 | controller | Tuesday 24 February 2026 15:56:00 +0000 (0:00:00.271) 0:01:15.690 ****** 2026-02-24 15:56:00.092213 | controller | skipping: [instance] 2026-02-24 15:56:00.109658 | controller | 2026-02-24 15:56:00.109675 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-24 15:56:00.109683 | controller | Tuesday 24 February 2026 15:56:00 +0000 (0:00:00.016) 0:01:15.707 ****** 2026-02-24 15:56:00.109692 | controller | skipping: [instance] 2026-02-24 15:56:00.127027 | controller | 2026-02-24 15:56:00.127065 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-24 15:56:00.127076 | controller | Tuesday 24 February 2026 15:56:00 +0000 (0:00:00.017) 0:01:15.725 ****** 2026-02-24 15:56:00.127089 | controller | skipping: [instance] 2026-02-24 15:56:00.144026 | controller | 2026-02-24 15:56:00.144050 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-24 15:56:00.144060 | controller | Tuesday 24 February 2026 15:56:00 +0000 (0:00:00.017) 0:01:15.742 ****** 2026-02-24 15:56:00.144071 | controller | skipping: [instance] 2026-02-24 15:56:00.160584 | controller | 2026-02-24 15:56:00.160604 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-24 15:56:00.160620 | controller | Tuesday 24 February 2026 15:56:00 +0000 (0:00:00.016) 0:01:15.759 ****** 2026-02-24 15:56:00.160630 | controller | skipping: [instance] 2026-02-24 15:56:00.182902 | controller | 2026-02-24 15:56:00.182922 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-24 15:56:00.182930 | controller | Tuesday 24 February 2026 15:56:00 +0000 (0:00:00.016) 0:01:15.776 ****** 2026-02-24 15:56:00.182940 | controller | skipping: [instance] 2026-02-24 15:56:00.183089 | controller | 2026-02-24 15:56:00.183247 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-24 15:56:00.183404 | controller | Tuesday 24 February 2026 15:56:00 +0000 (0:00:00.022) 0:01:15.798 ****** 2026-02-24 15:56:01.144904 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2026-02-24 15:56:01.472875 | controller | changed: [instance] => (item=/opt/basedir/logs) 2026-02-24 15:56:01.472910 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2026-02-24 15:56:01.472920 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2026-02-24 15:56:01.472927 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2026-02-24 15:56:01.472934 | controller | 2026-02-24 15:56:01.472940 | controller | TASK [Create secret file] ****************************************************** 2026-02-24 15:56:01.472948 | controller | Tuesday 24 February 2026 15:56:01 +0000 (0:00:00.960) 0:01:16.759 ****** 2026-02-24 15:56:01.472969 | controller | changed: [instance] 2026-02-24 15:56:01.473013 | controller | 2026-02-24 15:56:01.473022 | controller | PLAY RECAP ********************************************************************* 2026-02-24 15:56:01.473029 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2026-02-24 15:56:01.473036 | controller | 2026-02-24 15:56:01.473042 | controller | Tuesday 24 February 2026 15:56:01 +0000 (0:00:00.327) 0:01:17.087 ****** 2026-02-24 15:56:01.473049 | controller | =============================================================================== 2026-02-24 15:56:01.473056 | controller | test_deps : Install selinux python libs -------------------------------- 41.50s 2026-02-24 15:56:01.473062 | controller | ci_setup : Install needed packages -------------------------------------- 8.26s 2026-02-24 15:56:01.473068 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.43s 2026-02-24 15:56:01.473075 | controller | ci_setup : Install openshift client ------------------------------------- 6.02s 2026-02-24 15:56:01.473081 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.38s 2026-02-24 15:56:01.473087 | controller | test_deps : Install python yaml libs ------------------------------------ 1.23s 2026-02-24 15:56:01.473096 | controller | repo_setup : Run repo-setup --------------------------------------------- 1.03s 2026-02-24 15:56:01.473119 | controller | ci_setup : Manage directories ------------------------------------------- 0.96s 2026-02-24 15:56:01.473128 | controller | Gathering Facts --------------------------------------------------------- 0.86s 2026-02-24 15:56:01.474070 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.86s 2026-02-24 15:56:01.526697 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.72s 2026-02-24 15:56:01.526717 | controller | repo_setup : Install repo-setup package --------------------------------- 0.70s 2026-02-24 15:56:01.526725 | controller | ci_setup : Gather version of openshift client --------------------------- 0.61s 2026-02-24 15:56:01.526731 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.55s 2026-02-24 15:56:01.526736 | controller | repo_setup : Ensure directories are present ----------------------------- 0.54s 2026-02-24 15:56:01.526741 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.48s 2026-02-24 15:56:01.526746 | controller | Create custom basedir --------------------------------------------------- 0.33s 2026-02-24 15:56:01.526751 | controller | Create secret file ------------------------------------------------------ 0.33s 2026-02-24 15:56:01.526756 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.30s 2026-02-24 15:56:01.526788 | controller | ci_setup : Create completion file --------------------------------------- 0.30s 2026-02-24 15:56:01.526801 | controller | INFO Running crc_layout > converge 2026-02-24 15:56:02.086749 | controller | 2026-02-24 15:56:02.086964 | controller | PLAY [Converge] **************************************************************** 2026-02-24 15:56:02.087084 | controller | 2026-02-24 15:56:02.087207 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-24 15:56:02.087332 | controller | Tuesday 24 February 2026 15:56:02 +0000 (0:00:00.024) 0:00:00.024 ****** 2026-02-24 15:56:02.893299 | controller | ok: [instance] 2026-02-24 15:56:02.917987 | controller | 2026-02-24 15:56:02.918038 | controller | TASK [Load networking definition from scenario file] *************************** 2026-02-24 15:56:02.918053 | controller | Tuesday 24 February 2026 15:56:02 +0000 (0:00:00.806) 0:00:00.831 ****** 2026-02-24 15:56:02.918071 | controller | ok: [instance] 2026-02-24 15:56:04.462787 | controller | 2026-02-24 15:56:04.462821 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-24 15:56:04.462829 | controller | Tuesday 24 February 2026 15:56:02 +0000 (0:00:00.024) 0:00:00.855 ****** 2026-02-24 15:56:04.462839 | controller | changed: [instance] 2026-02-24 15:56:04.490192 | controller | 2026-02-24 15:56:04.490213 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-24 15:56:04.490229 | controller | Tuesday 24 February 2026 15:56:04 +0000 (0:00:01.545) 0:00:02.401 ****** 2026-02-24 15:56:04.490241 | controller | ok: [instance] 2026-02-24 15:56:04.511864 | controller | 2026-02-24 15:56:04.511898 | controller | TASK [reproducer : Load CI job environment] ************************************ 2026-02-24 15:56:04.511907 | controller | Tuesday 24 February 2026 15:56:04 +0000 (0:00:00.027) 0:00:02.428 ****** 2026-02-24 15:56:04.511918 | controller | skipping: [instance] 2026-02-24 15:56:04.511924 | controller | 2026-02-24 15:56:04.511930 | controller | TASK [Build final libvirt layout] ********************************************** 2026-02-24 15:56:04.511937 | controller | Tuesday 24 February 2026 15:56:04 +0000 (0:00:00.021) 0:00:02.450 ****** 2026-02-24 15:56:04.563376 | controller | 2026-02-24 15:56:04.645342 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2026-02-24 15:56:04.645361 | controller | Tuesday 24 February 2026 15:56:04 +0000 (0:00:00.051) 0:00:02.502 ****** 2026-02-24 15:56:04.645372 | controller | ok: [instance] 2026-02-24 15:56:04.716817 | controller | 2026-02-24 15:56:04.716840 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2026-02-24 15:56:04.716848 | controller | Tuesday 24 February 2026 15:56:04 +0000 (0:00:00.081) 0:00:02.583 ****** 2026-02-24 15:56:04.716858 | controller | skipping: [instance] 2026-02-24 15:56:04.744970 | controller | 2026-02-24 15:56:04.745020 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2026-02-24 15:56:04.745034 | controller | Tuesday 24 February 2026 15:56:04 +0000 (0:00:00.071) 0:00:02.654 ****** 2026-02-24 15:56:04.745052 | controller | ok: [instance] 2026-02-24 15:56:04.768885 | controller | 2026-02-24 15:56:04.768925 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2026-02-24 15:56:04.768939 | controller | Tuesday 24 February 2026 15:56:04 +0000 (0:00:00.028) 0:00:02.683 ****** 2026-02-24 15:56:04.768957 | controller | ok: [instance] => changed=false 2026-02-24 15:56:04.768983 | controller | msg: All assertions passed 2026-02-24 15:56:04.769186 | controller | 2026-02-24 15:56:04.769269 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2026-02-24 15:56:04.769425 | controller | Tuesday 24 February 2026 15:56:04 +0000 (0:00:00.024) 0:00:02.707 ****** 2026-02-24 15:56:04.811673 | controller | ok: [instance] 2026-02-24 15:56:04.811862 | controller | 2026-02-24 15:56:04.812002 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2026-02-24 15:56:04.812151 | controller | Tuesday 24 February 2026 15:56:04 +0000 (0:00:00.042) 0:00:02.750 ****** 2026-02-24 15:56:05.256863 | controller | ok: [instance] => (item=artifacts) 2026-02-24 15:56:05.256913 | controller | ok: [instance] => (item=logs) 2026-02-24 15:56:05.256921 | controller | 2026-02-24 15:56:05.256929 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2026-02-24 15:56:05.257021 | controller | Tuesday 24 February 2026 15:56:05 +0000 (0:00:00.444) 0:00:03.195 ****** 2026-02-24 15:56:05.334732 | controller | 2026-02-24 15:56:05.520420 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2026-02-24 15:56:05.520450 | controller | Tuesday 24 February 2026 15:56:05 +0000 (0:00:00.078) 0:00:03.273 ****** 2026-02-24 15:56:05.520463 | controller | ok: [instance] 2026-02-24 15:56:05.796740 | controller | 2026-02-24 15:56:05.796784 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2026-02-24 15:56:05.796795 | controller | Tuesday 24 February 2026 15:56:05 +0000 (0:00:00.185) 0:00:03.458 ****** 2026-02-24 15:56:05.796806 | controller | changed: [instance] 2026-02-24 15:56:06.079314 | controller | 2026-02-24 15:56:06.079337 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2026-02-24 15:56:06.079344 | controller | Tuesday 24 February 2026 15:56:05 +0000 (0:00:00.276) 0:00:03.735 ****** 2026-02-24 15:56:06.079354 | controller | ok: [instance] 2026-02-24 15:56:06.108815 | controller | 2026-02-24 15:56:06.108846 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2026-02-24 15:56:06.108858 | controller | Tuesday 24 February 2026 15:56:06 +0000 (0:00:00.282) 0:00:04.017 ****** 2026-02-24 15:56:06.108874 | controller | skipping: [instance] 2026-02-24 15:56:06.124966 | controller | 2026-02-24 15:56:06.125006 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2026-02-24 15:56:06.125020 | controller | Tuesday 24 February 2026 15:56:06 +0000 (0:00:00.029) 0:00:04.047 ****** 2026-02-24 15:56:06.125037 | controller | skipping: [instance] 2026-02-24 15:56:06.125084 | controller | 2026-02-24 15:56:06.125098 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2026-02-24 15:56:06.125244 | controller | Tuesday 24 February 2026 15:56:06 +0000 (0:00:00.016) 0:00:04.063 ****** 2026-02-24 15:56:06.144298 | controller | ok: [instance] 2026-02-24 15:56:06.169733 | controller | 2026-02-24 15:56:06.169794 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2026-02-24 15:56:06.169822 | controller | Tuesday 24 February 2026 15:56:06 +0000 (0:00:00.019) 0:00:04.082 ****** 2026-02-24 15:56:06.169840 | controller | skipping: [instance] 2026-02-24 15:56:14.431679 | controller | 2026-02-24 15:56:14.431711 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2026-02-24 15:56:14.431720 | controller | Tuesday 24 February 2026 15:56:06 +0000 (0:00:00.025) 0:00:04.108 ****** 2026-02-24 15:56:14.431730 | controller | changed: [instance] 2026-02-24 15:56:14.431756 | controller | 2026-02-24 15:56:14.431778 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2026-02-24 15:56:14.431945 | controller | Tuesday 24 February 2026 15:56:14 +0000 (0:00:08.261) 0:00:12.369 ****** 2026-02-24 15:56:14.642840 | controller | changed: [instance] 2026-02-24 15:56:15.144487 | controller | 2026-02-24 15:56:15.144530 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2026-02-24 15:56:15.144538 | controller | Tuesday 24 February 2026 15:56:14 +0000 (0:00:00.211) 0:00:12.580 ****** 2026-02-24 15:56:15.144549 | controller | changed: [instance] 2026-02-24 15:56:15.718541 | controller | 2026-02-24 15:56:15.718576 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2026-02-24 15:56:15.718584 | controller | Tuesday 24 February 2026 15:56:15 +0000 (0:00:00.501) 0:00:13.082 ****** 2026-02-24 15:56:15.718594 | controller | changed: [instance] 2026-02-24 15:56:15.907844 | controller | 2026-02-24 15:56:15.907877 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2026-02-24 15:56:15.907885 | controller | Tuesday 24 February 2026 15:56:15 +0000 (0:00:00.573) 0:00:13.656 ****** 2026-02-24 15:56:15.907895 | controller | ok: [instance] 2026-02-24 15:56:15.907919 | controller | 2026-02-24 15:56:15.907927 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2026-02-24 15:56:15.908025 | controller | Tuesday 24 February 2026 15:56:15 +0000 (0:00:00.189) 0:00:13.846 ****** 2026-02-24 15:56:16.539639 | controller | ok: [instance] 2026-02-24 15:56:17.259889 | controller | 2026-02-24 15:56:17.259923 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2026-02-24 15:56:17.259941 | controller | Tuesday 24 February 2026 15:56:16 +0000 (0:00:00.631) 0:00:14.477 ****** 2026-02-24 15:56:17.259953 | controller | changed: [instance] 2026-02-24 15:56:17.360985 | controller | 2026-02-24 15:56:17.361041 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2026-02-24 15:56:17.361055 | controller | Tuesday 24 February 2026 15:56:17 +0000 (0:00:00.720) 0:00:15.198 ****** 2026-02-24 15:56:17.361075 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2026-02-24 15:56:17.688085 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2026-02-24 15:56:17.688116 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2026-02-24 15:56:17.688124 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2026-02-24 15:56:17.688129 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2026-02-24 15:56:17.688135 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2026-02-24 15:56:17.688140 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2026-02-24 15:56:17.688145 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2026-02-24 15:56:17.688151 | controller | 2026-02-24 15:56:17.688157 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2026-02-24 15:56:17.688162 | controller | Tuesday 24 February 2026 15:56:17 +0000 (0:00:00.100) 0:00:15.298 ****** 2026-02-24 15:56:17.688172 | controller | ok: [instance] 2026-02-24 15:56:17.999470 | controller | 2026-02-24 15:56:17.999518 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2026-02-24 15:56:17.999527 | controller | Tuesday 24 February 2026 15:56:17 +0000 (0:00:00.327) 0:00:15.626 ****** 2026-02-24 15:56:17.999538 | controller | ok: [instance] 2026-02-24 15:56:18.307782 | controller | 2026-02-24 15:56:18.307811 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2026-02-24 15:56:18.307820 | controller | Tuesday 24 February 2026 15:56:17 +0000 (0:00:00.311) 0:00:15.937 ****** 2026-02-24 15:56:18.307830 | controller | ok: [instance] 2026-02-24 15:56:18.610380 | controller | 2026-02-24 15:56:18.610403 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2026-02-24 15:56:18.610411 | controller | Tuesday 24 February 2026 15:56:18 +0000 (0:00:00.308) 0:00:16.246 ****** 2026-02-24 15:56:18.610420 | controller | ok: [instance] 2026-02-24 15:56:18.914118 | controller | 2026-02-24 15:56:18.914135 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2026-02-24 15:56:18.914142 | controller | Tuesday 24 February 2026 15:56:18 +0000 (0:00:00.302) 0:00:16.548 ****** 2026-02-24 15:56:18.914151 | controller | ok: [instance] 2026-02-24 15:56:19.220894 | controller | 2026-02-24 15:56:19.220930 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2026-02-24 15:56:19.220938 | controller | Tuesday 24 February 2026 15:56:18 +0000 (0:00:00.303) 0:00:16.852 ****** 2026-02-24 15:56:19.220949 | controller | ok: [instance] 2026-02-24 15:56:19.220976 | controller | 2026-02-24 15:56:19.221156 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2026-02-24 15:56:19.527689 | controller | Tuesday 24 February 2026 15:56:19 +0000 (0:00:00.306) 0:00:17.159 ****** 2026-02-24 15:56:19.527725 | controller | ok: [instance] 2026-02-24 15:56:19.833797 | controller | 2026-02-24 15:56:19.833826 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2026-02-24 15:56:19.833835 | controller | Tuesday 24 February 2026 15:56:19 +0000 (0:00:00.306) 0:00:17.466 ****** 2026-02-24 15:56:19.833850 | controller | ok: [instance] 2026-02-24 15:56:20.140670 | controller | 2026-02-24 15:56:20.140692 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2026-02-24 15:56:20.140700 | controller | Tuesday 24 February 2026 15:56:19 +0000 (0:00:00.306) 0:00:17.772 ****** 2026-02-24 15:56:20.140709 | controller | ok: [instance] 2026-02-24 15:56:21.457751 | controller | 2026-02-24 15:56:21.457797 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2026-02-24 15:56:21.457806 | controller | Tuesday 24 February 2026 15:56:20 +0000 (0:00:00.306) 0:00:18.079 ****** 2026-02-24 15:56:21.457816 | controller | ok: [instance] 2026-02-24 15:56:21.765840 | controller | 2026-02-24 15:56:21.765876 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2026-02-24 15:56:21.765885 | controller | Tuesday 24 February 2026 15:56:21 +0000 (0:00:01.316) 0:00:19.396 ****** 2026-02-24 15:56:21.765897 | controller | ok: [instance] 2026-02-24 15:56:21.765928 | controller | 2026-02-24 15:56:21.765937 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2026-02-24 15:56:21.766073 | controller | Tuesday 24 February 2026 15:56:21 +0000 (0:00:00.308) 0:00:19.704 ****** 2026-02-24 15:56:22.076367 | controller | ok: [instance] 2026-02-24 15:56:22.384861 | controller | 2026-02-24 15:56:22.384891 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2026-02-24 15:56:22.384899 | controller | Tuesday 24 February 2026 15:56:22 +0000 (0:00:00.310) 0:00:20.014 ****** 2026-02-24 15:56:22.384909 | controller | ok: [instance] 2026-02-24 15:56:22.690919 | controller | 2026-02-24 15:56:22.690956 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2026-02-24 15:56:22.690970 | controller | Tuesday 24 February 2026 15:56:22 +0000 (0:00:00.308) 0:00:20.323 ****** 2026-02-24 15:56:22.690987 | controller | ok: [instance] 2026-02-24 15:56:23.000799 | controller | 2026-02-24 15:56:23.000829 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2026-02-24 15:56:23.000837 | controller | Tuesday 24 February 2026 15:56:22 +0000 (0:00:00.305) 0:00:20.629 ****** 2026-02-24 15:56:23.000847 | controller | ok: [instance] 2026-02-24 15:56:23.317997 | controller | 2026-02-24 15:56:23.318027 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2026-02-24 15:56:23.318035 | controller | Tuesday 24 February 2026 15:56:22 +0000 (0:00:00.309) 0:00:20.939 ****** 2026-02-24 15:56:23.318045 | controller | ok: [instance] 2026-02-24 15:56:23.636901 | controller | 2026-02-24 15:56:23.636943 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2026-02-24 15:56:23.636953 | controller | Tuesday 24 February 2026 15:56:23 +0000 (0:00:00.317) 0:00:21.256 ****** 2026-02-24 15:56:23.636965 | controller | ok: [instance] 2026-02-24 15:56:23.636994 | controller | 2026-02-24 15:56:23.637004 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2026-02-24 15:56:23.637066 | controller | Tuesday 24 February 2026 15:56:23 +0000 (0:00:00.319) 0:00:21.575 ****** 2026-02-24 15:56:23.948723 | controller | ok: [instance] 2026-02-24 15:56:24.255636 | controller | 2026-02-24 15:56:24.255663 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2026-02-24 15:56:24.255671 | controller | Tuesday 24 February 2026 15:56:23 +0000 (0:00:00.311) 0:00:21.887 ****** 2026-02-24 15:56:24.255681 | controller | ok: [instance] 2026-02-24 15:56:24.568406 | controller | 2026-02-24 15:56:24.568433 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2026-02-24 15:56:24.568441 | controller | Tuesday 24 February 2026 15:56:24 +0000 (0:00:00.306) 0:00:22.194 ****** 2026-02-24 15:56:24.568451 | controller | ok: [instance] 2026-02-24 15:56:24.875790 | controller | 2026-02-24 15:56:24.875820 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2026-02-24 15:56:24.875828 | controller | Tuesday 24 February 2026 15:56:24 +0000 (0:00:00.312) 0:00:22.506 ****** 2026-02-24 15:56:24.875838 | controller | ok: [instance] 2026-02-24 15:56:25.180861 | controller | 2026-02-24 15:56:25.180892 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2026-02-24 15:56:25.180902 | controller | Tuesday 24 February 2026 15:56:24 +0000 (0:00:00.307) 0:00:22.814 ****** 2026-02-24 15:56:25.180923 | controller | ok: [instance] 2026-02-24 15:56:25.489285 | controller | 2026-02-24 15:56:25.489315 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2026-02-24 15:56:25.489329 | controller | Tuesday 24 February 2026 15:56:25 +0000 (0:00:00.304) 0:00:23.119 ****** 2026-02-24 15:56:25.489339 | controller | ok: [instance] 2026-02-24 15:56:25.793188 | controller | 2026-02-24 15:56:25.793216 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2026-02-24 15:56:25.793224 | controller | Tuesday 24 February 2026 15:56:25 +0000 (0:00:00.308) 0:00:23.427 ****** 2026-02-24 15:56:25.793235 | controller | ok: [instance] 2026-02-24 15:56:25.811941 | controller | 2026-02-24 15:56:25.811990 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2026-02-24 15:56:25.812004 | controller | Tuesday 24 February 2026 15:56:25 +0000 (0:00:00.303) 0:00:23.731 ****** 2026-02-24 15:56:25.812022 | controller | skipping: [instance] 2026-02-24 15:56:26.084886 | controller | 2026-02-24 15:56:26.084917 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2026-02-24 15:56:26.084926 | controller | Tuesday 24 February 2026 15:56:25 +0000 (0:00:00.018) 0:00:23.750 ****** 2026-02-24 15:56:26.084938 | controller | ok: [instance] 2026-02-24 15:56:26.084964 | controller | 2026-02-24 15:56:26.084974 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2026-02-24 15:56:26.085071 | controller | Tuesday 24 February 2026 15:56:26 +0000 (0:00:00.273) 0:00:24.023 ****** 2026-02-24 15:56:26.449923 | controller | ok: [instance] 2026-02-24 15:56:26.449956 | controller | 2026-02-24 15:56:26.449966 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2026-02-24 15:56:26.449975 | controller | Tuesday 24 February 2026 15:56:26 +0000 (0:00:00.364) 0:00:24.388 ****** 2026-02-24 15:56:26.741581 | controller | changed: [instance] 2026-02-24 15:56:27.008130 | controller | 2026-02-24 15:56:27.008159 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2026-02-24 15:56:27.008168 | controller | Tuesday 24 February 2026 15:56:26 +0000 (0:00:00.291) 0:00:24.679 ****** 2026-02-24 15:56:27.008178 | controller | [WARNING]: Reset is not implemented for this connection 2026-02-24 15:56:27.017847 | controller | changed: [instance] 2026-02-24 15:56:27.017886 | controller | 2026-02-24 15:56:27.017895 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2026-02-24 15:56:27.017902 | controller | Tuesday 24 February 2026 15:56:27 +0000 (0:00:00.261) 0:00:24.941 ****** 2026-02-24 15:56:27.017909 | controller | 2026-02-24 15:56:27.017917 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2026-02-24 15:56:27.017960 | controller | Tuesday 24 February 2026 15:56:27 +0000 (0:00:00.015) 0:00:24.956 ****** 2026-02-24 15:56:27.085726 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2026-02-24 15:56:27.141710 | controller | 2026-02-24 15:56:27.141736 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2026-02-24 15:56:27.141744 | controller | Tuesday 24 February 2026 15:56:27 +0000 (0:00:00.068) 0:00:25.024 ****** 2026-02-24 15:56:27.141758 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2026-02-24 15:56:27.186567 | controller | 2026-02-24 15:56:27.186594 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-02-24 15:56:27.186603 | controller | Tuesday 24 February 2026 15:56:27 +0000 (0:00:00.055) 0:00:25.080 ****** 2026-02-24 15:56:27.186614 | controller | ok: [instance] => (item=compute) 2026-02-24 15:56:27.223745 | controller | ok: [instance] => (item=controller) 2026-02-24 15:56:27.223787 | controller | ok: [instance] => (item=crc) 2026-02-24 15:56:27.223799 | controller | 2026-02-24 15:56:27.223807 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-02-24 15:56:27.223813 | controller | Tuesday 24 February 2026 15:56:27 +0000 (0:00:00.044) 0:00:25.124 ****** 2026-02-24 15:56:27.223824 | controller | ok: [instance] 2026-02-24 15:56:27.264884 | controller | 2026-02-24 15:56:27.264916 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-02-24 15:56:27.264933 | controller | Tuesday 24 February 2026 15:56:27 +0000 (0:00:00.037) 0:00:25.162 ****** 2026-02-24 15:56:27.264944 | controller | ok: [instance] => changed=false 2026-02-24 15:56:27.264964 | controller | msg: All assertions passed 2026-02-24 15:56:27.264973 | controller | 2026-02-24 15:56:27.265127 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2026-02-24 15:56:27.306165 | controller | Tuesday 24 February 2026 15:56:27 +0000 (0:00:00.041) 0:00:25.203 ****** 2026-02-24 15:56:27.306188 | controller | 2026-02-24 15:56:27.306360 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2026-02-24 15:56:27.306534 | controller | Tuesday 24 February 2026 15:56:27 +0000 (0:00:00.041) 0:00:25.245 ****** 2026-02-24 15:56:27.380957 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.49', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2026-02-24 15:56:27.381147 | controller | ok: [instance] => (item={}) 2026-02-24 15:56:27.381298 | controller | 2026-02-24 15:56:27.381429 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2026-02-24 15:56:27.381571 | controller | Tuesday 24 February 2026 15:56:27 +0000 (0:00:00.074) 0:00:25.319 ****** 2026-02-24 15:56:27.397543 | controller | skipping: [instance] 2026-02-24 15:56:27.397707 | controller | 2026-02-24 15:56:27.397889 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2026-02-24 15:56:27.398042 | controller | Tuesday 24 February 2026 15:56:27 +0000 (0:00:00.016) 0:00:25.336 ****** 2026-02-24 15:56:27.606843 | controller | ok: [instance] 2026-02-24 15:56:27.606890 | controller | 2026-02-24 15:56:27.606901 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2026-02-24 15:56:27.606993 | controller | Tuesday 24 February 2026 15:56:27 +0000 (0:00:00.208) 0:00:25.545 ****** 2026-02-24 15:56:27.937930 | controller | changed: [instance] 2026-02-24 15:56:28.649592 | controller | 2026-02-24 15:56:28.649621 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2026-02-24 15:56:28.649630 | controller | Tuesday 24 February 2026 15:56:27 +0000 (0:00:00.331) 0:00:25.876 ****** 2026-02-24 15:56:28.649640 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2026-02-24 15:56:28.674430 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2026-02-24 15:56:28.674452 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2026-02-24 15:56:28.674460 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2026-02-24 15:56:28.674467 | controller | 2026-02-24 15:56:28.674474 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2026-02-24 15:56:28.674480 | controller | Tuesday 24 February 2026 15:56:28 +0000 (0:00:00.711) 0:00:26.587 ****** 2026-02-24 15:56:28.674490 | controller | skipping: [instance] 2026-02-24 15:56:29.031597 | controller | 2026-02-24 15:56:29.031625 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2026-02-24 15:56:29.031633 | controller | Tuesday 24 February 2026 15:56:28 +0000 (0:00:00.025) 0:00:26.613 ****** 2026-02-24 15:56:29.031643 | controller | changed: [instance] 2026-02-24 15:56:29.460239 | controller | 2026-02-24 15:56:29.460269 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2026-02-24 15:56:29.460277 | controller | Tuesday 24 February 2026 15:56:29 +0000 (0:00:00.348) 0:00:26.961 ****** 2026-02-24 15:56:29.460283 | controller | 2026-02-24 15:56:29.460288 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 15:56:29.460293 | controller | Tuesday 24 February 2026 15:56:29 +0000 (0:00:00.008) 0:00:26.969 ****** 2026-02-24 15:56:29.460310 | controller | changed: [instance] 2026-02-24 15:56:29.535206 | controller | 2026-02-24 15:56:29.535238 | controller | TASK [Ensure no default networks exists] *************************************** 2026-02-24 15:56:29.535249 | controller | Tuesday 24 February 2026 15:56:29 +0000 (0:00:00.428) 0:00:27.398 ****** 2026-02-24 15:56:29.535262 | controller | 2026-02-24 15:56:30.715617 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2026-02-24 15:56:30.715649 | controller | Tuesday 24 February 2026 15:56:29 +0000 (0:00:00.074) 0:00:27.473 ****** 2026-02-24 15:56:30.715661 | controller | ok: [instance] 2026-02-24 15:56:30.941098 | controller | 2026-02-24 15:56:30.941150 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2026-02-24 15:56:30.941164 | controller | Tuesday 24 February 2026 15:56:30 +0000 (0:00:01.180) 0:00:28.653 ****** 2026-02-24 15:56:30.941182 | controller | ok: [instance] 2026-02-24 15:56:30.941229 | controller | 2026-02-24 15:56:30.941243 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2026-02-24 15:56:30.941340 | controller | Tuesday 24 February 2026 15:56:30 +0000 (0:00:00.225) 0:00:28.879 ****** 2026-02-24 15:56:31.448706 | controller | ok: [instance] 2026-02-24 15:56:31.675863 | controller | 2026-02-24 15:56:31.675923 | controller | TASK [libvirt_manager : Removing default] ************************************** 2026-02-24 15:56:31.675939 | controller | Tuesday 24 February 2026 15:56:31 +0000 (0:00:00.507) 0:00:29.387 ****** 2026-02-24 15:56:31.675960 | controller | ok: [instance] 2026-02-24 15:56:32.846395 | controller | 2026-02-24 15:56:32.846440 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2026-02-24 15:56:32.846454 | controller | Tuesday 24 February 2026 15:56:31 +0000 (0:00:00.227) 0:00:29.614 ****** 2026-02-24 15:56:32.846471 | controller | ok: [instance] 2026-02-24 15:56:32.846645 | controller | 2026-02-24 15:56:33.151966 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2026-02-24 15:56:33.152012 | controller | Tuesday 24 February 2026 15:56:32 +0000 (0:00:01.170) 0:00:30.784 ****** 2026-02-24 15:56:33.152037 | controller | ok: [instance] 2026-02-24 15:56:33.152106 | controller | 2026-02-24 15:56:33.152145 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2026-02-24 15:56:33.152166 | controller | Tuesday 24 February 2026 15:56:33 +0000 (0:00:00.305) 0:00:31.090 ****** 2026-02-24 15:56:33.461151 | controller | changed: [instance] 2026-02-24 15:56:34.762401 | controller | 2026-02-24 15:56:34.762436 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2026-02-24 15:56:34.762445 | controller | Tuesday 24 February 2026 15:56:33 +0000 (0:00:00.309) 0:00:31.399 ****** 2026-02-24 15:56:34.762455 | controller | changed: [instance] 2026-02-24 15:56:35.316850 | controller | 2026-02-24 15:56:35.316881 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2026-02-24 15:56:35.316889 | controller | Tuesday 24 February 2026 15:56:34 +0000 (0:00:01.300) 0:00:32.700 ****** 2026-02-24 15:56:35.316900 | controller | changed: [instance] => (item=arptables) 2026-02-24 15:56:35.629925 | controller | changed: [instance] => (item=iptables) 2026-02-24 15:56:35.629964 | controller | changed: [instance] => (item=ip6tables) 2026-02-24 15:56:35.629972 | controller | 2026-02-24 15:56:35.629978 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2026-02-24 15:56:35.629984 | controller | Tuesday 24 February 2026 15:56:35 +0000 (0:00:00.553) 0:00:33.253 ****** 2026-02-24 15:56:35.629995 | controller | ok: [instance] 2026-02-24 15:56:35.718900 | controller | 2026-02-24 15:56:35.718934 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2026-02-24 15:56:35.718944 | controller | Tuesday 24 February 2026 15:56:35 +0000 (0:00:00.314) 0:00:33.567 ****** 2026-02-24 15:56:35.718957 | controller | ok: [instance] 2026-02-24 15:56:35.761884 | controller | 2026-02-24 15:56:35.761906 | controller | TASK [Ensure the required network configurations are applied] ****************** 2026-02-24 15:56:35.761915 | controller | Tuesday 24 February 2026 15:56:35 +0000 (0:00:00.089) 0:00:33.657 ****** 2026-02-24 15:56:35.761927 | controller | 2026-02-24 15:56:35.762020 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2026-02-24 15:56:35.762053 | controller | Tuesday 24 February 2026 15:56:35 +0000 (0:00:00.043) 0:00:33.700 ****** 2026-02-24 15:56:35.784511 | controller | skipping: [instance] 2026-02-24 15:56:35.807982 | controller | 2026-02-24 15:56:35.808018 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2026-02-24 15:56:35.808028 | controller | Tuesday 24 February 2026 15:56:35 +0000 (0:00:00.022) 0:00:33.723 ****** 2026-02-24 15:56:35.808040 | controller | skipping: [instance] 2026-02-24 15:56:35.808157 | controller | 2026-02-24 15:56:35.808173 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 15:56:35.808329 | controller | Tuesday 24 February 2026 15:56:35 +0000 (0:00:00.023) 0:00:33.746 ****** 2026-02-24 15:56:35.830294 | controller | skipping: [instance] 2026-02-24 15:56:35.830451 | controller | 2026-02-24 15:56:35.830595 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2026-02-24 15:56:35.830757 | controller | Tuesday 24 February 2026 15:56:35 +0000 (0:00:00.022) 0:00:33.769 ****** 2026-02-24 15:56:35.861022 | controller | skipping: [instance] 2026-02-24 15:56:35.861249 | controller | 2026-02-24 15:56:35.861418 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2026-02-24 15:56:35.861501 | controller | Tuesday 24 February 2026 15:56:35 +0000 (0:00:00.030) 0:00:33.799 ****** 2026-02-24 15:56:35.900213 | controller | ok: [instance] 2026-02-24 15:56:35.900442 | controller | 2026-02-24 15:56:35.900555 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2026-02-24 15:56:35.900670 | controller | Tuesday 24 February 2026 15:56:35 +0000 (0:00:00.039) 0:00:33.838 ****** 2026-02-24 15:56:35.933082 | controller | skipping: [instance] 2026-02-24 15:56:35.933310 | controller | 2026-02-24 15:56:35.933524 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2026-02-24 15:56:35.933628 | controller | Tuesday 24 February 2026 15:56:35 +0000 (0:00:00.032) 0:00:33.871 ****** 2026-02-24 15:56:35.955905 | controller | skipping: [instance] 2026-02-24 15:56:35.956047 | controller | 2026-02-24 15:56:35.956188 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2026-02-24 15:56:35.956322 | controller | Tuesday 24 February 2026 15:56:35 +0000 (0:00:00.023) 0:00:33.894 ****** 2026-02-24 15:56:36.010806 | controller | ok: [instance] 2026-02-24 15:56:36.010934 | controller | 2026-02-24 15:56:36.011086 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2026-02-24 15:56:36.011171 | controller | Tuesday 24 February 2026 15:56:36 +0000 (0:00:00.054) 0:00:33.949 ****** 2026-02-24 15:56:36.032387 | controller | skipping: [instance] 2026-02-24 15:56:36.032518 | controller | 2026-02-24 15:56:36.032642 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2026-02-24 15:56:36.032779 | controller | Tuesday 24 February 2026 15:56:36 +0000 (0:00:00.021) 0:00:33.971 ****** 2026-02-24 15:56:36.080250 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2026-02-24 15:56:36.393310 | controller | 2026-02-24 15:56:36.393358 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-24 15:56:36.393372 | controller | Tuesday 24 February 2026 15:56:36 +0000 (0:00:00.047) 0:00:34.018 ****** 2026-02-24 15:56:36.393391 | controller | ok: [instance -> localhost] 2026-02-24 15:56:41.424222 | controller | 2026-02-24 15:56:41.424252 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2026-02-24 15:56:41.424261 | controller | Tuesday 24 February 2026 15:56:36 +0000 (0:00:00.312) 0:00:34.331 ****** 2026-02-24 15:56:41.424271 | controller | changed: [instance -> localhost] 2026-02-24 15:56:41.611692 | controller | 2026-02-24 15:56:41.611719 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-24 15:56:41.611727 | controller | Tuesday 24 February 2026 15:56:41 +0000 (0:00:05.031) 0:00:39.362 ****** 2026-02-24 15:56:41.611737 | controller | changed: [instance] 2026-02-24 15:56:41.948454 | controller | 2026-02-24 15:56:41.948500 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2026-02-24 15:56:41.948510 | controller | Tuesday 24 February 2026 15:56:41 +0000 (0:00:00.187) 0:00:39.550 ****** 2026-02-24 15:56:41.948529 | controller | changed: [instance] 2026-02-24 15:56:43.550791 | controller | 2026-02-24 15:56:43.550824 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2026-02-24 15:56:43.550833 | controller | Tuesday 24 February 2026 15:56:41 +0000 (0:00:00.336) 0:00:39.886 ****** 2026-02-24 15:56:43.550843 | controller | changed: [instance -> localhost] 2026-02-24 15:56:43.890414 | controller | 2026-02-24 15:56:43.890446 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2026-02-24 15:56:43.890457 | controller | Tuesday 24 February 2026 15:56:43 +0000 (0:00:01.602) 0:00:41.488 ****** 2026-02-24 15:56:43.890469 | controller | changed: [instance] 2026-02-24 15:56:43.920728 | controller | 2026-02-24 15:56:43.920747 | controller | TASK [reproducer : Select right domain] **************************************** 2026-02-24 15:56:43.920754 | controller | Tuesday 24 February 2026 15:56:43 +0000 (0:00:00.339) 0:00:41.828 ****** 2026-02-24 15:56:43.920780 | controller | ok: [instance] 2026-02-24 15:56:44.055289 | controller | 2026-02-24 15:56:44.055312 | controller | TASK [Create the virtual networks] ********************************************* 2026-02-24 15:56:44.055321 | controller | Tuesday 24 February 2026 15:56:43 +0000 (0:00:00.030) 0:00:41.858 ****** 2026-02-24 15:56:44.055331 | controller | 2026-02-24 15:56:44.073181 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2026-02-24 15:56:44.073197 | controller | Tuesday 24 February 2026 15:56:44 +0000 (0:00:00.135) 0:00:41.994 ****** 2026-02-24 15:56:44.073207 | controller | ok: [instance] 2026-02-24 15:56:44.250994 | controller | 2026-02-24 15:56:44.251018 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2026-02-24 15:56:44.251027 | controller | Tuesday 24 February 2026 15:56:44 +0000 (0:00:00.017) 0:00:42.011 ****** 2026-02-24 15:56:44.251038 | controller | ok: [instance] 2026-02-24 15:56:44.282063 | controller | 2026-02-24 15:56:44.282082 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2026-02-24 15:56:44.282089 | controller | Tuesday 24 February 2026 15:56:44 +0000 (0:00:00.177) 0:00:42.189 ****** 2026-02-24 15:56:44.282098 | controller | skipping: [instance] 2026-02-24 15:56:44.282659 | controller | 2026-02-24 15:56:44.283214 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2026-02-24 15:56:44.283509 | controller | Tuesday 24 February 2026 15:56:44 +0000 (0:00:00.030) 0:00:42.219 ****** 2026-02-24 15:56:44.312116 | controller | skipping: [instance] 2026-02-24 15:56:44.313487 | controller | 2026-02-24 15:56:44.314648 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2026-02-24 15:56:44.315121 | controller | Tuesday 24 February 2026 15:56:44 +0000 (0:00:00.029) 0:00:42.248 ****** 2026-02-24 15:56:44.364698 | controller | ok: [instance] 2026-02-24 15:56:44.364911 | controller | 2026-02-24 15:56:44.365087 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2026-02-24 15:56:44.365246 | controller | Tuesday 24 February 2026 15:56:44 +0000 (0:00:00.054) 0:00:42.303 ****** 2026-02-24 15:56:44.487130 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 15:56:44.487320 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 15:56:44.487499 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 15:56:44.487657 | controller | 2026-02-24 15:56:44.487809 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2026-02-24 15:56:44.487946 | controller | Tuesday 24 February 2026 15:56:44 +0000 (0:00:00.122) 0:00:42.425 ****** 2026-02-24 15:56:44.519546 | controller | skipping: [instance] 2026-02-24 15:56:44.519801 | controller | 2026-02-24 15:56:44.519951 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2026-02-24 15:56:44.520087 | controller | Tuesday 24 February 2026 15:56:44 +0000 (0:00:00.032) 0:00:42.458 ****** 2026-02-24 15:56:44.860191 | controller | changed: [instance] 2026-02-24 15:56:44.947888 | controller | 2026-02-24 15:56:44.947906 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2026-02-24 15:56:44.947915 | controller | Tuesday 24 February 2026 15:56:44 +0000 (0:00:00.340) 0:00:42.798 ****** 2026-02-24 15:56:44.947953 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2026-02-24 15:56:44.998993 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2026-02-24 15:56:44.999041 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2026-02-24 15:56:44.999055 | controller | 2026-02-24 15:56:44.999066 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 15:56:44.999076 | controller | Tuesday 24 February 2026 15:56:44 +0000 (0:00:00.087) 0:00:42.885 ****** 2026-02-24 15:56:44.999094 | controller | changed: [instance] 2026-02-24 15:56:45.272940 | controller | 2026-02-24 15:56:45.272979 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 15:56:45.272988 | controller | Tuesday 24 February 2026 15:56:44 +0000 (0:00:00.051) 0:00:42.937 ****** 2026-02-24 15:56:45.273001 | controller | changed: [instance] 2026-02-24 15:56:45.481736 | controller | 2026-02-24 15:56:45.481783 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 15:56:45.481795 | controller | Tuesday 24 February 2026 15:56:45 +0000 (0:00:00.274) 0:00:43.211 ****** 2026-02-24 15:56:45.481805 | controller | changed: [instance] 2026-02-24 15:56:45.538800 | controller | 2026-02-24 15:56:45.538818 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 15:56:45.538826 | controller | Tuesday 24 February 2026 15:56:45 +0000 (0:00:00.208) 0:00:43.420 ****** 2026-02-24 15:56:45.538835 | controller | changed: [instance] 2026-02-24 15:56:45.751379 | controller | 2026-02-24 15:56:45.751409 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 15:56:45.751417 | controller | Tuesday 24 February 2026 15:56:45 +0000 (0:00:00.056) 0:00:43.477 ****** 2026-02-24 15:56:45.751427 | controller | changed: [instance] 2026-02-24 15:56:45.963589 | controller | 2026-02-24 15:56:45.963612 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 15:56:45.963620 | controller | Tuesday 24 February 2026 15:56:45 +0000 (0:00:00.212) 0:00:43.689 ****** 2026-02-24 15:56:45.963630 | controller | changed: [instance] 2026-02-24 15:56:46.015804 | controller | 2026-02-24 15:56:46.015823 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 15:56:46.015831 | controller | Tuesday 24 February 2026 15:56:45 +0000 (0:00:00.212) 0:00:43.902 ****** 2026-02-24 15:56:46.015840 | controller | changed: [instance] 2026-02-24 15:56:46.206691 | controller | 2026-02-24 15:56:46.206724 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 15:56:46.206738 | controller | Tuesday 24 February 2026 15:56:46 +0000 (0:00:00.051) 0:00:43.954 ****** 2026-02-24 15:56:46.206753 | controller | changed: [instance] 2026-02-24 15:56:46.419891 | controller | 2026-02-24 15:56:46.419926 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 15:56:46.419937 | controller | Tuesday 24 February 2026 15:56:46 +0000 (0:00:00.190) 0:00:44.144 ****** 2026-02-24 15:56:46.419950 | controller | changed: [instance] 2026-02-24 15:56:46.419980 | controller | 2026-02-24 15:56:46.419989 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2026-02-24 15:56:46.419998 | controller | Tuesday 24 February 2026 15:56:46 +0000 (0:00:00.213) 0:00:44.358 ****** 2026-02-24 15:56:46.608951 | controller | ok: [instance] 2026-02-24 15:56:46.609034 | controller | 2026-02-24 15:56:46.609275 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2026-02-24 15:56:47.094868 | controller | Tuesday 24 February 2026 15:56:46 +0000 (0:00:00.189) 0:00:44.547 ****** 2026-02-24 15:56:47.094911 | controller | changed: [instance] 2026-02-24 15:56:47.094937 | controller | 2026-02-24 15:56:47.094946 | controller | TASK [libvirt_manager : Remove ini file after conversion] ********************** 2026-02-24 15:56:47.095086 | controller | Tuesday 24 February 2026 15:56:47 +0000 (0:00:00.485) 0:00:45.033 ****** 2026-02-24 15:56:47.275847 | controller | changed: [instance] 2026-02-24 15:56:47.276089 | controller | 2026-02-24 15:56:47.276119 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 15:56:47.299378 | controller | Tuesday 24 February 2026 15:56:47 +0000 (0:00:00.181) 0:00:45.214 ****** 2026-02-24 15:56:47.299410 | controller | skipping: [instance] 2026-02-24 15:56:47.322357 | controller | 2026-02-24 15:56:47.322375 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 15:56:47.322389 | controller | Tuesday 24 February 2026 15:56:47 +0000 (0:00:00.023) 0:00:45.237 ****** 2026-02-24 15:56:47.322398 | controller | skipping: [instance] 2026-02-24 15:56:47.346412 | controller | 2026-02-24 15:56:47.346430 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 15:56:47.346438 | controller | Tuesday 24 February 2026 15:56:47 +0000 (0:00:00.023) 0:00:45.260 ****** 2026-02-24 15:56:47.346447 | controller | skipping: [instance] 2026-02-24 15:56:47.370986 | controller | 2026-02-24 15:56:47.371023 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 15:56:47.371037 | controller | Tuesday 24 February 2026 15:56:47 +0000 (0:00:00.024) 0:00:45.284 ****** 2026-02-24 15:56:47.371053 | controller | skipping: [instance] 2026-02-24 15:56:47.388933 | controller | 2026-02-24 15:56:47.388965 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 15:56:47.388979 | controller | Tuesday 24 February 2026 15:56:47 +0000 (0:00:00.024) 0:00:45.309 ****** 2026-02-24 15:56:47.388995 | controller | ok: [instance] 2026-02-24 15:56:47.389119 | controller | 2026-02-24 15:56:47.389141 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 15:56:47.389266 | controller | Tuesday 24 February 2026 15:56:47 +0000 (0:00:00.018) 0:00:45.327 ****** 2026-02-24 15:56:47.472459 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-24 15:56:47.472709 | controller | 2026-02-24 15:56:47.473001 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 15:56:47.473183 | controller | Tuesday 24 February 2026 15:56:47 +0000 (0:00:00.083) 0:00:45.411 ****** 2026-02-24 15:56:47.489433 | controller | skipping: [instance] 2026-02-24 15:56:47.489493 | controller | 2026-02-24 15:56:47.489686 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 15:56:47.489721 | controller | Tuesday 24 February 2026 15:56:47 +0000 (0:00:00.016) 0:00:45.428 ****** 2026-02-24 15:56:47.687892 | controller | changed: [instance] 2026-02-24 15:56:47.687950 | controller | 2026-02-24 15:56:47.687965 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 15:56:47.687981 | controller | Tuesday 24 February 2026 15:56:47 +0000 (0:00:00.198) 0:00:45.626 ****** 2026-02-24 15:56:48.073677 | controller | changed: [instance] 2026-02-24 15:56:48.130627 | controller | 2026-02-24 15:56:48.130663 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 15:56:48.130676 | controller | Tuesday 24 February 2026 15:56:48 +0000 (0:00:00.385) 0:00:46.011 ****** 2026-02-24 15:56:48.130689 | controller | ok: [instance] 2026-02-24 15:56:48.160967 | controller | 2026-02-24 15:56:48.161021 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 15:56:48.161034 | controller | Tuesday 24 February 2026 15:56:48 +0000 (0:00:00.057) 0:00:46.069 ****** 2026-02-24 15:56:48.161052 | controller | ok: [instance] 2026-02-24 15:56:48.161093 | controller | 2026-02-24 15:56:48.161106 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 15:56:48.161198 | controller | Tuesday 24 February 2026 15:56:48 +0000 (0:00:00.030) 0:00:46.099 ****** 2026-02-24 15:56:48.530834 | controller | changed: [instance] 2026-02-24 15:56:48.530927 | controller | 2026-02-24 15:56:48.530950 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2026-02-24 15:56:48.530961 | controller | Tuesday 24 February 2026 15:56:48 +0000 (0:00:00.369) 0:00:46.469 ****** 2026-02-24 15:56:48.611488 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2026-02-24 15:56:48.657584 | controller | 2026-02-24 15:56:48.657602 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2026-02-24 15:56:48.657610 | controller | Tuesday 24 February 2026 15:56:48 +0000 (0:00:00.080) 0:00:46.549 ****** 2026-02-24 15:56:48.657619 | controller | ok: [instance] => (item=public) 2026-02-24 15:56:49.086684 | controller | ok: [instance] => (item=osp_trunk) 2026-02-24 15:56:49.086713 | controller | 2026-02-24 15:56:49.086721 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2026-02-24 15:56:49.086727 | controller | Tuesday 24 February 2026 15:56:48 +0000 (0:00:00.045) 0:00:46.595 ****** 2026-02-24 15:56:49.086736 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 15:56:49.687326 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 15:56:49.687357 | controller | 2026-02-24 15:56:49.687365 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2026-02-24 15:56:49.687371 | controller | Tuesday 24 February 2026 15:56:49 +0000 (0:00:00.429) 0:00:47.025 ****** 2026-02-24 15:56:49.687381 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 15:56:50.117907 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 15:56:50.117947 | controller | 2026-02-24 15:56:50.117956 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2026-02-24 15:56:50.117964 | controller | Tuesday 24 February 2026 15:56:49 +0000 (0:00:00.600) 0:00:47.625 ****** 2026-02-24 15:56:50.117985 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 15:56:50.538850 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 15:56:50.538889 | controller | 2026-02-24 15:56:50.538898 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2026-02-24 15:56:50.538905 | controller | Tuesday 24 February 2026 15:56:50 +0000 (0:00:00.430) 0:00:48.056 ****** 2026-02-24 15:56:50.538917 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 15:56:50.539060 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 15:56:50.539087 | controller | 2026-02-24 15:56:50.539099 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2026-02-24 15:56:50.596568 | controller | Tuesday 24 February 2026 15:56:50 +0000 (0:00:00.421) 0:00:48.477 ****** 2026-02-24 15:56:50.596590 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2026-02-24 15:56:50.778958 | controller | 2026-02-24 15:56:50.778991 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2026-02-24 15:56:50.779001 | controller | Tuesday 24 February 2026 15:56:50 +0000 (0:00:00.057) 0:00:48.535 ****** 2026-02-24 15:56:50.779013 | controller | ok: [instance] 2026-02-24 15:56:51.148899 | controller | 2026-02-24 15:56:51.148955 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2026-02-24 15:56:51.148970 | controller | Tuesday 24 February 2026 15:56:50 +0000 (0:00:00.182) 0:00:48.717 ****** 2026-02-24 15:56:51.148990 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 15:56:51.215376 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 15:56:51.215421 | controller | 2026-02-24 15:56:51.215435 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2026-02-24 15:56:51.215443 | controller | Tuesday 24 February 2026 15:56:51 +0000 (0:00:00.370) 0:00:49.087 ****** 2026-02-24 15:56:51.215452 | controller | 2026-02-24 15:56:51.248858 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-24 15:56:51.248890 | controller | Tuesday 24 February 2026 15:56:51 +0000 (0:00:00.066) 0:00:49.153 ****** 2026-02-24 15:56:51.248903 | controller | skipping: [instance] 2026-02-24 15:56:52.444867 | controller | 2026-02-24 15:56:52.444899 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2026-02-24 15:56:52.444909 | controller | Tuesday 24 February 2026 15:56:51 +0000 (0:00:00.033) 0:00:49.187 ****** 2026-02-24 15:56:52.444921 | controller | ok: [instance] 2026-02-24 15:56:52.444949 | controller | 2026-02-24 15:56:52.444959 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-24 15:56:52.445075 | controller | Tuesday 24 February 2026 15:56:52 +0000 (0:00:01.195) 0:00:50.383 ****** 2026-02-24 15:56:52.628379 | controller | ok: [instance] 2026-02-24 15:56:52.979680 | controller | 2026-02-24 15:56:52.979699 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2026-02-24 15:56:52.979707 | controller | Tuesday 24 February 2026 15:56:52 +0000 (0:00:00.183) 0:00:50.567 ****** 2026-02-24 15:56:52.979716 | controller | changed: [instance] 2026-02-24 15:56:54.630902 | controller | 2026-02-24 15:56:54.630936 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2026-02-24 15:56:54.630946 | controller | Tuesday 24 February 2026 15:56:52 +0000 (0:00:00.351) 0:00:50.918 ****** 2026-02-24 15:56:54.630958 | controller | changed: [instance] 2026-02-24 15:56:54.630989 | controller | 2026-02-24 15:56:54.631162 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2026-02-24 15:56:54.987342 | controller | Tuesday 24 February 2026 15:56:54 +0000 (0:00:01.651) 0:00:52.569 ****** 2026-02-24 15:56:54.987374 | controller | changed: [instance] 2026-02-24 15:56:55.019562 | controller | 2026-02-24 15:56:55.019592 | controller | TASK [Create extra network configuration] ************************************** 2026-02-24 15:56:55.019605 | controller | Tuesday 24 February 2026 15:56:54 +0000 (0:00:00.356) 0:00:52.925 ****** 2026-02-24 15:56:55.019620 | controller | skipping: [instance] 2026-02-24 15:56:55.046784 | controller | 2026-02-24 15:56:55.046803 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2026-02-24 15:56:55.046811 | controller | Tuesday 24 February 2026 15:56:55 +0000 (0:00:00.032) 0:00:52.957 ****** 2026-02-24 15:56:55.046819 | controller | skipping: [instance] 2026-02-24 15:56:55.488976 | controller | 2026-02-24 15:56:55.489009 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2026-02-24 15:56:55.489019 | controller | Tuesday 24 February 2026 15:56:55 +0000 (0:00:00.027) 0:00:52.985 ****** 2026-02-24 15:56:55.489031 | controller | ok: [instance] 2026-02-24 15:56:55.632673 | controller | 2026-02-24 15:56:55.632705 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2026-02-24 15:56:55.632715 | controller | Tuesday 24 February 2026 15:56:55 +0000 (0:00:00.442) 0:00:53.427 ****** 2026-02-24 15:56:55.632727 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 15:56:56.809481 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 15:56:56.809514 | controller | 2026-02-24 15:56:56.809522 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2026-02-24 15:56:56.809534 | controller | Tuesday 24 February 2026 15:56:55 +0000 (0:00:00.143) 0:00:53.570 ****** 2026-02-24 15:56:56.809544 | controller | ok: [instance] 2026-02-24 15:57:00.396058 | controller | 2026-02-24 15:57:00.396089 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2026-02-24 15:57:00.396097 | controller | Tuesday 24 February 2026 15:56:56 +0000 (0:00:01.176) 0:00:54.747 ****** 2026-02-24 15:57:00.396107 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2026-02-24 15:57:00.614449 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2026-02-24 15:57:00.614485 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2026-02-24 15:57:00.614493 | controller | 2026-02-24 15:57:00.614499 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2026-02-24 15:57:00.614505 | controller | Tuesday 24 February 2026 15:57:00 +0000 (0:00:03.586) 0:00:58.334 ****** 2026-02-24 15:57:00.614514 | controller | changed: [instance] 2026-02-24 15:57:00.957751 | controller | 2026-02-24 15:57:00.957805 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2026-02-24 15:57:00.957814 | controller | Tuesday 24 February 2026 15:57:00 +0000 (0:00:00.218) 0:00:58.553 ****** 2026-02-24 15:57:00.957824 | controller | changed: [instance] 2026-02-24 15:57:01.337280 | controller | 2026-02-24 15:57:01.337331 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2026-02-24 15:57:01.337341 | controller | Tuesday 24 February 2026 15:57:00 +0000 (0:00:00.343) 0:00:58.896 ****** 2026-02-24 15:57:01.337353 | controller | changed: [instance] 2026-02-24 15:57:01.366900 | controller | 2026-02-24 15:57:01.366923 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2026-02-24 15:57:01.366932 | controller | Tuesday 24 February 2026 15:57:01 +0000 (0:00:00.379) 0:00:59.275 ****** 2026-02-24 15:57:01.366943 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2026-02-24 15:57:01.749677 | controller | 2026-02-24 15:57:01.749709 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2026-02-24 15:57:01.749718 | controller | Tuesday 24 February 2026 15:57:01 +0000 (0:00:00.029) 0:00:59.305 ****** 2026-02-24 15:57:01.749728 | controller | changed: [instance] 2026-02-24 15:57:01.767645 | controller | 2026-02-24 15:57:01.767670 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2026-02-24 15:57:01.767679 | controller | Tuesday 24 February 2026 15:57:01 +0000 (0:00:00.382) 0:00:59.687 ****** 2026-02-24 15:57:01.767690 | controller | skipping: [instance] 2026-02-24 15:57:01.800919 | controller | 2026-02-24 15:57:01.800963 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2026-02-24 15:57:01.800973 | controller | Tuesday 24 February 2026 15:57:01 +0000 (0:00:00.018) 0:00:59.706 ****** 2026-02-24 15:57:01.800986 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2026-02-24 15:57:02.195868 | controller | 2026-02-24 15:57:02.195906 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2026-02-24 15:57:02.195916 | controller | Tuesday 24 February 2026 15:57:01 +0000 (0:00:00.033) 0:00:59.739 ****** 2026-02-24 15:57:02.195928 | controller | changed: [instance] 2026-02-24 15:57:02.195956 | controller | 2026-02-24 15:57:02.195966 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2026-02-24 15:57:02.195991 | controller | Tuesday 24 February 2026 15:57:02 +0000 (0:00:00.395) 0:01:00.134 ****** 2026-02-24 15:57:02.214677 | controller | skipping: [instance] 2026-02-24 15:57:02.425451 | controller | 2026-02-24 15:57:02.425492 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2026-02-24 15:57:02.425502 | controller | Tuesday 24 February 2026 15:57:02 +0000 (0:00:00.018) 0:01:00.153 ****** 2026-02-24 15:57:02.425514 | controller | ok: [instance] => (item=127.0.0.2) 2026-02-24 15:57:03.079339 | controller | 2026-02-24 15:57:03.079369 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2026-02-24 15:57:03.079378 | controller | Tuesday 24 February 2026 15:57:02 +0000 (0:00:00.210) 0:01:00.363 ****** 2026-02-24 15:57:03.079388 | controller | changed: [instance] 2026-02-24 15:57:03.099875 | controller | 2026-02-24 15:57:03.099902 | controller | TASK [dnsmasq : Stop service] ************************************************** 2026-02-24 15:57:03.099912 | controller | Tuesday 24 February 2026 15:57:03 +0000 (0:00:00.653) 0:01:01.017 ****** 2026-02-24 15:57:03.099924 | controller | skipping: [instance] 2026-02-24 15:57:03.099976 | controller | 2026-02-24 15:57:03.099992 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2026-02-24 15:57:03.100002 | controller | Tuesday 24 February 2026 15:57:03 +0000 (0:00:00.020) 0:01:01.038 ****** 2026-02-24 15:57:03.119485 | controller | skipping: [instance] 2026-02-24 15:57:03.147852 | controller | 2026-02-24 15:57:03.147872 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2026-02-24 15:57:03.147880 | controller | Tuesday 24 February 2026 15:57:03 +0000 (0:00:00.019) 0:01:01.057 ****** 2026-02-24 15:57:03.147895 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-24 15:57:03.147922 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2026-02-24 15:57:03.147930 | controller | skipping: [instance] 2026-02-24 15:57:03.147936 | controller | 2026-02-24 15:57:03.147942 | controller | TASK [Create dnsmasq networks] ************************************************* 2026-02-24 15:57:03.147950 | controller | Tuesday 24 February 2026 15:57:03 +0000 (0:00:00.028) 0:01:01.086 ****** 2026-02-24 15:57:03.258682 | controller | 2026-02-24 15:57:03.289590 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-24 15:57:03.289608 | controller | Tuesday 24 February 2026 15:57:03 +0000 (0:00:00.110) 0:01:01.197 ****** 2026-02-24 15:57:03.289618 | controller | ok: [instance] => changed=false 2026-02-24 15:57:03.326405 | controller | msg: All assertions passed 2026-02-24 15:57:03.326423 | controller | 2026-02-24 15:57:03.326431 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-24 15:57:03.326437 | controller | Tuesday 24 February 2026 15:57:03 +0000 (0:00:00.031) 0:01:01.228 ****** 2026-02-24 15:57:03.326445 | controller | ok: [instance] => changed=false 2026-02-24 15:57:03.326601 | controller | msg: All assertions passed 2026-02-24 15:57:03.326725 | controller | 2026-02-24 15:57:03.326884 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-24 15:57:03.327018 | controller | Tuesday 24 February 2026 15:57:03 +0000 (0:00:00.037) 0:01:01.265 ****** 2026-02-24 15:57:03.760818 | controller | changed: [instance] 2026-02-24 15:57:03.780292 | controller | 2026-02-24 15:57:03.780319 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-24 15:57:03.780329 | controller | Tuesday 24 February 2026 15:57:03 +0000 (0:00:00.433) 0:01:01.699 ****** 2026-02-24 15:57:03.780341 | controller | skipping: [instance] 2026-02-24 15:57:03.804502 | controller | 2026-02-24 15:57:03.804523 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-24 15:57:03.804531 | controller | Tuesday 24 February 2026 15:57:03 +0000 (0:00:00.019) 0:01:01.718 ****** 2026-02-24 15:57:03.804541 | controller | skipping: [instance] 2026-02-24 15:57:03.833681 | controller | 2026-02-24 15:57:03.833705 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-24 15:57:03.833714 | controller | Tuesday 24 February 2026 15:57:03 +0000 (0:00:00.024) 0:01:01.743 ****** 2026-02-24 15:57:03.833724 | controller | ok: [instance] => changed=false 2026-02-24 15:57:03.870905 | controller | msg: All assertions passed 2026-02-24 15:57:03.870955 | controller | 2026-02-24 15:57:03.870965 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-24 15:57:03.870978 | controller | Tuesday 24 February 2026 15:57:03 +0000 (0:00:00.028) 0:01:01.772 ****** 2026-02-24 15:57:03.870991 | controller | ok: [instance] => changed=false 2026-02-24 15:57:04.293663 | controller | msg: All assertions passed 2026-02-24 15:57:04.293699 | controller | 2026-02-24 15:57:04.293709 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-24 15:57:04.293717 | controller | Tuesday 24 February 2026 15:57:03 +0000 (0:00:00.037) 0:01:01.809 ****** 2026-02-24 15:57:04.293728 | controller | changed: [instance] 2026-02-24 15:57:04.314298 | controller | 2026-02-24 15:57:04.314318 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-24 15:57:04.314325 | controller | Tuesday 24 February 2026 15:57:04 +0000 (0:00:00.422) 0:01:02.231 ****** 2026-02-24 15:57:04.314334 | controller | skipping: [instance] 2026-02-24 15:57:04.339294 | controller | 2026-02-24 15:57:04.339310 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-24 15:57:04.339317 | controller | Tuesday 24 February 2026 15:57:04 +0000 (0:00:00.020) 0:01:02.252 ****** 2026-02-24 15:57:04.339326 | controller | skipping: [instance] 2026-02-24 15:57:04.369190 | controller | 2026-02-24 15:57:04.369212 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2026-02-24 15:57:04.369222 | controller | Tuesday 24 February 2026 15:57:04 +0000 (0:00:00.025) 0:01:02.277 ****** 2026-02-24 15:57:04.369233 | controller | skipping: [instance] 2026-02-24 15:57:04.856695 | controller | 2026-02-24 15:57:04.856724 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2026-02-24 15:57:04.856733 | controller | Tuesday 24 February 2026 15:57:04 +0000 (0:00:00.029) 0:01:02.307 ****** 2026-02-24 15:57:04.856743 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 15:57:04.897145 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 15:57:04.897167 | controller | 2026-02-24 15:57:04.897176 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 15:57:04.897183 | controller | Tuesday 24 February 2026 15:57:04 +0000 (0:00:00.487) 0:01:02.795 ****** 2026-02-24 15:57:04.897194 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2026-02-24 15:57:05.217187 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2026-02-24 15:57:05.217218 | controller | 2026-02-24 15:57:05.217226 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 15:57:05.217233 | controller | Tuesday 24 February 2026 15:57:04 +0000 (0:00:00.040) 0:01:02.835 ****** 2026-02-24 15:57:05.217243 | controller | ok: [instance] 2026-02-24 15:57:05.251878 | controller | 2026-02-24 15:57:05.251912 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-24 15:57:05.251935 | controller | Tuesday 24 February 2026 15:57:05 +0000 (0:00:00.320) 0:01:03.155 ****** 2026-02-24 15:57:05.251949 | controller | ok: [instance] 2026-02-24 15:57:05.251957 | controller | 2026-02-24 15:57:05.251965 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 15:57:05.251974 | controller | Tuesday 24 February 2026 15:57:05 +0000 (0:00:00.034) 0:01:03.190 ****** 2026-02-24 15:57:05.453533 | controller | ok: [instance] 2026-02-24 15:57:05.487906 | controller | 2026-02-24 15:57:05.487936 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-24 15:57:05.487946 | controller | Tuesday 24 February 2026 15:57:05 +0000 (0:00:00.201) 0:01:03.391 ****** 2026-02-24 15:57:05.487958 | controller | ok: [instance] 2026-02-24 15:57:05.487988 | controller | 2026-02-24 15:57:05.487998 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2026-02-24 15:57:05.488081 | controller | Tuesday 24 February 2026 15:57:05 +0000 (0:00:00.034) 0:01:03.426 ****** 2026-02-24 15:57:05.818854 | controller | changed: [instance] 2026-02-24 15:57:05.819099 | controller | 2026-02-24 15:57:05.819115 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2026-02-24 15:57:06.146393 | controller | Tuesday 24 February 2026 15:57:05 +0000 (0:00:00.330) 0:01:03.757 ****** 2026-02-24 15:57:06.146427 | controller | changed: [instance] 2026-02-24 15:57:06.480406 | controller | 2026-02-24 15:57:06.480428 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2026-02-24 15:57:06.480436 | controller | Tuesday 24 February 2026 15:57:06 +0000 (0:00:00.327) 0:01:04.084 ****** 2026-02-24 15:57:06.480445 | controller | changed: [instance] 2026-02-24 15:57:06.573905 | controller | 2026-02-24 15:57:06.573949 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2026-02-24 15:57:06.573960 | controller | Tuesday 24 February 2026 15:57:06 +0000 (0:00:00.334) 0:01:04.419 ****** 2026-02-24 15:57:06.573975 | controller | ok: [instance] 2026-02-24 15:57:06.573983 | controller | 2026-02-24 15:57:06.573993 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2026-02-24 15:57:06.911513 | controller | Tuesday 24 February 2026 15:57:06 +0000 (0:00:00.093) 0:01:04.512 ****** 2026-02-24 15:57:06.911545 | controller | changed: [instance] 2026-02-24 15:57:06.936573 | controller | 2026-02-24 15:57:06.936593 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 15:57:06.936601 | controller | Tuesday 24 February 2026 15:57:06 +0000 (0:00:00.337) 0:01:04.850 ****** 2026-02-24 15:57:06.936616 | controller | skipping: [instance] 2026-02-24 15:57:06.961370 | controller | 2026-02-24 15:57:06.961388 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 15:57:06.961396 | controller | Tuesday 24 February 2026 15:57:06 +0000 (0:00:00.025) 0:01:04.875 ****** 2026-02-24 15:57:06.961406 | controller | skipping: [instance] 2026-02-24 15:57:06.985890 | controller | 2026-02-24 15:57:06.985926 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 15:57:06.985935 | controller | Tuesday 24 February 2026 15:57:06 +0000 (0:00:00.023) 0:01:04.899 ****** 2026-02-24 15:57:06.985946 | controller | skipping: [instance] 2026-02-24 15:57:07.010272 | controller | 2026-02-24 15:57:07.010295 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 15:57:07.010304 | controller | Tuesday 24 February 2026 15:57:06 +0000 (0:00:00.025) 0:01:04.924 ****** 2026-02-24 15:57:07.010313 | controller | skipping: [instance] 2026-02-24 15:57:07.030365 | controller | 2026-02-24 15:57:07.030387 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 15:57:07.030397 | controller | Tuesday 24 February 2026 15:57:07 +0000 (0:00:00.024) 0:01:04.948 ****** 2026-02-24 15:57:07.030408 | controller | ok: [instance] 2026-02-24 15:57:07.123512 | controller | 2026-02-24 15:57:07.123530 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 15:57:07.123538 | controller | Tuesday 24 February 2026 15:57:07 +0000 (0:00:00.019) 0:01:04.968 ****** 2026-02-24 15:57:07.123550 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-24 15:57:07.143081 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-24 15:57:07.143108 | controller | 2026-02-24 15:57:07.143117 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 15:57:07.143124 | controller | Tuesday 24 February 2026 15:57:07 +0000 (0:00:00.093) 0:01:05.061 ****** 2026-02-24 15:57:07.143135 | controller | skipping: [instance] 2026-02-24 15:57:07.143299 | controller | 2026-02-24 15:57:07.143476 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 15:57:07.143616 | controller | Tuesday 24 February 2026 15:57:07 +0000 (0:00:00.020) 0:01:05.081 ****** 2026-02-24 15:57:07.347342 | controller | ok: [instance] 2026-02-24 15:57:07.738942 | controller | 2026-02-24 15:57:07.738982 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 15:57:07.738992 | controller | Tuesday 24 February 2026 15:57:07 +0000 (0:00:00.203) 0:01:05.285 ****** 2026-02-24 15:57:07.739006 | controller | changed: [instance] 2026-02-24 15:57:07.799407 | controller | 2026-02-24 15:57:07.799442 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 15:57:07.799464 | controller | Tuesday 24 February 2026 15:57:07 +0000 (0:00:00.391) 0:01:05.677 ****** 2026-02-24 15:57:07.799476 | controller | ok: [instance] 2026-02-24 15:57:07.831881 | controller | 2026-02-24 15:57:07.831906 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 15:57:07.831914 | controller | Tuesday 24 February 2026 15:57:07 +0000 (0:00:00.060) 0:01:05.737 ****** 2026-02-24 15:57:07.831924 | controller | ok: [instance] 2026-02-24 15:57:07.831995 | controller | 2026-02-24 15:57:07.832016 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 15:57:07.832027 | controller | Tuesday 24 February 2026 15:57:07 +0000 (0:00:00.032) 0:01:05.770 ****** 2026-02-24 15:57:08.231384 | controller | changed: [instance] 2026-02-24 15:57:08.261227 | controller | 2026-02-24 15:57:08.261255 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2026-02-24 15:57:08.261265 | controller | Tuesday 24 February 2026 15:57:08 +0000 (0:00:00.399) 0:01:06.169 ****** 2026-02-24 15:57:08.261278 | controller | ok: [instance] 2026-02-24 15:57:08.280686 | controller | 2026-02-24 15:57:08.280706 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2026-02-24 15:57:08.280713 | controller | Tuesday 24 February 2026 15:57:08 +0000 (0:00:00.029) 0:01:06.199 ****** 2026-02-24 15:57:08.280722 | controller | ok: [instance] 2026-02-24 15:57:08.301791 | controller | 2026-02-24 15:57:08.301812 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2026-02-24 15:57:08.301820 | controller | Tuesday 24 February 2026 15:57:08 +0000 (0:00:00.019) 0:01:06.219 ****** 2026-02-24 15:57:08.301830 | controller | ok: [instance] 2026-02-24 15:57:08.376665 | controller | 2026-02-24 15:57:08.376682 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2026-02-24 15:57:08.376693 | controller | Tuesday 24 February 2026 15:57:08 +0000 (0:00:00.021) 0:01:06.240 ****** 2026-02-24 15:57:08.376702 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2026-02-24 15:57:08.507718 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2026-02-24 15:57:08.507739 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2026-02-24 15:57:08.507748 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2026-02-24 15:57:08.507754 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2026-02-24 15:57:08.507760 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2026-02-24 15:57:08.507818 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2026-02-24 15:57:08.507825 | controller | 2026-02-24 15:57:08.507832 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 15:57:08.507838 | controller | Tuesday 24 February 2026 15:57:08 +0000 (0:00:00.074) 0:01:06.314 ****** 2026-02-24 15:57:08.507848 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2026-02-24 15:57:08.587662 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2026-02-24 15:57:08.587682 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2026-02-24 15:57:08.587691 | controller | 2026-02-24 15:57:08.587698 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 15:57:08.587704 | controller | Tuesday 24 February 2026 15:57:08 +0000 (0:00:00.131) 0:01:06.446 ****** 2026-02-24 15:57:08.587714 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2026-02-24 15:57:08.587901 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2026-02-24 15:57:08.588057 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2026-02-24 15:57:08.588201 | controller | skipping: [instance] 2026-02-24 15:57:08.588320 | controller | 2026-02-24 15:57:08.588442 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 15:57:08.588573 | controller | Tuesday 24 February 2026 15:57:08 +0000 (0:00:00.080) 0:01:06.526 ****** 2026-02-24 15:57:08.665527 | controller | skipping: [instance] => (item=compute-0 - storage) 2026-02-24 15:57:08.665705 | controller | skipping: [instance] => (item=controller-0 - storage) 2026-02-24 15:57:08.665893 | controller | skipping: [instance] => (item=crc-0 - storage) 2026-02-24 15:57:08.666055 | controller | skipping: [instance] 2026-02-24 15:57:08.666200 | controller | 2026-02-24 15:57:08.666372 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 15:57:08.666521 | controller | Tuesday 24 February 2026 15:57:08 +0000 (0:00:00.077) 0:01:06.604 ****** 2026-02-24 15:57:08.747622 | controller | skipping: [instance] => (item=compute-0 - tenant) 2026-02-24 15:57:08.747818 | controller | skipping: [instance] => (item=controller-0 - tenant) 2026-02-24 15:57:08.747974 | controller | skipping: [instance] => (item=crc-0 - tenant) 2026-02-24 15:57:08.748118 | controller | skipping: [instance] 2026-02-24 15:57:08.748254 | controller | 2026-02-24 15:57:08.748397 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 15:57:08.748553 | controller | Tuesday 24 February 2026 15:57:08 +0000 (0:00:00.082) 0:01:06.686 ****** 2026-02-24 15:57:08.826580 | controller | skipping: [instance] => (item=compute-0 - external) 2026-02-24 15:57:08.826749 | controller | skipping: [instance] => (item=controller-0 - external) 2026-02-24 15:57:08.826904 | controller | skipping: [instance] => (item=crc-0 - external) 2026-02-24 15:57:08.827025 | controller | skipping: [instance] 2026-02-24 15:57:08.827135 | controller | 2026-02-24 15:57:08.827252 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 15:57:08.827373 | controller | Tuesday 24 February 2026 15:57:08 +0000 (0:00:00.078) 0:01:06.765 ****** 2026-02-24 15:57:08.905997 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2026-02-24 15:57:08.906171 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2026-02-24 15:57:08.906321 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2026-02-24 15:57:08.906484 | controller | skipping: [instance] 2026-02-24 15:57:08.906622 | controller | 2026-02-24 15:57:08.906781 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 15:57:08.906935 | controller | Tuesday 24 February 2026 15:57:08 +0000 (0:00:00.079) 0:01:06.844 ****** 2026-02-24 15:57:09.039501 | controller | ok: [instance] => (item=compute-0 - public) 2026-02-24 15:57:09.039673 | controller | ok: [instance] => (item=controller-0 - public) 2026-02-24 15:57:09.039849 | controller | ok: [instance] => (item=crc-0 - public) 2026-02-24 15:57:09.039994 | controller | 2026-02-24 15:57:09.040142 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2026-02-24 15:57:09.040264 | controller | Tuesday 24 February 2026 15:57:09 +0000 (0:00:00.133) 0:01:06.978 ****** 2026-02-24 15:57:09.145038 | controller | 2026-02-24 15:57:09.145211 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2026-02-24 15:57:09.145369 | controller | Tuesday 24 February 2026 15:57:09 +0000 (0:00:00.105) 0:01:07.084 ****** 2026-02-24 15:57:09.183793 | controller | ok: [instance] 2026-02-24 15:57:09.183963 | controller | 2026-02-24 15:57:09.184131 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2026-02-24 15:57:09.184291 | controller | Tuesday 24 February 2026 15:57:09 +0000 (0:00:00.038) 0:01:07.122 ****** 2026-02-24 15:57:09.279598 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:aa:14:a9', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-24 15:57:09.279808 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:6f:71:35', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-24 15:57:09.279973 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:a6:a3:e3', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-24 15:57:09.280122 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:33:fa:99', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-24 15:57:09.280267 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:a9:f8:d3', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-24 15:57:09.280409 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:1e:04:5c', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-24 15:57:09.280553 | controller | 2026-02-24 15:57:09.280675 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2026-02-24 15:57:09.280808 | controller | Tuesday 24 February 2026 15:57:09 +0000 (0:00:00.095) 0:01:07.218 ****** 2026-02-24 15:57:09.328942 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2026-02-24 15:57:09.329137 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2026-02-24 15:57:09.329291 | controller | 2026-02-24 15:57:09.329464 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-24 15:57:09.329625 | controller | Tuesday 24 February 2026 15:57:09 +0000 (0:00:00.049) 0:01:07.267 ****** 2026-02-24 15:57:09.504440 | controller | ok: [instance] 2026-02-24 15:57:09.528946 | controller | 2026-02-24 15:57:09.528993 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-24 15:57:09.529007 | controller | Tuesday 24 February 2026 15:57:09 +0000 (0:00:00.175) 0:01:07.442 ****** 2026-02-24 15:57:09.529024 | controller | ok: [instance] 2026-02-24 15:57:09.702630 | controller | 2026-02-24 15:57:09.702660 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-24 15:57:09.702668 | controller | Tuesday 24 February 2026 15:57:09 +0000 (0:00:00.024) 0:01:07.467 ****** 2026-02-24 15:57:09.702678 | controller | ok: [instance] 2026-02-24 15:57:09.725754 | controller | 2026-02-24 15:57:09.725787 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-24 15:57:09.725796 | controller | Tuesday 24 February 2026 15:57:09 +0000 (0:00:00.173) 0:01:07.641 ****** 2026-02-24 15:57:09.725806 | controller | ok: [instance] 2026-02-24 15:57:09.746485 | controller | 2026-02-24 15:57:09.746504 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2026-02-24 15:57:09.746512 | controller | Tuesday 24 February 2026 15:57:09 +0000 (0:00:00.023) 0:01:07.664 ****** 2026-02-24 15:57:09.746521 | controller | ok: [instance] 2026-02-24 15:57:09.917929 | controller | 2026-02-24 15:57:09.917970 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2026-02-24 15:57:09.917980 | controller | Tuesday 24 February 2026 15:57:09 +0000 (0:00:00.020) 0:01:07.684 ****** 2026-02-24 15:57:09.917993 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:aa:14:a9', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-24 15:57:09.918024 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:6f:71:35', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-24 15:57:09.918811 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:a6:a3:e3', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-24 15:57:09.956118 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:33:fa:99', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-24 15:57:09.956146 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:a9:f8:d3', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-24 15:57:09.956156 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:1e:04:5c', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-24 15:57:09.956163 | controller | 2026-02-24 15:57:09.956170 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2026-02-24 15:57:09.956177 | controller | Tuesday 24 February 2026 15:57:09 +0000 (0:00:00.171) 0:01:07.856 ****** 2026-02-24 15:57:09.956188 | controller | ok: [instance] 2026-02-24 15:57:11.946811 | controller | 2026-02-24 15:57:11.946841 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2026-02-24 15:57:11.946849 | controller | Tuesday 24 February 2026 15:57:09 +0000 (0:00:00.037) 0:01:07.894 ****** 2026-02-24 15:57:11.946859 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:aa:14:a9', 'entry': 'set:compute,52:54:00:aa:14:a9,192.168.140.100,compute-0', 'state': 'present'}) 2026-02-24 15:57:11.969378 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:6f:71:35', 'entry': 'set:controller,52:54:01:6f:71:35,192.168.140.9,controller-0', 'state': 'present'}) 2026-02-24 15:57:11.969401 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:a6:a3:e3', 'entry': 'set:ocp,52:54:02:a6:a3:e3,192.168.140.10,crc-0', 'state': 'present'}) 2026-02-24 15:57:11.969410 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:33:fa:99', 'entry': 'set:compute,52:54:00:33:fa:99,192.168.101.100,compute-0', 'state': 'present'}) 2026-02-24 15:57:11.969418 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:a9:f8:d3', 'entry': 'set:controller,52:54:01:a9:f8:d3,192.168.101.9,controller-0', 'state': 'present'}) 2026-02-24 15:57:11.969424 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:1e:04:5c', 'entry': 'set:ocp,52:54:02:1e:04:5c,192.168.101.10,crc-0', 'state': 'present'}) 2026-02-24 15:57:11.969431 | controller | 2026-02-24 15:57:11.969438 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2026-02-24 15:57:11.969466 | controller | Tuesday 24 February 2026 15:57:11 +0000 (0:00:01.990) 0:01:09.884 ****** 2026-02-24 15:57:11.969476 | controller | skipping: [instance] 2026-02-24 15:57:12.178782 | controller | 2026-02-24 15:57:12.178808 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2026-02-24 15:57:12.178817 | controller | Tuesday 24 February 2026 15:57:11 +0000 (0:00:00.023) 0:01:09.907 ****** 2026-02-24 15:57:12.178828 | controller | ok: [instance] => (item=compute-0) 2026-02-24 15:57:12.291648 | controller | ok: [instance] => (item=controller-0) 2026-02-24 15:57:12.291679 | controller | ok: [instance] => (item=crc-0) 2026-02-24 15:57:12.291691 | controller | 2026-02-24 15:57:12.291701 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2026-02-24 15:57:12.291711 | controller | Tuesday 24 February 2026 15:57:12 +0000 (0:00:00.209) 0:01:10.117 ****** 2026-02-24 15:57:12.291724 | controller | 2026-02-24 15:57:12.330929 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 15:57:12.330955 | controller | Tuesday 24 February 2026 15:57:12 +0000 (0:00:00.112) 0:01:10.229 ****** 2026-02-24 15:57:12.330978 | controller | ok: [instance] 2026-02-24 15:57:12.331013 | controller | 2026-02-24 15:57:12.331347 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 15:57:12.551515 | controller | Tuesday 24 February 2026 15:57:12 +0000 (0:00:00.039) 0:01:10.269 ****** 2026-02-24 15:57:12.551565 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 15:57:12.551801 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 15:57:12.551904 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 15:57:12.552064 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 15:57:12.552133 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 15:57:12.552315 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 15:57:12.552375 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 15:57:12.552498 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 15:57:12.552606 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 15:57:12.552717 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 15:57:12.552838 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 15:57:12.552952 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 15:57:12.553056 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 15:57:12.553158 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 15:57:12.553260 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 15:57:12.553407 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 15:57:12.553514 | controller | 2026-02-24 15:57:12.553617 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 15:57:12.553726 | controller | Tuesday 24 February 2026 15:57:12 +0000 (0:00:00.220) 0:01:10.490 ****** 2026-02-24 15:57:15.612909 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 15:57:15.612968 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 15:57:15.612983 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 15:57:15.612991 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 15:57:15.612998 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 15:57:15.613005 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 15:57:15.613012 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 15:57:15.613018 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 15:57:15.613025 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 15:57:15.613032 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 15:57:15.613041 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 15:57:15.613068 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 15:57:15.613725 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 15:57:15.957919 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 15:57:15.957955 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 15:57:15.957965 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 15:57:15.957972 | controller | 2026-02-24 15:57:15.957980 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 15:57:15.957987 | controller | Tuesday 24 February 2026 15:57:15 +0000 (0:00:03.060) 0:01:13.550 ****** 2026-02-24 15:57:15.958001 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 15:57:15.958036 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 15:57:15.958050 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 15:57:15.958057 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 15:57:15.958064 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 15:57:15.958070 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 15:57:15.958077 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 15:57:15.958083 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 15:57:15.958092 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 15:57:15.958873 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 15:57:15.958916 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 15:57:15.977831 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 15:57:15.977855 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 15:57:15.977864 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 15:57:15.977872 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 15:57:15.977880 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 15:57:15.977892 | controller | 2026-02-24 15:57:15.977900 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2026-02-24 15:57:15.977908 | controller | Tuesday 24 February 2026 15:57:15 +0000 (0:00:00.345) 0:01:13.895 ****** 2026-02-24 15:57:15.977919 | controller | ok: [instance] 2026-02-24 15:57:15.977963 | controller | 2026-02-24 15:57:15.978239 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2026-02-24 15:57:16.021621 | controller | Tuesday 24 February 2026 15:57:15 +0000 (0:00:00.020) 0:01:13.916 ****** 2026-02-24 15:57:16.021645 | controller | skipping: [instance] => (item=compute) 2026-02-24 15:57:16.051736 | controller | skipping: [instance] => (item=controller) 2026-02-24 15:57:16.051758 | controller | skipping: [instance] => (item=crc) 2026-02-24 15:57:16.051792 | controller | skipping: [instance] 2026-02-24 15:57:16.051802 | controller | 2026-02-24 15:57:16.051810 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2026-02-24 15:57:16.051817 | controller | Tuesday 24 February 2026 15:57:16 +0000 (0:00:00.043) 0:01:13.959 ****** 2026-02-24 15:57:16.051829 | controller | skipping: [instance] 2026-02-24 15:57:16.417906 | controller | 2026-02-24 15:57:16.417942 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2026-02-24 15:57:16.417953 | controller | Tuesday 24 February 2026 15:57:16 +0000 (0:00:00.030) 0:01:13.990 ****** 2026-02-24 15:57:16.417971 | controller | changed: [instance] 2026-02-24 15:57:16.418006 | controller | 2026-02-24 15:57:16.418015 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2026-02-24 15:57:16.418022 | controller | Tuesday 24 February 2026 15:57:16 +0000 (0:00:00.354) 0:01:14.345 ****** 2026-02-24 15:57:16.418029 | controller | 2026-02-24 15:57:16.418039 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-24 15:57:16.418203 | controller | Tuesday 24 February 2026 15:57:16 +0000 (0:00:00.010) 0:01:14.355 ****** 2026-02-24 15:57:17.023223 | controller | changed: [instance] 2026-02-24 15:57:17.372722 | controller | 2026-02-24 15:57:17.372749 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 15:57:17.372758 | controller | Tuesday 24 February 2026 15:57:17 +0000 (0:00:00.605) 0:01:14.961 ****** 2026-02-24 15:57:17.372820 | controller | changed: [instance] 2026-02-24 15:57:17.716762 | controller | 2026-02-24 15:57:17.716809 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2026-02-24 15:57:17.716818 | controller | Tuesday 24 February 2026 15:57:17 +0000 (0:00:00.349) 0:01:15.311 ****** 2026-02-24 15:57:17.716829 | controller | changed: [instance] 2026-02-24 15:57:18.072844 | controller | 2026-02-24 15:57:18.072876 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2026-02-24 15:57:18.072884 | controller | Tuesday 24 February 2026 15:57:17 +0000 (0:00:00.343) 0:01:15.655 ****** 2026-02-24 15:57:18.072894 | controller | changed: [instance] 2026-02-24 15:57:18.073155 | controller | 2026-02-24 15:57:18.073195 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2026-02-24 15:57:18.443839 | controller | Tuesday 24 February 2026 15:57:18 +0000 (0:00:00.356) 0:01:16.011 ****** 2026-02-24 15:57:18.443874 | controller | changed: [instance] 2026-02-24 15:57:18.443902 | controller | 2026-02-24 15:57:18.444122 | controller | TASK [Build utility records dataset] ******************************************* 2026-02-24 15:57:18.476701 | controller | Tuesday 24 February 2026 15:57:18 +0000 (0:00:00.371) 0:01:16.382 ****** 2026-02-24 15:57:18.476740 | controller | 2026-02-24 15:57:18.566336 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 15:57:18.566354 | controller | Tuesday 24 February 2026 15:57:18 +0000 (0:00:00.032) 0:01:16.415 ****** 2026-02-24 15:57:18.566365 | controller | ok: [instance] 2026-02-24 15:57:18.662617 | controller | 2026-02-24 15:57:18.662635 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 15:57:18.662643 | controller | Tuesday 24 February 2026 15:57:18 +0000 (0:00:00.089) 0:01:16.504 ****** 2026-02-24 15:57:18.662656 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 15:57:19.119878 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 15:57:19.119913 | controller | 2026-02-24 15:57:19.119923 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 15:57:19.119931 | controller | Tuesday 24 February 2026 15:57:18 +0000 (0:00:00.096) 0:01:16.600 ****** 2026-02-24 15:57:19.119943 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 15:57:19.119951 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 15:57:19.119958 | controller | 2026-02-24 15:57:19.119965 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 15:57:19.119974 | controller | Tuesday 24 February 2026 15:57:19 +0000 (0:00:00.457) 0:01:17.058 ****** 2026-02-24 15:57:19.411898 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 15:57:19.411958 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 15:57:19.411979 | controller | 2026-02-24 15:57:19.412491 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-24 15:57:20.888713 | controller | Tuesday 24 February 2026 15:57:19 +0000 (0:00:00.281) 0:01:17.339 ****** 2026-02-24 15:57:20.888741 | controller | 2026-02-24 15:57:20.888749 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 15:57:20.888755 | controller | Tuesday 24 February 2026 15:57:19 +0000 (0:00:00.010) 0:01:17.350 ****** 2026-02-24 15:57:20.888780 | controller | changed: [instance] 2026-02-24 15:57:21.242399 | controller | 2026-02-24 15:57:21.242427 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 15:57:21.242446 | controller | Tuesday 24 February 2026 15:57:20 +0000 (0:00:01.476) 0:01:18.827 ****** 2026-02-24 15:57:21.242457 | controller | changed: [instance] 2026-02-24 15:57:21.276257 | controller | 2026-02-24 15:57:21.276279 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2026-02-24 15:57:21.276289 | controller | Tuesday 24 February 2026 15:57:21 +0000 (0:00:00.353) 0:01:19.180 ****** 2026-02-24 15:57:21.276300 | controller | skipping: [instance] 2026-02-24 15:57:21.352638 | controller | 2026-02-24 15:57:21.352656 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2026-02-24 15:57:21.352664 | controller | Tuesday 24 February 2026 15:57:21 +0000 (0:00:00.033) 0:01:19.214 ****** 2026-02-24 15:57:21.352673 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2026-02-24 15:57:21.531874 | controller | 2026-02-24 15:57:21.531908 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2026-02-24 15:57:21.531916 | controller | Tuesday 24 February 2026 15:57:21 +0000 (0:00:00.076) 0:01:19.290 ****** 2026-02-24 15:57:21.531928 | controller | ok: [instance] 2026-02-24 15:57:21.531957 | controller | 2026-02-24 15:57:21.532091 | controller | TASK [Deploy CRC if needed] **************************************************** 2026-02-24 15:57:21.532114 | controller | Tuesday 24 February 2026 15:57:21 +0000 (0:00:00.179) 0:01:19.470 ****** 2026-02-24 15:57:21.551641 | controller | skipping: [instance] 2026-02-24 15:57:21.885871 | controller | 2026-02-24 15:57:21.885910 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2026-02-24 15:57:21.885920 | controller | Tuesday 24 February 2026 15:57:21 +0000 (0:00:00.019) 0:01:19.490 ****** 2026-02-24 15:57:21.885934 | controller | ok: [instance] 2026-02-24 15:57:21.885979 | controller | 2026-02-24 15:57:21.885990 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2026-02-24 15:57:21.886096 | controller | Tuesday 24 February 2026 15:57:21 +0000 (0:00:00.334) 0:01:19.824 ****** 2026-02-24 15:57:22.118284 | controller | ok: [instance] 2026-02-24 15:57:22.333787 | controller | 2026-02-24 15:57:22.333811 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2026-02-24 15:57:22.333821 | controller | Tuesday 24 February 2026 15:57:22 +0000 (0:00:00.232) 0:01:20.056 ****** 2026-02-24 15:57:22.333832 | controller | ok: [instance] 2026-02-24 15:57:22.553858 | controller | 2026-02-24 15:57:22.553890 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2026-02-24 15:57:22.553900 | controller | Tuesday 24 February 2026 15:57:22 +0000 (0:00:00.215) 0:01:20.272 ****** 2026-02-24 15:57:22.553913 | controller | ok: [instance] 2026-02-24 15:57:22.553946 | controller | 2026-02-24 15:57:22.553954 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2026-02-24 15:57:22.553963 | controller | Tuesday 24 February 2026 15:57:22 +0000 (0:00:00.219) 0:01:20.492 ****** 2026-02-24 15:57:22.774417 | controller | ok: [instance] 2026-02-24 15:57:22.811885 | controller | 2026-02-24 15:57:22.811909 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 15:57:22.811920 | controller | Tuesday 24 February 2026 15:57:22 +0000 (0:00:00.220) 0:01:20.712 ****** 2026-02-24 15:57:22.811932 | controller | 2026-02-24 15:57:22.812076 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-24 15:57:22.812113 | controller | Tuesday 24 February 2026 15:57:22 +0000 (0:00:00.038) 0:01:20.750 ****** 2026-02-24 15:57:23.003308 | controller | ok: [instance] 2026-02-24 15:57:23.026905 | controller | 2026-02-24 15:57:23.026938 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-24 15:57:23.026946 | controller | Tuesday 24 February 2026 15:57:23 +0000 (0:00:00.191) 0:01:20.941 ****** 2026-02-24 15:57:23.026957 | controller | ok: [instance] 2026-02-24 15:57:23.026982 | controller | 2026-02-24 15:57:23.027163 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-24 15:57:23.053294 | controller | Tuesday 24 February 2026 15:57:23 +0000 (0:00:00.023) 0:01:20.965 ****** 2026-02-24 15:57:23.053322 | controller | skipping: [instance] 2026-02-24 15:57:23.338498 | controller | 2026-02-24 15:57:23.338527 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2026-02-24 15:57:23.338536 | controller | Tuesday 24 February 2026 15:57:23 +0000 (0:00:00.025) 0:01:20.991 ****** 2026-02-24 15:57:23.338546 | controller | ok: [instance] 2026-02-24 15:57:23.554384 | controller | 2026-02-24 15:57:23.554410 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2026-02-24 15:57:23.554418 | controller | Tuesday 24 February 2026 15:57:23 +0000 (0:00:00.285) 0:01:21.276 ****** 2026-02-24 15:57:23.554441 | controller | ok: [instance] 2026-02-24 15:57:23.728808 | controller | 2026-02-24 15:57:23.728838 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2026-02-24 15:57:23.728846 | controller | Tuesday 24 February 2026 15:57:23 +0000 (0:00:00.216) 0:01:21.492 ****** 2026-02-24 15:57:23.728856 | controller | ok: [instance] 2026-02-24 15:57:23.785811 | controller | 2026-02-24 15:57:23.785843 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2026-02-24 15:57:23.785856 | controller | Tuesday 24 February 2026 15:57:23 +0000 (0:00:00.174) 0:01:21.667 ****** 2026-02-24 15:57:23.785871 | controller | 2026-02-24 15:57:23.828321 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-24 15:57:23.828338 | controller | Tuesday 24 February 2026 15:57:23 +0000 (0:00:00.056) 0:01:21.724 ****** 2026-02-24 15:57:23.828347 | controller | ok: [instance] => changed=false 2026-02-24 15:57:24.002448 | controller | msg: All assertions passed 2026-02-24 15:57:24.002472 | controller | 2026-02-24 15:57:24.002480 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-24 15:57:24.002486 | controller | Tuesday 24 February 2026 15:57:23 +0000 (0:00:00.042) 0:01:21.766 ****** 2026-02-24 15:57:24.002495 | controller | ok: [instance] 2026-02-24 15:57:24.184884 | controller | 2026-02-24 15:57:24.184918 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-24 15:57:24.184927 | controller | Tuesday 24 February 2026 15:57:24 +0000 (0:00:00.174) 0:01:21.940 ****** 2026-02-24 15:57:24.184937 | controller | ok: [instance] 2026-02-24 15:57:24.208587 | controller | 2026-02-24 15:57:24.208619 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-24 15:57:24.208628 | controller | Tuesday 24 February 2026 15:57:24 +0000 (0:00:00.182) 0:01:22.123 ****** 2026-02-24 15:57:24.208640 | controller | ok: [instance] => changed=false 2026-02-24 15:57:24.386287 | controller | msg: All assertions passed 2026-02-24 15:57:24.386315 | controller | 2026-02-24 15:57:24.386323 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-24 15:57:24.386330 | controller | Tuesday 24 February 2026 15:57:24 +0000 (0:00:00.023) 0:01:22.147 ****** 2026-02-24 15:57:24.386339 | controller | ok: [instance] 2026-02-24 15:57:24.559246 | controller | 2026-02-24 15:57:24.559285 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-24 15:57:24.559293 | controller | Tuesday 24 February 2026 15:57:24 +0000 (0:00:00.177) 0:01:22.324 ****** 2026-02-24 15:57:24.559303 | controller | ok: [instance] 2026-02-24 15:57:24.605405 | controller | 2026-02-24 15:57:24.605437 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-24 15:57:24.605446 | controller | Tuesday 24 February 2026 15:57:24 +0000 (0:00:00.172) 0:01:22.497 ****** 2026-02-24 15:57:24.605456 | controller | ok: [instance] 2026-02-24 15:57:24.994852 | controller | 2026-02-24 15:57:24.994885 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2026-02-24 15:57:24.994894 | controller | Tuesday 24 February 2026 15:57:24 +0000 (0:00:00.046) 0:01:22.544 ****** 2026-02-24 15:57:24.994905 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2026-02-24 15:57:25.013915 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2026-02-24 15:57:25.013946 | controller | 2026-02-24 15:57:25.013955 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2026-02-24 15:57:25.013961 | controller | Tuesday 24 February 2026 15:57:24 +0000 (0:00:00.389) 0:01:22.933 ****** 2026-02-24 15:57:25.013971 | controller | skipping: [instance] 2026-02-24 15:57:25.014154 | controller | 2026-02-24 15:57:25.014177 | controller | TASK [Load the architecture local kustomize patches] *************************** 2026-02-24 15:57:25.038778 | controller | Tuesday 24 February 2026 15:57:25 +0000 (0:00:00.019) 0:01:22.952 ****** 2026-02-24 15:57:25.038805 | controller | skipping: [instance] 2026-02-24 15:57:25.173488 | controller | 2026-02-24 15:57:25.173525 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2026-02-24 15:57:25.173535 | controller | Tuesday 24 February 2026 15:57:25 +0000 (0:00:00.024) 0:01:22.977 ****** 2026-02-24 15:57:25.173547 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2026-02-24 15:57:25.197831 | controller | 2026-02-24 15:57:25.197850 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2026-02-24 15:57:25.197857 | controller | Tuesday 24 February 2026 15:57:25 +0000 (0:00:00.134) 0:01:23.111 ****** 2026-02-24 15:57:25.197866 | controller | skipping: [instance] 2026-02-24 15:57:25.198081 | controller | 2026-02-24 15:57:25.198105 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2026-02-24 15:57:25.616334 | controller | Tuesday 24 February 2026 15:57:25 +0000 (0:00:00.024) 0:01:23.136 ****** 2026-02-24 15:57:25.616367 | controller | changed: [instance] 2026-02-24 15:57:25.616524 | controller | 2026-02-24 15:57:25.616662 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2026-02-24 15:57:25.616833 | controller | Tuesday 24 February 2026 15:57:25 +0000 (0:00:00.418) 0:01:23.554 ****** 2026-02-24 15:57:26.123912 | controller | changed: [instance] 2026-02-24 15:57:26.124327 | controller | 2026-02-24 15:57:26.124354 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2026-02-24 15:57:26.124369 | controller | Tuesday 24 February 2026 15:57:26 +0000 (0:00:00.496) 0:01:24.051 ****** 2026-02-24 15:57:26.542996 | controller | 2026-02-24 15:57:26.543024 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 15:57:26.543032 | controller | Tuesday 24 February 2026 15:57:26 +0000 (0:00:00.011) 0:01:24.062 ****** 2026-02-24 15:57:26.543042 | controller | changed: [instance] 2026-02-24 15:57:27.197502 | controller | 2026-02-24 15:57:27.197532 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-24 15:57:27.197541 | controller | Tuesday 24 February 2026 15:57:26 +0000 (0:00:00.418) 0:01:24.481 ****** 2026-02-24 15:57:27.197551 | controller | changed: [instance] 2026-02-24 15:57:27.229508 | controller | 2026-02-24 15:57:27.229535 | controller | TASK [Deploy virtualbmc] ******************************************************* 2026-02-24 15:57:27.229544 | controller | Tuesday 24 February 2026 15:57:27 +0000 (0:00:00.654) 0:01:25.135 ****** 2026-02-24 15:57:27.229554 | controller | skipping: [instance] 2026-02-24 15:57:27.298586 | controller | 2026-02-24 15:57:27.298616 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2026-02-24 15:57:27.298624 | controller | Tuesday 24 February 2026 15:57:27 +0000 (0:00:00.032) 0:01:25.168 ****** 2026-02-24 15:57:27.298635 | controller | skipping: [instance] 2026-02-24 15:57:27.855851 | controller | 2026-02-24 15:57:27.855887 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2026-02-24 15:57:27.855896 | controller | Tuesday 24 February 2026 15:57:27 +0000 (0:00:00.069) 0:01:25.237 ****** 2026-02-24 15:57:27.855907 | controller | changed: [instance] => (item=workload) 2026-02-24 15:57:27.855934 | controller | changed: [instance] => (item=reproducer-inventory) 2026-02-24 15:57:27.856238 | controller | ok: [instance] => (item=volumes) 2026-02-24 15:57:27.856289 | controller | 2026-02-24 15:57:27.856298 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2026-02-24 15:57:27.856307 | controller | Tuesday 24 February 2026 15:57:27 +0000 (0:00:00.557) 0:01:25.794 ****** 2026-02-24 15:57:28.257935 | controller | changed: [instance] => (item=workload) 2026-02-24 15:57:28.257994 | controller | changed: [instance] => (item=volumes) 2026-02-24 15:57:28.258006 | controller | 2026-02-24 15:57:28.258034 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2026-02-24 15:57:28.258169 | controller | Tuesday 24 February 2026 15:57:28 +0000 (0:00:00.401) 0:01:26.196 ****** 2026-02-24 15:57:28.282433 | controller | skipping: [instance] 2026-02-24 15:57:29.287802 | controller | 2026-02-24 15:57:29.287835 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2026-02-24 15:57:29.287844 | controller | Tuesday 24 February 2026 15:57:28 +0000 (0:00:00.024) 0:01:26.221 ****** 2026-02-24 15:57:29.287853 | controller | changed: [instance] => (item=compute) 2026-02-24 15:57:29.319879 | controller | changed: [instance] => (item=controller) 2026-02-24 15:57:29.319923 | controller | changed: [instance] => (item=crc) 2026-02-24 15:57:29.319933 | controller | 2026-02-24 15:57:29.319941 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2026-02-24 15:57:29.319948 | controller | Tuesday 24 February 2026 15:57:29 +0000 (0:00:01.004) 0:01:27.226 ****** 2026-02-24 15:57:29.319960 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance 2026-02-24 15:57:29.319989 | controller | 2026-02-24 15:57:29.319998 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] ***************** 2026-02-24 15:57:29.320121 | controller | Tuesday 24 February 2026 15:57:29 +0000 (0:00:00.032) 0:01:27.258 ****** 2026-02-24 15:57:29.495169 | controller | ok: [instance] 2026-02-24 15:57:29.513883 | controller | 2026-02-24 15:57:29.513916 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* 2026-02-24 15:57:29.513931 | controller | Tuesday 24 February 2026 15:57:29 +0000 (0:00:00.175) 0:01:27.433 ****** 2026-02-24 15:57:29.513943 | controller | skipping: [instance] 2026-02-24 15:57:29.874199 | controller | 2026-02-24 15:57:29.874229 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] *** 2026-02-24 15:57:29.874238 | controller | Tuesday 24 February 2026 15:57:29 +0000 (0:00:00.018) 0:01:27.452 ****** 2026-02-24 15:57:29.874248 | controller | changed: [instance] 2026-02-24 15:57:29.893895 | controller | 2026-02-24 15:57:29.893930 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* 2026-02-24 15:57:29.893939 | controller | Tuesday 24 February 2026 15:57:29 +0000 (0:00:00.360) 0:01:27.812 ****** 2026-02-24 15:57:29.893950 | controller | skipping: [instance] 2026-02-24 15:57:29.893978 | controller | 2026-02-24 15:57:29.894189 | controller | TASK [libvirt_manager : Write merged all-group.yml] **************************** 2026-02-24 15:57:29.913900 | controller | Tuesday 24 February 2026 15:57:29 +0000 (0:00:00.020) 0:01:27.832 ****** 2026-02-24 15:57:29.913970 | controller | skipping: [instance] 2026-02-24 15:57:29.950739 | controller | 2026-02-24 15:57:29.950761 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2026-02-24 15:57:29.950788 | controller | Tuesday 24 February 2026 15:57:29 +0000 (0:00:00.019) 0:01:27.852 ****** 2026-02-24 15:57:29.950798 | controller | skipping: [instance] 2026-02-24 15:57:30.015909 | controller | 2026-02-24 15:57:30.015938 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2026-02-24 15:57:30.015946 | controller | Tuesday 24 February 2026 15:57:29 +0000 (0:00:00.036) 0:01:27.889 ****** 2026-02-24 15:57:30.015956 | controller | skipping: [instance] => (item=crc) 2026-02-24 15:57:30.016267 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2026-02-24 15:57:30.016288 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2026-02-24 15:57:30.220354 | controller | 2026-02-24 15:57:30.220377 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-24 15:57:30.220385 | controller | Tuesday 24 February 2026 15:57:30 +0000 (0:00:00.065) 0:01:27.954 ****** 2026-02-24 15:57:30.220394 | controller | changed: [instance] 2026-02-24 15:57:30.399880 | controller | 2026-02-24 15:57:30.399913 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-24 15:57:30.399925 | controller | Tuesday 24 February 2026 15:57:30 +0000 (0:00:00.204) 0:01:28.158 ****** 2026-02-24 15:57:30.399938 | controller | ok: [instance] 2026-02-24 15:57:30.399978 | controller | 2026-02-24 15:57:30.400114 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-24 15:57:30.400141 | controller | Tuesday 24 February 2026 15:57:30 +0000 (0:00:00.179) 0:01:28.338 ****** 2026-02-24 15:57:59.781295 | controller | changed: [instance] 2026-02-24 15:57:59.985242 | controller | 2026-02-24 15:57:59.985276 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-24 15:57:59.985286 | controller | Tuesday 24 February 2026 15:57:59 +0000 (0:00:29.380) 0:01:57.719 ****** 2026-02-24 15:57:59.985299 | controller | ok: [instance] 2026-02-24 15:58:00.028368 | controller | 2026-02-24 15:58:00.028390 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-24 15:58:00.028417 | controller | Tuesday 24 February 2026 15:57:59 +0000 (0:00:00.203) 0:01:57.923 ****** 2026-02-24 15:58:00.028429 | controller | ok: [instance] => changed=false 2026-02-24 15:58:00.241578 | controller | msg: All assertions passed 2026-02-24 15:58:00.241602 | controller | 2026-02-24 15:58:00.241610 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-24 15:58:00.241616 | controller | Tuesday 24 February 2026 15:58:00 +0000 (0:00:00.043) 0:01:57.966 ****** 2026-02-24 15:58:00.241625 | controller | changed: [instance] 2026-02-24 15:58:00.448247 | controller | 2026-02-24 15:58:00.448273 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-24 15:58:00.448282 | controller | Tuesday 24 February 2026 15:58:00 +0000 (0:00:00.213) 0:01:58.180 ****** 2026-02-24 15:58:00.448293 | controller | ok: [instance] 2026-02-24 15:58:00.644449 | controller | 2026-02-24 15:58:00.644480 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-24 15:58:00.644490 | controller | Tuesday 24 February 2026 15:58:00 +0000 (0:00:00.206) 0:01:58.386 ****** 2026-02-24 15:58:00.644502 | controller | ok: [instance] 2026-02-24 15:58:00.666893 | controller | 2026-02-24 15:58:00.666931 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-24 15:58:00.666942 | controller | Tuesday 24 February 2026 15:58:00 +0000 (0:00:00.196) 0:01:58.582 ****** 2026-02-24 15:58:00.666955 | controller | skipping: [instance] 2026-02-24 15:58:00.860615 | controller | 2026-02-24 15:58:00.860650 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-24 15:58:00.860665 | controller | Tuesday 24 February 2026 15:58:00 +0000 (0:00:00.022) 0:01:58.605 ****** 2026-02-24 15:58:00.860678 | controller | ok: [instance] 2026-02-24 15:58:00.902913 | controller | 2026-02-24 15:58:00.902953 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-24 15:58:00.902967 | controller | Tuesday 24 February 2026 15:58:00 +0000 (0:00:00.193) 0:01:58.798 ****** 2026-02-24 15:58:00.902984 | controller | ok: [instance] => changed=false 2026-02-24 15:58:00.903025 | controller | msg: All assertions passed 2026-02-24 15:58:00.903035 | controller | 2026-02-24 15:58:00.903047 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-24 15:58:01.110678 | controller | Tuesday 24 February 2026 15:58:00 +0000 (0:00:00.042) 0:01:58.841 ****** 2026-02-24 15:58:01.110713 | controller | ok: [instance] 2026-02-24 15:58:01.289909 | controller | 2026-02-24 15:58:01.289942 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2026-02-24 15:58:01.289952 | controller | Tuesday 24 February 2026 15:58:01 +0000 (0:00:00.207) 0:01:59.049 ****** 2026-02-24 15:58:01.289964 | controller | ok: [instance] 2026-02-24 15:58:01.688493 | controller | 2026-02-24 15:58:01.688525 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2026-02-24 15:58:01.688546 | controller | Tuesday 24 February 2026 15:58:01 +0000 (0:00:00.179) 0:01:59.228 ****** 2026-02-24 15:58:01.688559 | controller | changed: [instance] 2026-02-24 15:58:01.866562 | controller | 2026-02-24 15:58:01.866596 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2026-02-24 15:58:01.866606 | controller | Tuesday 24 February 2026 15:58:01 +0000 (0:00:00.398) 0:01:59.626 ****** 2026-02-24 15:58:01.866618 | controller | ok: [instance] 2026-02-24 15:58:02.039507 | controller | 2026-02-24 15:58:02.039534 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2026-02-24 15:58:02.039541 | controller | Tuesday 24 February 2026 15:58:01 +0000 (0:00:00.178) 0:01:59.804 ****** 2026-02-24 15:58:02.039551 | controller | ok: [instance] 2026-02-24 15:58:02.423937 | controller | 2026-02-24 15:58:02.423975 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2026-02-24 15:58:02.423986 | controller | Tuesday 24 February 2026 15:58:02 +0000 (0:00:00.172) 0:01:59.977 ****** 2026-02-24 15:58:02.424000 | controller | changed: [instance] 2026-02-24 15:58:02.446509 | controller | 2026-02-24 15:58:02.446537 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2026-02-24 15:58:02.446545 | controller | Tuesday 24 February 2026 15:58:02 +0000 (0:00:00.384) 0:02:00.362 ****** 2026-02-24 15:58:02.446555 | controller | ok: [instance] 2026-02-24 15:58:02.671301 | controller | 2026-02-24 15:58:02.671331 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2026-02-24 15:58:02.671339 | controller | Tuesday 24 February 2026 15:58:02 +0000 (0:00:00.022) 0:02:00.384 ****** 2026-02-24 15:58:02.671348 | controller | ok: [instance] 2026-02-24 15:58:03.124647 | controller | 2026-02-24 15:58:03.124677 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2026-02-24 15:58:03.124686 | controller | Tuesday 24 February 2026 15:58:02 +0000 (0:00:00.224) 0:02:00.609 ****** 2026-02-24 15:58:03.124696 | controller | ok: [instance] 2026-02-24 15:58:03.242796 | controller | 2026-02-24 15:58:03.242824 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2026-02-24 15:58:03.242832 | controller | Tuesday 24 February 2026 15:58:03 +0000 (0:00:00.453) 0:02:01.062 ****** 2026-02-24 15:58:03.242842 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 15:58:03.534810 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 15:58:03.534844 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 15:58:03.534852 | controller | 2026-02-24 15:58:03.534859 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2026-02-24 15:58:03.534865 | controller | Tuesday 24 February 2026 15:58:03 +0000 (0:00:00.118) 0:02:01.181 ****** 2026-02-24 15:58:03.534876 | controller | changed: [instance] 2026-02-24 15:58:03.754182 | controller | 2026-02-24 15:58:03.754212 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2026-02-24 15:58:03.754220 | controller | Tuesday 24 February 2026 15:58:03 +0000 (0:00:00.292) 0:02:01.473 ****** 2026-02-24 15:58:03.754230 | controller | changed: [instance] 2026-02-24 15:58:04.055094 | controller | 2026-02-24 15:58:04.055128 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2026-02-24 15:58:04.055138 | controller | Tuesday 24 February 2026 15:58:03 +0000 (0:00:00.219) 0:02:01.692 ****** 2026-02-24 15:58:04.055150 | controller | changed: [instance] 2026-02-24 15:58:04.084857 | controller | 2026-02-24 15:58:04.084895 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2026-02-24 15:58:04.084906 | controller | Tuesday 24 February 2026 15:58:04 +0000 (0:00:00.300) 0:02:01.993 ****** 2026-02-24 15:58:04.084924 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 15:58:04.129380 | controller | 2026-02-24 15:58:04.129421 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 15:58:04.129429 | controller | Tuesday 24 February 2026 15:58:04 +0000 (0:00:00.029) 0:02:02.023 ****** 2026-02-24 15:58:04.129438 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 15:58:04.376511 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 15:58:04.376548 | controller | 2026-02-24 15:58:04.376558 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 15:58:04.376565 | controller | Tuesday 24 February 2026 15:58:04 +0000 (0:00:00.044) 0:02:02.067 ****** 2026-02-24 15:58:04.376577 | controller | ok: [instance] 2026-02-24 15:58:04.419758 | controller | 2026-02-24 15:58:04.419799 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 15:58:04.419806 | controller | Tuesday 24 February 2026 15:58:04 +0000 (0:00:00.247) 0:02:02.314 ****** 2026-02-24 15:58:04.419815 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 15:58:04.648869 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 15:58:04.648893 | controller | 2026-02-24 15:58:04.648902 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 15:58:04.648910 | controller | Tuesday 24 February 2026 15:58:04 +0000 (0:00:00.043) 0:02:02.358 ****** 2026-02-24 15:58:04.648921 | controller | ok: [instance] 2026-02-24 15:58:04.648949 | controller | 2026-02-24 15:58:04.649148 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 15:58:04.845295 | controller | Tuesday 24 February 2026 15:58:04 +0000 (0:00:00.229) 0:02:02.587 ****** 2026-02-24 15:58:04.845325 | controller | ok: [instance] 2026-02-24 15:58:05.128836 | controller | 2026-02-24 15:58:05.128864 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2026-02-24 15:58:05.128872 | controller | Tuesday 24 February 2026 15:58:04 +0000 (0:00:00.196) 0:02:02.783 ****** 2026-02-24 15:58:05.128881 | controller | changed: [instance] 2026-02-24 15:58:05.360243 | controller | 2026-02-24 15:58:05.360273 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 15:58:05.360283 | controller | Tuesday 24 February 2026 15:58:05 +0000 (0:00:00.283) 0:02:03.067 ****** 2026-02-24 15:58:05.360295 | controller | ok: [instance] 2026-02-24 15:58:05.406761 | controller | 2026-02-24 15:58:05.406828 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 15:58:05.406836 | controller | Tuesday 24 February 2026 15:58:05 +0000 (0:00:00.231) 0:02:03.298 ****** 2026-02-24 15:58:05.406846 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 15:58:05.634784 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 15:58:05.634819 | controller | 2026-02-24 15:58:05.634829 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 15:58:05.634837 | controller | Tuesday 24 February 2026 15:58:05 +0000 (0:00:00.046) 0:02:03.345 ****** 2026-02-24 15:58:05.634850 | controller | ok: [instance] 2026-02-24 15:58:05.834841 | controller | 2026-02-24 15:58:05.834872 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 15:58:05.834881 | controller | Tuesday 24 February 2026 15:58:05 +0000 (0:00:00.227) 0:02:03.573 ****** 2026-02-24 15:58:05.834892 | controller | ok: [instance] 2026-02-24 15:58:05.835047 | controller | 2026-02-24 15:58:05.835074 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2026-02-24 15:58:06.118655 | controller | Tuesday 24 February 2026 15:58:05 +0000 (0:00:00.200) 0:02:03.773 ****** 2026-02-24 15:58:06.118691 | controller | changed: [instance] 2026-02-24 15:58:06.141849 | controller | 2026-02-24 15:58:06.141876 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2026-02-24 15:58:06.141886 | controller | Tuesday 24 February 2026 15:58:06 +0000 (0:00:00.283) 0:02:04.057 ****** 2026-02-24 15:58:06.141897 | controller | skipping: [instance] 2026-02-24 15:58:06.170996 | controller | 2026-02-24 15:58:06.171017 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2026-02-24 15:58:06.171024 | controller | Tuesday 24 February 2026 15:58:06 +0000 (0:00:00.022) 0:02:04.080 ****** 2026-02-24 15:58:06.171032 | controller | skipping: [instance] 2026-02-24 15:58:06.198721 | controller | 2026-02-24 15:58:06.198750 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2026-02-24 15:58:06.198790 | controller | Tuesday 24 February 2026 15:58:06 +0000 (0:00:00.029) 0:02:04.109 ****** 2026-02-24 15:58:06.198811 | controller | skipping: [instance] 2026-02-24 15:58:06.223819 | controller | 2026-02-24 15:58:06.223837 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2026-02-24 15:58:06.223844 | controller | Tuesday 24 February 2026 15:58:06 +0000 (0:00:00.027) 0:02:04.137 ****** 2026-02-24 15:58:06.223860 | controller | skipping: [instance] 2026-02-24 15:58:06.224116 | controller | 2026-02-24 15:58:06.224182 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 15:58:06.224212 | controller | Tuesday 24 February 2026 15:58:06 +0000 (0:00:00.025) 0:02:04.162 ****** 2026-02-24 15:58:06.436862 | controller | changed: [instance] 2026-02-24 15:58:06.436919 | controller | 2026-02-24 15:58:06.437123 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 15:58:06.474613 | controller | Tuesday 24 February 2026 15:58:06 +0000 (0:00:00.212) 0:02:04.375 ****** 2026-02-24 15:58:06.474633 | controller | ok: [instance] 2026-02-24 15:58:06.528755 | controller | 2026-02-24 15:58:06.528818 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 15:58:06.528833 | controller | Tuesday 24 February 2026 15:58:06 +0000 (0:00:00.037) 0:02:04.413 ****** 2026-02-24 15:58:06.528855 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-24 15:58:06.726943 | controller | 2026-02-24 15:58:06.726966 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-24 15:58:06.726975 | controller | Tuesday 24 February 2026 15:58:06 +0000 (0:00:00.053) 0:02:04.466 ****** 2026-02-24 15:58:06.726986 | controller | ok: [instance] 2026-02-24 15:58:06.789579 | controller | 2026-02-24 15:58:06.789599 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-24 15:58:06.789607 | controller | Tuesday 24 February 2026 15:58:06 +0000 (0:00:00.198) 0:02:04.665 ****** 2026-02-24 15:58:06.789616 | controller | ok: [instance] 2026-02-24 15:58:06.890470 | controller | 2026-02-24 15:58:06.890501 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-24 15:58:06.890513 | controller | Tuesday 24 February 2026 15:58:06 +0000 (0:00:00.062) 0:02:04.727 ****** 2026-02-24 15:58:06.890528 | controller | ok: [instance] 2026-02-24 15:58:06.931907 | controller | 2026-02-24 15:58:06.931931 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-24 15:58:06.931940 | controller | Tuesday 24 February 2026 15:58:06 +0000 (0:00:00.101) 0:02:04.828 ****** 2026-02-24 15:58:06.931952 | controller | skipping: [instance] 2026-02-24 15:58:06.931982 | controller | 2026-02-24 15:58:06.931993 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-24 15:58:06.932067 | controller | Tuesday 24 February 2026 15:58:06 +0000 (0:00:00.041) 0:02:04.870 ****** 2026-02-24 15:58:06.975387 | controller | skipping: [instance] 2026-02-24 15:58:07.031449 | controller | 2026-02-24 15:58:07.031482 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-24 15:58:07.031496 | controller | Tuesday 24 February 2026 15:58:06 +0000 (0:00:00.043) 0:02:04.913 ****** 2026-02-24 15:58:07.031511 | controller | 2026-02-24 15:58:07.421847 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-24 15:58:07.421876 | controller | Tuesday 24 February 2026 15:58:07 +0000 (0:00:00.056) 0:02:04.969 ****** 2026-02-24 15:58:07.421888 | controller | ok: [instance] => (item=artifacts) 2026-02-24 15:58:07.422095 | controller | ok: [instance] => (item=logs) 2026-02-24 15:58:07.422107 | controller | 2026-02-24 15:58:07.422116 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-24 15:58:08.611909 | controller | Tuesday 24 February 2026 15:58:07 +0000 (0:00:00.390) 0:02:05.360 ****** 2026-02-24 15:58:08.611951 | controller | ok: [instance] 2026-02-24 15:58:08.611981 | controller | 2026-02-24 15:58:08.611991 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-24 15:58:08.612054 | controller | Tuesday 24 February 2026 15:58:08 +0000 (0:00:01.190) 0:02:06.550 ****** 2026-02-24 15:58:08.821465 | controller | changed: [instance] 2026-02-24 15:58:09.190231 | controller | 2026-02-24 15:58:09.190261 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-24 15:58:09.190269 | controller | Tuesday 24 February 2026 15:58:08 +0000 (0:00:00.209) 0:02:06.759 ****** 2026-02-24 15:58:09.190279 | controller | changed: [instance] 2026-02-24 15:58:09.556861 | controller | 2026-02-24 15:58:09.556891 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-24 15:58:09.556900 | controller | Tuesday 24 February 2026 15:58:09 +0000 (0:00:00.368) 0:02:07.128 ****** 2026-02-24 15:58:09.556910 | controller | changed: [instance] 2026-02-24 15:58:09.556934 | controller | 2026-02-24 15:58:09.557137 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-24 15:58:09.600940 | controller | Tuesday 24 February 2026 15:58:09 +0000 (0:00:00.367) 0:02:07.495 ****** 2026-02-24 15:58:09.600980 | controller | skipping: [instance] 2026-02-24 15:58:09.601003 | controller | 2026-02-24 15:58:09.601013 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-24 15:58:09.601043 | controller | Tuesday 24 February 2026 15:58:09 +0000 (0:00:00.043) 0:02:07.539 ****** 2026-02-24 15:58:09.797928 | controller | ok: [instance] 2026-02-24 15:58:09.798057 | controller | 2026-02-24 15:58:09.798184 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-24 15:58:09.798299 | controller | Tuesday 24 February 2026 15:58:09 +0000 (0:00:00.197) 0:02:07.736 ****** 2026-02-24 15:58:09.839001 | controller | skipping: [instance] 2026-02-24 15:58:09.839115 | controller | 2026-02-24 15:58:09.839234 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-24 15:58:09.839353 | controller | Tuesday 24 February 2026 15:58:09 +0000 (0:00:00.041) 0:02:07.777 ****** 2026-02-24 15:58:10.075444 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2026-02-24 15:58:10.350540 | controller | changed: [instance] 2026-02-24 15:58:10.350570 | controller | 2026-02-24 15:58:10.350578 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 15:58:10.350585 | controller | Tuesday 24 February 2026 15:58:10 +0000 (0:00:00.235) 0:02:08.013 ****** 2026-02-24 15:58:10.350594 | controller | changed: [instance] 2026-02-24 15:58:10.397733 | controller | 2026-02-24 15:58:10.397756 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 15:58:10.397782 | controller | Tuesday 24 February 2026 15:58:10 +0000 (0:00:00.275) 0:02:08.288 ****** 2026-02-24 15:58:10.397795 | controller | skipping: [instance] 2026-02-24 15:58:10.425860 | controller | 2026-02-24 15:58:10.425889 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2026-02-24 15:58:10.425897 | controller | Tuesday 24 February 2026 15:58:10 +0000 (0:00:00.047) 0:02:08.336 ****** 2026-02-24 15:58:10.425908 | controller | skipping: [instance] 2026-02-24 15:58:10.669270 | controller | 2026-02-24 15:58:10.669302 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2026-02-24 15:58:10.669312 | controller | Tuesday 24 February 2026 15:58:10 +0000 (0:00:00.028) 0:02:08.364 ****** 2026-02-24 15:58:10.669324 | controller | changed: [instance] 2026-02-24 15:58:10.886410 | controller | 2026-02-24 15:58:10.886442 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2026-02-24 15:58:10.886450 | controller | Tuesday 24 February 2026 15:58:10 +0000 (0:00:00.242) 0:02:08.607 ****** 2026-02-24 15:58:10.886461 | controller | changed: [instance] 2026-02-24 15:58:11.220109 | controller | 2026-02-24 15:58:11.220138 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2026-02-24 15:58:11.220146 | controller | Tuesday 24 February 2026 15:58:10 +0000 (0:00:00.217) 0:02:08.824 ****** 2026-02-24 15:58:11.220161 | controller | changed: [instance] 2026-02-24 15:58:11.249652 | controller | 2026-02-24 15:58:11.249682 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2026-02-24 15:58:11.249695 | controller | Tuesday 24 February 2026 15:58:11 +0000 (0:00:00.333) 0:02:09.158 ****** 2026-02-24 15:58:11.249710 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 15:58:11.294918 | controller | 2026-02-24 15:58:11.294948 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 15:58:11.294961 | controller | Tuesday 24 February 2026 15:58:11 +0000 (0:00:00.029) 0:02:09.187 ****** 2026-02-24 15:58:11.294976 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 15:58:11.295229 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 15:58:11.295254 | controller | 2026-02-24 15:58:11.295272 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 15:58:11.542687 | controller | Tuesday 24 February 2026 15:58:11 +0000 (0:00:00.045) 0:02:09.233 ****** 2026-02-24 15:58:11.542709 | controller | ok: [instance] 2026-02-24 15:58:11.585815 | controller | 2026-02-24 15:58:11.585832 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 15:58:11.585839 | controller | Tuesday 24 February 2026 15:58:11 +0000 (0:00:00.247) 0:02:09.481 ****** 2026-02-24 15:58:11.585847 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 15:58:11.586137 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 15:58:11.586158 | controller | 2026-02-24 15:58:11.813871 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 15:58:11.813982 | controller | Tuesday 24 February 2026 15:58:11 +0000 (0:00:00.043) 0:02:09.524 ****** 2026-02-24 15:58:11.813999 | controller | ok: [instance] 2026-02-24 15:58:12.015346 | controller | 2026-02-24 15:58:12.015365 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 15:58:12.015372 | controller | Tuesday 24 February 2026 15:58:11 +0000 (0:00:00.227) 0:02:09.752 ****** 2026-02-24 15:58:12.015381 | controller | ok: [instance] 2026-02-24 15:58:12.295242 | controller | 2026-02-24 15:58:12.295273 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2026-02-24 15:58:12.295282 | controller | Tuesday 24 February 2026 15:58:12 +0000 (0:00:00.201) 0:02:09.953 ****** 2026-02-24 15:58:12.295296 | controller | changed: [instance] 2026-02-24 15:58:12.520272 | controller | 2026-02-24 15:58:12.520299 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 15:58:12.520306 | controller | Tuesday 24 February 2026 15:58:12 +0000 (0:00:00.279) 0:02:10.233 ****** 2026-02-24 15:58:12.520316 | controller | ok: [instance] 2026-02-24 15:58:12.566883 | controller | 2026-02-24 15:58:12.566906 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 15:58:12.566913 | controller | Tuesday 24 February 2026 15:58:12 +0000 (0:00:00.225) 0:02:10.458 ****** 2026-02-24 15:58:12.566922 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 15:58:12.806912 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 15:58:12.806970 | controller | 2026-02-24 15:58:12.806981 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 15:58:12.806989 | controller | Tuesday 24 February 2026 15:58:12 +0000 (0:00:00.046) 0:02:10.505 ****** 2026-02-24 15:58:12.807006 | controller | ok: [instance] 2026-02-24 15:58:13.007864 | controller | 2026-02-24 15:58:13.007895 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 15:58:13.007905 | controller | Tuesday 24 February 2026 15:58:12 +0000 (0:00:00.239) 0:02:10.745 ****** 2026-02-24 15:58:13.007917 | controller | ok: [instance] 2026-02-24 15:58:13.007945 | controller | 2026-02-24 15:58:13.007955 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2026-02-24 15:58:13.007982 | controller | Tuesday 24 February 2026 15:58:13 +0000 (0:00:00.201) 0:02:10.946 ****** 2026-02-24 15:58:13.294902 | controller | changed: [instance] 2026-02-24 15:58:13.294936 | controller | 2026-02-24 15:58:13.294946 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2026-02-24 15:58:13.294956 | controller | Tuesday 24 February 2026 15:58:13 +0000 (0:00:00.286) 0:02:11.233 ****** 2026-02-24 15:58:13.336316 | controller | skipping: [instance] 2026-02-24 15:58:13.364459 | controller | 2026-02-24 15:58:13.364490 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2026-02-24 15:58:13.364503 | controller | Tuesday 24 February 2026 15:58:13 +0000 (0:00:00.041) 0:02:11.274 ****** 2026-02-24 15:58:13.364518 | controller | skipping: [instance] 2026-02-24 15:58:13.392535 | controller | 2026-02-24 15:58:13.392556 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2026-02-24 15:58:13.392565 | controller | Tuesday 24 February 2026 15:58:13 +0000 (0:00:00.028) 0:02:11.302 ****** 2026-02-24 15:58:13.392575 | controller | skipping: [instance] 2026-02-24 15:58:13.418982 | controller | 2026-02-24 15:58:13.419021 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2026-02-24 15:58:13.419035 | controller | Tuesday 24 February 2026 15:58:13 +0000 (0:00:00.028) 0:02:11.331 ****** 2026-02-24 15:58:13.419051 | controller | skipping: [instance] 2026-02-24 15:58:13.641307 | controller | 2026-02-24 15:58:13.641337 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 15:58:13.641345 | controller | Tuesday 24 February 2026 15:58:13 +0000 (0:00:00.025) 0:02:11.357 ****** 2026-02-24 15:58:13.641356 | controller | changed: [instance] 2026-02-24 15:58:13.681200 | controller | 2026-02-24 15:58:13.681226 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 15:58:13.681235 | controller | Tuesday 24 February 2026 15:58:13 +0000 (0:00:00.222) 0:02:11.579 ****** 2026-02-24 15:58:13.681247 | controller | ok: [instance] 2026-02-24 15:58:13.733233 | controller | 2026-02-24 15:58:13.733268 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 15:58:13.733281 | controller | Tuesday 24 February 2026 15:58:13 +0000 (0:00:00.040) 0:02:11.619 ****** 2026-02-24 15:58:13.733298 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-24 15:58:13.733308 | controller | 2026-02-24 15:58:13.733317 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-24 15:58:13.733329 | controller | Tuesday 24 February 2026 15:58:13 +0000 (0:00:00.051) 0:02:11.671 ****** 2026-02-24 15:58:13.928432 | controller | ok: [instance] 2026-02-24 15:58:13.991216 | controller | 2026-02-24 15:58:13.991235 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-24 15:58:13.991243 | controller | Tuesday 24 February 2026 15:58:13 +0000 (0:00:00.195) 0:02:11.866 ****** 2026-02-24 15:58:13.991252 | controller | ok: [instance] 2026-02-24 15:58:14.036535 | controller | 2026-02-24 15:58:14.036555 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-24 15:58:14.036563 | controller | Tuesday 24 February 2026 15:58:13 +0000 (0:00:00.062) 0:02:11.929 ****** 2026-02-24 15:58:14.036573 | controller | ok: [instance] 2026-02-24 15:58:14.079553 | controller | 2026-02-24 15:58:14.079576 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-24 15:58:14.079589 | controller | Tuesday 24 February 2026 15:58:14 +0000 (0:00:00.045) 0:02:11.975 ****** 2026-02-24 15:58:14.079601 | controller | skipping: [instance] 2026-02-24 15:58:14.123095 | controller | 2026-02-24 15:58:14.123124 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-24 15:58:14.123134 | controller | Tuesday 24 February 2026 15:58:14 +0000 (0:00:00.042) 0:02:12.018 ****** 2026-02-24 15:58:14.123145 | controller | skipping: [instance] 2026-02-24 15:58:14.123308 | controller | 2026-02-24 15:58:14.123458 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-24 15:58:14.123588 | controller | Tuesday 24 February 2026 15:58:14 +0000 (0:00:00.043) 0:02:12.061 ****** 2026-02-24 15:58:14.183090 | controller | 2026-02-24 15:58:14.183283 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-24 15:58:14.183458 | controller | Tuesday 24 February 2026 15:58:14 +0000 (0:00:00.060) 0:02:12.121 ****** 2026-02-24 15:58:14.584686 | controller | ok: [instance] => (item=artifacts) 2026-02-24 15:58:15.778470 | controller | ok: [instance] => (item=logs) 2026-02-24 15:58:15.778506 | controller | 2026-02-24 15:58:15.778514 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-24 15:58:15.778521 | controller | Tuesday 24 February 2026 15:58:14 +0000 (0:00:00.400) 0:02:12.522 ****** 2026-02-24 15:58:15.778531 | controller | ok: [instance] 2026-02-24 15:58:15.988887 | controller | 2026-02-24 15:58:15.988915 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-24 15:58:15.988924 | controller | Tuesday 24 February 2026 15:58:15 +0000 (0:00:01.193) 0:02:13.716 ****** 2026-02-24 15:58:15.988934 | controller | changed: [instance] 2026-02-24 15:58:16.364841 | controller | 2026-02-24 15:58:16.364871 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-24 15:58:16.364880 | controller | Tuesday 24 February 2026 15:58:15 +0000 (0:00:00.210) 0:02:13.927 ****** 2026-02-24 15:58:16.364889 | controller | changed: [instance] 2026-02-24 15:58:16.737408 | controller | 2026-02-24 15:58:16.737440 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-24 15:58:16.737450 | controller | Tuesday 24 February 2026 15:58:16 +0000 (0:00:00.375) 0:02:14.302 ****** 2026-02-24 15:58:16.737462 | controller | changed: [instance] 2026-02-24 15:58:16.782407 | controller | 2026-02-24 15:58:16.782425 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-24 15:58:16.782432 | controller | Tuesday 24 February 2026 15:58:16 +0000 (0:00:00.373) 0:02:14.675 ****** 2026-02-24 15:58:16.782441 | controller | skipping: [instance] 2026-02-24 15:58:16.983336 | controller | 2026-02-24 15:58:16.983372 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-24 15:58:16.983394 | controller | Tuesday 24 February 2026 15:58:16 +0000 (0:00:00.045) 0:02:14.720 ****** 2026-02-24 15:58:16.983408 | controller | ok: [instance] 2026-02-24 15:58:17.025981 | controller | 2026-02-24 15:58:17.026028 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-24 15:58:17.026043 | controller | Tuesday 24 February 2026 15:58:16 +0000 (0:00:00.200) 0:02:14.921 ****** 2026-02-24 15:58:17.026061 | controller | skipping: [instance] 2026-02-24 15:58:17.261790 | controller | 2026-02-24 15:58:17.261821 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-24 15:58:17.261830 | controller | Tuesday 24 February 2026 15:58:17 +0000 (0:00:00.042) 0:02:14.964 ****** 2026-02-24 15:58:17.261840 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2026-02-24 15:58:17.535879 | controller | changed: [instance] 2026-02-24 15:58:17.535916 | controller | 2026-02-24 15:58:17.535926 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 15:58:17.535935 | controller | Tuesday 24 February 2026 15:58:17 +0000 (0:00:00.235) 0:02:15.200 ****** 2026-02-24 15:58:17.535947 | controller | changed: [instance] 2026-02-24 15:58:17.535954 | controller | 2026-02-24 15:58:17.535961 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 15:58:17.535970 | controller | Tuesday 24 February 2026 15:58:17 +0000 (0:00:00.273) 0:02:15.473 ****** 2026-02-24 15:58:17.582371 | controller | skipping: [instance] 2026-02-24 15:58:17.610731 | controller | 2026-02-24 15:58:17.610754 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2026-02-24 15:58:17.610785 | controller | Tuesday 24 February 2026 15:58:17 +0000 (0:00:00.047) 0:02:15.520 ****** 2026-02-24 15:58:17.610801 | controller | skipping: [instance] 2026-02-24 15:58:17.852832 | controller | 2026-02-24 15:58:17.852859 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2026-02-24 15:58:17.852873 | controller | Tuesday 24 February 2026 15:58:17 +0000 (0:00:00.028) 0:02:15.549 ****** 2026-02-24 15:58:17.852885 | controller | changed: [instance] 2026-02-24 15:58:18.075173 | controller | 2026-02-24 15:58:18.075198 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2026-02-24 15:58:18.075214 | controller | Tuesday 24 February 2026 15:58:17 +0000 (0:00:00.242) 0:02:15.791 ****** 2026-02-24 15:58:18.075225 | controller | changed: [instance] 2026-02-24 15:58:18.441717 | controller | 2026-02-24 15:58:18.441748 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2026-02-24 15:58:18.441757 | controller | Tuesday 24 February 2026 15:58:18 +0000 (0:00:00.222) 0:02:16.013 ****** 2026-02-24 15:58:18.441783 | controller | changed: [instance] 2026-02-24 15:58:18.469881 | controller | 2026-02-24 15:58:18.469915 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2026-02-24 15:58:18.469925 | controller | Tuesday 24 February 2026 15:58:18 +0000 (0:00:00.366) 0:02:16.380 ****** 2026-02-24 15:58:18.469937 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 15:58:18.515254 | controller | 2026-02-24 15:58:18.515276 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 15:58:18.515284 | controller | Tuesday 24 February 2026 15:58:18 +0000 (0:00:00.028) 0:02:16.408 ****** 2026-02-24 15:58:18.515294 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 15:58:18.737718 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 15:58:18.737749 | controller | 2026-02-24 15:58:18.737758 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 15:58:18.737788 | controller | Tuesday 24 February 2026 15:58:18 +0000 (0:00:00.045) 0:02:16.453 ****** 2026-02-24 15:58:18.737804 | controller | ok: [instance] 2026-02-24 15:58:18.781512 | controller | 2026-02-24 15:58:18.781534 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 15:58:18.781541 | controller | Tuesday 24 February 2026 15:58:18 +0000 (0:00:00.222) 0:02:16.676 ****** 2026-02-24 15:58:18.781551 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 15:58:19.012981 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 15:58:19.013032 | controller | 2026-02-24 15:58:19.013047 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 15:58:19.013058 | controller | Tuesday 24 February 2026 15:58:18 +0000 (0:00:00.043) 0:02:16.719 ****** 2026-02-24 15:58:19.013077 | controller | ok: [instance] 2026-02-24 15:58:19.209546 | controller | 2026-02-24 15:58:19.209580 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 15:58:19.209590 | controller | Tuesday 24 February 2026 15:58:19 +0000 (0:00:00.231) 0:02:16.951 ****** 2026-02-24 15:58:19.209603 | controller | ok: [instance] 2026-02-24 15:58:19.498760 | controller | 2026-02-24 15:58:19.498811 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2026-02-24 15:58:19.498820 | controller | Tuesday 24 February 2026 15:58:19 +0000 (0:00:00.196) 0:02:17.147 ****** 2026-02-24 15:58:19.498831 | controller | changed: [instance] 2026-02-24 15:58:19.727847 | controller | 2026-02-24 15:58:19.727879 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 15:58:19.727887 | controller | Tuesday 24 February 2026 15:58:19 +0000 (0:00:00.289) 0:02:17.437 ****** 2026-02-24 15:58:19.727897 | controller | ok: [instance] 2026-02-24 15:58:19.728061 | controller | 2026-02-24 15:58:19.728091 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 15:58:19.772871 | controller | Tuesday 24 February 2026 15:58:19 +0000 (0:00:00.229) 0:02:17.666 ****** 2026-02-24 15:58:19.772894 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 15:58:19.773180 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 15:58:19.773205 | controller | 2026-02-24 15:58:20.001969 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 15:58:20.001998 | controller | Tuesday 24 February 2026 15:58:19 +0000 (0:00:00.044) 0:02:17.711 ****** 2026-02-24 15:58:20.002010 | controller | ok: [instance] 2026-02-24 15:58:20.199891 | controller | 2026-02-24 15:58:20.199925 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 15:58:20.199935 | controller | Tuesday 24 February 2026 15:58:19 +0000 (0:00:00.228) 0:02:17.940 ****** 2026-02-24 15:58:20.199948 | controller | ok: [instance] 2026-02-24 15:58:20.484869 | controller | 2026-02-24 15:58:20.484903 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2026-02-24 15:58:20.484915 | controller | Tuesday 24 February 2026 15:58:20 +0000 (0:00:00.197) 0:02:18.138 ****** 2026-02-24 15:58:20.484927 | controller | changed: [instance] 2026-02-24 15:58:20.484957 | controller | 2026-02-24 15:58:20.485221 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2026-02-24 15:58:20.505600 | controller | Tuesday 24 February 2026 15:58:20 +0000 (0:00:00.285) 0:02:18.423 ****** 2026-02-24 15:58:20.505626 | controller | skipping: [instance] 2026-02-24 15:58:20.533847 | controller | 2026-02-24 15:58:20.533868 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2026-02-24 15:58:20.533880 | controller | Tuesday 24 February 2026 15:58:20 +0000 (0:00:00.020) 0:02:18.444 ****** 2026-02-24 15:58:20.533889 | controller | skipping: [instance] 2026-02-24 15:58:20.534205 | controller | 2026-02-24 15:58:20.560916 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2026-02-24 15:58:20.560950 | controller | Tuesday 24 February 2026 15:58:20 +0000 (0:00:00.028) 0:02:18.472 ****** 2026-02-24 15:58:20.560968 | controller | skipping: [instance] 2026-02-24 15:58:20.561044 | controller | 2026-02-24 15:58:20.561066 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2026-02-24 15:58:20.561079 | controller | Tuesday 24 February 2026 15:58:20 +0000 (0:00:00.026) 0:02:18.499 ****** 2026-02-24 15:58:20.586762 | controller | skipping: [instance] 2026-02-24 15:58:20.790735 | controller | 2026-02-24 15:58:20.790787 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 15:58:20.790801 | controller | Tuesday 24 February 2026 15:58:20 +0000 (0:00:00.025) 0:02:18.525 ****** 2026-02-24 15:58:20.790814 | controller | changed: [instance] 2026-02-24 15:58:20.827855 | controller | 2026-02-24 15:58:20.827874 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 15:58:20.827882 | controller | Tuesday 24 February 2026 15:58:20 +0000 (0:00:00.203) 0:02:18.729 ****** 2026-02-24 15:58:20.827891 | controller | ok: [instance] 2026-02-24 15:58:20.854780 | controller | 2026-02-24 15:58:20.854797 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 15:58:20.854803 | controller | Tuesday 24 February 2026 15:58:20 +0000 (0:00:00.037) 0:02:18.766 ****** 2026-02-24 15:58:20.854812 | controller | skipping: [instance] 2026-02-24 15:58:20.854944 | controller | 2026-02-24 15:58:20.855078 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 15:58:20.855195 | controller | Tuesday 24 February 2026 15:58:20 +0000 (0:00:00.027) 0:02:18.793 ****** 2026-02-24 15:58:20.882695 | controller | skipping: [instance] 2026-02-24 15:58:20.882855 | controller | 2026-02-24 15:58:20.883043 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 15:58:20.883141 | controller | Tuesday 24 February 2026 15:58:20 +0000 (0:00:00.027) 0:02:18.821 ****** 2026-02-24 15:58:20.929246 | controller | skipping: [instance] 2026-02-24 15:58:20.929356 | controller | 2026-02-24 15:58:20.929696 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2026-02-24 15:58:20.955802 | controller | Tuesday 24 February 2026 15:58:20 +0000 (0:00:00.046) 0:02:18.868 ****** 2026-02-24 15:58:20.955834 | controller | skipping: [instance] 2026-02-24 15:58:20.955907 | controller | 2026-02-24 15:58:20.956072 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2026-02-24 15:58:20.956156 | controller | Tuesday 24 February 2026 15:58:20 +0000 (0:00:00.026) 0:02:18.894 ****** 2026-02-24 15:58:21.015038 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2026-02-24 15:58:21.015187 | controller | 2026-02-24 15:58:21.015291 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2026-02-24 15:58:21.015463 | controller | Tuesday 24 February 2026 15:58:21 +0000 (0:00:00.059) 0:02:18.953 ****** 2026-02-24 15:58:21.246300 | controller | ok: [instance] => (item=crc) 2026-02-24 15:58:21.246430 | controller | 2026-02-24 15:58:21.246548 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2026-02-24 15:58:21.246656 | controller | Tuesday 24 February 2026 15:58:21 +0000 (0:00:00.231) 0:02:19.185 ****** 2026-02-24 15:58:23.319260 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 15:58:23.319434 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 15:58:23.319605 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 15:58:23.319703 | controller | 2026-02-24 15:58:23.319827 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 15:58:23.319953 | controller | Tuesday 24 February 2026 15:58:23 +0000 (0:00:02.072) 0:02:21.257 ****** 2026-02-24 15:58:24.180198 | controller | changed: [instance] 2026-02-24 15:58:24.180341 | controller | 2026-02-24 15:58:24.180482 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 15:58:24.180591 | controller | Tuesday 24 February 2026 15:58:24 +0000 (0:00:00.860) 0:02:22.118 ****** 2026-02-24 15:58:24.942845 | controller | changed: [instance] 2026-02-24 15:58:25.786066 | controller | 2026-02-24 15:58:25.786118 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 15:58:25.786127 | controller | Tuesday 24 February 2026 15:58:24 +0000 (0:00:00.759) 0:02:22.878 ****** 2026-02-24 15:58:25.786140 | controller | changed: [instance] 2026-02-24 15:58:26.509745 | controller | 2026-02-24 15:58:26.509803 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2026-02-24 15:58:26.509817 | controller | Tuesday 24 February 2026 15:58:25 +0000 (0:00:00.845) 0:02:23.724 ****** 2026-02-24 15:58:26.509830 | controller | changed: [instance] => (item=compute-0.utility) 2026-02-24 15:58:52.838936 | controller | changed: [instance] => (item=controller-0.utility) 2026-02-24 15:58:52.838977 | controller | changed: [instance] => (item=crc-0.utility) 2026-02-24 15:58:52.838985 | controller | 2026-02-24 15:58:52.838991 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2026-02-24 15:58:52.838997 | controller | Tuesday 24 February 2026 15:58:26 +0000 (0:00:00.723) 0:02:24.447 ****** 2026-02-24 15:58:52.839007 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-02-24 15:58:52.839026 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2026-02-24 15:58:52.839048 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2026-02-24 15:58:52.839151 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2026-02-24 15:58:52.839237 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2026-02-24 15:58:52.839329 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2026-02-24 15:58:52.839408 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). 2026-02-24 15:58:52.839527 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j156214546734.24565', 'results_file': '/home/zuul/.ansible_async/j156214546734.24565', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2026-02-24 15:58:52.839613 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-02-24 15:58:52.840002 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j192625396384.24582', 'results_file': '/home/zuul/.ansible_async/j192625396384.24582', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2026-02-24 15:58:52.840073 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j82770369870.24598', 'results_file': '/home/zuul/.ansible_async/j82770369870.24598', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2026-02-24 15:58:52.840081 | controller | 2026-02-24 15:58:52.840091 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2026-02-24 15:58:52.840098 | controller | Tuesday 24 February 2026 15:58:52 +0000 (0:00:26.328) 0:02:50.776 ****** 2026-02-24 15:58:52.956799 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 15:58:52.988560 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 15:58:52.988603 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 15:58:52.988612 | controller | 2026-02-24 15:58:52.988619 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 15:58:52.988625 | controller | Tuesday 24 February 2026 15:58:52 +0000 (0:00:00.118) 0:02:50.894 ****** 2026-02-24 15:58:52.988638 | controller | skipping: [instance] 2026-02-24 15:58:53.027596 | controller | 2026-02-24 15:58:53.027627 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2026-02-24 15:58:53.027636 | controller | Tuesday 24 February 2026 15:58:52 +0000 (0:00:00.029) 0:02:50.924 ****** 2026-02-24 15:58:53.027646 | controller | 2026-02-24 15:58:53.112982 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 15:58:53.113044 | controller | Tuesday 24 February 2026 15:58:53 +0000 (0:00:00.041) 0:02:50.965 ****** 2026-02-24 15:58:53.113073 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-24 15:58:53.364744 | controller | 2026-02-24 15:58:53.364797 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 15:58:53.364806 | controller | Tuesday 24 February 2026 15:58:53 +0000 (0:00:00.085) 0:02:51.051 ****** 2026-02-24 15:58:53.364817 | controller | changed: [instance] 2026-02-24 15:58:53.607976 | controller | 2026-02-24 15:58:53.608012 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 15:58:53.608022 | controller | Tuesday 24 February 2026 15:58:53 +0000 (0:00:00.247) 0:02:51.298 ****** 2026-02-24 15:58:53.608036 | controller | changed: [instance] 2026-02-24 15:58:54.039980 | controller | 2026-02-24 15:58:54.040034 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2026-02-24 15:58:54.040042 | controller | Tuesday 24 February 2026 15:58:53 +0000 (0:00:00.247) 0:02:51.545 ****** 2026-02-24 15:58:54.040069 | controller | changed: [instance] 2026-02-24 15:58:54.070537 | controller | 2026-02-24 15:58:54.070591 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2026-02-24 15:58:54.070600 | controller | Tuesday 24 February 2026 15:58:54 +0000 (0:00:00.431) 0:02:51.977 ****** 2026-02-24 15:58:54.070612 | controller | skipping: [instance] 2026-02-24 15:58:54.070631 | controller | 2026-02-24 15:58:54.070689 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 15:58:54.070807 | controller | Tuesday 24 February 2026 15:58:54 +0000 (0:00:00.031) 0:02:52.009 ****** 2026-02-24 15:58:54.098358 | controller | skipping: [instance] 2026-02-24 15:58:54.098451 | controller | 2026-02-24 15:58:54.098573 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2026-02-24 15:58:54.098673 | controller | Tuesday 24 February 2026 15:58:54 +0000 (0:00:00.027) 0:02:52.037 ****** 2026-02-24 15:58:54.152753 | controller | skipping: [instance] 2026-02-24 15:58:54.206179 | controller | 2026-02-24 15:58:54.206227 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2026-02-24 15:58:54.206236 | controller | Tuesday 24 February 2026 15:58:54 +0000 (0:00:00.053) 0:02:52.090 ****** 2026-02-24 15:58:54.206248 | controller | skipping: [instance] 2026-02-24 15:58:54.234800 | controller | 2026-02-24 15:58:54.234835 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 15:58:54.234844 | controller | Tuesday 24 February 2026 15:58:54 +0000 (0:00:00.053) 0:02:52.144 ****** 2026-02-24 15:58:54.234855 | controller | skipping: [instance] 2026-02-24 15:58:54.277615 | controller | 2026-02-24 15:58:54.277647 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2026-02-24 15:58:54.277655 | controller | Tuesday 24 February 2026 15:58:54 +0000 (0:00:00.028) 0:02:52.172 ****** 2026-02-24 15:58:54.277665 | controller | 2026-02-24 15:58:54.277865 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 15:58:54.278014 | controller | Tuesday 24 February 2026 15:58:54 +0000 (0:00:00.043) 0:02:52.216 ****** 2026-02-24 15:58:54.365325 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-24 15:58:54.616789 | controller | 2026-02-24 15:58:54.616831 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 15:58:54.616840 | controller | Tuesday 24 February 2026 15:58:54 +0000 (0:00:00.086) 0:02:52.302 ****** 2026-02-24 15:58:54.616851 | controller | ok: [instance] 2026-02-24 15:58:54.849231 | controller | 2026-02-24 15:58:54.849269 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 15:58:54.849278 | controller | Tuesday 24 February 2026 15:58:54 +0000 (0:00:00.251) 0:02:52.554 ****** 2026-02-24 15:58:54.849290 | controller | ok: [instance] 2026-02-24 15:58:54.849613 | controller | 2026-02-24 15:58:55.268032 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2026-02-24 15:58:55.268070 | controller | Tuesday 24 February 2026 15:58:54 +0000 (0:00:00.232) 0:02:52.787 ****** 2026-02-24 15:58:55.268084 | controller | changed: [instance] 2026-02-24 15:58:55.298510 | controller | 2026-02-24 15:58:55.298538 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2026-02-24 15:58:55.298546 | controller | Tuesday 24 February 2026 15:58:55 +0000 (0:00:00.419) 0:02:53.206 ****** 2026-02-24 15:58:55.298556 | controller | skipping: [instance] 2026-02-24 15:58:55.333911 | controller | 2026-02-24 15:58:55.333930 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 15:58:55.333938 | controller | Tuesday 24 February 2026 15:58:55 +0000 (0:00:00.030) 0:02:53.237 ****** 2026-02-24 15:58:55.333947 | controller | skipping: [instance] 2026-02-24 15:58:57.061243 | controller | 2026-02-24 15:58:57.061294 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2026-02-24 15:58:57.061304 | controller | Tuesday 24 February 2026 15:58:55 +0000 (0:00:00.035) 0:02:53.272 ****** 2026-02-24 15:58:57.061317 | controller | changed: [instance -> controller-0.instance] 2026-02-24 15:58:58.309199 | controller | 2026-02-24 15:58:58.309237 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2026-02-24 15:58:58.309246 | controller | Tuesday 24 February 2026 15:58:57 +0000 (0:00:01.726) 0:02:54.998 ****** 2026-02-24 15:58:58.309256 | controller | changed: [instance -> controller-0.instance] 2026-02-24 15:58:58.351667 | controller | 2026-02-24 15:58:58.351700 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 15:58:58.351709 | controller | Tuesday 24 February 2026 15:58:58 +0000 (0:00:01.247) 0:02:56.246 ****** 2026-02-24 15:58:58.351729 | controller | 2026-02-24 15:58:58.590427 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-24 15:58:58.590465 | controller | Tuesday 24 February 2026 15:58:58 +0000 (0:00:00.043) 0:02:56.290 ****** 2026-02-24 15:58:58.590478 | controller | ok: [instance] 2026-02-24 15:58:58.621166 | controller | 2026-02-24 15:58:58.621196 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-24 15:58:58.621204 | controller | Tuesday 24 February 2026 15:58:58 +0000 (0:00:00.238) 0:02:56.528 ****** 2026-02-24 15:58:58.621215 | controller | ok: [instance] 2026-02-24 15:58:58.652098 | controller | 2026-02-24 15:58:58.652131 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-24 15:58:58.652140 | controller | Tuesday 24 February 2026 15:58:58 +0000 (0:00:00.030) 0:02:56.559 ****** 2026-02-24 15:58:58.652150 | controller | skipping: [instance] 2026-02-24 15:58:58.701141 | controller | 2026-02-24 15:58:58.701176 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2026-02-24 15:58:58.701184 | controller | Tuesday 24 February 2026 15:58:58 +0000 (0:00:00.031) 0:02:56.590 ****** 2026-02-24 15:58:58.701195 | controller | 2026-02-24 15:58:58.792800 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 15:58:58.792844 | controller | Tuesday 24 February 2026 15:58:58 +0000 (0:00:00.049) 0:02:56.639 ****** 2026-02-24 15:58:58.792858 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2026-02-24 15:58:58.792879 | controller | 2026-02-24 15:58:58.792886 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 15:58:58.792893 | controller | Tuesday 24 February 2026 15:58:58 +0000 (0:00:00.091) 0:02:56.731 ****** 2026-02-24 15:58:59.044025 | controller | ok: [instance] 2026-02-24 15:58:59.044240 | controller | 2026-02-24 15:58:59.044424 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 15:58:59.044570 | controller | Tuesday 24 February 2026 15:58:59 +0000 (0:00:00.251) 0:02:56.982 ****** 2026-02-24 15:58:59.284433 | controller | ok: [instance] 2026-02-24 15:58:59.284595 | controller | 2026-02-24 15:58:59.284739 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2026-02-24 15:58:59.284911 | controller | Tuesday 24 February 2026 15:58:59 +0000 (0:00:00.240) 0:02:57.222 ****** 2026-02-24 15:58:59.745749 | controller | changed: [instance] 2026-02-24 15:58:59.745955 | controller | 2026-02-24 15:58:59.746105 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2026-02-24 15:58:59.746244 | controller | Tuesday 24 February 2026 15:58:59 +0000 (0:00:00.461) 0:02:57.684 ****** 2026-02-24 15:59:00.933604 | controller | changed: [instance] 2026-02-24 15:59:00.933826 | controller | 2026-02-24 15:59:00.933973 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 15:59:00.934102 | controller | Tuesday 24 February 2026 15:59:00 +0000 (0:00:01.187) 0:02:58.871 ****** 2026-02-24 15:59:00.973751 | controller | skipping: [instance] 2026-02-24 15:59:00.973930 | controller | 2026-02-24 15:59:00.974075 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2026-02-24 15:59:00.974208 | controller | Tuesday 24 February 2026 15:59:00 +0000 (0:00:00.041) 0:02:58.912 ****** 2026-02-24 15:59:01.030645 | controller | skipping: [instance] 2026-02-24 15:59:01.030815 | controller | 2026-02-24 15:59:01.030963 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2026-02-24 15:59:01.031097 | controller | Tuesday 24 February 2026 15:59:01 +0000 (0:00:00.057) 0:02:58.969 ****** 2026-02-24 15:59:01.086983 | controller | skipping: [instance] 2026-02-24 15:59:01.087117 | controller | 2026-02-24 15:59:01.087245 | controller | TASK [Create VBMC entity] ****************************************************** 2026-02-24 15:59:01.087378 | controller | Tuesday 24 February 2026 15:59:01 +0000 (0:00:00.056) 0:02:59.025 ****** 2026-02-24 15:59:01.172888 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 15:59:01.172987 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 15:59:01.173104 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 15:59:01.173213 | controller | skipping: [instance] 2026-02-24 15:59:01.173317 | controller | 2026-02-24 15:59:01.173455 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2026-02-24 15:59:01.173575 | controller | Tuesday 24 February 2026 15:59:01 +0000 (0:00:00.085) 0:02:59.111 ****** 2026-02-24 15:59:01.455727 | controller | ok: [instance] 2026-02-24 15:59:01.455849 | controller | 2026-02-24 15:59:01.455975 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2026-02-24 15:59:01.456103 | controller | Tuesday 24 February 2026 15:59:01 +0000 (0:00:00.282) 0:02:59.394 ****** 2026-02-24 15:59:01.866718 | controller | changed: [instance] 2026-02-24 15:59:01.866886 | controller | 2026-02-24 15:59:01.867021 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2026-02-24 15:59:01.867137 | controller | Tuesday 24 February 2026 15:59:01 +0000 (0:00:00.410) 0:02:59.804 ****** 2026-02-24 15:59:01.911168 | controller | skipping: [instance] 2026-02-24 15:59:01.911298 | controller | 2026-02-24 15:59:01.911426 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2026-02-24 15:59:01.911568 | controller | Tuesday 24 February 2026 15:59:01 +0000 (0:00:00.044) 0:02:59.849 ****** 2026-02-24 15:59:01.957695 | controller | skipping: [instance] 2026-02-24 15:59:01.957840 | controller | 2026-02-24 15:59:01.957968 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2026-02-24 15:59:01.958097 | controller | Tuesday 24 February 2026 15:59:01 +0000 (0:00:00.046) 0:02:59.896 ****** 2026-02-24 15:59:01.997742 | controller | skipping: [instance] 2026-02-24 15:59:01.997873 | controller | 2026-02-24 15:59:01.997990 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2026-02-24 15:59:01.998100 | controller | Tuesday 24 February 2026 15:59:01 +0000 (0:00:00.040) 0:02:59.936 ****** 2026-02-24 15:59:02.748508 | controller | changed: [instance] 2026-02-24 15:59:03.432269 | controller | 2026-02-24 15:59:03.432316 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2026-02-24 15:59:03.432325 | controller | Tuesday 24 February 2026 15:59:02 +0000 (0:00:00.749) 0:03:00.686 ****** 2026-02-24 15:59:03.432339 | controller | changed: [instance] 2026-02-24 15:59:03.432499 | controller | 2026-02-24 15:59:03.432513 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2026-02-24 15:59:03.432602 | controller | Tuesday 24 February 2026 15:59:03 +0000 (0:00:00.683) 0:03:01.370 ****** 2026-02-24 15:59:03.489027 | controller | skipping: [instance] 2026-02-24 15:59:03.489069 | controller | 2026-02-24 15:59:03.489263 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2026-02-24 15:59:03.489295 | controller | Tuesday 24 February 2026 15:59:03 +0000 (0:00:00.056) 0:03:01.427 ****** 2026-02-24 15:59:03.563572 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2026-02-24 15:59:03.563696 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2026-02-24 15:59:03.564001 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2026-02-24 15:59:03.564059 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2026-02-24 15:59:03.564155 | controller | 2026-02-24 15:59:03.564279 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2026-02-24 15:59:03.564327 | controller | Tuesday 24 February 2026 15:59:03 +0000 (0:00:00.074) 0:03:01.502 ****** 2026-02-24 15:59:03.613585 | controller | skipping: [instance] 2026-02-24 15:59:03.613647 | controller | 2026-02-24 15:59:03.613802 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2026-02-24 15:59:03.613902 | controller | Tuesday 24 February 2026 15:59:03 +0000 (0:00:00.050) 0:03:01.552 ****** 2026-02-24 15:59:03.653319 | controller | skipping: [instance] 2026-02-24 15:59:03.653355 | controller | 2026-02-24 15:59:03.653501 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2026-02-24 15:59:03.653567 | controller | Tuesday 24 February 2026 15:59:03 +0000 (0:00:00.039) 0:03:01.592 ****** 2026-02-24 15:59:03.692226 | controller | skipping: [instance] 2026-02-24 15:59:03.692424 | controller | 2026-02-24 15:59:03.692639 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2026-02-24 15:59:03.692738 | controller | Tuesday 24 February 2026 15:59:03 +0000 (0:00:00.038) 0:03:01.630 ****** 2026-02-24 15:59:03.737110 | controller | skipping: [instance] 2026-02-24 15:59:03.737160 | controller | 2026-02-24 15:59:03.737248 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2026-02-24 15:59:03.737333 | controller | Tuesday 24 February 2026 15:59:03 +0000 (0:00:00.045) 0:03:01.675 ****** 2026-02-24 15:59:04.411868 | controller | changed: [instance] 2026-02-24 15:59:04.411928 | controller | 2026-02-24 15:59:04.411945 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2026-02-24 15:59:04.412054 | controller | Tuesday 24 February 2026 15:59:04 +0000 (0:00:00.673) 0:03:02.349 ****** 2026-02-24 15:59:04.454875 | controller | skipping: [instance] 2026-02-24 15:59:04.455013 | controller | 2026-02-24 15:59:04.455085 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2026-02-24 15:59:04.455117 | controller | Tuesday 24 February 2026 15:59:04 +0000 (0:00:00.043) 0:03:02.393 ****** 2026-02-24 15:59:04.493685 | controller | skipping: [instance] 2026-02-24 15:59:04.493745 | controller | 2026-02-24 15:59:04.493879 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2026-02-24 15:59:04.494047 | controller | Tuesday 24 February 2026 15:59:04 +0000 (0:00:00.039) 0:03:02.432 ****** 2026-02-24 15:59:04.537877 | controller | skipping: [instance] 2026-02-24 15:59:04.584504 | controller | 2026-02-24 15:59:04.584537 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-24 15:59:04.584548 | controller | Tuesday 24 February 2026 15:59:04 +0000 (0:00:00.043) 0:03:02.476 ****** 2026-02-24 15:59:04.584561 | controller | skipping: [instance] 2026-02-24 15:59:04.616622 | controller | 2026-02-24 15:59:04.616639 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-24 15:59:04.616646 | controller | Tuesday 24 February 2026 15:59:04 +0000 (0:00:00.046) 0:03:02.522 ****** 2026-02-24 15:59:04.616654 | controller | skipping: [instance] 2026-02-24 15:59:04.649716 | controller | 2026-02-24 15:59:04.649740 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-24 15:59:04.649750 | controller | Tuesday 24 February 2026 15:59:04 +0000 (0:00:00.032) 0:03:02.555 ****** 2026-02-24 15:59:04.649762 | controller | skipping: [instance] 2026-02-24 15:59:04.681987 | controller | 2026-02-24 15:59:04.682087 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-24 15:59:04.682101 | controller | Tuesday 24 February 2026 15:59:04 +0000 (0:00:00.032) 0:03:02.588 ****** 2026-02-24 15:59:04.682132 | controller | skipping: [instance] 2026-02-24 15:59:04.682245 | controller | 2026-02-24 15:59:04.682258 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-24 15:59:04.717931 | controller | Tuesday 24 February 2026 15:59:04 +0000 (0:00:00.032) 0:03:02.620 ****** 2026-02-24 15:59:04.717987 | controller | skipping: [instance] 2026-02-24 15:59:04.750633 | controller | 2026-02-24 15:59:04.750676 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-24 15:59:04.750686 | controller | Tuesday 24 February 2026 15:59:04 +0000 (0:00:00.035) 0:03:02.656 ****** 2026-02-24 15:59:04.750702 | controller | skipping: [instance] 2026-02-24 15:59:04.750868 | controller | 2026-02-24 15:59:04.751095 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-24 15:59:04.751297 | controller | Tuesday 24 February 2026 15:59:04 +0000 (0:00:00.033) 0:03:02.689 ****** 2026-02-24 15:59:04.797628 | controller | skipping: [instance] 2026-02-24 15:59:04.797853 | controller | 2026-02-24 15:59:04.798036 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2026-02-24 15:59:04.798205 | controller | Tuesday 24 February 2026 15:59:04 +0000 (0:00:00.046) 0:03:02.735 ****** 2026-02-24 15:59:04.833610 | controller | skipping: [instance] 2026-02-24 15:59:04.833761 | controller | 2026-02-24 15:59:04.833942 | controller | TASK [reproducer : Configure Controller node] ********************************** 2026-02-24 15:59:04.834088 | controller | Tuesday 24 February 2026 15:59:04 +0000 (0:00:00.036) 0:03:02.772 ****** 2026-02-24 15:59:04.993262 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2026-02-24 15:59:04.993564 | controller | 2026-02-24 15:59:04.993785 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-24 15:59:04.993921 | controller | Tuesday 24 February 2026 15:59:04 +0000 (0:00:00.159) 0:03:02.931 ****** 2026-02-24 15:59:06.411949 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-24 15:59:06.412013 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-24 15:59:06.412023 | controller | 2026-02-24 15:59:06.412033 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-24 15:59:06.412197 | controller | Tuesday 24 February 2026 15:59:06 +0000 (0:00:01.417) 0:03:04.349 ****** 2026-02-24 15:59:06.437611 | controller | skipping: [instance] 2026-02-24 15:59:07.123673 | controller | 2026-02-24 15:59:07.123727 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-24 15:59:07.123736 | controller | Tuesday 24 February 2026 15:59:06 +0000 (0:00:00.026) 0:03:04.375 ****** 2026-02-24 15:59:07.123748 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:07.169943 | controller | 2026-02-24 15:59:07.170014 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-24 15:59:07.170024 | controller | Tuesday 24 February 2026 15:59:07 +0000 (0:00:00.685) 0:03:05.061 ****** 2026-02-24 15:59:07.170039 | controller | skipping: [instance] 2026-02-24 15:59:07.213918 | controller | 2026-02-24 15:59:07.213954 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-24 15:59:07.213964 | controller | Tuesday 24 February 2026 15:59:07 +0000 (0:00:00.046) 0:03:05.108 ****** 2026-02-24 15:59:07.213977 | controller | skipping: [instance] 2026-02-24 15:59:07.259345 | controller | 2026-02-24 15:59:07.259367 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-24 15:59:07.259375 | controller | Tuesday 24 February 2026 15:59:07 +0000 (0:00:00.043) 0:03:05.152 ****** 2026-02-24 15:59:07.259384 | controller | skipping: [instance] 2026-02-24 15:59:07.316874 | controller | 2026-02-24 15:59:07.316909 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-24 15:59:07.316927 | controller | Tuesday 24 February 2026 15:59:07 +0000 (0:00:00.042) 0:03:05.194 ****** 2026-02-24 15:59:07.316941 | controller | skipping: [instance] 2026-02-24 15:59:07.317070 | controller | 2026-02-24 15:59:07.317117 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2026-02-24 15:59:07.317135 | controller | Tuesday 24 February 2026 15:59:07 +0000 (0:00:00.059) 0:03:05.254 ****** 2026-02-24 15:59:07.363999 | controller | skipping: [instance] 2026-02-24 15:59:07.364659 | controller | 2026-02-24 15:59:07.413474 | controller | TASK [reproducer : Install repos] ********************************************** 2026-02-24 15:59:07.413517 | controller | Tuesday 24 February 2026 15:59:07 +0000 (0:00:00.048) 0:03:05.302 ****** 2026-02-24 15:59:07.413531 | controller | skipping: [instance] 2026-02-24 15:59:07.413590 | controller | 2026-02-24 15:59:07.413602 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2026-02-24 15:59:07.454486 | controller | Tuesday 24 February 2026 15:59:07 +0000 (0:00:00.049) 0:03:05.351 ****** 2026-02-24 15:59:07.454526 | controller | skipping: [instance] 2026-02-24 15:59:07.454557 | controller | 2026-02-24 15:59:07.454671 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2026-02-24 15:59:07.454786 | controller | Tuesday 24 February 2026 15:59:07 +0000 (0:00:00.041) 0:03:05.393 ****** 2026-02-24 15:59:07.495162 | controller | skipping: [instance] 2026-02-24 15:59:07.495261 | controller | 2026-02-24 15:59:07.495274 | controller | TASK [reproducer : Install some tools] ***************************************** 2026-02-24 15:59:07.495380 | controller | Tuesday 24 February 2026 15:59:07 +0000 (0:00:00.040) 0:03:05.433 ****** 2026-02-24 15:59:08.743017 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:08.743093 | controller | 2026-02-24 15:59:08.743108 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2026-02-24 15:59:09.925903 | controller | Tuesday 24 February 2026 15:59:08 +0000 (0:00:01.247) 0:03:06.680 ****** 2026-02-24 15:59:09.925975 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:09.926008 | controller | 2026-02-24 15:59:09.926017 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2026-02-24 15:59:09.926244 | controller | Tuesday 24 February 2026 15:59:09 +0000 (0:00:01.182) 0:03:07.863 ****** 2026-02-24 15:59:10.636431 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:11.843927 | controller | 2026-02-24 15:59:11.843973 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2026-02-24 15:59:11.843982 | controller | Tuesday 24 February 2026 15:59:10 +0000 (0:00:00.710) 0:03:08.574 ****** 2026-02-24 15:59:11.844002 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:13.020101 | controller | 2026-02-24 15:59:13.020142 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2026-02-24 15:59:13.020151 | controller | Tuesday 24 February 2026 15:59:11 +0000 (0:00:01.207) 0:03:09.781 ****** 2026-02-24 15:59:13.020163 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-24 15:59:13.767631 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 15:59:13.767681 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 15:59:13.767688 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 15:59:13.767709 | controller | 2026-02-24 15:59:13.767715 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2026-02-24 15:59:13.767721 | controller | Tuesday 24 February 2026 15:59:13 +0000 (0:00:01.175) 0:03:10.956 ****** 2026-02-24 15:59:13.767734 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-24 15:59:15.589270 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 15:59:15.589311 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 15:59:15.589318 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 15:59:15.589324 | controller | 2026-02-24 15:59:15.589330 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2026-02-24 15:59:15.589336 | controller | Tuesday 24 February 2026 15:59:13 +0000 (0:00:00.745) 0:03:11.701 ****** 2026-02-24 15:59:15.589348 | controller | skipping: [instance] => (item=instance) 2026-02-24 15:59:16.234624 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2026-02-24 15:59:16.234671 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-24 15:59:16.234679 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2026-02-24 15:59:16.234685 | controller | 2026-02-24 15:59:16.234691 | controller | TASK [reproducer : Create kube directory] ************************************** 2026-02-24 15:59:16.234697 | controller | Tuesday 24 February 2026 15:59:15 +0000 (0:00:01.825) 0:03:13.526 ****** 2026-02-24 15:59:16.234709 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:17.349745 | controller | 2026-02-24 15:59:17.349804 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2026-02-24 15:59:17.349813 | controller | Tuesday 24 February 2026 15:59:16 +0000 (0:00:00.645) 0:03:14.172 ****** 2026-02-24 15:59:17.349846 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:18.369086 | controller | 2026-02-24 15:59:18.369133 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2026-02-24 15:59:18.369142 | controller | Tuesday 24 February 2026 15:59:17 +0000 (0:00:01.114) 0:03:15.287 ****** 2026-02-24 15:59:18.369166 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:18.403731 | controller | 2026-02-24 15:59:18.403799 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2026-02-24 15:59:18.403812 | controller | Tuesday 24 February 2026 15:59:18 +0000 (0:00:01.019) 0:03:16.306 ****** 2026-02-24 15:59:18.403840 | controller | skipping: [instance] 2026-02-24 15:59:18.404017 | controller | 2026-02-24 15:59:18.404184 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2026-02-24 15:59:18.404318 | controller | Tuesday 24 February 2026 15:59:18 +0000 (0:00:00.035) 0:03:16.342 ****** 2026-02-24 15:59:19.031273 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:19.641052 | controller | 2026-02-24 15:59:19.641102 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2026-02-24 15:59:19.641110 | controller | Tuesday 24 February 2026 15:59:19 +0000 (0:00:00.627) 0:03:16.969 ****** 2026-02-24 15:59:19.641123 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:19.685202 | controller | 2026-02-24 15:59:19.685222 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2026-02-24 15:59:19.685230 | controller | Tuesday 24 February 2026 15:59:19 +0000 (0:00:00.609) 0:03:17.578 ****** 2026-02-24 15:59:19.685239 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:19.759240 | controller | 2026-02-24 15:59:19.759265 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2026-02-24 15:59:19.759274 | controller | Tuesday 24 February 2026 15:59:19 +0000 (0:00:00.044) 0:03:17.623 ****** 2026-02-24 15:59:19.759287 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2026-02-24 15:59:19.818712 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2026-02-24 15:59:19.818734 | controller | 2026-02-24 15:59:19.818743 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-24 15:59:19.818750 | controller | Tuesday 24 February 2026 15:59:19 +0000 (0:00:00.073) 0:03:17.697 ****** 2026-02-24 15:59:19.818760 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 15:59:19.870132 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2026-02-24 15:59:19.870151 | controller | 2026-02-24 15:59:19.870158 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-24 15:59:19.870163 | controller | Tuesday 24 February 2026 15:59:19 +0000 (0:00:00.059) 0:03:17.757 ****** 2026-02-24 15:59:19.870171 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 15:59:19.921343 | controller | _secret_file: '' 2026-02-24 15:59:19.921365 | controller | 2026-02-24 15:59:19.921373 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-24 15:59:19.921378 | controller | Tuesday 24 February 2026 15:59:19 +0000 (0:00:00.051) 0:03:17.808 ****** 2026-02-24 15:59:19.921387 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 15:59:19.921559 | controller | _secret_content: my-default-location-place 2026-02-24 15:59:19.921687 | controller | 2026-02-24 15:59:19.921845 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-24 15:59:19.921997 | controller | Tuesday 24 February 2026 15:59:19 +0000 (0:00:00.051) 0:03:17.860 ****** 2026-02-24 15:59:19.981206 | controller | skipping: [instance] 2026-02-24 15:59:19.981404 | controller | 2026-02-24 15:59:19.981601 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-24 15:59:19.981805 | controller | Tuesday 24 February 2026 15:59:19 +0000 (0:00:00.059) 0:03:17.919 ****** 2026-02-24 15:59:20.031195 | controller | skipping: [instance] 2026-02-24 15:59:20.031330 | controller | 2026-02-24 15:59:20.031467 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-24 15:59:20.031598 | controller | Tuesday 24 February 2026 15:59:20 +0000 (0:00:00.049) 0:03:17.969 ****** 2026-02-24 15:59:20.086723 | controller | skipping: [instance] 2026-02-24 15:59:20.086878 | controller | 2026-02-24 15:59:20.087005 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-24 15:59:20.087125 | controller | Tuesday 24 February 2026 15:59:20 +0000 (0:00:00.055) 0:03:18.025 ****** 2026-02-24 15:59:21.111468 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:21.169286 | controller | 2026-02-24 15:59:21.169311 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-24 15:59:21.169321 | controller | Tuesday 24 February 2026 15:59:21 +0000 (0:00:01.022) 0:03:19.048 ****** 2026-02-24 15:59:21.169333 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 15:59:21.220601 | controller | _secret_dest: /home/zuul/ipmi-things 2026-02-24 15:59:21.220626 | controller | 2026-02-24 15:59:21.220636 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-24 15:59:21.220644 | controller | Tuesday 24 February 2026 15:59:21 +0000 (0:00:00.059) 0:03:19.107 ****** 2026-02-24 15:59:21.220655 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 15:59:21.277993 | controller | _secret_file: /tmp/ipmi-things 2026-02-24 15:59:21.278011 | controller | 2026-02-24 15:59:21.278019 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-24 15:59:21.278025 | controller | Tuesday 24 February 2026 15:59:21 +0000 (0:00:00.051) 0:03:19.158 ****** 2026-02-24 15:59:21.278033 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 15:59:21.337390 | controller | _secret_content: '' 2026-02-24 15:59:21.337412 | controller | 2026-02-24 15:59:21.337428 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-24 15:59:21.337435 | controller | Tuesday 24 February 2026 15:59:21 +0000 (0:00:00.056) 0:03:19.215 ****** 2026-02-24 15:59:21.337444 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2026-02-24 15:59:21.949752 | controller | msg: All assertions passed 2026-02-24 15:59:21.949800 | controller | 2026-02-24 15:59:21.949808 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-24 15:59:21.949814 | controller | Tuesday 24 February 2026 15:59:21 +0000 (0:00:00.059) 0:03:19.275 ****** 2026-02-24 15:59:21.949823 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:22.957995 | controller | 2026-02-24 15:59:22.958037 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-24 15:59:22.958046 | controller | Tuesday 24 February 2026 15:59:21 +0000 (0:00:00.611) 0:03:19.886 ****** 2026-02-24 15:59:22.958058 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:23.015478 | controller | 2026-02-24 15:59:23.015503 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-24 15:59:23.015513 | controller | Tuesday 24 February 2026 15:59:22 +0000 (0:00:01.007) 0:03:20.894 ****** 2026-02-24 15:59:23.015526 | controller | skipping: [instance] 2026-02-24 15:59:23.616180 | controller | 2026-02-24 15:59:23.616217 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2026-02-24 15:59:23.616226 | controller | Tuesday 24 February 2026 15:59:23 +0000 (0:00:00.059) 0:03:20.953 ****** 2026-02-24 15:59:23.616238 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:24.259957 | controller | 2026-02-24 15:59:24.260013 | controller | TASK [reproducer : Check if async file is still available] ********************* 2026-02-24 15:59:24.260022 | controller | Tuesday 24 February 2026 15:59:23 +0000 (0:00:00.599) 0:03:21.553 ****** 2026-02-24 15:59:24.260035 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 15:59:24.260052 | controller | 2026-02-24 15:59:24.260058 | controller | TASK [reproducer : Check package install status] ******************************* 2026-02-24 15:59:24.260118 | controller | Tuesday 24 February 2026 15:59:24 +0000 (0:00:00.644) 0:03:22.198 ****** 2026-02-24 16:00:14.849254 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2026-02-24 16:00:14.849341 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2026-02-24 16:00:14.849834 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2026-02-24 16:00:14.849858 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2026-02-24 16:00:14.851278 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2026-02-24 16:00:14.851304 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2026-02-24 16:00:14.851311 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2026-02-24 16:00:14.851316 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2026-02-24 16:00:14.851325 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2026-02-24 16:00:15.498635 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:15.498694 | controller | 2026-02-24 16:00:15.498702 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2026-02-24 16:00:15.498708 | controller | Tuesday 24 February 2026 16:00:14 +0000 (0:00:50.587) 0:04:12.785 ****** 2026-02-24 16:00:15.498724 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:18.280760 | controller | 2026-02-24 16:00:18.280819 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2026-02-24 16:00:18.280829 | controller | Tuesday 24 February 2026 16:00:15 +0000 (0:00:00.644) 0:04:13.430 ****** 2026-02-24 16:00:18.280846 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:18.331675 | controller | 2026-02-24 16:00:18.331786 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2026-02-24 16:00:18.331799 | controller | Tuesday 24 February 2026 16:00:18 +0000 (0:00:02.788) 0:04:16.218 ****** 2026-02-24 16:00:18.331819 | controller | skipping: [instance] 2026-02-24 16:00:18.331859 | controller | 2026-02-24 16:00:18.331865 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2026-02-24 16:00:18.331873 | controller | Tuesday 24 February 2026 16:00:18 +0000 (0:00:00.051) 0:04:16.270 ****** 2026-02-24 16:00:18.383438 | controller | skipping: [instance] 2026-02-24 16:00:19.127013 | controller | 2026-02-24 16:00:19.127062 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2026-02-24 16:00:19.127071 | controller | Tuesday 24 February 2026 16:00:18 +0000 (0:00:00.051) 0:04:16.321 ****** 2026-02-24 16:00:19.127084 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:19.743378 | controller | 2026-02-24 16:00:19.743424 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2026-02-24 16:00:19.743434 | controller | Tuesday 24 February 2026 16:00:19 +0000 (0:00:00.739) 0:04:17.061 ****** 2026-02-24 16:00:19.743446 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:20.107700 | controller | 2026-02-24 16:00:20.107737 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2026-02-24 16:00:20.107745 | controller | Tuesday 24 February 2026 16:00:19 +0000 (0:00:00.620) 0:04:17.681 ****** 2026-02-24 16:00:20.107756 | controller | changed: [instance] 2026-02-24 16:00:20.814276 | controller | 2026-02-24 16:00:20.814317 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2026-02-24 16:00:20.814326 | controller | Tuesday 24 February 2026 16:00:20 +0000 (0:00:00.364) 0:04:18.045 ****** 2026-02-24 16:00:20.814338 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:21.981305 | controller | 2026-02-24 16:00:21.981342 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2026-02-24 16:00:21.981350 | controller | Tuesday 24 February 2026 16:00:20 +0000 (0:00:00.706) 0:04:18.752 ****** 2026-02-24 16:00:21.981362 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:22.031419 | controller | 2026-02-24 16:00:22.031449 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 16:00:22.031467 | controller | Tuesday 24 February 2026 16:00:21 +0000 (0:00:01.167) 0:04:19.919 ****** 2026-02-24 16:00:22.031479 | controller | skipping: [instance] 2026-02-24 16:00:22.088339 | controller | 2026-02-24 16:00:22.088368 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 16:00:22.088378 | controller | Tuesday 24 February 2026 16:00:22 +0000 (0:00:00.050) 0:04:19.969 ****** 2026-02-24 16:00:22.088390 | controller | skipping: [instance] 2026-02-24 16:00:22.135993 | controller | 2026-02-24 16:00:22.136017 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 16:00:22.136025 | controller | Tuesday 24 February 2026 16:00:22 +0000 (0:00:00.056) 0:04:20.026 ****** 2026-02-24 16:00:22.136036 | controller | skipping: [instance] 2026-02-24 16:00:22.199610 | controller | 2026-02-24 16:00:22.199638 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2026-02-24 16:00:22.199648 | controller | Tuesday 24 February 2026 16:00:22 +0000 (0:00:00.047) 0:04:20.074 ****** 2026-02-24 16:00:22.199660 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:22.244951 | controller | 2026-02-24 16:00:22.244977 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2026-02-24 16:00:22.244986 | controller | Tuesday 24 February 2026 16:00:22 +0000 (0:00:00.063) 0:04:20.138 ****** 2026-02-24 16:00:22.244997 | controller | skipping: [instance] 2026-02-24 16:00:22.291347 | controller | 2026-02-24 16:00:22.291368 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2026-02-24 16:00:22.291375 | controller | Tuesday 24 February 2026 16:00:22 +0000 (0:00:00.045) 0:04:20.183 ****** 2026-02-24 16:00:22.291390 | controller | skipping: [instance] 2026-02-24 16:00:22.349251 | controller | 2026-02-24 16:00:22.349278 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2026-02-24 16:00:22.349286 | controller | Tuesday 24 February 2026 16:00:22 +0000 (0:00:00.046) 0:04:20.229 ****** 2026-02-24 16:00:22.349296 | controller | skipping: [instance] 2026-02-24 16:00:22.972909 | controller | 2026-02-24 16:00:22.972950 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2026-02-24 16:00:22.972958 | controller | Tuesday 24 February 2026 16:00:22 +0000 (0:00:00.057) 0:04:20.287 ****** 2026-02-24 16:00:22.972968 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:23.096918 | controller | 2026-02-24 16:00:23.096945 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2026-02-24 16:00:23.096953 | controller | Tuesday 24 February 2026 16:00:22 +0000 (0:00:00.623) 0:04:20.910 ****** 2026-02-24 16:00:23.096962 | controller | skipping: [instance] => (item=secret) 2026-02-24 16:00:24.143805 | controller | skipping: [instance] => (item=configmap) 2026-02-24 16:00:24.143849 | controller | skipping: [instance] => (item=pod) 2026-02-24 16:00:24.143857 | controller | skipping: [instance] => (item=service) 2026-02-24 16:00:24.143862 | controller | skipping: [instance] => (item=route) 2026-02-24 16:00:24.143867 | controller | skipping: [instance] 2026-02-24 16:00:24.143873 | controller | 2026-02-24 16:00:24.143879 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2026-02-24 16:00:24.143884 | controller | Tuesday 24 February 2026 16:00:23 +0000 (0:00:00.123) 0:04:21.034 ****** 2026-02-24 16:00:24.143894 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:24.143955 | controller | 2026-02-24 16:00:24.143973 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2026-02-24 16:00:25.186298 | controller | Tuesday 24 February 2026 16:00:24 +0000 (0:00:01.047) 0:04:22.082 ****** 2026-02-24 16:00:25.186370 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:25.229533 | controller | 2026-02-24 16:00:25.229603 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2026-02-24 16:00:25.229613 | controller | Tuesday 24 February 2026 16:00:25 +0000 (0:00:01.037) 0:04:23.119 ****** 2026-02-24 16:00:25.229624 | controller | skipping: [instance] 2026-02-24 16:00:25.268753 | controller | 2026-02-24 16:00:25.268790 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2026-02-24 16:00:25.268799 | controller | Tuesday 24 February 2026 16:00:25 +0000 (0:00:00.047) 0:04:23.167 ****** 2026-02-24 16:00:25.268808 | controller | skipping: [instance] 2026-02-24 16:00:25.350603 | controller | 2026-02-24 16:00:25.350673 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2026-02-24 16:00:25.350682 | controller | Tuesday 24 February 2026 16:00:25 +0000 (0:00:00.040) 0:04:23.207 ****** 2026-02-24 16:00:25.350696 | controller | skipping: [instance] => (item=secret) 2026-02-24 16:00:25.390156 | controller | skipping: [instance] => (item=configmap) 2026-02-24 16:00:25.390198 | controller | skipping: [instance] => (item=service) 2026-02-24 16:00:25.390208 | controller | skipping: [instance] => (item=route) 2026-02-24 16:00:25.390216 | controller | skipping: [instance] 2026-02-24 16:00:25.390225 | controller | 2026-02-24 16:00:25.390232 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2026-02-24 16:00:25.390240 | controller | Tuesday 24 February 2026 16:00:25 +0000 (0:00:00.080) 0:04:23.287 ****** 2026-02-24 16:00:25.390250 | controller | skipping: [instance] 2026-02-24 16:00:25.390386 | controller | 2026-02-24 16:00:25.390546 | controller | TASK [podman : Ensure podman is installed] ************************************* 2026-02-24 16:00:25.390696 | controller | Tuesday 24 February 2026 16:00:25 +0000 (0:00:00.040) 0:04:23.328 ****** 2026-02-24 16:00:26.944958 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:27.720087 | controller | 2026-02-24 16:00:27.720147 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2026-02-24 16:00:27.720157 | controller | Tuesday 24 February 2026 16:00:26 +0000 (0:00:01.554) 0:04:24.882 ****** 2026-02-24 16:00:27.720170 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:27.768015 | controller | 2026-02-24 16:00:27.768047 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2026-02-24 16:00:27.768055 | controller | Tuesday 24 February 2026 16:00:27 +0000 (0:00:00.774) 0:04:25.657 ****** 2026-02-24 16:00:27.768066 | controller | skipping: [instance] 2026-02-24 16:00:27.812390 | controller | 2026-02-24 16:00:27.812410 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2026-02-24 16:00:27.812417 | controller | Tuesday 24 February 2026 16:00:27 +0000 (0:00:00.049) 0:04:25.706 ****** 2026-02-24 16:00:27.812426 | controller | skipping: [instance] 2026-02-24 16:00:27.866691 | controller | 2026-02-24 16:00:27.866712 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2026-02-24 16:00:27.866719 | controller | Tuesday 24 February 2026 16:00:27 +0000 (0:00:00.044) 0:04:25.751 ****** 2026-02-24 16:00:27.866728 | controller | skipping: [instance] 2026-02-24 16:00:38.372542 | controller | 2026-02-24 16:00:38.372615 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2026-02-24 16:00:38.372625 | controller | Tuesday 24 February 2026 16:00:27 +0000 (0:00:00.053) 0:04:25.804 ****** 2026-02-24 16:00:38.372640 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:39.964668 | controller | 2026-02-24 16:00:39.964724 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2026-02-24 16:00:39.964742 | controller | Tuesday 24 February 2026 16:00:38 +0000 (0:00:10.505) 0:04:36.310 ****** 2026-02-24 16:00:39.964756 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:41.211349 | controller | 2026-02-24 16:00:41.211401 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-24 16:00:41.211410 | controller | Tuesday 24 February 2026 16:00:39 +0000 (0:00:01.591) 0:04:37.901 ****** 2026-02-24 16:00:41.211424 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-24 16:00:41.262944 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-24 16:00:41.262979 | controller | 2026-02-24 16:00:41.262987 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2026-02-24 16:00:41.262993 | controller | Tuesday 24 February 2026 16:00:41 +0000 (0:00:01.247) 0:04:39.148 ****** 2026-02-24 16:00:41.263011 | controller | skipping: [instance] 2026-02-24 16:00:41.914748 | controller | 2026-02-24 16:00:41.914815 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2026-02-24 16:00:41.914825 | controller | Tuesday 24 February 2026 16:00:41 +0000 (0:00:00.052) 0:04:39.201 ****** 2026-02-24 16:00:41.914839 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:41.964301 | controller | 2026-02-24 16:00:41.964335 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2026-02-24 16:00:41.964344 | controller | Tuesday 24 February 2026 16:00:41 +0000 (0:00:00.645) 0:04:39.846 ****** 2026-02-24 16:00:41.964356 | controller | skipping: [instance] 2026-02-24 16:00:42.018295 | controller | 2026-02-24 16:00:42.018317 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2026-02-24 16:00:42.018325 | controller | Tuesday 24 February 2026 16:00:41 +0000 (0:00:00.056) 0:04:39.902 ****** 2026-02-24 16:00:42.018335 | controller | skipping: [instance] 2026-02-24 16:00:42.018657 | controller | 2026-02-24 16:00:42.065480 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-24 16:00:42.065499 | controller | Tuesday 24 February 2026 16:00:42 +0000 (0:00:00.054) 0:04:39.957 ****** 2026-02-24 16:00:42.065510 | controller | skipping: [instance] 2026-02-24 16:00:42.106689 | controller | 2026-02-24 16:00:42.106714 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-24 16:00:42.106722 | controller | Tuesday 24 February 2026 16:00:42 +0000 (0:00:00.047) 0:04:40.004 ****** 2026-02-24 16:00:42.106732 | controller | skipping: [instance] 2026-02-24 16:00:42.244114 | controller | 2026-02-24 16:00:42.244137 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2026-02-24 16:00:42.244145 | controller | Tuesday 24 February 2026 16:00:42 +0000 (0:00:00.041) 0:04:40.045 ****** 2026-02-24 16:00:42.244154 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) 2026-02-24 16:00:43.510707 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) 2026-02-24 16:00:43.510777 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) 2026-02-24 16:00:43.510789 | controller | 2026-02-24 16:00:43.510797 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2026-02-24 16:00:43.510804 | controller | Tuesday 24 February 2026 16:00:42 +0000 (0:00:00.137) 0:04:40.182 ****** 2026-02-24 16:00:43.510816 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:43.560541 | controller | 2026-02-24 16:00:43.560568 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2026-02-24 16:00:43.560576 | controller | Tuesday 24 February 2026 16:00:43 +0000 (0:00:01.265) 0:04:41.448 ****** 2026-02-24 16:00:43.560588 | controller | skipping: [instance] 2026-02-24 16:00:43.709234 | controller | 2026-02-24 16:00:43.709265 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2026-02-24 16:00:43.709275 | controller | Tuesday 24 February 2026 16:00:43 +0000 (0:00:00.050) 0:04:41.498 ****** 2026-02-24 16:00:43.709288 | controller | 2026-02-24 16:00:43.768293 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2026-02-24 16:00:43.768336 | controller | Tuesday 24 February 2026 16:00:43 +0000 (0:00:00.148) 0:04:41.647 ****** 2026-02-24 16:00:43.768355 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:43.831438 | controller | 2026-02-24 16:00:43.831471 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-24 16:00:43.831480 | controller | Tuesday 24 February 2026 16:00:43 +0000 (0:00:00.059) 0:04:41.706 ****** 2026-02-24 16:00:43.831492 | controller | skipping: [instance] 2026-02-24 16:00:43.876384 | controller | 2026-02-24 16:00:43.876412 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-24 16:00:43.876428 | controller | Tuesday 24 February 2026 16:00:43 +0000 (0:00:00.060) 0:04:41.767 ****** 2026-02-24 16:00:43.876439 | controller | skipping: [instance] 2026-02-24 16:00:45.464177 | controller | 2026-02-24 16:00:45.464328 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2026-02-24 16:00:45.464349 | controller | Tuesday 24 February 2026 16:00:43 +0000 (0:00:00.047) 0:04:41.814 ****** 2026-02-24 16:00:45.464375 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:53.875245 | controller | 2026-02-24 16:00:53.875304 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2026-02-24 16:00:53.875313 | controller | Tuesday 24 February 2026 16:00:45 +0000 (0:00:01.586) 0:04:43.401 ****** 2026-02-24 16:00:53.875328 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1) 2026-02-24 16:00:53.987477 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b) 2026-02-24 16:00:53.987513 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282) 2026-02-24 16:00:53.987521 | controller | 2026-02-24 16:00:53.987526 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2026-02-24 16:00:53.987532 | controller | Tuesday 24 February 2026 16:00:53 +0000 (0:00:08.409) 0:04:51.810 ****** 2026-02-24 16:00:53.987550 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2026-02-24 16:00:54.224787 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2026-02-24 16:00:54.224819 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2026-02-24 16:00:54.224827 | controller | 2026-02-24 16:00:54.224832 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2026-02-24 16:00:54.224838 | controller | Tuesday 24 February 2026 16:00:53 +0000 (0:00:00.115) 0:04:51.925 ****** 2026-02-24 16:00:54.224848 | controller | ok: [instance -> localhost] 2026-02-24 16:00:56.394618 | controller | 2026-02-24 16:00:56.394697 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2026-02-24 16:00:56.394706 | controller | Tuesday 24 February 2026 16:00:54 +0000 (0:00:00.237) 0:04:52.163 ****** 2026-02-24 16:00:56.394720 | controller | changed: [instance -> localhost] => (item=controller-0) 2026-02-24 16:00:57.072659 | controller | 2026-02-24 16:00:57.072718 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2026-02-24 16:00:57.072727 | controller | Tuesday 24 February 2026 16:00:56 +0000 (0:00:02.168) 0:04:54.331 ****** 2026-02-24 16:00:57.072741 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:57.925849 | controller | 2026-02-24 16:00:57.925905 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2026-02-24 16:00:57.925916 | controller | Tuesday 24 February 2026 16:00:57 +0000 (0:00:00.677) 0:04:55.009 ****** 2026-02-24 16:00:57.925930 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:59.075074 | controller | 2026-02-24 16:00:59.075136 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2026-02-24 16:00:59.075145 | controller | Tuesday 24 February 2026 16:00:57 +0000 (0:00:00.854) 0:04:55.863 ****** 2026-02-24 16:00:59.075160 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:00:59.734293 | controller | 2026-02-24 16:00:59.734348 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2026-02-24 16:00:59.734357 | controller | Tuesday 24 February 2026 16:00:59 +0000 (0:00:01.149) 0:04:57.012 ****** 2026-02-24 16:00:59.734370 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:00.967447 | controller | 2026-02-24 16:01:00.967511 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2026-02-24 16:01:00.967525 | controller | Tuesday 24 February 2026 16:00:59 +0000 (0:00:00.658) 0:04:57.671 ****** 2026-02-24 16:01:00.967538 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:01.707340 | controller | 2026-02-24 16:01:01.707395 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2026-02-24 16:01:01.707404 | controller | Tuesday 24 February 2026 16:01:00 +0000 (0:00:01.233) 0:04:58.904 ****** 2026-02-24 16:01:01.707417 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:02.392806 | controller | 2026-02-24 16:01:02.392845 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2026-02-24 16:01:02.392853 | controller | Tuesday 24 February 2026 16:01:01 +0000 (0:00:00.740) 0:04:59.645 ****** 2026-02-24 16:01:02.392865 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:03.811908 | controller | 2026-02-24 16:01:03.811958 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2026-02-24 16:01:03.811967 | controller | Tuesday 24 February 2026 16:01:02 +0000 (0:00:00.685) 0:05:00.330 ****** 2026-02-24 16:01:03.811979 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-24 16:01:03.857515 | controller | 2026-02-24 16:01:03.857549 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 16:01:03.857558 | controller | Tuesday 24 February 2026 16:01:03 +0000 (0:00:01.418) 0:05:01.749 ****** 2026-02-24 16:01:03.857569 | controller | skipping: [instance] 2026-02-24 16:01:03.904152 | controller | 2026-02-24 16:01:03.904183 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 16:01:03.904191 | controller | Tuesday 24 February 2026 16:01:03 +0000 (0:00:00.046) 0:05:01.795 ****** 2026-02-24 16:01:03.904202 | controller | skipping: [instance] 2026-02-24 16:01:03.948969 | controller | 2026-02-24 16:01:03.948998 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 16:01:03.949006 | controller | Tuesday 24 February 2026 16:01:03 +0000 (0:00:00.046) 0:05:01.842 ****** 2026-02-24 16:01:03.949017 | controller | skipping: [instance] 2026-02-24 16:01:04.001570 | controller | 2026-02-24 16:01:04.001600 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 16:01:04.001609 | controller | Tuesday 24 February 2026 16:01:03 +0000 (0:00:00.044) 0:05:01.887 ****** 2026-02-24 16:01:04.001620 | controller | skipping: [instance] 2026-02-24 16:01:04.048574 | controller | 2026-02-24 16:01:04.048605 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 16:01:04.048620 | controller | Tuesday 24 February 2026 16:01:03 +0000 (0:00:00.052) 0:05:01.939 ****** 2026-02-24 16:01:04.048632 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:04.171353 | controller | 2026-02-24 16:01:04.171394 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 16:01:04.171402 | controller | Tuesday 24 February 2026 16:01:04 +0000 (0:00:00.046) 0:05:01.986 ****** 2026-02-24 16:01:04.171428 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-24 16:01:04.225950 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2026-02-24 16:01:04.225976 | controller | 2026-02-24 16:01:04.225984 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 16:01:04.225990 | controller | Tuesday 24 February 2026 16:01:04 +0000 (0:00:00.122) 0:05:02.109 ****** 2026-02-24 16:01:04.226002 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2026-02-24 16:01:07.929118 | controller | 2026-02-24 16:01:07.929186 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2026-02-24 16:01:07.929195 | controller | Tuesday 24 February 2026 16:01:04 +0000 (0:00:00.055) 0:05:02.164 ****** 2026-02-24 16:01:07.929209 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-24 16:01:09.133030 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2026-02-24 16:01:09.133080 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-24 16:01:09.133088 | controller | 2026-02-24 16:01:09.133095 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2026-02-24 16:01:09.133101 | controller | Tuesday 24 February 2026 16:01:07 +0000 (0:00:03.702) 0:05:05.866 ****** 2026-02-24 16:01:09.133112 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:09.660527 | controller | 2026-02-24 16:01:09.660577 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 16:01:09.660586 | controller | Tuesday 24 February 2026 16:01:09 +0000 (0:00:01.204) 0:05:07.070 ****** 2026-02-24 16:01:09.660606 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:10.868559 | controller | 2026-02-24 16:01:10.868610 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 16:01:10.868619 | controller | Tuesday 24 February 2026 16:01:09 +0000 (0:00:00.527) 0:05:07.598 ****** 2026-02-24 16:01:10.868633 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:10.971805 | controller | 2026-02-24 16:01:10.971844 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 16:01:10.971852 | controller | Tuesday 24 February 2026 16:01:10 +0000 (0:00:01.208) 0:05:08.806 ****** 2026-02-24 16:01:10.971864 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:11.047788 | controller | 2026-02-24 16:01:11.047820 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 16:01:11.047828 | controller | Tuesday 24 February 2026 16:01:10 +0000 (0:00:00.102) 0:05:08.909 ****** 2026-02-24 16:01:11.047839 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:12.117916 | controller | 2026-02-24 16:01:12.117977 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 16:01:12.117985 | controller | Tuesday 24 February 2026 16:01:11 +0000 (0:00:00.076) 0:05:08.985 ****** 2026-02-24 16:01:12.117999 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:13.044893 | controller | 2026-02-24 16:01:13.044946 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2026-02-24 16:01:13.044955 | controller | Tuesday 24 February 2026 16:01:12 +0000 (0:00:01.069) 0:05:10.055 ****** 2026-02-24 16:01:13.044968 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:19.100862 | controller | 2026-02-24 16:01:19.100918 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2026-02-24 16:01:19.100927 | controller | Tuesday 24 February 2026 16:01:13 +0000 (0:00:00.926) 0:05:10.982 ****** 2026-02-24 16:01:19.100939 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2026-02-24 16:01:19.315437 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:19.315481 | controller | 2026-02-24 16:01:19.315489 | controller | TASK [Configure ntp service] *************************************************** 2026-02-24 16:01:19.315495 | controller | Tuesday 24 February 2026 16:01:19 +0000 (0:00:06.056) 0:05:17.038 ****** 2026-02-24 16:01:19.315507 | controller | 2026-02-24 16:01:20.381162 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2026-02-24 16:01:20.381206 | controller | Tuesday 24 February 2026 16:01:19 +0000 (0:00:00.215) 0:05:17.253 ****** 2026-02-24 16:01:20.381219 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:21.386587 | controller | 2026-02-24 16:01:21.386639 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2026-02-24 16:01:21.386647 | controller | Tuesday 24 February 2026 16:01:20 +0000 (0:00:01.065) 0:05:18.319 ****** 2026-02-24 16:01:21.386660 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2026-02-24 16:01:22.343240 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2026-02-24 16:01:22.343291 | controller | 2026-02-24 16:01:22.343300 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2026-02-24 16:01:22.343306 | controller | Tuesday 24 February 2026 16:01:21 +0000 (0:00:01.005) 0:05:19.324 ****** 2026-02-24 16:01:22.343325 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:22.994840 | controller | 2026-02-24 16:01:22.994898 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2026-02-24 16:01:22.994907 | controller | Tuesday 24 February 2026 16:01:22 +0000 (0:00:00.956) 0:05:20.281 ****** 2026-02-24 16:01:22.994920 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:23.140283 | controller | 2026-02-24 16:01:23.140327 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2026-02-24 16:01:23.140335 | controller | Tuesday 24 February 2026 16:01:22 +0000 (0:00:00.651) 0:05:20.932 ****** 2026-02-24 16:01:23.140349 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2026-02-24 16:01:23.631255 | controller | 2026-02-24 16:01:23.631317 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2026-02-24 16:01:23.631325 | controller | Tuesday 24 February 2026 16:01:23 +0000 (0:00:00.145) 0:05:21.078 ****** 2026-02-24 16:01:23.631339 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:24.171639 | controller | 2026-02-24 16:01:24.171697 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2026-02-24 16:01:24.171705 | controller | Tuesday 24 February 2026 16:01:23 +0000 (0:00:00.490) 0:05:21.569 ****** 2026-02-24 16:01:24.171718 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-24 16:01:24.775853 | controller | 2026-02-24 16:01:24.775915 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2026-02-24 16:01:24.775925 | controller | Tuesday 24 February 2026 16:01:24 +0000 (0:00:00.536) 0:05:22.105 ****** 2026-02-24 16:01:24.775938 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-24 16:01:25.321588 | controller | 2026-02-24 16:01:25.321665 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2026-02-24 16:01:25.321674 | controller | Tuesday 24 February 2026 16:01:24 +0000 (0:00:00.607) 0:05:22.713 ****** 2026-02-24 16:01:25.321686 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-24 16:01:25.368816 | controller | 2026-02-24 16:01:25.368851 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2026-02-24 16:01:25.368860 | controller | Tuesday 24 February 2026 16:01:25 +0000 (0:00:00.545) 0:05:23.259 ****** 2026-02-24 16:01:25.368871 | controller | 2026-02-24 16:01:25.860815 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2026-02-24 16:01:25.860874 | controller | Tuesday 24 February 2026 16:01:25 +0000 (0:00:00.047) 0:05:23.307 ****** 2026-02-24 16:01:25.860888 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-24 16:01:26.672056 | controller | 2026-02-24 16:01:26.672114 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2026-02-24 16:01:26.672123 | controller | Tuesday 24 February 2026 16:01:25 +0000 (0:00:00.490) 0:05:23.798 ****** 2026-02-24 16:01:26.672136 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-24 16:01:26.713929 | controller | 2026-02-24 16:01:26.713969 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2026-02-24 16:01:26.713978 | controller | Tuesday 24 February 2026 16:01:26 +0000 (0:00:00.811) 0:05:24.609 ****** 2026-02-24 16:01:26.713990 | controller | skipping: [instance] 2026-02-24 16:01:26.756261 | controller | 2026-02-24 16:01:26.756284 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2026-02-24 16:01:26.756292 | controller | Tuesday 24 February 2026 16:01:26 +0000 (0:00:00.042) 0:05:24.652 ****** 2026-02-24 16:01:26.756302 | controller | skipping: [instance] 2026-02-24 16:01:27.023662 | controller | 2026-02-24 16:01:27.023714 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2026-02-24 16:01:27.023724 | controller | Tuesday 24 February 2026 16:01:26 +0000 (0:00:00.042) 0:05:24.694 ****** 2026-02-24 16:01:27.023746 | controller | changed: [instance] 2026-02-24 16:01:27.117114 | controller | 2026-02-24 16:01:27.117169 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2026-02-24 16:01:27.117179 | controller | Tuesday 24 February 2026 16:01:27 +0000 (0:00:00.266) 0:05:24.961 ****** 2026-02-24 16:01:27.117194 | controller | skipping: [instance] => (item=) 2026-02-24 16:01:27.162619 | controller | 2026-02-24 16:01:27.162659 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2026-02-24 16:01:27.162667 | controller | Tuesday 24 February 2026 16:01:27 +0000 (0:00:00.093) 0:05:25.054 ****** 2026-02-24 16:01:27.162681 | controller | ok: [instance] 2026-02-24 16:01:27.250147 | controller | 2026-02-24 16:01:27.250177 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 16:01:27.250187 | controller | Tuesday 24 February 2026 16:01:27 +0000 (0:00:00.045) 0:05:25.100 ****** 2026-02-24 16:01:27.250199 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-24 16:01:27.550584 | controller | 2026-02-24 16:01:27.550633 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 16:01:27.550649 | controller | Tuesday 24 February 2026 16:01:27 +0000 (0:00:00.087) 0:05:25.188 ****** 2026-02-24 16:01:27.550663 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-24 16:01:27.612838 | controller | 2026-02-24 16:01:27.612887 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2026-02-24 16:01:27.612896 | controller | Tuesday 24 February 2026 16:01:27 +0000 (0:00:00.299) 0:05:25.488 ****** 2026-02-24 16:01:27.612909 | controller | 2026-02-24 16:01:27.613130 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 16:01:27.613149 | controller | Tuesday 24 February 2026 16:01:27 +0000 (0:00:00.062) 0:05:25.550 ****** 2026-02-24 16:01:27.689857 | controller | ok: [instance] 2026-02-24 16:01:27.763243 | controller | 2026-02-24 16:01:27.763263 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 16:01:27.763278 | controller | Tuesday 24 February 2026 16:01:27 +0000 (0:00:00.077) 0:05:25.627 ****** 2026-02-24 16:01:27.763288 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-24 16:01:28.088891 | controller | 2026-02-24 16:01:28.088938 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 16:01:28.088947 | controller | Tuesday 24 February 2026 16:01:27 +0000 (0:00:00.073) 0:05:25.701 ****** 2026-02-24 16:01:28.088960 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-24 16:01:28.165859 | controller | 2026-02-24 16:01:28.165900 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 16:01:28.165909 | controller | Tuesday 24 February 2026 16:01:28 +0000 (0:00:00.324) 0:05:26.026 ****** 2026-02-24 16:01:28.165928 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-24 16:01:28.166408 | controller | skipping: [instance] 2026-02-24 16:01:28.639882 | controller | 2026-02-24 16:01:28.639933 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2026-02-24 16:01:28.639943 | controller | Tuesday 24 February 2026 16:01:28 +0000 (0:00:00.077) 0:05:26.104 ****** 2026-02-24 16:01:28.639957 | controller | changed: [instance] 2026-02-24 16:01:28.640359 | controller | 2026-02-24 16:01:28.640373 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-24 16:01:28.640383 | controller | Tuesday 24 February 2026 16:01:28 +0000 (0:00:00.460) 0:05:26.564 ****** 2026-02-24 16:01:29.445303 | controller | 2026-02-24 16:01:29.445364 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2026-02-24 16:01:29.445375 | controller | Tuesday 24 February 2026 16:01:28 +0000 (0:00:00.013) 0:05:26.577 ****** 2026-02-24 16:01:29.445389 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:29.882929 | controller | 2026-02-24 16:01:29.882992 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 16:01:29.883002 | controller | Tuesday 24 February 2026 16:01:29 +0000 (0:00:00.803) 0:05:27.381 ****** 2026-02-24 16:01:29.883017 | controller | changed: [instance] 2026-02-24 16:01:30.070937 | controller | 2026-02-24 16:01:30.070970 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2026-02-24 16:01:30.070979 | controller | Tuesday 24 February 2026 16:01:29 +0000 (0:00:00.439) 0:05:27.820 ****** 2026-02-24 16:01:30.070991 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 16:01:31.630690 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 16:01:31.630818 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2026-02-24 16:01:31.630833 | controller | 2026-02-24 16:01:31.630841 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2026-02-24 16:01:31.630849 | controller | Tuesday 24 February 2026 16:01:30 +0000 (0:00:00.188) 0:05:28.008 ****** 2026-02-24 16:01:31.630864 | controller | changed: [instance -> compute-0(compute-0.instance)] 2026-02-24 16:01:31.656322 | controller | 2026-02-24 16:01:31.656351 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-24 16:01:31.656359 | controller | Tuesday 24 February 2026 16:01:31 +0000 (0:00:01.559) 0:05:29.568 ****** 2026-02-24 16:01:31.656370 | controller | skipping: [instance] 2026-02-24 16:01:32.216639 | controller | 2026-02-24 16:01:32.216703 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-24 16:01:32.216712 | controller | Tuesday 24 February 2026 16:01:31 +0000 (0:00:00.026) 0:05:29.594 ****** 2026-02-24 16:01:32.216724 | controller | ok: [instance -> compute-0(compute-0.instance)] 2026-02-24 16:01:32.262652 | controller | 2026-02-24 16:01:32.262691 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-24 16:01:32.262700 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.559) 0:05:30.154 ****** 2026-02-24 16:01:32.262721 | controller | skipping: [instance] 2026-02-24 16:01:32.306576 | controller | 2026-02-24 16:01:32.306644 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-24 16:01:32.306654 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.046) 0:05:30.200 ****** 2026-02-24 16:01:32.306668 | controller | skipping: [instance] 2026-02-24 16:01:32.306705 | controller | 2026-02-24 16:01:32.345760 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-24 16:01:32.345822 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.044) 0:05:30.245 ****** 2026-02-24 16:01:32.345836 | controller | skipping: [instance] 2026-02-24 16:01:32.390788 | controller | 2026-02-24 16:01:32.390814 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-24 16:01:32.390823 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.039) 0:05:30.284 ****** 2026-02-24 16:01:32.390834 | controller | skipping: [instance] 2026-02-24 16:01:32.431515 | controller | 2026-02-24 16:01:32.431537 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2026-02-24 16:01:32.431546 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.045) 0:05:30.329 ****** 2026-02-24 16:01:32.431557 | controller | skipping: [instance] 2026-02-24 16:01:32.453929 | controller | 2026-02-24 16:01:32.453960 | controller | TASK [reproducer : Create repositories on computes] **************************** 2026-02-24 16:01:32.453970 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.040) 0:05:30.369 ****** 2026-02-24 16:01:32.453984 | controller | skipping: [instance] 2026-02-24 16:01:32.454047 | controller | 2026-02-24 16:01:32.454067 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2026-02-24 16:01:32.454080 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.022) 0:05:30.392 ****** 2026-02-24 16:01:32.483979 | controller | skipping: [instance] 2026-02-24 16:01:32.484058 | controller | 2026-02-24 16:01:32.484069 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2026-02-24 16:01:32.484161 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.030) 0:05:30.422 ****** 2026-02-24 16:01:32.539234 | controller | ok: [instance] 2026-02-24 16:01:32.642147 | controller | 2026-02-24 16:01:32.642170 | controller | TASK [reproducer : Push local code] ******************************************** 2026-02-24 16:01:32.642179 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.055) 0:05:30.477 ****** 2026-02-24 16:01:32.642190 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2026-02-24 16:01:32.682946 | controller | 2026-02-24 16:01:32.682968 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2026-02-24 16:01:32.682976 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.102) 0:05:30.580 ****** 2026-02-24 16:01:32.682985 | controller | skipping: [instance] 2026-02-24 16:01:32.683121 | controller | 2026-02-24 16:01:32.683259 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2026-02-24 16:01:32.683381 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.041) 0:05:30.621 ****** 2026-02-24 16:01:32.732495 | controller | skipping: [instance] 2026-02-24 16:01:32.781556 | controller | 2026-02-24 16:01:32.781574 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2026-02-24 16:01:32.781582 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.048) 0:05:30.670 ****** 2026-02-24 16:01:32.781591 | controller | skipping: [instance] 2026-02-24 16:01:32.781654 | controller | 2026-02-24 16:01:32.781789 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2026-02-24 16:01:32.781907 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.049) 0:05:30.720 ****** 2026-02-24 16:01:32.826801 | controller | skipping: [instance] 2026-02-24 16:01:32.826920 | controller | 2026-02-24 16:01:32.827039 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2026-02-24 16:01:32.827164 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.044) 0:05:30.765 ****** 2026-02-24 16:01:32.867910 | controller | skipping: [instance] 2026-02-24 16:01:32.867990 | controller | 2026-02-24 16:01:32.868098 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2026-02-24 16:01:32.868197 | controller | Tuesday 24 February 2026 16:01:32 +0000 (0:00:00.041) 0:05:30.806 ****** 2026-02-24 16:01:33.367574 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2026-02-24 16:01:33.367630 | controller | 2026-02-24 16:01:33.367738 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2026-02-24 16:01:33.367892 | controller | Tuesday 24 February 2026 16:01:33 +0000 (0:00:00.499) 0:05:31.305 ****** 2026-02-24 16:01:33.968874 | controller | ok: [instance -> localhost] => (item=ci-framework) 2026-02-24 16:01:33.968926 | controller | 2026-02-24 16:01:33.969012 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2026-02-24 16:01:33.969109 | controller | Tuesday 24 February 2026 16:01:33 +0000 (0:00:00.601) 0:05:31.907 ****** 2026-02-24 16:01:34.016571 | controller | skipping: [instance] => (item=ci-framework) 2026-02-24 16:01:34.016690 | controller | skipping: [instance] 2026-02-24 16:01:34.016916 | controller | 2026-02-24 16:01:34.017009 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2026-02-24 16:01:34.017132 | controller | Tuesday 24 February 2026 16:01:34 +0000 (0:00:00.048) 0:05:31.955 ****** 2026-02-24 16:01:34.098479 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2026-02-24 16:01:34.098654 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2026-02-24 16:01:34.099147 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2026-02-24 16:01:34.099171 | controller | 2026-02-24 16:01:34.619966 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2026-02-24 16:01:34.620034 | controller | Tuesday 24 February 2026 16:01:34 +0000 (0:00:00.081) 0:05:32.037 ****** 2026-02-24 16:01:34.620049 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:34.620071 | controller | 2026-02-24 16:01:34.620144 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2026-02-24 16:01:34.620233 | controller | Tuesday 24 February 2026 16:01:34 +0000 (0:00:00.521) 0:05:32.558 ****** 2026-02-24 16:01:34.661119 | controller | skipping: [instance] 2026-02-24 16:01:34.661203 | controller | 2026-02-24 16:01:34.661314 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2026-02-24 16:01:34.661421 | controller | Tuesday 24 February 2026 16:01:34 +0000 (0:00:00.041) 0:05:32.599 ****** 2026-02-24 16:01:35.180850 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:35.180948 | controller | 2026-02-24 16:01:35.181073 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2026-02-24 16:01:35.181186 | controller | Tuesday 24 February 2026 16:01:35 +0000 (0:00:00.519) 0:05:33.119 ****** 2026-02-24 16:01:35.235671 | controller | skipping: [instance] 2026-02-24 16:01:35.235743 | controller | 2026-02-24 16:01:35.235874 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2026-02-24 16:01:35.235970 | controller | Tuesday 24 February 2026 16:01:35 +0000 (0:00:00.055) 0:05:33.174 ****** 2026-02-24 16:01:35.728055 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:35.728114 | controller | 2026-02-24 16:01:35.728230 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2026-02-24 16:01:35.728326 | controller | Tuesday 24 February 2026 16:01:35 +0000 (0:00:00.492) 0:05:33.666 ****** 2026-02-24 16:01:38.124563 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:38.124624 | controller | 2026-02-24 16:01:38.124999 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2026-02-24 16:01:38.125036 | controller | Tuesday 24 February 2026 16:01:38 +0000 (0:00:02.396) 0:05:36.062 ****** 2026-02-24 16:01:58.366260 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:58.366672 | controller | 2026-02-24 16:01:58.366956 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2026-02-24 16:01:58.367113 | controller | Tuesday 24 February 2026 16:01:58 +0000 (0:00:20.235) 0:05:56.297 ****** 2026-02-24 16:01:59.469913 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:01:59.577194 | controller | 2026-02-24 16:01:59.577247 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2026-02-24 16:01:59.577257 | controller | Tuesday 24 February 2026 16:01:59 +0000 (0:00:01.109) 0:05:57.407 ****** 2026-02-24 16:01:59.577297 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2026-02-24 16:01:59.577403 | controller | 2026-02-24 16:01:59.577429 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2026-02-24 16:01:59.577469 | controller | Tuesday 24 February 2026 16:01:59 +0000 (0:00:00.108) 0:05:57.515 ****** 2026-02-24 16:02:00.081710 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:00.128928 | controller | 2026-02-24 16:02:00.128975 | controller | TASK [reproducer : Rotate log if present] ************************************** 2026-02-24 16:02:00.128985 | controller | Tuesday 24 February 2026 16:02:00 +0000 (0:00:00.503) 0:05:58.019 ****** 2026-02-24 16:02:00.128999 | controller | skipping: [instance] 2026-02-24 16:02:00.129178 | controller | 2026-02-24 16:02:00.129234 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2026-02-24 16:02:00.129253 | controller | Tuesday 24 February 2026 16:02:00 +0000 (0:00:00.047) 0:05:58.067 ****** 2026-02-24 16:02:00.183745 | controller | skipping: [instance] 2026-02-24 16:02:00.294228 | controller | 2026-02-24 16:02:00.294277 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2026-02-24 16:02:00.294290 | controller | Tuesday 24 February 2026 16:02:00 +0000 (0:00:00.054) 0:05:58.122 ****** 2026-02-24 16:02:00.294303 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:00.871495 | controller | 2026-02-24 16:02:00.871547 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-24 16:02:00.871556 | controller | Tuesday 24 February 2026 16:02:00 +0000 (0:00:00.110) 0:05:58.232 ****** 2026-02-24 16:02:00.871569 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:00.922522 | controller | 2026-02-24 16:02:00.922547 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-24 16:02:00.922555 | controller | Tuesday 24 February 2026 16:02:00 +0000 (0:00:00.576) 0:05:58.809 ****** 2026-02-24 16:02:00.922564 | controller | skipping: [instance] 2026-02-24 16:02:00.966726 | controller | 2026-02-24 16:02:00.966755 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-24 16:02:00.966763 | controller | Tuesday 24 February 2026 16:02:00 +0000 (0:00:00.051) 0:05:58.860 ****** 2026-02-24 16:02:00.966794 | controller | skipping: [instance] 2026-02-24 16:02:01.010723 | controller | 2026-02-24 16:02:01.010754 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-24 16:02:01.010762 | controller | Tuesday 24 February 2026 16:02:00 +0000 (0:00:00.044) 0:05:58.905 ****** 2026-02-24 16:02:01.010792 | controller | skipping: [instance] 2026-02-24 16:02:01.066995 | controller | 2026-02-24 16:02:01.067040 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-24 16:02:01.067049 | controller | Tuesday 24 February 2026 16:02:01 +0000 (0:00:00.043) 0:05:58.949 ****** 2026-02-24 16:02:01.067061 | controller | skipping: [instance] 2026-02-24 16:02:01.067189 | controller | 2026-02-24 16:02:01.067320 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-24 16:02:01.067351 | controller | Tuesday 24 February 2026 16:02:01 +0000 (0:00:00.056) 0:05:59.005 ****** 2026-02-24 16:02:02.621895 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:02:03.702195 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:02:03.702246 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:02:03.702254 | controller | changed: [instance -> controller-0] 2026-02-24 16:02:03.702260 | controller | 2026-02-24 16:02:03.702266 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-24 16:02:03.702271 | controller | Tuesday 24 February 2026 16:02:02 +0000 (0:00:01.552) 0:06:00.557 ****** 2026-02-24 16:02:03.702283 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:05.009552 | controller | 2026-02-24 16:02:05.009593 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-24 16:02:05.009602 | controller | Tuesday 24 February 2026 16:02:03 +0000 (0:00:01.081) 0:06:01.639 ****** 2026-02-24 16:02:05.009614 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:12.569637 | controller | 2026-02-24 16:02:12.569682 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-24 16:02:12.569691 | controller | Tuesday 24 February 2026 16:02:05 +0000 (0:00:01.307) 0:06:02.947 ****** 2026-02-24 16:02:12.569703 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:13.592946 | controller | 2026-02-24 16:02:13.593012 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-24 16:02:13.593024 | controller | Tuesday 24 February 2026 16:02:12 +0000 (0:00:07.559) 0:06:10.507 ****** 2026-02-24 16:02:13.593040 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:13.646134 | controller | 2026-02-24 16:02:13.646190 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-24 16:02:13.646199 | controller | Tuesday 24 February 2026 16:02:13 +0000 (0:00:01.023) 0:06:11.530 ****** 2026-02-24 16:02:13.646212 | controller | skipping: [instance] 2026-02-24 16:02:13.646308 | controller | 2026-02-24 16:02:13.646349 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-24 16:02:14.897157 | controller | Tuesday 24 February 2026 16:02:13 +0000 (0:00:00.053) 0:06:11.584 ****** 2026-02-24 16:02:14.897215 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:14.897299 | controller | 2026-02-24 16:02:14.897345 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-24 16:02:14.963417 | controller | Tuesday 24 February 2026 16:02:14 +0000 (0:00:01.250) 0:06:12.835 ****** 2026-02-24 16:02:14.963464 | controller | skipping: [instance] 2026-02-24 16:02:15.021085 | controller | 2026-02-24 16:02:15.021132 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-24 16:02:15.021142 | controller | Tuesday 24 February 2026 16:02:14 +0000 (0:00:00.066) 0:06:12.901 ****** 2026-02-24 16:02:15.021155 | controller | skipping: [instance] 2026-02-24 16:02:15.021182 | controller | 2026-02-24 16:02:15.021328 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-24 16:02:15.080818 | controller | Tuesday 24 February 2026 16:02:15 +0000 (0:00:00.058) 0:06:12.959 ****** 2026-02-24 16:02:15.080844 | controller | skipping: [instance] 2026-02-24 16:02:15.967922 | controller | 2026-02-24 16:02:15.967966 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-24 16:02:15.967975 | controller | Tuesday 24 February 2026 16:02:15 +0000 (0:00:00.059) 0:06:13.018 ****** 2026-02-24 16:02:15.967996 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:16.958962 | controller | 2026-02-24 16:02:16.959037 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-24 16:02:16.959051 | controller | Tuesday 24 February 2026 16:02:15 +0000 (0:00:00.886) 0:06:13.905 ****** 2026-02-24 16:02:16.959071 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:16.959123 | controller | 2026-02-24 16:02:16.959242 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-24 16:02:16.959284 | controller | Tuesday 24 February 2026 16:02:16 +0000 (0:00:00.991) 0:06:14.897 ****** 2026-02-24 16:02:17.007490 | controller | skipping: [instance] 2026-02-24 16:02:17.057889 | controller | 2026-02-24 16:02:17.057929 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-24 16:02:17.057953 | controller | Tuesday 24 February 2026 16:02:17 +0000 (0:00:00.048) 0:06:14.945 ****** 2026-02-24 16:02:17.057965 | controller | skipping: [instance] 2026-02-24 16:02:17.057992 | controller | 2026-02-24 16:02:17.058007 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-24 16:02:17.058015 | controller | Tuesday 24 February 2026 16:02:17 +0000 (0:00:00.050) 0:06:14.996 ****** 2026-02-24 16:02:17.112887 | controller | skipping: [instance] 2026-02-24 16:02:17.173867 | controller | 2026-02-24 16:02:17.173904 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-24 16:02:17.173916 | controller | Tuesday 24 February 2026 16:02:17 +0000 (0:00:00.054) 0:06:15.050 ****** 2026-02-24 16:02:17.173930 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:17.173989 | controller | 2026-02-24 16:02:17.174021 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-24 16:02:17.174035 | controller | Tuesday 24 February 2026 16:02:17 +0000 (0:00:00.061) 0:06:15.112 ****** 2026-02-24 16:02:17.216082 | controller | skipping: [instance] 2026-02-24 16:02:17.261909 | controller | 2026-02-24 16:02:17.261950 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-24 16:02:17.261960 | controller | Tuesday 24 February 2026 16:02:17 +0000 (0:00:00.042) 0:06:15.154 ****** 2026-02-24 16:02:17.261971 | controller | skipping: [instance] 2026-02-24 16:02:17.306583 | controller | 2026-02-24 16:02:17.306614 | controller | TASK [Download the RPM] ******************************************************** 2026-02-24 16:02:17.306623 | controller | Tuesday 24 February 2026 16:02:17 +0000 (0:00:00.045) 0:06:15.199 ****** 2026-02-24 16:02:17.306651 | controller | skipping: [instance] 2026-02-24 16:02:17.354403 | controller | 2026-02-24 16:02:17.354437 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-24 16:02:17.354447 | controller | Tuesday 24 February 2026 16:02:17 +0000 (0:00:00.044) 0:06:15.244 ****** 2026-02-24 16:02:17.354472 | controller | skipping: [instance] 2026-02-24 16:02:17.400092 | controller | 2026-02-24 16:02:17.400121 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-24 16:02:17.400129 | controller | Tuesday 24 February 2026 16:02:17 +0000 (0:00:00.048) 0:06:15.292 ****** 2026-02-24 16:02:17.400140 | controller | skipping: [instance] 2026-02-24 16:02:17.400297 | controller | 2026-02-24 16:02:17.400437 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-24 16:02:17.400568 | controller | Tuesday 24 February 2026 16:02:17 +0000 (0:00:00.046) 0:06:15.338 ****** 2026-02-24 16:02:17.448370 | controller | skipping: [instance] 2026-02-24 16:02:17.448547 | controller | 2026-02-24 16:02:17.448709 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-24 16:02:17.448885 | controller | Tuesday 24 February 2026 16:02:17 +0000 (0:00:00.048) 0:06:15.387 ****** 2026-02-24 16:02:17.498143 | controller | skipping: [instance] 2026-02-24 16:02:17.990921 | controller | 2026-02-24 16:02:17.990966 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-24 16:02:17.990976 | controller | Tuesday 24 February 2026 16:02:17 +0000 (0:00:00.049) 0:06:15.436 ****** 2026-02-24 16:02:17.990988 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:18.049388 | controller | 2026-02-24 16:02:18.049421 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-24 16:02:18.049429 | controller | Tuesday 24 February 2026 16:02:17 +0000 (0:00:00.492) 0:06:15.929 ****** 2026-02-24 16:02:18.049441 | controller | skipping: [instance] 2026-02-24 16:02:18.106907 | controller | 2026-02-24 16:02:18.106948 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-24 16:02:18.106958 | controller | Tuesday 24 February 2026 16:02:18 +0000 (0:00:00.058) 0:06:15.987 ****** 2026-02-24 16:02:18.106970 | controller | skipping: [instance] 2026-02-24 16:02:18.107027 | controller | 2026-02-24 16:02:18.107040 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-24 16:02:18.107148 | controller | Tuesday 24 February 2026 16:02:18 +0000 (0:00:00.057) 0:06:16.045 ****** 2026-02-24 16:02:18.151257 | controller | skipping: [instance] 2026-02-24 16:02:18.209936 | controller | 2026-02-24 16:02:18.209971 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-24 16:02:18.209981 | controller | Tuesday 24 February 2026 16:02:18 +0000 (0:00:00.044) 0:06:16.089 ****** 2026-02-24 16:02:18.209993 | controller | skipping: [instance] 2026-02-24 16:02:18.269253 | controller | 2026-02-24 16:02:18.269282 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-24 16:02:18.269290 | controller | Tuesday 24 February 2026 16:02:18 +0000 (0:00:00.058) 0:06:16.148 ****** 2026-02-24 16:02:18.269300 | controller | skipping: [instance] 2026-02-24 16:02:18.330101 | controller | 2026-02-24 16:02:18.330123 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-24 16:02:18.330132 | controller | Tuesday 24 February 2026 16:02:18 +0000 (0:00:00.059) 0:06:16.207 ****** 2026-02-24 16:02:18.330142 | controller | skipping: [instance] 2026-02-24 16:02:18.388486 | controller | 2026-02-24 16:02:18.388511 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-24 16:02:18.388528 | controller | Tuesday 24 February 2026 16:02:18 +0000 (0:00:00.059) 0:06:16.267 ****** 2026-02-24 16:02:18.388539 | controller | skipping: [instance] 2026-02-24 16:02:18.388696 | controller | 2026-02-24 16:02:18.388707 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-24 16:02:18.388716 | controller | Tuesday 24 February 2026 16:02:18 +0000 (0:00:00.059) 0:06:16.326 ****** 2026-02-24 16:02:18.450257 | controller | skipping: [instance] 2026-02-24 16:02:18.450320 | controller | 2026-02-24 16:02:18.450399 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-24 16:02:18.450495 | controller | Tuesday 24 February 2026 16:02:18 +0000 (0:00:00.062) 0:06:16.388 ****** 2026-02-24 16:02:19.127083 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:19.127144 | controller | 2026-02-24 16:02:19.127229 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-24 16:02:19.127328 | controller | Tuesday 24 February 2026 16:02:19 +0000 (0:00:00.676) 0:06:17.065 ****** 2026-02-24 16:02:20.210653 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:02:20.210709 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:02:20.211071 | controller | changed: [instance -> controller-0] 2026-02-24 16:02:20.211197 | controller | 2026-02-24 16:02:20.211212 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-24 16:02:20.211221 | controller | Tuesday 24 February 2026 16:02:20 +0000 (0:00:01.083) 0:06:18.148 ****** 2026-02-24 16:02:21.000926 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:21.000980 | controller | 2026-02-24 16:02:21.001188 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-24 16:02:21.001278 | controller | Tuesday 24 February 2026 16:02:20 +0000 (0:00:00.790) 0:06:18.939 ****** 2026-02-24 16:02:21.634903 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:21.701940 | controller | 2026-02-24 16:02:21.701994 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-24 16:02:21.702007 | controller | Tuesday 24 February 2026 16:02:21 +0000 (0:00:00.633) 0:06:19.572 ****** 2026-02-24 16:02:21.702037 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:02:21.702076 | controller | ok: [instance -> controller-0] 2026-02-24 16:02:21.702088 | controller | 2026-02-24 16:02:21.702117 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-24 16:02:21.702128 | controller | Tuesday 24 February 2026 16:02:21 +0000 (0:00:00.067) 0:06:19.640 ****** 2026-02-24 16:02:21.750759 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:52.132015 | controller | 2026-02-24 16:02:52.132116 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-24 16:02:52.132142 | controller | Tuesday 24 February 2026 16:02:21 +0000 (0:00:00.048) 0:06:19.689 ****** 2026-02-24 16:02:52.132162 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:52.675512 | controller | 2026-02-24 16:02:52.675624 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-24 16:02:52.675634 | controller | Tuesday 24 February 2026 16:02:52 +0000 (0:00:30.380) 0:06:50.069 ****** 2026-02-24 16:02:52.675656 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:53.202399 | controller | 2026-02-24 16:02:53.202452 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-24 16:02:53.202461 | controller | Tuesday 24 February 2026 16:02:52 +0000 (0:00:00.543) 0:06:50.613 ****** 2026-02-24 16:02:53.202474 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:53.202503 | controller | 2026-02-24 16:02:53.202789 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-24 16:02:59.479216 | controller | Tuesday 24 February 2026 16:02:53 +0000 (0:00:00.526) 0:06:51.139 ****** 2026-02-24 16:02:59.479290 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:02:59.479318 | controller | 2026-02-24 16:02:59.479328 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-24 16:02:59.479521 | controller | Tuesday 24 February 2026 16:02:59 +0000 (0:00:06.277) 0:06:57.417 ****** 2026-02-24 16:02:59.542657 | controller | skipping: [instance] 2026-02-24 16:02:59.542735 | controller | 2026-02-24 16:02:59.542746 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-24 16:02:59.542923 | controller | Tuesday 24 February 2026 16:02:59 +0000 (0:00:00.063) 0:06:57.481 ****** 2026-02-24 16:03:00.193094 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:03:00.193235 | controller | 2026-02-24 16:03:00.193263 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-24 16:03:00.725746 | controller | Tuesday 24 February 2026 16:03:00 +0000 (0:00:00.649) 0:06:58.131 ****** 2026-02-24 16:03:00.725837 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:03:00.725871 | controller | 2026-02-24 16:03:00.726002 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-24 16:03:00.726017 | controller | Tuesday 24 February 2026 16:03:00 +0000 (0:00:00.532) 0:06:58.663 ****** 2026-02-24 16:03:00.771314 | controller | skipping: [instance] 2026-02-24 16:03:00.771381 | controller | 2026-02-24 16:03:00.771390 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-24 16:03:00.771408 | controller | Tuesday 24 February 2026 16:03:00 +0000 (0:00:00.045) 0:06:58.709 ****** 2026-02-24 16:03:00.816912 | controller | skipping: [instance] 2026-02-24 16:03:00.817062 | controller | 2026-02-24 16:03:00.817106 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-24 16:03:00.817122 | controller | Tuesday 24 February 2026 16:03:00 +0000 (0:00:00.045) 0:06:58.755 ****** 2026-02-24 16:03:00.868813 | controller | skipping: [instance] 2026-02-24 16:03:00.916674 | controller | 2026-02-24 16:03:00.916713 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-24 16:03:00.916722 | controller | Tuesday 24 February 2026 16:03:00 +0000 (0:00:00.051) 0:06:58.806 ****** 2026-02-24 16:03:00.916734 | controller | skipping: [instance] 2026-02-24 16:03:00.963156 | controller | 2026-02-24 16:03:00.963230 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-24 16:03:00.963239 | controller | Tuesday 24 February 2026 16:03:00 +0000 (0:00:00.048) 0:06:58.855 ****** 2026-02-24 16:03:00.963268 | controller | skipping: [instance] 2026-02-24 16:03:00.963300 | controller | 2026-02-24 16:03:00.963309 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-24 16:03:01.005823 | controller | Tuesday 24 February 2026 16:03:00 +0000 (0:00:00.046) 0:06:58.901 ****** 2026-02-24 16:03:01.005890 | controller | skipping: [instance] 2026-02-24 16:03:03.775877 | controller | 2026-02-24 16:03:03.775967 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-24 16:03:03.775990 | controller | Tuesday 24 February 2026 16:03:01 +0000 (0:00:00.042) 0:06:58.944 ****** 2026-02-24 16:03:03.776018 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:03:03.946181 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:03:03.946229 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:03:03.946241 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:03:03.946249 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:03:03.946256 | controller | changed: [instance -> controller-0] 2026-02-24 16:03:03.946264 | controller | 2026-02-24 16:03:03.946284 | controller | TASK [Prepare install_yamls make targets] ************************************** 2026-02-24 16:03:03.946292 | controller | Tuesday 24 February 2026 16:03:03 +0000 (0:00:02.768) 0:07:01.713 ****** 2026-02-24 16:03:03.946310 | controller | 2026-02-24 16:03:03.946407 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2026-02-24 16:03:03.946424 | controller | Tuesday 24 February 2026 16:03:03 +0000 (0:00:00.171) 0:07:01.884 ****** 2026-02-24 16:03:05.506036 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:03:05.506121 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:03:05.506233 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:03:05.506338 | controller | changed: [instance -> controller-0] 2026-02-24 16:03:05.506433 | controller | 2026-02-24 16:03:05.506533 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2026-02-24 16:03:05.506606 | controller | Tuesday 24 February 2026 16:03:05 +0000 (0:00:01.559) 0:07:03.444 ****** 2026-02-24 16:03:05.577862 | controller | 2026-02-24 16:03:05.577959 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2026-02-24 16:03:05.578058 | controller | Tuesday 24 February 2026 16:03:05 +0000 (0:00:00.072) 0:07:03.516 ****** 2026-02-24 16:03:05.625830 | controller | skipping: [instance] 2026-02-24 16:03:05.625917 | controller | 2026-02-24 16:03:05.626106 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2026-02-24 16:03:05.626174 | controller | Tuesday 24 February 2026 16:03:05 +0000 (0:00:00.048) 0:07:03.564 ****** 2026-02-24 16:03:05.677582 | controller | skipping: [instance] 2026-02-24 16:03:05.677693 | controller | 2026-02-24 16:03:05.677855 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2026-02-24 16:03:05.677997 | controller | Tuesday 24 February 2026 16:03:05 +0000 (0:00:00.051) 0:07:03.615 ****** 2026-02-24 16:03:05.750792 | controller | 2026-02-24 16:03:05.750930 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 16:03:05.751080 | controller | Tuesday 24 February 2026 16:03:05 +0000 (0:00:00.073) 0:07:03.689 ****** 2026-02-24 16:03:05.800907 | controller | skipping: [instance] 2026-02-24 16:03:05.801043 | controller | 2026-02-24 16:03:05.801170 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 16:03:05.801313 | controller | Tuesday 24 February 2026 16:03:05 +0000 (0:00:00.050) 0:07:03.739 ****** 2026-02-24 16:03:05.849548 | controller | skipping: [instance] 2026-02-24 16:03:05.849625 | controller | 2026-02-24 16:03:05.849746 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 16:03:05.849961 | controller | Tuesday 24 February 2026 16:03:05 +0000 (0:00:00.048) 0:07:03.787 ****** 2026-02-24 16:03:05.895420 | controller | skipping: [instance] 2026-02-24 16:03:05.895516 | controller | 2026-02-24 16:03:05.895552 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 16:03:05.895683 | controller | Tuesday 24 February 2026 16:03:05 +0000 (0:00:00.046) 0:07:03.833 ****** 2026-02-24 16:03:05.949726 | controller | skipping: [instance] 2026-02-24 16:03:05.949826 | controller | 2026-02-24 16:03:05.949924 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2026-02-24 16:03:05.950025 | controller | Tuesday 24 February 2026 16:03:05 +0000 (0:00:00.054) 0:07:03.888 ****** 2026-02-24 16:03:06.052837 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 16:03:06.052916 | controller | ok: [instance -> controller-0] 2026-02-24 16:03:06.053047 | controller | 2026-02-24 16:03:06.053153 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2026-02-24 16:03:06.053270 | controller | Tuesday 24 February 2026 16:03:06 +0000 (0:00:00.103) 0:07:03.991 ****** 2026-02-24 16:03:06.127385 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:03:06.127507 | controller | 2026-02-24 16:03:06.127525 | controller | TASK [install_yamls : Get environment structure] ******************************* 2026-02-24 16:03:06.127539 | controller | Tuesday 24 February 2026 16:03:06 +0000 (0:00:00.074) 0:07:04.065 ****** 2026-02-24 16:03:07.196352 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:03:07.196516 | controller | 2026-02-24 16:03:07.196598 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2026-02-24 16:03:07.196610 | controller | Tuesday 24 February 2026 16:03:07 +0000 (0:00:01.068) 0:07:05.133 ****** 2026-02-24 16:03:07.247332 | controller | skipping: [instance] 2026-02-24 16:03:07.247379 | controller | 2026-02-24 16:03:07.247520 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2026-02-24 16:03:07.247656 | controller | Tuesday 24 February 2026 16:03:07 +0000 (0:00:00.051) 0:07:05.185 ****** 2026-02-24 16:03:07.301959 | controller | skipping: [instance] 2026-02-24 16:03:07.302059 | controller | 2026-02-24 16:03:07.302179 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2026-02-24 16:03:07.302323 | controller | Tuesday 24 February 2026 16:03:07 +0000 (0:00:00.054) 0:07:05.240 ****** 2026-02-24 16:03:07.347170 | controller | skipping: [instance] 2026-02-24 16:03:07.347254 | controller | 2026-02-24 16:03:07.347377 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2026-02-24 16:03:07.347484 | controller | Tuesday 24 February 2026 16:03:07 +0000 (0:00:00.045) 0:07:05.285 ****** 2026-02-24 16:03:07.415977 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:03:07.416024 | controller | 2026-02-24 16:03:07.416126 | controller | TASK [install_yamls : Show the env structure] ********************************** 2026-02-24 16:03:07.416212 | controller | Tuesday 24 February 2026 16:03:07 +0000 (0:00:00.068) 0:07:05.354 ****** 2026-02-24 16:03:07.474112 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:03:07.474202 | controller | 2026-02-24 16:03:07.474331 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2026-02-24 16:03:07.474457 | controller | Tuesday 24 February 2026 16:03:07 +0000 (0:00:00.058) 0:07:05.412 ****** 2026-02-24 16:03:07.543331 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:03:07.543419 | controller | 2026-02-24 16:03:07.543543 | controller | TASK [install_yamls : Generate make targets] *********************************** 2026-02-24 16:03:07.543663 | controller | Tuesday 24 February 2026 16:03:07 +0000 (0:00:00.068) 0:07:05.481 ****** 2026-02-24 16:03:08.300344 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:03:08.300414 | controller | 2026-02-24 16:03:08.300661 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2026-02-24 16:03:08.355174 | controller | Tuesday 24 February 2026 16:03:08 +0000 (0:00:00.756) 0:07:06.238 ****** 2026-02-24 16:03:08.355222 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:03:08.355252 | controller | 2026-02-24 16:03:08.355263 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2026-02-24 16:03:08.355394 | controller | Tuesday 24 February 2026 16:03:08 +0000 (0:00:00.055) 0:07:06.293 ****** 2026-02-24 16:03:09.383836 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:03:09.383901 | controller | 2026-02-24 16:03:09.384013 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2026-02-24 16:03:09.384141 | controller | Tuesday 24 February 2026 16:03:09 +0000 (0:00:01.028) 0:07:07.321 ****** 2026-02-24 16:03:09.437651 | controller | skipping: [instance] 2026-02-24 16:03:09.437754 | controller | 2026-02-24 16:03:09.437968 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-24 16:03:09.438113 | controller | Tuesday 24 February 2026 16:03:09 +0000 (0:00:00.054) 0:07:07.376 ****** 2026-02-24 16:03:10.228166 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:03:10.228236 | controller | 2026-02-24 16:03:10.228311 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-24 16:03:10.228407 | controller | Tuesday 24 February 2026 16:03:10 +0000 (0:00:00.790) 0:07:08.166 ****** 2026-02-24 16:03:10.300980 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:03:10.301065 | controller | 2026-02-24 16:03:10.301191 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2026-02-24 16:03:10.301281 | controller | Tuesday 24 February 2026 16:03:10 +0000 (0:00:00.072) 0:07:08.239 ****** 2026-02-24 16:03:11.397570 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:03:11.397744 | controller | 2026-02-24 16:03:11.397891 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2026-02-24 16:03:11.397946 | controller | Tuesday 24 February 2026 16:03:11 +0000 (0:00:01.096) 0:07:09.335 ****** 2026-02-24 16:03:11.939266 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 16:03:12.095636 | controller | 2026-02-24 16:03:12.095694 | controller | TASK [Configure CRC network if needed] ***************************************** 2026-02-24 16:03:12.095707 | controller | Tuesday 24 February 2026 16:03:11 +0000 (0:00:00.541) 0:07:09.877 ****** 2026-02-24 16:03:12.095726 | controller | 2026-02-24 16:03:13.422708 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2026-02-24 16:03:13.422746 | controller | Tuesday 24 February 2026 16:03:12 +0000 (0:00:00.156) 0:07:10.033 ****** 2026-02-24 16:03:13.422759 | controller | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-24 16:03:13.425128 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false 2026-02-24 16:03:13.425180 | controller | module_stderr: |- 2026-02-24 16:03:13.425190 | controller | Shared connection to controller-0.utility closed. 2026-02-24 16:03:13.425197 | controller | module_stdout: |- 2026-02-24 16:03:13.425203 | controller | Traceback (most recent call last): 2026-02-24 16:03:13.425210 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 700, in urlopen 2026-02-24 16:03:13.425218 | controller | httplib_response = self._make_request( 2026-02-24 16:03:13.425852 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 383, in _make_request 2026-02-24 16:03:13.426074 | controller | self._validate_conn(conn) 2026-02-24 16:03:13.426124 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1015, in _validate_conn 2026-02-24 16:03:13.426133 | controller | conn.connect() 2026-02-24 16:03:13.426139 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connection.py", line 411, in connect 2026-02-24 16:03:13.426145 | controller | self.sock = ssl_wrap_socket( 2026-02-24 16:03:13.426151 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket 2026-02-24 16:03:13.426156 | controller | ssl_sock = _ssl_wrap_socket_impl( 2026-02-24 16:03:13.426168 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl 2026-02-24 16:03:13.426184 | controller | return ssl_context.wrap_socket(sock, server_hostname=server_hostname) 2026-02-24 16:03:13.426192 | controller | File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket 2026-02-24 16:03:13.426257 | controller | return self.sslsocket_class._create( 2026-02-24 16:03:13.426268 | controller | File "/usr/lib64/python3.9/ssl.py", line 1076, in _create 2026-02-24 16:03:13.426350 | controller | self.do_handshake() 2026-02-24 16:03:13.426437 | controller | File "/usr/lib64/python3.9/ssl.py", line 1345, in do_handshake 2026-02-24 16:03:13.426513 | controller | self._sslobj.do_handshake() 2026-02-24 16:03:13.426598 | controller | ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147) 2026-02-24 16:03:13.426677 | controller | 2026-02-24 16:03:13.426774 | controller | During handling of the above exception, another exception occurred: 2026-02-24 16:03:13.426868 | controller | 2026-02-24 16:03:13.426939 | controller | Traceback (most recent call last): 2026-02-24 16:03:13.427023 | controller | File "/tmp/ansible-tmp-1771948992.1420033-28422-127705142663901/AnsiballZ_k8s_info.py", line 107, in 2026-02-24 16:03:13.427106 | controller | _ansiballz_main() 2026-02-24 16:03:13.427204 | controller | File "/tmp/ansible-tmp-1771948992.1420033-28422-127705142663901/AnsiballZ_k8s_info.py", line 99, in _ansiballz_main 2026-02-24 16:03:13.427324 | controller | invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS) 2026-02-24 16:03:13.427396 | controller | File "/tmp/ansible-tmp-1771948992.1420033-28422-127705142663901/AnsiballZ_k8s_info.py", line 47, in invoke_module 2026-02-24 16:03:13.427478 | controller | runpy.run_module(mod_name='ansible_collections.kubernetes.core.plugins.modules.k8s_info', init_globals=dict(_module_fqn='ansible_collections.kubernetes.core.plugins.modules.k8s_info', _modlib_path=modlib_path), 2026-02-24 16:03:13.427551 | controller | File "/usr/lib64/python3.9/runpy.py", line 225, in run_module 2026-02-24 16:03:13.427631 | controller | return _run_module_code(code, init_globals, run_name, mod_spec) 2026-02-24 16:03:13.427711 | controller | File "/usr/lib64/python3.9/runpy.py", line 97, in _run_module_code 2026-02-24 16:03:13.427810 | controller | _run_code(code, mod_globals, init_globals, 2026-02-24 16:03:13.427893 | controller | File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-24 16:03:13.427978 | controller | exec(code, run_globals) 2026-02-24 16:03:13.428071 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_69oxilnp/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 229, in 2026-02-24 16:03:13.428156 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_69oxilnp/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 221, in main 2026-02-24 16:03:13.428243 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_69oxilnp/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 352, in get_api_client 2026-02-24 16:03:13.428334 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_69oxilnp/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 246, in wrapper 2026-02-24 16:03:13.428433 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_69oxilnp/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 259, in create_api_client 2026-02-24 16:03:13.428531 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 84, in __init__ 2026-02-24 16:03:13.428601 | controller | self.__discoverer = discoverer(self, cache_file) 2026-02-24 16:03:13.428685 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_69oxilnp/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 190, in __init__ 2026-02-24 16:03:13.428787 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_69oxilnp/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 45, in __init__ 2026-02-24 16:03:13.428874 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_69oxilnp/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 92, in __init_cache 2026-02-24 16:03:13.428939 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/discovery.py", line 146, in _load_server_info 2026-02-24 16:03:13.429019 | controller | 'kubernetes': self.client.request('get', '/version', serializer=just_json) 2026-02-24 16:03:13.429100 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-24 16:03:13.429180 | controller | resp = func(self, *args, **kwargs) 2026-02-24 16:03:13.429261 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 277, in request 2026-02-24 16:03:13.429352 | controller | api_response = self.client.call_api( 2026-02-24 16:03:13.429435 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-24 16:03:13.429514 | controller | return self.__call_api(resource_path, method, 2026-02-24 16:03:13.429602 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-24 16:03:13.429689 | controller | response_data = self.request( 2026-02-24 16:03:13.429793 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-24 16:03:13.429885 | controller | return self.rest_client.GET(url, 2026-02-24 16:03:13.429976 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-24 16:03:13.430067 | controller | return self.request("GET", url, 2026-02-24 16:03:13.430157 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 217, in request 2026-02-24 16:03:13.430254 | controller | r = self.pool_manager.request(method, url, 2026-02-24 16:03:13.430355 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 74, in request 2026-02-24 16:03:13.430443 | controller | return self.request_encode_url( 2026-02-24 16:03:13.430530 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 96, in request_encode_url 2026-02-24 16:03:13.430617 | controller | return self.urlopen(method, url, **extra_kw) 2026-02-24 16:03:13.430703 | controller | File "/usr/lib/python3.9/site-packages/urllib3/poolmanager.py", line 376, in urlopen 2026-02-24 16:03:13.430816 | controller | response = conn.urlopen(method, u.request_uri, **kw) 2026-02-24 16:03:13.431006 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-24 16:03:13.431072 | controller | return self.urlopen( 2026-02-24 16:03:13.431082 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-24 16:03:13.431173 | controller | return self.urlopen( 2026-02-24 16:03:13.431266 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-24 16:03:13.431363 | controller | return self.urlopen( 2026-02-24 16:03:13.431506 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 756, in urlopen 2026-02-24 16:03:13.431580 | controller | retries = retries.increment( 2026-02-24 16:03:13.431898 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 576, in increment 2026-02-24 16:03:13.432541 | controller | raise MaxRetryError(_pool, url, error or ResponseError(cause)) 2026-02-24 16:03:13.434610 | controller | urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-24 16:03:13.434637 | controller | msg: |- 2026-02-24 16:03:13.434646 | controller | MODULE FAILURE 2026-02-24 16:03:13.434652 | controller | See stdout/stderr for the exact error 2026-02-24 16:03:13.434657 | controller | rc: 1 2026-02-24 16:03:13.434667 | controller | 2026-02-24 16:03:13.434813 | controller | TASK [Create dnsmasq dir] ****************************************************** 2026-02-24 16:03:13.434964 | controller | Tuesday 24 February 2026 16:03:13 +0000 (0:00:01.339) 0:07:11.373 ****** 2026-02-24 16:03:13.684994 | controller | changed: [instance] 2026-02-24 16:03:13.685079 | controller | 2026-02-24 16:03:13.685093 | controller | TASK [Get journalctl in a file] ************************************************ 2026-02-24 16:03:13.685142 | controller | Tuesday 24 February 2026 16:03:13 +0000 (0:00:00.249) 0:07:11.623 ****** 2026-02-24 16:03:13.933554 | controller | changed: [instance] 2026-02-24 16:03:13.933622 | controller | 2026-02-24 16:03:13.933706 | controller | TASK [Dump journalctl output] ************************************************** 2026-02-24 16:03:13.933829 | controller | Tuesday 24 February 2026 16:03:13 +0000 (0:00:00.248) 0:07:11.871 ****** 2026-02-24 16:03:14.395578 | controller | changed: [instance] 2026-02-24 16:03:14.395651 | controller | 2026-02-24 16:03:14.395678 | controller | TASK [Copy all dnsmasq config] ************************************************* 2026-02-24 16:03:14.395804 | controller | Tuesday 24 February 2026 16:03:14 +0000 (0:00:00.461) 0:07:12.333 ****** 2026-02-24 16:03:14.944171 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-24 16:03:14.944237 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2026-02-24 16:03:14.944286 | controller | 2026-02-24 16:03:14.944403 | controller | TASK [Create log directory] **************************************************** 2026-02-24 16:03:14.944501 | controller | Tuesday 24 February 2026 16:03:14 +0000 (0:00:00.548) 0:07:12.882 ****** 2026-02-24 16:03:15.167894 | controller | changed: [instance] 2026-02-24 16:03:15.167948 | controller | 2026-02-24 16:03:15.168010 | controller | TASK [Sync logs from controller-0] ********************************************* 2026-02-24 16:03:15.168112 | controller | Tuesday 24 February 2026 16:03:15 +0000 (0:00:00.223) 0:07:13.106 ****** 2026-02-24 16:03:16.186898 | controller | changed: [instance] 2026-02-24 16:03:16.186959 | controller | 2026-02-24 16:03:16.186969 | controller | PLAY RECAP ********************************************************************* 2026-02-24 16:03:16.186977 | controller | instance : ok=541 changed=208 unreachable=0 failed=1 skipped=229 rescued=0 ignored=0 2026-02-24 16:03:16.186983 | controller | 2026-02-24 16:03:16.186988 | controller | Tuesday 24 February 2026 16:03:16 +0000 (0:00:01.016) 0:07:14.122 ****** 2026-02-24 16:03:16.186994 | controller | =============================================================================== 2026-02-24 16:03:16.187002 | controller | reproducer : Check package install status ------------------------------ 50.59s 2026-02-24 16:03:16.187050 | controller | ci_setup : Install needed packages ------------------------------------- 30.38s 2026-02-24 16:03:16.187135 | controller | libvirt_manager : Download base image ---------------------------------- 29.38s 2026-02-24 16:03:16.187220 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 26.33s 2026-02-24 16:03:16.187303 | controller | reproducer : Install collections on controller-0 ----------------------- 20.24s 2026-02-24 16:03:16.187400 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.51s 2026-02-24 16:03:16.187485 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 8.41s 2026-02-24 16:03:16.187608 | controller | libvirt_manager : Install packages required for using KVM --------------- 8.26s 2026-02-24 16:03:16.187687 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.56s 2026-02-24 16:03:16.187791 | controller | ci_setup : Install openshift client ------------------------------------- 6.28s 2026-02-24 16:03:16.187879 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.06s 2026-02-24 16:03:16.187962 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.03s 2026-02-24 16:03:16.188059 | controller | networking_mapper : Gather the facts ------------------------------------ 3.70s 2026-02-24 16:03:16.188145 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.59s 2026-02-24 16:03:16.188229 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.06s 2026-02-24 16:03:16.188314 | controller | sushy_emulator : Install required packages ------------------------------ 2.79s 2026-02-24 16:03:16.188409 | controller | ci_setup : Manage directories ------------------------------------------- 2.77s 2026-02-24 16:03:16.188492 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.40s 2026-02-24 16:03:16.188576 | controller | reproducer : Restart NetworkManager ------------------------------------- 2.32s 2026-02-24 16:03:16.188658 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.17s 2026-02-24 16:03:16.330738 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2026-02-24 16:03:16.331170 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2026-02-24 16:03:16.339910 | controller | INFO Running crc_layout > cleanup 2026-02-24 16:03:16.340494 | controller | WARNING Skipping, cleanup playbook not configured. 2026-02-24 16:03:16.347517 | controller | INFO Running crc_layout > destroy 2026-02-24 16:03:16.347815 | controller | WARNING Skipping, instances are delegated. 2026-02-24 16:03:16.348095 | controller | INFO Pruning extra files from scenario ephemeral directory 2026-02-24 16:03:16.349719 | controller | INFO Writing /tmp/report.html report. 2026-02-24 16:03:16.640426 | [controller] Waiting on logger 2026-02-24 16:03:21.787880 | [controller] Waiting on logger 2026-02-24 16:03:32.220563 | [controller] Waiting on logger 2026-02-24 16:03:42.651932 | [controller] Waiting on logger 2026-02-24 16:03:46.478255 | [Zuul] Log Stream did not terminate 2026-02-24 16:03:46.478613 | controller | ERROR 2026-02-24 16:03:46.478719 | controller | { 2026-02-24 16:03:46.478752 | controller | "delta": "0:08:51.066008", 2026-02-24 16:03:46.478772 | controller | "end": "2026-02-24 16:03:16.422700", 2026-02-24 16:03:46.478793 | controller | "msg": "non-zero return code", 2026-02-24 16:03:46.478808 | controller | "rc": 1, 2026-02-24 16:03:46.478823 | controller | "start": "2026-02-24 15:54:25.356692" 2026-02-24 16:03:46.478837 | controller | } failure 2026-02-24 16:03:46.528717 | 2026-02-24 16:03:46.528770 | PLAY RECAP 2026-02-24 16:03:46.528809 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2026-02-24 16:03:46.528837 | 2026-02-24 16:03:46.589154 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-24 16:03:46.590205 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-24 16:03:47.070827 | 2026-02-24 16:03:47.070915 | PLAY [Run ci/playbooks/collect-logs.yml] 2026-02-24 16:03:47.089451 | 2026-02-24 16:03:47.089517 | TASK [Filter out host if needed] 2026-02-24 16:03:47.097390 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2026-02-24 16:03:47.101440 | 2026-02-24 16:03:47.101502 | TASK [Ensure file is present] 2026-02-24 16:03:47.494678 | controller | ok 2026-02-24 16:03:47.499872 | 2026-02-24 16:03:47.499935 | TASK [Manage molecule report file] 2026-02-24 16:03:47.519306 | [controller] Waiting on logger 2026-02-24 16:03:56.859806 | [controller] Waiting on logger 2026-02-24 16:04:07.291781 | [controller] Waiting on logger 2026-02-24 16:04:16.672474 | [controller] Waiting on logger 2026-02-24 16:04:17.872907 | [Zuul] Log Stream did not terminate 2026-02-24 16:04:17.873094 | controller | changed 2026-02-24 16:04:17.877878 | 2026-02-24 16:04:17.877941 | TASK [Check if we get ci-framework-data basedir] 2026-02-24 16:04:18.180455 | controller | ok 2026-02-24 16:04:18.185482 | 2026-02-24 16:04:18.185545 | TASK [Create ci-framework-data log directory for zuul] 2026-02-24 16:04:18.589414 | controller | changed 2026-02-24 16:04:18.595008 | 2026-02-24 16:04:18.595070 | TASK [Copy ci-framework interesting files] 2026-02-24 16:04:19.643946 | [controller] Waiting on logger 2026-02-24 16:04:30.076090 | [controller] Waiting on logger 2026-02-24 16:04:40.507856 | [controller] Waiting on logger 2026-02-24 16:04:48.905732 | [Zuul] Log Stream did not terminate 2026-02-24 16:04:48.905914 | controller | changed 2026-02-24 16:04:48.911689 | 2026-02-24 16:04:48.911749 | TASK [Get SELinux listing] 2026-02-24 16:04:49.852013 | [controller] Waiting on logger 2026-02-24 16:04:52.027786 | [controller] Waiting on logger 2026-02-24 16:05:08.475905 | [controller] Waiting on logger 2026-02-24 16:05:10.688840 | [controller] Waiting on logger 2026-02-24 16:05:19.232692 | [Zuul] Log Stream did not terminate 2026-02-24 16:05:19.233035 | controller | changed 2026-02-24 16:05:19.238662 | 2026-02-24 16:05:19.238722 | TASK [Generate log index] 2026-02-24 16:05:20.466223 | controller | changed 2026-02-24 16:05:20.470651 | 2026-02-24 16:05:20.470708 | TASK [Get some env related data] 2026-02-24 16:05:21.532794 | [controller] Waiting on logger 2026-02-24 16:05:31.324223 | [controller] Waiting on logger 2026-02-24 16:05:42.204139 | [controller] Waiting on logger 2026-02-24 16:05:51.807464 | [Zuul] Log Stream did not terminate 2026-02-24 16:05:51.807737 | controller | changed 2026-02-24 16:05:51.812994 | 2026-02-24 16:05:51.813053 | TASK [Generate list of logs to collect in home directory] 2026-02-24 16:05:52.185318 | controller | ok: All paths examined 2026-02-24 16:05:52.190181 | 2026-02-24 16:05:52.190236 | LOOP [Copy logs from home directory] 2026-02-24 16:05:52.831715 | controller | changed: 2026-02-24 16:05:52.831925 | controller | { 2026-02-24 16:05:52.831955 | controller | "atime": 1743544925.4788878, 2026-02-24 16:05:52.831974 | controller | "ctime": 1743545329.1409318, 2026-02-24 16:05:52.831992 | controller | "dev": 64513, 2026-02-24 16:05:52.832013 | controller | "gid": 1000, 2026-02-24 16:05:52.832030 | controller | "gr_name": "zuul", 2026-02-24 16:05:52.832045 | controller | "inode": 4518807, 2026-02-24 16:05:52.832060 | controller | "isblk": false, 2026-02-24 16:05:52.832074 | controller | "ischr": false, 2026-02-24 16:05:52.832088 | controller | "isdir": false, 2026-02-24 16:05:52.832101 | controller | "isfifo": false, 2026-02-24 16:05:52.832115 | controller | "isgid": false, 2026-02-24 16:05:52.832131 | controller | "islnk": false, 2026-02-24 16:05:52.832145 | controller | "isreg": true, 2026-02-24 16:05:52.832159 | controller | "issock": false, 2026-02-24 16:05:52.832172 | controller | "isuid": false, 2026-02-24 16:05:52.832185 | controller | "mode": "0644", 2026-02-24 16:05:52.832198 | controller | "mtime": 1743545329.1409318, 2026-02-24 16:05:52.832210 | controller | "nlink": 1, 2026-02-24 16:05:52.832223 | controller | "path": "/home/zuul/crc-setup.log", 2026-02-24 16:05:52.832237 | controller | "pw_name": "zuul", 2026-02-24 16:05:52.832250 | controller | "rgrp": true, 2026-02-24 16:05:52.832263 | controller | "roth": true, 2026-02-24 16:05:52.832276 | controller | "rusr": true, 2026-02-24 16:05:52.832289 | controller | "size": 4108, 2026-02-24 16:05:52.832324 | controller | "uid": 1000, 2026-02-24 16:05:52.832341 | controller | "wgrp": false, 2026-02-24 16:05:52.832355 | controller | "woth": false, 2026-02-24 16:05:52.832368 | controller | "wusr": true, 2026-02-24 16:05:52.832381 | controller | "xgrp": false, 2026-02-24 16:05:52.832395 | controller | "xoth": false, 2026-02-24 16:05:52.832408 | controller | "xusr": false 2026-02-24 16:05:52.832421 | controller | } 2026-02-24 16:05:53.083656 | [controller] Waiting on logger 2026-02-24 16:05:53.461583 | controller | changed: 2026-02-24 16:05:53.461676 | controller | { 2026-02-24 16:05:53.461705 | controller | "atime": 1743545331.0429637, 2026-02-24 16:05:53.461727 | controller | "ctime": 1743545842.0111232, 2026-02-24 16:05:53.461745 | controller | "dev": 64513, 2026-02-24 16:05:53.461762 | controller | "gid": 1000, 2026-02-24 16:05:53.461778 | controller | "gr_name": "zuul", 2026-02-24 16:05:53.461794 | controller | "inode": 4194437, 2026-02-24 16:05:53.461808 | controller | "isblk": false, 2026-02-24 16:05:53.461823 | controller | "ischr": false, 2026-02-24 16:05:53.461838 | controller | "isdir": false, 2026-02-24 16:05:53.461852 | controller | "isfifo": false, 2026-02-24 16:05:53.461866 | controller | "isgid": false, 2026-02-24 16:05:53.461880 | controller | "islnk": false, 2026-02-24 16:05:53.461896 | controller | "isreg": true, 2026-02-24 16:05:53.461925 | controller | "issock": false, 2026-02-24 16:05:53.461943 | controller | "isuid": false, 2026-02-24 16:05:53.461958 | controller | "mode": "0644", 2026-02-24 16:05:53.461972 | controller | "mtime": 1743545842.0111232, 2026-02-24 16:05:53.461986 | controller | "nlink": 1, 2026-02-24 16:05:53.462000 | controller | "path": "/home/zuul/crc-start.log", 2026-02-24 16:05:53.462013 | controller | "pw_name": "zuul", 2026-02-24 16:05:53.462026 | controller | "rgrp": true, 2026-02-24 16:05:53.462039 | controller | "roth": true, 2026-02-24 16:05:53.462051 | controller | "rusr": true, 2026-02-24 16:05:53.462063 | controller | "size": 4023, 2026-02-24 16:05:53.462075 | controller | "uid": 1000, 2026-02-24 16:05:53.462087 | controller | "wgrp": false, 2026-02-24 16:05:53.462099 | controller | "woth": false, 2026-02-24 16:05:53.462121 | controller | "wusr": true, 2026-02-24 16:05:53.462140 | controller | "xgrp": false, 2026-02-24 16:05:53.462157 | controller | "xoth": false, 2026-02-24 16:05:53.462174 | controller | "xusr": false 2026-02-24 16:05:53.462191 | controller | } 2026-02-24 16:05:54.071750 | controller | changed: 2026-02-24 16:05:54.071802 | controller | { 2026-02-24 16:05:54.071826 | controller | "atime": 1771948446.738896, 2026-02-24 16:05:54.071843 | controller | "ctime": 1771948462.8936858, 2026-02-24 16:05:54.071859 | controller | "dev": 64513, 2026-02-24 16:05:54.071874 | controller | "gid": 1000, 2026-02-24 16:05:54.071887 | controller | "gr_name": "zuul", 2026-02-24 16:05:54.071903 | controller | "inode": 4685798, 2026-02-24 16:05:54.071927 | controller | "isblk": false, 2026-02-24 16:05:54.071941 | controller | "ischr": false, 2026-02-24 16:05:54.071955 | controller | "isdir": false, 2026-02-24 16:05:54.071969 | controller | "isfifo": false, 2026-02-24 16:05:54.071983 | controller | "isgid": false, 2026-02-24 16:05:54.071996 | controller | "islnk": false, 2026-02-24 16:05:54.072008 | controller | "isreg": true, 2026-02-24 16:05:54.072021 | controller | "issock": false, 2026-02-24 16:05:54.072033 | controller | "isuid": false, 2026-02-24 16:05:54.072045 | controller | "mode": "0644", 2026-02-24 16:05:54.072057 | controller | "mtime": 1771948462.8936858, 2026-02-24 16:05:54.072072 | controller | "nlink": 1, 2026-02-24 16:05:54.072087 | controller | "path": "/home/zuul/ansible.log", 2026-02-24 16:05:54.072102 | controller | "pw_name": "zuul", 2026-02-24 16:05:54.072115 | controller | "rgrp": true, 2026-02-24 16:05:54.072128 | controller | "roth": true, 2026-02-24 16:05:54.072141 | controller | "rusr": true, 2026-02-24 16:05:54.072154 | controller | "size": 6749, 2026-02-24 16:05:54.072167 | controller | "uid": 1000, 2026-02-24 16:05:54.072179 | controller | "wgrp": false, 2026-02-24 16:05:54.072191 | controller | "woth": false, 2026-02-24 16:05:54.072203 | controller | "wusr": true, 2026-02-24 16:05:54.072215 | controller | "xgrp": false, 2026-02-24 16:05:54.072227 | controller | "xoth": false, 2026-02-24 16:05:54.072239 | controller | "xusr": false 2026-02-24 16:05:54.072257 | controller | } 2026-02-24 16:05:54.079549 | 2026-02-24 16:05:54.079654 | TASK [Copy crio stats log file] 2026-02-24 16:05:54.093105 | controller | skipping: Conditional result was False 2026-02-24 16:05:54.098153 | 2026-02-24 16:05:54.098213 | TASK [Get SELinux related data] 2026-02-24 16:05:54.119512 | [controller] Waiting on logger 2026-02-24 16:06:06.587837 | [controller] Waiting on logger 2026-02-24 16:06:15.931980 | [controller] Waiting on logger 2026-02-24 16:06:24.439894 | [Zuul] Log Stream did not terminate 2026-02-24 16:06:24.440198 | controller | ERROR 2026-02-24 16:06:24.440396 | controller | { 2026-02-24 16:06:24.440461 | controller | "delta": "0:00:00.010544", 2026-02-24 16:06:24.440500 | controller | "end": "2026-02-24 16:05:54.403995", 2026-02-24 16:06:24.440530 | controller | "msg": "non-zero return code", 2026-02-24 16:06:24.440559 | controller | "rc": 1, 2026-02-24 16:06:24.440588 | controller | "start": "2026-02-24 16:05:54.393451" 2026-02-24 16:06:24.440615 | controller | } 2026-02-24 16:06:24.440650 | controller | ERROR: Ignoring Errors 2026-02-24 16:06:24.445418 | 2026-02-24 16:06:24.445476 | TASK [Create system configuration directory] 2026-02-24 16:06:24.728280 | controller | changed 2026-02-24 16:06:24.732693 | 2026-02-24 16:06:24.732752 | TASK [Get some of the system configurations] 2026-02-24 16:06:24.752673 | [controller] Waiting on logger 2026-02-24 16:06:35.195929 | [controller] Waiting on logger 2026-02-24 16:06:45.627997 | [controller] Waiting on logger 2026-02-24 16:06:54.972133 | [controller] Waiting on logger 2026-02-24 16:06:55.065011 | [Zuul] Log Stream did not terminate 2026-02-24 16:06:55.065339 | controller | changed 2026-02-24 16:06:55.070097 | 2026-02-24 16:06:55.070155 | TASK [Copy generated documentation if available] 2026-02-24 16:06:55.083286 | controller | skipping: Conditional result was False 2026-02-24 16:06:55.088253 | 2026-02-24 16:06:55.088328 | TASK [Copy generated AsciiDoc documentation if available] 2026-02-24 16:06:55.101198 | controller | skipping: Conditional result was False 2026-02-24 16:06:55.105920 | 2026-02-24 16:06:55.105978 | TASK [Compress logs bigger than 2MB] 2026-02-24 16:06:58.235876 | [controller] Waiting on logger 2026-02-24 16:07:04.494699 | controller | changed 2026-02-24 16:07:04.499865 | 2026-02-24 16:07:04.499935 | TASK [Copy files from workspace on node] 2026-02-24 16:07:04.517506 | controller | ok 2026-02-24 16:07:04.538938 | 2026-02-24 16:07:04.539004 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-24 16:07:04.552154 | controller | skipping: Conditional result was False 2026-02-24 16:07:04.557419 | 2026-02-24 16:07:04.557486 | TASK [fetch-output : Set log path for single node] 2026-02-24 16:07:04.584688 | controller | ok 2026-02-24 16:07:04.589409 | 2026-02-24 16:07:04.589473 | LOOP [fetch-output : Ensure local output dirs] 2026-02-24 16:07:04.770771 | controller -> localhost | ok: "/var/lib/zuul/builds/9336e7fafca4452dbef6bad521dd34aa/work/logs" 2026-02-24 16:07:04.771009 | controller -> localhost | changed: All items complete 2026-02-24 16:07:04.771041 | 2026-02-24 16:07:04.934696 | controller -> localhost | changed: "/var/lib/zuul/builds/9336e7fafca4452dbef6bad521dd34aa/work/artifacts" 2026-02-24 16:07:05.103100 | controller -> localhost | changed: "/var/lib/zuul/builds/9336e7fafca4452dbef6bad521dd34aa/work/docs" 2026-02-24 16:07:05.116461 | 2026-02-24 16:07:05.116548 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-24 16:07:05.774681 | controller | changed: 2026-02-24 16:07:05.774864 | controller | .d..t...... ./ 2026-02-24 16:07:05.774906 | controller | >f+++++++++ README.html 2026-02-24 16:07:05.774929 | controller | >f+++++++++ ansible-execution.log 2026-02-24 16:07:05.774948 | controller | >f+++++++++ ansible.log 2026-02-24 16:07:05.774964 | controller | >f+++++++++ crc-setup.log 2026-02-24 16:07:05.774980 | controller | >f+++++++++ crc-start.log 2026-02-24 16:07:05.774995 | controller | >f+++++++++ dmesg.log 2026-02-24 16:07:05.775009 | controller | >f+++++++++ installed-pkgs.log 2026-02-24 16:07:05.775027 | controller | >f+++++++++ python.log 2026-02-24 16:07:05.775042 | controller | >f+++++++++ registries.conf 2026-02-24 16:07:05.775056 | controller | >f+++++++++ report.html 2026-02-24 16:07:05.775069 | controller | >f+++++++++ selinux-denials.log 2026-02-24 16:07:05.775082 | controller | >f+++++++++ selinux-listing.log 2026-02-24 16:07:05.775095 | controller | cd+++++++++ ci-framework-data/ 2026-02-24 16:07:05.775108 | controller | cd+++++++++ ci-framework-data/artifacts/ 2026-02-24 16:07:05.775121 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2026-02-24 16:07:05.775135 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2026-02-24 16:07:05.775148 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2026-02-24 16:07:05.775161 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2026-02-24 16:07:05.775175 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2026-02-24 16:07:05.775188 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2026-02-24 16:07:05.775201 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2026-02-24 16:07:05.775215 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2026-02-24 16:07:05.775228 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2026-02-24 16:07:05.775241 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2026-02-24 16:07:05.775254 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2026-02-24 16:07:05.775267 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2026-02-24 16:07:05.775280 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2026-02-24 16:07:05.775305 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:aa:14:a9 2026-02-24 16:07:05.775329 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:6f:71:35 2026-02-24 16:07:05.775346 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:a6:a3:e3 2026-02-24 16:07:05.775361 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:33:fa:99 2026-02-24 16:07:05.775375 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:a9:f8:d3 2026-02-24 16:07:05.775388 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:1e:04:5c 2026-02-24 16:07:05.775402 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2026-02-24 16:07:05.775415 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2026-02-24 16:07:05.775428 | controller | cd+++++++++ ci-framework-data/logs/ 2026-02-24 16:07:05.775441 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2026-02-24 16:07:05.775454 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2026-02-24 16:07:05.775467 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2026-02-24 16:07:05.775480 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2026-02-24 16:07:05.775492 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2026-02-24 16:07:05.775508 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2026-02-24 16:07:05.775522 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2026-02-24 16:07:05.775534 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2026-02-24 16:07:05.775547 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2026-02-24 16:07:05.775563 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2026-02-24 16:07:05.775578 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2026-02-24 16:07:05.775591 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2026-02-24 16:07:05.775605 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2026-02-24 16:07:05.775618 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2026-02-24 16:07:05.775631 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2026-02-24 16:07:05.775644 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2026-02-24 16:07:05.775657 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2026-02-24 16:07:05.775670 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2026-02-24 16:07:05.775683 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2026-02-24 16:07:05.775695 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2026-02-24 16:07:05.775708 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2026-02-24 16:07:05.775721 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2026-02-24 16:07:05.775734 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2026-02-24 16:07:05.775748 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2026-02-24 16:07:05.775761 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2026-02-24 16:07:05.775774 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2026-02-24 16:07:05.775787 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2026-02-24 16:07:05.775800 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2026-02-24 16:07:05.775813 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2026-02-24 16:07:05.775826 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2026-02-24 16:07:05.775838 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2026-02-24 16:07:05.775851 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2026-02-24 16:07:05.775863 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2026-02-24 16:07:05.775875 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2026-02-24 16:07:05.775897 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2026-02-24 16:07:05.775913 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2026-02-24 16:07:05.775928 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2026-02-24 16:07:05.775941 | controller | cd+++++++++ registries.conf.d/ 2026-02-24 16:07:05.775954 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2026-02-24 16:07:05.775966 | controller | cd+++++++++ system-config/ 2026-02-24 16:07:05.775982 | controller | cd+++++++++ system-config/libvirt/ 2026-02-24 16:07:05.775996 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2026-02-24 16:07:05.776009 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2026-02-24 16:07:05.776022 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2026-02-24 16:07:05.776034 | controller | >f+++++++++ system-config/libvirt/network.conf 2026-02-24 16:07:05.776046 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2026-02-24 16:07:05.776059 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2026-02-24 16:07:05.776071 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2026-02-24 16:07:05.776083 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2026-02-24 16:07:05.776095 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2026-02-24 16:07:05.776107 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2026-02-24 16:07:05.776119 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2026-02-24 16:07:05.776132 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2026-02-24 16:07:05.776144 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2026-02-24 16:07:05.776156 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2026-02-24 16:07:05.776169 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2026-02-24 16:07:05.776181 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2026-02-24 16:07:06.243313 | controller | changed: .d..t...... ./ 2026-02-24 16:07:06.692712 | controller | changed: .d..t...... ./ 2026-02-24 16:07:06.712611 | 2026-02-24 16:07:06.712674 | TASK [Return artifact to Zuul] 2026-02-24 16:07:06.740134 | controller | ok 2026-02-24 16:07:06.756721 | 2026-02-24 16:07:06.756772 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2026-02-24 16:07:06.756868 | 2026-02-24 16:07:06.756904 | PLAY RECAP 2026-02-24 16:07:06.756939 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2026-02-24 16:07:06.756960 | 2026-02-24 16:07:06.830175 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-24 16:07:06.831489 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-24 16:07:07.295503 | 2026-02-24 16:07:07.295592 | PLAY [all] 2026-02-24 16:07:07.312125 | 2026-02-24 16:07:07.312192 | TASK [include_role : fetch-output] 2026-02-24 16:07:07.339832 | controller | ok 2026-02-24 16:07:07.354479 | 2026-02-24 16:07:07.354550 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-24 16:07:07.387637 | controller | skipping: Conditional result was False 2026-02-24 16:07:07.392606 | 2026-02-24 16:07:07.392669 | TASK [fetch-output : Set log path for single node] 2026-02-24 16:07:07.420045 | controller | ok 2026-02-24 16:07:07.424477 | 2026-02-24 16:07:07.424539 | LOOP [fetch-output : Ensure local output dirs] 2026-02-24 16:07:07.714598 | controller -> localhost | ok: "/var/lib/zuul/builds/9336e7fafca4452dbef6bad521dd34aa/work/logs" 2026-02-24 16:07:07.879989 | controller -> localhost | ok: "/var/lib/zuul/builds/9336e7fafca4452dbef6bad521dd34aa/work/artifacts" 2026-02-24 16:07:08.047286 | controller -> localhost | ok: "/var/lib/zuul/builds/9336e7fafca4452dbef6bad521dd34aa/work/docs" 2026-02-24 16:07:08.061493 | 2026-02-24 16:07:08.061623 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-24 16:07:08.667363 | controller | ok 2026-02-24 16:07:08.667558 | controller | ok: All items complete 2026-02-24 16:07:08.667586 | 2026-02-24 16:07:09.119636 | controller | ok 2026-02-24 16:07:09.577485 | controller | ok 2026-02-24 16:07:09.596782 | 2026-02-24 16:07:09.596905 | TASK [include_role : fetch-output-openshift] 2026-02-24 16:07:09.609873 | controller | skipping: Conditional result was False 2026-02-24 16:07:09.615149 | 2026-02-24 16:07:09.615213 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-02-24 16:07:09.923165 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.007399 2026-02-24 16:07:10.092671 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.005290 2026-02-24 16:07:10.126663 | 2026-02-24 16:07:10.126745 | PLAY [all] 2026-02-24 16:07:10.139538 | 2026-02-24 16:07:10.139601 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-02-24 16:07:10.645326 | controller | changed 2026-02-24 16:07:10.666365 | 2026-02-24 16:07:10.666416 | PLAY RECAP 2026-02-24 16:07:10.666455 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-02-24 16:07:10.666477 | 2026-02-24 16:07:10.730094 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-24 16:07:10.730727 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2026-02-24 16:07:11.233385 | 2026-02-24 16:07:11.233534 | PLAY [localhost] 2026-02-24 16:07:11.249377 | 2026-02-24 16:07:11.249454 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-02-24 16:07:11.530341 | localhost | changed 2026-02-24 16:07:11.534593 | 2026-02-24 16:07:11.534676 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-02-24 16:07:11.551572 | localhost | ok 2026-02-24 16:07:11.558717 | 2026-02-24 16:07:11.558784 | TASK [add-fileserver : Create SSH private key tempfile] 2026-02-24 16:07:11.828532 | localhost | changed 2026-02-24 16:07:11.833637 | 2026-02-24 16:07:11.833712 | TASK [add-fileserver : Create SSH private key from secret] 2026-02-24 16:07:12.326192 | localhost | changed 2026-02-24 16:07:12.330790 | 2026-02-24 16:07:12.330859 | TASK [add-fileserver : Add fileserver ssh key] 2026-02-24 16:07:12.641285 | localhost | Identity added: /var/lib/zuul/builds/9336e7fafca4452dbef6bad521dd34aa/work/tmp/ansible.5oajdrsr (/var/lib/zuul/builds/9336e7fafca4452dbef6bad521dd34aa/work/tmp/ansible.5oajdrsr) 2026-02-24 16:07:12.641488 | localhost | ok: Runtime: 0:00:00.005987 2026-02-24 16:07:12.645580 | 2026-02-24 16:07:12.645649 | TASK [add-fileserver : Remove SSH private key from disk] 2026-02-24 16:07:12.844607 | localhost | ok: Runtime: 0:00:00.004096 2026-02-24 16:07:12.848930 | 2026-02-24 16:07:12.849000 | TASK [add-fileserver : Add fileserver to inventory] 2026-02-24 16:07:12.896429 | localhost | changed 2026-02-24 16:07:12.901322 | 2026-02-24 16:07:12.901399 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-02-24 16:07:13.212226 | localhost | changed 2026-02-24 16:07:13.230760 | 2026-02-24 16:07:13.230818 | PLAY [localhost] 2026-02-24 16:07:13.241623 | 2026-02-24 16:07:13.241684 | TASK [Generate bulk log download script] 2026-02-24 16:07:13.259710 | localhost | ok 2026-02-24 16:07:13.270746 | 2026-02-24 16:07:13.270818 | TASK [local-log-download : Check API endpoint is defined] 2026-02-24 16:07:13.297841 | localhost | ok: All assertions passed 2026-02-24 16:07:13.302132 | 2026-02-24 16:07:13.302195 | TASK [local-log-download : Create download script] 2026-02-24 16:07:13.639101 | localhost -> localhost | changed 2026-02-24 16:07:13.647366 | 2026-02-24 16:07:13.647429 | TASK [Register quick-download link] 2026-02-24 16:07:13.663510 | localhost | ok 2026-02-24 16:07:13.694457 | 2026-02-24 16:07:13.694522 | PLAY [logserver.rdoproject.org] 2026-02-24 16:07:13.703544 | 2026-02-24 16:07:13.703604 | TASK [Set zuul-log-path fact] 2026-02-24 16:07:13.718539 | logserver.rdoproject.org | ok 2026-02-24 16:07:13.726958 | 2026-02-24 16:07:13.727023 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-24 16:07:13.741995 | logserver.rdoproject.org | ok 2026-02-24 16:07:13.747071 | 2026-02-24 16:07:13.747136 | TASK [upload-logs : Create log directories] 2026-02-24 16:07:15.729498 | logserver.rdoproject.org | changed 2026-02-24 16:07:15.732202 | 2026-02-24 16:07:15.732258 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-02-24 16:07:15.927526 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004720 2026-02-24 16:07:15.931720 | 2026-02-24 16:07:15.931780 | TASK [upload-logs : Upload logs to log server] 2026-02-24 16:07:17.487918 | logserver.rdoproject.org | Output suppressed because no_log was given 2026-02-24 16:07:17.490608 | 2026-02-24 16:07:17.490672 | LOOP [upload-logs : Compress console log and json output] 2026-02-24 16:07:17.528727 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 16:07:17.537511 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 16:07:17.546976 | 2026-02-24 16:07:17.547043 | LOOP [upload-logs : Upload compressed console log and json output] 2026-02-24 16:07:17.579768 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 16:07:17.580052 | 2026-02-24 16:07:17.583224 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 16:07:17.594438 | 2026-02-24 16:07:17.594512 | LOOP [upload-logs : Upload console log and json output]